2024-03-19T06:04:54.933 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-19T06:04:54.933 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/pool-perm} --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674 --verbose -- /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674/orig.config.yaml 2024-03-19T06:04:54.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T06:04:55.064 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674 branch: wip-vshankar-testing-20240307.022905 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/pool-perm} email: vshankar@redhat.com first_in_suite: false job_id: '7610674' kernel: flavor: default kdb: true sha1: 908b6b276e8f14e16032b32a9770077cd37b6bd4 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20240307.022905 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240307.022905 sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6045 sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f sleep_before_teardown: 0 subset: 832/1024 suite: fs suite_branch: wip-vshankar-testing-20240307.022905 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi032.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHK9D/Y/H040981xY6SRILI9PlrGvBdT45cqKN9ms4MWqoJxDItCeKGfnYVMK2YLr60XQgtwZy69sOwvE0FBczs= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGAmXfjV+X+ZH5sgNguN6cRoHoYI4pszUisZKBbkrDTITM2/5G8zzZ2HpMijH9SO7rvKJL3a8Y2mZDaJjGxxkLM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-19_04:59:54 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-19T06:04:55.064 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa; will attempt to use it 2024-03-19T06:04:55.065 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks 2024-03-19T06:04:55.065 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-19T06:04:55.067 INFO:teuthology.task.internal:Checking packages... 2024-03-19T06:04:55.089 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f' 2024-03-19T06:04:55.089 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-19T06:04:55.089 INFO:teuthology.packaging:ref: None 2024-03-19T06:04:55.089 INFO:teuthology.packaging:tag: None 2024-03-19T06:04:55.089 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240307.022905 2024-03-19T06:04:55.089 INFO:teuthology.packaging:sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:04:55.090 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20240307.022905 2024-03-19T06:04:55.226 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1934-gb0ea271b-1jammy 2024-03-19T06:04:55.228 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-19T06:04:55.235 INFO:teuthology.task.internal:no buildpackages task found 2024-03-19T06:04:55.235 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-19T06:04:55.243 INFO:teuthology.task.internal:Saving configuration 2024-03-19T06:04:55.259 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-19T06:04:55.267 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-19T06:04:55.294 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-19 05:58:52.323850', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJDBjbLbPn5DEGIAFklWpSSXhPD/Ti8FOCgZgCKxwX3A'} 2024-03-19T06:04:55.314 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-19 05:58:52.325181', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGfjLBgq6Gg1MP+WLSRTc2DK3Qz+t64UTKN1PV+8G6IP'} 2024-03-19T06:04:55.315 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-19T06:04:55.322 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-19T06:04:55.322 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-19T06:04:55.323 INFO:teuthology.run_tasks:Running task console_log... 2024-03-19T06:04:55.393 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8e514a64c0>, signals=[15]) 2024-03-19T06:04:55.394 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-19T06:04:55.401 INFO:teuthology.task.internal:Opening connections... 2024-03-19T06:04:55.401 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:04:55.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T06:04:55.490 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:04:55.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T06:04:55.566 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-19T06:04:55.574 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2024-03-19T06:04:55.580 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2024-03-19T06:04:55.580 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-03-19T06:04:55.626 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-19T06:04:55.627 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2024-03-19T06:04:55.627 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="22.04" 2024-03-19T06:04:55.627 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-19T06:04:55.627 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=jammy 2024-03-19T06:04:55.627 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2024-03-19T06:04:55.627 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2024-03-19T06:04:55.627 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-19T06:04:55.627 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-19T06:04:55.627 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-19T06:04:55.627 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-19T06:04:55.627 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=jammy 2024-03-19T06:04:55.628 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-03-19T06:04:55.664 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-03-19T06:04:55.669 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-03-19T06:04:55.669 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-03-19T06:04:55.718 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-19T06:04:55.718 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Ubuntu" 2024-03-19T06:04:55.718 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="22.04" 2024-03-19T06:04:55.718 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-19T06:04:55.718 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_CODENAME=jammy 2024-03-19T06:04:55.718 INFO:teuthology.orchestra.run.smithi171.stdout:ID=ubuntu 2024-03-19T06:04:55.718 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE=debian 2024-03-19T06:04:55.718 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-19T06:04:55.718 INFO:teuthology.orchestra.run.smithi171.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-19T06:04:55.718 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-19T06:04:55.718 INFO:teuthology.orchestra.run.smithi171.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-19T06:04:55.718 INFO:teuthology.orchestra.run.smithi171.stdout:UBUNTU_CODENAME=jammy 2024-03-19T06:04:55.719 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-03-19T06:04:55.747 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-19T06:04:55.757 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-19T06:04:55.768 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-19T06:04:55.768 DEBUG:teuthology.orchestra.run.smithi032:> test '!' -e /home/ubuntu/cephtest 2024-03-19T06:04:55.771 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-03-19T06:04:55.775 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-19T06:04:55.782 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-19T06:04:55.782 DEBUG:teuthology.orchestra.run.smithi032:> test -z $(ls -A /var/lib/ceph) 2024-03-19T06:04:55.817 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-03-19T06:04:55.830 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-19T06:04:55.889 INFO:teuthology.run_tasks:Running task kernel... 2024-03-19T06:04:55.908 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '908b6b276e8f14e16032b32a9770077cd37b6bd4'} 2024-03-19T06:04:55.908 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '908b6b276e8f14e16032b32a9770077cd37b6bd4'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '908b6b276e8f14e16032b32a9770077cd37b6bd4'}}, timeout 300 2024-03-19T06:04:55.908 DEBUG:teuthology.orchestra.run.smithi032:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-19T06:04:55.909 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-19T06:04:55.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:04:55.914 DEBUG:teuthology.task.kernel:sha1 for mon.a is 908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T06:04:55.914 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "908b6b276e8f14e16032b32a9770077cd37b6bd4"... 2024-03-19T06:04:55.914 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-03-19T06:04:55.915 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:04:55.915 DEBUG:teuthology.task.kernel:sha1 for mon.b is 908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T06:04:55.915 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "908b6b276e8f14e16032b32a9770077cd37b6bd4"... 2024-03-19T06:04:55.915 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-03-19T06:04:55.960 INFO:teuthology.orchestra.run.smithi032.stdout:5.15.0-56-generic 2024-03-19T06:04:55.960 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T06:04:55.960 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-19T06:04:55.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T06:04:55.964 INFO:teuthology.orchestra.run.smithi171.stdout:5.15.0-56-generic 2024-03-19T06:04:55.964 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T06:04:55.964 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-19T06:04:55.965 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T06:04:56.109 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2024-03-19T06:04:56.110 DEBUG:teuthology.orchestra.run.smithi032:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-03-19T06:04:56.111 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2024-03-19T06:04:56.111 DEBUG:teuthology.orchestra.run.smithi171:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-03-19T06:04:56.135 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-03-19T06:04:56.136 INFO:teuthology.orchestra.run.smithi032.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-03-19T06:04:56.250 INFO:teuthology.orchestra.run.smithi032.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-03-19T06:04:56.250 INFO:teuthology.orchestra.run.smithi032.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-03-19T06:04:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-03-19T06:04:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:hint: 2024-03-19T06:04:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:hint: git config --global init.defaultBranch 2024-03-19T06:04:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:hint: 2024-03-19T06:04:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-03-19T06:04:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-03-19T06:04:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:hint: 2024-03-19T06:04:56.251 INFO:teuthology.orchestra.run.smithi032.stderr:hint: git branch -m 2024-03-19T06:04:56.251 INFO:teuthology.orchestra.run.smithi032.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-03-19T06:04:56.253 DEBUG:teuthology.orchestra.run.smithi032:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-03-19T06:04:56.268 INFO:teuthology.orchestra.run.smithi171.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-03-19T06:04:56.268 INFO:teuthology.orchestra.run.smithi171.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-03-19T06:04:56.268 INFO:teuthology.orchestra.run.smithi171.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-03-19T06:04:56.268 INFO:teuthology.orchestra.run.smithi171.stderr:hint: 2024-03-19T06:04:56.268 INFO:teuthology.orchestra.run.smithi171.stderr:hint: git config --global init.defaultBranch 2024-03-19T06:04:56.268 INFO:teuthology.orchestra.run.smithi171.stderr:hint: 2024-03-19T06:04:56.268 INFO:teuthology.orchestra.run.smithi171.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-03-19T06:04:56.268 INFO:teuthology.orchestra.run.smithi171.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-03-19T06:04:56.269 INFO:teuthology.orchestra.run.smithi171.stderr:hint: 2024-03-19T06:04:56.269 INFO:teuthology.orchestra.run.smithi171.stderr:hint: git branch -m 2024-03-19T06:04:56.269 INFO:teuthology.orchestra.run.smithi171.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-03-19T06:04:56.272 DEBUG:teuthology.orchestra.run.smithi171:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-03-19T06:04:56.321 DEBUG:teuthology.orchestra.run.smithi032:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-03-19T06:04:56.340 DEBUG:teuthology.orchestra.run.smithi171:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-03-19T06:04:56.377 DEBUG:teuthology.orchestra.run.smithi032:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-03-19T06:04:56.394 DEBUG:teuthology.orchestra.run.smithi171:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-03-19T06:06:00.826 INFO:teuthology.orchestra.run.smithi171.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-03-19T06:06:00.827 INFO:teuthology.orchestra.run.smithi171.stderr: * [new branch] main -> origin/main 2024-03-19T06:06:00.827 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20240312 -> 20240312 2024-03-19T06:06:00.859 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20190312 -> 20190312 2024-03-19T06:06:00.859 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20190416 -> 20190416 2024-03-19T06:06:00.859 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20190514 -> 20190514 2024-03-19T06:06:00.859 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20190618 -> 20190618 2024-03-19T06:06:00.860 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20190717 -> 20190717 2024-03-19T06:06:00.860 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20190815 -> 20190815 2024-03-19T06:06:00.860 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20190923 -> 20190923 2024-03-19T06:06:00.860 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20191022 -> 20191022 2024-03-19T06:06:00.860 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20191215 -> 20191215 2024-03-19T06:06:00.861 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20200122 -> 20200122 2024-03-19T06:06:00.862 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20200316 -> 20200316 2024-03-19T06:06:00.862 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20200421 -> 20200421 2024-03-19T06:06:00.862 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20200519 -> 20200519 2024-03-19T06:06:00.862 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20200619 -> 20200619 2024-03-19T06:06:00.862 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20200721 -> 20200721 2024-03-19T06:06:00.862 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20200817 -> 20200817 2024-03-19T06:06:00.862 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20200918 -> 20200918 2024-03-19T06:06:00.862 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20201022 -> 20201022 2024-03-19T06:06:00.862 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20201118 -> 20201118 2024-03-19T06:06:00.862 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20201218 -> 20201218 2024-03-19T06:06:00.862 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20210208 -> 20210208 2024-03-19T06:06:00.862 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20210315 -> 20210315 2024-03-19T06:06:00.862 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20210511 -> 20210511 2024-03-19T06:06:00.862 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20210716 -> 20210716 2024-03-19T06:06:00.865 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20210818 -> 20210818 2024-03-19T06:06:00.865 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20210919 -> 20210919 2024-03-19T06:06:00.865 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20211027 -> 20211027 2024-03-19T06:06:00.865 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20211216 -> 20211216 2024-03-19T06:06:00.865 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20220209 -> 20220209 2024-03-19T06:06:00.865 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20220310 -> 20220310 2024-03-19T06:06:00.865 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20220411 -> 20220411 2024-03-19T06:06:00.865 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20220509 -> 20220509 2024-03-19T06:06:00.865 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20220610 -> 20220610 2024-03-19T06:06:00.866 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20220708 -> 20220708 2024-03-19T06:06:00.866 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20220815 -> 20220815 2024-03-19T06:06:00.866 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20220913 -> 20220913 2024-03-19T06:06:00.866 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20221012 -> 20221012 2024-03-19T06:06:00.866 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20221109 -> 20221109 2024-03-19T06:06:00.866 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20221214 -> 20221214 2024-03-19T06:06:00.866 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20230117 -> 20230117 2024-03-19T06:06:00.866 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20230210 -> 20230210 2024-03-19T06:06:00.866 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20230310 -> 20230310 2024-03-19T06:06:00.866 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20230404 -> 20230404 2024-03-19T06:06:00.866 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20230515 -> 20230515 2024-03-19T06:06:00.866 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20230625 -> 20230625 2024-03-19T06:06:00.866 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20230804 -> 20230804 2024-03-19T06:06:00.866 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20230919 -> 20230919 2024-03-19T06:06:00.867 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20231030 -> 20231030 2024-03-19T06:06:00.867 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20231111 -> 20231111 2024-03-19T06:06:00.867 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20231211 -> 20231211 2024-03-19T06:06:00.867 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20240115 -> 20240115 2024-03-19T06:06:00.867 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20240220 -> 20240220 2024-03-19T06:06:05.042 INFO:teuthology.orchestra.run.smithi171.stderr:Updating files: 51% (1825/3573) Updating files: 52% (1858/3573) Updating files: 53% (1894/3573) Updating files: 54% (1930/3573) Updating files: 55% (1966/3573) Updating files: 56% (2001/3573) Updating files: 57% (2037/3573) Updating files: 58% (2073/3573) Updating files: 59% (2109/3573) Updating files: 60% (2144/3573) Updating files: 61% (2180/3573) Updating files: 62% (2216/3573) Updating files: 63% (2251/3573) Updating files: 64% (2287/3573) Updating files: 64% (2302/3573) Updating files: 65% (2323/3573) Updating files: 66% (2359/3573) Updating files: 67% (2394/3573) Updating files: 68% (2430/3573) Updating files: 69% (2466/3573) Updating files: 70% (2502/3573) Updating files: 71% (2537/3573) Updating files: 72% (2573/3573) Updating files: 73% (2609/3573) Updating files: 74% (2645/3573) Updating files: 75% (2680/3573) Updating files: 76% (2716/3573) Updating files: 77% (2752/3573) Updating files: 77% (2760/3573) Updating files: 78% (2787/3573) Updating files: 79% (2823/3573) Updating files: 80% (2859/3573) Updating files: 81% (2895/3573) Updating files: 82% (2930/3573) Updating files: 83% (2966/3573) Updating files: 84% (3002/3573) Updating files: 85% (3038/3573) Updating files: 86% (3073/3573) Updating files: 87% (3109/3573) Updating files: 88% (3145/3573) Updating files: 89% (3180/3573) Updating files: 90% (3216/3573) Updating files: 90% (3244/3573) Updating files: 91% (3252/3573) Updating files: 92% (3288/3573) Updating files: 93% (3323/3573) Updating files: 94% (3359/3573) Updating files: 95% (3395/3573) Updating files: 96% (3431/3573) Updating files: 97% (3466/3573) Updating files: 98% (3502/3573) Updating files: 99% (3538/3573) Updating files: 100% (3573/3573) Updating files: 100% (3573/3573), done. 2024-03-19T06:06:05.047 INFO:teuthology.orchestra.run.smithi171.stdout:HEAD is now at 3b128b60 Merge branch 'mt7921-bt' into 'main' 2024-03-19T06:06:05.068 INFO:teuthology.task.kernel:Downloading kernel 908b6b276e8f14e16032b32a9770077cd37b6bd4 on mon.b... 2024-03-19T06:06:05.068 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T06:06:05.215 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g908b6b276e8f/ 2024-03-19T06:06:05.215 DEBUG:teuthology.orchestra.run.smithi171:> rm -f /tmp/linux-image.deb && echo linux-image-6.8.0-g908b6b276e8f_6.8.0-g908b6b276e8f-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g908b6b276e8f/ --input-file=- 2024-03-19T06:06:05.218 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi171.front.sepia.ceph.com to complete... 2024-03-19T06:06:05.476 INFO:teuthology.orchestra.run.smithi032.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-03-19T06:06:05.476 INFO:teuthology.orchestra.run.smithi032.stderr: * [new branch] main -> origin/main 2024-03-19T06:06:05.476 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20240312 -> 20240312 2024-03-19T06:06:05.511 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190312 -> 20190312 2024-03-19T06:06:05.512 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190416 -> 20190416 2024-03-19T06:06:05.512 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190514 -> 20190514 2024-03-19T06:06:05.512 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190618 -> 20190618 2024-03-19T06:06:05.512 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190717 -> 20190717 2024-03-19T06:06:05.512 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190815 -> 20190815 2024-03-19T06:06:05.512 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190923 -> 20190923 2024-03-19T06:06:05.512 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20191022 -> 20191022 2024-03-19T06:06:05.512 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20191215 -> 20191215 2024-03-19T06:06:05.512 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200122 -> 20200122 2024-03-19T06:06:05.518 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200316 -> 20200316 2024-03-19T06:06:05.518 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200421 -> 20200421 2024-03-19T06:06:05.518 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200519 -> 20200519 2024-03-19T06:06:05.518 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200619 -> 20200619 2024-03-19T06:06:05.518 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200721 -> 20200721 2024-03-19T06:06:05.518 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200817 -> 20200817 2024-03-19T06:06:05.518 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200918 -> 20200918 2024-03-19T06:06:05.518 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20201022 -> 20201022 2024-03-19T06:06:05.518 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20201118 -> 20201118 2024-03-19T06:06:05.518 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20201218 -> 20201218 2024-03-19T06:06:05.518 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210208 -> 20210208 2024-03-19T06:06:05.518 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210315 -> 20210315 2024-03-19T06:06:05.519 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210511 -> 20210511 2024-03-19T06:06:05.519 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210716 -> 20210716 2024-03-19T06:06:05.519 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210818 -> 20210818 2024-03-19T06:06:05.519 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210919 -> 20210919 2024-03-19T06:06:05.519 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20211027 -> 20211027 2024-03-19T06:06:05.519 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20211216 -> 20211216 2024-03-19T06:06:05.519 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220209 -> 20220209 2024-03-19T06:06:05.519 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220310 -> 20220310 2024-03-19T06:06:05.519 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220411 -> 20220411 2024-03-19T06:06:05.519 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220509 -> 20220509 2024-03-19T06:06:05.519 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220610 -> 20220610 2024-03-19T06:06:05.519 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220708 -> 20220708 2024-03-19T06:06:05.519 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220815 -> 20220815 2024-03-19T06:06:05.519 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220913 -> 20220913 2024-03-19T06:06:05.519 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20221012 -> 20221012 2024-03-19T06:06:05.519 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20221109 -> 20221109 2024-03-19T06:06:05.520 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20221214 -> 20221214 2024-03-19T06:06:05.520 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230117 -> 20230117 2024-03-19T06:06:05.520 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230210 -> 20230210 2024-03-19T06:06:05.520 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230310 -> 20230310 2024-03-19T06:06:05.520 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230404 -> 20230404 2024-03-19T06:06:05.520 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230515 -> 20230515 2024-03-19T06:06:05.520 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230625 -> 20230625 2024-03-19T06:06:05.520 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230804 -> 20230804 2024-03-19T06:06:05.520 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230919 -> 20230919 2024-03-19T06:06:05.520 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20231030 -> 20231030 2024-03-19T06:06:05.520 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20231111 -> 20231111 2024-03-19T06:06:05.520 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20231211 -> 20231211 2024-03-19T06:06:05.520 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20240115 -> 20240115 2024-03-19T06:06:05.520 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20240220 -> 20240220 2024-03-19T06:06:07.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19 06:06:06 URL:https://3.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g908b6b276e8f/linux-image-6.8.0-g908b6b276e8f_6.8.0-g908b6b276e8f-1_amd64.deb [39270872/39270872] -> "/tmp/linux-image.deb" [1] 2024-03-19T06:06:07.038 INFO:teuthology.orchestra.run.smithi171.stderr:FINISHED --2024-03-19 06:06:06-- 2024-03-19T06:06:07.038 INFO:teuthology.orchestra.run.smithi171.stderr:Total wall clock time: 1.7s 2024-03-19T06:06:07.039 INFO:teuthology.orchestra.run.smithi171.stderr:Downloaded: 1 files, 37M in 1.5s (24.6 MB/s) 2024-03-19T06:06:07.043 INFO:teuthology.task.kernel:Installing kernel 908b6b276e8f14e16032b32a9770077cd37b6bd4 on mon.b... 2024-03-19T06:06:07.043 DEBUG:teuthology.orchestra.run.smithi171:> sudo dpkg -i /tmp/linux-image.deb 2024-03-19T06:06:07.303 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-image-6.8.0-g908b6b276e8f. 2024-03-19T06:06:09.336 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-03-19T06:06:09.340 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-03-19T06:06:09.481 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-image-6.8.0-g908b6b276e8f (6.8.0-g908b6b276e8f-1) ... 2024-03-19T06:06:09.932 INFO:teuthology.orchestra.run.smithi032.stderr:Updating files: 48% (1732/3573) Updating files: 49% (1751/3573) Updating files: 50% (1787/3573) Updating files: 51% (1823/3573) Updating files: 52% (1858/3573) Updating files: 53% (1894/3573) Updating files: 54% (1930/3573) Updating files: 55% (1966/3573) Updating files: 56% (2001/3573) Updating files: 57% (2037/3573) Updating files: 58% (2073/3573) Updating files: 59% (2109/3573) Updating files: 60% (2144/3573) Updating files: 61% (2180/3573) Updating files: 61% (2201/3573) Updating files: 62% (2216/3573) Updating files: 63% (2251/3573) Updating files: 64% (2287/3573) Updating files: 65% (2323/3573) Updating files: 66% (2359/3573) Updating files: 67% (2394/3573) Updating files: 68% (2430/3573) Updating files: 69% (2466/3573) Updating files: 70% (2502/3573) Updating files: 71% (2537/3573) Updating files: 71% (2555/3573) Updating files: 72% (2573/3573) Updating files: 73% (2609/3573) Updating files: 74% (2645/3573) Updating files: 75% (2680/3573) Updating files: 76% (2716/3573) Updating files: 77% (2752/3573) Updating files: 78% (2787/3573) Updating files: 79% (2823/3573) Updating files: 80% (2859/3573) Updating files: 81% (2895/3573) Updating files: 82% (2930/3573) Updating files: 83% (2966/3573) Updating files: 83% (2983/3573) Updating files: 84% (3002/3573) Updating files: 85% (3038/3573) Updating files: 86% (3073/3573) Updating files: 87% (3109/3573) Updating files: 88% (3145/3573) Updating files: 89% (3180/3573) Updating files: 90% (3216/3573) Updating files: 91% (3252/3573) Updating files: 92% (3288/3573) Updating files: 93% (3323/3573) Updating files: 94% (3359/3573) Updating files: 95% (3395/3573) Updating files: 96% (3431/3573) Updating files: 97% (3466/3573) Updating files: 98% (3502/3573) Updating files: 99% (3538/3573) Updating files: 100% (3573/3573) Updating files: 100% (3573/3573), done. 2024-03-19T06:06:09.937 INFO:teuthology.orchestra.run.smithi032.stdout:HEAD is now at 3b128b60 Merge branch 'mt7921-bt' into 'main' 2024-03-19T06:06:09.959 INFO:teuthology.task.kernel:Downloading kernel 908b6b276e8f14e16032b32a9770077cd37b6bd4 on mon.a... 2024-03-19T06:06:09.959 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T06:06:10.107 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g908b6b276e8f/ 2024-03-19T06:06:10.108 DEBUG:teuthology.orchestra.run.smithi032:> rm -f /tmp/linux-image.deb && echo linux-image-6.8.0-g908b6b276e8f_6.8.0-g908b6b276e8f-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g908b6b276e8f/ --input-file=- 2024-03-19T06:06:10.110 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi032.front.sepia.ceph.com to complete... 2024-03-19T06:06:11.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19 06:06:11 URL:https://3.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g908b6b276e8f/linux-image-6.8.0-g908b6b276e8f_6.8.0-g908b6b276e8f-1_amd64.deb [39270872/39270872] -> "/tmp/linux-image.deb" [1] 2024-03-19T06:06:11.812 INFO:teuthology.orchestra.run.smithi032.stderr:FINISHED --2024-03-19 06:06:11-- 2024-03-19T06:06:11.812 INFO:teuthology.orchestra.run.smithi032.stderr:Total wall clock time: 1.7s 2024-03-19T06:06:11.812 INFO:teuthology.orchestra.run.smithi032.stderr:Downloaded: 1 files, 37M in 1.5s (25.5 MB/s) 2024-03-19T06:06:11.817 INFO:teuthology.task.kernel:Installing kernel 908b6b276e8f14e16032b32a9770077cd37b6bd4 on mon.a... 2024-03-19T06:06:11.817 DEBUG:teuthology.orchestra.run.smithi032:> sudo dpkg -i /tmp/linux-image.deb 2024-03-19T06:06:12.072 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-image-6.8.0-g908b6b276e8f. 2024-03-19T06:06:12.583 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-image-6.8.0-g908b6b276e8f (6.8.0-g908b6b276e8f-1) ... 2024-03-19T06:06:12.684 INFO:teuthology.orchestra.run.smithi171.stderr:update-initramfs: Generating /boot/initrd.img-6.8.0-g908b6b276e8f 2024-03-19T06:06:14.071 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-03-19T06:06:14.075 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-03-19T06:06:14.258 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-image-6.8.0-g908b6b276e8f (6.8.0-g908b6b276e8f-1) ... 2024-03-19T06:06:17.561 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-image-6.8.0-g908b6b276e8f (6.8.0-g908b6b276e8f-1) ... 2024-03-19T06:06:17.661 INFO:teuthology.orchestra.run.smithi032.stderr:update-initramfs: Generating /boot/initrd.img-6.8.0-g908b6b276e8f 2024-03-19T06:06:33.319 INFO:teuthology.orchestra.run.smithi171.stderr:Sourcing file `/etc/default/grub' 2024-03-19T06:06:33.334 INFO:teuthology.orchestra.run.smithi171.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-19T06:06:33.377 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ... 2024-03-19T06:06:33.660 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-6.8.0-g908b6b276e8f 2024-03-19T06:06:33.679 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-6.8.0-g908b6b276e8f 2024-03-19T06:06:33.996 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-19T06:06:34.010 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-19T06:06:34.079 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-19T06:06:34.085 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-19T06:06:34.270 INFO:teuthology.orchestra.run.smithi171.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-19T06:06:34.270 INFO:teuthology.orchestra.run.smithi171.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-19T06:06:34.270 INFO:teuthology.orchestra.run.smithi171.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-19T06:06:34.310 INFO:teuthology.orchestra.run.smithi171.stderr:done 2024-03-19T06:06:34.467 DEBUG:teuthology.orchestra.run.smithi171:> dpkg-deb -c /tmp/linux-image.deb 2024-03-19T06:06:34.475 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./ 2024-03-19T06:06:34.475 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./boot/ 2024-03-19T06:06:34.475 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 4474370 2024-03-19 02:25 ./boot/System.map-6.8.0-g908b6b276e8f 2024-03-19T06:06:34.485 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 170904 2024-03-19 02:25 ./boot/config-6.8.0-g908b6b276e8f 2024-03-19T06:06:34.485 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11555840 2024-03-19 02:25 ./boot/vmlinuz-6.8.0-g908b6b276e8f 2024-03-19T06:06:34.503 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./etc/ 2024-03-19T06:06:34.503 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./etc/kernel/ 2024-03-19T06:06:34.503 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./etc/kernel/postinst.d/ 2024-03-19T06:06:34.503 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./etc/kernel/postrm.d/ 2024-03-19T06:06:34.503 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./etc/kernel/preinst.d/ 2024-03-19T06:06:34.503 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./etc/kernel/prerm.d/ 2024-03-19T06:06:34.503 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/ 2024-03-19T06:06:34.503 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/ 2024-03-19T06:06:34.503 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/ 2024-03-19T06:06:34.503 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/ 2024-03-19T06:06:34.504 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/ 2024-03-19T06:06:34.504 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/ 2024-03-19T06:06:34.504 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/ 2024-03-19T06:06:34.504 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 490449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/aesni-intel.ko 2024-03-19T06:06:34.506 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-19T06:06:34.506 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-19T06:06:34.506 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-19T06:06:34.506 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 93081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-19T06:06:34.506 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 106697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-19T06:06:34.506 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 152145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-19T06:06:34.506 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-19T06:06:34.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-19T06:06:34.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 83857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-19T06:06:34.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-19T06:06:34.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-19T06:06:34.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-19T06:06:34.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-19T06:06:34.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-19T06:06:34.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-19T06:06:34.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 58489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-19T06:06:34.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-19T06:06:34.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-19T06:06:34.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-19T06:06:34.507 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/ 2024-03-19T06:06:34.507 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu/ 2024-03-19T06:06:34.507 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu/mce/ 2024-03-19T06:06:34.508 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-19T06:06:34.508 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpuid.ko 2024-03-19T06:06:34.508 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/msr.ko 2024-03-19T06:06:34.508 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/ 2024-03-19T06:06:34.508 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 354265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-19T06:06:34.508 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 886177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-19T06:06:34.508 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 2294937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm.ko 2024-03-19T06:06:34.524 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/ 2024-03-19T06:06:34.524 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/af_alg.ko 2024-03-19T06:06:34.524 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/algif_hash.ko 2024-03-19T06:06:34.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/algif_skcipher.ko 2024-03-19T06:06:34.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/ansi_cprng.ko 2024-03-19T06:06:34.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/anubis.ko 2024-03-19T06:06:34.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/arc4.ko 2024-03-19T06:06:34.525 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/asymmetric_keys/ 2024-03-19T06:06:34.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-03-19T06:06:34.525 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/ 2024-03-19T06:06:34.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_memcpy.ko 2024-03-19T06:06:34.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_pq.ko 2024-03-19T06:06:34.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-19T06:06:34.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_tx.ko 2024-03-19T06:06:34.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_xor.ko 2024-03-19T06:06:34.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/raid6test.ko 2024-03-19T06:06:34.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/authenc.ko 2024-03-19T06:06:34.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/authencesn.ko 2024-03-19T06:06:34.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blake2b_generic.ko 2024-03-19T06:06:34.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blowfish_common.ko 2024-03-19T06:06:34.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blowfish_generic.ko 2024-03-19T06:06:34.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/camellia_generic.ko 2024-03-19T06:06:34.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast5_generic.ko 2024-03-19T06:06:34.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast6_generic.ko 2024-03-19T06:06:34.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast_common.ko 2024-03-19T06:06:34.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/ccm.ko 2024-03-19T06:06:34.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cmac.ko 2024-03-19T06:06:34.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crc32_generic.ko 2024-03-19T06:06:34.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cryptd.ko 2024-03-19T06:06:34.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crypto_engine.ko 2024-03-19T06:06:34.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crypto_simd.ko 2024-03-19T06:06:34.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crypto_user.ko 2024-03-19T06:06:34.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cts.ko 2024-03-19T06:06:34.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/des_generic.ko 2024-03-19T06:06:34.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/dh_generic.ko 2024-03-19T06:06:34.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/echainiv.ko 2024-03-19T06:06:34.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/essiv.ko 2024-03-19T06:06:34.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/fcrypt.ko 2024-03-19T06:06:34.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/khazad.ko 2024-03-19T06:06:34.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/lrw.ko 2024-03-19T06:06:34.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/lz4.ko 2024-03-19T06:06:34.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/lz4hc.ko 2024-03-19T06:06:34.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/md4.ko 2024-03-19T06:06:34.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/michael_mic.ko 2024-03-19T06:06:34.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/pcbc.ko 2024-03-19T06:06:34.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/pcrypt.ko 2024-03-19T06:06:34.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/rmd160.ko 2024-03-19T06:06:34.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/seed.ko 2024-03-19T06:06:34.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/serpent_generic.ko 2024-03-19T06:06:34.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 143033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/tcrypt.ko 2024-03-19T06:06:34.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/tea.ko 2024-03-19T06:06:34.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/twofish_common.ko 2024-03-19T06:06:34.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/twofish_generic.ko 2024-03-19T06:06:34.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/vmac.ko 2024-03-19T06:06:34.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/wp512.ko 2024-03-19T06:06:34.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xcbc.ko 2024-03-19T06:06:34.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xor.ko 2024-03-19T06:06:34.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xts.ko 2024-03-19T06:06:34.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xxhash_generic.ko 2024-03-19T06:06:34.528 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ 2024-03-19T06:06:34.528 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/ 2024-03-19T06:06:34.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/acpi_extlog.ko 2024-03-19T06:06:34.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-19T06:06:34.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/acpi_pad.ko 2024-03-19T06:06:34.529 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/apei/ 2024-03-19T06:06:34.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/apei/einj.ko 2024-03-19T06:06:34.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/ec_sys.ko 2024-03-19T06:06:34.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/platform_profile.ko 2024-03-19T06:06:34.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/sbs.ko 2024-03-19T06:06:34.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/sbshc.ko 2024-03-19T06:06:34.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 104433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/video.ko 2024-03-19T06:06:34.529 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/ 2024-03-19T06:06:34.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/acard-ahci.ko 2024-03-19T06:06:34.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 89937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/ahci.ko 2024-03-19T06:06:34.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/ahci_platform.ko 2024-03-19T06:06:34.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 88313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/libahci.ko 2024-03-19T06:06:34.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/libahci_platform.ko 2024-03-19T06:06:34.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_acpi.ko 2024-03-19T06:06:34.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ali.ko 2024-03-19T06:06:34.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_amd.ko 2024-03-19T06:06:34.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_artop.ko 2024-03-19T06:06:34.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_atiixp.ko 2024-03-19T06:06:34.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_atp867x.ko 2024-03-19T06:06:34.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cmd640.ko 2024-03-19T06:06:34.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cmd64x.ko 2024-03-19T06:06:34.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cypress.ko 2024-03-19T06:06:34.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_efar.ko 2024-03-19T06:06:34.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt366.ko 2024-03-19T06:06:34.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt37x.ko 2024-03-19T06:06:34.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-19T06:06:34.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-19T06:06:34.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_it8213.ko 2024-03-19T06:06:34.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_it821x.ko 2024-03-19T06:06:34.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_jmicron.ko 2024-03-19T06:06:34.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 52177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_legacy.ko 2024-03-19T06:06:34.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_marvell.ko 2024-03-19T06:06:34.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_mpiix.ko 2024-03-19T06:06:34.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_netcell.ko 2024-03-19T06:06:34.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ninja32.ko 2024-03-19T06:06:34.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ns87410.ko 2024-03-19T06:06:34.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ns87415.ko 2024-03-19T06:06:34.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_oldpiix.ko 2024-03-19T06:06:34.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_opti.ko 2024-03-19T06:06:34.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_optidma.ko 2024-03-19T06:06:34.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pcmcia.ko 2024-03-19T06:06:34.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-19T06:06:34.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-19T06:06:34.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_piccolo.ko 2024-03-19T06:06:34.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_radisys.ko 2024-03-19T06:06:34.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_rdc.ko 2024-03-19T06:06:34.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_rz1000.ko 2024-03-19T06:06:34.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sch.ko 2024-03-19T06:06:34.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_serverworks.ko 2024-03-19T06:06:34.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sil680.ko 2024-03-19T06:06:34.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sl82c105.ko 2024-03-19T06:06:34.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_triflex.ko 2024-03-19T06:06:34.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_via.ko 2024-03-19T06:06:34.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pdc_adma.ko 2024-03-19T06:06:34.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_inic162x.ko 2024-03-19T06:06:34.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 83257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_mv.ko 2024-03-19T06:06:34.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_nv.ko 2024-03-19T06:06:34.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_promise.ko 2024-03-19T06:06:34.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_qstor.ko 2024-03-19T06:06:34.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sil.ko 2024-03-19T06:06:34.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sil24.ko 2024-03-19T06:06:34.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sis.ko 2024-03-19T06:06:34.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_svw.ko 2024-03-19T06:06:34.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sx4.ko 2024-03-19T06:06:34.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_uli.ko 2024-03-19T06:06:34.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_via.ko 2024-03-19T06:06:34.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_vsc.ko 2024-03-19T06:06:34.533 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/auxdisplay/ 2024-03-19T06:06:34.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/auxdisplay/ks0108.ko 2024-03-19T06:06:34.533 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/bcma/ 2024-03-19T06:06:34.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 124457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/bcma/bcma.ko 2024-03-19T06:06:34.533 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/ 2024-03-19T06:06:34.533 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/aoe/ 2024-03-19T06:06:34.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 113833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/aoe/aoe.ko 2024-03-19T06:06:34.534 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/drbd/ 2024-03-19T06:06:34.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 964817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/drbd/drbd.ko 2024-03-19T06:06:34.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 169705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/floppy.ko 2024-03-19T06:06:34.534 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/mtip32xx/ 2024-03-19T06:06:34.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 94217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-19T06:06:34.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 116337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/nbd.ko 2024-03-19T06:06:34.534 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/null_blk/ 2024-03-19T06:06:34.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 110329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/null_blk/null_blk.ko 2024-03-19T06:06:34.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 98193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/pktcdvd.ko 2024-03-19T06:06:34.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 263641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/rbd.ko 2024-03-19T06:06:34.534 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/xen-blkback/ 2024-03-19T06:06:34.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 98121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-19T06:06:34.534 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/zram/ 2024-03-19T06:06:34.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 58777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/zram/zram.ko 2024-03-19T06:06:34.535 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ 2024-03-19T06:06:34.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/applicom.ko 2024-03-19T06:06:34.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hangcheck-timer.ko 2024-03-19T06:06:34.535 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/ 2024-03-19T06:06:34.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-19T06:06:34.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-19T06:06:34.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-19T06:06:34.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/via-rng.ko 2024-03-19T06:06:34.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-19T06:06:34.535 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ 2024-03-19T06:06:34.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-19T06:06:34.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 148521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-19T06:06:34.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-19T06:06:34.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 139361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-19T06:06:34.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-19T06:06:34.536 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-19T06:06:34.536 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/lp.ko 2024-03-19T06:06:34.536 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/mwave/ 2024-03-19T06:06:34.536 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 84025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/mwave/mwave.ko 2024-03-19T06:06:34.536 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/nvram.ko 2024-03-19T06:06:34.536 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ppdev.ko 2024-03-19T06:06:34.536 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tlclk.ko 2024-03-19T06:06:34.536 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/ 2024-03-19T06:06:34.536 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-19T06:06:34.536 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-03-19T06:06:34.536 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-03-19T06:06:34.536 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-03-19T06:06:34.536 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-19T06:06:34.536 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-19T06:06:34.537 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23465 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-03-19T06:06:34.537 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/xillybus/ 2024-03-19T06:06:34.537 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/xillybus/xillybus_class.ko 2024-03-19T06:06:34.537 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/xillybus/xillybus_core.ko 2024-03-19T06:06:34.537 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-03-19T06:06:34.537 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/clk/ 2024-03-19T06:06:34.537 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/clk/clk-palmas.ko 2024-03-19T06:06:34.537 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/clk/clk-si5351.ko 2024-03-19T06:06:34.537 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/clk/clk-twl6040.ko 2024-03-19T06:06:34.537 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/clk/clk-wm831x.ko 2024-03-19T06:06:34.537 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/ 2024-03-19T06:06:34.537 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-19T06:06:34.537 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-19T06:06:34.537 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-19T06:06:34.537 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ 2024-03-19T06:06:34.538 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp/ 2024-03-19T06:06:34.538 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-19T06:06:34.538 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 246841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp/ccp.ko 2024-03-19T06:06:34.538 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/ 2024-03-19T06:06:34.538 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/ 2024-03-19T06:06:34.538 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_common/ 2024-03-19T06:06:34.538 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 570497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-19T06:06:34.692 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-03-19T06:06:34.692 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-19T06:06:34.692 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/padlock-aes.ko 2024-03-19T06:06:34.692 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/padlock-sha.ko 2024-03-19T06:06:34.692 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/virtio/ 2024-03-19T06:06:34.692 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-19T06:06:34.692 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dca/ 2024-03-19T06:06:34.692 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dca/dca.ko 2024-03-19T06:06:34.692 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/ 2024-03-19T06:06:34.693 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/dw/ 2024-03-19T06:06:34.693 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-19T06:06:34.693 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/ioat/ 2024-03-19T06:06:34.693 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 122817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-19T06:06:34.693 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/ 2024-03-19T06:06:34.693 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 80305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/amd64_edac.ko 2024-03-19T06:06:34.693 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/e752x_edac.ko 2024-03-19T06:06:34.693 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/edac_mce_amd.ko 2024-03-19T06:06:34.693 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i3000_edac.ko 2024-03-19T06:06:34.694 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i3200_edac.ko 2024-03-19T06:06:34.694 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i5100_edac.ko 2024-03-19T06:06:34.694 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i5400_edac.ko 2024-03-19T06:06:34.694 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i7300_edac.ko 2024-03-19T06:06:34.694 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i7core_edac.ko 2024-03-19T06:06:34.694 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18273 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i82975x_edac.ko 2024-03-19T06:06:34.694 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/ie31200_edac.ko 2024-03-19T06:06:34.694 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 56737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/sb_edac.ko 2024-03-19T06:06:34.695 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/x38_edac.ko 2024-03-19T06:06:34.695 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/extcon/ 2024-03-19T06:06:34.695 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/extcon/extcon-gpio.ko 2024-03-19T06:06:34.695 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/extcon/extcon-max14577.ko 2024-03-19T06:06:34.695 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/extcon/extcon-max77693.ko 2024-03-19T06:06:34.695 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/extcon/extcon-max8997.ko 2024-03-19T06:06:34.695 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/extcon/extcon-palmas.ko 2024-03-19T06:06:34.695 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/extcon/extcon-rt8973a.ko 2024-03-19T06:06:34.695 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/extcon/extcon-sm5502.ko 2024-03-19T06:06:34.695 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/ 2024-03-19T06:06:34.695 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/dmi-sysfs.ko 2024-03-19T06:06:34.695 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/efi/ 2024-03-19T06:06:34.695 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/efi/efi-pstore.ko 2024-03-19T06:06:34.695 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-19T06:06:34.695 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/ 2024-03-19T06:06:34.696 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-adp5520.ko 2024-03-19T06:06:34.696 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-amd8111.ko 2024-03-19T06:06:34.696 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-arizona.ko 2024-03-19T06:06:34.696 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-da9052.ko 2024-03-19T06:06:34.696 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-da9055.ko 2024-03-19T06:06:34.696 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-dln2.ko 2024-03-19T06:06:34.696 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 77753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-f7188x.ko 2024-03-19T06:06:34.696 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-generic.ko 2024-03-19T06:06:34.696 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-ich.ko 2024-03-19T06:06:34.696 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-03-19T06:06:34.696 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-kempld.ko 2024-03-19T06:06:34.696 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-lp3943.ko 2024-03-19T06:06:34.696 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-max7300.ko 2024-03-19T06:06:34.696 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-max730x.ko 2024-03-19T06:06:34.696 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-max732x.ko 2024-03-19T06:06:34.697 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-03-19T06:06:34.697 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-pca953x.ko 2024-03-19T06:06:34.697 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-pcf857x.ko 2024-03-19T06:06:34.697 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-rdc321x.ko 2024-03-19T06:06:34.697 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-sch.ko 2024-03-19T06:06:34.697 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-sch311x.ko 2024-03-19T06:06:34.697 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-tps65912.ko 2024-03-19T06:06:34.697 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-twl4030.ko 2024-03-19T06:06:34.697 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-twl6040.ko 2024-03-19T06:06:34.697 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-19T06:06:34.697 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-vx855.ko 2024-03-19T06:06:34.697 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-wm831x.ko 2024-03-19T06:06:34.697 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-wm8350.ko 2024-03-19T06:06:34.697 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-wm8994.ko 2024-03-19T06:06:34.698 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/ 2024-03-19T06:06:34.698 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-a4tech.ko 2024-03-19T06:06:34.698 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-apple.ko 2024-03-19T06:06:34.698 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-appleir.ko 2024-03-19T06:06:34.698 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-aureal.ko 2024-03-19T06:06:34.698 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-axff.ko 2024-03-19T06:06:34.698 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-belkin.ko 2024-03-19T06:06:34.698 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-cherry.ko 2024-03-19T06:06:34.698 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-chicony.ko 2024-03-19T06:06:34.698 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 60665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-cp2112.ko 2024-03-19T06:06:34.698 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-cypress.ko 2024-03-19T06:06:34.698 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-dr.ko 2024-03-19T06:06:34.698 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-elecom.ko 2024-03-19T06:06:34.698 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-elo.ko 2024-03-19T06:06:34.699 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-emsff.ko 2024-03-19T06:06:34.699 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-ezkey.ko 2024-03-19T06:06:34.699 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gaff.ko 2024-03-19T06:06:34.699 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-generic.ko 2024-03-19T06:06:34.699 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gt683r.ko 2024-03-19T06:06:34.699 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gyration.ko 2024-03-19T06:06:34.699 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-19T06:06:34.699 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-19T06:06:34.699 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtekff.ko 2024-03-19T06:06:34.699 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-hyperv.ko 2024-03-19T06:06:34.699 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-icade.ko 2024-03-19T06:06:34.699 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-kensington.ko 2024-03-19T06:06:34.699 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-keytouch.ko 2024-03-19T06:06:34.699 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-kye.ko 2024-03-19T06:06:34.700 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-lcpower.ko 2024-03-19T06:06:34.700 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-led.ko 2024-03-19T06:06:34.700 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-lenovo.ko 2024-03-19T06:06:34.700 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-lg-g15.ko 2024-03-19T06:06:34.700 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 57977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-19T06:06:34.700 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 101545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-19T06:06:34.700 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 80921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-logitech.ko 2024-03-19T06:06:34.700 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-magicmouse.ko 2024-03-19T06:06:34.700 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-microsoft.ko 2024-03-19T06:06:34.700 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-monterey.ko 2024-03-19T06:06:34.700 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-multitouch.ko 2024-03-19T06:06:34.700 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-ntrig.ko 2024-03-19T06:06:34.700 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-ortek.ko 2024-03-19T06:06:34.700 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-penmount.ko 2024-03-19T06:06:34.701 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-petalynx.ko 2024-03-19T06:06:34.701 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 72865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-picolcd.ko 2024-03-19T06:06:34.701 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-pl.ko 2024-03-19T06:06:34.701 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-plantronics.ko 2024-03-19T06:06:34.701 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-primax.ko 2024-03-19T06:06:34.701 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-rmi.ko 2024-03-19T06:06:34.701 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-19T06:06:34.701 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-common.ko 2024-03-19T06:06:34.701 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-19T06:06:34.701 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-19T06:06:34.701 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-19T06:06:34.701 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-19T06:06:34.701 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-19T06:06:34.701 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-19T06:06:34.702 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-19T06:06:34.702 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-19T06:06:34.702 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-19T06:06:34.702 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat.ko 2024-03-19T06:06:34.702 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-saitek.ko 2024-03-19T06:06:34.702 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-samsung.ko 2024-03-19T06:06:34.702 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-19T06:06:34.702 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sjoy.ko 2024-03-19T06:06:34.702 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sony.ko 2024-03-19T06:06:34.702 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-speedlink.ko 2024-03-19T06:06:34.702 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-steelseries.ko 2024-03-19T06:06:34.702 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sunplus.ko 2024-03-19T06:06:34.702 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-19T06:06:34.703 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-tivo.ko 2024-03-19T06:06:34.703 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-tmff.ko 2024-03-19T06:06:34.703 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-topseed.ko 2024-03-19T06:06:34.703 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-twinhan.ko 2024-03-19T06:06:34.703 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-uclogic.ko 2024-03-19T06:06:34.703 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-waltop.ko 2024-03-19T06:06:34.703 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 143393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-wiimote.ko 2024-03-19T06:06:34.703 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8065 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-xinmo.ko 2024-03-19T06:06:34.703 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-zpff.ko 2024-03-19T06:06:34.703 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-zydacron.ko 2024-03-19T06:06:34.703 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 269233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid.ko 2024-03-19T06:06:34.703 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/uhid.ko 2024-03-19T06:06:34.703 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/usbhid/ 2024-03-19T06:06:34.704 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 125641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/usbhid/usbhid.ko 2024-03-19T06:06:34.704 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/usbhid/usbkbd.ko 2024-03-19T06:06:34.704 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/usbhid/usbmouse.ko 2024-03-19T06:06:34.704 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 218881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/wacom.ko 2024-03-19T06:06:34.704 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/ 2024-03-19T06:06:34.704 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 64305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_balloon.ko 2024-03-19T06:06:34.704 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 90113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_utils.ko 2024-03-19T06:06:34.704 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 304953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_vmbus.ko 2024-03-19T06:06:34.704 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ 2024-03-19T06:06:34.704 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 66801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/abituguru.ko 2024-03-19T06:06:34.704 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 61817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/abituguru3.ko 2024-03-19T06:06:34.704 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-19T06:06:34.704 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ad7414.ko 2024-03-19T06:06:34.705 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ad7418.ko 2024-03-19T06:06:34.705 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adc128d818.ko 2024-03-19T06:06:34.705 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1025.ko 2024-03-19T06:06:34.705 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 97889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1026.ko 2024-03-19T06:06:34.705 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1029.ko 2024-03-19T06:06:34.705 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45465 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1031.ko 2024-03-19T06:06:34.705 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm9240.ko 2024-03-19T06:06:34.705 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ads7828.ko 2024-03-19T06:06:34.705 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7410.ko 2024-03-19T06:06:34.705 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7411.ko 2024-03-19T06:06:34.705 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 74321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7462.ko 2024-03-19T06:06:34.705 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7470.ko 2024-03-19T06:06:34.705 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 69313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7475.ko 2024-03-19T06:06:34.705 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7x10.ko 2024-03-19T06:06:34.706 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/amc6821.ko 2024-03-19T06:06:34.706 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 55113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/applesmc.ko 2024-03-19T06:06:34.706 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asb100.ko 2024-03-19T06:06:34.706 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 58529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asc7621.ko 2024-03-19T06:06:34.706 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-19T06:06:34.706 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/atxp1.ko 2024-03-19T06:06:34.706 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/coretemp.ko 2024-03-19T06:06:34.706 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/da9052-hwmon.ko 2024-03-19T06:06:34.706 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/da9055-hwmon.ko 2024-03-19T06:06:34.706 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-19T06:06:34.706 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 99513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/dme1737.ko 2024-03-19T06:06:34.706 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ds1621.ko 2024-03-19T06:06:34.706 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ds620.ko 2024-03-19T06:06:34.706 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/emc1403.ko 2024-03-19T06:06:34.707 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/emc2103.ko 2024-03-19T06:06:34.707 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/emc6w201.ko 2024-03-19T06:06:34.707 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 66897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f71805f.ko 2024-03-19T06:06:34.707 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 94601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f71882fg.ko 2024-03-19T06:06:34.707 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f75375s.ko 2024-03-19T06:06:34.707 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/fam15h_power.ko 2024-03-19T06:06:34.707 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 55361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/fschmd.ko 2024-03-19T06:06:34.707 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/g760a.ko 2024-03-19T06:06:34.707 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/g762.ko 2024-03-19T06:06:34.707 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/gl518sm.ko 2024-03-19T06:06:34.707 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/gl520sm.ko 2024-03-19T06:06:34.707 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/hih6130.ko 2024-03-19T06:06:34.707 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-19T06:06:34.707 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/i5500_temp.ko 2024-03-19T06:06:34.708 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/i5k_amb.ko 2024-03-19T06:06:34.708 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ibmaem.ko 2024-03-19T06:06:34.708 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ibmpex.ko 2024-03-19T06:06:34.708 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ina209.ko 2024-03-19T06:06:34.708 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ina2xx.ko 2024-03-19T06:06:34.708 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 140137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/it87.ko 2024-03-19T06:06:34.708 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/jc42.ko 2024-03-19T06:06:34.708 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/k10temp.ko 2024-03-19T06:06:34.708 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/k8temp.ko 2024-03-19T06:06:34.708 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lineage-pem.ko 2024-03-19T06:06:34.708 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm63.ko 2024-03-19T06:06:34.708 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm73.ko 2024-03-19T06:06:34.708 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm75.ko 2024-03-19T06:06:34.709 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm77.ko 2024-03-19T06:06:34.709 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm78.ko 2024-03-19T06:06:34.709 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm80.ko 2024-03-19T06:06:34.709 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm83.ko 2024-03-19T06:06:34.709 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 72745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm85.ko 2024-03-19T06:06:34.709 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46065 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm87.ko 2024-03-19T06:06:34.709 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm90.ko 2024-03-19T06:06:34.709 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm92.ko 2024-03-19T06:06:34.709 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 108753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm93.ko 2024-03-19T06:06:34.709 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95234.ko 2024-03-19T06:06:34.709 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95241.ko 2024-03-19T06:06:34.709 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95245.ko 2024-03-19T06:06:34.709 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc2945.ko 2024-03-19T06:06:34.709 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4151.ko 2024-03-19T06:06:34.709 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15105 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4215.ko 2024-03-19T06:06:34.710 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4222.ko 2024-03-19T06:06:34.710 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4245.ko 2024-03-19T06:06:34.710 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4260.ko 2024-03-19T06:06:34.710 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4261.ko 2024-03-19T06:06:34.710 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max16065.ko 2024-03-19T06:06:34.710 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max1619.ko 2024-03-19T06:06:34.710 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max1668.ko 2024-03-19T06:06:34.710 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max197.ko 2024-03-19T06:06:34.710 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6639.ko 2024-03-19T06:06:34.710 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6650.ko 2024-03-19T06:06:34.710 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6697.ko 2024-03-19T06:06:34.710 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/mc13783-adc.ko 2024-03-19T06:06:34.711 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/mcp3021.ko 2024-03-19T06:06:34.711 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-03-19T06:06:34.711 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6683.ko 2024-03-19T06:06:34.711 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 119849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6775-core.ko 2024-03-19T06:06:34.711 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 61441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6775.ko 2024-03-19T06:06:34.711 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct7802.ko 2024-03-19T06:06:34.711 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 82721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pc87360.ko 2024-03-19T06:06:34.711 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pc87427.ko 2024-03-19T06:06:34.711 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pcf8591.ko 2024-03-19T06:06:34.711 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ 2024-03-19T06:06:34.711 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-19T06:06:34.711 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-19T06:06:34.711 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-19T06:06:34.711 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-19T06:06:34.711 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-19T06:06:34.712 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-19T06:06:34.712 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-19T06:06:34.712 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 82481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-19T06:06:34.712 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-19T06:06:34.712 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-19T06:06:34.712 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-19T06:06:34.712 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-19T06:06:34.712 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/powr1220.ko 2024-03-19T06:06:34.712 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch5627.ko 2024-03-19T06:06:34.712 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch5636.ko 2024-03-19T06:06:34.712 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-19T06:06:34.712 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sht15.ko 2024-03-19T06:06:34.712 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sht21.ko 2024-03-19T06:06:34.712 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/shtc1.ko 2024-03-19T06:06:34.712 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sis5595.ko 2024-03-19T06:06:34.713 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47b397.ko 2024-03-19T06:06:34.713 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47m1.ko 2024-03-19T06:06:34.713 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47m192.ko 2024-03-19T06:06:34.713 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26465 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/thmc50.ko 2024-03-19T06:06:34.713 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp102.ko 2024-03-19T06:06:34.713 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp103.ko 2024-03-19T06:06:34.713 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp401.ko 2024-03-19T06:06:34.713 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp421.ko 2024-03-19T06:06:34.713 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/via-cputemp.ko 2024-03-19T06:06:34.713 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 43449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/via686a.ko 2024-03-19T06:06:34.713 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 52369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/vt1211.ko 2024-03-19T06:06:34.713 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/vt8231.ko 2024-03-19T06:06:34.713 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 58265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83627ehf.ko 2024-03-19T06:06:34.713 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 79841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83627hf.ko 2024-03-19T06:06:34.714 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 71257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83781d.ko 2024-03-19T06:06:34.714 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 63137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83791d.ko 2024-03-19T06:06:34.714 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 71233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83792d.ko 2024-03-19T06:06:34.714 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 101385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83793.ko 2024-03-19T06:06:34.714 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 119417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83795.ko 2024-03-19T06:06:34.714 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83l785ts.ko 2024-03-19T06:06:34.714 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83l786ng.ko 2024-03-19T06:06:34.714 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-03-19T06:06:34.714 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-03-19T06:06:34.714 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/ 2024-03-19T06:06:34.714 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos/ 2024-03-19T06:06:34.714 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-19T06:06:34.714 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-19T06:06:34.714 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/ 2024-03-19T06:06:34.715 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-03-19T06:06:34.715 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-03-19T06:06:34.715 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-03-19T06:06:34.715 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-19T06:06:34.715 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-19T06:06:34.715 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-19T06:06:34.715 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-03-19T06:06:34.715 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-19T06:06:34.715 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-03-19T06:06:34.715 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-19T06:06:34.715 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-19T06:06:34.715 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-19T06:06:34.715 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-19T06:06:34.715 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-03-19T06:06:34.715 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-03-19T06:06:34.716 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 67689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-19T06:06:34.716 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-19T06:06:34.716 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-19T06:06:34.716 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-03-19T06:06:34.716 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-19T06:06:34.716 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-19T06:06:34.716 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-03-19T06:06:34.716 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-19T06:06:34.716 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-19T06:06:34.716 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-19T06:06:34.716 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-03-19T06:06:34.716 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-19T06:06:34.716 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-19T06:06:34.717 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-03-19T06:06:34.717 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-03-19T06:06:34.717 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-19T06:06:34.717 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-03-19T06:06:34.717 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-19T06:06:34.717 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-19T06:06:34.717 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-19T06:06:34.717 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-19T06:06:34.717 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-03-19T06:06:34.717 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-mux.ko 2024-03-19T06:06:34.717 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-smbus.ko 2024-03-19T06:06:34.717 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-stub.ko 2024-03-19T06:06:34.717 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/muxes/ 2024-03-19T06:06:34.717 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-03-19T06:06:34.717 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-03-19T06:06:34.718 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-03-19T06:06:34.718 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ 2024-03-19T06:06:34.718 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ 2024-03-19T06:06:34.718 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 273529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-19T06:06:34.718 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 883945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_core.ko 2024-03-19T06:06:34.718 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 69185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-19T06:06:34.718 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 324337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-19T06:06:34.718 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 97841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-19T06:06:34.718 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 282345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-19T06:06:34.718 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 66057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-19T06:06:34.718 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/ 2024-03-19T06:06:34.718 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/cxgb4/ 2024-03-19T06:06:34.718 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 493185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-19T06:06:34.718 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx4/ 2024-03-19T06:06:34.719 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 420593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-19T06:06:34.719 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx5/ 2024-03-19T06:06:34.719 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 741737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-19T06:06:34.719 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mthca/ 2024-03-19T06:06:34.719 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 296881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-19T06:06:34.719 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/ocrdma/ 2024-03-19T06:06:34.719 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 153729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-03-19T06:06:34.719 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/usnic/ 2024-03-19T06:06:34.719 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 169145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-03-19T06:06:34.719 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/ 2024-03-19T06:06:34.719 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/ipoib/ 2024-03-19T06:06:34.719 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 266577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-19T06:06:34.719 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/iser/ 2024-03-19T06:06:34.719 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 100281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-19T06:06:34.719 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/isert/ 2024-03-19T06:06:34.719 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 111337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-19T06:06:34.720 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srp/ 2024-03-19T06:06:34.720 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 128665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-19T06:06:34.720 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srpt/ 2024-03-19T06:06:34.720 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 129801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-19T06:06:34.720 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/ 2024-03-19T06:06:34.720 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/evbug.ko 2024-03-19T06:06:34.720 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/ff-memless.ko 2024-03-19T06:06:34.720 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/ 2024-03-19T06:06:34.720 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-19T06:06:34.720 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-19T06:06:34.720 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/gameport.ko 2024-03-19T06:06:34.720 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/joydev.ko 2024-03-19T06:06:34.720 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/ 2024-03-19T06:06:34.720 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-03-19T06:06:34.720 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-03-19T06:06:34.721 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-03-19T06:06:34.721 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-03-19T06:06:34.721 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-19T06:06:34.721 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-03-19T06:06:34.721 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/lkkbd.ko 2024-03-19T06:06:34.721 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/lm8323.ko 2024-03-19T06:06:34.721 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/lm8333.ko 2024-03-19T06:06:34.721 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-03-19T06:06:34.721 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-03-19T06:06:34.721 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-03-19T06:06:34.721 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-03-19T06:06:34.721 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/newtonkbd.ko 2024-03-19T06:06:34.721 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-03-19T06:06:34.721 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/qt1070.ko 2024-03-19T06:06:34.721 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/qt2160.ko 2024-03-19T06:06:34.721 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-03-19T06:06:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/stowaway.ko 2024-03-19T06:06:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/sunkbd.ko 2024-03-19T06:06:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-03-19T06:06:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-03-19T06:06:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-03-19T06:06:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/xtkbd.ko 2024-03-19T06:06:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/matrix-keymap.ko 2024-03-19T06:06:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/ 2024-03-19T06:06:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/appletouch.ko 2024-03-19T06:06:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/bcm5974.ko 2024-03-19T06:06:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 123201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/cyapatp.ko 2024-03-19T06:06:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 89393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-19T06:06:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/gpio_mouse.ko 2024-03-19T06:06:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 335921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/psmouse.ko 2024-03-19T06:06:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/sermouse.ko 2024-03-19T06:06:34.723 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-19T06:06:34.723 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-19T06:06:34.723 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-19T06:06:34.723 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/rmi4/ 2024-03-19T06:06:34.723 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 109601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-19T06:06:34.723 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/ 2024-03-19T06:06:34.723 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/altera_ps2.ko 2024-03-19T06:06:34.723 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/arc_ps2.ko 2024-03-19T06:06:34.723 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/ct82c710.ko 2024-03-19T06:06:34.724 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-19T06:06:34.724 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/parkbd.ko 2024-03-19T06:06:34.724 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/pcips2.ko 2024-03-19T06:06:34.724 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/ps2mult.ko 2024-03-19T06:06:34.724 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/serio_raw.ko 2024-03-19T06:06:34.724 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/serport.ko 2024-03-19T06:06:34.724 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/sparse-keymap.ko 2024-03-19T06:06:34.724 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/ 2024-03-19T06:06:34.724 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-88pm860x.ko 2024-03-19T06:06:34.724 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-adp5520.ko 2024-03-19T06:06:34.725 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-bd2802.ko 2024-03-19T06:06:34.725 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-blinkm.ko 2024-03-19T06:06:34.725 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-da903x.ko 2024-03-19T06:06:34.725 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-da9052.ko 2024-03-19T06:06:34.725 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-gpio.ko 2024-03-19T06:06:34.725 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lm3530.ko 2024-03-19T06:06:34.725 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lm3533.ko 2024-03-19T06:06:34.725 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lm355x.ko 2024-03-19T06:06:34.725 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lm3642.ko 2024-03-19T06:06:34.725 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lp3944.ko 2024-03-19T06:06:34.725 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lp8788.ko 2024-03-19T06:06:34.725 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-max8997.ko 2024-03-19T06:06:34.725 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-mc13783.ko 2024-03-19T06:06:34.725 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-menf21bmc.ko 2024-03-19T06:06:34.726 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-pca9532.ko 2024-03-19T06:06:34.726 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-pca955x.ko 2024-03-19T06:06:34.726 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-pca963x.ko 2024-03-19T06:06:34.726 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-ss4200.ko 2024-03-19T06:06:34.726 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-tca6507.ko 2024-03-19T06:06:34.726 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-wm831x-status.ko 2024-03-19T06:06:34.726 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-wm8350.ko 2024-03-19T06:06:34.726 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ 2024-03-19T06:06:34.726 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-19T06:06:34.726 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-19T06:06:34.726 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-19T06:06:34.726 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-19T06:06:34.726 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-19T06:06:34.726 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-19T06:06:34.726 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-19T06:06:34.727 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-19T06:06:34.727 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-19T06:06:34.727 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/ 2024-03-19T06:06:34.727 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/bcache/ 2024-03-19T06:06:34.727 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 647121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/bcache/bcache.ko 2024-03-19T06:06:34.727 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-bio-prison.ko 2024-03-19T06:06:34.727 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 93321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-bufio.ko 2024-03-19T06:06:34.727 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-cache-smq.ko 2024-03-19T06:06:34.727 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 155825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-cache.ko 2024-03-19T06:06:34.727 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 107937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-crypt.ko 2024-03-19T06:06:34.727 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-delay.ko 2024-03-19T06:06:34.727 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-era.ko 2024-03-19T06:06:34.727 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-flakey.ko 2024-03-19T06:06:34.727 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-log-userspace.ko 2024-03-19T06:06:34.727 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-log.ko 2024-03-19T06:06:34.727 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-mirror.ko 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 77881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-multipath.ko 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-queue-length.ko 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-raid.ko 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-region-hash.ko 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-round-robin.ko 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-service-time.ko 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 109457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-snapshot.ko 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-switch.ko 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 181777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-thin-pool.ko 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-verity.ko 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-zero.ko 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/persistent-data/ 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 199881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid0.ko 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 100841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid1.ko 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 126369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid10.ko 2024-03-19T06:06:34.728 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 368497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid456.ko 2024-03-19T06:06:34.729 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/ 2024-03-19T06:06:34.729 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/ 2024-03-19T06:06:34.729 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 178049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptbase.ko 2024-03-19T06:06:34.729 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 63241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptctl.ko 2024-03-19T06:06:34.729 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptfc.ko 2024-03-19T06:06:34.729 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptlan.ko 2024-03-19T06:06:34.729 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 123233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptsas.ko 2024-03-19T06:06:34.729 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 80921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptscsih.ko 2024-03-19T06:06:34.729 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 52865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptspi.ko 2024-03-19T06:06:34.729 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/ 2024-03-19T06:06:34.729 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/88pm800.ko 2024-03-19T06:06:34.729 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/88pm805.ko 2024-03-19T06:06:34.729 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11105 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/88pm80x.ko 2024-03-19T06:06:34.729 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/arizona-i2c.ko 2024-03-19T06:06:34.729 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 123649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/arizona.ko 2024-03-19T06:06:34.729 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/bcm590xx.ko 2024-03-19T06:06:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/cros_ec_dev.ko 2024-03-19T06:06:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/dln2.ko 2024-03-19T06:06:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/janz-cmodio.ko 2024-03-19T06:06:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/kempld-core.ko 2024-03-19T06:06:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lm3533-core.ko 2024-03-19T06:06:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-03-19T06:06:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lp3943.ko 2024-03-19T06:06:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 56969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lpc_ich.ko 2024-03-19T06:06:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lpc_sch.ko 2024-03-19T06:06:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/max8907.ko 2024-03-19T06:06:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/mc13xxx-core.ko 2024-03-19T06:06:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-03-19T06:06:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/menf21bmc.ko 2024-03-19T06:06:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/pcf50633-adc.ko 2024-03-19T06:06:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/pcf50633-gpio.ko 2024-03-19T06:06:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/pcf50633.ko 2024-03-19T06:06:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-03-19T06:06:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/retu-mfd.ko 2024-03-19T06:06:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 80345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/si476x-core.ko 2024-03-19T06:06:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/sm501.ko 2024-03-19T06:06:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/tps65010.ko 2024-03-19T06:06:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/tps6507x.ko 2024-03-19T06:06:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/viperboard.ko 2024-03-19T06:06:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/vx855.ko 2024-03-19T06:06:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/wl1273-core.ko 2024-03-19T06:06:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/wm8994.ko 2024-03-19T06:06:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ 2024-03-19T06:06:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-03-19T06:06:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ad525x_dpot.ko 2024-03-19T06:06:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/altera-stapl/ 2024-03-19T06:06:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-19T06:06:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/apds9802als.ko 2024-03-19T06:06:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/apds990x.ko 2024-03-19T06:06:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/bh1770glc.ko 2024-03-19T06:06:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/c2port/ 2024-03-19T06:06:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-03-19T06:06:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/c2port/core.ko 2024-03-19T06:06:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/cb710/ 2024-03-19T06:06:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/cb710/cb710.ko 2024-03-19T06:06:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ds1682.ko 2024-03-19T06:06:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/dummy-irq.ko 2024-03-19T06:06:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/echo/ 2024-03-19T06:06:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/echo/echo.ko 2024-03-19T06:06:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/ 2024-03-19T06:06:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/at24.ko 2024-03-19T06:06:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-19T06:06:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/max6875.ko 2024-03-19T06:06:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/enclosure.ko 2024-03-19T06:06:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/genwqe/ 2024-03-19T06:06:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 152073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-03-19T06:06:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/hmc6352.ko 2024-03-19T06:06:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/hpilo.ko 2024-03-19T06:06:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ibmasm/ 2024-03-19T06:06:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 72561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-03-19T06:06:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ics932s401.ko 2024-03-19T06:06:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/isl29003.ko 2024-03-19T06:06:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/isl29020.ko 2024-03-19T06:06:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d/ 2024-03-19T06:06:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-19T06:06:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-19T06:06:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/ 2024-03-19T06:06:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 126153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei-me.ko 2024-03-19T06:06:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 56377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei-txe.ko 2024-03-19T06:06:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 313601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei.ko 2024-03-19T06:06:34.734 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/phantom.ko 2024-03-19T06:06:34.734 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ti-st/ 2024-03-19T06:06:34.734 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 74305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ti-st/st_drv.ko 2024-03-19T06:06:34.734 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tifm_7xx1.ko 2024-03-19T06:06:34.734 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tifm_core.ko 2024-03-19T06:06:34.734 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tsl2550.ko 2024-03-19T06:06:34.734 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_balloon.ko 2024-03-19T06:06:34.734 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_vmci/ 2024-03-19T06:06:34.734 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 183569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-19T06:06:34.734 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ 2024-03-19T06:06:34.734 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/bonding/ 2024-03-19T06:06:34.734 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 491609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/bonding/bonding.ko 2024-03-19T06:06:34.735 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/ 2024-03-19T06:06:34.735 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/b53/ 2024-03-19T06:06:34.735 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 105937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-19T06:06:34.735 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-19T06:06:34.735 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-19T06:06:34.735 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6xxx/ 2024-03-19T06:06:34.735 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 459001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-19T06:06:34.736 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dummy.ko 2024-03-19T06:06:34.736 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/eql.ko 2024-03-19T06:06:34.736 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ 2024-03-19T06:06:34.736 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/ 2024-03-19T06:06:34.736 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-19T06:06:34.736 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-19T06:06:34.736 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 130665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-19T06:06:34.736 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 68785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-19T06:06:34.736 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/ 2024-03-19T06:06:34.736 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-19T06:06:34.736 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 64617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-19T06:06:34.737 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-19T06:06:34.737 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 101617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-19T06:06:34.737 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/adaptec/ 2024-03-19T06:06:34.737 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-19T06:06:34.737 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/agere/ 2024-03-19T06:06:34.737 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 69169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-19T06:06:34.737 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/alteon/ 2024-03-19T06:06:34.737 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-19T06:06:34.737 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/altera/ 2024-03-19T06:06:34.737 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-19T06:06:34.737 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/ 2024-03-19T06:06:34.737 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-19T06:06:34.737 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-19T06:06:34.737 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 87457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-19T06:06:34.737 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/ 2024-03-19T06:06:34.738 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/alx/ 2024-03-19T06:06:34.738 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 97201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-19T06:06:34.738 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-03-19T06:06:34.738 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 102497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-19T06:06:34.738 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-03-19T06:06:34.739 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 90209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-19T06:06:34.739 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx/ 2024-03-19T06:06:34.739 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 81321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-19T06:06:34.739 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 69545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-19T06:06:34.739 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/ 2024-03-19T06:06:34.739 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 78385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-19T06:06:34.739 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 176697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-19T06:06:34.739 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-03-19T06:06:34.739 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1434505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-19T06:06:34.739 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 128369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-19T06:06:34.739 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/genet/ 2024-03-19T06:06:34.739 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 131281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-19T06:06:34.739 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 314329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-19T06:06:34.739 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade/ 2024-03-19T06:06:34.740 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade/bna/ 2024-03-19T06:06:34.740 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 323737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-19T06:06:34.740 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/ 2024-03-19T06:06:34.740 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-03-19T06:06:34.740 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 193593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-19T06:06:34.740 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-03-19T06:06:34.740 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 347217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-19T06:06:34.740 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-03-19T06:06:34.740 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1045449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-19T06:06:34.740 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-03-19T06:06:34.740 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 166145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-19T06:06:34.740 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-03-19T06:06:34.740 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-19T06:06:34.740 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco/ 2024-03-19T06:06:34.740 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco/enic/ 2024-03-19T06:06:34.741 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 204249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-19T06:06:34.741 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/ 2024-03-19T06:06:34.741 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/ 2024-03-19T06:06:34.741 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 69433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-19T06:06:34.741 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 61425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-19T06:06:34.741 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 141201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-19T06:06:34.741 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-19T06:06:34.741 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 62833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-19T06:06:34.741 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-19T06:06:34.741 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink/ 2024-03-19T06:06:34.741 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 60673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-19T06:06:34.741 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 62833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-19T06:06:34.741 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dnet.ko 2024-03-19T06:06:34.741 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ec_bhf.ko 2024-03-19T06:06:34.741 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex/ 2024-03-19T06:06:34.742 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex/benet/ 2024-03-19T06:06:34.742 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 281217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-19T06:06:34.742 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ethoc.ko 2024-03-19T06:06:34.742 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/fealnx.ko 2024-03-19T06:06:34.742 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/fujitsu/ 2024-03-19T06:06:34.742 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-03-19T06:06:34.742 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ 2024-03-19T06:06:34.742 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 90305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-19T06:06:34.742 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000/ 2024-03-19T06:06:34.742 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 295697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-19T06:06:34.742 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000e/ 2024-03-19T06:06:34.742 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 584353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-19T06:06:34.742 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/fm10k/ 2024-03-19T06:06:34.742 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 246041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-19T06:06:34.742 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/i40e/ 2024-03-19T06:06:34.743 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 944545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-19T06:06:34.743 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/iavf/ 2024-03-19T06:06:34.743 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 288529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-19T06:06:34.743 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igb/ 2024-03-19T06:06:34.743 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 513673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-19T06:06:34.743 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igbvf/ 2024-03-19T06:06:34.743 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 93489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-19T06:06:34.743 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-03-19T06:06:34.743 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 735169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-19T06:06:34.743 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-03-19T06:06:34.743 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 151745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-19T06:06:34.743 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 86993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/jme.ko 2024-03-19T06:06:34.743 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/ 2024-03-19T06:06:34.743 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-19T06:06:34.743 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 102441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-19T06:06:34.743 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 122609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-19T06:06:34.744 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/ 2024-03-19T06:06:34.744 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-03-19T06:06:34.744 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 727481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-19T06:06:34.744 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 278881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-19T06:06:34.744 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-03-19T06:06:34.744 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-03-19T06:06:34.744 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1122297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-19T06:06:34.744 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel/ 2024-03-19T06:06:34.744 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 52985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-03-19T06:06:34.744 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-03-19T06:06:34.744 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-03-19T06:06:34.744 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 95577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-19T06:06:34.744 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom/ 2024-03-19T06:06:34.744 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-03-19T06:06:34.744 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 108409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-19T06:06:34.744 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi/ 2024-03-19T06:06:34.745 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 73617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-19T06:06:34.745 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-19T06:06:34.745 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/neterion/ 2024-03-19T06:06:34.745 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 151097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-19T06:06:34.745 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/nvidia/ 2024-03-19T06:06:34.745 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 136801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-19T06:06:34.745 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines/ 2024-03-19T06:06:34.745 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-19T06:06:34.745 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-19T06:06:34.745 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/ 2024-03-19T06:06:34.745 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-03-19T06:06:34.745 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 227865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-19T06:06:34.746 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 87017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-19T06:06:34.746 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-03-19T06:06:34.746 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 672057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-19T06:06:34.746 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rdc/ 2024-03-19T06:06:34.746 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-19T06:06:34.746 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/ 2024-03-19T06:06:34.746 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 67281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-19T06:06:34.746 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 83809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-19T06:06:34.746 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-19T06:06:34.746 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 194073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-19T06:06:34.746 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/samsung/ 2024-03-19T06:06:34.746 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-03-19T06:06:34.747 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 104049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-03-19T06:06:34.747 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sfc/ 2024-03-19T06:06:34.747 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1067001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-19T06:06:34.747 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/silan/ 2024-03-19T06:06:34.747 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-19T06:06:34.747 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis/ 2024-03-19T06:06:34.747 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-19T06:06:34.747 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 63201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-19T06:06:34.747 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/ 2024-03-19T06:06:34.747 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 61425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-19T06:06:34.747 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 67297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-19T06:06:34.747 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 73257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-19T06:06:34.747 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 68049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-19T06:06:34.747 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/ 2024-03-19T06:06:34.748 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-03-19T06:06:34.748 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-03-19T06:06:34.748 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-19T06:06:34.748 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-03-19T06:06:34.748 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 495777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-19T06:06:34.748 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/ 2024-03-19T06:06:34.748 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 103185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-19T06:06:34.748 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 166049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-19T06:06:34.748 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 66273 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-19T06:06:34.748 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 78721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-19T06:06:34.748 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/tehuti/ 2024-03-19T06:06:34.748 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-19T06:06:34.748 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ti/ 2024-03-19T06:06:34.748 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 92345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-19T06:06:34.748 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via/ 2024-03-19T06:06:34.749 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 79937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-19T06:06:34.749 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 83721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-19T06:06:34.749 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet/ 2024-03-19T06:06:34.749 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-19T06:06:34.749 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-19T06:06:34.749 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/xircom/ 2024-03-19T06:06:34.749 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-19T06:06:34.749 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/fddi/ 2024-03-19T06:06:34.749 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/fddi/defxx.ko 2024-03-19T06:06:34.749 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/fddi/skfp/ 2024-03-19T06:06:34.749 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 217113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/fddi/skfp/skfp.ko 2024-03-19T06:06:34.749 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 74993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/geneve.ko 2024-03-19T06:06:34.749 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/hyperv/ 2024-03-19T06:06:34.749 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 237265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-19T06:06:34.749 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ieee802154/ 2024-03-19T06:06:34.749 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-19T06:06:34.750 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ifb.ko 2024-03-19T06:06:34.750 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ipvlan/ 2024-03-19T06:06:34.750 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 85857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-19T06:06:34.750 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 62897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/macvlan.ko 2024-03-19T06:06:34.750 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/macvtap.ko 2024-03-19T06:06:34.750 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/ 2024-03-19T06:06:34.750 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-19T06:06:34.750 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-19T06:06:34.750 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-gpio.ko 2024-03-19T06:06:34.750 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-19T06:06:34.750 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio.ko 2024-03-19T06:06:34.750 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mii.ko 2024-03-19T06:06:34.750 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/netconsole.ko 2024-03-19T06:06:34.750 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/nlmon.ko 2024-03-19T06:06:34.751 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs/ 2024-03-19T06:06:34.751 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-19T06:06:34.751 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-19T06:06:34.751 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/ 2024-03-19T06:06:34.751 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/amd.ko 2024-03-19T06:06:34.751 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-19T06:06:34.751 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-19T06:06:34.751 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm87xx.ko 2024-03-19T06:06:34.751 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/broadcom.ko 2024-03-19T06:06:34.751 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/cicada.ko 2024-03-19T06:06:34.751 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/davicom.ko 2024-03-19T06:06:34.751 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/et1011c.ko 2024-03-19T06:06:34.752 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/icplus.ko 2024-03-19T06:06:34.752 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/lxt.ko 2024-03-19T06:06:34.752 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 81961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/marvell.ko 2024-03-19T06:06:34.752 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 76569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/micrel.ko 2024-03-19T06:06:34.752 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/national.ko 2024-03-19T06:06:34.752 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 99009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/phylink.ko 2024-03-19T06:06:34.752 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/qsemi.ko 2024-03-19T06:06:34.752 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/realtek.ko 2024-03-19T06:06:34.753 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/smsc.ko 2024-03-19T06:06:34.753 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/ste10Xp.ko 2024-03-19T06:06:34.753 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/vitesse.ko 2024-03-19T06:06:34.753 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/plip/ 2024-03-19T06:06:34.753 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 43769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/plip/plip.ko 2024-03-19T06:06:34.753 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ 2024-03-19T06:06:34.753 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-19T06:06:34.753 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_async.ko 2024-03-19T06:06:34.753 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-19T06:06:34.753 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-19T06:06:34.753 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-19T06:06:34.753 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pppoe.ko 2024-03-19T06:06:34.753 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pppox.ko 2024-03-19T06:06:34.753 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pptp.ko 2024-03-19T06:06:34.753 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/sb1000.ko 2024-03-19T06:06:34.753 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/slip/ 2024-03-19T06:06:34.754 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/slip/slip.ko 2024-03-19T06:06:34.754 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/sungem_phy.ko 2024-03-19T06:06:34.754 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 64561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/tap.ko 2024-03-19T06:06:34.754 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/ 2024-03-19T06:06:34.754 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 107233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team.ko 2024-03-19T06:06:34.754 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-19T06:06:34.754 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-19T06:06:34.754 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-19T06:06:34.754 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_random.ko 2024-03-19T06:06:34.754 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-19T06:06:34.755 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 86825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/veth.ko 2024-03-19T06:06:34.755 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vmxnet3/ 2024-03-19T06:06:34.755 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 144361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-19T06:06:34.755 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vxlan/ 2024-03-19T06:06:34.755 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 307193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vxlan/vxlan.ko 2024-03-19T06:06:34.755 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/xen-netback/ 2024-03-19T06:06:34.755 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 144017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-19T06:06:34.755 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ntb/ 2024-03-19T06:06:34.755 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ntb/ntb.ko 2024-03-19T06:06:34.755 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/ 2024-03-19T06:06:34.755 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host/ 2024-03-19T06:06:34.755 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 267745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host/nvme-core.ko 2024-03-19T06:06:34.755 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 103361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host/nvme.ko 2024-03-19T06:06:34.755 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/ 2024-03-19T06:06:34.756 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 131329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport.ko 2024-03-19T06:06:34.756 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14465 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_cs.ko 2024-03-19T06:06:34.756 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 85217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_pc.ko 2024-03-19T06:06:34.756 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_serial.ko 2024-03-19T06:06:34.756 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/ 2024-03-19T06:06:34.756 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/hotplug/ 2024-03-19T06:06:34.756 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-19T06:06:34.756 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-03-19T06:06:34.756 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-03-19T06:06:34.756 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/pci-stub.ko 2024-03-19T06:06:34.756 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/xen-pcifront.ko 2024-03-19T06:06:34.756 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/ 2024-03-19T06:06:34.756 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/i82092.ko 2024-03-19T06:06:34.756 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 146153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/pcmcia.ko 2024-03-19T06:06:34.757 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 62081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/pcmcia_core.ko 2024-03-19T06:06:34.757 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-03-19T06:06:34.757 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/pd6729.ko 2024-03-19T06:06:34.757 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 112793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-19T06:06:34.757 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/phy/ 2024-03-19T06:06:34.757 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/phy/broadcom/ 2024-03-19T06:06:34.757 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-03-19T06:06:34.757 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/phy/samsung/ 2024-03-19T06:06:34.757 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-03-19T06:06:34.757 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl/ 2024-03-19T06:06:34.757 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl/intel/ 2024-03-19T06:06:34.757 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 69033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-19T06:06:34.757 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/ 2024-03-19T06:06:34.757 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/chrome/ 2024-03-19T06:06:34.757 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-03-19T06:06:34.758 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/chrome/cros_ec.ko 2024-03-19T06:06:34.758 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-03-19T06:06:34.758 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-03-19T06:06:34.758 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26105 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-03-19T06:06:34.758 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-03-19T06:06:34.758 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-03-19T06:06:34.758 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/ 2024-03-19T06:06:34.758 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 73601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-19T06:06:34.758 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/acerhdf.ko 2024-03-19T06:06:34.758 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-19T06:06:34.758 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-19T06:06:34.758 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-19T06:06:34.758 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 131945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-19T06:06:34.758 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-19T06:06:34.758 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-19T06:06:34.759 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-19T06:06:34.759 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-19T06:06:34.759 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-19T06:06:34.759 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/hdaps.ko 2024-03-19T06:06:34.759 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/ibm_rtl.ko 2024-03-19T06:06:34.759 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel/ 2024-03-19T06:06:34.759 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-19T06:06:34.759 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-03-19T06:06:34.759 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel_ips.ko 2024-03-19T06:06:34.759 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-19T06:06:34.759 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-19T06:06:34.759 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-19T06:06:34.759 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-19T06:06:34.759 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-19T06:06:34.759 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-19T06:06:34.760 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-19T06:06:34.760 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-19T06:06:34.760 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-19T06:06:34.760 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/wmi.ko 2024-03-19T06:06:34.760 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/ 2024-03-19T06:06:34.760 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/ 2024-03-19T06:06:34.760 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/88pm860x_battery.ko 2024-03-19T06:06:34.760 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/88pm860x_charger.ko 2024-03-19T06:06:34.760 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/bq2415x_charger.ko 2024-03-19T06:06:34.760 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/bq24190_charger.ko 2024-03-19T06:06:34.760 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/bq24735-charger.ko 2024-03-19T06:06:34.760 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-03-19T06:06:34.760 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/da9030_battery.ko 2024-03-19T06:06:34.760 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/da9052-battery.ko 2024-03-19T06:06:34.760 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/ds2760_battery.ko 2024-03-19T06:06:34.760 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/ds2780_battery.ko 2024-03-19T06:06:34.761 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/ds2781_battery.ko 2024-03-19T06:06:34.761 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/ds2782_battery.ko 2024-03-19T06:06:34.761 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/gpio-charger.ko 2024-03-19T06:06:34.761 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/isp1704_charger.ko 2024-03-19T06:06:34.761 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/lp8727_charger.ko 2024-03-19T06:06:34.761 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/max14577_charger.ko 2024-03-19T06:06:34.761 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/max17042_battery.ko 2024-03-19T06:06:34.761 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/max8903_charger.ko 2024-03-19T06:06:34.761 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/max8925_power.ko 2024-03-19T06:06:34.761 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/pcf50633-charger.ko 2024-03-19T06:06:34.761 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/sbs-battery.ko 2024-03-19T06:06:34.761 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/test_power.ko 2024-03-19T06:06:34.762 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/tps65090-charger.ko 2024-03-19T06:06:34.762 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/wm831x_backup.ko 2024-03-19T06:06:34.762 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/wm831x_power.ko 2024-03-19T06:06:34.762 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/wm8350_power.ko 2024-03-19T06:06:34.762 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap/ 2024-03-19T06:06:34.762 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 58105 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-19T06:06:34.762 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-19T06:06:34.762 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/ 2024-03-19T06:06:34.762 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/ 2024-03-19T06:06:34.762 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-19T06:06:34.762 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-19T06:06:34.762 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps_parport.ko 2024-03-19T06:06:34.762 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/pps_core.ko 2024-03-19T06:06:34.762 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp/ 2024-03-19T06:06:34.762 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp/ptp.ko 2024-03-19T06:06:34.763 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp/ptp_kvm.ko 2024-03-19T06:06:34.763 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/ 2024-03-19T06:06:34.763 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-88pm80x.ko 2024-03-19T06:06:34.763 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-88pm860x.ko 2024-03-19T06:06:34.763 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-19T06:06:34.763 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-da9052.ko 2024-03-19T06:06:34.763 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-da9055.ko 2024-03-19T06:06:34.763 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-da9063.ko 2024-03-19T06:06:34.763 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-19T06:06:34.763 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 68481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-19T06:06:34.763 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-19T06:06:34.763 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-19T06:06:34.763 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-19T06:06:34.763 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-19T06:06:34.763 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13273 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-19T06:06:34.763 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-19T06:06:34.764 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-19T06:06:34.764 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-em3027.ko 2024-03-19T06:06:34.764 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-19T06:06:34.764 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-19T06:06:34.764 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-19T06:06:34.764 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-lp8788.ko 2024-03-19T06:06:34.764 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-19T06:06:34.764 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-19T06:06:34.764 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-19T06:06:34.764 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m48t86.ko 2024-03-19T06:06:34.764 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-max6900.ko 2024-03-19T06:06:34.764 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-max8907.ko 2024-03-19T06:06:34.764 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-max8925.ko 2024-03-19T06:06:34.764 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-max8997.ko 2024-03-19T06:06:34.764 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-max8998.ko 2024-03-19T06:06:34.765 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-03-19T06:06:34.765 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-19T06:06:34.765 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-palmas.ko 2024-03-19T06:06:34.765 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-19T06:06:34.765 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf50633.ko 2024-03-19T06:06:34.765 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-19T06:06:34.765 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-19T06:06:34.765 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-19T06:06:34.765 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-19T06:06:34.765 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rc5t583.ko 2024-03-19T06:06:34.765 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-19T06:06:34.765 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-19T06:06:34.766 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-19T06:06:34.766 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-19T06:06:34.766 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-19T06:06:34.766 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-s35390a.ko 2024-03-19T06:06:34.766 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-19T06:06:34.766 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-tps6586x.ko 2024-03-19T06:06:34.766 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-tps65910.ko 2024-03-19T06:06:34.766 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-wm831x.ko 2024-03-19T06:06:34.766 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-wm8350.ko 2024-03-19T06:06:34.766 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-x1205.ko 2024-03-19T06:06:34.766 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ 2024-03-19T06:06:34.766 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 77529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-9xxx.ko 2024-03-19T06:06:34.766 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 57721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-sas.ko 2024-03-19T06:06:34.766 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 55017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-xxxx.ko 2024-03-19T06:06:34.766 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 135345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/BusLogic.ko 2024-03-19T06:06:34.766 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/a100u2w.ko 2024-03-19T06:06:34.767 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aacraid/ 2024-03-19T06:06:34.767 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 271441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-19T06:06:34.767 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 100473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/advansys.ko 2024-03-19T06:06:34.767 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx/ 2024-03-19T06:06:34.767 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 356865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-19T06:06:34.767 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 295929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-19T06:06:34.767 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic94xx/ 2024-03-19T06:06:34.767 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 189145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-03-19T06:06:34.767 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/am53c974.ko 2024-03-19T06:06:34.767 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/arcmsr/ 2024-03-19T06:06:34.767 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 108209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-19T06:06:34.767 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/atp870u.ko 2024-03-19T06:06:34.767 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/be2iscsi/ 2024-03-19T06:06:34.767 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 246937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-19T06:06:34.768 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bfa/ 2024-03-19T06:06:34.768 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1171953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bfa/bfa.ko 2024-03-19T06:06:34.768 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2fc/ 2024-03-19T06:06:34.768 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 238401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-19T06:06:34.768 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2i/ 2024-03-19T06:06:34.768 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 115329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-19T06:06:34.768 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ch.ko 2024-03-19T06:06:34.768 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/csiostor/ 2024-03-19T06:06:34.768 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 308961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-19T06:06:34.768 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/ 2024-03-19T06:06:34.768 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-03-19T06:06:34.768 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 76041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-19T06:06:34.768 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-03-19T06:06:34.768 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 101425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-19T06:06:34.768 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 146753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-19T06:06:34.768 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 75977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/dc395x.ko 2024-03-19T06:06:34.769 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/dmx3191d.ko 2024-03-19T06:06:34.769 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esas2r/ 2024-03-19T06:06:34.769 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 212385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-19T06:06:34.769 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 60505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esp_scsi.ko 2024-03-19T06:06:34.769 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe/ 2024-03-19T06:06:34.769 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 78225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-19T06:06:34.769 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 157729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-19T06:06:34.769 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fdomain.ko 2024-03-19T06:06:34.769 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fnic/ 2024-03-19T06:06:34.769 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 294953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fnic/fnic.ko 2024-03-19T06:06:34.769 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 201729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hpsa.ko 2024-03-19T06:06:34.769 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hptiop.ko 2024-03-19T06:06:34.769 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hv_storvsc.ko 2024-03-19T06:06:34.769 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/imm.ko 2024-03-19T06:06:34.769 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 43977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/initio.ko 2024-03-19T06:06:34.770 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 265945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ipr.ko 2024-03-19T06:06:34.770 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 101881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ips.ko 2024-03-19T06:06:34.770 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/isci/ 2024-03-19T06:06:34.770 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 317193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/isci/isci.ko 2024-03-19T06:06:34.770 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-19T06:06:34.770 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 52865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-19T06:06:34.770 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libfc/ 2024-03-19T06:06:34.770 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 315321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libfc/libfc.ko 2024-03-19T06:06:34.770 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 145497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libiscsi.ko 2024-03-19T06:06:34.770 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-19T06:06:34.770 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libsas/ 2024-03-19T06:06:34.770 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 216401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libsas/libsas.ko 2024-03-19T06:06:34.770 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/lpfc/ 2024-03-19T06:06:34.770 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 2194089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-19T06:06:34.771 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/ 2024-03-19T06:06:34.771 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 73473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-19T06:06:34.771 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-19T06:06:34.771 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 310689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-19T06:06:34.771 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 85521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid.ko 2024-03-19T06:06:34.771 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mpt3sas/ 2024-03-19T06:06:34.771 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 659633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-19T06:06:34.771 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvsas/ 2024-03-19T06:06:34.771 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 119489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-19T06:06:34.771 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 78041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvumi.ko 2024-03-19T06:06:34.771 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pcmcia/ 2024-03-19T06:06:34.771 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 81561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-03-19T06:06:34.771 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-03-19T06:06:34.771 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-03-19T06:06:34.771 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-03-19T06:06:34.772 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pm8001/ 2024-03-19T06:06:34.772 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 366337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-19T06:06:34.772 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 124601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pmcraid.ko 2024-03-19T06:06:34.772 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ppa.ko 2024-03-19T06:06:34.772 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 55337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla1280.ko 2024-03-19T06:06:34.772 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx/ 2024-03-19T06:06:34.772 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1876753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-19T06:06:34.772 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 85193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-19T06:06:34.772 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla4xxx/ 2024-03-19T06:06:34.772 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 558953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-19T06:06:34.772 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qlogicfas408.ko 2024-03-19T06:06:34.772 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/raid_class.ko 2024-03-19T06:06:34.772 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 261081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_debug.ko 2024-03-19T06:06:34.772 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 173929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-19T06:06:34.772 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 280113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-19T06:06:34.773 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 97625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-19T06:06:34.773 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 73865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-19T06:06:34.773 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-19T06:06:34.773 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ses.ko 2024-03-19T06:06:34.773 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 115649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/st.ko 2024-03-19T06:06:34.773 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/stex.ko 2024-03-19T06:06:34.773 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/sym53c8xx_2/ 2024-03-19T06:06:34.773 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 164889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-19T06:06:34.773 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/virtio_scsi.ko 2024-03-19T06:06:34.773 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-19T06:06:34.773 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/wd719x.ko 2024-03-19T06:06:34.773 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/xen-scsifront.ko 2024-03-19T06:06:34.773 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ssb/ 2024-03-19T06:06:34.773 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 129393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ssb/ssb.ko 2024-03-19T06:06:34.773 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/ 2024-03-19T06:06:34.774 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/iscsi/ 2024-03-19T06:06:34.774 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 736761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-19T06:06:34.774 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/loopback/ 2024-03-19T06:06:34.774 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-19T06:06:34.774 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_file.ko 2024-03-19T06:06:34.774 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_iblock.ko 2024-03-19T06:06:34.774 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 931521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_mod.ko 2024-03-19T06:06:34.774 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_pscsi.ko 2024-03-19T06:06:34.774 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 122489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_user.ko 2024-03-19T06:06:34.774 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/tcm_fc/ 2024-03-19T06:06:34.774 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 75521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-19T06:06:34.774 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/ 2024-03-19T06:06:34.774 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/ 2024-03-19T06:06:34.774 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/ 2024-03-19T06:06:34.775 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-19T06:06:34.775 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-19T06:06:34.775 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-19T06:06:34.775 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-19T06:06:34.775 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-19T06:06:34.775 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-19T06:06:34.775 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-19T06:06:34.775 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-19T06:06:34.775 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-19T06:06:34.775 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-19T06:06:34.775 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-19T06:06:34.775 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-19T06:06:34.775 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-19T06:06:34.776 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-19T06:06:34.776 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11465 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-19T06:06:34.776 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-03-19T06:06:34.776 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-19T06:06:34.776 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-19T06:06:34.776 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-19T06:06:34.776 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/ 2024-03-19T06:06:34.776 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/ipwireless/ 2024-03-19T06:06:34.776 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 78353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-19T06:06:34.776 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 57777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/moxa.ko 2024-03-19T06:06:34.776 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/mxser.ko 2024-03-19T06:06:34.776 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 108489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/n_gsm.ko 2024-03-19T06:06:34.777 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/n_hdlc.ko 2024-03-19T06:06:34.777 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 67841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/nozomi.ko 2024-03-19T06:06:34.777 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/ 2024-03-19T06:06:34.777 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/8250/ 2024-03-19T06:06:34.777 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-03-19T06:06:34.777 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-19T06:06:34.777 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-03-19T06:06:34.777 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/altera_uart.ko 2024-03-19T06:06:34.777 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/arc_uart.ko 2024-03-19T06:06:34.777 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 72553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-03-19T06:06:34.777 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/jsm/ 2024-03-19T06:06:34.777 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 101993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-19T06:06:34.777 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/rp2.ko 2024-03-19T06:06:34.777 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/sc16is7xx.ko 2024-03-19T06:06:34.777 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/ 2024-03-19T06:06:34.778 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/core/ 2024-03-19T06:06:34.778 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 545401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-19T06:06:34.778 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/host/ 2024-03-19T06:06:34.778 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-19T06:06:34.778 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-03-19T06:06:34.778 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/ 2024-03-19T06:06:34.778 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio.ko 2024-03-19T06:06:34.778 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_aec.ko 2024-03-19T06:06:34.778 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_cif.ko 2024-03-19T06:06:34.778 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_dmem_genirq.ko 2024-03-19T06:06:34.778 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_mf624.ko 2024-03-19T06:06:34.778 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_netx.ko 2024-03-19T06:06:34.778 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_pci_generic.ko 2024-03-19T06:06:34.778 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-03-19T06:06:34.779 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_sercos3.ko 2024-03-19T06:06:34.779 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/ 2024-03-19T06:06:34.779 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/c67x00/ 2024-03-19T06:06:34.779 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 73225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/c67x00/c67x00.ko 2024-03-19T06:06:34.779 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/chipidea/ 2024-03-19T06:06:34.779 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 145793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-03-19T06:06:34.779 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-03-19T06:06:34.779 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-03-19T06:06:34.779 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-03-19T06:06:34.780 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-03-19T06:06:34.780 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/ 2024-03-19T06:06:34.780 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 87009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/cdc-acm.ko 2024-03-19T06:06:34.780 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-19T06:06:34.780 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/usblp.ko 2024-03-19T06:06:34.780 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 89769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/usbtmc.ko 2024-03-19T06:06:34.781 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/common/ 2024-03-19T06:06:34.781 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/common/ulpi.ko 2024-03-19T06:06:34.781 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/dwc2/ 2024-03-19T06:06:34.781 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-03-19T06:06:34.781 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/dwc3/ 2024-03-19T06:06:34.781 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-03-19T06:06:34.781 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-03-19T06:06:34.781 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 452825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/dwc3/dwc3.ko 2024-03-19T06:06:34.781 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/ 2024-03-19T06:06:34.781 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/ 2024-03-19T06:06:34.781 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 60329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/u_ether.ko 2024-03-19T06:06:34.781 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/u_serial.ko 2024-03-19T06:06:34.781 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-03-19T06:06:34.782 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-03-19T06:06:34.782 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-03-19T06:06:34.782 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-03-19T06:06:34.782 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 92409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-03-19T06:06:34.782 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-03-19T06:06:34.782 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 122257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-03-19T06:06:34.782 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-03-19T06:06:34.782 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-03-19T06:06:34.782 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-03-19T06:06:34.782 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 57633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-03-19T06:06:34.782 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 85521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-03-19T06:06:34.782 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-03-19T06:06:34.782 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 58025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-03-19T06:06:34.783 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 67353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-03-19T06:06:34.783 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/ 2024-03-19T06:06:34.783 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-03-19T06:06:34.783 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-03-19T06:06:34.783 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-03-19T06:06:34.783 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-03-19T06:06:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-03-19T06:06:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-03-19T06:06:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-03-19T06:06:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-03-19T06:06:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-03-19T06:06:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-03-19T06:06:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-03-19T06:06:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-03-19T06:06:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 62369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-03-19T06:06:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15105 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-03-19T06:06:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 161233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/libcomposite.ko 2024-03-19T06:06:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/ 2024-03-19T06:06:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-03-19T06:06:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/bdc/ 2024-03-19T06:06:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 157617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-03-19T06:06:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-03-19T06:06:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 52929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-03-19T06:06:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 69617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-03-19T06:06:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 55953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-03-19T06:06:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 75969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/net2272.ko 2024-03-19T06:06:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 74985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/net2280.ko 2024-03-19T06:06:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 73017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-03-19T06:06:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 65881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-03-19T06:06:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 66001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-03-19T06:06:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 81409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-03-19T06:06:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 156337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-03-19T06:06:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/ 2024-03-19T06:06:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/bcma-hcd.ko 2024-03-19T06:06:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 80017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/isp116x-hcd.ko 2024-03-19T06:06:34.786 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 87193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-03-19T06:06:34.786 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 78777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-03-19T06:06:34.786 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-19T06:06:34.786 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/sl811_cs.ko 2024-03-19T06:06:34.786 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/ssb-hcd.ko 2024-03-19T06:06:34.786 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-03-19T06:06:34.786 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image/ 2024-03-19T06:06:34.786 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image/mdc800.ko 2024-03-19T06:06:34.786 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image/microtek.ko 2024-03-19T06:06:34.787 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/ 2024-03-19T06:06:34.787 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/adutux.ko 2024-03-19T06:06:34.787 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/appledisplay.ko 2024-03-19T06:06:34.787 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-03-19T06:06:34.787 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/cytherm.ko 2024-03-19T06:06:34.787 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/ehset.ko 2024-03-19T06:06:34.787 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/emi26.ko 2024-03-19T06:06:34.787 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/emi62.ko 2024-03-19T06:06:34.787 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/ezusb.ko 2024-03-19T06:06:34.787 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/idmouse.ko 2024-03-19T06:06:34.787 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/iowarrior.ko 2024-03-19T06:06:34.787 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-19T06:06:34.788 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/ldusb.ko 2024-03-19T06:06:34.788 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36105 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/legousbtower.ko 2024-03-19T06:06:34.788 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/lvstest.ko 2024-03-19T06:06:34.788 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/sisusbvga/ 2024-03-19T06:06:34.788 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 64745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-19T06:06:34.788 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-19T06:06:34.788 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usb3503.ko 2024-03-19T06:06:34.788 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usblcd.ko 2024-03-19T06:06:34.788 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-19T06:06:34.789 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usbtest.ko 2024-03-19T06:06:34.789 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/uss720.ko 2024-03-19T06:06:34.789 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/yurex.ko 2024-03-19T06:06:34.789 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/mon/ 2024-03-19T06:06:34.789 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 72825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/mon/usbmon.ko 2024-03-19T06:06:34.789 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/musb/ 2024-03-19T06:06:34.789 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 301633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/musb/musb_hdrc.ko 2024-03-19T06:06:34.789 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy/ 2024-03-19T06:06:34.789 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy/phy-generic.ko 2024-03-19T06:06:34.789 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-03-19T06:06:34.790 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy/phy-isp1301.ko 2024-03-19T06:06:34.790 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy/phy-tahvo.ko 2024-03-19T06:06:34.790 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ 2024-03-19T06:06:34.790 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/aircable.ko 2024-03-19T06:06:34.790 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ark3116.ko 2024-03-19T06:06:34.790 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-19T06:06:34.790 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ch341.ko 2024-03-19T06:06:34.790 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cp210x.ko 2024-03-19T06:06:34.790 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cyberjack.ko 2024-03-19T06:06:34.790 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 58121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-19T06:06:34.790 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-19T06:06:34.791 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/empeg.ko 2024-03-19T06:06:34.791 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/f81232.ko 2024-03-19T06:06:34.791 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 175105 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-19T06:06:34.791 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-19T06:06:34.791 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 136985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-19T06:06:34.791 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 124745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/io_ti.ko 2024-03-19T06:06:34.791 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 67681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ipaq.ko 2024-03-19T06:06:34.791 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ipw.ko 2024-03-19T06:06:34.791 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ir-usb.ko 2024-03-19T06:06:34.791 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 58137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-19T06:06:34.791 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 107433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/keyspan.ko 2024-03-19T06:06:34.791 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-19T06:06:34.791 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-19T06:06:34.791 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-19T06:06:34.792 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mct_u232.ko 2024-03-19T06:06:34.792 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/metro-usb.ko 2024-03-19T06:06:34.792 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 66361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mos7720.ko 2024-03-19T06:06:34.792 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 78129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mos7840.ko 2024-03-19T06:06:34.792 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 56249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mxuport.ko 2024-03-19T06:06:34.792 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/navman.ko 2024-03-19T06:06:34.792 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/omninet.ko 2024-03-19T06:06:34.792 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/opticon.ko 2024-03-19T06:06:34.792 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 191825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/option.ko 2024-03-19T06:06:34.792 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/oti6858.ko 2024-03-19T06:06:34.792 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/pl2303.ko 2024-03-19T06:06:34.792 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/qcaux.ko 2024-03-19T06:06:34.792 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/qcserial.ko 2024-03-19T06:06:34.792 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/quatech2.ko 2024-03-19T06:06:34.792 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/safe_serial.ko 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/sierra.ko 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ssu100.ko 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/symbolserial.ko 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 61393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb_debug.ko 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 125529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usbserial.ko 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/visor.ko 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/whiteheat.ko 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/wishbone-serial.ko 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 52761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/uas.ko 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-19T06:06:34.793 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-19T06:06:34.794 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-19T06:06:34.794 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-19T06:06:34.794 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-19T06:06:34.794 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-19T06:06:34.794 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-19T06:06:34.794 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-karma.ko 2024-03-19T06:06:34.794 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-19T06:06:34.794 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-19T06:06:34.794 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-19T06:06:34.794 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-19T06:06:34.794 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-19T06:06:34.794 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 180329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/usb-storage.ko 2024-03-19T06:06:34.794 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/ 2024-03-19T06:06:34.794 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 67401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 71025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 104065 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/ 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci/ 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 162865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 103673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/vfio.ko 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 76441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/ 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 113665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost.ko 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 58001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_net.ko 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 89057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_scsi.ko 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/ 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/ 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-03-19T06:06:34.795 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/aat2870_bl.ko 2024-03-19T06:06:34.796 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/adp5520_bl.ko 2024-03-19T06:06:34.796 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/adp8860_bl.ko 2024-03-19T06:06:34.796 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/adp8870_bl.ko 2024-03-19T06:06:34.796 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/apple_bl.ko 2024-03-19T06:06:34.796 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/as3711_bl.ko 2024-03-19T06:06:34.796 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/bd6107.ko 2024-03-19T06:06:34.796 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/da903x_bl.ko 2024-03-19T06:06:34.796 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/da9052_bl.ko 2024-03-19T06:06:34.796 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/gpio_backlight.ko 2024-03-19T06:06:34.796 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/kb3886_bl.ko 2024-03-19T06:06:34.796 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/lcd.ko 2024-03-19T06:06:34.796 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/lm3533_bl.ko 2024-03-19T06:06:34.796 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/lm3639_bl.ko 2024-03-19T06:06:34.796 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/lv5207lp.ko 2024-03-19T06:06:34.797 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/max8925_bl.ko 2024-03-19T06:06:34.797 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/pandora_bl.ko 2024-03-19T06:06:34.797 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-03-19T06:06:34.797 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-19T06:06:34.797 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/wm831x_bl.ko 2024-03-19T06:06:34.797 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/ 2024-03-19T06:06:34.797 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/ 2024-03-19T06:06:34.797 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/ds2482.ko 2024-03-19T06:06:34.797 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/ds2490.ko 2024-03-19T06:06:34.797 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/matrox_w1.ko 2024-03-19T06:06:34.797 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11273 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/w1-gpio.ko 2024-03-19T06:06:34.797 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/ 2024-03-19T06:06:34.797 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-19T06:06:34.797 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-19T06:06:34.797 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-19T06:06:34.797 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-19T06:06:34.798 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-19T06:06:34.798 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-19T06:06:34.798 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-19T06:06:34.798 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-19T06:06:34.798 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-19T06:06:34.798 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-19T06:06:34.798 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 56337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-19T06:06:34.798 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 103049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/wire.ko 2024-03-19T06:06:34.798 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ 2024-03-19T06:06:34.798 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/acquirewdt.ko 2024-03-19T06:06:34.798 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/advantechwdt.ko 2024-03-19T06:06:34.798 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18465 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-19T06:06:34.798 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-19T06:06:34.798 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/cpu5wdt.ko 2024-03-19T06:06:34.799 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/da9052_wdt.ko 2024-03-19T06:06:34.799 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/da9055_wdt.ko 2024-03-19T06:06:34.799 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/da9063_wdt.ko 2024-03-19T06:06:34.799 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/dw_wdt.ko 2024-03-19T06:06:34.799 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/eurotechwdt.ko 2024-03-19T06:06:34.799 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-19T06:06:34.799 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/hpwdt.ko 2024-03-19T06:06:34.799 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/i6300esb.ko 2024-03-19T06:06:34.799 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-19T06:06:34.799 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-19T06:06:34.799 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ib700wdt.ko 2024-03-19T06:06:34.799 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ibmasr.ko 2024-03-19T06:06:34.799 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-19T06:06:34.799 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-19T06:06:34.799 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/it87_wdt.ko 2024-03-19T06:06:34.799 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/kempld_wdt.ko 2024-03-19T06:06:34.800 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/machzwd.ko 2024-03-19T06:06:34.800 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/mena21_wdt.ko 2024-03-19T06:06:34.800 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-03-19T06:06:34.800 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/nv_tco.ko 2024-03-19T06:06:34.800 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-03-19T06:06:34.800 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/pc87413_wdt.ko 2024-03-19T06:06:34.800 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-19T06:06:34.800 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-19T06:06:34.800 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/retu_wdt.ko 2024-03-19T06:06:34.800 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-03-19T06:06:34.800 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-03-19T06:06:34.800 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-19T06:06:34.800 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sc1200wdt.ko 2024-03-19T06:06:34.800 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-19T06:06:34.800 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-03-19T06:06:34.801 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/softdog.ko 2024-03-19T06:06:34.801 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-19T06:06:34.801 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/twl4030_wdt.ko 2024-03-19T06:06:34.801 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/via_wdt.ko 2024-03-19T06:06:34.801 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-19T06:06:34.801 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-19T06:06:34.801 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-19T06:06:34.801 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/wafer5823wdt.ko 2024-03-19T06:06:34.801 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/wdt_pci.ko 2024-03-19T06:06:34.801 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/wm831x_wdt.ko 2024-03-19T06:06:34.801 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/wm8350_wdt.ko 2024-03-19T06:06:34.801 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/xen_wdt.ko 2024-03-19T06:06:34.801 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/ 2024-03-19T06:06:34.801 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-evtchn.ko 2024-03-19T06:06:34.802 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-gntalloc.ko 2024-03-19T06:06:34.802 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-gntdev.ko 2024-03-19T06:06:34.802 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-pciback/ 2024-03-19T06:06:34.802 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 176385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-19T06:06:34.802 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-privcmd.ko 2024-03-19T06:06:34.802 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 71153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-scsiback.ko 2024-03-19T06:06:34.802 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xenfs/ 2024-03-19T06:06:34.802 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-19T06:06:34.802 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ 2024-03-19T06:06:34.802 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/9p/ 2024-03-19T06:06:34.802 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 158281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/9p/9p.ko 2024-03-19T06:06:34.802 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/adfs/ 2024-03-19T06:06:34.802 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 61721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/adfs/adfs.ko 2024-03-19T06:06:34.802 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/affs/ 2024-03-19T06:06:34.803 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 163417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/affs/affs.ko 2024-03-19T06:06:34.803 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/afs/ 2024-03-19T06:06:34.803 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1019225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/afs/kafs.ko 2024-03-19T06:06:34.803 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/autofs/ 2024-03-19T06:06:34.803 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 103225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/autofs/autofs4.ko 2024-03-19T06:06:34.803 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/befs/ 2024-03-19T06:06:34.803 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 64625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/befs/befs.ko 2024-03-19T06:06:34.803 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/bfs/ 2024-03-19T06:06:34.803 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/bfs/bfs.ko 2024-03-19T06:06:34.803 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/binfmt_misc.ko 2024-03-19T06:06:34.803 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/btrfs/ 2024-03-19T06:06:34.803 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 3487553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/btrfs/btrfs.ko 2024-03-19T06:06:34.804 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cachefiles/ 2024-03-19T06:06:34.804 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 305897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cachefiles/cachefiles.ko 2024-03-19T06:06:34.804 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ceph/ 2024-03-19T06:06:34.804 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1335721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ceph/ceph.ko 2024-03-19T06:06:34.804 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/coda/ 2024-03-19T06:06:34.804 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 97769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/coda/coda.ko 2024-03-19T06:06:34.804 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/configfs/ 2024-03-19T06:06:34.804 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 108577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/configfs/configfs.ko 2024-03-19T06:06:34.804 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cramfs/ 2024-03-19T06:06:34.804 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cramfs/cramfs.ko 2024-03-19T06:06:34.804 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/dlm/ 2024-03-19T06:06:34.804 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 644249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/dlm/dlm.ko 2024-03-19T06:06:34.804 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/efs/ 2024-03-19T06:06:34.804 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/efs/efs.ko 2024-03-19T06:06:34.804 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/f2fs/ 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1527665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/f2fs/f2fs.ko 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat/ 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat/msdos.ko 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/freevxfs/ 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/freevxfs/freevxfs.ko 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fuse/ 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fuse/cuse.ko 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/gfs2/ 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1231361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/gfs2/gfs2.ko 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfs/ 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 141713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfs/hfs.ko 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfsplus/ 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 223281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfsplus/hfsplus.ko 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hpfs/ 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 193545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hpfs/hpfs.ko 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/isofs/ 2024-03-19T06:06:34.805 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 74737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/isofs/isofs.ko 2024-03-19T06:06:34.806 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/jfs/ 2024-03-19T06:06:34.806 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 420449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/jfs/jfs.ko 2024-03-19T06:06:34.806 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/lockd/ 2024-03-19T06:06:34.806 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 281705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/lockd/lockd.ko 2024-03-19T06:06:34.806 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/minix/ 2024-03-19T06:06:34.806 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 88937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/minix/minix.ko 2024-03-19T06:06:34.806 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/netfs/ 2024-03-19T06:06:34.806 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 490505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/netfs/netfs.ko 2024-03-19T06:06:34.806 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/ 2024-03-19T06:06:34.806 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/blocklayout/ 2024-03-19T06:06:34.806 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 81457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-19T06:06:34.806 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/filelayout/ 2024-03-19T06:06:34.806 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-19T06:06:34.806 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/flexfilelayout/ 2024-03-19T06:06:34.807 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 117377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-19T06:06:34.807 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1058377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfs.ko 2024-03-19T06:06:34.807 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 66361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfsv2.ko 2024-03-19T06:06:34.807 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 120193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfsv3.ko 2024-03-19T06:06:34.807 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 2041825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfsv4.ko 2024-03-19T06:06:34.863 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common/ 2024-03-19T06:06:34.863 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common/grace.ko 2024-03-19T06:06:34.863 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common/nfs_acl.ko 2024-03-19T06:06:34.863 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfsd/ 2024-03-19T06:06:34.863 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1511665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfsd/nfsd.ko 2024-03-19T06:06:34.863 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nilfs2/ 2024-03-19T06:06:34.863 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 582529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nilfs2/nilfs2.ko 2024-03-19T06:06:34.863 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/ 2024-03-19T06:06:34.863 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-celtic.ko 2024-03-19T06:06:34.864 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-centeuro.ko 2024-03-19T06:06:34.864 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-croatian.ko 2024-03-19T06:06:34.864 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-cyrillic.ko 2024-03-19T06:06:34.864 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-gaelic.ko 2024-03-19T06:06:34.864 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-greek.ko 2024-03-19T06:06:34.864 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-iceland.ko 2024-03-19T06:06:34.864 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-inuit.ko 2024-03-19T06:06:34.864 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-roman.ko 2024-03-19T06:06:34.864 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-romanian.ko 2024-03-19T06:06:34.864 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-turkish.ko 2024-03-19T06:06:34.864 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_ascii.ko 2024-03-19T06:06:34.864 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1250.ko 2024-03-19T06:06:34.864 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1251.ko 2024-03-19T06:06:34.864 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1255.ko 2024-03-19T06:06:34.864 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp737.ko 2024-03-19T06:06:34.865 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp775.ko 2024-03-19T06:06:34.865 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp850.ko 2024-03-19T06:06:34.865 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp852.ko 2024-03-19T06:06:34.865 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp855.ko 2024-03-19T06:06:34.865 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp857.ko 2024-03-19T06:06:34.865 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp860.ko 2024-03-19T06:06:34.865 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13065 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp861.ko 2024-03-19T06:06:34.865 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp862.ko 2024-03-19T06:06:34.865 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13065 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp863.ko 2024-03-19T06:06:34.865 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp864.ko 2024-03-19T06:06:34.865 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13065 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp865.ko 2024-03-19T06:06:34.865 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp866.ko 2024-03-19T06:06:34.865 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp869.ko 2024-03-19T06:06:34.865 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp874.ko 2024-03-19T06:06:34.865 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 94041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp932.ko 2024-03-19T06:06:34.866 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 142577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp936.ko 2024-03-19T06:06:34.866 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 165649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp949.ko 2024-03-19T06:06:34.866 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 118025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp950.ko 2024-03-19T06:06:34.866 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_euc-jp.ko 2024-03-19T06:06:34.866 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-1.ko 2024-03-19T06:06:34.866 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-13.ko 2024-03-19T06:06:34.866 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-14.ko 2024-03-19T06:06:34.866 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-15.ko 2024-03-19T06:06:34.866 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-2.ko 2024-03-19T06:06:34.866 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-3.ko 2024-03-19T06:06:34.866 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-4.ko 2024-03-19T06:06:34.866 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-5.ko 2024-03-19T06:06:34.866 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-6.ko 2024-03-19T06:06:34.866 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-7.ko 2024-03-19T06:06:34.867 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-9.ko 2024-03-19T06:06:34.867 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-r.ko 2024-03-19T06:06:34.867 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-ru.ko 2024-03-19T06:06:34.867 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-u.ko 2024-03-19T06:06:34.867 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-19T06:06:34.867 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_utf8.ko 2024-03-19T06:06:34.867 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ntfs/ 2024-03-19T06:06:34.867 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 220545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ntfs/ntfs.ko 2024-03-19T06:06:34.867 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ 2024-03-19T06:06:34.867 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/cluster/ 2024-03-19T06:06:34.867 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 244673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-19T06:06:34.867 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlm/ 2024-03-19T06:06:34.867 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 440681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-19T06:06:34.867 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlmfs/ 2024-03-19T06:06:34.867 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-19T06:06:34.867 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 2590849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2.ko 2024-03-19T06:06:34.868 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-19T06:06:34.868 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-19T06:06:34.868 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-19T06:06:34.868 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/omfs/ 2024-03-19T06:06:34.868 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/omfs/omfs.ko 2024-03-19T06:06:34.868 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/overlayfs/ 2024-03-19T06:06:34.868 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 360953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/overlayfs/overlay.ko 2024-03-19T06:06:34.868 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/pstore/ 2024-03-19T06:06:34.868 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 56945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/pstore/ramoops.ko 2024-03-19T06:06:34.868 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/qnx4/ 2024-03-19T06:06:34.868 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/qnx4/qnx4.ko 2024-03-19T06:06:34.868 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/qnx6/ 2024-03-19T06:06:34.868 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/qnx6/qnx6.ko 2024-03-19T06:06:34.868 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/quota/ 2024-03-19T06:06:34.869 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/quota/quota_tree.ko 2024-03-19T06:06:34.869 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/quota/quota_v1.ko 2024-03-19T06:06:34.869 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/quota/quota_v2.ko 2024-03-19T06:06:34.869 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/reiserfs/ 2024-03-19T06:06:34.869 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 532289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/reiserfs/reiserfs.ko 2024-03-19T06:06:34.869 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/romfs/ 2024-03-19T06:06:34.869 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/romfs/romfs.ko 2024-03-19T06:06:34.869 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/ 2024-03-19T06:06:34.869 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/client/ 2024-03-19T06:06:34.869 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 2712601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/client/cifs.ko 2024-03-19T06:06:34.870 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common/ 2024-03-19T06:06:34.870 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7065 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common/cifs_arc4.ko 2024-03-19T06:06:34.870 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common/cifs_md4.ko 2024-03-19T06:06:34.870 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/squashfs/ 2024-03-19T06:06:34.870 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 134809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/squashfs/squashfs.ko 2024-03-19T06:06:34.870 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/sysv/ 2024-03-19T06:06:34.870 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 91329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/sysv/sysv.ko 2024-03-19T06:06:34.870 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/udf/ 2024-03-19T06:06:34.870 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 248409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/udf/udf.ko 2024-03-19T06:06:34.870 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ufs/ 2024-03-19T06:06:34.870 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 162785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ufs/ufs.ko 2024-03-19T06:06:34.870 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/xfs/ 2024-03-19T06:06:34.870 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 4036193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/xfs/xfs.ko 2024-03-19T06:06:34.871 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/ 2024-03-19T06:06:34.871 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/locking/ 2024-03-19T06:06:34.871 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 80489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/locking/locktorture.ko 2024-03-19T06:06:34.871 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/time/ 2024-03-19T06:06:34.871 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/time/test_udelay.ko 2024-03-19T06:06:34.871 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 60265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/torture.ko 2024-03-19T06:06:34.871 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ 2024-03-19T06:06:34.871 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crc-itu-t.ko 2024-03-19T06:06:34.871 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crc7.ko 2024-03-19T06:06:34.871 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crc8.ko 2024-03-19T06:06:34.871 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto/ 2024-03-19T06:06:34.871 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto/libarc4.ko 2024-03-19T06:06:34.871 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto/libdes.ko 2024-03-19T06:06:34.871 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/interval_tree_test.ko 2024-03-19T06:06:34.872 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/libcrc32c.ko 2024-03-19T06:06:34.872 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lru_cache.ko 2024-03-19T06:06:34.872 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4/ 2024-03-19T06:06:34.872 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4/lz4_compress.ko 2024-03-19T06:06:34.872 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4/lz4hc_compress.ko 2024-03-19T06:06:34.872 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/math/ 2024-03-19T06:06:34.872 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/math/cordic.ko 2024-03-19T06:06:34.872 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/memory-notifier-error-inject.ko 2024-03-19T06:06:34.872 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/notifier-error-inject.ko 2024-03-19T06:06:34.872 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/percpu_test.ko 2024-03-19T06:06:34.872 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/pm-notifier-error-inject.ko 2024-03-19T06:06:34.872 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/raid6/ 2024-03-19T06:06:34.872 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 143337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/raid6/raid6_pq.ko 2024-03-19T06:06:34.872 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/rbtree_test.ko 2024-03-19T06:06:34.872 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/reed_solomon/ 2024-03-19T06:06:34.873 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-19T06:06:34.873 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/test-kstrtox.ko 2024-03-19T06:06:34.873 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/test-string_helpers.ko 2024-03-19T06:06:34.873 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 4863225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/test_bpf.ko 2024-03-19T06:06:34.873 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/test_firmware.ko 2024-03-19T06:06:34.873 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/test_module.ko 2024-03-19T06:06:34.873 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/test_user_copy.ko 2024-03-19T06:06:34.873 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_bm.ko 2024-03-19T06:06:34.873 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_fsm.ko 2024-03-19T06:06:34.873 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_kmp.ko 2024-03-19T06:06:34.873 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/xz/ 2024-03-19T06:06:34.873 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/xz/xz_dec_test.ko 2024-03-19T06:06:34.873 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/mm/ 2024-03-19T06:06:34.873 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/mm/hwpoison-inject.ko 2024-03-19T06:06:34.873 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ 2024-03-19T06:06:34.874 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/ 2024-03-19T06:06:34.874 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 55777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/6lowpan.ko 2024-03-19T06:06:34.874 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_dest.ko 2024-03-19T06:06:34.874 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_fragment.ko 2024-03-19T06:06:34.874 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_hop.ko 2024-03-19T06:06:34.874 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-19T06:06:34.874 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_mobility.ko 2024-03-19T06:06:34.874 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_routing.ko 2024-03-19T06:06:34.874 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_udp.ko 2024-03-19T06:06:34.874 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/ 2024-03-19T06:06:34.874 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/garp.ko 2024-03-19T06:06:34.874 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/mrp.ko 2024-03-19T06:06:34.874 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/p8022.ko 2024-03-19T06:06:34.874 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/psnap.ko 2024-03-19T06:06:34.875 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/stp.ko 2024-03-19T06:06:34.875 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/8021q/ 2024-03-19T06:06:34.875 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 82897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/8021q/8021q.ko 2024-03-19T06:06:34.875 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/ 2024-03-19T06:06:34.875 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 198833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet.ko 2024-03-19T06:06:34.875 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_fd.ko 2024-03-19T06:06:34.875 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_rdma.ko 2024-03-19T06:06:34.875 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_virtio.ko 2024-03-19T06:06:34.875 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/batman-adv/ 2024-03-19T06:06:34.875 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 667545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/batman-adv/batman-adv.ko 2024-03-19T06:06:34.875 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/ 2024-03-19T06:06:34.875 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 67769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/br_netfilter.ko 2024-03-19T06:06:34.875 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 790673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/bridge.ko 2024-03-19T06:06:34.875 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ 2024-03-19T06:06:34.876 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-19T06:06:34.876 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-19T06:06:34.876 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-19T06:06:34.876 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-19T06:06:34.876 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-19T06:06:34.876 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-19T06:06:34.876 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-19T06:06:34.876 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-19T06:06:34.876 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-19T06:06:34.876 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-19T06:06:34.877 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-19T06:06:34.877 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-19T06:06:34.877 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-19T06:06:34.877 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-19T06:06:34.877 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-19T06:06:34.877 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-19T06:06:34.877 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-19T06:06:34.878 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-19T06:06:34.878 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-19T06:06:34.878 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-19T06:06:34.878 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 55945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtables.ko 2024-03-19T06:06:34.878 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-19T06:06:34.878 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-19T06:06:34.879 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ceph/ 2024-03-19T06:06:34.879 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1046825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ceph/libceph.ko 2024-03-19T06:06:34.879 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/core/ 2024-03-19T06:06:34.879 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 125705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/core/pktgen.ko 2024-03-19T06:06:34.879 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/ 2024-03-19T06:06:34.879 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 194505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp.ko 2024-03-19T06:06:34.880 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_diag.ko 2024-03-19T06:06:34.880 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 58745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_ipv4.ko 2024-03-19T06:06:34.880 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 61401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_ipv6.ko 2024-03-19T06:06:34.880 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/ 2024-03-19T06:06:34.880 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 390089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/dsa_core.ko 2024-03-19T06:06:34.880 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_brcm.ko 2024-03-19T06:06:34.881 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_dsa.ko 2024-03-19T06:06:34.881 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_none.ko 2024-03-19T06:06:34.881 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_trailer.ko 2024-03-19T06:06:34.881 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/hsr/ 2024-03-19T06:06:34.881 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 102073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/hsr/hsr.ko 2024-03-19T06:06:34.881 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/ 2024-03-19T06:06:34.881 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/6lowpan/ 2024-03-19T06:06:34.882 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-19T06:06:34.882 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 284721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/ieee802154.ko 2024-03-19T06:06:34.882 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-19T06:06:34.882 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ 2024-03-19T06:06:34.882 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ah4.ko 2024-03-19T06:06:34.882 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/esp4.ko 2024-03-19T06:06:34.882 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/fou.ko 2024-03-19T06:06:34.882 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/gre.ko 2024-03-19T06:06:34.883 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/inet_diag.ko 2024-03-19T06:06:34.883 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 61137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_gre.ko 2024-03-19T06:06:34.883 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 61513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_tunnel.ko 2024-03-19T06:06:34.883 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_vti.ko 2024-03-19T06:06:34.883 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ipcomp.ko 2024-03-19T06:06:34.883 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ipip.ko 2024-03-19T06:06:34.883 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ 2024-03-19T06:06:34.883 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-19T06:06:34.883 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-19T06:06:34.883 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-19T06:06:34.884 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ip_tables.ko 2024-03-19T06:06:34.884 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-19T06:06:34.884 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-03-19T06:06:34.884 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-19T06:06:34.884 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-19T06:06:34.884 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-19T06:06:34.884 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-03-19T06:06:34.884 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-19T06:06:34.884 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-19T06:06:34.884 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-19T06:06:34.884 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-19T06:06:34.884 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-19T06:06:34.884 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-19T06:06:34.884 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-19T06:06:34.884 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-19T06:06:34.885 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-19T06:06:34.885 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-03-19T06:06:34.885 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-19T06:06:34.885 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-19T06:06:34.885 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-19T06:06:34.885 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-19T06:06:34.885 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-19T06:06:34.885 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_bic.ko 2024-03-19T06:06:34.885 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_dctcp.ko 2024-03-19T06:06:34.885 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_diag.ko 2024-03-19T06:06:34.885 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_highspeed.ko 2024-03-19T06:06:34.885 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_htcp.ko 2024-03-19T06:06:34.885 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_hybla.ko 2024-03-19T06:06:34.886 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_illinois.ko 2024-03-19T06:06:34.886 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_lp.ko 2024-03-19T06:06:34.886 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_scalable.ko 2024-03-19T06:06:34.886 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_vegas.ko 2024-03-19T06:06:34.886 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_veno.ko 2024-03-19T06:06:34.886 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_westwood.ko 2024-03-19T06:06:34.886 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_yeah.ko 2024-03-19T06:06:34.886 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tunnel4.ko 2024-03-19T06:06:34.886 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/udp_diag.ko 2024-03-19T06:06:34.886 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/udp_tunnel.ko 2024-03-19T06:06:34.886 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-19T06:06:34.886 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ 2024-03-19T06:06:34.886 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ah6.ko 2024-03-19T06:06:34.886 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/esp6.ko 2024-03-19T06:06:34.887 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/fou6.ko 2024-03-19T06:06:34.887 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 79929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_gre.ko 2024-03-19T06:06:34.887 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 94169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_tunnel.ko 2024-03-19T06:06:34.887 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-19T06:06:34.887 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54273 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_vti.ko 2024-03-19T06:06:34.887 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ipcomp6.ko 2024-03-19T06:06:34.887 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/mip6.ko 2024-03-19T06:06:34.887 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ 2024-03-19T06:06:34.887 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-19T06:06:34.887 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-03-19T06:06:34.887 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-19T06:06:34.887 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-19T06:06:34.887 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-19T06:06:34.887 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-19T06:06:34.887 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-19T06:06:34.888 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-19T06:06:34.888 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-19T06:06:34.888 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-19T06:06:34.888 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-19T06:06:34.888 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-19T06:06:34.888 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-19T06:06:34.888 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-19T06:06:34.888 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-19T06:06:34.888 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-19T06:06:34.888 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-19T06:06:34.888 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-19T06:06:34.888 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-19T06:06:34.888 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-19T06:06:34.888 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-19T06:06:34.889 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-19T06:06:34.889 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-19T06:06:34.889 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-19T06:06:34.889 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-19T06:06:34.889 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 74881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/sit.ko 2024-03-19T06:06:34.889 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/tunnel6.ko 2024-03-19T06:06:34.889 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-19T06:06:34.889 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/key/ 2024-03-19T06:06:34.889 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 84401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/key/af_key.ko 2024-03-19T06:06:34.889 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/ 2024-03-19T06:06:34.889 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 125209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_core.ko 2024-03-19T06:06:34.889 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-19T06:06:34.889 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_eth.ko 2024-03-19T06:06:34.889 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ip.ko 2024-03-19T06:06:34.890 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ip6.ko 2024-03-19T06:06:34.890 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_netlink.ko 2024-03-19T06:06:34.890 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ppp.ko 2024-03-19T06:06:34.890 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/lapb/ 2024-03-19T06:06:34.890 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/lapb/lapb.ko 2024-03-19T06:06:34.890 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/llc/ 2024-03-19T06:06:34.890 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/llc/llc.ko 2024-03-19T06:06:34.890 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 268521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/llc/llc2.ko 2024-03-19T06:06:34.890 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/mac802154/ 2024-03-19T06:06:34.890 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 309417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/mac802154/mac802154.ko 2024-03-19T06:06:34.890 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/mpls/ 2024-03-19T06:06:34.890 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/mpls/mpls_gso.ko 2024-03-19T06:06:34.891 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ 2024-03-19T06:06:34.891 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ 2024-03-19T06:06:34.891 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 119705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set.ko 2024-03-19T06:06:34.891 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-19T06:06:34.891 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-19T06:06:34.891 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-19T06:06:34.891 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 99993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-19T06:06:34.891 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 100281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-19T06:06:34.891 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 102553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-19T06:06:34.891 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 102345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-19T06:06:34.891 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 111673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-19T06:06:34.892 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-19T06:06:34.892 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 108345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-19T06:06:34.892 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 112145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-19T06:06:34.892 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 112409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-19T06:06:34.892 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 110337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-19T06:06:34.892 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 113289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-19T06:06:34.892 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-19T06:06:34.892 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ 2024-03-19T06:06:34.892 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 412513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-19T06:06:34.892 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-19T06:06:34.892 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-19T06:06:34.892 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-19T06:06:34.892 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-19T06:06:34.893 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-19T06:06:34.893 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-19T06:06:34.893 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-19T06:06:34.893 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-19T06:06:34.893 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-19T06:06:34.893 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-19T06:06:34.893 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-19T06:06:34.893 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-19T06:06:34.893 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-19T06:06:34.893 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conncount.ko 2024-03-19T06:06:34.893 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 411769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack.ko 2024-03-19T06:06:34.893 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-19T06:06:34.894 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-19T06:06:34.894 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-19T06:06:34.894 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 118161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-19T06:06:34.894 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-19T06:06:34.894 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-19T06:06:34.894 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 108313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-19T06:06:34.894 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-19T06:06:34.894 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-19T06:06:34.894 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 66537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-19T06:06:34.894 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-19T06:06:34.894 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-19T06:06:34.894 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-19T06:06:34.894 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 92233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_flow_table.ko 2024-03-19T06:06:34.894 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-19T06:06:34.895 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_log_syslog.ko 2024-03-19T06:06:34.895 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 96521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat.ko 2024-03-19T06:06:34.895 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-19T06:06:34.895 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-19T06:06:34.895 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_irc.ko 2024-03-19T06:06:34.895 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_sip.ko 2024-03-19T06:06:34.895 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-19T06:06:34.895 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-19T06:06:34.895 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 623473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_tables.ko 2024-03-19T06:06:34.895 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink.ko 2024-03-19T06:06:34.895 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-19T06:06:34.895 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-03-19T06:06:34.895 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_log.ko 2024-03-19T06:06:34.895 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-19T06:06:34.896 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-19T06:06:34.896 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_chain_nat.ko 2024-03-19T06:06:34.896 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_compat.ko 2024-03-19T06:06:34.896 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_ct.ko 2024-03-19T06:06:34.896 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-19T06:06:34.896 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_fib.ko 2024-03-19T06:06:34.896 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-19T06:06:34.896 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_hash.ko 2024-03-19T06:06:34.896 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_limit.ko 2024-03-19T06:06:34.896 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_log.ko 2024-03-19T06:06:34.896 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_masq.ko 2024-03-19T06:06:34.896 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_nat.ko 2024-03-19T06:06:34.896 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_numgen.ko 2024-03-19T06:06:34.896 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_osf.ko 2024-03-19T06:06:34.896 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_queue.ko 2024-03-19T06:06:34.896 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_redir.ko 2024-03-19T06:06:34.897 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_reject.ko 2024-03-19T06:06:34.897 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_reject_inet.ko 2024-03-19T06:06:34.897 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_socket.ko 2024-03-19T06:06:34.897 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_synproxy.ko 2024-03-19T06:06:34.897 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_tproxy.ko 2024-03-19T06:06:34.897 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 89233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/x_tables.ko 2024-03-19T06:06:34.897 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_AUDIT.ko 2024-03-19T06:06:34.897 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-19T06:06:34.897 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-19T06:06:34.897 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-19T06:06:34.897 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CT.ko 2024-03-19T06:06:34.897 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_DSCP.ko 2024-03-19T06:06:34.897 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_HL.ko 2024-03-19T06:06:34.897 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_HMARK.ko 2024-03-19T06:06:34.897 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-19T06:06:34.898 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_LED.ko 2024-03-19T06:06:34.898 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_LOG.ko 2024-03-19T06:06:34.898 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-19T06:06:34.898 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NETMAP.ko 2024-03-19T06:06:34.898 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NFLOG.ko 2024-03-19T06:06:34.898 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-19T06:06:34.898 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_RATEEST.ko 2024-03-19T06:06:34.898 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-19T06:06:34.898 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_SECMARK.ko 2024-03-19T06:06:34.898 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-19T06:06:34.899 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-19T06:06:34.899 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TEE.ko 2024-03-19T06:06:34.899 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TPROXY.ko 2024-03-19T06:06:34.899 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TRACE.ko 2024-03-19T06:06:34.899 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_addrtype.ko 2024-03-19T06:06:34.900 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_bpf.ko 2024-03-19T06:06:34.900 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cgroup.ko 2024-03-19T06:06:34.900 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cluster.ko 2024-03-19T06:06:34.900 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_comment.ko 2024-03-19T06:06:34.900 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connbytes.ko 2024-03-19T06:06:34.900 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connlabel.ko 2024-03-19T06:06:34.900 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connlimit.ko 2024-03-19T06:06:34.901 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connmark.ko 2024-03-19T06:06:34.901 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_conntrack.ko 2024-03-19T06:06:34.901 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cpu.ko 2024-03-19T06:06:34.901 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_dccp.ko 2024-03-19T06:06:34.901 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_devgroup.ko 2024-03-19T06:06:34.901 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_dscp.ko 2024-03-19T06:06:34.902 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ecn.ko 2024-03-19T06:06:34.902 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_esp.ko 2024-03-19T06:06:34.902 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 43201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_hashlimit.ko 2024-03-19T06:06:34.902 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_helper.ko 2024-03-19T06:06:34.902 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_hl.ko 2024-03-19T06:06:34.903 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ipcomp.ko 2024-03-19T06:06:34.903 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_iprange.ko 2024-03-19T06:06:34.903 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ipvs.ko 2024-03-19T06:06:34.903 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_l2tp.ko 2024-03-19T06:06:34.903 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_length.ko 2024-03-19T06:06:34.903 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_limit.ko 2024-03-19T06:06:34.904 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_mac.ko 2024-03-19T06:06:34.904 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_mark.ko 2024-03-19T06:06:34.904 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_multiport.ko 2024-03-19T06:06:34.904 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_nat.ko 2024-03-19T06:06:34.904 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_nfacct.ko 2024-03-19T06:06:34.904 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_osf.ko 2024-03-19T06:06:34.905 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_owner.ko 2024-03-19T06:06:34.905 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_physdev.ko 2024-03-19T06:06:34.905 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_pkttype.ko 2024-03-19T06:06:34.905 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_policy.ko 2024-03-19T06:06:34.905 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_quota.ko 2024-03-19T06:06:34.905 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_rateest.ko 2024-03-19T06:06:34.906 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_realm.ko 2024-03-19T06:06:34.906 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_recent.ko 2024-03-19T06:06:34.906 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_sctp.ko 2024-03-19T06:06:34.906 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_set.ko 2024-03-19T06:06:34.906 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_socket.ko 2024-03-19T06:06:34.906 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_state.ko 2024-03-19T06:06:34.906 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_statistic.ko 2024-03-19T06:06:34.906 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_string.ko 2024-03-19T06:06:34.906 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_tcpmss.ko 2024-03-19T06:06:34.906 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_tcpudp.ko 2024-03-19T06:06:34.906 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_time.ko 2024-03-19T06:06:34.906 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_u32.ko 2024-03-19T06:06:34.906 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netlink/ 2024-03-19T06:06:34.906 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netlink/netlink_diag.ko 2024-03-19T06:06:34.907 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/nsh/ 2024-03-19T06:06:34.907 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/nsh/nsh.ko 2024-03-19T06:06:34.907 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/ 2024-03-19T06:06:34.907 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 384201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/openvswitch.ko 2024-03-19T06:06:34.907 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-geneve.ko 2024-03-19T06:06:34.907 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-gre.ko 2024-03-19T06:06:34.907 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-vxlan.ko 2024-03-19T06:06:34.907 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/packet/ 2024-03-19T06:06:34.907 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/packet/af_packet_diag.ko 2024-03-19T06:06:34.907 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/phonet/ 2024-03-19T06:06:34.907 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 112553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/phonet/phonet.ko 2024-03-19T06:06:34.907 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 55057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/phonet/pn_pep.ko 2024-03-19T06:06:34.907 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/ 2024-03-19T06:06:34.907 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 253961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds.ko 2024-03-19T06:06:34.908 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 165105 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds_rdma.ko 2024-03-19T06:06:34.908 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 68097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds_tcp.ko 2024-03-19T06:06:34.908 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/rxrpc/ 2024-03-19T06:06:34.908 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 828297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/rxrpc/rxrpc.ko 2024-03-19T06:06:34.908 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/ 2024-03-19T06:06:34.908 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_csum.ko 2024-03-19T06:06:34.908 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_gact.ko 2024-03-19T06:06:34.908 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_mirred.ko 2024-03-19T06:06:34.908 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_nat.ko 2024-03-19T06:06:34.908 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 43353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_pedit.ko 2024-03-19T06:06:34.908 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_police.ko 2024-03-19T06:06:34.908 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_simple.ko 2024-03-19T06:06:34.908 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_skbedit.ko 2024-03-19T06:06:34.908 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_vlan.ko 2024-03-19T06:06:34.908 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_basic.ko 2024-03-19T06:06:34.909 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_bpf.ko 2024-03-19T06:06:34.909 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_cgroup.ko 2024-03-19T06:06:34.909 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_flow.ko 2024-03-19T06:06:34.909 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_fw.ko 2024-03-19T06:06:34.909 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_route.ko 2024-03-19T06:06:34.909 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 62657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_u32.ko 2024-03-19T06:06:34.909 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7465 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_cmp.ko 2024-03-19T06:06:34.909 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_ipset.ko 2024-03-19T06:06:34.909 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_meta.ko 2024-03-19T06:06:34.909 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_nbyte.ko 2024-03-19T06:06:34.909 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_text.ko 2024-03-19T06:06:34.909 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7273 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_u32.ko 2024-03-19T06:06:34.909 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_choke.ko 2024-03-19T06:06:34.910 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_codel.ko 2024-03-19T06:06:34.910 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_drr.ko 2024-03-19T06:06:34.910 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_fq.ko 2024-03-19T06:06:34.910 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_fq_codel.ko 2024-03-19T06:06:34.910 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_gred.ko 2024-03-19T06:06:34.910 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_hfsc.ko 2024-03-19T06:06:34.911 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_hhf.ko 2024-03-19T06:06:34.911 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 66449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_htb.ko 2024-03-19T06:06:34.911 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_ingress.ko 2024-03-19T06:06:34.911 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_mqprio.ko 2024-03-19T06:06:34.911 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_mqprio_lib.ko 2024-03-19T06:06:34.911 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_multiq.ko 2024-03-19T06:06:34.911 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_netem.ko 2024-03-19T06:06:34.911 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_pie.ko 2024-03-19T06:06:34.911 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_plug.ko 2024-03-19T06:06:34.911 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_prio.ko 2024-03-19T06:06:34.911 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_qfq.ko 2024-03-19T06:06:34.911 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_red.ko 2024-03-19T06:06:34.912 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_sfb.ko 2024-03-19T06:06:34.912 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_sfq.ko 2024-03-19T06:06:34.912 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_tbf.ko 2024-03-19T06:06:34.912 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28273 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_teql.ko 2024-03-19T06:06:34.912 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp/ 2024-03-19T06:06:34.912 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 932945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp/sctp.ko 2024-03-19T06:06:34.912 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp/sctp_diag.ko 2024-03-19T06:06:34.912 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/ 2024-03-19T06:06:34.912 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss/ 2024-03-19T06:06:34.912 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 337009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-19T06:06:34.912 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 55041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-19T06:06:34.913 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1513905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/sunrpc.ko 2024-03-19T06:06:34.913 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/xprtrdma/ 2024-03-19T06:06:34.913 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 704761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-19T06:06:34.913 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc/ 2024-03-19T06:06:34.913 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc/diag.ko 2024-03-19T06:06:34.913 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 867249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc/tipc.ko 2024-03-19T06:06:34.913 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/unix/ 2024-03-19T06:06:34.913 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/unix/unix_diag.ko 2024-03-19T06:06:34.913 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/ 2024-03-19T06:06:34.913 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 87745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-19T06:06:34.913 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 67953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-19T06:06:34.913 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 98113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock.ko 2024-03-19T06:06:34.913 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-19T06:06:34.913 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-19T06:06:34.913 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/x25/ 2024-03-19T06:06:34.914 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 131273 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/x25/x25.ko 2024-03-19T06:06:34.914 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/xfrm/ 2024-03-19T06:06:34.914 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23065 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/xfrm/xfrm_algo.ko 2024-03-19T06:06:34.914 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-19T06:06:34.914 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 105217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/xfrm/xfrm_user.ko 2024-03-19T06:06:34.914 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/virt/ 2024-03-19T06:06:34.914 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/virt/lib/ 2024-03-19T06:06:34.914 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/virt/lib/irqbypass.ko 2024-03-19T06:06:34.914 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 642383 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.alias 2024-03-19T06:06:34.914 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 625850 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.alias.bin 2024-03-19T06:06:34.914 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7677 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.builtin 2024-03-19T06:06:34.914 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23498 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.builtin.alias.bin 2024-03-19T06:06:34.914 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9916 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.builtin.bin 2024-03-19T06:06:34.915 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70732 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.builtin.modinfo 2024-03-19T06:06:34.915 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 147214 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.dep 2024-03-19T06:06:34.915 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 233213 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.dep.bin 2024-03-19T06:06:34.915 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 210 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.devname 2024-03-19T06:06:34.915 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 72614 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.order 2024-03-19T06:06:34.915 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 879 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.softdep 2024-03-19T06:06:34.915 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 257955 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.symbols 2024-03-19T06:06:34.915 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 312782 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.symbols.bin 2024-03-19T06:06:34.915 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./usr/ 2024-03-19T06:06:34.915 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./usr/share/ 2024-03-19T06:06:34.915 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./usr/share/doc/ 2024-03-19T06:06:34.915 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./usr/share/doc/linux-image-6.8.0-g908b6b276e8f/ 2024-03-19T06:06:34.915 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 171 2024-03-19 02:25 ./usr/share/doc/linux-image-6.8.0-g908b6b276e8f/changelog.Debian.gz 2024-03-19T06:06:34.915 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 691 2024-03-19 02:25 ./usr/share/doc/linux-image-6.8.0-g908b6b276e8f/copyright 2024-03-19T06:06:34.922 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g908b6b276e8f 2024-03-19T06:06:34.922 INFO:teuthology.task.kernel:searching for kernel 6.8.0-g908b6b276e8f 2024-03-19T06:06:34.923 DEBUG:teuthology.orchestra.run.smithi171:> egrep '(submenu|menuentry.*6.8.0-g908b6b276e8f).*{' /boot/grub/grub.cfg 2024-03-19T06:06:34.929 INFO:teuthology.orchestra.run.smithi171.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-19T06:06:34.929 INFO:teuthology.orchestra.run.smithi171.stdout: menuentry 'Ubuntu, with Linux 6.8.0-g908b6b276e8f' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-g908b6b276e8f-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-19T06:06:34.929 INFO:teuthology.orchestra.run.smithi171.stdout: menuentry 'Ubuntu, with Linux 6.8.0-g908b6b276e8f (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-g908b6b276e8f-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-19T06:06:34.930 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-03-19T06:06:34.930 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.8.0-g908b6b276e8f 2024-03-19T06:06:34.930 DEBUG:teuthology.orchestra.run.smithi171:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-03-19T06:06:34.973 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi171.front.sepia.ceph.com to complete... 2024-03-19T06:06:35.357 INFO:teuthology.orchestra.run.smithi171.stderr:Sourcing file `/etc/default/grub' 2024-03-19T06:06:35.358 INFO:teuthology.orchestra.run.smithi171.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-19T06:06:35.370 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ... 2024-03-19T06:06:35.572 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-6.8.0-g908b6b276e8f 2024-03-19T06:06:35.578 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-6.8.0-g908b6b276e8f 2024-03-19T06:06:35.816 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-19T06:06:35.821 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-19T06:06:35.862 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-19T06:06:35.867 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-19T06:06:35.999 INFO:teuthology.orchestra.run.smithi171.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-19T06:06:35.999 INFO:teuthology.orchestra.run.smithi171.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-19T06:06:35.999 INFO:teuthology.orchestra.run.smithi171.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-19T06:06:36.018 INFO:teuthology.orchestra.run.smithi171.stderr:done 2024-03-19T06:06:39.633 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub' 2024-03-19T06:06:39.639 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-19T06:06:39.662 INFO:teuthology.orchestra.run.smithi032.stderr:Generating grub configuration file ... 2024-03-19T06:06:39.967 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-6.8.0-g908b6b276e8f 2024-03-19T06:06:39.983 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-6.8.0-g908b6b276e8f 2024-03-19T06:06:40.340 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-19T06:06:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-19T06:06:40.415 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-19T06:06:40.420 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-19T06:06:40.575 INFO:teuthology.orchestra.run.smithi032.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-19T06:06:40.575 INFO:teuthology.orchestra.run.smithi032.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-19T06:06:40.575 INFO:teuthology.orchestra.run.smithi032.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-19T06:06:40.620 INFO:teuthology.orchestra.run.smithi032.stderr:done 2024-03-19T06:06:40.770 DEBUG:teuthology.orchestra.run.smithi032:> dpkg-deb -c /tmp/linux-image.deb 2024-03-19T06:06:40.778 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./ 2024-03-19T06:06:40.778 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./boot/ 2024-03-19T06:06:40.778 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 4474370 2024-03-19 02:25 ./boot/System.map-6.8.0-g908b6b276e8f 2024-03-19T06:06:40.790 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 170904 2024-03-19 02:25 ./boot/config-6.8.0-g908b6b276e8f 2024-03-19T06:06:40.790 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11555840 2024-03-19 02:25 ./boot/vmlinuz-6.8.0-g908b6b276e8f 2024-03-19T06:06:40.810 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./etc/ 2024-03-19T06:06:40.810 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./etc/kernel/ 2024-03-19T06:06:40.810 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./etc/kernel/postinst.d/ 2024-03-19T06:06:40.810 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./etc/kernel/postrm.d/ 2024-03-19T06:06:40.810 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./etc/kernel/preinst.d/ 2024-03-19T06:06:40.811 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./etc/kernel/prerm.d/ 2024-03-19T06:06:40.811 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/ 2024-03-19T06:06:40.811 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/ 2024-03-19T06:06:40.811 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/ 2024-03-19T06:06:40.811 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/ 2024-03-19T06:06:40.811 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/ 2024-03-19T06:06:40.811 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/ 2024-03-19T06:06:40.811 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/ 2024-03-19T06:06:40.811 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 490449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/aesni-intel.ko 2024-03-19T06:06:40.813 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-19T06:06:40.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-19T06:06:40.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-19T06:06:40.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 93081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-19T06:06:40.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 106697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-19T06:06:40.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 152145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-19T06:06:40.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-19T06:06:40.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-19T06:06:40.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 83857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-19T06:06:40.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-19T06:06:40.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-19T06:06:40.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-19T06:06:40.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-19T06:06:40.814 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-19T06:06:40.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-19T06:06:40.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-19T06:06:40.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-19T06:06:40.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-19T06:06:40.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-19T06:06:40.815 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/ 2024-03-19T06:06:40.815 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu/ 2024-03-19T06:06:40.815 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu/mce/ 2024-03-19T06:06:40.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-19T06:06:40.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpuid.ko 2024-03-19T06:06:40.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/msr.ko 2024-03-19T06:06:40.815 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/ 2024-03-19T06:06:40.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 354265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-19T06:06:40.815 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 886177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-19T06:06:40.816 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 2294937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm.ko 2024-03-19T06:06:40.828 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/ 2024-03-19T06:06:40.828 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/af_alg.ko 2024-03-19T06:06:40.828 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/algif_hash.ko 2024-03-19T06:06:40.828 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/algif_skcipher.ko 2024-03-19T06:06:40.828 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/ansi_cprng.ko 2024-03-19T06:06:40.828 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/anubis.ko 2024-03-19T06:06:40.828 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/arc4.ko 2024-03-19T06:06:40.828 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/asymmetric_keys/ 2024-03-19T06:06:40.829 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-03-19T06:06:40.829 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/ 2024-03-19T06:06:40.829 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_memcpy.ko 2024-03-19T06:06:40.829 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_pq.ko 2024-03-19T06:06:40.829 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-19T06:06:40.829 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_tx.ko 2024-03-19T06:06:40.829 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_xor.ko 2024-03-19T06:06:40.829 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/raid6test.ko 2024-03-19T06:06:40.829 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/authenc.ko 2024-03-19T06:06:40.829 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/authencesn.ko 2024-03-19T06:06:40.829 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blake2b_generic.ko 2024-03-19T06:06:40.829 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blowfish_common.ko 2024-03-19T06:06:40.829 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blowfish_generic.ko 2024-03-19T06:06:40.829 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/camellia_generic.ko 2024-03-19T06:06:40.829 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast5_generic.ko 2024-03-19T06:06:40.830 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast6_generic.ko 2024-03-19T06:06:40.830 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast_common.ko 2024-03-19T06:06:40.830 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/ccm.ko 2024-03-19T06:06:40.830 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cmac.ko 2024-03-19T06:06:40.830 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crc32_generic.ko 2024-03-19T06:06:40.830 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cryptd.ko 2024-03-19T06:06:40.830 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crypto_engine.ko 2024-03-19T06:06:40.830 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crypto_simd.ko 2024-03-19T06:06:40.830 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crypto_user.ko 2024-03-19T06:06:40.830 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cts.ko 2024-03-19T06:06:40.830 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/des_generic.ko 2024-03-19T06:06:40.830 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/dh_generic.ko 2024-03-19T06:06:40.830 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/echainiv.ko 2024-03-19T06:06:40.830 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/essiv.ko 2024-03-19T06:06:40.831 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/fcrypt.ko 2024-03-19T06:06:40.831 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/khazad.ko 2024-03-19T06:06:40.831 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/lrw.ko 2024-03-19T06:06:40.831 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/lz4.ko 2024-03-19T06:06:40.831 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/lz4hc.ko 2024-03-19T06:06:40.831 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/md4.ko 2024-03-19T06:06:40.831 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/michael_mic.ko 2024-03-19T06:06:40.831 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/pcbc.ko 2024-03-19T06:06:40.831 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/pcrypt.ko 2024-03-19T06:06:40.831 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/rmd160.ko 2024-03-19T06:06:40.831 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/seed.ko 2024-03-19T06:06:40.831 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/serpent_generic.ko 2024-03-19T06:06:40.831 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 143033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/tcrypt.ko 2024-03-19T06:06:40.831 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/tea.ko 2024-03-19T06:06:40.831 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/twofish_common.ko 2024-03-19T06:06:40.832 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/twofish_generic.ko 2024-03-19T06:06:40.832 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/vmac.ko 2024-03-19T06:06:40.832 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/wp512.ko 2024-03-19T06:06:40.832 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xcbc.ko 2024-03-19T06:06:40.832 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xor.ko 2024-03-19T06:06:40.832 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xts.ko 2024-03-19T06:06:40.832 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xxhash_generic.ko 2024-03-19T06:06:40.832 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ 2024-03-19T06:06:40.832 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/ 2024-03-19T06:06:40.832 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/acpi_extlog.ko 2024-03-19T06:06:40.832 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-19T06:06:40.832 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/acpi_pad.ko 2024-03-19T06:06:40.832 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/apei/ 2024-03-19T06:06:40.832 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/apei/einj.ko 2024-03-19T06:06:40.832 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/ec_sys.ko 2024-03-19T06:06:40.833 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/platform_profile.ko 2024-03-19T06:06:40.833 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/sbs.ko 2024-03-19T06:06:40.833 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/sbshc.ko 2024-03-19T06:06:40.833 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 104433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/video.ko 2024-03-19T06:06:40.833 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/ 2024-03-19T06:06:40.833 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/acard-ahci.ko 2024-03-19T06:06:40.833 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/ahci.ko 2024-03-19T06:06:40.833 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/ahci_platform.ko 2024-03-19T06:06:40.833 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 88313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/libahci.ko 2024-03-19T06:06:40.833 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/libahci_platform.ko 2024-03-19T06:06:40.833 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_acpi.ko 2024-03-19T06:06:40.833 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ali.ko 2024-03-19T06:06:40.833 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_amd.ko 2024-03-19T06:06:40.833 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_artop.ko 2024-03-19T06:06:40.833 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_atiixp.ko 2024-03-19T06:06:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_atp867x.ko 2024-03-19T06:06:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cmd640.ko 2024-03-19T06:06:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cmd64x.ko 2024-03-19T06:06:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cypress.ko 2024-03-19T06:06:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_efar.ko 2024-03-19T06:06:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt366.ko 2024-03-19T06:06:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt37x.ko 2024-03-19T06:06:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-19T06:06:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-19T06:06:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_it8213.ko 2024-03-19T06:06:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_it821x.ko 2024-03-19T06:06:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_jmicron.ko 2024-03-19T06:06:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_legacy.ko 2024-03-19T06:06:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_marvell.ko 2024-03-19T06:06:40.835 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_mpiix.ko 2024-03-19T06:06:40.835 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_netcell.ko 2024-03-19T06:06:40.835 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ninja32.ko 2024-03-19T06:06:40.835 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ns87410.ko 2024-03-19T06:06:40.835 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ns87415.ko 2024-03-19T06:06:40.835 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_oldpiix.ko 2024-03-19T06:06:40.835 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_opti.ko 2024-03-19T06:06:40.835 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_optidma.ko 2024-03-19T06:06:40.835 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pcmcia.ko 2024-03-19T06:06:40.835 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-19T06:06:40.835 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-19T06:06:40.835 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_piccolo.ko 2024-03-19T06:06:40.835 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_radisys.ko 2024-03-19T06:06:40.835 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_rdc.ko 2024-03-19T06:06:40.835 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_rz1000.ko 2024-03-19T06:06:40.836 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sch.ko 2024-03-19T06:06:40.836 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_serverworks.ko 2024-03-19T06:06:40.836 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sil680.ko 2024-03-19T06:06:40.836 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sl82c105.ko 2024-03-19T06:06:40.836 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_triflex.ko 2024-03-19T06:06:40.836 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_via.ko 2024-03-19T06:06:40.836 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pdc_adma.ko 2024-03-19T06:06:40.836 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_inic162x.ko 2024-03-19T06:06:40.836 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 83257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_mv.ko 2024-03-19T06:06:40.836 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_nv.ko 2024-03-19T06:06:40.836 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_promise.ko 2024-03-19T06:06:40.836 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_qstor.ko 2024-03-19T06:06:40.836 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sil.ko 2024-03-19T06:06:40.836 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sil24.ko 2024-03-19T06:06:40.836 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sis.ko 2024-03-19T06:06:40.836 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_svw.ko 2024-03-19T06:06:40.837 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sx4.ko 2024-03-19T06:06:40.837 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_uli.ko 2024-03-19T06:06:40.837 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_via.ko 2024-03-19T06:06:40.837 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_vsc.ko 2024-03-19T06:06:40.837 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/auxdisplay/ 2024-03-19T06:06:40.837 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/auxdisplay/ks0108.ko 2024-03-19T06:06:40.837 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/bcma/ 2024-03-19T06:06:40.837 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 124457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/bcma/bcma.ko 2024-03-19T06:06:40.837 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/ 2024-03-19T06:06:40.837 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/aoe/ 2024-03-19T06:06:40.837 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 113833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/aoe/aoe.ko 2024-03-19T06:06:40.837 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/drbd/ 2024-03-19T06:06:40.837 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 964817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/drbd/drbd.ko 2024-03-19T06:06:40.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 169705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/floppy.ko 2024-03-19T06:06:40.866 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/mtip32xx/ 2024-03-19T06:06:40.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 94217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-19T06:06:40.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 116337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/nbd.ko 2024-03-19T06:06:40.866 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/null_blk/ 2024-03-19T06:06:40.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 110329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/null_blk/null_blk.ko 2024-03-19T06:06:40.866 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 98193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/pktcdvd.ko 2024-03-19T06:06:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 263641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/rbd.ko 2024-03-19T06:06:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/xen-blkback/ 2024-03-19T06:06:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 98121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-19T06:06:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/zram/ 2024-03-19T06:06:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/zram/zram.ko 2024-03-19T06:06:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ 2024-03-19T06:06:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/applicom.ko 2024-03-19T06:06:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hangcheck-timer.ko 2024-03-19T06:06:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/ 2024-03-19T06:06:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-19T06:06:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-19T06:06:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-19T06:06:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/via-rng.ko 2024-03-19T06:06:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-19T06:06:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ 2024-03-19T06:06:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-19T06:06:40.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 148521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-19T06:06:40.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-19T06:06:40.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 139361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-19T06:06:40.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-19T06:06:40.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-19T06:06:40.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/lp.ko 2024-03-19T06:06:40.868 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/mwave/ 2024-03-19T06:06:40.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 84025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/mwave/mwave.ko 2024-03-19T06:06:40.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/nvram.ko 2024-03-19T06:06:40.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ppdev.ko 2024-03-19T06:06:40.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tlclk.ko 2024-03-19T06:06:40.868 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/ 2024-03-19T06:06:40.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-19T06:06:40.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-03-19T06:06:40.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-03-19T06:06:40.868 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-03-19T06:06:40.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-19T06:06:40.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-19T06:06:40.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23465 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-03-19T06:06:40.869 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/xillybus/ 2024-03-19T06:06:40.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/xillybus/xillybus_class.ko 2024-03-19T06:06:40.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/xillybus/xillybus_core.ko 2024-03-19T06:06:40.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-03-19T06:06:40.869 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/clk/ 2024-03-19T06:06:40.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/clk/clk-palmas.ko 2024-03-19T06:06:40.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/clk/clk-si5351.ko 2024-03-19T06:06:40.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/clk/clk-twl6040.ko 2024-03-19T06:06:40.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/clk/clk-wm831x.ko 2024-03-19T06:06:40.869 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/ 2024-03-19T06:06:40.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-19T06:06:40.869 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-19T06:06:40.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-19T06:06:40.870 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ 2024-03-19T06:06:40.870 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp/ 2024-03-19T06:06:40.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-19T06:06:40.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 246841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp/ccp.ko 2024-03-19T06:06:40.870 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/ 2024-03-19T06:06:40.870 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/ 2024-03-19T06:06:40.870 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_common/ 2024-03-19T06:06:40.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 570497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-19T06:06:40.870 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-03-19T06:06:40.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-19T06:06:40.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/padlock-aes.ko 2024-03-19T06:06:40.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/padlock-sha.ko 2024-03-19T06:06:40.870 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/virtio/ 2024-03-19T06:06:40.870 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-19T06:06:40.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dca/ 2024-03-19T06:06:40.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dca/dca.ko 2024-03-19T06:06:40.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/ 2024-03-19T06:06:40.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/dw/ 2024-03-19T06:06:40.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-19T06:06:40.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/ioat/ 2024-03-19T06:06:40.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 122817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-19T06:06:40.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/ 2024-03-19T06:06:40.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 80305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/amd64_edac.ko 2024-03-19T06:06:40.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/e752x_edac.ko 2024-03-19T06:06:40.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/edac_mce_amd.ko 2024-03-19T06:06:40.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i3000_edac.ko 2024-03-19T06:06:40.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i3200_edac.ko 2024-03-19T06:06:40.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i5100_edac.ko 2024-03-19T06:06:40.871 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i5400_edac.ko 2024-03-19T06:06:40.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i7300_edac.ko 2024-03-19T06:06:40.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i7core_edac.ko 2024-03-19T06:06:40.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18273 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i82975x_edac.ko 2024-03-19T06:06:40.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/ie31200_edac.ko 2024-03-19T06:06:40.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/sb_edac.ko 2024-03-19T06:06:40.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/x38_edac.ko 2024-03-19T06:06:40.872 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/extcon/ 2024-03-19T06:06:40.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/extcon/extcon-gpio.ko 2024-03-19T06:06:40.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/extcon/extcon-max14577.ko 2024-03-19T06:06:40.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/extcon/extcon-max77693.ko 2024-03-19T06:06:40.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/extcon/extcon-max8997.ko 2024-03-19T06:06:40.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/extcon/extcon-palmas.ko 2024-03-19T06:06:40.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/extcon/extcon-rt8973a.ko 2024-03-19T06:06:40.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/extcon/extcon-sm5502.ko 2024-03-19T06:06:40.872 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/ 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/dmi-sysfs.ko 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/efi/ 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/efi/efi-pstore.ko 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/ 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-adp5520.ko 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-amd8111.ko 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-arizona.ko 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-da9052.ko 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-da9055.ko 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-dln2.ko 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 77753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-f7188x.ko 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-generic.ko 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-ich.ko 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-kempld.ko 2024-03-19T06:06:40.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-lp3943.ko 2024-03-19T06:06:40.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-max7300.ko 2024-03-19T06:06:40.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-max730x.ko 2024-03-19T06:06:40.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-max732x.ko 2024-03-19T06:06:40.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-03-19T06:06:40.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-pca953x.ko 2024-03-19T06:06:40.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-pcf857x.ko 2024-03-19T06:06:40.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-rdc321x.ko 2024-03-19T06:06:40.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-sch.ko 2024-03-19T06:06:40.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-sch311x.ko 2024-03-19T06:06:40.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-tps65912.ko 2024-03-19T06:06:40.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-twl4030.ko 2024-03-19T06:06:40.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-twl6040.ko 2024-03-19T06:06:40.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-19T06:06:40.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-vx855.ko 2024-03-19T06:06:40.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-wm831x.ko 2024-03-19T06:06:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-wm8350.ko 2024-03-19T06:06:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-wm8994.ko 2024-03-19T06:06:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/ 2024-03-19T06:06:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-a4tech.ko 2024-03-19T06:06:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-apple.ko 2024-03-19T06:06:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-appleir.ko 2024-03-19T06:06:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-aureal.ko 2024-03-19T06:06:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-axff.ko 2024-03-19T06:06:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-belkin.ko 2024-03-19T06:06:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-cherry.ko 2024-03-19T06:06:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-chicony.ko 2024-03-19T06:06:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-cp2112.ko 2024-03-19T06:06:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-cypress.ko 2024-03-19T06:06:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-dr.ko 2024-03-19T06:06:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-elecom.ko 2024-03-19T06:06:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-elo.ko 2024-03-19T06:06:40.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-emsff.ko 2024-03-19T06:06:40.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-ezkey.ko 2024-03-19T06:06:40.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gaff.ko 2024-03-19T06:06:40.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-generic.ko 2024-03-19T06:06:40.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gt683r.ko 2024-03-19T06:06:40.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gyration.ko 2024-03-19T06:06:40.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-19T06:06:40.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-19T06:06:40.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtekff.ko 2024-03-19T06:06:40.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-hyperv.ko 2024-03-19T06:06:40.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-icade.ko 2024-03-19T06:06:40.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-kensington.ko 2024-03-19T06:06:40.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-keytouch.ko 2024-03-19T06:06:40.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-kye.ko 2024-03-19T06:06:40.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-lcpower.ko 2024-03-19T06:06:40.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-led.ko 2024-03-19T06:06:40.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-lenovo.ko 2024-03-19T06:06:40.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-lg-g15.ko 2024-03-19T06:06:40.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-19T06:06:40.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 101545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-19T06:06:40.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 80921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-logitech.ko 2024-03-19T06:06:40.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-magicmouse.ko 2024-03-19T06:06:40.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-microsoft.ko 2024-03-19T06:06:40.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-monterey.ko 2024-03-19T06:06:40.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-multitouch.ko 2024-03-19T06:06:40.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-ntrig.ko 2024-03-19T06:06:40.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-ortek.ko 2024-03-19T06:06:40.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-penmount.ko 2024-03-19T06:06:40.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-petalynx.ko 2024-03-19T06:06:40.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 72865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-picolcd.ko 2024-03-19T06:06:40.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-pl.ko 2024-03-19T06:06:40.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-plantronics.ko 2024-03-19T06:06:40.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-primax.ko 2024-03-19T06:06:40.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-rmi.ko 2024-03-19T06:06:40.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-19T06:06:40.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-common.ko 2024-03-19T06:06:40.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-19T06:06:40.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-19T06:06:40.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-19T06:06:40.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-19T06:06:40.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-19T06:06:40.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-19T06:06:40.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-19T06:06:40.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-19T06:06:40.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-19T06:06:40.878 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat.ko 2024-03-19T06:06:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-saitek.ko 2024-03-19T06:06:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-samsung.ko 2024-03-19T06:06:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-19T06:06:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sjoy.ko 2024-03-19T06:06:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sony.ko 2024-03-19T06:06:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-speedlink.ko 2024-03-19T06:06:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-steelseries.ko 2024-03-19T06:06:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sunplus.ko 2024-03-19T06:06:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-19T06:06:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-tivo.ko 2024-03-19T06:06:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-tmff.ko 2024-03-19T06:06:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-topseed.ko 2024-03-19T06:06:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-twinhan.ko 2024-03-19T06:06:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-uclogic.ko 2024-03-19T06:06:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-waltop.ko 2024-03-19T06:06:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 143393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-wiimote.ko 2024-03-19T06:06:40.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8065 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-xinmo.ko 2024-03-19T06:06:40.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-zpff.ko 2024-03-19T06:06:40.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-zydacron.ko 2024-03-19T06:06:40.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 269233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid.ko 2024-03-19T06:06:40.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/uhid.ko 2024-03-19T06:06:40.880 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/usbhid/ 2024-03-19T06:06:40.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 125641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/usbhid/usbhid.ko 2024-03-19T06:06:40.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/usbhid/usbkbd.ko 2024-03-19T06:06:40.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/usbhid/usbmouse.ko 2024-03-19T06:06:40.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 218881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/wacom.ko 2024-03-19T06:06:40.880 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/ 2024-03-19T06:06:40.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 64305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_balloon.ko 2024-03-19T06:06:40.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 90113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_utils.ko 2024-03-19T06:06:40.880 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 304953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_vmbus.ko 2024-03-19T06:06:40.881 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ 2024-03-19T06:06:40.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/abituguru.ko 2024-03-19T06:06:40.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/abituguru3.ko 2024-03-19T06:06:40.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-19T06:06:40.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ad7414.ko 2024-03-19T06:06:40.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ad7418.ko 2024-03-19T06:06:40.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adc128d818.ko 2024-03-19T06:06:40.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1025.ko 2024-03-19T06:06:40.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 97889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1026.ko 2024-03-19T06:06:40.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1029.ko 2024-03-19T06:06:40.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45465 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1031.ko 2024-03-19T06:06:40.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm9240.ko 2024-03-19T06:06:40.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ads7828.ko 2024-03-19T06:06:40.881 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7410.ko 2024-03-19T06:06:40.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7411.ko 2024-03-19T06:06:40.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7462.ko 2024-03-19T06:06:40.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7470.ko 2024-03-19T06:06:40.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7475.ko 2024-03-19T06:06:40.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7x10.ko 2024-03-19T06:06:40.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/amc6821.ko 2024-03-19T06:06:40.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/applesmc.ko 2024-03-19T06:06:40.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asb100.ko 2024-03-19T06:06:40.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asc7621.ko 2024-03-19T06:06:40.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-19T06:06:40.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/atxp1.ko 2024-03-19T06:06:40.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/coretemp.ko 2024-03-19T06:06:40.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/da9052-hwmon.ko 2024-03-19T06:06:40.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/da9055-hwmon.ko 2024-03-19T06:06:40.882 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-19T06:06:40.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 99513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/dme1737.ko 2024-03-19T06:06:40.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ds1621.ko 2024-03-19T06:06:40.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ds620.ko 2024-03-19T06:06:40.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/emc1403.ko 2024-03-19T06:06:40.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/emc2103.ko 2024-03-19T06:06:40.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/emc6w201.ko 2024-03-19T06:06:40.883 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f71805f.ko 2024-03-19T06:06:40.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 94601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f71882fg.ko 2024-03-19T06:06:40.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f75375s.ko 2024-03-19T06:06:40.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/fam15h_power.ko 2024-03-19T06:06:40.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/fschmd.ko 2024-03-19T06:06:40.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/g760a.ko 2024-03-19T06:06:40.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/g762.ko 2024-03-19T06:06:40.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/gl518sm.ko 2024-03-19T06:06:40.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/gl520sm.ko 2024-03-19T06:06:40.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/hih6130.ko 2024-03-19T06:06:40.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-19T06:06:40.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/i5500_temp.ko 2024-03-19T06:06:40.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/i5k_amb.ko 2024-03-19T06:06:40.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ibmaem.ko 2024-03-19T06:06:40.884 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ibmpex.ko 2024-03-19T06:06:40.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ina209.ko 2024-03-19T06:06:40.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ina2xx.ko 2024-03-19T06:06:40.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 140137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/it87.ko 2024-03-19T06:06:40.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/jc42.ko 2024-03-19T06:06:40.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/k10temp.ko 2024-03-19T06:06:40.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/k8temp.ko 2024-03-19T06:06:40.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lineage-pem.ko 2024-03-19T06:06:40.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm63.ko 2024-03-19T06:06:40.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm73.ko 2024-03-19T06:06:40.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm75.ko 2024-03-19T06:06:40.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm77.ko 2024-03-19T06:06:40.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm78.ko 2024-03-19T06:06:40.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm80.ko 2024-03-19T06:06:40.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm83.ko 2024-03-19T06:06:40.885 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 72745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm85.ko 2024-03-19T06:06:40.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46065 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm87.ko 2024-03-19T06:06:40.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm90.ko 2024-03-19T06:06:40.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm92.ko 2024-03-19T06:06:40.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 108753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm93.ko 2024-03-19T06:06:40.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95234.ko 2024-03-19T06:06:40.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95241.ko 2024-03-19T06:06:40.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95245.ko 2024-03-19T06:06:40.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc2945.ko 2024-03-19T06:06:40.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4151.ko 2024-03-19T06:06:40.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15105 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4215.ko 2024-03-19T06:06:40.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4222.ko 2024-03-19T06:06:40.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4245.ko 2024-03-19T06:06:40.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4260.ko 2024-03-19T06:06:40.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4261.ko 2024-03-19T06:06:40.886 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max16065.ko 2024-03-19T06:06:40.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max1619.ko 2024-03-19T06:06:40.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max1668.ko 2024-03-19T06:06:40.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max197.ko 2024-03-19T06:06:40.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6639.ko 2024-03-19T06:06:40.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6650.ko 2024-03-19T06:06:40.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6697.ko 2024-03-19T06:06:40.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/mc13783-adc.ko 2024-03-19T06:06:40.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/mcp3021.ko 2024-03-19T06:06:40.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-03-19T06:06:40.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6683.ko 2024-03-19T06:06:40.887 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 119849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6775-core.ko 2024-03-19T06:06:40.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6775.ko 2024-03-19T06:06:40.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct7802.ko 2024-03-19T06:06:40.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 82721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pc87360.ko 2024-03-19T06:06:40.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pc87427.ko 2024-03-19T06:06:40.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pcf8591.ko 2024-03-19T06:06:40.888 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ 2024-03-19T06:06:40.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-19T06:06:40.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-19T06:06:40.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-19T06:06:40.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-19T06:06:40.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-19T06:06:40.888 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-19T06:06:40.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-19T06:06:40.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 82481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-19T06:06:40.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-19T06:06:40.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-19T06:06:40.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-19T06:06:40.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-19T06:06:40.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/powr1220.ko 2024-03-19T06:06:40.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch5627.ko 2024-03-19T06:06:40.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch5636.ko 2024-03-19T06:06:40.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-19T06:06:40.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sht15.ko 2024-03-19T06:06:40.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sht21.ko 2024-03-19T06:06:40.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/shtc1.ko 2024-03-19T06:06:40.889 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sis5595.ko 2024-03-19T06:06:40.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47b397.ko 2024-03-19T06:06:40.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47m1.ko 2024-03-19T06:06:40.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47m192.ko 2024-03-19T06:06:40.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26465 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/thmc50.ko 2024-03-19T06:06:40.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp102.ko 2024-03-19T06:06:40.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp103.ko 2024-03-19T06:06:40.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp401.ko 2024-03-19T06:06:40.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp421.ko 2024-03-19T06:06:40.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/via-cputemp.ko 2024-03-19T06:06:40.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/via686a.ko 2024-03-19T06:06:40.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/vt1211.ko 2024-03-19T06:06:40.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/vt8231.ko 2024-03-19T06:06:40.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83627ehf.ko 2024-03-19T06:06:40.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 79841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83627hf.ko 2024-03-19T06:06:40.890 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 71257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83781d.ko 2024-03-19T06:06:40.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 63137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83791d.ko 2024-03-19T06:06:40.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 71233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83792d.ko 2024-03-19T06:06:40.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 101385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83793.ko 2024-03-19T06:06:40.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 119417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83795.ko 2024-03-19T06:06:40.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83l785ts.ko 2024-03-19T06:06:40.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83l786ng.ko 2024-03-19T06:06:40.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-03-19T06:06:40.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-03-19T06:06:40.891 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/ 2024-03-19T06:06:40.891 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos/ 2024-03-19T06:06:40.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-19T06:06:40.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-19T06:06:40.891 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/ 2024-03-19T06:06:40.891 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-03-19T06:06:40.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-03-19T06:06:40.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-03-19T06:06:40.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-19T06:06:40.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-19T06:06:40.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-19T06:06:40.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-03-19T06:06:40.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-19T06:06:40.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-03-19T06:06:40.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-19T06:06:40.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-19T06:06:40.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-19T06:06:40.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-19T06:06:40.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-03-19T06:06:40.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-03-19T06:06:40.892 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-19T06:06:40.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-19T06:06:40.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-19T06:06:40.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-03-19T06:06:40.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-19T06:06:40.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-19T06:06:40.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-03-19T06:06:40.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-19T06:06:40.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-19T06:06:40.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-19T06:06:40.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-03-19T06:06:40.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-19T06:06:40.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-19T06:06:40.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-03-19T06:06:40.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-03-19T06:06:40.893 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-19T06:06:40.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-03-19T06:06:40.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-19T06:06:40.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-19T06:06:40.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-19T06:06:40.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-19T06:06:40.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-03-19T06:06:40.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-mux.ko 2024-03-19T06:06:40.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-smbus.ko 2024-03-19T06:06:40.894 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-stub.ko 2024-03-19T06:06:40.894 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/muxes/ 2024-03-19T06:06:40.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-03-19T06:06:40.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-03-19T06:06:40.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-03-19T06:06:40.895 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ 2024-03-19T06:06:40.895 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ 2024-03-19T06:06:40.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 273529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-19T06:06:40.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 883945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_core.ko 2024-03-19T06:06:40.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-19T06:06:40.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 324337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-19T06:06:40.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 97841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-19T06:06:40.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 282345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-19T06:06:40.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-19T06:06:40.895 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/ 2024-03-19T06:06:40.895 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/cxgb4/ 2024-03-19T06:06:40.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 493185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-19T06:06:40.928 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx4/ 2024-03-19T06:06:40.929 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 420593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-19T06:06:40.929 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx5/ 2024-03-19T06:06:40.929 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 741737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-19T06:06:40.929 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mthca/ 2024-03-19T06:06:40.929 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 296881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-19T06:06:40.929 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/ocrdma/ 2024-03-19T06:06:40.929 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 153729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-03-19T06:06:40.929 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/usnic/ 2024-03-19T06:06:40.929 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 169145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-03-19T06:06:40.929 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/ 2024-03-19T06:06:40.929 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/ipoib/ 2024-03-19T06:06:40.929 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 266577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-19T06:06:40.930 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/iser/ 2024-03-19T06:06:40.930 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 100281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-19T06:06:40.930 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/isert/ 2024-03-19T06:06:40.930 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 111337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-19T06:06:40.930 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srp/ 2024-03-19T06:06:40.930 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 128665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-19T06:06:40.930 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srpt/ 2024-03-19T06:06:40.930 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 129801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-19T06:06:40.930 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/ 2024-03-19T06:06:40.930 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/evbug.ko 2024-03-19T06:06:40.930 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/ff-memless.ko 2024-03-19T06:06:40.930 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/ 2024-03-19T06:06:40.930 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-19T06:06:40.930 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-19T06:06:40.931 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/gameport.ko 2024-03-19T06:06:40.931 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/joydev.ko 2024-03-19T06:06:40.931 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/ 2024-03-19T06:06:40.931 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-03-19T06:06:40.931 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-03-19T06:06:40.931 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-03-19T06:06:40.931 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-03-19T06:06:40.931 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-19T06:06:40.931 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-03-19T06:06:40.931 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/lkkbd.ko 2024-03-19T06:06:40.931 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/lm8323.ko 2024-03-19T06:06:40.931 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/lm8333.ko 2024-03-19T06:06:40.931 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-03-19T06:06:40.931 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-03-19T06:06:40.931 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-03-19T06:06:40.932 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-03-19T06:06:40.932 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/newtonkbd.ko 2024-03-19T06:06:40.932 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-03-19T06:06:40.932 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/qt1070.ko 2024-03-19T06:06:40.932 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/qt2160.ko 2024-03-19T06:06:40.932 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-03-19T06:06:40.932 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/stowaway.ko 2024-03-19T06:06:40.932 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/sunkbd.ko 2024-03-19T06:06:40.932 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-03-19T06:06:40.932 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-03-19T06:06:40.932 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-03-19T06:06:40.932 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/xtkbd.ko 2024-03-19T06:06:40.932 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/matrix-keymap.ko 2024-03-19T06:06:40.932 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/ 2024-03-19T06:06:40.933 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/appletouch.ko 2024-03-19T06:06:40.933 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/bcm5974.ko 2024-03-19T06:06:40.933 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 123201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/cyapatp.ko 2024-03-19T06:06:40.933 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-19T06:06:40.933 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/gpio_mouse.ko 2024-03-19T06:06:40.933 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 335921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/psmouse.ko 2024-03-19T06:06:40.933 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/sermouse.ko 2024-03-19T06:06:40.933 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-19T06:06:40.933 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-19T06:06:40.933 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-19T06:06:40.933 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/rmi4/ 2024-03-19T06:06:40.933 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 109601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-19T06:06:40.933 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/ 2024-03-19T06:06:40.933 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/altera_ps2.ko 2024-03-19T06:06:40.934 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/arc_ps2.ko 2024-03-19T06:06:40.934 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/ct82c710.ko 2024-03-19T06:06:40.934 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-19T06:06:40.934 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/parkbd.ko 2024-03-19T06:06:40.934 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/pcips2.ko 2024-03-19T06:06:40.934 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/ps2mult.ko 2024-03-19T06:06:40.934 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/serio_raw.ko 2024-03-19T06:06:40.934 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/serport.ko 2024-03-19T06:06:40.934 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/sparse-keymap.ko 2024-03-19T06:06:40.934 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/ 2024-03-19T06:06:40.934 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-88pm860x.ko 2024-03-19T06:06:40.934 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-adp5520.ko 2024-03-19T06:06:40.934 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-bd2802.ko 2024-03-19T06:06:40.934 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-blinkm.ko 2024-03-19T06:06:40.935 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-da903x.ko 2024-03-19T06:06:40.935 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-da9052.ko 2024-03-19T06:06:40.935 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-gpio.ko 2024-03-19T06:06:40.935 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lm3530.ko 2024-03-19T06:06:40.935 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lm3533.ko 2024-03-19T06:06:40.935 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lm355x.ko 2024-03-19T06:06:40.935 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lm3642.ko 2024-03-19T06:06:40.935 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lp3944.ko 2024-03-19T06:06:40.935 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lp8788.ko 2024-03-19T06:06:40.935 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-max8997.ko 2024-03-19T06:06:40.935 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-mc13783.ko 2024-03-19T06:06:40.935 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-menf21bmc.ko 2024-03-19T06:06:40.935 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-pca9532.ko 2024-03-19T06:06:40.935 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-pca955x.ko 2024-03-19T06:06:40.935 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-pca963x.ko 2024-03-19T06:06:40.935 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-ss4200.ko 2024-03-19T06:06:40.936 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-tca6507.ko 2024-03-19T06:06:40.936 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-wm831x-status.ko 2024-03-19T06:06:40.936 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-wm8350.ko 2024-03-19T06:06:40.936 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ 2024-03-19T06:06:40.936 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-19T06:06:40.936 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-19T06:06:40.936 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-19T06:06:40.936 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-19T06:06:40.936 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-19T06:06:40.936 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-19T06:06:40.936 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-19T06:06:40.936 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-19T06:06:40.936 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-19T06:06:40.936 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/ 2024-03-19T06:06:40.936 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/bcache/ 2024-03-19T06:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 647121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/bcache/bcache.ko 2024-03-19T06:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-bio-prison.ko 2024-03-19T06:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 93321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-bufio.ko 2024-03-19T06:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-cache-smq.ko 2024-03-19T06:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 155825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-cache.ko 2024-03-19T06:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 107937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-crypt.ko 2024-03-19T06:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-delay.ko 2024-03-19T06:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-era.ko 2024-03-19T06:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-flakey.ko 2024-03-19T06:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-log-userspace.ko 2024-03-19T06:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-log.ko 2024-03-19T06:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-mirror.ko 2024-03-19T06:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 77881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-multipath.ko 2024-03-19T06:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-queue-length.ko 2024-03-19T06:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-raid.ko 2024-03-19T06:06:40.938 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-region-hash.ko 2024-03-19T06:06:40.938 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-round-robin.ko 2024-03-19T06:06:40.938 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-service-time.ko 2024-03-19T06:06:40.938 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 109457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-snapshot.ko 2024-03-19T06:06:40.938 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-switch.ko 2024-03-19T06:06:40.938 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 181777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-thin-pool.ko 2024-03-19T06:06:40.938 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-verity.ko 2024-03-19T06:06:40.938 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-zero.ko 2024-03-19T06:06:40.938 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/persistent-data/ 2024-03-19T06:06:40.938 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 199881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-19T06:06:40.938 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid0.ko 2024-03-19T06:06:40.938 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 100841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid1.ko 2024-03-19T06:06:40.938 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 126369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid10.ko 2024-03-19T06:06:40.938 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 368497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid456.ko 2024-03-19T06:06:40.939 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/ 2024-03-19T06:06:40.939 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/ 2024-03-19T06:06:40.939 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 178049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptbase.ko 2024-03-19T06:06:40.939 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 63241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptctl.ko 2024-03-19T06:06:40.939 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptfc.ko 2024-03-19T06:06:40.939 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptlan.ko 2024-03-19T06:06:40.939 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 123233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptsas.ko 2024-03-19T06:06:40.939 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 80921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptscsih.ko 2024-03-19T06:06:40.939 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptspi.ko 2024-03-19T06:06:40.939 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/ 2024-03-19T06:06:40.939 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/88pm800.ko 2024-03-19T06:06:40.939 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/88pm805.ko 2024-03-19T06:06:40.939 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11105 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/88pm80x.ko 2024-03-19T06:06:40.939 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/arizona-i2c.ko 2024-03-19T06:06:40.939 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 123649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/arizona.ko 2024-03-19T06:06:40.940 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/bcm590xx.ko 2024-03-19T06:06:40.940 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/cros_ec_dev.ko 2024-03-19T06:06:40.940 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/dln2.ko 2024-03-19T06:06:40.940 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/janz-cmodio.ko 2024-03-19T06:06:40.940 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/kempld-core.ko 2024-03-19T06:06:40.940 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lm3533-core.ko 2024-03-19T06:06:40.940 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-03-19T06:06:40.940 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lp3943.ko 2024-03-19T06:06:40.940 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lpc_ich.ko 2024-03-19T06:06:40.940 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lpc_sch.ko 2024-03-19T06:06:40.940 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/max8907.ko 2024-03-19T06:06:40.940 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/mc13xxx-core.ko 2024-03-19T06:06:40.940 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-03-19T06:06:40.940 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/menf21bmc.ko 2024-03-19T06:06:40.940 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/pcf50633-adc.ko 2024-03-19T06:06:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/pcf50633-gpio.ko 2024-03-19T06:06:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/pcf50633.ko 2024-03-19T06:06:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-03-19T06:06:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/retu-mfd.ko 2024-03-19T06:06:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 80345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/si476x-core.ko 2024-03-19T06:06:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/sm501.ko 2024-03-19T06:06:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/tps65010.ko 2024-03-19T06:06:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/tps6507x.ko 2024-03-19T06:06:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/viperboard.ko 2024-03-19T06:06:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/vx855.ko 2024-03-19T06:06:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/wl1273-core.ko 2024-03-19T06:06:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/wm8994.ko 2024-03-19T06:06:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ 2024-03-19T06:06:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-03-19T06:06:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ad525x_dpot.ko 2024-03-19T06:06:40.941 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/altera-stapl/ 2024-03-19T06:06:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-19T06:06:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/apds9802als.ko 2024-03-19T06:06:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/apds990x.ko 2024-03-19T06:06:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/bh1770glc.ko 2024-03-19T06:06:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/c2port/ 2024-03-19T06:06:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-03-19T06:06:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/c2port/core.ko 2024-03-19T06:06:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/cb710/ 2024-03-19T06:06:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/cb710/cb710.ko 2024-03-19T06:06:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ds1682.ko 2024-03-19T06:06:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/dummy-irq.ko 2024-03-19T06:06:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/echo/ 2024-03-19T06:06:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/echo/echo.ko 2024-03-19T06:06:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/ 2024-03-19T06:06:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/at24.ko 2024-03-19T06:06:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-19T06:06:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/max6875.ko 2024-03-19T06:06:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/enclosure.ko 2024-03-19T06:06:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/genwqe/ 2024-03-19T06:06:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 152073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-03-19T06:06:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/hmc6352.ko 2024-03-19T06:06:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/hpilo.ko 2024-03-19T06:06:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ibmasm/ 2024-03-19T06:06:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 72561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-03-19T06:06:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ics932s401.ko 2024-03-19T06:06:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/isl29003.ko 2024-03-19T06:06:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/isl29020.ko 2024-03-19T06:06:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d/ 2024-03-19T06:06:40.943 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-19T06:06:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-19T06:06:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/ 2024-03-19T06:06:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 126153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei-me.ko 2024-03-19T06:06:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei-txe.ko 2024-03-19T06:06:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 313601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei.ko 2024-03-19T06:06:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/phantom.ko 2024-03-19T06:06:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ti-st/ 2024-03-19T06:06:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/ti-st/st_drv.ko 2024-03-19T06:06:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tifm_7xx1.ko 2024-03-19T06:06:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tifm_core.ko 2024-03-19T06:06:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tsl2550.ko 2024-03-19T06:06:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_balloon.ko 2024-03-19T06:06:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_vmci/ 2024-03-19T06:06:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 183569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-19T06:06:40.944 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ 2024-03-19T06:06:40.945 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/bonding/ 2024-03-19T06:06:40.945 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 491609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/bonding/bonding.ko 2024-03-19T06:06:40.945 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/ 2024-03-19T06:06:40.945 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/b53/ 2024-03-19T06:06:40.945 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 105937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-19T06:06:40.945 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-19T06:06:40.945 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-19T06:06:40.945 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6xxx/ 2024-03-19T06:06:40.945 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 459001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-19T06:06:40.945 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dummy.ko 2024-03-19T06:06:40.945 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/eql.ko 2024-03-19T06:06:40.945 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ 2024-03-19T06:06:40.945 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/ 2024-03-19T06:06:40.945 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-19T06:06:40.945 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-19T06:06:40.946 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 130665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-19T06:06:40.946 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 68785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-19T06:06:40.946 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/ 2024-03-19T06:06:40.946 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-19T06:06:40.946 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 64617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-19T06:06:40.946 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-19T06:06:40.946 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 101617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-19T06:06:40.946 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/adaptec/ 2024-03-19T06:06:40.946 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-19T06:06:40.946 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/agere/ 2024-03-19T06:06:40.946 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-19T06:06:40.946 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/alteon/ 2024-03-19T06:06:40.946 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-19T06:06:40.947 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/altera/ 2024-03-19T06:06:40.947 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-19T06:06:40.947 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/ 2024-03-19T06:06:40.947 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-19T06:06:40.947 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-19T06:06:40.947 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 87457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-19T06:06:40.947 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/ 2024-03-19T06:06:40.947 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/alx/ 2024-03-19T06:06:40.947 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 97201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-19T06:06:40.947 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-03-19T06:06:40.947 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-19T06:06:40.947 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-03-19T06:06:40.947 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 90209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-19T06:06:40.947 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx/ 2024-03-19T06:06:40.947 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 81321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-19T06:06:40.948 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-19T06:06:40.948 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/ 2024-03-19T06:06:40.948 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-19T06:06:40.948 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 176697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-19T06:06:40.948 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-03-19T06:06:40.948 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1434505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-19T06:06:40.948 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 128369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-19T06:06:40.948 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/genet/ 2024-03-19T06:06:40.948 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 131281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-19T06:06:40.948 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 314329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-19T06:06:40.948 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade/ 2024-03-19T06:06:40.948 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade/bna/ 2024-03-19T06:06:40.948 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 323737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-19T06:06:40.948 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/ 2024-03-19T06:06:40.949 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-03-19T06:06:40.949 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 193593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-19T06:06:40.949 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-03-19T06:06:40.949 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 347217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-19T06:06:40.949 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-03-19T06:06:40.949 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1045449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-19T06:06:40.949 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-03-19T06:06:40.949 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 166145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-19T06:06:40.949 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-03-19T06:06:40.949 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-19T06:06:40.949 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco/ 2024-03-19T06:06:40.949 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco/enic/ 2024-03-19T06:06:40.949 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 204249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-19T06:06:40.949 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/ 2024-03-19T06:06:40.949 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/ 2024-03-19T06:06:40.950 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-19T06:06:40.950 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-19T06:06:40.950 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 141201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-19T06:06:40.950 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-19T06:06:40.950 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-19T06:06:40.950 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-19T06:06:40.950 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink/ 2024-03-19T06:06:40.950 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-19T06:06:40.950 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-19T06:06:40.950 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dnet.ko 2024-03-19T06:06:40.950 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ec_bhf.ko 2024-03-19T06:06:40.950 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex/ 2024-03-19T06:06:40.950 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex/benet/ 2024-03-19T06:06:40.950 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 281217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-19T06:06:40.950 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ethoc.ko 2024-03-19T06:06:40.951 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/fealnx.ko 2024-03-19T06:06:40.951 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/fujitsu/ 2024-03-19T06:06:40.951 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-03-19T06:06:40.951 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ 2024-03-19T06:06:40.951 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 90305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-19T06:06:40.951 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000/ 2024-03-19T06:06:40.951 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 295697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-19T06:06:40.951 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000e/ 2024-03-19T06:06:40.951 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 584353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-19T06:06:40.951 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/fm10k/ 2024-03-19T06:06:40.951 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 246041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-19T06:06:40.951 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/i40e/ 2024-03-19T06:06:40.951 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 944545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-19T06:06:40.951 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/iavf/ 2024-03-19T06:06:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 288529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-19T06:06:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igb/ 2024-03-19T06:06:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 513673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-19T06:06:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igbvf/ 2024-03-19T06:06:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 93489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-19T06:06:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-03-19T06:06:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 735169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-19T06:06:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-03-19T06:06:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 151745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-19T06:06:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 86993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/jme.ko 2024-03-19T06:06:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/ 2024-03-19T06:06:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-19T06:06:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-19T06:06:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 122609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-19T06:06:40.952 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/ 2024-03-19T06:06:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-03-19T06:06:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 727481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-19T06:06:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 278881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-19T06:06:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-03-19T06:06:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-03-19T06:06:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1122297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-19T06:06:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel/ 2024-03-19T06:06:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-03-19T06:06:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-03-19T06:06:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-03-19T06:06:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 95577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-19T06:06:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom/ 2024-03-19T06:06:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-03-19T06:06:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 108409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-19T06:06:40.953 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi/ 2024-03-19T06:06:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 73617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-19T06:06:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-19T06:06:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/neterion/ 2024-03-19T06:06:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 151097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-19T06:06:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/nvidia/ 2024-03-19T06:06:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 136801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-19T06:06:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines/ 2024-03-19T06:06:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-19T06:06:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-19T06:06:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/ 2024-03-19T06:06:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-03-19T06:06:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 227865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-19T06:06:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 87017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-19T06:06:40.954 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-03-19T06:06:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 672057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-19T06:06:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rdc/ 2024-03-19T06:06:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-19T06:06:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/ 2024-03-19T06:06:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-19T06:06:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 83809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-19T06:06:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-19T06:06:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 194073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-19T06:06:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/samsung/ 2024-03-19T06:06:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-03-19T06:06:40.955 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 104049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-03-19T06:06:41.019 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sfc/ 2024-03-19T06:06:41.019 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1067001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-19T06:06:41.019 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/silan/ 2024-03-19T06:06:41.019 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-19T06:06:41.019 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis/ 2024-03-19T06:06:41.019 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 63201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/ 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 73257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 68049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/ 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 495777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/ 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 103185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 166049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66273 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/tehuti/ 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ti/ 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 92345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via/ 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 79937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 83721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet/ 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/xircom/ 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/fddi/ 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/fddi/defxx.ko 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/fddi/skfp/ 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 217113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/fddi/skfp/skfp.ko 2024-03-19T06:06:41.022 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/geneve.ko 2024-03-19T06:06:41.022 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/hyperv/ 2024-03-19T06:06:41.022 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 237265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-19T06:06:41.022 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ieee802154/ 2024-03-19T06:06:41.022 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-19T06:06:41.022 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ifb.ko 2024-03-19T06:06:41.022 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ipvlan/ 2024-03-19T06:06:41.022 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-19T06:06:41.022 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/macvlan.ko 2024-03-19T06:06:41.022 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/macvtap.ko 2024-03-19T06:06:41.022 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/ 2024-03-19T06:06:41.022 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-19T06:06:41.022 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-19T06:06:41.022 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-gpio.ko 2024-03-19T06:06:41.022 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-19T06:06:41.023 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio.ko 2024-03-19T06:06:41.023 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mii.ko 2024-03-19T06:06:41.023 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/netconsole.ko 2024-03-19T06:06:41.023 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/nlmon.ko 2024-03-19T06:06:41.023 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs/ 2024-03-19T06:06:41.023 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-19T06:06:41.023 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-19T06:06:41.023 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/ 2024-03-19T06:06:41.023 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/amd.ko 2024-03-19T06:06:41.023 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-19T06:06:41.023 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-19T06:06:41.023 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm87xx.ko 2024-03-19T06:06:41.023 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/broadcom.ko 2024-03-19T06:06:41.023 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/cicada.ko 2024-03-19T06:06:41.023 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/davicom.ko 2024-03-19T06:06:41.023 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/et1011c.ko 2024-03-19T06:06:41.024 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/icplus.ko 2024-03-19T06:06:41.024 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/lxt.ko 2024-03-19T06:06:41.024 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 81961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/marvell.ko 2024-03-19T06:06:41.024 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 76569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/micrel.ko 2024-03-19T06:06:41.024 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/national.ko 2024-03-19T06:06:41.024 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 99009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/phylink.ko 2024-03-19T06:06:41.024 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/qsemi.ko 2024-03-19T06:06:41.024 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/realtek.ko 2024-03-19T06:06:41.024 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/smsc.ko 2024-03-19T06:06:41.024 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/ste10Xp.ko 2024-03-19T06:06:41.024 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/vitesse.ko 2024-03-19T06:06:41.024 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/plip/ 2024-03-19T06:06:41.024 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/plip/plip.ko 2024-03-19T06:06:41.024 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ 2024-03-19T06:06:41.024 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-19T06:06:41.024 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_async.ko 2024-03-19T06:06:41.025 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-19T06:06:41.025 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-19T06:06:41.025 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-19T06:06:41.025 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pppoe.ko 2024-03-19T06:06:41.025 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pppox.ko 2024-03-19T06:06:41.025 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pptp.ko 2024-03-19T06:06:41.025 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/sb1000.ko 2024-03-19T06:06:41.025 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/slip/ 2024-03-19T06:06:41.025 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/slip/slip.ko 2024-03-19T06:06:41.025 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/sungem_phy.ko 2024-03-19T06:06:41.025 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 64561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/tap.ko 2024-03-19T06:06:41.025 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/ 2024-03-19T06:06:41.025 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 107233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team.ko 2024-03-19T06:06:41.025 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-19T06:06:41.025 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-19T06:06:41.025 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-19T06:06:41.026 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_random.ko 2024-03-19T06:06:41.026 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-19T06:06:41.026 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 86825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/veth.ko 2024-03-19T06:06:41.026 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vmxnet3/ 2024-03-19T06:06:41.026 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 144361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-19T06:06:41.026 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vxlan/ 2024-03-19T06:06:41.026 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 307193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vxlan/vxlan.ko 2024-03-19T06:06:41.026 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/xen-netback/ 2024-03-19T06:06:41.026 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 144017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-19T06:06:41.026 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ntb/ 2024-03-19T06:06:41.026 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ntb/ntb.ko 2024-03-19T06:06:41.026 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/ 2024-03-19T06:06:41.026 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host/ 2024-03-19T06:06:41.026 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 267745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host/nvme-core.ko 2024-03-19T06:06:41.026 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 103361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host/nvme.ko 2024-03-19T06:06:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/ 2024-03-19T06:06:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 131329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport.ko 2024-03-19T06:06:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14465 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_cs.ko 2024-03-19T06:06:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_pc.ko 2024-03-19T06:06:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_serial.ko 2024-03-19T06:06:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/ 2024-03-19T06:06:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/hotplug/ 2024-03-19T06:06:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-19T06:06:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-03-19T06:06:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-03-19T06:06:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/pci-stub.ko 2024-03-19T06:06:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/xen-pcifront.ko 2024-03-19T06:06:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/ 2024-03-19T06:06:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/i82092.ko 2024-03-19T06:06:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 146153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/pcmcia.ko 2024-03-19T06:06:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/pcmcia_core.ko 2024-03-19T06:06:41.028 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-03-19T06:06:41.028 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/pd6729.ko 2024-03-19T06:06:41.028 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 112793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-19T06:06:41.028 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/phy/ 2024-03-19T06:06:41.028 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/phy/broadcom/ 2024-03-19T06:06:41.028 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-03-19T06:06:41.028 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/phy/samsung/ 2024-03-19T06:06:41.028 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-03-19T06:06:41.028 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl/ 2024-03-19T06:06:41.028 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl/intel/ 2024-03-19T06:06:41.028 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-19T06:06:41.028 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/ 2024-03-19T06:06:41.028 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/chrome/ 2024-03-19T06:06:41.028 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-03-19T06:06:41.028 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/chrome/cros_ec.ko 2024-03-19T06:06:41.028 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-03-19T06:06:41.029 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-03-19T06:06:41.029 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26105 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-03-19T06:06:41.029 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-03-19T06:06:41.029 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-03-19T06:06:41.029 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/ 2024-03-19T06:06:41.029 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 73601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-19T06:06:41.029 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/acerhdf.ko 2024-03-19T06:06:41.029 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-19T06:06:41.029 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-19T06:06:41.029 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-19T06:06:41.029 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 131945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-19T06:06:41.029 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-19T06:06:41.029 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-19T06:06:41.029 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-19T06:06:41.029 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-19T06:06:41.030 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-19T06:06:41.030 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/hdaps.ko 2024-03-19T06:06:41.030 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/ibm_rtl.ko 2024-03-19T06:06:41.030 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel/ 2024-03-19T06:06:41.030 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-19T06:06:41.030 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-03-19T06:06:41.030 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel_ips.ko 2024-03-19T06:06:41.030 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-19T06:06:41.030 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-19T06:06:41.030 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-19T06:06:41.030 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-19T06:06:41.030 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-19T06:06:41.030 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-19T06:06:41.030 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-19T06:06:41.031 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-19T06:06:41.031 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-19T06:06:41.031 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/wmi.ko 2024-03-19T06:06:41.031 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/ 2024-03-19T06:06:41.031 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/ 2024-03-19T06:06:41.031 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/88pm860x_battery.ko 2024-03-19T06:06:41.031 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/88pm860x_charger.ko 2024-03-19T06:06:41.031 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/bq2415x_charger.ko 2024-03-19T06:06:41.031 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/bq24190_charger.ko 2024-03-19T06:06:41.031 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/bq24735-charger.ko 2024-03-19T06:06:41.031 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-03-19T06:06:41.031 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/da9030_battery.ko 2024-03-19T06:06:41.031 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/da9052-battery.ko 2024-03-19T06:06:41.031 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/ds2760_battery.ko 2024-03-19T06:06:41.032 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/ds2780_battery.ko 2024-03-19T06:06:41.032 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/ds2781_battery.ko 2024-03-19T06:06:41.032 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/ds2782_battery.ko 2024-03-19T06:06:41.032 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/gpio-charger.ko 2024-03-19T06:06:41.032 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/isp1704_charger.ko 2024-03-19T06:06:41.032 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/lp8727_charger.ko 2024-03-19T06:06:41.032 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/max14577_charger.ko 2024-03-19T06:06:41.032 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/max17042_battery.ko 2024-03-19T06:06:41.032 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/max8903_charger.ko 2024-03-19T06:06:41.032 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/max8925_power.ko 2024-03-19T06:06:41.032 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/pcf50633-charger.ko 2024-03-19T06:06:41.032 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/sbs-battery.ko 2024-03-19T06:06:41.032 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/test_power.ko 2024-03-19T06:06:41.032 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/tps65090-charger.ko 2024-03-19T06:06:41.033 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/wm831x_backup.ko 2024-03-19T06:06:41.033 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/wm831x_power.ko 2024-03-19T06:06:41.033 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/power/supply/wm8350_power.ko 2024-03-19T06:06:41.033 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap/ 2024-03-19T06:06:41.033 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58105 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-19T06:06:41.033 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-19T06:06:41.033 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/ 2024-03-19T06:06:41.033 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/ 2024-03-19T06:06:41.033 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-19T06:06:41.033 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-19T06:06:41.033 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps_parport.ko 2024-03-19T06:06:41.033 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/pps_core.ko 2024-03-19T06:06:41.033 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp/ 2024-03-19T06:06:41.033 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp/ptp.ko 2024-03-19T06:06:41.033 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp/ptp_kvm.ko 2024-03-19T06:06:41.034 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/ 2024-03-19T06:06:41.034 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-88pm80x.ko 2024-03-19T06:06:41.034 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-88pm860x.ko 2024-03-19T06:06:41.034 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-19T06:06:41.034 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-da9052.ko 2024-03-19T06:06:41.034 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-da9055.ko 2024-03-19T06:06:41.034 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-da9063.ko 2024-03-19T06:06:41.034 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-19T06:06:41.034 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 68481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-19T06:06:41.034 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-19T06:06:41.034 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-19T06:06:41.034 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-19T06:06:41.034 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-19T06:06:41.034 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13273 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-19T06:06:41.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-19T06:06:41.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-19T06:06:41.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-em3027.ko 2024-03-19T06:06:41.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-19T06:06:41.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-19T06:06:41.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-19T06:06:41.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-lp8788.ko 2024-03-19T06:06:41.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-19T06:06:41.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-19T06:06:41.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-19T06:06:41.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m48t86.ko 2024-03-19T06:06:41.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-max6900.ko 2024-03-19T06:06:41.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-max8907.ko 2024-03-19T06:06:41.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-max8925.ko 2024-03-19T06:06:41.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-max8997.ko 2024-03-19T06:06:41.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-max8998.ko 2024-03-19T06:06:41.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-03-19T06:06:41.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-19T06:06:41.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-palmas.ko 2024-03-19T06:06:41.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-19T06:06:41.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf50633.ko 2024-03-19T06:06:41.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-19T06:06:41.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-19T06:06:41.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-19T06:06:41.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-19T06:06:41.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rc5t583.ko 2024-03-19T06:06:41.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-19T06:06:41.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-19T06:06:41.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-19T06:06:41.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-19T06:06:41.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-19T06:06:41.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-s35390a.ko 2024-03-19T06:06:41.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-19T06:06:41.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-tps6586x.ko 2024-03-19T06:06:41.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-tps65910.ko 2024-03-19T06:06:41.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-wm831x.ko 2024-03-19T06:06:41.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-wm8350.ko 2024-03-19T06:06:41.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-x1205.ko 2024-03-19T06:06:41.037 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ 2024-03-19T06:06:41.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 77529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-9xxx.ko 2024-03-19T06:06:41.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-sas.ko 2024-03-19T06:06:41.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-xxxx.ko 2024-03-19T06:06:41.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 135345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/BusLogic.ko 2024-03-19T06:06:41.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/a100u2w.ko 2024-03-19T06:06:41.038 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aacraid/ 2024-03-19T06:06:41.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 271441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-19T06:06:41.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 100473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/advansys.ko 2024-03-19T06:06:41.038 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx/ 2024-03-19T06:06:41.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 356865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-19T06:06:41.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 295929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-19T06:06:41.038 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic94xx/ 2024-03-19T06:06:41.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 189145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-03-19T06:06:41.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/am53c974.ko 2024-03-19T06:06:41.038 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/arcmsr/ 2024-03-19T06:06:41.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 108209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-19T06:06:41.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/atp870u.ko 2024-03-19T06:06:41.038 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/be2iscsi/ 2024-03-19T06:06:41.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 246937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-19T06:06:41.039 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bfa/ 2024-03-19T06:06:41.039 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1171953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bfa/bfa.ko 2024-03-19T06:06:41.039 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2fc/ 2024-03-19T06:06:41.039 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 238401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-19T06:06:41.039 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2i/ 2024-03-19T06:06:41.039 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 115329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-19T06:06:41.039 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ch.ko 2024-03-19T06:06:41.039 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/csiostor/ 2024-03-19T06:06:41.039 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 308961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-19T06:06:41.039 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/ 2024-03-19T06:06:41.039 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-03-19T06:06:41.039 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 76041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-19T06:06:41.039 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-03-19T06:06:41.039 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 101425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-19T06:06:41.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 146753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-19T06:06:41.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 75977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/dc395x.ko 2024-03-19T06:06:41.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/dmx3191d.ko 2024-03-19T06:06:41.040 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esas2r/ 2024-03-19T06:06:41.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 212385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-19T06:06:41.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esp_scsi.ko 2024-03-19T06:06:41.040 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe/ 2024-03-19T06:06:41.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-19T06:06:41.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 157729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-19T06:06:41.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fdomain.ko 2024-03-19T06:06:41.040 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fnic/ 2024-03-19T06:06:41.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 294953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fnic/fnic.ko 2024-03-19T06:06:41.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 201729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hpsa.ko 2024-03-19T06:06:41.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hptiop.ko 2024-03-19T06:06:41.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hv_storvsc.ko 2024-03-19T06:06:41.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/imm.ko 2024-03-19T06:06:41.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/initio.ko 2024-03-19T06:06:41.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 265945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ipr.ko 2024-03-19T06:06:41.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 101881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ips.ko 2024-03-19T06:06:41.041 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/isci/ 2024-03-19T06:06:41.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 317193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/isci/isci.ko 2024-03-19T06:06:41.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-19T06:06:41.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-19T06:06:41.041 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libfc/ 2024-03-19T06:06:41.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 315321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libfc/libfc.ko 2024-03-19T06:06:41.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 145497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libiscsi.ko 2024-03-19T06:06:41.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-19T06:06:41.041 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libsas/ 2024-03-19T06:06:41.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 216401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libsas/libsas.ko 2024-03-19T06:06:41.041 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/lpfc/ 2024-03-19T06:06:41.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 2194089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-19T06:06:41.042 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/ 2024-03-19T06:06:41.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 73473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-19T06:06:41.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-19T06:06:41.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 310689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-19T06:06:41.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid.ko 2024-03-19T06:06:41.042 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mpt3sas/ 2024-03-19T06:06:41.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 659633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-19T06:06:41.042 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvsas/ 2024-03-19T06:06:41.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 119489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-19T06:06:41.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvumi.ko 2024-03-19T06:06:41.042 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pcmcia/ 2024-03-19T06:06:41.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 81561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-03-19T06:06:41.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-03-19T06:06:41.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-03-19T06:06:41.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-03-19T06:06:41.043 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pm8001/ 2024-03-19T06:06:41.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 366337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-19T06:06:41.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 124601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pmcraid.ko 2024-03-19T06:06:41.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ppa.ko 2024-03-19T06:06:41.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla1280.ko 2024-03-19T06:06:41.043 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx/ 2024-03-19T06:06:41.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1876753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-19T06:06:41.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-19T06:06:41.043 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla4xxx/ 2024-03-19T06:06:41.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 558953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-19T06:06:41.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qlogicfas408.ko 2024-03-19T06:06:41.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/raid_class.ko 2024-03-19T06:06:41.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 261081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_debug.ko 2024-03-19T06:06:41.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 173929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-19T06:06:41.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 280113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-19T06:06:41.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 97625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-19T06:06:41.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 73865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-19T06:06:41.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-19T06:06:41.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ses.ko 2024-03-19T06:06:41.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 115649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/st.ko 2024-03-19T06:06:41.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/stex.ko 2024-03-19T06:06:41.044 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/sym53c8xx_2/ 2024-03-19T06:06:41.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 164889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-19T06:06:41.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/virtio_scsi.ko 2024-03-19T06:06:41.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-19T06:06:41.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/wd719x.ko 2024-03-19T06:06:41.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/xen-scsifront.ko 2024-03-19T06:06:41.044 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ssb/ 2024-03-19T06:06:41.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 129393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ssb/ssb.ko 2024-03-19T06:06:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/ 2024-03-19T06:06:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/iscsi/ 2024-03-19T06:06:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 736761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-19T06:06:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/loopback/ 2024-03-19T06:06:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-19T06:06:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_file.ko 2024-03-19T06:06:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_iblock.ko 2024-03-19T06:06:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 931521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_mod.ko 2024-03-19T06:06:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_pscsi.ko 2024-03-19T06:06:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 122489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_user.ko 2024-03-19T06:06:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/tcm_fc/ 2024-03-19T06:06:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 75521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-19T06:06:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/ 2024-03-19T06:06:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/ 2024-03-19T06:06:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/ 2024-03-19T06:06:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-19T06:06:41.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-19T06:06:41.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-19T06:06:41.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-19T06:06:41.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-19T06:06:41.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-19T06:06:41.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-19T06:06:41.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-19T06:06:41.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-19T06:06:41.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-19T06:06:41.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-19T06:06:41.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-19T06:06:41.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-19T06:06:41.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-19T06:06:41.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11465 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/ 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/ipwireless/ 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/moxa.ko 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/mxser.ko 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 108489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/n_gsm.ko 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/n_hdlc.ko 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/nozomi.ko 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/ 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/8250/ 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-19T06:06:41.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-03-19T06:06:41.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/altera_uart.ko 2024-03-19T06:06:41.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/arc_uart.ko 2024-03-19T06:06:41.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 72553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-03-19T06:06:41.048 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/jsm/ 2024-03-19T06:06:41.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 101993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-19T06:06:41.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/rp2.ko 2024-03-19T06:06:41.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/sc16is7xx.ko 2024-03-19T06:06:41.048 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/ 2024-03-19T06:06:41.048 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/core/ 2024-03-19T06:06:41.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 545401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-19T06:06:41.048 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/host/ 2024-03-19T06:06:41.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-19T06:06:41.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-03-19T06:06:41.048 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/ 2024-03-19T06:06:41.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio.ko 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_aec.ko 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_cif.ko 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_dmem_genirq.ko 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_mf624.ko 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_netx.ko 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_pci_generic.ko 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_sercos3.ko 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/ 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/c67x00/ 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 73225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/c67x00/c67x00.ko 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/chipidea/ 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 145793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-03-19T06:06:41.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-03-19T06:06:41.050 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/ 2024-03-19T06:06:41.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 87009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/cdc-acm.ko 2024-03-19T06:06:41.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-19T06:06:41.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/usblp.ko 2024-03-19T06:06:41.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/usbtmc.ko 2024-03-19T06:06:41.050 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/common/ 2024-03-19T06:06:41.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/common/ulpi.ko 2024-03-19T06:06:41.050 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/dwc2/ 2024-03-19T06:06:41.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-03-19T06:06:41.050 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/dwc3/ 2024-03-19T06:06:41.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-03-19T06:06:41.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-03-19T06:06:41.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 452825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/dwc3/dwc3.ko 2024-03-19T06:06:41.050 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/ 2024-03-19T06:06:41.050 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/ 2024-03-19T06:06:41.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/u_ether.ko 2024-03-19T06:06:41.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/u_serial.ko 2024-03-19T06:06:41.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-03-19T06:06:41.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-03-19T06:06:41.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-03-19T06:06:41.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-03-19T06:06:41.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 92409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-03-19T06:06:41.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-03-19T06:06:41.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 122257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-03-19T06:06:41.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-03-19T06:06:41.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-03-19T06:06:41.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-03-19T06:06:41.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-03-19T06:06:41.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-03-19T06:06:41.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-03-19T06:06:41.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-03-19T06:06:41.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-03-19T06:06:41.052 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/ 2024-03-19T06:06:41.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-03-19T06:06:41.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-03-19T06:06:41.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-03-19T06:06:41.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-03-19T06:06:41.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-03-19T06:06:41.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-03-19T06:06:41.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-03-19T06:06:41.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-03-19T06:06:41.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-03-19T06:06:41.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-03-19T06:06:41.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-03-19T06:06:41.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-03-19T06:06:41.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-03-19T06:06:41.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15105 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-03-19T06:06:41.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 161233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/libcomposite.ko 2024-03-19T06:06:41.053 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/ 2024-03-19T06:06:41.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-03-19T06:06:41.053 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/bdc/ 2024-03-19T06:06:41.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 157617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-03-19T06:06:41.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-03-19T06:06:41.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-03-19T06:06:41.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-03-19T06:06:41.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-03-19T06:06:41.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 75969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/net2272.ko 2024-03-19T06:06:41.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/net2280.ko 2024-03-19T06:06:41.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 73017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-03-19T06:06:41.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 65881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-03-19T06:06:41.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-03-19T06:06:41.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 81409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-03-19T06:06:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 156337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-03-19T06:06:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/ 2024-03-19T06:06:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/bcma-hcd.ko 2024-03-19T06:06:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 80017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/isp116x-hcd.ko 2024-03-19T06:06:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 87193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-03-19T06:06:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-03-19T06:06:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-19T06:06:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/sl811_cs.ko 2024-03-19T06:06:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/ssb-hcd.ko 2024-03-19T06:06:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-03-19T06:06:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image/ 2024-03-19T06:06:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image/mdc800.ko 2024-03-19T06:06:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image/microtek.ko 2024-03-19T06:06:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/ 2024-03-19T06:06:41.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/adutux.ko 2024-03-19T06:06:41.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/appledisplay.ko 2024-03-19T06:06:41.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-03-19T06:06:41.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/cytherm.ko 2024-03-19T06:06:41.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/ehset.ko 2024-03-19T06:06:41.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/emi26.ko 2024-03-19T06:06:41.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/emi62.ko 2024-03-19T06:06:41.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/ezusb.ko 2024-03-19T06:06:41.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/idmouse.ko 2024-03-19T06:06:41.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/iowarrior.ko 2024-03-19T06:06:41.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-19T06:06:41.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/ldusb.ko 2024-03-19T06:06:41.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36105 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/legousbtower.ko 2024-03-19T06:06:41.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/lvstest.ko 2024-03-19T06:06:41.055 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/sisusbvga/ 2024-03-19T06:06:41.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 64745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-19T06:06:41.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-19T06:06:41.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usb3503.ko 2024-03-19T06:06:41.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usblcd.ko 2024-03-19T06:06:41.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-19T06:06:41.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usbtest.ko 2024-03-19T06:06:41.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/uss720.ko 2024-03-19T06:06:41.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/yurex.ko 2024-03-19T06:06:41.056 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/mon/ 2024-03-19T06:06:41.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 72825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/mon/usbmon.ko 2024-03-19T06:06:41.056 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/musb/ 2024-03-19T06:06:41.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 301633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/musb/musb_hdrc.ko 2024-03-19T06:06:41.056 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy/ 2024-03-19T06:06:41.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy/phy-generic.ko 2024-03-19T06:06:41.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-03-19T06:06:41.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy/phy-isp1301.ko 2024-03-19T06:06:41.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy/phy-tahvo.ko 2024-03-19T06:06:41.057 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ 2024-03-19T06:06:41.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/aircable.ko 2024-03-19T06:06:41.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ark3116.ko 2024-03-19T06:06:41.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-19T06:06:41.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ch341.ko 2024-03-19T06:06:41.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cp210x.ko 2024-03-19T06:06:41.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cyberjack.ko 2024-03-19T06:06:41.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-19T06:06:41.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-19T06:06:41.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/empeg.ko 2024-03-19T06:06:41.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/f81232.ko 2024-03-19T06:06:41.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 175105 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-19T06:06:41.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-19T06:06:41.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 136985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-19T06:06:41.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 124745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/io_ti.ko 2024-03-19T06:06:41.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ipaq.ko 2024-03-19T06:06:41.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ipw.ko 2024-03-19T06:06:41.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ir-usb.ko 2024-03-19T06:06:41.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-19T06:06:41.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 107433 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/keyspan.ko 2024-03-19T06:06:41.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-19T06:06:41.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-19T06:06:41.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-19T06:06:41.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mct_u232.ko 2024-03-19T06:06:41.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/metro-usb.ko 2024-03-19T06:06:41.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mos7720.ko 2024-03-19T06:06:41.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mos7840.ko 2024-03-19T06:06:41.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mxuport.ko 2024-03-19T06:06:41.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/navman.ko 2024-03-19T06:06:41.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/omninet.ko 2024-03-19T06:06:41.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/opticon.ko 2024-03-19T06:06:41.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 191825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/option.ko 2024-03-19T06:06:41.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/oti6858.ko 2024-03-19T06:06:41.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/pl2303.ko 2024-03-19T06:06:41.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/qcaux.ko 2024-03-19T06:06:41.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/qcserial.ko 2024-03-19T06:06:41.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/quatech2.ko 2024-03-19T06:06:41.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/safe_serial.ko 2024-03-19T06:06:41.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/sierra.ko 2024-03-19T06:06:41.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-19T06:06:41.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ssu100.ko 2024-03-19T06:06:41.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/symbolserial.ko 2024-03-19T06:06:41.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-19T06:06:41.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-19T06:06:41.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb_debug.ko 2024-03-19T06:06:41.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-19T06:06:41.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 125529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usbserial.ko 2024-03-19T06:06:41.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/visor.ko 2024-03-19T06:06:41.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/whiteheat.ko 2024-03-19T06:06:41.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/wishbone-serial.ko 2024-03-19T06:06:41.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-19T06:06:41.060 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ 2024-03-19T06:06:41.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/uas.ko 2024-03-19T06:06:41.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-19T06:06:41.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-19T06:06:41.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-19T06:06:41.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-19T06:06:41.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-19T06:06:41.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-19T06:06:41.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-19T06:06:41.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-karma.ko 2024-03-19T06:06:41.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-19T06:06:41.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-19T06:06:41.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-19T06:06:41.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-19T06:06:41.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-19T06:06:41.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 180329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/usb-storage.ko 2024-03-19T06:06:41.061 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/ 2024-03-19T06:06:41.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-19T06:06:41.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 71025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-19T06:06:41.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 104065 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-19T06:06:41.061 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/ 2024-03-19T06:06:41.061 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci/ 2024-03-19T06:06:41.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 162865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-19T06:06:41.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-19T06:06:41.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 103673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/vfio.ko 2024-03-19T06:06:41.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 76441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-19T06:06:41.062 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/ 2024-03-19T06:06:41.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 113665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost.ko 2024-03-19T06:06:41.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-19T06:06:41.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_net.ko 2024-03-19T06:06:41.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_scsi.ko 2024-03-19T06:06:41.062 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/ 2024-03-19T06:06:41.062 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/ 2024-03-19T06:06:41.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-03-19T06:06:41.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/aat2870_bl.ko 2024-03-19T06:06:41.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/adp5520_bl.ko 2024-03-19T06:06:41.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/adp8860_bl.ko 2024-03-19T06:06:41.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/adp8870_bl.ko 2024-03-19T06:06:41.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/apple_bl.ko 2024-03-19T06:06:41.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/as3711_bl.ko 2024-03-19T06:06:41.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/bd6107.ko 2024-03-19T06:06:41.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/da903x_bl.ko 2024-03-19T06:06:41.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/da9052_bl.ko 2024-03-19T06:06:41.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/gpio_backlight.ko 2024-03-19T06:06:41.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/kb3886_bl.ko 2024-03-19T06:06:41.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/lcd.ko 2024-03-19T06:06:41.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/lm3533_bl.ko 2024-03-19T06:06:41.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/lm3639_bl.ko 2024-03-19T06:06:41.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/lv5207lp.ko 2024-03-19T06:06:41.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/max8925_bl.ko 2024-03-19T06:06:41.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/pandora_bl.ko 2024-03-19T06:06:41.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-03-19T06:06:41.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-19T06:06:41.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/wm831x_bl.ko 2024-03-19T06:06:41.064 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/ 2024-03-19T06:06:41.064 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/ 2024-03-19T06:06:41.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/ds2482.ko 2024-03-19T06:06:41.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/ds2490.ko 2024-03-19T06:06:41.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/matrox_w1.ko 2024-03-19T06:06:41.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11273 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/w1-gpio.ko 2024-03-19T06:06:41.064 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/ 2024-03-19T06:06:41.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-19T06:06:41.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-19T06:06:41.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-19T06:06:41.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-19T06:06:41.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-19T06:06:41.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-19T06:06:41.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-19T06:06:41.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-19T06:06:41.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-19T06:06:41.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-19T06:06:41.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-19T06:06:41.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 103049 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/wire.ko 2024-03-19T06:06:41.065 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ 2024-03-19T06:06:41.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/acquirewdt.ko 2024-03-19T06:06:41.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/advantechwdt.ko 2024-03-19T06:06:41.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18465 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-19T06:06:41.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-19T06:06:41.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/cpu5wdt.ko 2024-03-19T06:06:41.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/da9052_wdt.ko 2024-03-19T06:06:41.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/da9055_wdt.ko 2024-03-19T06:06:41.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/da9063_wdt.ko 2024-03-19T06:06:41.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/dw_wdt.ko 2024-03-19T06:06:41.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/eurotechwdt.ko 2024-03-19T06:06:41.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-19T06:06:41.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/hpwdt.ko 2024-03-19T06:06:41.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/i6300esb.ko 2024-03-19T06:06:41.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-19T06:06:41.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-19T06:06:41.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ib700wdt.ko 2024-03-19T06:06:41.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ibmasr.ko 2024-03-19T06:06:41.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-19T06:06:41.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-19T06:06:41.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/it87_wdt.ko 2024-03-19T06:06:41.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21393 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/kempld_wdt.ko 2024-03-19T06:06:41.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/machzwd.ko 2024-03-19T06:06:41.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/mena21_wdt.ko 2024-03-19T06:06:41.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-03-19T06:06:41.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/nv_tco.ko 2024-03-19T06:06:41.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-03-19T06:06:41.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/pc87413_wdt.ko 2024-03-19T06:06:41.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-19T06:06:41.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-19T06:06:41.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/retu_wdt.ko 2024-03-19T06:06:41.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-03-19T06:06:41.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-03-19T06:06:41.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-19T06:06:41.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sc1200wdt.ko 2024-03-19T06:06:41.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-19T06:06:41.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21481 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-03-19T06:06:41.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/softdog.ko 2024-03-19T06:06:41.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-19T06:06:41.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/twl4030_wdt.ko 2024-03-19T06:06:41.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/via_wdt.ko 2024-03-19T06:06:41.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-19T06:06:41.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-19T06:06:41.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-19T06:06:41.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/wafer5823wdt.ko 2024-03-19T06:06:41.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/wdt_pci.ko 2024-03-19T06:06:41.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/wm831x_wdt.ko 2024-03-19T06:06:41.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13689 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/wm8350_wdt.ko 2024-03-19T06:06:41.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15609 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/xen_wdt.ko 2024-03-19T06:06:41.068 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/ 2024-03-19T06:06:41.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-evtchn.ko 2024-03-19T06:06:41.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-gntalloc.ko 2024-03-19T06:06:41.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-gntdev.ko 2024-03-19T06:06:41.068 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-pciback/ 2024-03-19T06:06:41.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 176385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-19T06:06:41.069 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-privcmd.ko 2024-03-19T06:06:41.069 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 71153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-scsiback.ko 2024-03-19T06:06:41.069 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xenfs/ 2024-03-19T06:06:41.069 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-19T06:06:41.069 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ 2024-03-19T06:06:41.069 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/9p/ 2024-03-19T06:06:41.069 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 158281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/9p/9p.ko 2024-03-19T06:06:41.069 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/adfs/ 2024-03-19T06:06:41.069 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/adfs/adfs.ko 2024-03-19T06:06:41.069 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/affs/ 2024-03-19T06:06:41.069 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 163417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/affs/affs.ko 2024-03-19T06:06:41.069 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/afs/ 2024-03-19T06:06:41.069 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1019225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/afs/kafs.ko 2024-03-19T06:06:41.069 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/autofs/ 2024-03-19T06:06:41.070 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 103225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/autofs/autofs4.ko 2024-03-19T06:06:41.070 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/befs/ 2024-03-19T06:06:41.070 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 64625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/befs/befs.ko 2024-03-19T06:06:41.070 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/bfs/ 2024-03-19T06:06:41.070 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/bfs/bfs.ko 2024-03-19T06:06:41.070 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/binfmt_misc.ko 2024-03-19T06:06:41.070 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/btrfs/ 2024-03-19T06:06:41.070 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 3487553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/btrfs/btrfs.ko 2024-03-19T06:06:41.125 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cachefiles/ 2024-03-19T06:06:41.125 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 305897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cachefiles/cachefiles.ko 2024-03-19T06:06:41.125 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ceph/ 2024-03-19T06:06:41.125 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1335721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ceph/ceph.ko 2024-03-19T06:06:41.125 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/coda/ 2024-03-19T06:06:41.125 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 97769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/coda/coda.ko 2024-03-19T06:06:41.125 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/configfs/ 2024-03-19T06:06:41.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 108577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/configfs/configfs.ko 2024-03-19T06:06:41.126 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cramfs/ 2024-03-19T06:06:41.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cramfs/cramfs.ko 2024-03-19T06:06:41.126 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/dlm/ 2024-03-19T06:06:41.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 644249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/dlm/dlm.ko 2024-03-19T06:06:41.126 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/efs/ 2024-03-19T06:06:41.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/efs/efs.ko 2024-03-19T06:06:41.126 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/f2fs/ 2024-03-19T06:06:41.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1527665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/f2fs/f2fs.ko 2024-03-19T06:06:41.126 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat/ 2024-03-19T06:06:41.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat/msdos.ko 2024-03-19T06:06:41.126 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/freevxfs/ 2024-03-19T06:06:41.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/freevxfs/freevxfs.ko 2024-03-19T06:06:41.126 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fuse/ 2024-03-19T06:06:41.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fuse/cuse.ko 2024-03-19T06:06:41.127 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/gfs2/ 2024-03-19T06:06:41.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1231361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/gfs2/gfs2.ko 2024-03-19T06:06:41.127 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfs/ 2024-03-19T06:06:41.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 141713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfs/hfs.ko 2024-03-19T06:06:41.127 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfsplus/ 2024-03-19T06:06:41.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 223281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfsplus/hfsplus.ko 2024-03-19T06:06:41.127 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hpfs/ 2024-03-19T06:06:41.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 193545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hpfs/hpfs.ko 2024-03-19T06:06:41.127 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/isofs/ 2024-03-19T06:06:41.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/isofs/isofs.ko 2024-03-19T06:06:41.127 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/jfs/ 2024-03-19T06:06:41.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 420449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/jfs/jfs.ko 2024-03-19T06:06:41.127 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/lockd/ 2024-03-19T06:06:41.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 281705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/lockd/lockd.ko 2024-03-19T06:06:41.128 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/minix/ 2024-03-19T06:06:41.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 88937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/minix/minix.ko 2024-03-19T06:06:41.128 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/netfs/ 2024-03-19T06:06:41.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 490505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/netfs/netfs.ko 2024-03-19T06:06:41.128 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/ 2024-03-19T06:06:41.128 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/blocklayout/ 2024-03-19T06:06:41.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 81457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-19T06:06:41.128 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/filelayout/ 2024-03-19T06:06:41.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-19T06:06:41.128 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/flexfilelayout/ 2024-03-19T06:06:41.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 117377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-19T06:06:41.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1058377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfs.ko 2024-03-19T06:06:41.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfsv2.ko 2024-03-19T06:06:41.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 120193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfsv3.ko 2024-03-19T06:06:41.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 2041825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfsv4.ko 2024-03-19T06:06:41.129 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common/ 2024-03-19T06:06:41.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common/grace.ko 2024-03-19T06:06:41.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common/nfs_acl.ko 2024-03-19T06:06:41.129 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfsd/ 2024-03-19T06:06:41.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1511665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfsd/nfsd.ko 2024-03-19T06:06:41.129 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nilfs2/ 2024-03-19T06:06:41.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 582529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nilfs2/nilfs2.ko 2024-03-19T06:06:41.129 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/ 2024-03-19T06:06:41.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-celtic.ko 2024-03-19T06:06:41.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-centeuro.ko 2024-03-19T06:06:41.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-croatian.ko 2024-03-19T06:06:41.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-cyrillic.ko 2024-03-19T06:06:41.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-gaelic.ko 2024-03-19T06:06:41.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-greek.ko 2024-03-19T06:06:41.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-iceland.ko 2024-03-19T06:06:41.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-inuit.ko 2024-03-19T06:06:41.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-roman.ko 2024-03-19T06:06:41.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-romanian.ko 2024-03-19T06:06:41.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-turkish.ko 2024-03-19T06:06:41.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_ascii.ko 2024-03-19T06:06:41.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1250.ko 2024-03-19T06:06:41.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1251.ko 2024-03-19T06:06:41.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1255.ko 2024-03-19T06:06:41.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp737.ko 2024-03-19T06:06:41.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp775.ko 2024-03-19T06:06:41.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp850.ko 2024-03-19T06:06:41.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp852.ko 2024-03-19T06:06:41.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp855.ko 2024-03-19T06:06:41.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp857.ko 2024-03-19T06:06:41.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp860.ko 2024-03-19T06:06:41.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13065 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp861.ko 2024-03-19T06:06:41.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp862.ko 2024-03-19T06:06:41.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13065 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp863.ko 2024-03-19T06:06:41.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp864.ko 2024-03-19T06:06:41.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13065 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp865.ko 2024-03-19T06:06:41.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp866.ko 2024-03-19T06:06:41.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp869.ko 2024-03-19T06:06:41.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp874.ko 2024-03-19T06:06:41.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 94041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp932.ko 2024-03-19T06:06:41.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 142577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp936.ko 2024-03-19T06:06:41.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 165649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp949.ko 2024-03-19T06:06:41.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 118025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp950.ko 2024-03-19T06:06:41.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_euc-jp.ko 2024-03-19T06:06:41.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-1.ko 2024-03-19T06:06:41.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-13.ko 2024-03-19T06:06:41.132 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-14.ko 2024-03-19T06:06:41.132 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-15.ko 2024-03-19T06:06:41.132 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-2.ko 2024-03-19T06:06:41.132 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-3.ko 2024-03-19T06:06:41.132 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-4.ko 2024-03-19T06:06:41.132 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-5.ko 2024-03-19T06:06:41.132 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-6.ko 2024-03-19T06:06:41.132 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-7.ko 2024-03-19T06:06:41.132 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-9.ko 2024-03-19T06:06:41.132 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-r.ko 2024-03-19T06:06:41.132 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-ru.ko 2024-03-19T06:06:41.132 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-u.ko 2024-03-19T06:06:41.132 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-19T06:06:41.132 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_utf8.ko 2024-03-19T06:06:41.132 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ntfs/ 2024-03-19T06:06:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 220545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ntfs/ntfs.ko 2024-03-19T06:06:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ 2024-03-19T06:06:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/cluster/ 2024-03-19T06:06:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 244673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-19T06:06:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlm/ 2024-03-19T06:06:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 440681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-19T06:06:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlmfs/ 2024-03-19T06:06:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54177 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-19T06:06:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 2590849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2.ko 2024-03-19T06:06:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-19T06:06:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-19T06:06:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-19T06:06:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/omfs/ 2024-03-19T06:06:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/omfs/omfs.ko 2024-03-19T06:06:41.133 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/overlayfs/ 2024-03-19T06:06:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 360953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/overlayfs/overlay.ko 2024-03-19T06:06:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/pstore/ 2024-03-19T06:06:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/pstore/ramoops.ko 2024-03-19T06:06:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/qnx4/ 2024-03-19T06:06:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/qnx4/qnx4.ko 2024-03-19T06:06:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/qnx6/ 2024-03-19T06:06:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46625 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/qnx6/qnx6.ko 2024-03-19T06:06:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/quota/ 2024-03-19T06:06:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/quota/quota_tree.ko 2024-03-19T06:06:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/quota/quota_v1.ko 2024-03-19T06:06:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/quota/quota_v2.ko 2024-03-19T06:06:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/reiserfs/ 2024-03-19T06:06:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 532289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/reiserfs/reiserfs.ko 2024-03-19T06:06:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/romfs/ 2024-03-19T06:06:41.134 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/romfs/romfs.ko 2024-03-19T06:06:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/ 2024-03-19T06:06:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/client/ 2024-03-19T06:06:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 2712601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/client/cifs.ko 2024-03-19T06:06:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common/ 2024-03-19T06:06:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7065 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common/cifs_arc4.ko 2024-03-19T06:06:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common/cifs_md4.ko 2024-03-19T06:06:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/squashfs/ 2024-03-19T06:06:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 134809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/squashfs/squashfs.ko 2024-03-19T06:06:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/sysv/ 2024-03-19T06:06:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 91329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/sysv/sysv.ko 2024-03-19T06:06:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/udf/ 2024-03-19T06:06:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 248409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/udf/udf.ko 2024-03-19T06:06:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ufs/ 2024-03-19T06:06:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 162785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ufs/ufs.ko 2024-03-19T06:06:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/xfs/ 2024-03-19T06:06:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 4036193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/fs/xfs/xfs.ko 2024-03-19T06:06:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/ 2024-03-19T06:06:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/locking/ 2024-03-19T06:06:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 80489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/locking/locktorture.ko 2024-03-19T06:06:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/time/ 2024-03-19T06:06:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/time/test_udelay.ko 2024-03-19T06:06:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/torture.ko 2024-03-19T06:06:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ 2024-03-19T06:06:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crc-itu-t.ko 2024-03-19T06:06:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crc7.ko 2024-03-19T06:06:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crc8.ko 2024-03-19T06:06:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto/ 2024-03-19T06:06:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto/libarc4.ko 2024-03-19T06:06:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto/libdes.ko 2024-03-19T06:06:41.136 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/interval_tree_test.ko 2024-03-19T06:06:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/libcrc32c.ko 2024-03-19T06:06:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lru_cache.ko 2024-03-19T06:06:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4/ 2024-03-19T06:06:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4/lz4_compress.ko 2024-03-19T06:06:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4/lz4hc_compress.ko 2024-03-19T06:06:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/math/ 2024-03-19T06:06:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/math/cordic.ko 2024-03-19T06:06:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/memory-notifier-error-inject.ko 2024-03-19T06:06:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/notifier-error-inject.ko 2024-03-19T06:06:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/percpu_test.ko 2024-03-19T06:06:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/pm-notifier-error-inject.ko 2024-03-19T06:06:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/raid6/ 2024-03-19T06:06:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 143337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/raid6/raid6_pq.ko 2024-03-19T06:06:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/rbtree_test.ko 2024-03-19T06:06:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/reed_solomon/ 2024-03-19T06:06:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-19T06:06:41.138 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/test-kstrtox.ko 2024-03-19T06:06:41.138 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/test-string_helpers.ko 2024-03-19T06:06:41.138 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 4863225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/test_bpf.ko 2024-03-19T06:06:41.138 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/test_firmware.ko 2024-03-19T06:06:41.138 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/test_module.ko 2024-03-19T06:06:41.138 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/test_user_copy.ko 2024-03-19T06:06:41.138 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_bm.ko 2024-03-19T06:06:41.138 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_fsm.ko 2024-03-19T06:06:41.138 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_kmp.ko 2024-03-19T06:06:41.138 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/xz/ 2024-03-19T06:06:41.138 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/lib/xz/xz_dec_test.ko 2024-03-19T06:06:41.138 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/mm/ 2024-03-19T06:06:41.138 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18129 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/mm/hwpoison-inject.ko 2024-03-19T06:06:41.138 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ 2024-03-19T06:06:41.139 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/ 2024-03-19T06:06:41.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/6lowpan.ko 2024-03-19T06:06:41.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_dest.ko 2024-03-19T06:06:41.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_fragment.ko 2024-03-19T06:06:41.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_hop.ko 2024-03-19T06:06:41.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-19T06:06:41.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_mobility.ko 2024-03-19T06:06:41.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_routing.ko 2024-03-19T06:06:41.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_udp.ko 2024-03-19T06:06:41.139 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/ 2024-03-19T06:06:41.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/garp.ko 2024-03-19T06:06:41.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/mrp.ko 2024-03-19T06:06:41.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/p8022.ko 2024-03-19T06:06:41.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/psnap.ko 2024-03-19T06:06:41.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/stp.ko 2024-03-19T06:06:41.139 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/8021q/ 2024-03-19T06:06:41.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 82897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/8021q/8021q.ko 2024-03-19T06:06:41.140 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/ 2024-03-19T06:06:41.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 198833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet.ko 2024-03-19T06:06:41.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_fd.ko 2024-03-19T06:06:41.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_rdma.ko 2024-03-19T06:06:41.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_virtio.ko 2024-03-19T06:06:41.140 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/batman-adv/ 2024-03-19T06:06:41.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 667545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/batman-adv/batman-adv.ko 2024-03-19T06:06:41.140 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/ 2024-03-19T06:06:41.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/br_netfilter.ko 2024-03-19T06:06:41.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 790673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/bridge.ko 2024-03-19T06:06:41.140 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ 2024-03-19T06:06:41.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-19T06:06:41.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-19T06:06:41.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-19T06:06:41.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-19T06:06:41.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-19T06:06:41.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-19T06:06:41.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-19T06:06:41.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-19T06:06:41.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-19T06:06:41.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-19T06:06:41.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-19T06:06:41.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-19T06:06:41.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-19T06:06:41.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-19T06:06:41.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-19T06:06:41.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-19T06:06:41.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-19T06:06:41.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-19T06:06:41.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-19T06:06:41.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-19T06:06:41.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtables.ko 2024-03-19T06:06:41.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-19T06:06:41.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-19T06:06:41.142 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ceph/ 2024-03-19T06:06:41.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1046825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ceph/libceph.ko 2024-03-19T06:06:41.142 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/core/ 2024-03-19T06:06:41.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 125705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/core/pktgen.ko 2024-03-19T06:06:41.142 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/ 2024-03-19T06:06:41.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 194505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp.ko 2024-03-19T06:06:41.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_diag.ko 2024-03-19T06:06:41.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_ipv4.ko 2024-03-19T06:06:41.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_ipv6.ko 2024-03-19T06:06:41.142 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/ 2024-03-19T06:06:41.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 390089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/dsa_core.ko 2024-03-19T06:06:41.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_brcm.ko 2024-03-19T06:06:41.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12601 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_dsa.ko 2024-03-19T06:06:41.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_none.ko 2024-03-19T06:06:41.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_trailer.ko 2024-03-19T06:06:41.143 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/hsr/ 2024-03-19T06:06:41.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102073 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/hsr/hsr.ko 2024-03-19T06:06:41.143 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/ 2024-03-19T06:06:41.143 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/6lowpan/ 2024-03-19T06:06:41.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-19T06:06:41.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 284721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/ieee802154.ko 2024-03-19T06:06:41.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-19T06:06:41.143 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ 2024-03-19T06:06:41.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ah4.ko 2024-03-19T06:06:41.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/esp4.ko 2024-03-19T06:06:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/fou.ko 2024-03-19T06:06:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/gre.ko 2024-03-19T06:06:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/inet_diag.ko 2024-03-19T06:06:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_gre.ko 2024-03-19T06:06:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_tunnel.ko 2024-03-19T06:06:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_vti.ko 2024-03-19T06:06:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ipcomp.ko 2024-03-19T06:06:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ipip.ko 2024-03-19T06:06:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ 2024-03-19T06:06:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-19T06:06:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-19T06:06:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-19T06:06:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ip_tables.ko 2024-03-19T06:06:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-19T06:06:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9585 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-03-19T06:06:41.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-19T06:06:41.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-19T06:06:41.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14785 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-19T06:06:41.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-03-19T06:06:41.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-19T06:06:41.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-19T06:06:41.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-19T06:06:41.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-19T06:06:41.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-19T06:06:41.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-19T06:06:41.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-19T06:06:41.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-19T06:06:41.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-19T06:06:41.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-03-19T06:06:41.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-19T06:06:41.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-19T06:06:41.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-19T06:06:41.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-19T06:06:41.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-19T06:06:41.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_bic.ko 2024-03-19T06:06:41.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_dctcp.ko 2024-03-19T06:06:41.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15969 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_diag.ko 2024-03-19T06:06:41.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_highspeed.ko 2024-03-19T06:06:41.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_htcp.ko 2024-03-19T06:06:41.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_hybla.ko 2024-03-19T06:06:41.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_illinois.ko 2024-03-19T06:06:41.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_lp.ko 2024-03-19T06:06:41.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_scalable.ko 2024-03-19T06:06:41.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_vegas.ko 2024-03-19T06:06:41.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_veno.ko 2024-03-19T06:06:41.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10857 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_westwood.ko 2024-03-19T06:06:41.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_yeah.ko 2024-03-19T06:06:41.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tunnel4.ko 2024-03-19T06:06:41.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/udp_diag.ko 2024-03-19T06:06:41.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/udp_tunnel.ko 2024-03-19T06:06:41.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-19T06:06:41.147 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ 2024-03-19T06:06:41.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ah6.ko 2024-03-19T06:06:41.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/esp6.ko 2024-03-19T06:06:41.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/fou6.ko 2024-03-19T06:06:41.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 79929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_gre.ko 2024-03-19T06:06:41.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 94169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_tunnel.ko 2024-03-19T06:06:41.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-19T06:06:41.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54273 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_vti.ko 2024-03-19T06:06:41.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ipcomp6.ko 2024-03-19T06:06:41.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/mip6.ko 2024-03-19T06:06:41.148 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ 2024-03-19T06:06:41.148 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-19T06:06:41.148 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-03-19T06:06:41.148 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-19T06:06:41.148 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-19T06:06:41.148 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-19T06:06:41.148 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-19T06:06:41.148 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-19T06:06:41.148 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-19T06:06:41.148 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-19T06:06:41.148 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-19T06:06:41.148 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-19T06:06:41.148 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-19T06:06:41.148 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-19T06:06:41.148 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-19T06:06:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15025 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-19T06:06:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-19T06:06:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-19T06:06:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-19T06:06:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-19T06:06:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-19T06:06:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-19T06:06:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-19T06:06:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-19T06:06:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-19T06:06:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8913 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-19T06:06:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/sit.ko 2024-03-19T06:06:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/tunnel6.ko 2024-03-19T06:06:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-19T06:06:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/key/ 2024-03-19T06:06:41.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 84401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/key/af_key.ko 2024-03-19T06:06:41.150 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/ 2024-03-19T06:06:41.150 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 125209 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_core.ko 2024-03-19T06:06:41.150 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-19T06:06:41.150 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_eth.ko 2024-03-19T06:06:41.150 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36497 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ip.ko 2024-03-19T06:06:41.150 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ip6.ko 2024-03-19T06:06:41.150 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_netlink.ko 2024-03-19T06:06:41.150 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ppp.ko 2024-03-19T06:06:41.150 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/lapb/ 2024-03-19T06:06:41.150 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/lapb/lapb.ko 2024-03-19T06:06:41.150 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/llc/ 2024-03-19T06:06:41.150 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/llc/llc.ko 2024-03-19T06:06:41.150 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 268521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/llc/llc2.ko 2024-03-19T06:06:41.150 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/mac802154/ 2024-03-19T06:06:41.151 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 309417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/mac802154/mac802154.ko 2024-03-19T06:06:41.151 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/mpls/ 2024-03-19T06:06:41.151 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/mpls/mpls_gso.ko 2024-03-19T06:06:41.151 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ 2024-03-19T06:06:41.151 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ 2024-03-19T06:06:41.151 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 119705 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set.ko 2024-03-19T06:06:41.151 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28617 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-19T06:06:41.151 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-19T06:06:41.151 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-19T06:06:41.151 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 99993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-19T06:06:41.151 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 100281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-19T06:06:41.151 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-19T06:06:41.151 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-19T06:06:41.151 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 111673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-19T06:06:41.151 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-19T06:06:41.151 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 108345 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-19T06:06:41.152 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 112145 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-19T06:06:41.152 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 112409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-19T06:06:41.152 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 110337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-19T06:06:41.152 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 113289 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-19T06:06:41.152 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-19T06:06:41.152 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ 2024-03-19T06:06:41.152 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 412513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-19T06:06:41.152 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11993 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-19T06:06:41.152 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-19T06:06:41.152 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-19T06:06:41.152 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-19T06:06:41.152 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-19T06:06:41.152 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-19T06:06:41.152 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-19T06:06:41.152 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10641 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-19T06:06:41.153 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9265 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-19T06:06:41.153 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-19T06:06:41.153 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13545 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-19T06:06:41.153 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7721 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-19T06:06:41.153 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-19T06:06:41.153 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conncount.ko 2024-03-19T06:06:41.153 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 411769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack.ko 2024-03-19T06:06:41.153 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15881 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-19T06:06:41.153 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-19T06:06:41.153 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-19T06:06:41.153 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 118161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-19T06:06:41.153 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-19T06:06:41.153 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-19T06:06:41.153 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 108313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-19T06:06:41.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-19T06:06:41.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-19T06:06:41.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-19T06:06:41.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-19T06:06:41.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-19T06:06:41.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-19T06:06:41.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 92233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_flow_table.ko 2024-03-19T06:06:41.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-19T06:06:41.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_log_syslog.ko 2024-03-19T06:06:41.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 96521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat.ko 2024-03-19T06:06:41.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-19T06:06:41.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12529 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-19T06:06:41.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_irc.ko 2024-03-19T06:06:41.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_sip.ko 2024-03-19T06:06:41.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-19T06:06:41.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44137 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-19T06:06:41.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 623473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_tables.ko 2024-03-19T06:06:41.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42513 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink.ko 2024-03-19T06:06:41.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30161 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-19T06:06:41.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-03-19T06:06:41.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_log.ko 2024-03-19T06:06:41.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-19T06:06:41.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49649 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-19T06:06:41.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_chain_nat.ko 2024-03-19T06:06:41.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_compat.ko 2024-03-19T06:06:41.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_ct.ko 2024-03-19T06:06:41.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9505 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-19T06:06:41.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_fib.ko 2024-03-19T06:06:41.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-19T06:06:41.156 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_hash.ko 2024-03-19T06:06:41.156 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20033 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_limit.ko 2024-03-19T06:06:41.156 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_log.ko 2024-03-19T06:06:41.156 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_masq.ko 2024-03-19T06:06:41.156 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14329 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_nat.ko 2024-03-19T06:06:41.156 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_numgen.ko 2024-03-19T06:06:41.156 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11753 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_osf.ko 2024-03-19T06:06:41.156 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_queue.ko 2024-03-19T06:06:41.156 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_redir.ko 2024-03-19T06:06:41.156 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_reject.ko 2024-03-19T06:06:41.156 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9985 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_reject_inet.ko 2024-03-19T06:06:41.156 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12841 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_socket.ko 2024-03-19T06:06:41.156 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_synproxy.ko 2024-03-19T06:06:41.156 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_tproxy.ko 2024-03-19T06:06:41.157 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/x_tables.ko 2024-03-19T06:06:41.157 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_AUDIT.ko 2024-03-19T06:06:41.157 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-19T06:06:41.157 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7633 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-19T06:06:41.157 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-19T06:06:41.157 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CT.ko 2024-03-19T06:06:41.157 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_DSCP.ko 2024-03-19T06:06:41.157 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_HL.ko 2024-03-19T06:06:41.157 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13281 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_HMARK.ko 2024-03-19T06:06:41.157 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-19T06:06:41.157 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13801 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_LED.ko 2024-03-19T06:06:41.157 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_LOG.ko 2024-03-19T06:06:41.157 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-19T06:06:41.157 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11561 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NETMAP.ko 2024-03-19T06:06:41.157 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NFLOG.ko 2024-03-19T06:06:41.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-19T06:06:41.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_RATEEST.ko 2024-03-19T06:06:41.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-19T06:06:41.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_SECMARK.ko 2024-03-19T06:06:41.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-19T06:06:41.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-19T06:06:41.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TEE.ko 2024-03-19T06:06:41.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TPROXY.ko 2024-03-19T06:06:41.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8233 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TRACE.ko 2024-03-19T06:06:41.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_addrtype.ko 2024-03-19T06:06:41.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_bpf.ko 2024-03-19T06:06:41.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cgroup.ko 2024-03-19T06:06:41.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cluster.ko 2024-03-19T06:06:41.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_comment.ko 2024-03-19T06:06:41.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connbytes.ko 2024-03-19T06:06:41.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11257 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connlabel.ko 2024-03-19T06:06:41.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connlimit.ko 2024-03-19T06:06:41.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connmark.ko 2024-03-19T06:06:41.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12305 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_conntrack.ko 2024-03-19T06:06:41.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cpu.ko 2024-03-19T06:06:41.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10889 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_dccp.ko 2024-03-19T06:06:41.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7769 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_devgroup.ko 2024-03-19T06:06:41.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_dscp.ko 2024-03-19T06:06:41.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10569 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ecn.ko 2024-03-19T06:06:41.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_esp.ko 2024-03-19T06:06:41.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_hashlimit.ko 2024-03-19T06:06:41.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_helper.ko 2024-03-19T06:06:41.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_hl.ko 2024-03-19T06:06:41.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11825 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ipcomp.ko 2024-03-19T06:06:41.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_iprange.ko 2024-03-19T06:06:41.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11697 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ipvs.ko 2024-03-19T06:06:41.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_l2tp.ko 2024-03-19T06:06:41.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_length.ko 2024-03-19T06:06:41.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10121 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_limit.ko 2024-03-19T06:06:41.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_mac.ko 2024-03-19T06:06:41.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_mark.ko 2024-03-19T06:06:41.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11729 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_multiport.ko 2024-03-19T06:06:41.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13737 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_nat.ko 2024-03-19T06:06:41.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_nfacct.ko 2024-03-19T06:06:41.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_osf.ko 2024-03-19T06:06:41.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_owner.ko 2024-03-19T06:06:41.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10017 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_physdev.ko 2024-03-19T06:06:41.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_pkttype.ko 2024-03-19T06:06:41.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11897 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_policy.ko 2024-03-19T06:06:41.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9385 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_quota.ko 2024-03-19T06:06:41.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_rateest.ko 2024-03-19T06:06:41.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8169 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_realm.ko 2024-03-19T06:06:41.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36361 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_recent.ko 2024-03-19T06:06:41.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13241 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_sctp.ko 2024-03-19T06:06:41.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30001 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_set.ko 2024-03-19T06:06:41.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_socket.ko 2024-03-19T06:06:41.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9417 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_state.ko 2024-03-19T06:06:41.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_statistic.ko 2024-03-19T06:06:41.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8713 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_string.ko 2024-03-19T06:06:41.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_tcpmss.ko 2024-03-19T06:06:41.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15681 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_tcpudp.ko 2024-03-19T06:06:41.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_time.ko 2024-03-19T06:06:41.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9313 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_u32.ko 2024-03-19T06:06:41.161 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netlink/ 2024-03-19T06:06:41.162 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/netlink/netlink_diag.ko 2024-03-19T06:06:41.162 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/nsh/ 2024-03-19T06:06:41.162 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12337 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/nsh/nsh.ko 2024-03-19T06:06:41.162 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/ 2024-03-19T06:06:41.162 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 384201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/openvswitch.ko 2024-03-19T06:06:41.162 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10369 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-geneve.ko 2024-03-19T06:06:41.162 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-gre.ko 2024-03-19T06:06:41.162 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11833 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-vxlan.ko 2024-03-19T06:06:41.162 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/packet/ 2024-03-19T06:06:41.162 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13473 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/packet/af_packet_diag.ko 2024-03-19T06:06:41.162 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/phonet/ 2024-03-19T06:06:41.162 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 112553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/phonet/phonet.ko 2024-03-19T06:06:41.162 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55057 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/phonet/pn_pep.ko 2024-03-19T06:06:41.162 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/ 2024-03-19T06:06:41.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 253961 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds.ko 2024-03-19T06:06:41.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 165105 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds_rdma.ko 2024-03-19T06:06:41.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 68097 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds_tcp.ko 2024-03-19T06:06:41.163 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/rxrpc/ 2024-03-19T06:06:41.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 828297 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/rxrpc/rxrpc.ko 2024-03-19T06:06:41.163 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/ 2024-03-19T06:06:41.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_csum.ko 2024-03-19T06:06:41.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23489 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_gact.ko 2024-03-19T06:06:41.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_mirred.ko 2024-03-19T06:06:41.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23377 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_nat.ko 2024-03-19T06:06:41.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43353 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_pedit.ko 2024-03-19T06:06:41.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_police.ko 2024-03-19T06:06:41.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20193 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_simple.ko 2024-03-19T06:06:41.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35201 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_skbedit.ko 2024-03-19T06:06:41.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36577 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_vlan.ko 2024-03-19T06:06:41.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_basic.ko 2024-03-19T06:06:41.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33873 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_bpf.ko 2024-03-19T06:06:41.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19185 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_cgroup.ko 2024-03-19T06:06:41.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_flow.ko 2024-03-19T06:06:41.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_fw.ko 2024-03-19T06:06:41.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_route.ko 2024-03-19T06:06:41.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62657 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_u32.ko 2024-03-19T06:06:41.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7465 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_cmp.ko 2024-03-19T06:06:41.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_ipset.ko 2024-03-19T06:06:41.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33425 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_meta.ko 2024-03-19T06:06:41.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7921 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_nbyte.ko 2024-03-19T06:06:41.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10929 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_text.ko 2024-03-19T06:06:41.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7273 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_u32.ko 2024-03-19T06:06:41.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21673 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_choke.ko 2024-03-19T06:06:41.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20865 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_codel.ko 2024-03-19T06:06:41.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34593 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_drr.ko 2024-03-19T06:06:41.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_fq.ko 2024-03-19T06:06:41.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31521 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_fq_codel.ko 2024-03-19T06:06:41.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35457 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_gred.ko 2024-03-19T06:06:41.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49849 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_hfsc.ko 2024-03-19T06:06:41.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21977 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_hhf.ko 2024-03-19T06:06:41.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66449 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_htb.ko 2024-03-19T06:06:41.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_ingress.ko 2024-03-19T06:06:41.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30225 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_mqprio.ko 2024-03-19T06:06:41.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10809 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_mqprio_lib.ko 2024-03-19T06:06:41.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26089 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_multiq.ko 2024-03-19T06:06:41.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36153 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_netem.ko 2024-03-19T06:06:41.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27409 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_pie.ko 2024-03-19T06:06:41.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10665 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_plug.ko 2024-03-19T06:06:41.166 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24777 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_prio.ko 2024-03-19T06:06:41.166 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48537 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_qfq.ko 2024-03-19T06:06:41.166 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_red.ko 2024-03-19T06:06:41.166 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26793 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_sfb.ko 2024-03-19T06:06:41.166 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31321 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_sfq.ko 2024-03-19T06:06:41.166 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_tbf.ko 2024-03-19T06:06:41.166 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28273 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_teql.ko 2024-03-19T06:06:41.166 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp/ 2024-03-19T06:06:41.166 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 932945 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp/sctp.ko 2024-03-19T06:06:41.166 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp/sctp_diag.ko 2024-03-19T06:06:41.166 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/ 2024-03-19T06:06:41.166 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss/ 2024-03-19T06:06:41.166 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 337009 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-19T06:06:41.166 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55041 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-19T06:06:41.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1513905 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/sunrpc.ko 2024-03-19T06:06:41.167 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/xprtrdma/ 2024-03-19T06:06:41.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 704761 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-19T06:06:41.167 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc/ 2024-03-19T06:06:41.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10401 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc/diag.ko 2024-03-19T06:06:41.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 867249 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc/tipc.ko 2024-03-19T06:06:41.167 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/unix/ 2024-03-19T06:06:41.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15937 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/unix/unix_diag.ko 2024-03-19T06:06:41.167 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/ 2024-03-19T06:06:41.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 87745 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-19T06:06:41.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67953 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-19T06:06:41.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 98113 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock.ko 2024-03-19T06:06:41.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11081 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-19T06:06:41.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17817 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-19T06:06:41.167 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/x25/ 2024-03-19T06:06:41.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 131273 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/x25/x25.ko 2024-03-19T06:06:41.168 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/xfrm/ 2024-03-19T06:06:41.168 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23065 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/xfrm/xfrm_algo.ko 2024-03-19T06:06:41.168 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20553 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-19T06:06:41.168 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 105217 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/net/xfrm/xfrm_user.ko 2024-03-19T06:06:41.168 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/virt/ 2024-03-19T06:06:41.168 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/virt/lib/ 2024-03-19T06:06:41.168 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15441 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/kernel/virt/lib/irqbypass.ko 2024-03-19T06:06:41.168 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 642383 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.alias 2024-03-19T06:06:41.168 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 625850 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.alias.bin 2024-03-19T06:06:41.168 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7677 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.builtin 2024-03-19T06:06:41.168 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23498 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.builtin.alias.bin 2024-03-19T06:06:41.168 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9916 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.builtin.bin 2024-03-19T06:06:41.168 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70732 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.builtin.modinfo 2024-03-19T06:06:41.168 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 147214 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.dep 2024-03-19T06:06:41.168 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 233213 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.dep.bin 2024-03-19T06:06:41.169 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 210 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.devname 2024-03-19T06:06:41.169 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 72614 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.order 2024-03-19T06:06:41.169 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 879 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.softdep 2024-03-19T06:06:41.169 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 257955 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.symbols 2024-03-19T06:06:41.169 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 312782 2024-03-19 02:25 ./lib/modules/6.8.0-g908b6b276e8f/modules.symbols.bin 2024-03-19T06:06:41.169 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./usr/ 2024-03-19T06:06:41.169 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./usr/share/ 2024-03-19T06:06:41.169 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./usr/share/doc/ 2024-03-19T06:06:41.169 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-03-19 02:25 ./usr/share/doc/linux-image-6.8.0-g908b6b276e8f/ 2024-03-19T06:06:41.169 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 171 2024-03-19 02:25 ./usr/share/doc/linux-image-6.8.0-g908b6b276e8f/changelog.Debian.gz 2024-03-19T06:06:41.169 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 691 2024-03-19 02:25 ./usr/share/doc/linux-image-6.8.0-g908b6b276e8f/copyright 2024-03-19T06:06:41.174 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g908b6b276e8f 2024-03-19T06:06:41.174 INFO:teuthology.task.kernel:searching for kernel 6.8.0-g908b6b276e8f 2024-03-19T06:06:41.174 DEBUG:teuthology.orchestra.run.smithi032:> egrep '(submenu|menuentry.*6.8.0-g908b6b276e8f).*{' /boot/grub/grub.cfg 2024-03-19T06:06:41.181 INFO:teuthology.orchestra.run.smithi032.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-19T06:06:41.181 INFO:teuthology.orchestra.run.smithi032.stdout: menuentry 'Ubuntu, with Linux 6.8.0-g908b6b276e8f' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-g908b6b276e8f-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-19T06:06:41.181 INFO:teuthology.orchestra.run.smithi032.stdout: menuentry 'Ubuntu, with Linux 6.8.0-g908b6b276e8f (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-g908b6b276e8f-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-19T06:06:41.181 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-03-19T06:06:41.181 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.8.0-g908b6b276e8f 2024-03-19T06:06:41.182 DEBUG:teuthology.orchestra.run.smithi032:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-03-19T06:06:41.223 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi032.front.sepia.ceph.com to complete... 2024-03-19T06:06:41.597 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub' 2024-03-19T06:06:41.598 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-19T06:06:41.602 INFO:teuthology.orchestra.run.smithi032.stderr:Generating grub configuration file ... 2024-03-19T06:06:41.840 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-6.8.0-g908b6b276e8f 2024-03-19T06:06:41.846 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-6.8.0-g908b6b276e8f 2024-03-19T06:06:42.082 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-19T06:06:42.087 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-19T06:06:42.133 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-19T06:06:42.138 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-19T06:06:42.291 INFO:teuthology.orchestra.run.smithi032.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-19T06:06:42.291 INFO:teuthology.orchestra.run.smithi032.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-19T06:06:42.291 INFO:teuthology.orchestra.run.smithi032.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-19T06:06:42.308 INFO:teuthology.orchestra.run.smithi032.stderr:done 2024-03-19T06:07:07.124 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-19T06:07:07.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-03-19T06:07:07.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T06:07:13.423 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-19T06:07:13.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-03-19T06:07:13.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T06:07:25.471 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-19T06:07:31.870 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-03-19T06:07:34.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-03-19T06:07:34.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T06:07:37.534 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-19T06:07:40.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-03-19T06:07:40.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T06:07:49.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-03-19T06:07:49.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T06:07:59.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-03-19T06:08:11.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-03-19T06:08:11.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T06:08:14.334 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-03-19T06:08:29.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-03-19T06:08:29.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T06:08:29.602 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-03-19T06:08:30.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-03-19T06:08:30.381 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.8.0-g908b6b276e8f"... 2024-03-19T06:08:30.381 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-03-19T06:08:30.436 INFO:teuthology.orchestra.run.smithi032.stdout:6.8.0-g908b6b276e8f 2024-03-19T06:08:30.437 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g908b6b276e8f vs 6.8.0-g908b6b276e8f 2024-03-19T06:08:30.437 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-19T06:08:30.437 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-19T06:08:31.438 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-19T06:08:31.438 DEBUG:teuthology.orchestra.run.smithi032:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-19T06:08:31.537 INFO:teuthology.orchestra.run.smithi032.stdout:ttyS1 2024-03-19T06:08:31.576 DEBUG:teuthology.parallel:result is None 2024-03-19T06:08:49.548 DEBUG:teuthology.orchestra.remote:timed out 2024-03-19T06:09:04.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-03-19T06:09:04.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T06:09:04.830 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-03-19T06:09:05.435 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-03-19T06:09:05.436 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.8.0-g908b6b276e8f"... 2024-03-19T06:09:05.436 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-03-19T06:09:05.486 INFO:teuthology.orchestra.run.smithi171.stdout:6.8.0-g908b6b276e8f 2024-03-19T06:09:05.487 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g908b6b276e8f vs 6.8.0-g908b6b276e8f 2024-03-19T06:09:05.487 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-19T06:09:05.487 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-19T06:09:06.488 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-19T06:09:06.488 DEBUG:teuthology.orchestra.run.smithi171:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-19T06:09:06.567 INFO:teuthology.orchestra.run.smithi171.stdout:ttyS1 2024-03-19T06:09:06.610 DEBUG:teuthology.parallel:result is None 2024-03-19T06:09:06.610 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-19T06:09:06.622 INFO:teuthology.task.internal:Creating test directory... 2024-03-19T06:09:06.622 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-19T06:09:06.626 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-19T06:09:06.635 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-19T06:09:06.641 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-19T06:09:06.650 INFO:teuthology.task.internal:Creating archive directory... 2024-03-19T06:09:06.650 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-19T06:09:06.679 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-19T06:09:06.702 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-19T06:09:06.709 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-19T06:09:06.709 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-19T06:09:06.739 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-19T06:09:06.761 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-19T06:09:06.775 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-19T06:09:06.779 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-19T06:09:06.793 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-19T06:09:06.795 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-19T06:09:06.802 INFO:teuthology.task.internal:Configuring sudo... 2024-03-19T06:09:06.802 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-19T06:09:06.823 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-19T06:09:06.859 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-19T06:09:06.869 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-19T06:09:06.869 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-19T06:09:06.887 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-19T06:09:06.911 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-19T06:09:06.945 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-19T06:09:06.997 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:09:06.997 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-19T06:09:07.073 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-19T06:09:07.082 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-19T06:09:07.131 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:09:07.131 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-19T06:09:07.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo service rsyslog restart 2024-03-19T06:09:07.212 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-03-19T06:09:07.337 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-19T06:09:07.345 INFO:teuthology.task.internal:Starting timer... 2024-03-19T06:09:07.345 INFO:teuthology.run_tasks:Running task pcp... 2024-03-19T06:09:07.409 INFO:teuthology.run_tasks:Running task selinux... 2024-03-19T06:09:07.418 DEBUG:teuthology.task.selinux:Excluding smithi032: OS 'ubuntu' does not support SELinux 2024-03-19T06:09:07.418 DEBUG:teuthology.task.selinux:Excluding smithi171: OS 'ubuntu' does not support SELinux 2024-03-19T06:09:07.418 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-19T06:09:07.418 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-03-19T06:09:07.418 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-19T06:09:07.419 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-19T06:09:07.427 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-19T06:09:07.446 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-19T06:09:07.447 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi032.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-19T06:16:52.787 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi032.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-03-19T06:16:52.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-03-19T06:16:52.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T06:16:52.875 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-03-19T06:16:52.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-03-19T06:16:52.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-03-19T06:16:52.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T06:16:53.071 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-03-19T06:16:53.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-03-19T06:16:53.201 INFO:teuthology.run_tasks:Running task clock... 2024-03-19T06:16:53.213 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-19T06:16:53.213 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-19T06:16:53.214 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-19T06:16:53.217 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-19T06:16:53.217 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-19T06:16:53.253 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-19T06:16:53.254 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: Command line: ntpd -gq 2024-03-19T06:16:53.254 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: ---------------------------------------------------- 2024-03-19T06:16:53.254 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: ntp-4 is maintained by Network Time Foundation, 2024-03-19T06:16:53.254 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-19T06:16:53.254 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: corporation. Support and training for ntp-4 are 2024-03-19T06:16:53.254 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: available at https://www.nwtime.org/support 2024-03-19T06:16:53.254 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: ---------------------------------------------------- 2024-03-19T06:16:53.255 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: proto: precision = 0.043 usec (-24) 2024-03-19T06:16:53.255 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: basedate set to 2022-02-04 2024-03-19T06:16:53.255 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: gps base set to 2022-02-06 (week 2196) 2024-03-19T06:16:53.256 INFO:teuthology.orchestra.run.smithi032.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-19T06:16:53.256 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-19T06:16:53.256 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: restrict ::: KOD does nothing without LIMITED. 2024-03-19T06:16:53.256 INFO:teuthology.orchestra.run.smithi032.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-19T06:16:53.257 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: Listen and drop on 0 v6wildcard [::]:123 2024-03-19T06:16:53.257 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-19T06:16:53.258 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: Listen normally on 2 lo 127.0.0.1:123 2024-03-19T06:16:53.258 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: Listen normally on 3 ens1f0 172.21.15.32:123 2024-03-19T06:16:53.258 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: Listen normally on 4 lo [::1]:123 2024-03-19T06:16:53.258 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:2602%4]:123 2024-03-19T06:16:53.258 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:16:53 ntpd[17082]: Listening on routing socket on fd #22 for interface updates 2024-03-19T06:16:53.282 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-19T06:16:53.282 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: Command line: ntpd -gq 2024-03-19T06:16:53.282 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: ---------------------------------------------------- 2024-03-19T06:16:53.282 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: ntp-4 is maintained by Network Time Foundation, 2024-03-19T06:16:53.282 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-19T06:16:53.282 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: corporation. Support and training for ntp-4 are 2024-03-19T06:16:53.283 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: available at https://www.nwtime.org/support 2024-03-19T06:16:53.283 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: ---------------------------------------------------- 2024-03-19T06:16:53.283 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: proto: precision = 0.041 usec (-24) 2024-03-19T06:16:53.283 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: basedate set to 2022-02-04 2024-03-19T06:16:53.284 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: gps base set to 2022-02-06 (week 2196) 2024-03-19T06:16:53.284 INFO:teuthology.orchestra.run.smithi171.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-19T06:16:53.284 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-19T06:16:53.284 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: restrict ::: KOD does nothing without LIMITED. 2024-03-19T06:16:53.285 INFO:teuthology.orchestra.run.smithi171.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-19T06:16:53.286 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: Listen and drop on 0 v6wildcard [::]:123 2024-03-19T06:16:53.286 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-19T06:16:53.286 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: Listen normally on 2 lo 127.0.0.1:123 2024-03-19T06:16:53.286 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: Listen normally on 3 enp3s0f1 172.21.15.171:123 2024-03-19T06:16:53.286 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: Listen normally on 4 lo [::1]:123 2024-03-19T06:16:53.286 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f6d%5]:123 2024-03-19T06:16:53.286 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:16:53 ntpd[17183]: Listening on routing socket on fd #22 for interface updates 2024-03-19T06:16:54.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:54 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:54.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:54 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:54.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:54 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:54.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:54 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:54.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:54 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:54.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:54 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:54.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:54 ntpd[17082]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:54.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:54 ntpd[17082]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:16:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:54 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:54 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:54 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:54 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:54 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:54 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:54 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:54 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:54.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:54 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:54.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:54 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:16:54.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:54 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:54.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:54 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:54.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:54 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:54.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:54 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:16:55.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:55 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:55.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:55 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:55.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:55 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:55.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:55 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:55.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:55 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:55.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:55 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:55.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:55 ntpd[17082]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:55.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:55 ntpd[17082]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:16:55.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:55 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:55.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:55 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:55.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:55 ntpd[17082]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:55.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:55 ntpd[17082]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:16:56.254 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:56 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:56.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:56 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:56.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:56 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:56.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:56 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:56.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:56 ntpd[17082]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:56.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:56 ntpd[17082]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:16:56.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:56.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:56.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:56.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:56.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:56.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:56.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:56.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:56.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:56.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:16:56.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:56.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:56.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:56.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:16:56.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:56.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:56.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:56.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:56 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:16:57.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:57 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:57.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:57 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:57.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:57 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:57.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:57 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:57.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:57 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:57.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:57 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:57.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:57 ntpd[17082]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:57.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:57 ntpd[17082]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:16:57.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:57 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:57.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:57 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:57.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:57 ntpd[17082]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:57.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:57 ntpd[17082]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:16:58.254 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:58 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:58.254 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:58 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:58.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:58 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:58.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:58 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:58.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:58 ntpd[17082]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:58.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:58 ntpd[17082]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:16:58.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:58.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:58.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:58.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:58.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:58.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:58.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:58.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:58.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:58.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:16:58.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:58.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:58.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:58.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:16:58.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:58.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:58.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:58.286 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:16:58 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:16:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:59 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:59 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:59 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:59 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:59 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:59 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:59 ntpd[17082]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:59 ntpd[17082]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:16:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:59 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:16:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:59 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:16:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:59 ntpd[17082]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:16:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:16:59 ntpd[17082]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:17:00.254 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:17:00 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:17:00.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:17:00 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:17:00.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:17:00 ntpd[17082]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:17:00.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:17:00 ntpd[17082]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:17:00.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:17:00 ntpd[17082]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:17:00.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:17:00 ntpd[17082]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:17:00.255 INFO:teuthology.orchestra.run.smithi032.stdout:19 Mar 06:17:00 ntpd[17082]: ntpd: time slew -0.001599 s 2024-03-19T06:17:00.255 INFO:teuthology.orchestra.run.smithi032.stdout:ntpd: time slew -0.001599s 2024-03-19T06:17:00.255 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:17:00 ntpd[17082]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-19T06:17:00.256 INFO:teuthology.orchestra.run.smithi032.stderr:19 Mar 06:17:00 ntpd[17082]: can't open /var/log/ntpstats/loopstats.20240319: Permission denied 2024-03-19T06:17:00.283 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:17:00 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:17:00.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:17:00 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:17:00.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:17:00 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:17:00.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:17:00 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:17:00.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:17:00 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:17:00.284 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:17:00 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:17:00.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:17:00 ntpd[17183]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-19T06:17:00.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:17:00 ntpd[17183]: can't open /var/log/ntpstats/rawstats.20240319: Permission denied 2024-03-19T06:17:00.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:17:00 ntpd[17183]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-19T06:17:00.285 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:17:00 ntpd[17183]: can't open /var/log/ntpstats/peerstats.20240319: Permission denied 2024-03-19T06:17:00.285 INFO:teuthology.orchestra.run.smithi171.stdout:19 Mar 06:17:00 ntpd[17183]: ntpd: time slew -0.003811 s 2024-03-19T06:17:00.285 INFO:teuthology.orchestra.run.smithi171.stdout:ntpd: time slew -0.003811s 2024-03-19T06:17:00.286 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:17:00 ntpd[17183]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-19T06:17:00.286 INFO:teuthology.orchestra.run.smithi171.stderr:19 Mar 06:17:00 ntpd[17183]: can't open /var/log/ntpstats/loopstats.20240319: Permission denied 2024-03-19T06:17:00.341 INFO:teuthology.orchestra.run.smithi032.stdout: remote refid st t when poll reach delay offset jitter 2024-03-19T06:17:00.342 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================== 2024-03-19T06:17:00.342 INFO:teuthology.orchestra.run.smithi032.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-19T06:17:00.342 INFO:teuthology.orchestra.run.smithi032.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-19T06:17:00.342 INFO:teuthology.orchestra.run.smithi032.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-19T06:17:00.342 INFO:teuthology.orchestra.run.smithi032.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-19T06:17:00.381 INFO:teuthology.orchestra.run.smithi171.stdout: remote refid st t when poll reach delay offset jitter 2024-03-19T06:17:00.381 INFO:teuthology.orchestra.run.smithi171.stdout:============================================================================== 2024-03-19T06:17:00.381 INFO:teuthology.orchestra.run.smithi171.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-19T06:17:00.382 INFO:teuthology.orchestra.run.smithi171.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-19T06:17:00.382 INFO:teuthology.orchestra.run.smithi171.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-19T06:17:00.382 INFO:teuthology.orchestra.run.smithi171.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-19T06:17:00.383 INFO:teuthology.run_tasks:Running task install... 2024-03-19T06:17:00.392 DEBUG:teuthology.task.install:project ceph 2024-03-19T06:17:00.393 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'}} 2024-03-19T06:17:00.393 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'} 2024-03-19T06:17:00.393 INFO:teuthology.task.install:Using flavor: default 2024-03-19T06:17:00.399 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-19T06:17:00.399 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-19T06:17:00.399 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-key list | grep Ceph 2024-03-19T06:17:00.400 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-key list | grep Ceph 2024-03-19T06:17:00.503 INFO:teuthology.orchestra.run.smithi032.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-19T06:17:00.523 INFO:teuthology.orchestra.run.smithi171.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-19T06:17:00.573 INFO:teuthology.orchestra.run.smithi171.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-19T06:17:00.574 INFO:teuthology.orchestra.run.smithi171.stdout:uid [ unknown] Ceph.com (release key) 2024-03-19T06:17:00.575 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-03-19T06:17:00.575 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-03-19T06:17:00.575 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:17:00.627 INFO:teuthology.orchestra.run.smithi032.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-19T06:17:00.628 INFO:teuthology.orchestra.run.smithi032.stdout:uid [ unknown] Ceph.com (release key) 2024-03-19T06:17:00.629 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-03-19T06:17:00.629 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-03-19T06:17:00.629 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:17:00.721 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default/ 2024-03-19T06:17:00.721 INFO:teuthology.task.install.deb:Package version is 19.0.0-1934-gb0ea271b-1jammy 2024-03-19T06:17:00.841 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:17:00.841 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-19T06:17:00.860 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get update 2024-03-19T06:17:00.873 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default/ 2024-03-19T06:17:00.873 INFO:teuthology.task.install.deb:Package version is 19.0.0-1934-gb0ea271b-1jammy 2024-03-19T06:17:01.052 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-19T06:17:01.083 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:17:01.083 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-19T06:17:01.103 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2024-03-19T06:17:01.130 INFO:teuthology.orchestra.run.smithi171.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy InRelease 2024-03-19T06:17:01.164 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-19T06:17:01.164 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-19T06:17:01.203 INFO:teuthology.orchestra.run.smithi171.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-19T06:17:01.225 INFO:teuthology.orchestra.run.smithi171.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2024-03-19T06:17:01.245 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-19T06:17:01.257 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-19T06:17:01.327 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-19T06:17:01.329 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-19T06:17:01.346 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-19T06:17:01.375 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-19T06:17:01.489 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-19T06:17:01.533 INFO:teuthology.orchestra.run.smithi032.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy InRelease 2024-03-19T06:17:01.638 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 28.9 kB in 1s (52.2 kB/s) 2024-03-19T06:17:01.642 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-19T06:17:01.722 INFO:teuthology.orchestra.run.smithi032.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-19T06:17:01.801 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2024-03-19T06:17:01.893 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-19T06:17:02.008 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 28.9 kB in 1s (43.0 kB/s) 2024-03-19T06:17:02.596 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-03-19T06:17:02.611 DEBUG:teuthology.orchestra.run.smithi171:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1934-gb0ea271b-1jammy cephadm=19.0.0-1934-gb0ea271b-1jammy ceph-mds=19.0.0-1934-gb0ea271b-1jammy ceph-mgr=19.0.0-1934-gb0ea271b-1jammy ceph-common=19.0.0-1934-gb0ea271b-1jammy ceph-fuse=19.0.0-1934-gb0ea271b-1jammy ceph-test=19.0.0-1934-gb0ea271b-1jammy ceph-volume=19.0.0-1934-gb0ea271b-1jammy radosgw=19.0.0-1934-gb0ea271b-1jammy python3-rados=19.0.0-1934-gb0ea271b-1jammy python3-rgw=19.0.0-1934-gb0ea271b-1jammy python3-cephfs=19.0.0-1934-gb0ea271b-1jammy python3-rbd=19.0.0-1934-gb0ea271b-1jammy libcephfs2=19.0.0-1934-gb0ea271b-1jammy libcephfs-dev=19.0.0-1934-gb0ea271b-1jammy librados2=19.0.0-1934-gb0ea271b-1jammy librbd1=19.0.0-1934-gb0ea271b-1jammy rbd-fuse=19.0.0-1934-gb0ea271b-1jammy python3-cephfs=19.0.0-1934-gb0ea271b-1jammy cephfs-shell=19.0.0-1934-gb0ea271b-1jammy cephfs-top=19.0.0-1934-gb0ea271b-1jammy cephfs-mirror=19.0.0-1934-gb0ea271b-1jammy 2024-03-19T06:17:02.685 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-03-19T06:17:02.854 INFO:teuthology.orchestra.run.smithi171.stdout:Building dependency tree... 2024-03-19T06:17:02.855 INFO:teuthology.orchestra.run.smithi171.stdout:Reading state information... 2024-03-19T06:17:02.999 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-03-19T06:17:03.013 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages were automatically installed and are no longer required: 2024-03-19T06:17:03.013 INFO:teuthology.orchestra.run.smithi171.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-19T06:17:03.013 INFO:teuthology.orchestra.run.smithi171.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-19T06:17:03.013 INFO:teuthology.orchestra.run.smithi171.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-19T06:17:03.015 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1934-gb0ea271b-1jammy cephadm=19.0.0-1934-gb0ea271b-1jammy ceph-mds=19.0.0-1934-gb0ea271b-1jammy ceph-mgr=19.0.0-1934-gb0ea271b-1jammy ceph-common=19.0.0-1934-gb0ea271b-1jammy ceph-fuse=19.0.0-1934-gb0ea271b-1jammy ceph-test=19.0.0-1934-gb0ea271b-1jammy ceph-volume=19.0.0-1934-gb0ea271b-1jammy radosgw=19.0.0-1934-gb0ea271b-1jammy python3-rados=19.0.0-1934-gb0ea271b-1jammy python3-rgw=19.0.0-1934-gb0ea271b-1jammy python3-cephfs=19.0.0-1934-gb0ea271b-1jammy python3-rbd=19.0.0-1934-gb0ea271b-1jammy libcephfs2=19.0.0-1934-gb0ea271b-1jammy libcephfs-dev=19.0.0-1934-gb0ea271b-1jammy librados2=19.0.0-1934-gb0ea271b-1jammy librbd1=19.0.0-1934-gb0ea271b-1jammy rbd-fuse=19.0.0-1934-gb0ea271b-1jammy python3-cephfs=19.0.0-1934-gb0ea271b-1jammy cephfs-shell=19.0.0-1934-gb0ea271b-1jammy cephfs-top=19.0.0-1934-gb0ea271b-1jammy cephfs-mirror=19.0.0-1934-gb0ea271b-1jammy 2024-03-19T06:17:03.017 INFO:teuthology.orchestra.run.smithi171.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-19T06:17:03.017 INFO:teuthology.orchestra.run.smithi171.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-19T06:17:03.017 INFO:teuthology.orchestra.run.smithi171.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-19T06:17:03.017 INFO:teuthology.orchestra.run.smithi171.stdout:The following additional packages will be installed: 2024-03-19T06:17:03.017 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-19T06:17:03.018 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-19T06:17:03.018 INFO:teuthology.orchestra.run.smithi171.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-19T06:17:03.018 INFO:teuthology.orchestra.run.smithi171.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-19T06:17:03.018 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-19T06:17:03.018 INFO:teuthology.orchestra.run.smithi171.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-19T06:17:03.018 INFO:teuthology.orchestra.run.smithi171.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-19T06:17:03.018 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-19T06:17:03.018 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-19T06:17:03.018 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-03-19T06:17:03.018 INFO:teuthology.orchestra.run.smithi171.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-03-19T06:17:03.018 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-03-19T06:17:03.018 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-03-19T06:17:03.018 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-03-19T06:17:03.019 INFO:teuthology.orchestra.run.smithi171.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-03-19T06:17:03.019 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-03-19T06:17:03.019 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-03-19T06:17:03.019 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-03-19T06:17:03.019 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-03-19T06:17:03.019 INFO:teuthology.orchestra.run.smithi171.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-03-19T06:17:03.019 INFO:teuthology.orchestra.run.smithi171.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-03-19T06:17:03.019 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-03-19T06:17:03.019 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-03-19T06:17:03.019 INFO:teuthology.orchestra.run.smithi171.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-03-19T06:17:03.019 INFO:teuthology.orchestra.run.smithi171.stdout:Suggested packages: 2024-03-19T06:17:03.019 INFO:teuthology.orchestra.run.smithi171.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-19T06:17:03.019 INFO:teuthology.orchestra.run.smithi171.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-19T06:17:03.020 INFO:teuthology.orchestra.run.smithi171.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-19T06:17:03.020 INFO:teuthology.orchestra.run.smithi171.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-19T06:17:03.020 INFO:teuthology.orchestra.run.smithi171.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-19T06:17:03.020 INFO:teuthology.orchestra.run.smithi171.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-19T06:17:03.020 INFO:teuthology.orchestra.run.smithi171.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-19T06:17:03.020 INFO:teuthology.orchestra.run.smithi171.stdout:Recommended packages: 2024-03-19T06:17:03.020 INFO:teuthology.orchestra.run.smithi171.stdout: btrfs-tools 2024-03-19T06:17:03.095 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-03-19T06:17:03.167 INFO:teuthology.orchestra.run.smithi171.stdout:The following NEW packages will be installed: 2024-03-19T06:17:03.168 INFO:teuthology.orchestra.run.smithi171.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-19T06:17:03.168 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-19T06:17:03.168 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-03-19T06:17:03.168 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-03-19T06:17:03.168 INFO:teuthology.orchestra.run.smithi171.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-19T06:17:03.168 INFO:teuthology.orchestra.run.smithi171.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-03-19T06:17:03.168 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-03-19T06:17:03.168 INFO:teuthology.orchestra.run.smithi171.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-03-19T06:17:03.168 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-03-19T06:17:03.168 INFO:teuthology.orchestra.run.smithi171.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-03-19T06:17:03.168 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-03-19T06:17:03.168 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-03-19T06:17:03.168 INFO:teuthology.orchestra.run.smithi171.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-03-19T06:17:03.168 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-19T06:17:03.168 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-19T06:17:03.169 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-19T06:17:03.169 INFO:teuthology.orchestra.run.smithi171.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-19T06:17:03.169 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-19T06:17:03.169 INFO:teuthology.orchestra.run.smithi171.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-19T06:17:03.169 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-03-19T06:17:03.169 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-03-19T06:17:03.169 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-03-19T06:17:03.169 INFO:teuthology.orchestra.run.smithi171.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-19T06:17:03.169 INFO:teuthology.orchestra.run.smithi171.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-19T06:17:03.169 INFO:teuthology.orchestra.run.smithi171.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-19T06:17:03.169 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-19T06:17:03.169 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-03-19T06:17:03.169 INFO:teuthology.orchestra.run.smithi171.stdout: socat unzip xmlstarlet zip 2024-03-19T06:17:03.270 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-03-19T06:17:03.271 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-03-19T06:17:03.439 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-03-19T06:17:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-19T06:17:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-19T06:17:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-19T06:17:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-19T06:17:03.440 INFO:teuthology.orchestra.run.smithi032.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-19T06:17:03.440 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-19T06:17:03.440 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2024-03-19T06:17:03.440 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-19T06:17:03.440 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-19T06:17:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-19T06:17:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-19T06:17:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-19T06:17:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-19T06:17:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-19T06:17:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-19T06:17:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-19T06:17:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-03-19T06:17:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-03-19T06:17:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-03-19T06:17:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-03-19T06:17:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-03-19T06:17:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-03-19T06:17:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-03-19T06:17:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-03-19T06:17:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-03-19T06:17:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-03-19T06:17:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-03-19T06:17:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-03-19T06:17:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-03-19T06:17:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-03-19T06:17:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-03-19T06:17:03.444 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2024-03-19T06:17:03.444 INFO:teuthology.orchestra.run.smithi032.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-19T06:17:03.444 INFO:teuthology.orchestra.run.smithi032.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-19T06:17:03.444 INFO:teuthology.orchestra.run.smithi032.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-19T06:17:03.444 INFO:teuthology.orchestra.run.smithi032.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-19T06:17:03.444 INFO:teuthology.orchestra.run.smithi032.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-19T06:17:03.444 INFO:teuthology.orchestra.run.smithi032.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-19T06:17:03.444 INFO:teuthology.orchestra.run.smithi032.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-19T06:17:03.444 INFO:teuthology.orchestra.run.smithi032.stdout:Recommended packages: 2024-03-19T06:17:03.444 INFO:teuthology.orchestra.run.smithi032.stdout: btrfs-tools 2024-03-19T06:17:03.468 INFO:teuthology.orchestra.run.smithi171.stdout:0 upgraded, 124 newly installed, 0 to remove and 288 not upgraded. 2024-03-19T06:17:03.468 INFO:teuthology.orchestra.run.smithi171.stdout:Need to get 177 MB of archives. 2024-03-19T06:17:03.468 INFO:teuthology.orchestra.run.smithi171.stdout:After this operation, 732 MB of additional disk space will be used. 2024-03-19T06:17:03.468 INFO:teuthology.orchestra.run.smithi171.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1934-gb0ea271b-1jammy [3,546 kB] 2024-03-19T06:17:03.601 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2024-03-19T06:17:03.601 INFO:teuthology.orchestra.run.smithi032.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-19T06:17:03.601 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-19T06:17:03.601 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-03-19T06:17:03.601 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-03-19T06:17:03.601 INFO:teuthology.orchestra.run.smithi032.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-19T06:17:03.601 INFO:teuthology.orchestra.run.smithi032.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-03-19T06:17:03.601 INFO:teuthology.orchestra.run.smithi032.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-03-19T06:17:03.601 INFO:teuthology.orchestra.run.smithi032.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-03-19T06:17:03.601 INFO:teuthology.orchestra.run.smithi032.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-03-19T06:17:03.601 INFO:teuthology.orchestra.run.smithi032.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-03-19T06:17:03.602 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-03-19T06:17:03.602 INFO:teuthology.orchestra.run.smithi032.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-03-19T06:17:03.602 INFO:teuthology.orchestra.run.smithi032.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-03-19T06:17:03.602 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-19T06:17:03.602 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-19T06:17:03.602 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-19T06:17:03.602 INFO:teuthology.orchestra.run.smithi032.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-19T06:17:03.602 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-19T06:17:03.602 INFO:teuthology.orchestra.run.smithi032.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-19T06:17:03.602 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-03-19T06:17:03.602 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-03-19T06:17:03.602 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-03-19T06:17:03.602 INFO:teuthology.orchestra.run.smithi032.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-19T06:17:03.602 INFO:teuthology.orchestra.run.smithi032.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-19T06:17:03.603 INFO:teuthology.orchestra.run.smithi032.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-19T06:17:03.603 INFO:teuthology.orchestra.run.smithi032.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-19T06:17:03.603 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-03-19T06:17:03.603 INFO:teuthology.orchestra.run.smithi032.stdout: socat unzip xmlstarlet zip 2024-03-19T06:17:04.152 INFO:teuthology.orchestra.run.smithi032.stdout:0 upgraded, 124 newly installed, 0 to remove and 288 not upgraded. 2024-03-19T06:17:04.152 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 177 MB of archives. 2024-03-19T06:17:04.152 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 732 MB of additional disk space will be used. 2024-03-19T06:17:04.152 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1934-gb0ea271b-1jammy [3,546 kB] 2024-03-19T06:17:04.253 INFO:teuthology.orchestra.run.smithi171.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1934-gb0ea271b-1jammy [3,220 kB] 2024-03-19T06:17:04.682 INFO:teuthology.orchestra.run.smithi171.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1934-gb0ea271b-1jammy [711 kB] 2024-03-19T06:17:04.764 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1934-gb0ea271b-1jammy [356 kB] 2024-03-19T06:17:04.805 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1934-gb0ea271b-1jammy [32.8 kB] 2024-03-19T06:17:04.807 INFO:teuthology.orchestra.run.smithi171.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1934-gb0ea271b-1jammy [180 kB] 2024-03-19T06:17:04.831 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1934-gb0ea271b-1jammy [64.6 kB] 2024-03-19T06:17:04.836 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1934-gb0ea271b-1jammy [330 kB] 2024-03-19T06:17:04.878 INFO:teuthology.orchestra.run.smithi171.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1934-gb0ea271b-1jammy [6,582 kB] 2024-03-19T06:17:05.828 INFO:teuthology.orchestra.run.smithi171.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1934-gb0ea271b-1jammy [112 kB] 2024-03-19T06:17:05.843 INFO:teuthology.orchestra.run.smithi171.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-03-19T06:17:05.844 INFO:teuthology.orchestra.run.smithi171.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1934-gb0ea271b-1jammy [466 kB] 2024-03-19T06:17:05.864 INFO:teuthology.orchestra.run.smithi171.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-19T06:17:05.879 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1934-gb0ea271b-1jammy [3,220 kB] 2024-03-19T06:17:05.879 INFO:teuthology.orchestra.run.smithi171.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-03-19T06:17:05.923 INFO:teuthology.orchestra.run.smithi171.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1934-gb0ea271b-1jammy [24.2 MB] 2024-03-19T06:17:05.931 INFO:teuthology.orchestra.run.smithi171.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-19T06:17:05.943 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-03-19T06:17:05.957 INFO:teuthology.orchestra.run.smithi171.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-19T06:17:05.960 INFO:teuthology.orchestra.run.smithi171.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-19T06:17:05.965 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-19T06:17:05.973 INFO:teuthology.orchestra.run.smithi171.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-19T06:17:05.978 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-03-19T06:17:06.021 INFO:teuthology.orchestra.run.smithi171.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-19T06:17:06.024 INFO:teuthology.orchestra.run.smithi171.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-19T06:17:06.033 INFO:teuthology.orchestra.run.smithi171.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-19T06:17:06.036 INFO:teuthology.orchestra.run.smithi171.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-19T06:17:06.036 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-19T06:17:06.037 INFO:teuthology.orchestra.run.smithi171.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-19T06:17:06.045 INFO:teuthology.orchestra.run.smithi171.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-19T06:17:06.047 INFO:teuthology.orchestra.run.smithi171.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-19T06:17:06.049 INFO:teuthology.orchestra.run.smithi171.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-19T06:17:06.050 INFO:teuthology.orchestra.run.smithi171.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-19T06:17:06.052 INFO:teuthology.orchestra.run.smithi171.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-19T06:17:06.065 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-19T06:17:06.070 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-19T06:17:06.070 INFO:teuthology.orchestra.run.smithi171.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-19T06:17:06.073 INFO:teuthology.orchestra.run.smithi171.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-19T06:17:06.074 INFO:teuthology.orchestra.run.smithi171.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-19T06:17:06.075 INFO:teuthology.orchestra.run.smithi171.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-19T06:17:06.075 INFO:teuthology.orchestra.run.smithi171.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-19T06:17:06.076 INFO:teuthology.orchestra.run.smithi171.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-19T06:17:06.077 INFO:teuthology.orchestra.run.smithi171.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-19T06:17:06.077 INFO:teuthology.orchestra.run.smithi171.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-19T06:17:06.077 INFO:teuthology.orchestra.run.smithi171.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-19T06:17:06.088 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-19T06:17:06.095 INFO:teuthology.orchestra.run.smithi171.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-19T06:17:06.096 INFO:teuthology.orchestra.run.smithi171.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-19T06:17:06.096 INFO:teuthology.orchestra.run.smithi171.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-19T06:17:06.116 INFO:teuthology.orchestra.run.smithi171.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-19T06:17:06.116 INFO:teuthology.orchestra.run.smithi171.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-19T06:17:06.116 INFO:teuthology.orchestra.run.smithi171.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-19T06:17:06.117 INFO:teuthology.orchestra.run.smithi171.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-19T06:17:06.118 INFO:teuthology.orchestra.run.smithi171.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-19T06:17:06.118 INFO:teuthology.orchestra.run.smithi171.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-19T06:17:06.118 INFO:teuthology.orchestra.run.smithi171.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-19T06:17:06.138 INFO:teuthology.orchestra.run.smithi171.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-19T06:17:06.139 INFO:teuthology.orchestra.run.smithi171.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-19T06:17:06.139 INFO:teuthology.orchestra.run.smithi171.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-19T06:17:06.150 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-19T06:17:06.154 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-19T06:17:06.165 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-19T06:17:06.169 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-19T06:17:06.170 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-19T06:17:06.173 INFO:teuthology.orchestra.run.smithi171.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-19T06:17:06.173 INFO:teuthology.orchestra.run.smithi171.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-19T06:17:06.174 INFO:teuthology.orchestra.run.smithi171.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-19T06:17:06.174 INFO:teuthology.orchestra.run.smithi171.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-19T06:17:06.176 INFO:teuthology.orchestra.run.smithi171.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-19T06:17:06.177 INFO:teuthology.orchestra.run.smithi171.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-19T06:17:06.178 INFO:teuthology.orchestra.run.smithi171.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-19T06:17:06.182 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-19T06:17:06.185 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-19T06:17:06.187 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-19T06:17:06.189 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-19T06:17:06.191 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-19T06:17:06.203 INFO:teuthology.orchestra.run.smithi171.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-19T06:17:06.204 INFO:teuthology.orchestra.run.smithi171.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-19T06:17:06.206 INFO:teuthology.orchestra.run.smithi171.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-19T06:17:06.216 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-19T06:17:06.219 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-19T06:17:06.221 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-19T06:17:06.222 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-19T06:17:06.222 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-19T06:17:06.224 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-19T06:17:06.224 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-19T06:17:06.225 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-19T06:17:06.225 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-19T06:17:06.228 INFO:teuthology.orchestra.run.smithi171.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-19T06:17:06.229 INFO:teuthology.orchestra.run.smithi171.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-19T06:17:06.231 INFO:teuthology.orchestra.run.smithi171.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-19T06:17:06.271 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-19T06:17:06.271 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-19T06:17:06.297 INFO:teuthology.orchestra.run.smithi171.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-19T06:17:06.298 INFO:teuthology.orchestra.run.smithi171.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-19T06:17:06.301 INFO:teuthology.orchestra.run.smithi171.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-19T06:17:06.301 INFO:teuthology.orchestra.run.smithi171.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-19T06:17:06.302 INFO:teuthology.orchestra.run.smithi171.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-19T06:17:06.327 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-19T06:17:06.329 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-19T06:17:06.330 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-19T06:17:06.331 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-19T06:17:06.332 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-19T06:17:06.332 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-19T06:17:06.333 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-19T06:17:06.333 INFO:teuthology.orchestra.run.smithi032.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-19T06:17:06.342 INFO:teuthology.orchestra.run.smithi171.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-19T06:17:06.344 INFO:teuthology.orchestra.run.smithi171.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-19T06:17:06.345 INFO:teuthology.orchestra.run.smithi171.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-19T06:17:06.371 INFO:teuthology.orchestra.run.smithi171.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-19T06:17:06.380 INFO:teuthology.orchestra.run.smithi032.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-19T06:17:06.381 INFO:teuthology.orchestra.run.smithi032.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-19T06:17:06.382 INFO:teuthology.orchestra.run.smithi171.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-19T06:17:06.383 INFO:teuthology.orchestra.run.smithi171.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-19T06:17:06.383 INFO:teuthology.orchestra.run.smithi171.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-19T06:17:06.384 INFO:teuthology.orchestra.run.smithi171.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-19T06:17:06.385 INFO:teuthology.orchestra.run.smithi171.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-19T06:17:06.407 INFO:teuthology.orchestra.run.smithi032.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-19T06:17:06.409 INFO:teuthology.orchestra.run.smithi171.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-19T06:17:06.410 INFO:teuthology.orchestra.run.smithi171.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-19T06:17:06.416 INFO:teuthology.orchestra.run.smithi171.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-19T06:17:06.416 INFO:teuthology.orchestra.run.smithi032.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-19T06:17:06.417 INFO:teuthology.orchestra.run.smithi032.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-19T06:17:06.418 INFO:teuthology.orchestra.run.smithi032.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-19T06:17:06.421 INFO:teuthology.orchestra.run.smithi171.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-19T06:17:06.421 INFO:teuthology.orchestra.run.smithi032.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-19T06:17:06.422 INFO:teuthology.orchestra.run.smithi032.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-19T06:17:06.422 INFO:teuthology.orchestra.run.smithi171.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-19T06:17:06.423 INFO:teuthology.orchestra.run.smithi032.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-19T06:17:06.424 INFO:teuthology.orchestra.run.smithi032.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-19T06:17:06.440 INFO:teuthology.orchestra.run.smithi032.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-19T06:17:06.441 INFO:teuthology.orchestra.run.smithi032.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-19T06:17:06.442 INFO:teuthology.orchestra.run.smithi171.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-19T06:17:06.446 INFO:teuthology.orchestra.run.smithi171.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-19T06:17:06.449 INFO:teuthology.orchestra.run.smithi171.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-03-19T06:17:06.449 INFO:teuthology.orchestra.run.smithi171.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-19T06:17:06.450 INFO:teuthology.orchestra.run.smithi171.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-19T06:17:06.469 INFO:teuthology.orchestra.run.smithi032.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-19T06:17:06.470 INFO:teuthology.orchestra.run.smithi032.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-19T06:17:06.470 INFO:teuthology.orchestra.run.smithi032.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-19T06:17:06.471 INFO:teuthology.orchestra.run.smithi171.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-19T06:17:06.473 INFO:teuthology.orchestra.run.smithi032.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-19T06:17:06.480 INFO:teuthology.orchestra.run.smithi171.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-19T06:17:06.481 INFO:teuthology.orchestra.run.smithi171.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-19T06:17:06.487 INFO:teuthology.orchestra.run.smithi171.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-19T06:17:06.488 INFO:teuthology.orchestra.run.smithi171.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-19T06:17:06.531 INFO:teuthology.orchestra.run.smithi171.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-19T06:17:06.532 INFO:teuthology.orchestra.run.smithi171.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-19T06:17:06.534 INFO:teuthology.orchestra.run.smithi171.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-19T06:17:06.536 INFO:teuthology.orchestra.run.smithi171.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-19T06:17:06.621 INFO:teuthology.orchestra.run.smithi171.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-19T06:17:06.623 INFO:teuthology.orchestra.run.smithi032.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-19T06:17:06.624 INFO:teuthology.orchestra.run.smithi032.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-19T06:17:06.625 INFO:teuthology.orchestra.run.smithi032.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-19T06:17:06.626 INFO:teuthology.orchestra.run.smithi032.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-19T06:17:06.626 INFO:teuthology.orchestra.run.smithi171.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-19T06:17:06.627 INFO:teuthology.orchestra.run.smithi171.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-19T06:17:06.627 INFO:teuthology.orchestra.run.smithi032.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-19T06:17:06.629 INFO:teuthology.orchestra.run.smithi171.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-19T06:17:06.629 INFO:teuthology.orchestra.run.smithi171.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-19T06:17:06.647 INFO:teuthology.orchestra.run.smithi032.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-19T06:17:06.650 INFO:teuthology.orchestra.run.smithi032.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-19T06:17:06.650 INFO:teuthology.orchestra.run.smithi032.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-19T06:17:06.677 INFO:teuthology.orchestra.run.smithi032.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-19T06:17:06.678 INFO:teuthology.orchestra.run.smithi032.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-19T06:17:06.689 INFO:teuthology.orchestra.run.smithi032.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-19T06:17:06.689 INFO:teuthology.orchestra.run.smithi032.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-19T06:17:06.690 INFO:teuthology.orchestra.run.smithi032.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-19T06:17:06.691 INFO:teuthology.orchestra.run.smithi032.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-19T06:17:06.691 INFO:teuthology.orchestra.run.smithi032.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-19T06:17:06.692 INFO:teuthology.orchestra.run.smithi032.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-19T06:17:06.696 INFO:teuthology.orchestra.run.smithi032.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-19T06:17:06.714 INFO:teuthology.orchestra.run.smithi032.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-19T06:17:06.716 INFO:teuthology.orchestra.run.smithi032.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-19T06:17:06.716 INFO:teuthology.orchestra.run.smithi032.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-19T06:17:06.734 INFO:teuthology.orchestra.run.smithi032.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-19T06:17:06.738 INFO:teuthology.orchestra.run.smithi032.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-03-19T06:17:06.738 INFO:teuthology.orchestra.run.smithi032.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-19T06:17:06.740 INFO:teuthology.orchestra.run.smithi032.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-19T06:17:06.740 INFO:teuthology.orchestra.run.smithi032.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-19T06:17:06.745 INFO:teuthology.orchestra.run.smithi032.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-19T06:17:06.746 INFO:teuthology.orchestra.run.smithi032.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-19T06:17:06.756 INFO:teuthology.orchestra.run.smithi032.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-19T06:17:06.756 INFO:teuthology.orchestra.run.smithi032.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-19T06:17:06.757 INFO:teuthology.orchestra.run.smithi032.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-19T06:17:06.777 INFO:teuthology.orchestra.run.smithi032.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-19T06:17:06.778 INFO:teuthology.orchestra.run.smithi032.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-19T06:17:06.779 INFO:teuthology.orchestra.run.smithi032.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-19T06:17:06.788 INFO:teuthology.orchestra.run.smithi032.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-19T06:17:06.789 INFO:teuthology.orchestra.run.smithi032.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-19T06:17:06.789 INFO:teuthology.orchestra.run.smithi032.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-19T06:17:06.791 INFO:teuthology.orchestra.run.smithi032.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-19T06:17:06.800 INFO:teuthology.orchestra.run.smithi032.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-19T06:17:07.045 INFO:teuthology.orchestra.run.smithi032.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1934-gb0ea271b-1jammy [711 kB] 2024-03-19T06:17:07.347 INFO:teuthology.orchestra.run.smithi032.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1934-gb0ea271b-1jammy [356 kB] 2024-03-19T06:17:07.501 INFO:teuthology.orchestra.run.smithi032.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1934-gb0ea271b-1jammy [32.8 kB] 2024-03-19T06:17:07.502 INFO:teuthology.orchestra.run.smithi032.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1934-gb0ea271b-1jammy [180 kB] 2024-03-19T06:17:07.581 INFO:teuthology.orchestra.run.smithi032.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1934-gb0ea271b-1jammy [64.6 kB] 2024-03-19T06:17:07.586 INFO:teuthology.orchestra.run.smithi032.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1934-gb0ea271b-1jammy [330 kB] 2024-03-19T06:17:07.720 INFO:teuthology.orchestra.run.smithi032.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1934-gb0ea271b-1jammy [6,582 kB] 2024-03-19T06:17:09.030 INFO:teuthology.orchestra.run.smithi171.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1934-gb0ea271b-1jammy [5,081 kB] 2024-03-19T06:17:09.646 INFO:teuthology.orchestra.run.smithi171.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1934-gb0ea271b-1jammy [243 kB] 2024-03-19T06:17:09.677 INFO:teuthology.orchestra.run.smithi171.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1934-gb0ea271b-1jammy [124 kB] 2024-03-19T06:17:09.689 INFO:teuthology.orchestra.run.smithi171.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1934-gb0ea271b-1jammy [1,522 kB] 2024-03-19T06:17:09.880 INFO:teuthology.orchestra.run.smithi171.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1934-gb0ea271b-1jammy [6,247 kB] 2024-03-19T06:17:10.219 INFO:teuthology.orchestra.run.smithi032.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1934-gb0ea271b-1jammy [112 kB] 2024-03-19T06:17:10.223 INFO:teuthology.orchestra.run.smithi032.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1934-gb0ea271b-1jammy [466 kB] 2024-03-19T06:17:10.395 INFO:teuthology.orchestra.run.smithi032.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1934-gb0ea271b-1jammy [24.2 MB] 2024-03-19T06:17:10.711 INFO:teuthology.orchestra.run.smithi171.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1934-gb0ea271b-1jammy [22.8 MB] 2024-03-19T06:17:13.803 INFO:teuthology.orchestra.run.smithi171.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1934-gb0ea271b-1jammy [14.0 kB] 2024-03-19T06:17:14.404 INFO:teuthology.orchestra.run.smithi171.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1934-gb0ea271b-1jammy [867 kB] 2024-03-19T06:17:14.404 INFO:teuthology.orchestra.run.smithi171.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1934-gb0ea271b-1jammy [2,199 kB] 2024-03-19T06:17:14.404 INFO:teuthology.orchestra.run.smithi171.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1934-gb0ea271b-1jammy [777 kB] 2024-03-19T06:17:14.404 INFO:teuthology.orchestra.run.smithi171.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1934-gb0ea271b-1jammy [145 kB] 2024-03-19T06:17:14.404 INFO:teuthology.orchestra.run.smithi171.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1934-gb0ea271b-1jammy [1,934 kB] 2024-03-19T06:17:14.594 INFO:teuthology.orchestra.run.smithi171.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1934-gb0ea271b-1jammy [8,625 kB] 2024-03-19T06:17:15.744 INFO:teuthology.orchestra.run.smithi171.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1934-gb0ea271b-1jammy [14.2 kB] 2024-03-19T06:17:15.744 INFO:teuthology.orchestra.run.smithi171.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1934-gb0ea271b-1jammy [50.0 MB] 2024-03-19T06:17:18.576 INFO:teuthology.orchestra.run.smithi032.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1934-gb0ea271b-1jammy [5,081 kB] 2024-03-19T06:17:20.052 INFO:teuthology.orchestra.run.smithi032.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1934-gb0ea271b-1jammy [243 kB] 2024-03-19T06:17:20.136 INFO:teuthology.orchestra.run.smithi032.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1934-gb0ea271b-1jammy [124 kB] 2024-03-19T06:17:20.144 INFO:teuthology.orchestra.run.smithi032.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1934-gb0ea271b-1jammy [1,522 kB] 2024-03-19T06:17:20.834 INFO:teuthology.orchestra.run.smithi032.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1934-gb0ea271b-1jammy [6,247 kB] 2024-03-19T06:17:21.341 INFO:teuthology.orchestra.run.smithi171.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1934-gb0ea271b-1jammy [121 kB] 2024-03-19T06:17:21.342 INFO:teuthology.orchestra.run.smithi171.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1934-gb0ea271b-1jammy [228 kB] 2024-03-19T06:17:21.350 INFO:teuthology.orchestra.run.smithi171.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1934-gb0ea271b-1jammy [34.0 kB] 2024-03-19T06:17:21.353 INFO:teuthology.orchestra.run.smithi171.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1934-gb0ea271b-1jammy [23.4 kB] 2024-03-19T06:17:21.355 INFO:teuthology.orchestra.run.smithi171.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1934-gb0ea271b-1jammy [38.4 kB] 2024-03-19T06:17:21.367 INFO:teuthology.orchestra.run.smithi171.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1934-gb0ea271b-1jammy [13.0 MB] 2024-03-19T06:17:22.325 INFO:teuthology.orchestra.run.smithi171.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1934-gb0ea271b-1jammy [91.3 kB] 2024-03-19T06:17:22.951 INFO:teuthology.orchestra.run.smithi032.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1934-gb0ea271b-1jammy [22.8 MB] 2024-03-19T06:17:22.970 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 177 MB in 19s (9,224 kB/s) 2024-03-19T06:17:23.113 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyperclip. 2024-03-19T06:17:23.179 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132923 files and directories currently installed.) 2024-03-19T06:17:23.182 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-03-19T06:17:23.228 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-03-19T06:17:23.539 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-19T06:17:23.552 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-19T06:17:23.580 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-19T06:17:23.908 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cmd2. 2024-03-19T06:17:23.922 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-03-19T06:17:23.975 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-03-19T06:17:24.320 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-19T06:17:24.334 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-19T06:17:24.445 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-19T06:17:24.782 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-19T06:17:24.796 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-19T06:17:24.840 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-19T06:17:25.176 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-19T06:17:25.191 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-19T06:17:25.226 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-19T06:17:25.671 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-19T06:17:25.686 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-19T06:17:25.746 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-19T06:17:26.274 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-19T06:17:26.290 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-19T06:17:26.333 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-19T06:17:26.661 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-19T06:17:26.676 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-19T06:17:26.713 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-19T06:17:27.049 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-19T06:17:27.064 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-19T06:17:27.107 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-19T06:17:27.252 INFO:teuthology.orchestra.run.smithi032.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1934-gb0ea271b-1jammy [14.0 kB] 2024-03-19T06:17:27.268 INFO:teuthology.orchestra.run.smithi032.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1934-gb0ea271b-1jammy [867 kB] 2024-03-19T06:17:27.393 INFO:teuthology.orchestra.run.smithi032.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1934-gb0ea271b-1jammy [2,199 kB] 2024-03-19T06:17:27.452 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librados2. 2024-03-19T06:17:27.467 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../010-librados2_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:27.510 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librados2 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:27.737 INFO:teuthology.orchestra.run.smithi032.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1934-gb0ea271b-1jammy [777 kB] 2024-03-19T06:17:27.854 INFO:teuthology.orchestra.run.smithi032.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1934-gb0ea271b-1jammy [145 kB] 2024-03-19T06:17:27.890 INFO:teuthology.orchestra.run.smithi032.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1934-gb0ea271b-1jammy [1,934 kB] 2024-03-19T06:17:27.938 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librbd1. 2024-03-19T06:17:27.953 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../011-librbd1_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:27.996 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librbd1 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:28.193 INFO:teuthology.orchestra.run.smithi032.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1934-gb0ea271b-1jammy [8,625 kB] 2024-03-19T06:17:28.390 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libcephfs2. 2024-03-19T06:17:28.404 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:28.449 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libcephfs2 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:28.676 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rados. 2024-03-19T06:17:28.690 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:28.734 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rados (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:29.062 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-19T06:17:29.076 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:17:29.120 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-ceph-argparse (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:29.398 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cephfs. 2024-03-19T06:17:29.413 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:29.456 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cephfs (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:29.504 INFO:teuthology.orchestra.run.smithi032.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1934-gb0ea271b-1jammy [14.2 kB] 2024-03-19T06:17:29.504 INFO:teuthology.orchestra.run.smithi032.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1934-gb0ea271b-1jammy [50.0 MB] 2024-03-19T06:17:29.743 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-19T06:17:29.757 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:17:29.792 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-ceph-common (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:30.129 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-prettytable. 2024-03-19T06:17:30.144 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-03-19T06:17:30.178 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-19T06:17:30.456 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rbd. 2024-03-19T06:17:30.471 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:30.514 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rbd (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:30.851 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-19T06:17:30.866 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-19T06:17:30.909 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-19T06:17:31.203 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-19T06:17:31.219 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-19T06:17:31.261 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-19T06:17:31.556 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-19T06:17:31.571 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-19T06:17:31.614 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-19T06:17:31.918 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package lua5.1. 2024-03-19T06:17:31.933 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-19T06:17:31.976 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-19T06:17:32.279 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package lua-any. 2024-03-19T06:17:32.294 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-03-19T06:17:32.329 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-19T06:17:32.609 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package zip. 2024-03-19T06:17:32.623 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-03-19T06:17:32.665 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking zip (3.0-12build2) ... 2024-03-19T06:17:32.985 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package unzip. 2024-03-19T06:17:32.999 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-19T06:17:33.043 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-19T06:17:33.430 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package luarocks. 2024-03-19T06:17:33.445 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-19T06:17:33.480 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-19T06:17:33.896 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librgw2. 2024-03-19T06:17:33.910 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../027-librgw2_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:33.954 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librgw2 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:34.482 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rgw. 2024-03-19T06:17:34.496 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:34.540 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rgw (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:34.901 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-19T06:17:34.916 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-19T06:17:34.959 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-19T06:17:35.246 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libradosstriper1. 2024-03-19T06:17:35.260 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:35.295 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libradosstriper1 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:35.504 INFO:teuthology.orchestra.run.smithi032.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1934-gb0ea271b-1jammy [121 kB] 2024-03-19T06:17:35.505 INFO:teuthology.orchestra.run.smithi032.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1934-gb0ea271b-1jammy [228 kB] 2024-03-19T06:17:35.509 INFO:teuthology.orchestra.run.smithi032.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1934-gb0ea271b-1jammy [34.0 kB] 2024-03-19T06:17:35.511 INFO:teuthology.orchestra.run.smithi032.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1934-gb0ea271b-1jammy [23.4 kB] 2024-03-19T06:17:35.511 INFO:teuthology.orchestra.run.smithi032.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1934-gb0ea271b-1jammy [38.4 kB] 2024-03-19T06:17:35.512 INFO:teuthology.orchestra.run.smithi032.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1934-gb0ea271b-1jammy [13.0 MB] 2024-03-19T06:17:35.716 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-common. 2024-03-19T06:17:35.730 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:35.774 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-common (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:36.760 INFO:teuthology.orchestra.run.smithi032.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1934-gb0ea271b-1jammy [91.3 kB] 2024-03-19T06:17:37.418 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 177 MB in 33s (5,327 kB/s) 2024-03-19T06:17:37.537 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyperclip. 2024-03-19T06:17:37.608 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132923 files and directories currently installed.) 2024-03-19T06:17:37.611 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-03-19T06:17:37.644 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-03-19T06:17:37.746 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-base. 2024-03-19T06:17:37.761 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:37.805 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-base (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:37.946 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-19T06:17:37.961 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-19T06:17:38.005 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-19T06:17:38.341 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cmd2. 2024-03-19T06:17:38.355 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-03-19T06:17:38.399 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-03-19T06:17:38.417 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-19T06:17:38.431 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-19T06:17:38.475 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-19T06:17:38.710 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-19T06:17:38.726 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-19T06:17:38.753 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cheroot. 2024-03-19T06:17:38.767 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-19T06:17:38.803 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-19T06:17:38.810 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-19T06:17:39.106 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-19T06:17:39.121 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-19T06:17:39.164 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-19T06:17:39.172 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-19T06:17:39.188 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-19T06:17:39.230 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-19T06:17:39.492 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-19T06:17:39.507 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-19T06:17:39.550 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-19T06:17:39.675 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-19T06:17:39.690 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-19T06:17:39.733 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-19T06:17:39.861 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-19T06:17:39.878 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-19T06:17:39.920 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-19T06:17:40.111 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-19T06:17:40.127 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-19T06:17:40.169 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-19T06:17:40.189 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-tempora. 2024-03-19T06:17:40.204 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-03-19T06:17:40.239 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-19T06:17:40.542 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-portend. 2024-03-19T06:17:40.557 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-03-19T06:17:40.600 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-19T06:17:40.614 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-19T06:17:40.630 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-19T06:17:40.672 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-19T06:17:40.928 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-19T06:17:40.943 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-19T06:17:40.986 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-19T06:17:41.034 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-19T06:17:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-19T06:17:41.084 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-19T06:17:41.298 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-19T06:17:41.312 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-19T06:17:41.381 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-19T06:17:41.412 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-19T06:17:41.423 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-19T06:17:41.453 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-19T06:17:41.726 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-natsort. 2024-03-19T06:17:41.741 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-03-19T06:17:41.765 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librados2. 2024-03-19T06:17:41.775 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../010-librados2_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:41.784 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-19T06:17:41.814 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librados2 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:42.112 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-logutils. 2024-03-19T06:17:42.126 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-03-19T06:17:42.170 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-19T06:17:42.442 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librbd1. 2024-03-19T06:17:42.459 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../011-librbd1_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:42.508 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librbd1 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:42.515 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-19T06:17:42.530 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-19T06:17:42.573 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-19T06:17:42.876 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-mako. 2024-03-19T06:17:42.891 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-19T06:17:42.928 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libcephfs2. 2024-03-19T06:17:42.937 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-19T06:17:42.941 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:42.978 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libcephfs2 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:43.281 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rados. 2024-03-19T06:17:43.288 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-19T06:17:43.293 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:43.302 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-19T06:17:43.322 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rados (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:43.346 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-19T06:17:43.633 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-19T06:17:43.646 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:17:43.665 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-19T06:17:43.680 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-19T06:17:43.683 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-ceph-argparse (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:43.724 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-19T06:17:43.935 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cephfs. 2024-03-19T06:17:43.948 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:43.985 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cephfs (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:44.001 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-webob. 2024-03-19T06:17:44.016 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-19T06:17:44.059 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-19T06:17:44.305 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-19T06:17:44.318 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:17:44.355 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-ceph-common (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:44.430 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-waitress. 2024-03-19T06:17:44.444 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-19T06:17:44.490 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-19T06:17:44.683 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-prettytable. 2024-03-19T06:17:44.695 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-03-19T06:17:44.732 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-19T06:17:44.833 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-tempita. 2024-03-19T06:17:44.847 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-19T06:17:44.891 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-19T06:17:44.951 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rbd. 2024-03-19T06:17:44.964 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:44.993 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rbd (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:45.227 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-paste. 2024-03-19T06:17:45.242 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-19T06:17:45.277 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-19T06:17:45.346 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-19T06:17:45.359 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-19T06:17:45.398 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-19T06:17:45.572 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-19T06:17:45.586 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-19T06:17:45.630 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-19T06:17:45.683 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-19T06:17:45.699 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-19T06:17:45.741 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-19T06:17:45.958 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-19T06:17:45.973 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-19T06:17:46.016 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-19T06:17:46.069 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-19T06:17:46.083 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-19T06:17:46.119 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-19T06:17:46.335 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-webtest. 2024-03-19T06:17:46.350 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-03-19T06:17:46.385 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-19T06:17:46.448 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua5.1. 2024-03-19T06:17:46.461 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-19T06:17:46.505 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-19T06:17:46.655 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pecan. 2024-03-19T06:17:46.670 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-19T06:17:46.713 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-19T06:17:46.800 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-any. 2024-03-19T06:17:46.814 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-03-19T06:17:46.858 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-19T06:17:47.111 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package zip. 2024-03-19T06:17:47.124 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-03-19T06:17:47.185 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-certifi. 2024-03-19T06:17:47.198 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-03-19T06:17:47.211 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking zip (3.0-12build2) ... 2024-03-19T06:17:47.243 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-19T06:17:47.530 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package unzip. 2024-03-19T06:17:47.544 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-19T06:17:47.580 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-19T06:17:47.595 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-idna. 2024-03-19T06:17:47.607 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-03-19T06:17:47.645 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-19T06:17:47.957 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-urllib3. 2024-03-19T06:17:47.967 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package luarocks. 2024-03-19T06:17:47.972 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-19T06:17:47.982 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-19T06:17:48.025 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-19T06:17:48.049 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-19T06:17:48.377 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-requests. 2024-03-19T06:17:48.390 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-19T06:17:48.399 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librgw2. 2024-03-19T06:17:48.412 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../027-librgw2_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:48.435 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-19T06:17:48.449 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librgw2 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:48.771 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-19T06:17:48.784 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-19T06:17:48.829 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-19T06:17:48.952 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rgw. 2024-03-19T06:17:48.965 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:49.001 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rgw (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:49.149 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-19T06:17:49.162 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:17:49.207 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:49.330 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-19T06:17:49.343 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-19T06:17:49.388 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-19T06:17:49.604 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-19T06:17:49.619 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:49.687 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:49.707 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libradosstriper1. 2024-03-19T06:17:49.721 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:49.765 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libradosstriper1 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:49.982 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-19T06:17:49.996 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-19T06:17:50.039 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-19T06:17:50.119 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-common. 2024-03-19T06:17:50.132 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:50.193 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-common (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:50.393 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-openssl. 2024-03-19T06:17:50.407 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-03-19T06:17:50.442 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-19T06:17:50.787 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr. 2024-03-19T06:17:50.801 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:50.845 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:51.241 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mon. 2024-03-19T06:17:51.254 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:51.323 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mon (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:51.348 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-base. 2024-03-19T06:17:51.358 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:51.407 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-base (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:51.919 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-osd. 2024-03-19T06:17:51.933 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:51.976 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-osd (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:51.994 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-19T06:17:52.006 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-19T06:17:52.044 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-19T06:17:52.514 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cheroot. 2024-03-19T06:17:52.525 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-19T06:17:52.563 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-19T06:17:52.772 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph. 2024-03-19T06:17:52.786 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../068-ceph_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:52.830 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:52.875 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-19T06:17:52.889 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-19T06:17:52.942 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-19T06:17:53.183 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-fuse. 2024-03-19T06:17:53.197 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:53.203 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-19T06:17:53.214 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-19T06:17:53.241 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-fuse (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:53.252 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-19T06:17:53.538 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-19T06:17:53.550 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-19T06:17:53.588 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-19T06:17:53.635 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mds. 2024-03-19T06:17:53.650 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:53.693 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mds (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:53.875 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-tempora. 2024-03-19T06:17:53.887 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-03-19T06:17:53.925 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-19T06:17:54.063 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package cephadm. 2024-03-19T06:17:54.077 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../071-cephadm_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:17:54.113 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking cephadm (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:54.169 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-portend. 2024-03-19T06:17:54.181 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-03-19T06:17:54.210 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-19T06:17:54.416 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-19T06:17:54.430 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-19T06:17:54.474 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-19T06:17:54.521 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-19T06:17:54.534 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-19T06:17:54.571 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-19T06:17:54.793 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-19T06:17:54.807 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-19T06:17:54.851 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-19T06:17:54.874 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-19T06:17:54.886 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-19T06:17:54.924 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-19T06:17:55.244 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-natsort. 2024-03-19T06:17:55.256 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-03-19T06:17:55.294 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-19T06:17:55.605 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-logutils. 2024-03-19T06:17:55.617 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-03-19T06:17:55.655 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-19T06:17:55.840 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-babel. 2024-03-19T06:17:55.853 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-19T06:17:55.898 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-19T06:17:55.991 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-19T06:17:56.003 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-19T06:17:56.041 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-19T06:17:56.222 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jinja2. 2024-03-19T06:17:56.235 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-19T06:17:56.276 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-19T06:17:56.319 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-mako. 2024-03-19T06:17:56.331 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-19T06:17:56.360 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-19T06:17:56.587 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-19T06:17:56.601 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:17:56.645 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:56.663 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-19T06:17:56.675 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-19T06:17:56.705 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-19T06:17:56.975 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-19T06:17:56.987 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-19T06:17:56.999 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-19T06:17:57.014 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-03-19T06:17:57.024 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-19T06:17:57.049 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-19T06:17:57.361 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webob. 2024-03-19T06:17:57.373 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-19T06:17:57.410 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-19T06:17:57.644 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-routes. 2024-03-19T06:17:57.655 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-19T06:17:57.693 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-19T06:17:57.838 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-waitress. 2024-03-19T06:17:57.850 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-19T06:17:57.891 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-19T06:17:58.013 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-19T06:17:58.027 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:17:58.063 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:17:58.158 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-tempita. 2024-03-19T06:17:58.169 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-19T06:17:58.199 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-19T06:17:58.485 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-paste. 2024-03-19T06:17:58.497 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-19T06:17:58.525 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-19T06:17:58.536 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-19T06:17:58.551 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-19T06:17:58.574 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-19T06:17:58.855 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-19T06:17:58.867 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-19T06:17:58.896 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-19T06:17:59.136 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-joblib. 2024-03-19T06:17:59.148 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-19T06:17:59.166 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-19T06:17:59.180 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-19T06:17:59.186 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-19T06:17:59.224 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-19T06:17:59.544 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webtest. 2024-03-19T06:17:59.557 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-03-19T06:17:59.578 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-19T06:17:59.589 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-19T06:17:59.593 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-19T06:17:59.708 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-19T06:17:59.930 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pecan. 2024-03-19T06:17:59.943 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-19T06:17:59.979 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-19T06:18:00.011 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-sklearn. 2024-03-19T06:18:00.023 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-19T06:18:00.061 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-19T06:18:00.334 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-certifi. 2024-03-19T06:18:00.347 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-03-19T06:18:00.384 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-19T06:18:00.687 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-idna. 2024-03-19T06:18:00.700 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-03-19T06:18:00.736 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-19T06:18:00.778 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-19T06:18:00.789 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:18:00.820 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:01.006 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-urllib3. 2024-03-19T06:18:01.019 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-19T06:18:01.056 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-19T06:18:01.368 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-requests. 2024-03-19T06:18:01.381 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-19T06:18:01.417 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-19T06:18:01.728 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-19T06:18:01.741 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-19T06:18:01.778 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-19T06:18:01.865 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cachetools. 2024-03-19T06:18:01.877 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-03-19T06:18:01.915 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-19T06:18:02.039 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-19T06:18:02.052 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:18:02.089 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:02.217 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-19T06:18:02.229 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-19T06:18:02.267 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-19T06:18:02.477 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-19T06:18:02.490 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:02.629 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-19T06:18:02.641 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-19T06:18:02.679 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-19T06:18:02.711 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:03.024 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rsa. 2024-03-19T06:18:03.030 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-19T06:18:03.036 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-03-19T06:18:03.046 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-19T06:18:03.074 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-19T06:18:03.088 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-19T06:18:03.366 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-openssl. 2024-03-19T06:18:03.380 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-03-19T06:18:03.424 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-19T06:18:03.427 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-google-auth. 2024-03-19T06:18:03.439 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-03-19T06:18:03.477 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-19T06:18:03.772 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-19T06:18:03.784 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-19T06:18:03.794 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr. 2024-03-19T06:18:03.808 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:03.813 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-19T06:18:03.852 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:04.134 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-websocket. 2024-03-19T06:18:04.145 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-03-19T06:18:04.183 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-19T06:18:04.255 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mon. 2024-03-19T06:18:04.269 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:04.313 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mon (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:04.528 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-19T06:18:04.540 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-19T06:18:04.578 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-19T06:18:04.825 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-osd. 2024-03-19T06:18:04.839 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:04.883 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-osd (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:05.235 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-19T06:18:05.246 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:18:05.285 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:05.596 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-19T06:18:05.610 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-19T06:18:05.646 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-19T06:18:05.678 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph. 2024-03-19T06:18:05.691 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../068-ceph_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:05.736 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:05.983 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-19T06:18:05.994 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-19T06:18:06.032 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-19T06:18:06.038 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-fuse. 2024-03-19T06:18:06.052 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:06.096 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-fuse (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:06.319 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package jq. 2024-03-19T06:18:06.330 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-19T06:18:06.368 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-19T06:18:06.425 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mds. 2024-03-19T06:18:06.439 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:06.483 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mds (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:06.621 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package socat. 2024-03-19T06:18:06.634 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-19T06:18:06.696 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-19T06:18:06.877 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephadm. 2024-03-19T06:18:06.891 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../071-cephadm_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:06.935 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephadm (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:06.999 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package xmlstarlet. 2024-03-19T06:18:07.012 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-19T06:18:07.049 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-19T06:18:07.263 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-19T06:18:07.277 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-19T06:18:07.321 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-19T06:18:07.420 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-test. 2024-03-19T06:18:07.433 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:07.624 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-19T06:18:07.637 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-19T06:18:07.682 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-19T06:18:07.722 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-test (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:08.654 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-babel. 2024-03-19T06:18:08.666 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-19T06:18:08.703 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-19T06:18:09.031 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jinja2. 2024-03-19T06:18:09.044 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-19T06:18:09.098 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-19T06:18:09.442 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-19T06:18:09.456 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:18:09.500 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:09.707 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-volume. 2024-03-19T06:18:09.720 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:18:09.765 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-volume (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:09.912 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-19T06:18:09.926 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-03-19T06:18:09.970 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-19T06:18:10.178 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package cephfs-mirror. 2024-03-19T06:18:10.191 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:10.231 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-routes. 2024-03-19T06:18:10.236 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking cephfs-mirror (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:10.245 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-19T06:18:10.281 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-19T06:18:10.564 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-colorama. 2024-03-19T06:18:10.577 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-03-19T06:18:10.584 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-19T06:18:10.598 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:18:10.613 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-03-19T06:18:10.634 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:10.849 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package cephfs-shell. 2024-03-19T06:18:10.862 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:18:10.902 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking cephfs-shell (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:11.087 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-19T06:18:11.101 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-19T06:18:11.145 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-19T06:18:11.194 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package cephfs-top. 2024-03-19T06:18:11.207 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:18:11.251 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking cephfs-top (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:11.487 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-19T06:18:11.500 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:11.545 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libcephfs-dev (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:11.657 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-joblib. 2024-03-19T06:18:11.671 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-19T06:18:11.718 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-19T06:18:11.873 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-19T06:18:11.886 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-19T06:18:11.931 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-19T06:18:12.052 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-19T06:18:12.065 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-19T06:18:12.212 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-19T06:18:12.311 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-19T06:18:12.324 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-03-19T06:18:12.369 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-19T06:18:12.548 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-sklearn. 2024-03-19T06:18:12.562 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-19T06:18:12.606 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-19T06:18:12.756 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package nvme-cli. 2024-03-19T06:18:12.772 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-19T06:18:12.814 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-19T06:18:13.244 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package pkg-config. 2024-03-19T06:18:13.258 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-19T06:18:13.302 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-19T06:18:13.306 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-19T06:18:13.320 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:18:13.357 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:13.555 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-19T06:18:13.569 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-19T06:18:13.613 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-19T06:18:14.075 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-19T06:18:14.088 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-19T06:18:14.132 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-19T06:18:14.386 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cachetools. 2024-03-19T06:18:14.399 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-03-19T06:18:14.427 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pastescript. 2024-03-19T06:18:14.441 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-03-19T06:18:14.443 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-19T06:18:14.485 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-19T06:18:14.721 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-19T06:18:14.735 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-19T06:18:14.770 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-19T06:18:14.805 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pluggy. 2024-03-19T06:18:14.820 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-19T06:18:14.880 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-19T06:18:15.066 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-19T06:18:15.080 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-19T06:18:15.115 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-19T06:18:15.199 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-psutil. 2024-03-19T06:18:15.213 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-19T06:18:15.258 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-19T06:18:15.443 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rsa. 2024-03-19T06:18:15.458 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-03-19T06:18:15.501 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-19T06:18:15.644 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-py. 2024-03-19T06:18:15.658 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-03-19T06:18:15.702 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-19T06:18:15.806 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-google-auth. 2024-03-19T06:18:15.819 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-03-19T06:18:15.863 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-19T06:18:16.047 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pygments. 2024-03-19T06:18:16.061 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-19T06:18:16.114 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-19T06:18:16.183 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-19T06:18:16.197 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-19T06:18:16.241 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-19T06:18:16.553 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-websocket. 2024-03-19T06:18:16.567 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-03-19T06:18:16.593 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-19T06:18:16.606 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-19T06:18:16.627 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-19T06:18:16.642 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-19T06:18:16.914 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-19T06:18:16.928 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-19T06:18:16.945 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-toml. 2024-03-19T06:18:16.959 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-03-19T06:18:16.963 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-19T06:18:17.028 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-19T06:18:17.331 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pytest. 2024-03-19T06:18:17.345 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-19T06:18:17.381 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-19T06:18:17.611 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-19T06:18:17.624 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:18:17.660 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:17.976 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-simplejson. 2024-03-19T06:18:17.991 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-19T06:18:18.013 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-19T06:18:18.026 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-19T06:18:18.034 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-19T06:18:18.071 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-19T06:18:18.329 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-19T06:18:18.343 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-19T06:18:18.386 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-19T06:18:18.549 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-19T06:18:18.563 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-19T06:18:18.607 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-19T06:18:18.893 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package jq. 2024-03-19T06:18:18.908 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-19T06:18:18.951 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-19T06:18:19.082 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package radosgw. 2024-03-19T06:18:19.095 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../122-radosgw_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:19.140 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking radosgw (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:19.204 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package socat. 2024-03-19T06:18:19.218 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-19T06:18:19.262 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-19T06:18:19.607 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package xmlstarlet. 2024-03-19T06:18:19.621 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-19T06:18:19.665 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-19T06:18:19.894 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package rbd-fuse. 2024-03-19T06:18:19.908 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:19.951 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking rbd-fuse (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:20.019 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-test. 2024-03-19T06:18:20.033 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:20.077 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-test (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:20.245 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-19T06:18:20.557 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-19T06:18:20.657 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-19T06:18:20.905 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-19T06:18:21.298 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-19T06:18:21.888 INFO:teuthology.orchestra.run.smithi171.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-19T06:18:21.956 INFO:teuthology.orchestra.run.smithi171.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-03-19T06:18:22.015 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-volume. 2024-03-19T06:18:22.018 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up cephadm (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:22.029 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:18:22.065 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-volume (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:22.454 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephfs-mirror. 2024-03-19T06:18:22.468 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:22.512 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephfs-mirror (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:22.586 INFO:teuthology.orchestra.run.smithi171.stdout:Adding system user cephadm....done 2024-03-19T06:18:22.724 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-19T06:18:22.832 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-colorama. 2024-03-19T06:18:22.846 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-03-19T06:18:22.890 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-03-19T06:18:23.000 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-19T06:18:23.142 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephfs-shell. 2024-03-19T06:18:23.156 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:18:23.200 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephfs-shell (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:23.293 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-19T06:18:23.419 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-19T06:18:23.529 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephfs-top. 2024-03-19T06:18:23.543 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1934-gb0ea271b-1jammy_all.deb ... 2024-03-19T06:18:23.578 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephfs-top (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:23.686 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-19T06:18:23.823 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-19T06:18:23.837 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:23.872 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libcephfs-dev (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:23.954 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-19T06:18:24.080 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-19T06:18:24.183 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-19T06:18:24.197 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-19T06:18:24.241 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-19T06:18:24.415 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-19T06:18:24.596 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-19T06:18:24.611 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-03-19T06:18:24.654 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-19T06:18:24.784 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-19T06:18:25.033 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package nvme-cli. 2024-03-19T06:18:25.047 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-19T06:18:25.052 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-03-19T06:18:25.083 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-19T06:18:25.320 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-19T06:18:25.472 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package pkg-config. 2024-03-19T06:18:25.486 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-19T06:18:25.521 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-19T06:18:25.604 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-19T06:18:25.749 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-19T06:18:25.763 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-19T06:18:25.799 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-19T06:18:25.897 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-19T06:18:26.148 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-19T06:18:26.194 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-19T06:18:26.208 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-19T06:18:26.244 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-19T06:18:26.399 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-19T06:18:26.571 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pastescript. 2024-03-19T06:18:26.586 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-03-19T06:18:26.629 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-19T06:18:26.667 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-ceph-argparse (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:26.943 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-19T06:18:26.950 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pluggy. 2024-03-19T06:18:26.964 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-19T06:18:27.007 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-19T06:18:27.069 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-19T06:18:27.195 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-03-19T06:18:27.319 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-psutil. 2024-03-19T06:18:27.334 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-19T06:18:27.377 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-19T06:18:27.463 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-19T06:18:27.589 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-19T06:18:27.739 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-py. 2024-03-19T06:18:27.753 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-03-19T06:18:27.805 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-19T06:18:27.858 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-19T06:18:28.109 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pygments. 2024-03-19T06:18:28.123 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-19T06:18:28.158 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-19T06:18:28.275 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-19T06:18:28.304 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-19T06:18:28.368 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-19T06:18:28.528 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-19T06:18:28.654 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-19T06:18:28.667 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-19T06:18:28.704 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-19T06:18:28.904 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-19T06:18:29.006 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-toml. 2024-03-19T06:18:29.020 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-03-19T06:18:29.030 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-19T06:18:29.065 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-19T06:18:29.331 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-19T06:18:29.392 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pytest. 2024-03-19T06:18:29.407 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-19T06:18:29.450 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-19T06:18:29.615 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-19T06:18:29.804 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-simplejson. 2024-03-19T06:18:29.819 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-19T06:18:29.862 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-19T06:18:29.925 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up zip (3.0-12build2) ... 2024-03-19T06:18:30.051 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-19T06:18:30.132 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-19T06:18:30.146 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-19T06:18:30.190 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-19T06:18:30.778 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-19T06:18:30.969 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package radosgw. 2024-03-19T06:18:30.982 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../122-radosgw_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:31.026 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking radosgw (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:31.045 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-19T06:18:31.171 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-19T06:18:31.331 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-19T06:18:31.647 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package rbd-fuse. 2024-03-19T06:18:31.648 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-19T06:18:31.661 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1934-gb0ea271b-1jammy_amd64.deb ... 2024-03-19T06:18:31.705 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking rbd-fuse (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:32.007 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-19T06:18:32.033 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-19T06:18:32.310 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-19T06:18:32.314 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-19T06:18:32.411 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-19T06:18:32.682 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-19T06:18:32.711 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-19T06:18:33.012 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-03-19T06:18:33.079 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-19T06:18:33.338 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-19T06:18:33.731 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-19T06:18:33.751 INFO:teuthology.orchestra.run.smithi032.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-19T06:18:33.793 INFO:teuthology.orchestra.run.smithi032.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-03-19T06:18:33.980 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephadm (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:33.990 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-19T06:18:34.100 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-ceph-common (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:34.401 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-idna (3.3-1) ... 2024-03-19T06:18:34.473 INFO:teuthology.orchestra.run.smithi032.stdout:Adding system user cephadm....done 2024-03-19T06:18:34.711 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-19T06:18:34.777 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-19T06:18:35.003 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-19T06:18:35.272 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-19T06:18:35.397 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-19T06:18:35.665 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-19T06:18:35.933 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-19T06:18:36.000 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-19T06:18:36.059 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-19T06:18:36.276 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-19T06:18:36.402 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-19T06:18:36.410 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-19T06:18:36.703 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-19T06:18:36.771 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-19T06:18:36.829 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-19T06:18:36.947 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-19T06:18:37.039 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-03-19T06:18:37.248 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-19T06:18:37.307 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-19T06:18:37.508 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-19T06:18:37.600 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-19T06:18:37.793 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-19T06:18:37.834 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-19T06:18:37.918 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-19T06:18:38.103 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-19T06:18:38.236 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-19T06:18:38.361 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-19T06:18:38.513 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-19T06:18:38.638 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-ceph-argparse (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:38.780 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-19T06:18:38.947 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-19T06:18:39.073 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-19T06:18:39.089 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-19T06:18:39.199 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-03-19T06:18:39.358 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-19T06:18:39.450 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-19T06:18:39.551 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-19T06:18:39.667 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-19T06:18:39.793 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-19T06:18:39.802 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-19T06:18:40.086 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-19T06:18:40.169 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-19T06:18:40.199 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-19T06:18:40.203 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-19T06:18:40.264 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-19T06:18:40.406 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-19T06:18:40.513 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-19T06:18:40.766 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-19T06:18:40.822 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-19T06:18:40.867 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-19T06:18:41.090 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-19T06:18:41.138 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-19T06:18:41.215 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-19T06:18:41.350 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-19T06:18:41.402 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-19T06:18:41.438 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-19T06:18:41.685 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-19T06:18:41.745 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up zip (3.0-12build2) ... 2024-03-19T06:18:41.811 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-19T06:18:41.871 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-19T06:18:42.204 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-19T06:18:42.480 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-19T06:18:42.598 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-19T06:18:42.626 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-19T06:18:42.858 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-19T06:18:42.915 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-19T06:18:42.975 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-19T06:18:43.050 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-19T06:18:43.118 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-19T06:18:43.376 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-19T06:18:43.444 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-19T06:18:43.685 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-19T06:18:43.862 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-19T06:18:43.995 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-19T06:18:44.130 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-19T06:18:44.181 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-19T06:18:44.474 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-19T06:18:44.556 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-19T06:18:44.759 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-19T06:18:44.849 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-03-19T06:18:45.060 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-19T06:18:45.175 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-19T06:18:45.446 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-19T06:18:45.535 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-19T06:18:45.722 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-19T06:18:45.794 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-19T06:18:45.962 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-ceph-common (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:46.074 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-19T06:18:46.200 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librados2 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:46.280 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-idna (3.3-1) ... 2024-03-19T06:18:46.326 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:46.477 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-19T06:18:46.648 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-19T06:18:46.789 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libcephfs2 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:46.914 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libradosstriper1 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:47.074 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-19T06:18:47.376 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librbd1 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:47.502 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-modules-core (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:47.652 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-fuse (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:47.861 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-19T06:18:47.861 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-19T06:18:47.912 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-19T06:18:48.163 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-19T06:18:48.298 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-19T06:18:48.454 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libcephfs-dev (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:48.563 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rados (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:48.613 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-19T06:18:48.716 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-19T06:18:48.834 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-19T06:18:49.056 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librgw2 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:49.152 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-19T06:18:49.215 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up cephfs-top (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:49.341 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-19T06:18:49.428 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-19T06:18:49.705 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-19T06:18:49.830 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-19T06:18:50.140 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-19T06:18:50.391 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-19T06:18:50.619 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rbd (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:50.642 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-19T06:18:50.729 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up rbd-fuse (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:50.871 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rgw (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:50.910 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-19T06:18:50.997 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cephfs (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:51.123 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up cephfs-shell (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:51.178 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-19T06:18:51.249 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-common (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:51.471 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-19T06:18:51.597 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-19T06:18:51.835 INFO:teuthology.orchestra.run.smithi171.stdout:Adding group ceph....done 2024-03-19T06:18:51.898 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-19T06:18:52.024 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-19T06:18:52.220 INFO:teuthology.orchestra.run.smithi171.stdout:Adding system user ceph....done 2024-03-19T06:18:52.325 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-19T06:18:52.389 INFO:teuthology.orchestra.run.smithi171.stdout:Setting system user ceph properties....done 2024-03-19T06:18:52.406 INFO:teuthology.orchestra.run.smithi171.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-19T06:18:52.548 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-19T06:18:52.618 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-19T06:18:52.869 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-19T06:18:52.929 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-19T06:18:52.994 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-19T06:18:53.129 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-19T06:18:53.218 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-19T06:18:53.472 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-19T06:18:53.592 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up cephfs-mirror (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:53.598 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-19T06:18:53.801 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-19T06:18:53.802 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-19T06:18:54.008 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-19T06:18:54.267 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-19T06:18:54.393 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-19T06:18:54.401 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-test (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:54.527 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up radosgw (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:54.661 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-19T06:18:54.796 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-19T06:18:55.053 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-19T06:18:55.053 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-19T06:18:55.139 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-19T06:18:55.456 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-19T06:18:55.654 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-base (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:55.758 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-19T06:18:55.952 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-19T06:18:56.042 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-19T06:18:56.237 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-19T06:18:56.522 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-19T06:18:56.647 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mds (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:56.798 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-19T06:18:56.871 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-19T06:18:56.871 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-19T06:18:57.216 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-19T06:18:57.458 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:57.501 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-19T06:18:57.671 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-19T06:18:57.671 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-19T06:18:57.845 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-19T06:18:57.979 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librados2 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:58.105 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:58.215 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-19T06:18:58.275 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-osd (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:58.543 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libcephfs2 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:58.669 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libradosstriper1 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:58.743 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-19T06:18:58.744 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-19T06:18:58.794 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-19T06:18:59.096 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librbd1 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:59.239 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-modules-core (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:59.327 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:59.356 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-fuse (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:59.428 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:59.558 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-19T06:18:59.558 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-19T06:18:59.604 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mon (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:18:59.814 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-19T06:18:59.814 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-19T06:19:00.258 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libcephfs-dev (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:00.367 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rados (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:00.405 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-cephadm (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:00.494 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librgw2 (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:00.547 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:00.703 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephfs-top (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:00.715 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-dashboard (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:00.837 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-19T06:19:00.858 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-volume (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:01.219 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-19T06:19:01.320 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-19T06:19:01.463 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-19T06:19:02.170 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rbd (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:02.296 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up rbd-fuse (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:02.455 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rgw (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:02.581 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cephfs (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:02.610 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-19T06:19:02.707 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephfs-shell (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:02.816 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-common (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:03.307 INFO:teuthology.orchestra.run.smithi171.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-19T06:19:03.312 DEBUG:teuthology.orchestra.run.smithi171:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-03-19T06:19:03.319 INFO:teuthology.orchestra.run.smithi032.stdout:Adding group ceph....done 2024-03-19T06:19:03.387 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-03-19T06:19:03.558 INFO:teuthology.orchestra.run.smithi171.stdout:Building dependency tree... 2024-03-19T06:19:03.559 INFO:teuthology.orchestra.run.smithi171.stdout:Reading state information... 2024-03-19T06:19:03.645 INFO:teuthology.orchestra.run.smithi032.stdout:Adding system user ceph....done 2024-03-19T06:19:03.718 INFO:teuthology.orchestra.run.smithi171.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-03-19T06:19:03.718 INFO:teuthology.orchestra.run.smithi171.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-03-19T06:19:03.718 INFO:teuthology.orchestra.run.smithi171.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-03-19T06:19:03.718 INFO:teuthology.orchestra.run.smithi171.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-03-19T06:19:03.718 INFO:teuthology.orchestra.run.smithi171.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-03-19T06:19:03.718 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages were automatically installed and are no longer required: 2024-03-19T06:19:03.718 INFO:teuthology.orchestra.run.smithi171.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-19T06:19:03.718 INFO:teuthology.orchestra.run.smithi171.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-19T06:19:03.719 INFO:teuthology.orchestra.run.smithi171.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-19T06:19:03.719 INFO:teuthology.orchestra.run.smithi171.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-19T06:19:03.719 INFO:teuthology.orchestra.run.smithi171.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-19T06:19:03.719 INFO:teuthology.orchestra.run.smithi171.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-19T06:19:03.720 INFO:teuthology.orchestra.run.smithi171.stdout:The following additional packages will be installed: 2024-03-19T06:19:03.720 INFO:teuthology.orchestra.run.smithi171.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-03-19T06:19:03.720 INFO:teuthology.orchestra.run.smithi171.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-03-19T06:19:03.720 INFO:teuthology.orchestra.run.smithi171.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-03-19T06:19:03.721 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-03-19T06:19:03.721 INFO:teuthology.orchestra.run.smithi171.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-19T06:19:03.722 INFO:teuthology.orchestra.run.smithi171.stdout:Suggested packages: 2024-03-19T06:19:03.722 INFO:teuthology.orchestra.run.smithi171.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-03-19T06:19:03.722 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-03-19T06:19:03.722 INFO:teuthology.orchestra.run.smithi171.stdout: libengine-pkcs11-openssl 2024-03-19T06:19:03.772 INFO:teuthology.orchestra.run.smithi171.stdout:The following NEW packages will be installed: 2024-03-19T06:19:03.772 INFO:teuthology.orchestra.run.smithi171.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-03-19T06:19:03.772 INFO:teuthology.orchestra.run.smithi171.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-03-19T06:19:03.773 INFO:teuthology.orchestra.run.smithi171.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-03-19T06:19:03.773 INFO:teuthology.orchestra.run.smithi171.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-03-19T06:19:03.773 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-03-19T06:19:03.773 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-03-19T06:19:03.773 INFO:teuthology.orchestra.run.smithi171.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-19T06:19:03.774 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages will be upgraded: 2024-03-19T06:19:03.775 INFO:teuthology.orchestra.run.smithi171.stdout: libssl3 2024-03-19T06:19:03.839 INFO:teuthology.orchestra.run.smithi032.stdout:Setting system user ceph properties....done 2024-03-19T06:19:03.857 INFO:teuthology.orchestra.run.smithi032.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-19T06:19:03.858 INFO:teuthology.orchestra.run.smithi171.stdout:1 upgraded, 39 newly installed, 0 to remove and 287 not upgraded. 2024-03-19T06:19:03.858 INFO:teuthology.orchestra.run.smithi171.stdout:Need to get 54.6 MB of archives. 2024-03-19T06:19:03.858 INFO:teuthology.orchestra.run.smithi171.stdout:After this operation, 202 MB of additional disk space will be used. 2024-03-19T06:19:03.859 INFO:teuthology.orchestra.run.smithi171.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-03-19T06:19:03.984 INFO:teuthology.orchestra.run.smithi171.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-03-19T06:19:04.006 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-19T06:19:04.052 INFO:teuthology.orchestra.run.smithi171.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-03-19T06:19:04.061 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-03-19T06:19:04.062 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-03-19T06:19:04.064 INFO:teuthology.orchestra.run.smithi171.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-03-19T06:19:04.065 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-03-19T06:19:04.065 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-03-19T06:19:04.067 INFO:teuthology.orchestra.run.smithi171.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-03-19T06:19:04.067 INFO:teuthology.orchestra.run.smithi171.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-03-19T06:19:04.068 INFO:teuthology.orchestra.run.smithi171.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-03-19T06:19:04.075 INFO:teuthology.orchestra.run.smithi171.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-03-19T06:19:04.089 INFO:teuthology.orchestra.run.smithi171.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-03-19T06:19:04.315 INFO:teuthology.orchestra.run.smithi171.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-03-19T06:19:04.316 INFO:teuthology.orchestra.run.smithi171.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-03-19T06:19:04.317 INFO:teuthology.orchestra.run.smithi171.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-03-19T06:19:04.320 INFO:teuthology.orchestra.run.smithi171.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-03-19T06:19:04.320 INFO:teuthology.orchestra.run.smithi171.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-03-19T06:19:04.325 INFO:teuthology.orchestra.run.smithi171.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-03-19T06:19:04.326 INFO:teuthology.orchestra.run.smithi171.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-03-19T06:19:04.333 INFO:teuthology.orchestra.run.smithi171.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-03-19T06:19:04.334 INFO:teuthology.orchestra.run.smithi171.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-03-19T06:19:04.355 INFO:teuthology.orchestra.run.smithi171.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-03-19T06:19:04.356 INFO:teuthology.orchestra.run.smithi171.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-03-19T06:19:04.369 INFO:teuthology.orchestra.run.smithi171.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-03-19T06:19:04.391 INFO:teuthology.orchestra.run.smithi171.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-03-19T06:19:04.394 INFO:teuthology.orchestra.run.smithi171.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-03-19T06:19:04.395 INFO:teuthology.orchestra.run.smithi171.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-03-19T06:19:04.395 INFO:teuthology.orchestra.run.smithi171.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-03-19T06:19:04.396 INFO:teuthology.orchestra.run.smithi171.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-03-19T06:19:04.407 INFO:teuthology.orchestra.run.smithi171.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-03-19T06:19:04.409 INFO:teuthology.orchestra.run.smithi171.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-03-19T06:19:04.416 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-19T06:19:04.564 INFO:teuthology.orchestra.run.smithi171.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-03-19T06:19:04.564 INFO:teuthology.orchestra.run.smithi171.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-03-19T06:19:04.564 INFO:teuthology.orchestra.run.smithi171.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-03-19T06:19:04.565 INFO:teuthology.orchestra.run.smithi171.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-03-19T06:19:04.565 INFO:teuthology.orchestra.run.smithi171.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-03-19T06:19:04.565 INFO:teuthology.orchestra.run.smithi171.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-03-19T06:19:04.578 INFO:teuthology.orchestra.run.smithi171.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-03-19T06:19:04.579 INFO:teuthology.orchestra.run.smithi171.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-03-19T06:19:04.957 INFO:teuthology.orchestra.run.smithi171.stdout:Preconfiguring packages ... 2024-03-19T06:19:05.063 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephfs-mirror (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:05.110 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 54.6 MB in 1s (68.6 MB/s) 2024-03-19T06:19:05.253 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package flex. 2024-03-19T06:19:05.275 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-19T06:19:05.275 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-19T06:19:05.323 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140586 files and directories currently installed.) 2024-03-19T06:19:05.327 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-03-19T06:19:05.369 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking flex (2.6.4-8build2) ... 2024-03-19T06:19:05.931 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-19T06:19:05.969 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-test (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:06.094 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up radosgw (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:06.126 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-03-19T06:19:06.483 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-19T06:19:06.646 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-19T06:19:06.646 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-19T06:19:06.979 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package bison. 2024-03-19T06:19:07.049 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140659 files and directories currently installed.) 2024-03-19T06:19:07.053 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-03-19T06:19:07.089 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-03-19T06:19:07.297 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-base (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:07.516 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-03-19T06:19:07.531 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-03-19T06:19:07.575 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-03-19T06:19:07.650 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-19T06:19:07.912 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package dump. 2024-03-19T06:19:07.926 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-03-19T06:19:07.970 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking dump (0.4b47-3) ... 2024-03-19T06:19:08.249 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package indent. 2024-03-19T06:19:08.264 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-03-19T06:19:08.315 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mds (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:08.324 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-19T06:19:08.552 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-19T06:19:08.552 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-19T06:19:08.586 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-03-19T06:19:08.601 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-03-19T06:19:08.644 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-19T06:19:08.982 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-03-19T06:19:08.997 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-03-19T06:19:09.040 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-19T06:19:09.183 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:09.403 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-19T06:19:09.403 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-19T06:19:09.438 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-03-19T06:19:09.454 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-03-19T06:19:09.496 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-03-19T06:19:09.842 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libfl2:amd64. 2024-03-19T06:19:09.858 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-03-19T06:19:09.933 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-03-19T06:19:10.002 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-osd (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:10.170 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-03-19T06:19:10.186 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-03-19T06:19:10.245 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-19T06:19:10.354 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-19T06:19:10.355 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-19T06:19:10.524 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libjson-perl. 2024-03-19T06:19:10.539 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-03-19T06:19:10.582 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-03-19T06:19:10.852 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libllvm14:amd64. 2024-03-19T06:19:10.868 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-03-19T06:19:10.911 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-19T06:19:10.987 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:11.121 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:11.264 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mon (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:11.465 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-19T06:19:11.465 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-19T06:19:12.141 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-cephadm (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:12.267 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:12.373 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-03-19T06:19:12.388 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-19T06:19:12.431 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-19T06:19:12.692 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libmbim-proxy. 2024-03-19T06:19:12.708 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-19T06:19:12.710 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-dashboard (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:12.750 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-19T06:19:12.861 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-volume (19.0.0-1934-gb0ea271b-1jammy) ... 2024-03-19T06:19:13.071 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-03-19T06:19:13.087 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-19T06:19:13.129 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-19T06:19:13.239 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-19T06:19:13.348 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-19T06:19:13.491 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libndp0:amd64. 2024-03-19T06:19:13.507 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-03-19T06:19:13.508 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-19T06:19:13.549 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-19T06:19:13.878 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libnm0:amd64. 2024-03-19T06:19:13.893 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-03-19T06:19:13.961 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-19T06:19:14.210 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-19T06:19:14.314 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libpq5:amd64. 2024-03-19T06:19:14.330 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-19T06:19:14.373 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-19T06:19:14.727 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-03-19T06:19:14.743 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-19T06:19:14.785 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-19T06:19:14.904 INFO:teuthology.orchestra.run.smithi032.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-19T06:19:14.908 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-03-19T06:19:14.984 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-03-19T06:19:15.063 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqmi-proxy. 2024-03-19T06:19:15.079 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-19T06:19:15.113 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-19T06:19:15.159 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-03-19T06:19:15.160 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-03-19T06:19:15.323 INFO:teuthology.orchestra.run.smithi032.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-03-19T06:19:15.324 INFO:teuthology.orchestra.run.smithi032.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-03-19T06:19:15.324 INFO:teuthology.orchestra.run.smithi032.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-03-19T06:19:15.324 INFO:teuthology.orchestra.run.smithi032.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-03-19T06:19:15.324 INFO:teuthology.orchestra.run.smithi032.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-03-19T06:19:15.324 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-03-19T06:19:15.324 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-19T06:19:15.324 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-19T06:19:15.324 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-19T06:19:15.325 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-19T06:19:15.325 INFO:teuthology.orchestra.run.smithi032.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-19T06:19:15.325 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-19T06:19:15.326 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2024-03-19T06:19:15.326 INFO:teuthology.orchestra.run.smithi032.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-03-19T06:19:15.326 INFO:teuthology.orchestra.run.smithi032.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-03-19T06:19:15.326 INFO:teuthology.orchestra.run.smithi032.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-03-19T06:19:15.326 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-03-19T06:19:15.326 INFO:teuthology.orchestra.run.smithi032.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-19T06:19:15.327 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2024-03-19T06:19:15.327 INFO:teuthology.orchestra.run.smithi032.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-03-19T06:19:15.327 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-03-19T06:19:15.327 INFO:teuthology.orchestra.run.smithi032.stdout: libengine-pkcs11-openssl 2024-03-19T06:19:15.358 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-03-19T06:19:15.373 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-19T06:19:15.378 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2024-03-19T06:19:15.378 INFO:teuthology.orchestra.run.smithi032.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-03-19T06:19:15.378 INFO:teuthology.orchestra.run.smithi032.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-03-19T06:19:15.379 INFO:teuthology.orchestra.run.smithi032.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-03-19T06:19:15.379 INFO:teuthology.orchestra.run.smithi032.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-03-19T06:19:15.379 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-03-19T06:19:15.379 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-03-19T06:19:15.379 INFO:teuthology.orchestra.run.smithi032.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-19T06:19:15.380 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages will be upgraded: 2024-03-19T06:19:15.380 INFO:teuthology.orchestra.run.smithi032.stdout: libssl3 2024-03-19T06:19:15.416 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-19T06:19:15.565 INFO:teuthology.orchestra.run.smithi032.stdout:1 upgraded, 39 newly installed, 0 to remove and 287 not upgraded. 2024-03-19T06:19:15.565 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 54.6 MB of archives. 2024-03-19T06:19:15.565 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 202 MB of additional disk space will be used. 2024-03-19T06:19:15.565 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-03-19T06:19:15.920 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-03-19T06:19:15.935 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-03-19T06:19:15.970 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-03-19T06:19:16.068 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-03-19T06:19:16.334 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-03-19T06:19:16.340 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package modemmanager. 2024-03-19T06:19:16.356 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-19T06:19:16.366 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-03-19T06:19:16.369 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-03-19T06:19:16.374 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-03-19T06:19:16.378 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-03-19T06:19:16.379 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-03-19T06:19:16.381 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-03-19T06:19:16.386 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-03-19T06:19:16.399 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-19T06:19:16.551 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-03-19T06:19:16.551 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-03-19T06:19:16.807 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-03-19T06:19:17.031 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package network-manager. 2024-03-19T06:19:17.047 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-03-19T06:19:17.098 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-03-19T06:19:17.707 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ppp. 2024-03-19T06:19:17.723 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-03-19T06:19:17.851 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-03-19T06:19:17.853 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-03-19T06:19:17.853 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-03-19T06:19:17.856 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-03-19T06:19:17.856 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-03-19T06:19:17.861 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-03-19T06:19:17.878 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-03-19T06:19:17.886 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-03-19T06:19:18.051 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-03-19T06:19:18.078 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-03-19T06:19:18.422 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package pptp-linux. 2024-03-19T06:19:18.436 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-03-19T06:19:18.480 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-03-19T06:19:18.725 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package network-manager-pptp. 2024-03-19T06:19:18.739 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-03-19T06:19:18.795 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-03-19T06:19:18.795 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-03-19T06:19:18.808 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-03-19T06:19:18.822 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-03-19T06:19:18.899 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-03-19T06:19:18.907 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-03-19T06:19:18.908 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-03-19T06:19:18.909 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-03-19T06:19:18.909 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-03-19T06:19:18.937 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-03-19T06:19:18.941 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-03-19T06:19:19.162 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package postgresql-client-common. 2024-03-19T06:19:19.177 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-03-19T06:19:19.220 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking postgresql-client-common (238) ... 2024-03-19T06:19:19.567 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-03-19T06:19:19.650 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-03-19T06:19:19.650 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-03-19T06:19:19.650 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-03-19T06:19:19.740 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-03-19T06:19:19.754 INFO:teuthology.orchestra.run.smithi032.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-03-19T06:19:19.993 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package postgresql-client-14. 2024-03-19T06:19:20.009 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-19T06:19:20.043 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-19T06:19:20.221 INFO:teuthology.orchestra.run.smithi032.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-03-19T06:19:20.223 INFO:teuthology.orchestra.run.smithi032.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-03-19T06:19:20.616 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package postgresql-common. 2024-03-19T06:19:20.631 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-03-19T06:19:20.633 INFO:teuthology.orchestra.run.smithi032.stdout:Preconfiguring packages ... 2024-03-19T06:19:20.684 INFO:teuthology.orchestra.run.smithi171.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-03-19T06:19:20.706 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking postgresql-common (238) ... 2024-03-19T06:19:20.786 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 54.6 MB in 5s (11.3 MB/s) 2024-03-19T06:19:20.911 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package flex. 2024-03-19T06:19:20.984 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140586 files and directories currently installed.) 2024-03-19T06:19:20.988 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-03-19T06:19:21.026 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking flex (2.6.4-8build2) ... 2024-03-19T06:19:21.191 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package postgresql-14. 2024-03-19T06:19:21.207 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-19T06:19:21.252 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-19T06:19:21.598 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-19T06:19:21.800 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-03-19T06:19:22.216 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-19T06:19:22.439 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package postgresql. 2024-03-19T06:19:22.454 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-03-19T06:19:22.497 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking postgresql (14+238) ... 2024-03-19T06:19:22.775 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package postgresql-client. 2024-03-19T06:19:22.789 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-03-19T06:19:22.801 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package bison. 2024-03-19T06:19:22.825 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking postgresql-client (14+238) ... 2024-03-19T06:19:22.876 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140659 files and directories currently installed.) 2024-03-19T06:19:22.880 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-03-19T06:19:22.928 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-03-19T06:19:23.053 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package postgresql-contrib. 2024-03-19T06:19:23.067 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-03-19T06:19:23.119 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking postgresql-contrib (14+238) ... 2024-03-19T06:19:23.404 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-03-19T06:19:23.419 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-03-19T06:19:23.462 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-03-19T06:19:23.473 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package tcl8.6. 2024-03-19T06:19:23.487 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-03-19T06:19:23.531 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-19T06:19:23.816 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package dump. 2024-03-19T06:19:23.832 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-03-19T06:19:23.834 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package tcl. 2024-03-19T06:19:23.849 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-03-19T06:19:23.874 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking dump (0.4b47-3) ... 2024-03-19T06:19:23.896 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-03-19T06:19:24.136 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package indent. 2024-03-19T06:19:24.152 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-03-19T06:19:24.194 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-19T06:19:24.229 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package wpasupplicant. 2024-03-19T06:19:24.244 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-03-19T06:19:24.288 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-19T06:19:24.413 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-03-19T06:19:24.429 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-03-19T06:19:24.463 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-19T06:19:24.660 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-03-19T06:19:24.675 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-03-19T06:19:24.718 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-03-19T06:19:24.817 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-03-19T06:19:24.834 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-03-19T06:19:24.876 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-19T06:19:25.204 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-03-19T06:19:25.220 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-03-19T06:19:25.262 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-03-19T06:19:25.308 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package usb-modeswitch. 2024-03-19T06:19:25.323 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-03-19T06:19:25.374 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-19T06:19:25.558 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libfl2:amd64. 2024-03-19T06:19:25.574 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-03-19T06:19:25.607 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-03-19T06:19:25.686 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up postgresql-client-common (238) ... 2024-03-19T06:19:25.882 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-03-19T06:19:25.898 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-03-19T06:19:25.909 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up flex (2.6.4-8build2) ... 2024-03-19T06:19:25.943 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-19T06:19:26.059 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-19T06:19:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-19T06:19:26.196 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libjson-perl. 2024-03-19T06:19:26.212 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-03-19T06:19:26.254 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-03-19T06:19:26.311 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-03-19T06:19:26.437 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-19T06:19:26.564 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-19T06:19:26.574 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libllvm14:amd64. 2024-03-19T06:19:26.590 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-03-19T06:19:26.632 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-19T06:19:27.516 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-03-19T06:19:27.611 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-19T06:19:27.994 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-03-19T06:19:28.010 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-19T06:19:28.016 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-19T06:19:28.016 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-19T06:19:28.051 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-19T06:19:28.321 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libmbim-proxy. 2024-03-19T06:19:28.337 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-19T06:19:28.379 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-19T06:19:28.665 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-03-19T06:19:28.707 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-03-19T06:19:28.723 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-19T06:19:28.765 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-19T06:19:28.816 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-19T06:19:28.968 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-03-19T06:19:29.043 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libndp0:amd64. 2024-03-19T06:19:29.059 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-03-19T06:19:29.094 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-03-19T06:19:29.111 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-19T06:19:29.212 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-03-19T06:19:29.363 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-19T06:19:29.429 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libnm0:amd64. 2024-03-19T06:19:29.445 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-03-19T06:19:29.487 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-19T06:19:29.581 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-03-19T06:19:29.849 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libpq5:amd64. 2024-03-19T06:19:29.865 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-19T06:19:29.907 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-19T06:19:30.271 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-19T06:19:30.303 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-03-19T06:19:30.320 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-19T06:19:30.361 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-19T06:19:30.431 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up dump (0.4b47-3) ... 2024-03-19T06:19:30.526 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-03-19T06:19:30.591 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-19T06:19:30.714 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqmi-proxy. 2024-03-19T06:19:30.717 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-19T06:19:30.730 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-19T06:19:30.772 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-19T06:19:30.843 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up tcl (8.6.11+1build2) ... 2024-03-19T06:19:31.017 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-03-19T06:19:31.020 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libjson-perl (4.04000-1) ... 2024-03-19T06:19:31.033 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-19T06:19:31.075 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-19T06:19:31.138 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-03-19T06:19:31.228 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-03-19T06:19:31.298 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-19T06:19:31.424 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-19T06:19:31.604 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-03-19T06:19:31.620 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-03-19T06:19:31.626 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-19T06:19:31.662 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-03-19T06:19:31.752 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-19T06:19:31.870 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-03-19T06:19:32.047 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up postgresql-client (14+238) ... 2024-03-19T06:19:32.056 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package modemmanager. 2024-03-19T06:19:32.072 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-19T06:19:32.115 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-19T06:19:32.173 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-03-19T06:19:32.737 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:19:32.737 INFO:teuthology.orchestra.run.smithi171.stdout:The following network interfaces were found in /etc/network/interfaces 2024-03-19T06:19:32.737 INFO:teuthology.orchestra.run.smithi171.stdout:which means they are currently configured by ifupdown: 2024-03-19T06:19:32.737 INFO:teuthology.orchestra.run.smithi171.stdout:- enp3s0f1 2024-03-19T06:19:32.737 INFO:teuthology.orchestra.run.smithi171.stdout:If you want to manage those interfaces with NetworkManager instead 2024-03-19T06:19:32.737 INFO:teuthology.orchestra.run.smithi171.stdout:remove their configuration from /etc/network/interfaces. 2024-03-19T06:19:32.737 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:19:32.762 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package network-manager. 2024-03-19T06:19:32.779 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-03-19T06:19:32.829 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-03-19T06:19:32.870 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-03-19T06:19:33.268 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-03-19T06:19:33.470 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ppp. 2024-03-19T06:19:33.482 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-03-19T06:19:33.656 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-03-19T06:19:33.816 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-03-19T06:19:34.162 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package pptp-linux. 2024-03-19T06:19:34.175 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-03-19T06:19:34.217 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-03-19T06:19:34.329 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-19T06:19:34.427 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package network-manager-pptp. 2024-03-19T06:19:34.440 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-03-19T06:19:34.470 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-19T06:19:34.478 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-03-19T06:19:34.580 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-03-19T06:19:34.739 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up postgresql-common (238) ... 2024-03-19T06:19:34.764 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-client-common. 2024-03-19T06:19:34.777 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-03-19T06:19:34.805 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-client-common (238) ... 2024-03-19T06:19:35.093 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-client-14. 2024-03-19T06:19:35.107 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-19T06:19:35.151 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-19T06:19:35.707 INFO:teuthology.orchestra.run.smithi171.stdout:Adding user postgres to group ssl-cert 2024-03-19T06:19:35.980 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:19:35.981 INFO:teuthology.orchestra.run.smithi171.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-03-19T06:19:36.133 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-common. 2024-03-19T06:19:36.149 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-03-19T06:19:36.202 INFO:teuthology.orchestra.run.smithi032.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-03-19T06:19:36.231 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-common (238) ... 2024-03-19T06:19:36.241 INFO:teuthology.orchestra.run.smithi171.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-03-19T06:19:36.241 INFO:teuthology.orchestra.run.smithi171.stdout:Removing obsolete dictionary files: 2024-03-19T06:19:36.698 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-14. 2024-03-19T06:19:36.712 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-19T06:19:36.843 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-19T06:19:36.930 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-03-19T06:19:37.369 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-19T06:19:37.775 INFO:teuthology.orchestra.run.smithi171.stdout:Creating new PostgreSQL cluster 14/main ... 2024-03-19T06:19:37.795 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-03-19T06:19:37.852 INFO:teuthology.orchestra.run.smithi171.stdout:The files belonging to this database system will be owned by user "postgres". 2024-03-19T06:19:37.853 INFO:teuthology.orchestra.run.smithi171.stdout:This user must also own the server process. 2024-03-19T06:19:37.853 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:19:37.853 INFO:teuthology.orchestra.run.smithi171.stdout:The database cluster will be initialized with locale "en_US". 2024-03-19T06:19:37.853 INFO:teuthology.orchestra.run.smithi171.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-03-19T06:19:37.853 INFO:teuthology.orchestra.run.smithi171.stdout:The default text search configuration will be set to "english". 2024-03-19T06:19:37.853 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:19:37.853 INFO:teuthology.orchestra.run.smithi171.stdout:Data page checksums are disabled. 2024-03-19T06:19:37.853 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:19:37.853 INFO:teuthology.orchestra.run.smithi171.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-03-19T06:19:37.854 INFO:teuthology.orchestra.run.smithi171.stdout:creating subdirectories ... ok 2024-03-19T06:19:37.854 INFO:teuthology.orchestra.run.smithi171.stdout:selecting dynamic shared memory implementation ... posix 2024-03-19T06:19:37.877 INFO:teuthology.orchestra.run.smithi171.stdout:selecting default max_connections ... 100 2024-03-19T06:19:37.911 INFO:teuthology.orchestra.run.smithi171.stdout:selecting default shared_buffers ... 128MB 2024-03-19T06:19:37.924 INFO:teuthology.orchestra.run.smithi171.stdout:selecting default time zone ... Etc/UTC 2024-03-19T06:19:37.925 INFO:teuthology.orchestra.run.smithi171.stdout:creating configuration files ... ok 2024-03-19T06:19:37.969 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql. 2024-03-19T06:19:37.982 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-03-19T06:19:38.019 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql (14+238) ... 2024-03-19T06:19:38.092 INFO:teuthology.orchestra.run.smithi171.stdout:running bootstrap script ... ok 2024-03-19T06:19:38.262 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-client. 2024-03-19T06:19:38.278 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-03-19T06:19:38.321 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-client (14+238) ... 2024-03-19T06:19:38.565 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-contrib. 2024-03-19T06:19:38.579 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-03-19T06:19:38.625 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-contrib (14+238) ... 2024-03-19T06:19:38.725 INFO:teuthology.orchestra.run.smithi171.stdout:performing post-bootstrap initialization ... ok 2024-03-19T06:19:38.959 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package tcl8.6. 2024-03-19T06:19:38.974 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-03-19T06:19:39.017 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-19T06:19:39.262 INFO:teuthology.orchestra.run.smithi171.stdout:syncing data to disk ... ok 2024-03-19T06:19:39.270 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package tcl. 2024-03-19T06:19:39.285 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-03-19T06:19:39.325 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-03-19T06:19:39.665 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package wpasupplicant. 2024-03-19T06:19:39.680 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-03-19T06:19:39.723 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-19T06:19:39.743 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-03-19T06:19:40.078 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-03-19T06:19:40.093 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-03-19T06:19:40.136 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-03-19T06:19:40.489 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package usb-modeswitch. 2024-03-19T06:19:40.504 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-03-19T06:19:40.547 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-19T06:19:40.834 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-client-common (238) ... 2024-03-19T06:19:41.045 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up flex (2.6.4-8build2) ... 2024-03-19T06:19:41.172 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-19T06:19:41.273 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-19T06:19:41.374 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-03-19T06:19:41.508 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-19T06:19:41.634 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-19T06:19:42.636 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-03-19T06:19:42.723 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-19T06:19:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-19T06:19:43.099 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-19T06:19:43.190 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-19T06:19:43.316 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up postgresql-contrib (14+238) ... 2024-03-19T06:19:43.442 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up postgresql (14+238) ... 2024-03-19T06:19:43.593 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-19T06:19:43.719 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-19T06:19:43.785 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-03-19T06:19:43.928 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-19T06:19:43.972 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-03-19T06:19:43.972 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-03-19T06:19:44.053 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-03-19T06:19:44.155 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-03-19T06:19:44.280 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-03-19T06:19:44.406 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-19T06:19:44.558 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-03-19T06:19:44.681 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-19T06:19:45.042 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-19T06:19:45.180 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-19T06:19:45.227 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-19T06:19:45.306 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up dump (0.4b47-3) ... 2024-03-19T06:19:45.401 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-03-19T06:19:45.466 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-19T06:19:45.601 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-19T06:19:46.110 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up tcl (8.6.11+1build2) ... 2024-03-19T06:19:46.236 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libjson-perl (4.04000-1) ... 2024-03-19T06:19:46.345 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-03-19T06:19:46.419 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-03-19T06:19:46.489 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-19T06:19:46.615 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-19T06:19:46.657 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-03-19T06:19:46.791 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-19T06:19:46.794 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-19T06:19:46.926 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-19T06:19:47.202 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-03-19T06:19:47.333 INFO:teuthology.orchestra.run.smithi171.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-19T06:19:47.340 DEBUG:teuthology.parallel:result is None 2024-03-19T06:19:47.412 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-client (14+238) ... 2024-03-19T06:19:47.538 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-03-19T06:19:48.131 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:19:48.131 INFO:teuthology.orchestra.run.smithi032.stdout:The following network interfaces were found in /etc/network/interfaces 2024-03-19T06:19:48.131 INFO:teuthology.orchestra.run.smithi032.stdout:which means they are currently configured by ifupdown: 2024-03-19T06:19:48.131 INFO:teuthology.orchestra.run.smithi032.stdout:- ens1f0 2024-03-19T06:19:48.131 INFO:teuthology.orchestra.run.smithi032.stdout:If you want to manage those interfaces with NetworkManager instead 2024-03-19T06:19:48.132 INFO:teuthology.orchestra.run.smithi032.stdout:remove their configuration from /etc/network/interfaces. 2024-03-19T06:19:48.132 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:19:48.271 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-03-19T06:19:48.668 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-03-19T06:19:49.116 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-03-19T06:19:49.865 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-19T06:19:50.017 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-19T06:19:50.143 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-03-19T06:19:50.303 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-common (238) ... 2024-03-19T06:19:51.245 INFO:teuthology.orchestra.run.smithi032.stdout:Adding user postgres to group ssl-cert 2024-03-19T06:19:51.516 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:19:51.516 INFO:teuthology.orchestra.run.smithi032.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-03-19T06:19:51.783 INFO:teuthology.orchestra.run.smithi032.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-03-19T06:19:51.783 INFO:teuthology.orchestra.run.smithi032.stdout:Removing obsolete dictionary files: 2024-03-19T06:19:52.514 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-03-19T06:19:53.121 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-19T06:19:53.463 INFO:teuthology.orchestra.run.smithi032.stdout:Creating new PostgreSQL cluster 14/main ... 2024-03-19T06:19:53.479 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-03-19T06:19:53.534 INFO:teuthology.orchestra.run.smithi032.stdout:The files belonging to this database system will be owned by user "postgres". 2024-03-19T06:19:53.534 INFO:teuthology.orchestra.run.smithi032.stdout:This user must also own the server process. 2024-03-19T06:19:53.535 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:19:53.535 INFO:teuthology.orchestra.run.smithi032.stdout:The database cluster will be initialized with locale "en_US". 2024-03-19T06:19:53.535 INFO:teuthology.orchestra.run.smithi032.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-03-19T06:19:53.535 INFO:teuthology.orchestra.run.smithi032.stdout:The default text search configuration will be set to "english". 2024-03-19T06:19:53.535 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:19:53.535 INFO:teuthology.orchestra.run.smithi032.stdout:Data page checksums are disabled. 2024-03-19T06:19:53.535 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:19:53.535 INFO:teuthology.orchestra.run.smithi032.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-03-19T06:19:53.536 INFO:teuthology.orchestra.run.smithi032.stdout:creating subdirectories ... ok 2024-03-19T06:19:53.536 INFO:teuthology.orchestra.run.smithi032.stdout:selecting dynamic shared memory implementation ... posix 2024-03-19T06:19:53.560 INFO:teuthology.orchestra.run.smithi032.stdout:selecting default max_connections ... 100 2024-03-19T06:19:53.596 INFO:teuthology.orchestra.run.smithi032.stdout:selecting default shared_buffers ... 128MB 2024-03-19T06:19:53.610 INFO:teuthology.orchestra.run.smithi032.stdout:selecting default time zone ... Etc/UTC 2024-03-19T06:19:53.611 INFO:teuthology.orchestra.run.smithi032.stdout:creating configuration files ... ok 2024-03-19T06:19:53.783 INFO:teuthology.orchestra.run.smithi032.stdout:running bootstrap script ... ok 2024-03-19T06:19:54.412 INFO:teuthology.orchestra.run.smithi032.stdout:performing post-bootstrap initialization ... ok 2024-03-19T06:19:54.995 INFO:teuthology.orchestra.run.smithi032.stdout:syncing data to disk ... ok 2024-03-19T06:19:55.529 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-03-19T06:19:58.487 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-19T06:19:58.646 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-contrib (14+238) ... 2024-03-19T06:19:58.756 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql (14+238) ... 2024-03-19T06:19:58.857 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-19T06:19:58.983 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-19T06:19:59.251 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-03-19T06:19:59.251 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-03-19T06:20:00.036 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-19T06:20:00.346 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-19T06:20:00.481 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-19T06:20:01.878 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-03-19T06:20:01.978 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-19T06:20:02.524 INFO:teuthology.orchestra.run.smithi032.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-19T06:20:02.531 DEBUG:teuthology.parallel:result is None 2024-03-19T06:20:02.532 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:20:02.676 DEBUG:teuthology.orchestra.run.smithi032:> dpkg-query -W -f '${Version}' ceph 2024-03-19T06:20:02.698 INFO:teuthology.orchestra.run.smithi032.stdout:19.0.0-1934-gb0ea271b-1jammy 2024-03-19T06:20:02.699 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1934-gb0ea271b-1jammy 2024-03-19T06:20:02.699 INFO:teuthology.task.install:The correct ceph version 19.0.0-1934-gb0ea271b-1jammy is installed. 2024-03-19T06:20:02.701 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:20:02.922 DEBUG:teuthology.orchestra.run.smithi171:> dpkg-query -W -f '${Version}' ceph 2024-03-19T06:20:02.950 INFO:teuthology.orchestra.run.smithi171.stdout:19.0.0-1934-gb0ea271b-1jammy 2024-03-19T06:20:02.950 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1934-gb0ea271b-1jammy 2024-03-19T06:20:02.950 INFO:teuthology.task.install:The correct ceph version 19.0.0-1934-gb0ea271b-1jammy is installed. 2024-03-19T06:20:02.952 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-19T06:20:02.952 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:02.952 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-19T06:20:02.972 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:02.972 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-19T06:20:03.010 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-19T06:20:03.011 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:03.011 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/daemon-helper 2024-03-19T06:20:03.033 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-19T06:20:03.093 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:03.093 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-03-19T06:20:03.114 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-19T06:20:03.181 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-19T06:20:03.182 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:03.182 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-19T06:20:03.201 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-19T06:20:03.265 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:03.265 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-19T06:20:03.285 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-19T06:20:03.353 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-19T06:20:03.353 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:03.353 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/stdin-killer 2024-03-19T06:20:03.373 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-19T06:20:03.433 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:03.433 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-03-19T06:20:03.455 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-19T06:20:03.517 INFO:teuthology.run_tasks:Running task ceph... 2024-03-19T06:20:03.608 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-19T06:20:03.608 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 777 /var/log/ceph 2024-03-19T06:20:03.611 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /var/log/ceph 2024-03-19T06:20:03.631 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-19T06:20:03.631 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-19T06:20:03.673 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-19T06:20:03.693 INFO:tasks.ceph:Creating extra log directories... 2024-03-19T06:20:03.693 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-19T06:20:03.733 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-19T06:20:03.764 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-19T06:20:03.764 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-19T06:20:03.764 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-19T06:20:03.764 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:03.764 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-19T06:20:03.802 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-19T06:20:03.893 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:03.893 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-19T06:20:03.902 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-19T06:20:04.000 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-19T06:20:04.000 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-19T06:20:04.000 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674', 'branch': 'wip-vshankar-testing-20240307.022905', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/pool-perm}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7610674', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '908b6b276e8f14e16032b32a9770077cd37b6bd4'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240307.022905'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240307.022905', 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6045, 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f', 'sleep_before_teardown': 0, 'subset': '832/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240307.022905', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi032.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHK9D/Y/H040981xY6SRILI9PlrGvBdT45cqKN9ms4MWqoJxDItCeKGfnYVMK2YLr60XQgtwZy69sOwvE0FBczs=', 'smithi171.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGAmXfjV+X+ZH5sgNguN6cRoHoYI4pszUisZKBbkrDTITM2/5G8zzZ2HpMijH9SO7rvKJL3a8Y2mZDaJjGxxkLM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '908b6b276e8f14e16032b32a9770077cd37b6bd4'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-19_04:59:54', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-19T06:20:04.000 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-19T06:20:04.003 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-19T06:20:04.012 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/run/ceph 2024-03-19T06:20:04.052 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph 2024-03-19T06:20:04.077 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:04.077 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/scratch_devs of=/dev/stdout 2024-03-19T06:20:04.118 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-19T06:20:04.118 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_1 2024-03-19T06:20:04.170 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-19T06:20:04.170 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T06:20:04.170 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-03-19T06:20:04.170 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:20:04.170 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-03-19 06:13:20.354310748 +0000 2024-03-19T06:20:04.170 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-03-19 06:13:20.082313177 +0000 2024-03-19T06:20:04.170 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-03-19 06:13:20.082313177 +0000 2024-03-19T06:20:04.170 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-03-19 06:13:20.082313177 +0000 2024-03-19T06:20:04.171 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-19T06:20:04.231 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-03-19T06:20:04.232 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-03-19T06:20:04.232 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000249049 s, 2.1 MB/s 2024-03-19T06:20:04.233 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-19T06:20:04.284 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_2 2024-03-19T06:20:04.334 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-19T06:20:04.334 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T06:20:04.334 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-03-19T06:20:04.334 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:20:04.334 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-03-19 06:13:20.858306245 +0000 2024-03-19T06:20:04.334 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-03-19 06:13:20.590308640 +0000 2024-03-19T06:20:04.334 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-03-19 06:13:20.590308640 +0000 2024-03-19T06:20:04.334 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-03-19 06:13:20.590308640 +0000 2024-03-19T06:20:04.335 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-19T06:20:04.395 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-03-19T06:20:04.395 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-03-19T06:20:04.395 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000241332 s, 2.1 MB/s 2024-03-19T06:20:04.397 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-19T06:20:04.447 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_3 2024-03-19T06:20:04.498 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-19T06:20:04.498 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T06:20:04.498 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-03-19T06:20:04.498 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:20:04.498 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-03-19 06:13:21.386301530 +0000 2024-03-19T06:20:04.498 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-03-19 06:13:21.122303888 +0000 2024-03-19T06:20:04.499 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-03-19 06:13:21.122303888 +0000 2024-03-19T06:20:04.499 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-03-19 06:13:21.122303888 +0000 2024-03-19T06:20:04.499 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-19T06:20:04.560 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-03-19T06:20:04.560 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-03-19T06:20:04.560 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000239997 s, 2.1 MB/s 2024-03-19T06:20:04.562 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-19T06:20:04.616 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_4 2024-03-19T06:20:04.666 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-19T06:20:04.666 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T06:20:04.666 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 943 Links: 1 2024-03-19T06:20:04.666 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:20:04.666 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-03-19 06:13:21.910296850 +0000 2024-03-19T06:20:04.666 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-03-19 06:13:21.642299243 +0000 2024-03-19T06:20:04.667 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-03-19 06:13:21.642299243 +0000 2024-03-19T06:20:04.667 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-03-19 06:13:21.642299243 +0000 2024-03-19T06:20:04.667 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-19T06:20:04.728 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-03-19T06:20:04.728 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-03-19T06:20:04.728 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000249539 s, 2.1 MB/s 2024-03-19T06:20:04.730 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-19T06:20:04.784 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-19T06:20:04.784 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:04.784 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-03-19T06:20:04.794 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-19T06:20:04.794 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-03-19T06:20:04.846 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-19T06:20:04.846 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T06:20:04.846 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-03-19T06:20:04.846 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:20:04.846 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-03-19 06:13:17.391724675 +0000 2024-03-19T06:20:04.846 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-03-19 06:13:17.107727211 +0000 2024-03-19T06:20:04.846 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-03-19 06:13:17.107727211 +0000 2024-03-19T06:20:04.846 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-03-19 06:13:17.107727211 +0000 2024-03-19T06:20:04.847 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-19T06:20:04.907 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-03-19T06:20:04.908 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-03-19T06:20:04.908 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000419205 s, 1.2 MB/s 2024-03-19T06:20:04.910 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-19T06:20:04.964 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-03-19T06:20:05.014 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-19T06:20:05.014 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T06:20:05.014 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-03-19T06:20:05.014 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:20:05.014 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-03-19 06:13:17.911720031 +0000 2024-03-19T06:20:05.014 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-03-19 06:13:17.647722387 +0000 2024-03-19T06:20:05.014 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-03-19 06:13:17.647722387 +0000 2024-03-19T06:20:05.014 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-03-19 06:13:17.647722387 +0000 2024-03-19T06:20:05.014 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-19T06:20:05.076 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-03-19T06:20:05.076 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-03-19T06:20:05.076 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000664926 s, 770 kB/s 2024-03-19T06:20:05.078 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-19T06:20:05.131 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-03-19T06:20:05.182 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-19T06:20:05.182 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T06:20:05.182 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-03-19T06:20:05.182 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:20:05.182 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-03-19 06:13:18.383715814 +0000 2024-03-19T06:20:05.182 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-03-19 06:13:18.139717994 +0000 2024-03-19T06:20:05.182 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-03-19 06:13:18.139717994 +0000 2024-03-19T06:20:05.182 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-03-19 06:13:18.139717994 +0000 2024-03-19T06:20:05.183 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-19T06:20:05.247 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-03-19T06:20:05.248 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-03-19T06:20:05.248 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000381804 s, 1.3 MB/s 2024-03-19T06:20:05.250 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-19T06:20:05.308 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-03-19T06:20:05.358 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-19T06:20:05.358 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T06:20:05.358 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 929 Links: 1 2024-03-19T06:20:05.358 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:20:05.358 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-03-19 06:13:18.907711134 +0000 2024-03-19T06:20:05.358 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-03-19 06:13:18.647713456 +0000 2024-03-19T06:20:05.358 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-03-19 06:13:18.647713456 +0000 2024-03-19T06:20:05.359 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-03-19 06:13:18.647713456 +0000 2024-03-19T06:20:05.359 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-19T06:20:05.424 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-03-19T06:20:05.424 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-03-19T06:20:05.424 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000386157 s, 1.3 MB/s 2024-03-19T06:20:05.426 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-19T06:20:05.479 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-19T06:20:05.479 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-19T06:20:05.480 INFO:tasks.ceph:Generating config... 2024-03-19T06:20:05.481 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-19T06:20:05.481 INFO:tasks.ceph:[client] debug client = 20 2024-03-19T06:20:05.481 INFO:tasks.ceph:[client] debug ms = 1 2024-03-19T06:20:05.481 INFO:tasks.ceph:[client] pid file = 2024-03-19T06:20:05.481 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-19T06:20:05.481 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-19T06:20:05.481 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-19T06:20:05.481 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-19T06:20:05.481 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-19T06:20:05.481 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-19T06:20:05.481 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-19T06:20:05.482 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-19T06:20:05.482 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-19T06:20:05.482 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-19T06:20:05.482 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-19T06:20:05.482 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-19T06:20:05.482 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-19T06:20:05.482 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-19T06:20:05.482 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-19T06:20:05.482 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-19T06:20:05.482 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-19T06:20:05.482 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-19T06:20:05.482 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-19T06:20:05.482 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-19T06:20:05.482 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-19T06:20:05.482 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-19T06:20:05.483 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-19T06:20:05.483 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-19T06:20:05.483 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-19T06:20:05.483 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-19T06:20:05.483 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-19T06:20:05.483 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-19T06:20:05.483 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-19T06:20:05.483 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-19T06:20:05.483 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-19T06:20:05.483 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-19T06:20:05.483 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-19T06:20:05.483 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-19T06:20:05.483 INFO:tasks.ceph:Setting up mon.a... 2024-03-19T06:20:05.484 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-19T06:20:05.530 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.keyring 2024-03-19T06:20:05.547 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-19T06:20:05.596 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-19T06:20:05.616 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.32'), ('mon.b', '172.21.15.171'), ('mon.c', '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]')] 2024-03-19T06:20:05.617 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.32,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-19T06:20:05.617 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:05.618 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-19T06:20:05.669 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.32 --add b 172.21.15.171 --addv c '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:20:05.757 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:20:05.757 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: generated fsid 5b96820f-940f-489f-8b00-afd5c905fd95 2024-03-19T06:20:05.757 INFO:teuthology.orchestra.run.smithi032.stdout:setting min_mon_release = quincy 2024-03-19T06:20:05.757 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 0 2024-03-19T06:20:05.757 INFO:teuthology.orchestra.run.smithi032.stdout:fsid 5b96820f-940f-489f-8b00-afd5c905fd95 2024-03-19T06:20:05.758 INFO:teuthology.orchestra.run.smithi032.stdout:last_changed 2024-03-19T06:20:05.770935+0000 2024-03-19T06:20:05.758 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-03-19T06:20:05.770935+0000 2024-03-19T06:20:05.758 INFO:teuthology.orchestra.run.smithi032.stdout:min_mon_release 17 (quincy) 2024-03-19T06:20:05.758 INFO:teuthology.orchestra.run.smithi032.stdout:election_strategy: 1 2024-03-19T06:20:05.758 INFO:teuthology.orchestra.run.smithi032.stdout:0: [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon.a 2024-03-19T06:20:05.758 INFO:teuthology.orchestra.run.smithi032.stdout:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-03-19T06:20:05.758 INFO:teuthology.orchestra.run.smithi032.stdout:2: [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] mon.c 2024-03-19T06:20:05.758 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-19T06:20:05.760 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-19T06:20:05.768 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5b96820f-940f-489f-8b00-afd5c905fd95... 2024-03-19T06:20:05.769 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-19T06:20:05.817 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-19T06:20:05.857 INFO:teuthology.orchestra.run.smithi032.stdout:[global] 2024-03-19T06:20:05.857 INFO:teuthology.orchestra.run.smithi032.stdout: chdir = "" 2024-03-19T06:20:05.857 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-19T06:20:05.857 INFO:teuthology.orchestra.run.smithi032.stdout: auth supported = cephx 2024-03-19T06:20:05.858 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.858 INFO:teuthology.orchestra.run.smithi032.stdout: filestore xattr use omap = true 2024-03-19T06:20:05.858 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.858 INFO:teuthology.orchestra.run.smithi032.stdout: mon clock drift allowed = 1.000 2024-03-19T06:20:05.858 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.858 INFO:teuthology.orchestra.run.smithi032.stdout: osd crush chooseleaf type = 0 2024-03-19T06:20:05.858 INFO:teuthology.orchestra.run.smithi032.stdout: auth debug = true 2024-03-19T06:20:05.858 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.858 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on old message = true 2024-03-19T06:20:05.858 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on bug = true 2024-03-19T06:20:05.858 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.858 INFO:teuthology.orchestra.run.smithi032.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-19T06:20:05.858 INFO:teuthology.orchestra.run.smithi032.stdout: mon pg warn max object skew = 0 2024-03-19T06:20:05.858 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.859 INFO:teuthology.orchestra.run.smithi032.stdout: # disable pg_autoscaler by default for new pools 2024-03-19T06:20:05.859 INFO:teuthology.orchestra.run.smithi032.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-19T06:20:05.859 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.859 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default size = 2 2024-03-19T06:20:05.859 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.859 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow primary affinity = true 2024-03-19T06:20:05.859 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow pg remap = true 2024-03-19T06:20:05.859 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on legacy crush tunables = false 2024-03-19T06:20:05.859 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on crush straw calc version zero = false 2024-03-19T06:20:05.859 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on no sortbitwise = false 2024-03-19T06:20:05.859 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on osd down out interval zero = false 2024-03-19T06:20:05.859 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on too few osds = false 2024-03-19T06:20:05.859 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-19T06:20:05.859 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-19T06:20:05.859 INFO:teuthology.orchestra.run.smithi032.stdout: mon_allow_pool_size_one = true 2024-03-19T06:20:05.860 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.860 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-19T06:20:05.860 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.860 INFO:teuthology.orchestra.run.smithi032.stdout: osd default data pool replay window = 5 2024-03-19T06:20:05.860 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.860 INFO:teuthology.orchestra.run.smithi032.stdout: mon allow pool delete = true 2024-03-19T06:20:05.860 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.860 INFO:teuthology.orchestra.run.smithi032.stdout: mon cluster log file level = debug 2024-03-19T06:20:05.860 INFO:teuthology.orchestra.run.smithi032.stdout: debug asserts on shutdown = true 2024-03-19T06:20:05.860 INFO:teuthology.orchestra.run.smithi032.stdout: mon health detail to clog = false 2024-03-19T06:20:05.860 INFO:teuthology.orchestra.run.smithi032.stdout: mon host = "172.21.15.32,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-03-19T06:20:05.860 INFO:teuthology.orchestra.run.smithi032.stdout: fsid = 5b96820f-940f-489f-8b00-afd5c905fd95 2024-03-19T06:20:05.860 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.860 INFO:teuthology.orchestra.run.smithi032.stdout:[osd] 2024-03-19T06:20:05.860 INFO:teuthology.orchestra.run.smithi032.stdout: osd journal size = 100 2024-03-19T06:20:05.861 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.861 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub load threshold = 5.0 2024-03-19T06:20:05.861 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub max interval = 600 2024-03-19T06:20:05.861 INFO:teuthology.orchestra.run.smithi032.stdout: osd mclock profile = high_recovery_ops 2024-03-19T06:20:05.861 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.861 INFO:teuthology.orchestra.run.smithi032.stdout: osd recover clone overlap = true 2024-03-19T06:20:05.861 INFO:teuthology.orchestra.run.smithi032.stdout: osd recovery max chunk = 1048576 2024-03-19T06:20:05.861 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.861 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug shutdown = true 2024-03-19T06:20:05.861 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug op order = true 2024-03-19T06:20:05.861 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug verify stray on activate = true 2024-03-19T06:20:05.861 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug trim objects = true 2024-03-19T06:20:05.861 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.861 INFO:teuthology.orchestra.run.smithi032.stdout: osd open classes on start = true 2024-03-19T06:20:05.861 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug pg log writeout = true 2024-03-19T06:20:05.862 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.862 INFO:teuthology.orchestra.run.smithi032.stdout: osd deep scrub update digest min age = 30 2024-03-19T06:20:05.862 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.862 INFO:teuthology.orchestra.run.smithi032.stdout: osd map max advance = 10 2024-03-19T06:20:05.862 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.862 INFO:teuthology.orchestra.run.smithi032.stdout: journal zero on create = true 2024-03-19T06:20:05.862 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.862 INFO:teuthology.orchestra.run.smithi032.stdout: filestore ondisk finisher threads = 3 2024-03-19T06:20:05.862 INFO:teuthology.orchestra.run.smithi032.stdout: filestore apply finisher threads = 3 2024-03-19T06:20:05.862 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.862 INFO:teuthology.orchestra.run.smithi032.stdout: bdev debug aio = true 2024-03-19T06:20:05.862 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug misdirected ops = true 2024-03-19T06:20:05.862 INFO:teuthology.orchestra.run.smithi032.stdout: bdev async discard = True 2024-03-19T06:20:05.862 INFO:teuthology.orchestra.run.smithi032.stdout: bdev enable discard = True 2024-03-19T06:20:05.862 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore allocator = bitmap 2024-03-19T06:20:05.863 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore block size = 96636764160 2024-03-19T06:20:05.863 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore fsck on mount = True 2024-03-19T06:20:05.863 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluefs = 1/20 2024-03-19T06:20:05.863 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluestore = 1/20 2024-03-19T06:20:05.863 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-03-19T06:20:05.863 INFO:teuthology.orchestra.run.smithi032.stdout: debug osd = 20 2024-03-19T06:20:05.863 INFO:teuthology.orchestra.run.smithi032.stdout: debug rocksdb = 4/10 2024-03-19T06:20:05.863 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd backfillfull_ratio = 0.85 2024-03-19T06:20:05.863 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd full ratio = 0.9 2024-03-19T06:20:05.863 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd nearfull ratio = 0.8 2024-03-19T06:20:05.863 INFO:teuthology.orchestra.run.smithi032.stdout: osd failsafe full ratio = 0.95 2024-03-19T06:20:05.863 INFO:teuthology.orchestra.run.smithi032.stdout: osd objectstore = bluestore 2024-03-19T06:20:05.863 INFO:teuthology.orchestra.run.smithi032.stdout: osd op complaint time = 180 2024-03-19T06:20:05.863 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.863 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr] 2024-03-19T06:20:05.863 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-03-19T06:20:05.864 INFO:teuthology.orchestra.run.smithi032.stdout: debug mgr = 20 2024-03-19T06:20:05.864 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-03-19T06:20:05.864 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-03-19T06:20:05.864 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-03-19T06:20:05.864 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-03-19T06:20:05.864 INFO:teuthology.orchestra.run.smithi032.stdout: mgr/telemetry/nag = false 2024-03-19T06:20:05.864 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.864 INFO:teuthology.orchestra.run.smithi032.stdout:[mon] 2024-03-19T06:20:05.864 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-03-19T06:20:05.864 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-03-19T06:20:05.864 INFO:teuthology.orchestra.run.smithi032.stdout: debug paxos = 20 2024-03-19T06:20:05.864 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-03-19T06:20:05.864 INFO:teuthology.orchestra.run.smithi032.stdout: mon data avail warn = 5 2024-03-19T06:20:05.864 INFO:teuthology.orchestra.run.smithi032.stdout: mon mgr mkfs grace = 240 2024-03-19T06:20:05.864 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-03-19T06:20:05.864 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd reporter subtree level = osd 2024-03-19T06:20:05.865 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd prime pg temp = true 2024-03-19T06:20:05.865 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-03-19T06:20:05.865 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.865 INFO:teuthology.orchestra.run.smithi032.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-19T06:20:05.865 INFO:teuthology.orchestra.run.smithi032.stdout: auth mon ticket ttl = 660 # 11m 2024-03-19T06:20:05.865 INFO:teuthology.orchestra.run.smithi032.stdout: auth service ticket ttl = 240 # 4m 2024-03-19T06:20:05.865 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.865 INFO:teuthology.orchestra.run.smithi032.stdout: # don't complain about insecure global_id in the test suite 2024-03-19T06:20:05.865 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-19T06:20:05.865 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-19T06:20:05.865 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.865 INFO:teuthology.orchestra.run.smithi032.stdout: # 1m isn't quite enough 2024-03-19T06:20:05.865 INFO:teuthology.orchestra.run.smithi032.stdout: mon_down_mkfs_grace = 2m 2024-03-19T06:20:05.865 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.865 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_filestore_osds = false 2024-03-19T06:20:05.865 INFO:teuthology.orchestra.run.smithi032.stdout: mon op complaint time = 120 2024-03-19T06:20:05.866 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:05.866 INFO:teuthology.orchestra.run.smithi032.stdout:[client] 2024-03-19T06:20:05.866 INFO:teuthology.orchestra.run.smithi032.stdout: rgw cache enabled = true 2024-03-19T06:20:05.866 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable ops log = true 2024-03-19T06:20:05.866 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable usage log = true 2024-03-19T06:20:05.866 INFO:teuthology.orchestra.run.smithi032.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-19T06:20:05.866 INFO:teuthology.orchestra.run.smithi032.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-19T06:20:05.866 INFO:teuthology.orchestra.run.smithi032.stdout: client mount timeout = 600 2024-03-19T06:20:05.866 INFO:teuthology.orchestra.run.smithi032.stdout: debug client = 20 2024-03-19T06:20:05.866 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-03-19T06:20:05.866 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = "" 2024-03-19T06:20:05.866 INFO:teuthology.orchestra.run.smithi032.stdout: rados mon op timeout = 900 2024-03-19T06:20:05.866 INFO:teuthology.orchestra.run.smithi032.stdout: rados osd op timeout = 900 2024-03-19T06:20:05.866 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.a] 2024-03-19T06:20:05.866 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.b] 2024-03-19T06:20:05.867 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.c] 2024-03-19T06:20:05.867 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2024-03-19T06:20:05.867 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.c] 2024-03-19T06:20:05.867 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.b] 2024-03-19T06:20:05.867 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.d] 2024-03-19T06:20:05.867 INFO:teuthology.orchestra.run.smithi032.stdout:[mds] 2024-03-19T06:20:05.867 INFO:teuthology.orchestra.run.smithi032.stdout: debug mds = 20 2024-03-19T06:20:05.867 INFO:teuthology.orchestra.run.smithi032.stdout: debug mds balancer = 20 2024-03-19T06:20:05.867 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-03-19T06:20:05.867 INFO:teuthology.orchestra.run.smithi032.stdout: mds debug frag = True 2024-03-19T06:20:05.867 INFO:teuthology.orchestra.run.smithi032.stdout: mds debug scatterstat = True 2024-03-19T06:20:05.867 INFO:teuthology.orchestra.run.smithi032.stdout: mds op complaint time = 180 2024-03-19T06:20:05.867 INFO:teuthology.orchestra.run.smithi032.stdout: mds verify scatter = True 2024-03-19T06:20:05.867 INFO:teuthology.orchestra.run.smithi032.stdout: osd op complaint time = 180 2024-03-19T06:20:05.867 INFO:teuthology.orchestra.run.smithi032.stdout: rados mon op timeout = 900 2024-03-19T06:20:05.867 INFO:teuthology.orchestra.run.smithi032.stdout: rados osd op timeout = 900 2024-03-19T06:20:05.868 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2024-03-19T06:20:05.868 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2024-03-19T06:20:05.868 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-19T06:20:05.868 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2024-03-19T06:20:05.868 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.868 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2024-03-19T06:20:05.868 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.868 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2024-03-19T06:20:05.868 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.868 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2024-03-19T06:20:05.869 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2024-03-19T06:20:05.869 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.869 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2024-03-19T06:20:05.869 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2024-03-19T06:20:05.869 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.869 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-19T06:20:05.869 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2024-03-19T06:20:05.869 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.869 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2024-03-19T06:20:05.869 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-19T06:20:05.869 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.869 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2024-03-19T06:20:05.869 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.869 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2024-03-19T06:20:05.869 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2024-03-19T06:20:05.869 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2024-03-19T06:20:05.870 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2024-03-19T06:20:05.870 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2024-03-19T06:20:05.870 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2024-03-19T06:20:05.870 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2024-03-19T06:20:05.870 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-19T06:20:05.870 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-19T06:20:05.870 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2024-03-19T06:20:05.870 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.870 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-19T06:20:05.870 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.870 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2024-03-19T06:20:05.870 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.870 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2024-03-19T06:20:05.870 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.871 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2024-03-19T06:20:05.871 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2024-03-19T06:20:05.871 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2024-03-19T06:20:05.871 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "172.21.15.32,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-03-19T06:20:05.871 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = 5b96820f-940f-489f-8b00-afd5c905fd95 2024-03-19T06:20:05.871 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.871 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2024-03-19T06:20:05.871 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2024-03-19T06:20:05.871 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.871 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2024-03-19T06:20:05.871 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2024-03-19T06:20:05.871 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock profile = high_recovery_ops 2024-03-19T06:20:05.871 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.871 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2024-03-19T06:20:05.871 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2024-03-19T06:20:05.871 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.872 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2024-03-19T06:20:05.872 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2024-03-19T06:20:05.872 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2024-03-19T06:20:05.872 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug trim objects = true 2024-03-19T06:20:05.872 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.872 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2024-03-19T06:20:05.872 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2024-03-19T06:20:05.872 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.872 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2024-03-19T06:20:05.872 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.872 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2024-03-19T06:20:05.872 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.872 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2024-03-19T06:20:05.872 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.872 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2024-03-19T06:20:05.873 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2024-03-19T06:20:05.873 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.873 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2024-03-19T06:20:05.873 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2024-03-19T06:20:05.873 INFO:teuthology.orchestra.run.smithi171.stdout: bdev async discard = True 2024-03-19T06:20:05.873 INFO:teuthology.orchestra.run.smithi171.stdout: bdev enable discard = True 2024-03-19T06:20:05.873 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore allocator = bitmap 2024-03-19T06:20:05.873 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2024-03-19T06:20:05.873 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2024-03-19T06:20:05.873 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 1/20 2024-03-19T06:20:05.873 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 1/20 2024-03-19T06:20:05.873 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-03-19T06:20:05.873 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2024-03-19T06:20:05.873 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 4/10 2024-03-19T06:20:05.873 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2024-03-19T06:20:05.874 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2024-03-19T06:20:05.874 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2024-03-19T06:20:05.874 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2024-03-19T06:20:05.874 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2024-03-19T06:20:05.874 INFO:teuthology.orchestra.run.smithi171.stdout: osd op complaint time = 180 2024-03-19T06:20:05.874 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.874 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2024-03-19T06:20:05.874 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-03-19T06:20:05.874 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2024-03-19T06:20:05.874 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-03-19T06:20:05.874 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-03-19T06:20:05.874 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-03-19T06:20:05.874 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-03-19T06:20:05.874 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2024-03-19T06:20:05.874 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.874 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2024-03-19T06:20:05.875 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-03-19T06:20:05.875 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-03-19T06:20:05.875 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2024-03-19T06:20:05.875 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-03-19T06:20:05.875 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2024-03-19T06:20:05.875 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2024-03-19T06:20:05.875 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-03-19T06:20:05.875 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2024-03-19T06:20:05.875 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2024-03-19T06:20:05.875 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-03-19T06:20:05.875 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.875 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-19T06:20:05.875 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2024-03-19T06:20:05.875 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2024-03-19T06:20:05.875 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.875 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2024-03-19T06:20:05.876 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-19T06:20:05.876 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-19T06:20:05.876 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.876 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2024-03-19T06:20:05.876 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2024-03-19T06:20:05.876 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.876 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2024-03-19T06:20:05.876 INFO:teuthology.orchestra.run.smithi171.stdout: mon op complaint time = 120 2024-03-19T06:20:05.876 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-03-19T06:20:05.876 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2024-03-19T06:20:05.876 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2024-03-19T06:20:05.876 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = true 2024-03-19T06:20:05.876 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2024-03-19T06:20:05.876 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-19T06:20:05.876 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-19T06:20:05.876 INFO:teuthology.orchestra.run.smithi171.stdout: client mount timeout = 600 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout: debug client = 20 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = "" 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout: rados mon op timeout = 900 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout: rados osd op timeout = 900 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout:[mds] 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout: debug mds = 20 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout: debug mds balancer = 20 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-03-19T06:20:05.877 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug frag = True 2024-03-19T06:20:05.878 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug scatterstat = True 2024-03-19T06:20:05.878 INFO:teuthology.orchestra.run.smithi171.stdout: mds op complaint time = 180 2024-03-19T06:20:05.878 INFO:teuthology.orchestra.run.smithi171.stdout: mds verify scatter = True 2024-03-19T06:20:05.878 INFO:teuthology.orchestra.run.smithi171.stdout: osd op complaint time = 180 2024-03-19T06:20:05.878 INFO:teuthology.orchestra.run.smithi171.stdout: rados mon op timeout = 900 2024-03-19T06:20:05.878 INFO:teuthology.orchestra.run.smithi171.stdout: rados osd op timeout = 900 2024-03-19T06:20:05.879 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-19T06:20:05.879 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-19T06:20:05.979 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-19T06:20:05.979 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:05.979 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-19T06:20:05.988 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:05.988 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-19T06:20:06.042 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:20:06.043 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:06.043 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-19T06:20:06.043 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-19T06:20:06.117 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:06.117 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:20:06.169 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:20:06.170 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:06.170 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-19T06:20:06.170 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-19T06:20:06.204 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:06.204 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:20:06.253 INFO:tasks.ceph:Setting up mon nodes... 2024-03-19T06:20:06.253 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-19T06:20:06.253 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-19T06:20:06.310 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-19T06:20:06.315 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-19T06:20:06.375 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-19T06:20:06.396 INFO:tasks.ceph:Setting up mds nodes... 2024-03-19T06:20:06.396 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-19T06:20:06.452 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-19T06:20:06.456 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-19T06:20:06.476 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-19T06:20:06.572 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-19T06:20:06.577 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-19T06:20:06.597 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-19T06:20:06.653 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-19T06:20:06.658 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-19T06:20:06.678 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-19T06:20:06.774 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-19T06:20:06.779 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-19T06:20:06.798 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-19T06:20:06.798 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-19T06:20:06.842 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-19T06:20:06.859 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-19T06:20:06.947 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-19T06:20:06.964 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-19T06:20:07.005 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-19T06:20:07.021 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-19T06:20:07.109 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-19T06:20:07.126 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-19T06:20:07.126 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-19T06:20:07.126 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-19T06:20:07.146 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-19T06:20:07.146 INFO:tasks.ceph:role: osd.0 2024-03-19T06:20:07.146 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:20:07.146 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-19T06:20:07.213 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-19T06:20:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-19T06:20:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-19T06:20:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-19T06:20:07.214 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-19T06:20:07.214 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-03-19T06:20:07.214 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-19T06:20:07.214 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-19T06:20:07.214 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-19T06:20:07.214 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-19T06:20:07.243 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-03-19T06:20:07.244 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-03-19T06:20:07.244 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-19T06:20:07.316 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-19T06:20:07.377 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-03-19T06:20:07.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:20:07.378 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-19T06:20:07.447 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-19T06:20:07.447 INFO:tasks.ceph:role: osd.1 2024-03-19T06:20:07.447 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:20:07.447 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-19T06:20:07.508 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-19T06:20:07.508 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-19T06:20:07.508 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-19T06:20:07.508 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-19T06:20:07.508 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-19T06:20:07.508 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-03-19T06:20:07.509 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-19T06:20:07.509 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-19T06:20:07.509 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-19T06:20:07.509 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-19T06:20:07.532 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-03-19T06:20:07.535 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-03-19T06:20:07.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-19T06:20:07.606 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-19T06:20:07.670 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-03-19T06:20:07.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:20:07.671 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-19T06:20:07.733 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-19T06:20:07.733 INFO:tasks.ceph:role: osd.2 2024-03-19T06:20:07.733 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:20:07.733 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-19T06:20:07.792 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-19T06:20:07.792 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-19T06:20:07.793 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-19T06:20:07.793 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-19T06:20:07.793 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-19T06:20:07.793 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-03-19T06:20:07.793 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-19T06:20:07.793 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-19T06:20:07.793 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-19T06:20:07.793 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-19T06:20:07.817 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-03-19T06:20:07.820 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-03-19T06:20:07.820 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-19T06:20:07.886 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-19T06:20:07.945 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-03-19T06:20:07.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:20:07.946 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-19T06:20:08.009 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-19T06:20:08.009 INFO:tasks.ceph:role: osd.3 2024-03-19T06:20:08.009 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:20:08.009 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-19T06:20:08.068 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-19T06:20:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-19T06:20:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-19T06:20:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-19T06:20:08.069 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-19T06:20:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-03-19T06:20:08.069 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-19T06:20:08.069 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-19T06:20:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-19T06:20:08.069 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-19T06:20:08.093 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-03-19T06:20:08.096 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-03-19T06:20:08.096 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-19T06:20:08.161 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-19T06:20:08.221 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-03-19T06:20:08.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:20:08.222 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:20:08.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:08.379+0000 7fe534c937c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-19T06:20:08.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:08.379+0000 7fe534c937c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-19T06:20:08.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:08.379+0000 7fe534c937c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-19T06:20:08.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:08.379+0000 7fe534c937c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-19T06:20:08.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:08.379+0000 7fe534c937c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-19T06:20:08.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:08.383+0000 7fe534c937c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-19T06:20:11.342 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-19T06:20:11.364 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:20:11.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:11.475+0000 7f140c7b67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-19T06:20:11.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:11.475+0000 7f140c7b67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-19T06:20:11.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:11.475+0000 7f140c7b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-19T06:20:11.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:11.475+0000 7f140c7b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-19T06:20:11.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:11.475+0000 7f140c7b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-19T06:20:11.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:11.479+0000 7f140c7b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-19T06:20:14.434 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-19T06:20:14.456 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:20:14.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:14.563+0000 7fbe47fa47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-19T06:20:14.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:14.563+0000 7fbe47fa47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-19T06:20:14.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:14.563+0000 7fbe47fa47c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-19T06:20:14.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:14.563+0000 7fbe47fa47c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-19T06:20:14.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:14.563+0000 7fbe47fa47c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-19T06:20:14.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:14.563+0000 7fbe47fa47c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-19T06:20:17.529 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-19T06:20:17.551 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:20:17.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:17.663+0000 7fa2c12b67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-19T06:20:17.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:17.663+0000 7fa2c12b67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-19T06:20:17.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:17.663+0000 7fa2c12b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-19T06:20:17.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:17.663+0000 7fa2c12b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-19T06:20:17.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:17.663+0000 7fa2c12b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-19T06:20:17.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:17.667+0000 7fa2c12b67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-19T06:20:20.653 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-19T06:20:20.675 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-19T06:20:20.696 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-19T06:20:20.696 INFO:tasks.ceph:role: osd.4 2024-03-19T06:20:20.696 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:20:20.696 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-19T06:20:20.764 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-19T06:20:20.765 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-19T06:20:20.765 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-19T06:20:20.765 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-19T06:20:20.765 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-19T06:20:20.765 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-03-19T06:20:20.765 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-19T06:20:20.765 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-19T06:20:20.765 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-19T06:20:20.765 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-19T06:20:21.222 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-03-19T06:20:21.225 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-03-19T06:20:21.225 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-19T06:20:21.340 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-19T06:20:21.357 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: /sbin/restorecon: command not found 2024-03-19T06:20:21.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:20:21.358 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-19T06:20:21.420 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-19T06:20:21.421 INFO:tasks.ceph:role: osd.5 2024-03-19T06:20:21.421 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:20:21.421 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-19T06:20:21.493 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-19T06:20:21.493 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-19T06:20:21.493 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-19T06:20:21.494 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-19T06:20:21.494 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-19T06:20:21.494 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-03-19T06:20:21.494 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-19T06:20:21.494 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-19T06:20:21.494 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-19T06:20:21.494 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-19T06:20:21.983 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-03-19T06:20:21.986 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-03-19T06:20:21.987 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-19T06:20:22.143 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-19T06:20:22.162 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: /sbin/restorecon: command not found 2024-03-19T06:20:22.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:20:22.163 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-19T06:20:22.229 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-19T06:20:22.229 INFO:tasks.ceph:role: osd.6 2024-03-19T06:20:22.229 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:20:22.229 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-19T06:20:22.300 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-19T06:20:22.300 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-19T06:20:22.301 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-19T06:20:22.301 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-19T06:20:22.301 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-19T06:20:22.301 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-03-19T06:20:22.301 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-19T06:20:22.301 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-19T06:20:22.301 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-19T06:20:22.301 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-19T06:20:22.782 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-03-19T06:20:22.785 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-03-19T06:20:22.785 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-19T06:20:22.906 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-19T06:20:22.922 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: /sbin/restorecon: command not found 2024-03-19T06:20:22.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:20:22.923 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-19T06:20:22.984 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-19T06:20:22.984 INFO:tasks.ceph:role: osd.7 2024-03-19T06:20:22.985 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:20:22.985 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-19T06:20:23.056 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-19T06:20:23.056 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-19T06:20:23.056 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-19T06:20:23.056 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-19T06:20:23.057 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-19T06:20:23.057 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-03-19T06:20:23.057 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-19T06:20:23.057 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-19T06:20:23.057 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-19T06:20:23.057 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-19T06:20:23.503 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-03-19T06:20:23.506 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-03-19T06:20:23.506 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-19T06:20:23.619 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-19T06:20:23.636 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: /sbin/restorecon: command not found 2024-03-19T06:20:23.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:20:23.637 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:20:23.771 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:23.780+0000 7f819cb3c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-19T06:20:23.776 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:23.784+0000 7f819cb3c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-19T06:20:23.776 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:23.784+0000 7f819cb3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-19T06:20:23.776 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:23.784+0000 7f819cb3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-19T06:20:23.776 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:23.784+0000 7f819cb3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-19T06:20:23.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:23.788+0000 7f819cb3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-19T06:20:26.743 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-19T06:20:26.763 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:20:26.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:26.868+0000 7f01ddb9d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-19T06:20:26.859 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:26.868+0000 7f01ddb9d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-19T06:20:26.859 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:26.868+0000 7f01ddb9d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-19T06:20:26.859 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:26.868+0000 7f01ddb9d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-19T06:20:26.859 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:26.868+0000 7f01ddb9d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-19T06:20:26.861 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:26.868+0000 7f01ddb9d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-19T06:20:29.832 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-19T06:20:29.852 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:20:29.943 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:29.952+0000 7fb2571967c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-19T06:20:29.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:29.952+0000 7fb2571967c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-19T06:20:29.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:29.952+0000 7fb2571967c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-19T06:20:29.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:29.952+0000 7fb2571967c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-19T06:20:29.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:29.952+0000 7fb2571967c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-19T06:20:29.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:29.956+0000 7fb2571967c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-19T06:20:32.943 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-19T06:20:32.963 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:20:33.061 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:33.072+0000 7f57863057c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-19T06:20:33.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:33.072+0000 7f57863057c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-19T06:20:33.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:33.072+0000 7f57863057c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-19T06:20:33.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:33.072+0000 7f57863057c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-19T06:20:33.062 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:33.072+0000 7f57863057c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-19T06:20:33.064 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:33.072+0000 7f57863057c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-19T06:20:34.002 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:20:34.006 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:20:36.047 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-19T06:20:36.067 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-19T06:20:36.068 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:36.068 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-19T06:20:36.090 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:36.090 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-19T06:20:36.151 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:36.151 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-19T06:20:36.216 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:36.216 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-19T06:20:36.279 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:36.279 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-19T06:20:36.343 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:36.343 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-19T06:20:36.407 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:36.407 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-19T06:20:36.471 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:36.471 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-19T06:20:36.493 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:36.493 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-19T06:20:36.557 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:36.557 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-19T06:20:36.621 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:36.621 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-19T06:20:36.689 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:36.689 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-19T06:20:36.753 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:36.753 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-19T06:20:36.821 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:36.821 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-19T06:20:36.885 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:36.885 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-19T06:20:36.894 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:36.895 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-19T06:20:36.947 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:36.947 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-19T06:20:36.956 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:36.956 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-19T06:20:37.004 INFO:tasks.ceph:Adding keys to all mons... 2024-03-19T06:20:37.005 DEBUG:teuthology.orchestra.run.smithi032:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-19T06:20:37.009 DEBUG:teuthology.orchestra.run.smithi171:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-19T06:20:37.052 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.y] 2024-03-19T06:20:37.052 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCWLvllS0JQExAA9gZOkTMS3zZfd6B3JtfXNw== 2024-03-19T06:20:37.052 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2024-03-19T06:20:37.052 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCWLvlljLvFGxAAlds2Mvwa4/hC2skBcC2ceA== 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.c] 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCWLvllWfL0IhAAbekYB7Oxo0Mkvhr9MfnTlQ== 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.0] 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCYLvllx+jFFhAAnkaZb1RSqgc++W4yccQSwQ== 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.1] 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCbLvllpaOLHBAAUrnlxbToEpaUGPK64IPpcw== 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.2] 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCeLvllF3C8IRAAdroKWih6nFV1qSYCoB/lmw== 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.3] 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQChLvllvtbDJxAArLL+/yemOLsey+PM9dkWRg== 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.x] 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCWLvlluVExFxAAtRoYgLHd1QZXDoHoE7hcGQ== 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.b] 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCWLvllqALDJxAAfoy/TWEOQH79VM3rc4wOJA== 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.d] 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCWLvll/Ij7LhAA6Kje3GNOhtsqVtw2XxnzbA== 2024-03-19T06:20:37.053 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.4] 2024-03-19T06:20:37.054 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCnLvllKeTFLhAA9mcJnZWoF4dg9uAiVbNCvQ== 2024-03-19T06:20:37.054 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.5] 2024-03-19T06:20:37.054 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCqLvllMLEDNBAAOS5umMhq4ko7Xaq3EPfbGA== 2024-03-19T06:20:37.054 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.6] 2024-03-19T06:20:37.054 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCtLvllAMULORAAkXGAk1fzYoe3aLCX3X7X/Q== 2024-03-19T06:20:37.054 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.7] 2024-03-19T06:20:37.054 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCxLvllXLiCBBAAhLxVcFjGUC/9oUgvZeEhvA== 2024-03-19T06:20:37.054 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-03-19T06:20:37.054 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCWLvll4jsFMxAAr4PzH6Djodh2O01vGYgxKA== 2024-03-19T06:20:37.054 INFO:teuthology.orchestra.run.smithi032.stdout:[client.2] 2024-03-19T06:20:37.054 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCWLvllYZFNORAALY1J92J5+349+Qeis5e7qA== 2024-03-19T06:20:37.054 INFO:teuthology.orchestra.run.smithi032.stdout:[client.1] 2024-03-19T06:20:37.054 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCXLvll7wIgARAAaX65ntzvAhcJTgqzb0y1Ew== 2024-03-19T06:20:37.054 INFO:teuthology.orchestra.run.smithi032.stdout:[client.3] 2024-03-19T06:20:37.055 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCXLvllT1RXBxAAI6mJ94oohPbKmh4ItjkrBQ== 2024-03-19T06:20:37.068 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.y] 2024-03-19T06:20:37.068 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCWLvllS0JQExAA9gZOkTMS3zZfd6B3JtfXNw== 2024-03-19T06:20:37.068 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2024-03-19T06:20:37.068 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCWLvlljLvFGxAAlds2Mvwa4/hC2skBcC2ceA== 2024-03-19T06:20:37.068 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2024-03-19T06:20:37.068 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCWLvllWfL0IhAAbekYB7Oxo0Mkvhr9MfnTlQ== 2024-03-19T06:20:37.068 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.0] 2024-03-19T06:20:37.068 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCYLvllx+jFFhAAnkaZb1RSqgc++W4yccQSwQ== 2024-03-19T06:20:37.068 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.1] 2024-03-19T06:20:37.068 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCbLvllpaOLHBAAUrnlxbToEpaUGPK64IPpcw== 2024-03-19T06:20:37.068 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.2] 2024-03-19T06:20:37.069 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCeLvllF3C8IRAAdroKWih6nFV1qSYCoB/lmw== 2024-03-19T06:20:37.069 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.3] 2024-03-19T06:20:37.069 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQChLvllvtbDJxAArLL+/yemOLsey+PM9dkWRg== 2024-03-19T06:20:37.069 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.x] 2024-03-19T06:20:37.069 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCWLvlluVExFxAAtRoYgLHd1QZXDoHoE7hcGQ== 2024-03-19T06:20:37.069 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2024-03-19T06:20:37.069 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCWLvllqALDJxAAfoy/TWEOQH79VM3rc4wOJA== 2024-03-19T06:20:37.069 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2024-03-19T06:20:37.069 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCWLvll/Ij7LhAA6Kje3GNOhtsqVtw2XxnzbA== 2024-03-19T06:20:37.069 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.4] 2024-03-19T06:20:37.069 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCnLvllKeTFLhAA9mcJnZWoF4dg9uAiVbNCvQ== 2024-03-19T06:20:37.069 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.5] 2024-03-19T06:20:37.069 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCqLvllMLEDNBAAOS5umMhq4ko7Xaq3EPfbGA== 2024-03-19T06:20:37.069 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.6] 2024-03-19T06:20:37.069 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCtLvllAMULORAAkXGAk1fzYoe3aLCX3X7X/Q== 2024-03-19T06:20:37.069 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.7] 2024-03-19T06:20:37.070 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCxLvllXLiCBBAAhLxVcFjGUC/9oUgvZeEhvA== 2024-03-19T06:20:37.070 INFO:teuthology.orchestra.run.smithi171.stdout:[client.0] 2024-03-19T06:20:37.070 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCWLvll4jsFMxAAr4PzH6Djodh2O01vGYgxKA== 2024-03-19T06:20:37.070 INFO:teuthology.orchestra.run.smithi171.stdout:[client.2] 2024-03-19T06:20:37.070 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCWLvllYZFNORAALY1J92J5+349+Qeis5e7qA== 2024-03-19T06:20:37.070 INFO:teuthology.orchestra.run.smithi171.stdout:[client.1] 2024-03-19T06:20:37.070 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCXLvll7wIgARAAaX65ntzvAhcJTgqzb0y1Ew== 2024-03-19T06:20:37.070 INFO:teuthology.orchestra.run.smithi171.stdout:[client.3] 2024-03-19T06:20:37.070 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCXLvllT1RXBxAAI6mJ94oohPbKmh4ItjkrBQ== 2024-03-19T06:20:37.071 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-19T06:20:37.105 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-19T06:20:37.168 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:20:37.172 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:20:37.231 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:20:37.234 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:20:37.292 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:20:37.295 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:20:37.348 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:20:37.352 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:20:37.406 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:20:37.409 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:20:37.462 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:20:37.466 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:20:37.520 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-19T06:20:37.523 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-19T06:20:37.576 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:20:37.580 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:20:37.636 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:20:37.639 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:20:37.695 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:20:37.698 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:20:37.751 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:20:37.755 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:20:37.808 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:20:37.811 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:20:37.864 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:20:37.867 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:20:37.919 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-19T06:20:37.923 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-19T06:20:37.979 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-19T06:20:37.982 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-19T06:20:38.038 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-19T06:20:38.041 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-19T06:20:38.097 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-19T06:20:38.100 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-19T06:20:38.158 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-19T06:20:38.158 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-19T06:20:38.178 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-19T06:20:38.284 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-19T06:20:38.306 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-19T06:20:38.326 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-19T06:20:38.436 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-19T06:20:38.455 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-19T06:20:38.516 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-19T06:20:38.622 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-19T06:20:38.642 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:20:38.644 DEBUG:teuthology.orchestra.run.smithi171:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:20:38.691 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-19T06:20:38.692 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-19T06:20:38.692 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-19T06:20:38.695 INFO:tasks.ceph.mon.a:Started 2024-03-19T06:20:38.695 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-19T06:20:38.696 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-19T06:20:38.735 INFO:tasks.ceph.mon.b:Started 2024-03-19T06:20:38.735 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-19T06:20:38.735 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-19T06:20:38.739 INFO:tasks.ceph.mon.c:Started 2024-03-19T06:20:38.739 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-19T06:20:38.739 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-19T06:20:38.739 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-19T06:20:38.743 INFO:tasks.ceph.mgr.y:Started 2024-03-19T06:20:38.743 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-19T06:20:38.744 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-19T06:20:38.746 INFO:tasks.ceph.mgr.x:Started 2024-03-19T06:20:38.747 INFO:tasks.ceph:Setting crush tunables to default 2024-03-19T06:20:38.747 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd crush tunables default 2024-03-19T06:20:38.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.897+0000 7f91a7000640 1 Processor -- start 2024-03-19T06:20:38.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.897+0000 7f91a7000640 1 -- start start 2024-03-19T06:20:38.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.897+0000 7f91a7000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 0x7f91a006c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.897+0000 7f91a7000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 0x7f91a00b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.897+0000 7f91a7000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 0x7f91a00d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.897+0000 7f91a7000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a00b3fb0 con 0x7f91a00b3b60 2024-03-19T06:20:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.897+0000 7f91a7000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a00cbf00 con 0x7f91a006c5a0 2024-03-19T06:20:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.897+0000 7f91a7000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a006cb20 con 0x7f91a015dbb0 2024-03-19T06:20:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.897+0000 7f91a5000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 0x7f91a00d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.897+0000 7f91a5000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 0x7f91a00d1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36392/0 (socket says 172.21.15.32:36392) 2024-03-19T06:20:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.897+0000 7f91a5000640 1 -- 172.21.15.32:0/3474919630 learned_addr learned my addr 172.21.15.32:0/3474919630 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:20:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.897+0000 7f919fe00640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 0x7f91a006c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.901+0000 7f91a5000640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 msgr2=0x7f91a00d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-19T06:20:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.901+0000 7f91a5000640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 msgr2=0x7f91a00d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:20:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.901+0000 7f91a5000640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 0x7f91a00d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:20:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.901+0000 7f919fe00640 1 -- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 msgr2=0x7f91a006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-19T06:20:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.901+0000 7f919fe00640 1 -- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 msgr2=0x7f91a006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:20:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.901+0000 7f919fe00640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 0x7f91a006c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:20:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.901+0000 7f919fe00640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 0x7f91a006c060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T06:20:38.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.901+0000 7f91a5000640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 0x7f91a00d1740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T06:20:38.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.901+0000 7f9197400640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 0x7f91a00b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:38.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.901+0000 7f9197400640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 msgr2=0x7f91a00b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-19T06:20:38.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.901+0000 7f9197400640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 msgr2=0x7f91a00b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:20:38.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.901+0000 7f9197400640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 0x7f91a00b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:20:38.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:38.901+0000 7f9197400640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 0x7f91a00b3620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T06:20:39.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.105+0000 7f91a5000640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 0x7f91a00d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.105+0000 7f91a5000640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 msgr2=0x7f91a00d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-19T06:20:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.105+0000 7f91a5000640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 msgr2=0x7f91a00d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:20:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.105+0000 7f9197400640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 0x7f91a00b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.105+0000 7f91a5000640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 0x7f91a00d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:20:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.105+0000 7f919fe00640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 0x7f91a006c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.105+0000 7f91a5000640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 0x7f91a00d1740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T06:20:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.105+0000 7f9197400640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 msgr2=0x7f91a00b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-19T06:20:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.105+0000 7f9197400640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 msgr2=0x7f91a00b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:20:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.105+0000 7f9197400640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 0x7f91a00b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:20:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.105+0000 7f919fe00640 1 -- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 msgr2=0x7f91a006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-19T06:20:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.105+0000 7f919fe00640 1 -- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 msgr2=0x7f91a006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:20:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.105+0000 7f919fe00640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 0x7f91a006c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:20:39.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.105+0000 7f9197400640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 0x7f91a00b3620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T06:20:39.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.105+0000 7f919fe00640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 0x7f91a006c060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T06:20:39.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.509+0000 7f91a5000640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 0x7f91a00d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:39.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.509+0000 7f91a5000640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 msgr2=0x7f91a00d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-19T06:20:39.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.509+0000 7f919fe00640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 0x7f91a006c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:39.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.509+0000 7f91a5000640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 msgr2=0x7f91a00d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:20:39.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.509+0000 7f9197400640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 0x7f91a00b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:39.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.509+0000 7f91a5000640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 0x7f91a00d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:20:39.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.509+0000 7f91a5000640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 0x7f91a00d1740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-19T06:20:39.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.509+0000 7f919fe00640 1 -- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 msgr2=0x7f91a006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-19T06:20:39.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.509+0000 7f919fe00640 1 -- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 msgr2=0x7f91a006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:20:39.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.509+0000 7f919fe00640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 0x7f91a006c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:20:39.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.509+0000 7f9197400640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 msgr2=0x7f91a00b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-19T06:20:39.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.509+0000 7f9197400640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 msgr2=0x7f91a00b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:20:39.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.509+0000 7f9197400640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 0x7f91a00b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:20:39.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.509+0000 7f9197400640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 0x7f91a00b3620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-19T06:20:39.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:39.509+0000 7f919fe00640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 0x7f91a006c060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-19T06:20:40.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:40.313+0000 7f91a5000640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 0x7f91a00d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:40.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:40.313+0000 7f9197400640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 0x7f91a00b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:40.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:40.313+0000 7f919fe00640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 0x7f91a006c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:40.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:40.313+0000 7f91a5000640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 msgr2=0x7f91a00d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-19T06:20:40.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:40.313+0000 7f91a5000640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 msgr2=0x7f91a00d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:20:40.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:40.313+0000 7f91a5000640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 0x7f91a00d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:20:40.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:40.313+0000 7f91a5000640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 0x7f91a00d1740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-19T06:20:40.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:40.313+0000 7f9197400640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 msgr2=0x7f91a00b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-19T06:20:40.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:40.313+0000 7f9197400640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 msgr2=0x7f91a00b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:20:40.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:40.313+0000 7f9197400640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 0x7f91a00b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:20:40.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:40.313+0000 7f9197400640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 0x7f91a00b3620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-19T06:20:40.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:40.313+0000 7f919fe00640 1 -- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 msgr2=0x7f91a006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-19T06:20:40.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:40.313+0000 7f919fe00640 1 -- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 msgr2=0x7f91a006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:20:40.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:40.313+0000 7f919fe00640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 0x7f91a006c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:20:40.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:40.313+0000 7f919fe00640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 0x7f91a006c060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-19T06:20:41.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:41.897+0000 7f919e000640 1 -- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 msgr2=0x7f91a006c060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:20:41.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:41.897+0000 7f919e000640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91a015dbb0 0x7f91a006c060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:41.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:41.897+0000 7f919e000640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 msgr2=0x7f91a00b3620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:20:41.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:41.897+0000 7f919e000640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.171:3300/0 conn(0x7f91a006c5a0 0x7f91a00b3620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:41.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:41.897+0000 7f919e000640 1 -- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 msgr2=0x7f91a00d1740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:20:41.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:41.897+0000 7f919e000640 1 --2- 172.21.15.32:0/3474919630 >> v2:172.21.15.32:3300/0 conn(0x7f91a00b3b60 0x7f91a00d1740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:41.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:41.897+0000 7f919e000640 1 -- 172.21.15.32:0/3474919630 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a006ce00 con 0x7f91840073a0 2024-03-19T06:20:41.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:41.897+0000 7f919e000640 1 -- 172.21.15.32:0/3474919630 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918400c110 con 0x7f91840036a0 2024-03-19T06:20:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f919f400640 1 -- 172.21.15.32:0/3474919630 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807479265 0 0) 0x7f918400c110 con 0x7f91840036a0 2024-03-19T06:20:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f919f400640 1 -- 172.21.15.32:0/3474919630 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f917c003530 con 0x7f91840036a0 2024-03-19T06:20:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f919f400640 1 -- 172.21.15.32:0/3474919630 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225619919 0 0) 0x7f91a006ce00 con 0x7f91840073a0 2024-03-19T06:20:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f919f400640 1 -- 172.21.15.32:0/3474919630 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f918400c110 con 0x7f91840073a0 2024-03-19T06:20:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f919f400640 1 -- 172.21.15.32:0/3474919630 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2729168544 0 0) 0x7f918400c110 con 0x7f91840073a0 2024-03-19T06:20:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f919f400640 1 -- 172.21.15.32:0/3474919630 >> v1:172.21.15.171:6789/0 conn(0x7f91840036a0 legacy=0x7f9184005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f919f400640 1 -- 172.21.15.32:0/3474919630 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918400d350 con 0x7f91840073a0 2024-03-19T06:20:44.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f919f400640 1 -- 172.21.15.32:0/3474919630 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f918800f040 con 0x7f91840073a0 2024-03-19T06:20:44.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f919f400640 1 -- 172.21.15.32:0/3474919630 >> v1:172.21.15.32:6789/0 conn(0x7f91840073a0 legacy=0x7f9184009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:44.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f91a5000640 1 -- 172.21.15.32:0/3474919630 reap_dead start 2024-03-19T06:20:44.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f919f400640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f917c003bd0 0x7f917c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:44.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f919f400640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f917c004810 0x7f917c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:44.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f919f400640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f917c0099c0 0x7f917c00bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:44.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f919f400640 1 -- 172.21.15.32:0/3474919630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c00c320 con 0x7f917c004810 2024-03-19T06:20:44.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f919f400640 1 -- 172.21.15.32:0/3474919630 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c00c4d0 con 0x7f917c003bd0 2024-03-19T06:20:44.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f919f400640 1 -- 172.21.15.32:0/3474919630 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c00c6d0 con 0x7f917c0099c0 2024-03-19T06:20:44.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f9197400640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f917c004810 0x7f917c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:44.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f919fe00640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f917c003bd0 0x7f917c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:44.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f9197400640 1 -- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f917c0099c0 msgr2=0x7f917c00bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:20:44.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f9197400640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f917c0099c0 0x7f917c00bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f9197400640 1 -- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f917c003bd0 msgr2=0x7f917c003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:20:44.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f9197400640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f917c003bd0 0x7f917c003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.049+0000 7f9197400640 1 -- 172.21.15.32:0/3474919630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918400c110 con 0x7f917c004810 2024-03-19T06:20:44.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.053+0000 7f9197400640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f917c004810 0x7f917c004c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9188000ee0 tx=0x7f918801d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d46243dfaff848 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:44.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.053+0000 7f919f400640 1 -- 172.21.15.32:0/3474919630 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880ac070 con 0x7f917c004810 2024-03-19T06:20:44.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.053+0000 7f919f400640 1 -- 172.21.15.32:0/3474919630 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91880a6720 con 0x7f917c004810 2024-03-19T06:20:44.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.053+0000 7f919f400640 1 -- 172.21.15.32:0/3474919630 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918800ec90 con 0x7f917c004810 2024-03-19T06:20:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.053+0000 7f91a7000640 1 -- 172.21.15.32:0/3474919630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f917c004810 msgr2=0x7f917c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.053+0000 7f91a7000640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f917c004810 0x7f917c004c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9188000ee0 tx=0x7f918801d870 comp rx=0 tx=0).stop 2024-03-19T06:20:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.053+0000 7f91a7000640 1 -- 172.21.15.32:0/3474919630 shutdown_connections 2024-03-19T06:20:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.053+0000 7f91a7000640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f917c0099c0 0x7f917c00bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.053+0000 7f91a7000640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f917c004810 0x7f917c004c90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.053+0000 7f91a7000640 1 --2- 172.21.15.32:0/3474919630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f917c003bd0 0x7f917c003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.053+0000 7f91a7000640 1 -- 172.21.15.32:0/3474919630 >> 172.21.15.32:0/3474919630 conn(0x7f91a0066ca0 msgr2=0x7f91a00670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.053+0000 7f91a7000640 1 -- 172.21.15.32:0/3474919630 shutdown_connections 2024-03-19T06:20:44.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.053+0000 7f91a7000640 1 -- 172.21.15.32:0/3474919630 wait complete. 2024-03-19T06:20:44.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f91a7000640 1 Processor -- start 2024-03-19T06:20:44.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f91a7000640 1 -- start start 2024-03-19T06:20:44.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f91a7000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f917c003bd0 0x7f91a00cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:44.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f91a7000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f917c004810 0x7f91a014e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:44.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f91a7000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f917c0099c0 0x7f91a014eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:44.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f91a7000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a006d910 con 0x7f917c0099c0 2024-03-19T06:20:44.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f91a7000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a00cc1a0 con 0x7f917c004810 2024-03-19T06:20:44.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f91a7000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a015df90 con 0x7f917c003bd0 2024-03-19T06:20:44.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f91a5000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f917c0099c0 0x7f91a014eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:44.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f919fe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f917c003bd0 0x7f91a00cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:44.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f9197400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f917c004810 0x7f91a014e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:44.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f91a5000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f917c0099c0 0x7f91a014eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38942/0 (socket says 172.21.15.32:38942) 2024-03-19T06:20:44.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f91a5000640 1 -- 172.21.15.32:0/775627468 learned_addr learned my addr 172.21.15.32:0/775627468 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:20:44.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f91a5000640 1 -- 172.21.15.32:0/775627468 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f917c003bd0 msgr2=0x7f91a00cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:44.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f91a5000640 1 --2- 172.21.15.32:0/775627468 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f917c003bd0 0x7f91a00cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f91a5000640 1 -- 172.21.15.32:0/775627468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f917c004810 msgr2=0x7f91a014e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:44.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.057+0000 7f91a5000640 1 --2- 172.21.15.32:0/775627468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f917c004810 0x7f91a014e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.061+0000 7f91a5000640 1 -- 172.21.15.32:0/775627468 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a00c54d0 con 0x7f917c0099c0 2024-03-19T06:20:44.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.061+0000 7f91a5000640 1 --2- 172.21.15.32:0/775627468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f917c0099c0 0x7f91a014eda0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9184007280 tx=0x7f9198013d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:44.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.061+0000 7f919cc00640 1 -- 172.21.15.32:0/775627468 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919801e070 con 0x7f917c0099c0 2024-03-19T06:20:44.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.061+0000 7f919cc00640 1 -- 172.21.15.32:0/775627468 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9198007930 con 0x7f917c0099c0 2024-03-19T06:20:44.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.061+0000 7f91a7000640 1 -- 172.21.15.32:0/775627468 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a00c5770 con 0x7f917c0099c0 2024-03-19T06:20:44.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.061+0000 7f919cc00640 1 -- 172.21.15.32:0/775627468 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198007d00 con 0x7f917c0099c0 2024-03-19T06:20:44.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.061+0000 7f91a7000640 1 -- 172.21.15.32:0/775627468 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a00c5d30 con 0x7f917c0099c0 2024-03-19T06:20:44.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.061+0000 7f919cc00640 1 -- 172.21.15.32:0/775627468 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f9198015040 con 0x7f917c0099c0 2024-03-19T06:20:44.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.061+0000 7f919cc00640 1 -- 172.21.15.32:0/775627468 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9198022520 con 0x7f917c0099c0 2024-03-19T06:20:44.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.061+0000 7f91a7000640 1 -- 172.21.15.32:0/775627468 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a00749e0 con 0x7f917c0099c0 2024-03-19T06:20:44.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.073+0000 7f919cc00640 1 -- 172.21.15.32:0/775627468 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9198027020 con 0x7f917c0099c0 2024-03-19T06:20:44.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.137+0000 7f91a7000640 1 -- 172.21.15.32:0/775627468 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f91a00d16d0 con 0x7f917c0099c0 2024-03-19T06:20:44.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.141+0000 7f919cc00640 1 -- 172.21.15.32:0/775627468 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9198022720 con 0x7f917c0099c0 2024-03-19T06:20:44.133 INFO:teuthology.orchestra.run.smithi032.stderr:adjusted tunables profile to default 2024-03-19T06:20:44.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.141+0000 7f91a7000640 1 -- 172.21.15.32:0/775627468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f917c0099c0 msgr2=0x7f91a014eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:44.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.141+0000 7f91a7000640 1 --2- 172.21.15.32:0/775627468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f917c0099c0 0x7f91a014eda0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9184007280 tx=0x7f9198013d50 comp rx=0 tx=0).stop 2024-03-19T06:20:44.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.141+0000 7f91a7000640 1 -- 172.21.15.32:0/775627468 shutdown_connections 2024-03-19T06:20:44.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.141+0000 7f91a7000640 1 --2- 172.21.15.32:0/775627468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f917c0099c0 0x7f91a014eda0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.141+0000 7f91a7000640 1 --2- 172.21.15.32:0/775627468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f917c004810 0x7f91a014e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.141+0000 7f91a7000640 1 --2- 172.21.15.32:0/775627468 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f917c003bd0 0x7f91a00cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.141+0000 7f91a7000640 1 -- 172.21.15.32:0/775627468 >> 172.21.15.32:0/775627468 conn(0x7f91a0066ca0 msgr2=0x7f91a00b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:44.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.141+0000 7f91a7000640 1 -- 172.21.15.32:0/775627468 shutdown_connections 2024-03-19T06:20:44.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:44.141+0000 7f91a7000640 1 -- 172.21.15.32:0/775627468 wait complete. 2024-03-19T06:20:44.153 INFO:tasks.ceph:check_enable_crimson: False 2024-03-19T06:20:44.153 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-19T06:20:44.154 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:44.154 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-19T06:20:44.174 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:44.174 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-19T06:20:44.233 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:44.233 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-19T06:20:44.293 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:20:44.293 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-19T06:20:44.357 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:44.357 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-19T06:20:44.380 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:44.380 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-19T06:20:44.445 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:44.445 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-19T06:20:44.512 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:20:44.512 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-19T06:20:44.576 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 3474385b-fff3-4c03-ab2f-b478e54f93ee 0 2024-03-19T06:20:44.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.768+0000 7fe7e6400640 1 Processor -- start 2024-03-19T06:20:44.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.768+0000 7fe7e6400640 1 -- start start 2024-03-19T06:20:44.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.768+0000 7fe7e6400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e006b450 0x7fe7e006f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:44.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.768+0000 7fe7e6400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e00af2d0 con 0x7fe7e00aea70 2024-03-19T06:20:44.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.768+0000 7fe7e6400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e015eea0 con 0x7fe7e015a840 2024-03-19T06:20:44.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.768+0000 7fe7e6400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e00cdc20 con 0x7fe7e006b450 2024-03-19T06:20:44.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.768+0000 7fe7dea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e006b450 0x7fe7e006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:44.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.768+0000 7fe7df400640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fe7e015a840 0x7fe7e006ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:42948/0 (socket says 172.21.15.171:42948) 2024-03-19T06:20:44.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.768+0000 7fe7df400640 1 -- 172.21.15.171:0/2514878799 learned_addr learned my addr 172.21.15.171:0/2514878799 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-03-19T06:20:44.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.768+0000 7fe7dea00640 1 -- 172.21.15.171:0/2514878799 >> v1:172.21.15.171:6789/0 conn(0x7fe7e015a840 legacy=0x7fe7e006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:44.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.768+0000 7fe7dea00640 1 -- 172.21.15.171:0/2514878799 >> v1:172.21.15.32:6789/0 conn(0x7fe7e00aea70 legacy=0x7fe7e00ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:20:44.761 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.768+0000 7fe7dea00640 1 -- 172.21.15.171:0/2514878799 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e015f180 con 0x7fe7e006b450 2024-03-19T06:20:44.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.772+0000 7fe7dea00640 1 --2- 172.21.15.171:0/2514878799 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e006b450 0x7fe7e006f040 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0097f0 tx=0x7fe7cc01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15d6214262eafcc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:44.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.772+0000 7fe7de000640 1 -- 172.21.15.171:0/2514878799 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc0b1070 con 0x7fe7e006b450 2024-03-19T06:20:44.764 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.772+0000 7fe7de000640 1 -- 172.21.15.171:0/2514878799 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc0a8050 con 0x7fe7e006b450 2024-03-19T06:20:44.764 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.772+0000 7fe7de000640 1 -- 172.21.15.171:0/2514878799 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc0ac860 con 0x7fe7e006b450 2024-03-19T06:20:44.764 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.772+0000 7fe7e6400640 1 -- 172.21.15.171:0/2514878799 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e006b450 msgr2=0x7fe7e006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:44.764 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.772+0000 7fe7e6400640 1 --2- 172.21.15.171:0/2514878799 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e006b450 0x7fe7e006f040 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0097f0 tx=0x7fe7cc01c380 comp rx=0 tx=0).stop 2024-03-19T06:20:44.764 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.772+0000 7fe7e6400640 1 -- 172.21.15.171:0/2514878799 shutdown_connections 2024-03-19T06:20:44.764 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.772+0000 7fe7e6400640 1 --2- 172.21.15.171:0/2514878799 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e006b450 0x7fe7e006f040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.765 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.772+0000 7fe7e6400640 1 -- 172.21.15.171:0/2514878799 >> 172.21.15.171:0/2514878799 conn(0x7fe7e00b1590 msgr2=0x7fe7e00b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:44.765 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.772+0000 7fe7e6400640 1 -- 172.21.15.171:0/2514878799 shutdown_connections 2024-03-19T06:20:44.765 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.772+0000 7fe7e6400640 1 -- 172.21.15.171:0/2514878799 wait complete. 2024-03-19T06:20:44.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7e6400640 1 Processor -- start 2024-03-19T06:20:44.766 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7e6400640 1 -- start start 2024-03-19T06:20:44.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7e6400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7e006b450 0x7fe7e01f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:44.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7e6400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e00aea70 0x7fe7e01f9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:44.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7e6400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7e015a840 0x7fe7e015d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:44.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7e6400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e00cf150 con 0x7fe7e006b450 2024-03-19T06:20:44.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7e6400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e00cefd0 con 0x7fe7e015a840 2024-03-19T06:20:44.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7e6400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e00cf2d0 con 0x7fe7e00aea70 2024-03-19T06:20:44.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7dea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e00aea70 0x7fe7e01f9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:44.767 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7dfe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7e015a840 0x7fe7e015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:44.768 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7dea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e00aea70 0x7fe7e01f9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:37358/0 (socket says 172.21.15.171:37358) 2024-03-19T06:20:44.768 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7df400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7e006b450 0x7fe7e01f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:44.768 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7dea00640 1 -- 172.21.15.171:0/4103016522 learned_addr learned my addr 172.21.15.171:0/4103016522 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-03-19T06:20:44.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7dea00640 1 -- 172.21.15.171:0/4103016522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7e015a840 msgr2=0x7fe7e015d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:44.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7dea00640 1 --2- 172.21.15.171:0/4103016522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7e015a840 0x7fe7e015d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7dea00640 1 -- 172.21.15.171:0/4103016522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7e006b450 msgr2=0x7fe7e01f6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:44.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7dea00640 1 --2- 172.21.15.171:0/4103016522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7e006b450 0x7fe7e01f6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7dea00640 1 -- 172.21.15.171:0/4103016522 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e015b0c0 con 0x7fe7e00aea70 2024-03-19T06:20:44.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7dfe00640 1 --2- 172.21.15.171:0/4103016522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7e015a840 0x7fe7e015d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:20:44.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7dea00640 1 --2- 172.21.15.171:0/4103016522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e00aea70 0x7fe7e01f9680 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0097f0 tx=0x7fe7cc01abc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:44.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7d7400640 1 -- 172.21.15.171:0/4103016522 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc0b1040 con 0x7fe7e00aea70 2024-03-19T06:20:44.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7d7400640 1 -- 172.21.15.171:0/4103016522 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc0bc070 con 0x7fe7e00aea70 2024-03-19T06:20:44.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7e6400640 1 -- 172.21.15.171:0/4103016522 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e015b3a0 con 0x7fe7e00aea70 2024-03-19T06:20:44.769 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7d7400640 1 -- 172.21.15.171:0/4103016522 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc0b7690 con 0x7fe7e00aea70 2024-03-19T06:20:44.770 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7e6400640 1 -- 172.21.15.171:0/4103016522 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e01f9bc0 con 0x7fe7e00aea70 2024-03-19T06:20:44.770 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7d7400640 1 -- 172.21.15.171:0/4103016522 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe7cc0b7830 con 0x7fe7e00aea70 2024-03-19T06:20:44.770 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.776+0000 7fe7d7400640 1 -- 172.21.15.171:0/4103016522 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe7cc0c1a30 con 0x7fe7e00aea70 2024-03-19T06:20:44.770 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.780+0000 7fe7e6400640 1 -- 172.21.15.171:0/4103016522 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e00749e0 con 0x7fe7e00aea70 2024-03-19T06:20:44.785 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.796+0000 7fe7d7400640 1 -- 172.21.15.171:0/4103016522 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fe7cc016090 con 0x7fe7e00aea70 2024-03-19T06:20:44.850 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.860+0000 7fe7e6400640 1 -- 172.21.15.171:0/4103016522 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3474385b-fff3-4c03-ab2f-b478e54f93ee", "id": 0} v 0) v1 -- 0x7fe7e006e6c0 con 0x7fe7e00aea70 2024-03-19T06:20:44.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.864+0000 7fe7d7400640 1 -- 172.21.15.171:0/4103016522 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3474385b-fff3-4c03-ab2f-b478e54f93ee", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe7cc0c1460 con 0x7fe7e00aea70 2024-03-19T06:20:44.857 INFO:teuthology.orchestra.run.smithi171.stdout:0 2024-03-19T06:20:44.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.868+0000 7fe7e6400640 1 -- 172.21.15.171:0/4103016522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e00aea70 msgr2=0x7fe7e01f9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:44.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.868+0000 7fe7e6400640 1 --2- 172.21.15.171:0/4103016522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e00aea70 0x7fe7e01f9680 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0097f0 tx=0x7fe7cc01abc0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.868+0000 7fe7e6400640 1 -- 172.21.15.171:0/4103016522 shutdown_connections 2024-03-19T06:20:44.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.868+0000 7fe7e6400640 1 --2- 172.21.15.171:0/4103016522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7e015a840 0x7fe7e015d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.868+0000 7fe7e6400640 1 --2- 172.21.15.171:0/4103016522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7e00aea70 0x7fe7e01f9680 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.868+0000 7fe7e6400640 1 --2- 172.21.15.171:0/4103016522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7e006b450 0x7fe7e01f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:44.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.868+0000 7fe7e6400640 1 -- 172.21.15.171:0/4103016522 >> 172.21.15.171:0/4103016522 conn(0x7fe7e00b1590 msgr2=0x7fe7e00afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:44.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.868+0000 7fe7e6400640 1 -- 172.21.15.171:0/4103016522 shutdown_connections 2024-03-19T06:20:44.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:44.868+0000 7fe7e6400640 1 -- 172.21.15.171:0/4103016522 wait complete. 2024-03-19T06:20:44.877 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new ac890403-9829-40d7-8d50-80a17597ab63 1 2024-03-19T06:20:45.012 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.020+0000 7f52a9200640 1 Processor -- start 2024-03-19T06:20:45.012 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.020+0000 7f52a9200640 1 -- start start 2024-03-19T06:20:45.013 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.024+0000 7f52a9200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f52a406b450 0x7f52a406fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.013 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.024+0000 7f52a9200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a40d16d0 con 0x7f52a415dba0 2024-03-19T06:20:45.013 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.024+0000 7f52a9200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a40ccea0 con 0x7f52a4070070 2024-03-19T06:20:45.013 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.024+0000 7f52a9200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a40704c0 con 0x7f52a406b450 2024-03-19T06:20:45.014 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.024+0000 7f529be00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f52a406b450 0x7f52a406fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.014 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.024+0000 7f529be00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f52a406b450 0x7f52a406fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:43420/0 (socket says 172.21.15.171:43420) 2024-03-19T06:20:45.014 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.024+0000 7f529be00640 1 -- 172.21.15.171:0/2871598183 learned_addr learned my addr 172.21.15.171:0/2871598183 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-03-19T06:20:45.014 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.024+0000 7f52a2800640 1 --1- 172.21.15.171:0/2871598183 >> v1:172.21.15.171:6789/0 conn(0x7f52a4070070 0x7f52a40cd0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:42968/0 (socket says 172.21.15.171:42968) 2024-03-19T06:20:45.014 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.024+0000 7f529be00640 1 -- 172.21.15.171:0/2871598183 >> v1:172.21.15.171:6789/0 conn(0x7f52a4070070 legacy=0x7f52a40cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.014 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.024+0000 7f529be00640 1 -- 172.21.15.171:0/2871598183 >> v1:172.21.15.32:6789/0 conn(0x7f52a415dba0 legacy=0x7f52a406ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.014 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.024+0000 7f529be00640 1 -- 172.21.15.171:0/2871598183 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a4070710 con 0x7f52a406b450 2024-03-19T06:20:45.016 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.024+0000 7f529be00640 1 --2- 172.21.15.171:0/2871598183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52a406b450 0x7f52a406fb30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f52a4070640 tx=0x7f528c01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b09998e4a5a5e1e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:45.017 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a1400640 1 -- 172.21.15.171:0/2871598183 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0b1070 con 0x7f52a406b450 2024-03-19T06:20:45.017 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a1400640 1 -- 172.21.15.171:0/2871598183 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c0ac600 con 0x7f52a406b450 2024-03-19T06:20:45.017 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a1400640 1 -- 172.21.15.171:0/2871598183 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0ac9d0 con 0x7f52a406b450 2024-03-19T06:20:45.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a9200640 1 -- 172.21.15.171:0/2871598183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52a406b450 msgr2=0x7f52a406fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a9200640 1 --2- 172.21.15.171:0/2871598183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52a406b450 0x7f52a406fb30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f52a4070640 tx=0x7f528c01c4b0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a9200640 1 -- 172.21.15.171:0/2871598183 shutdown_connections 2024-03-19T06:20:45.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a9200640 1 --2- 172.21.15.171:0/2871598183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52a406b450 0x7f52a406fb30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a9200640 1 -- 172.21.15.171:0/2871598183 >> 172.21.15.171:0/2871598183 conn(0x7f52a4099a70 msgr2=0x7f52a4099e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:45.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a9200640 1 -- 172.21.15.171:0/2871598183 shutdown_connections 2024-03-19T06:20:45.018 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a9200640 1 -- 172.21.15.171:0/2871598183 wait complete. 2024-03-19T06:20:45.019 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a9200640 1 Processor -- start 2024-03-19T06:20:45.019 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a9200640 1 -- start start 2024-03-19T06:20:45.022 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a9200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52a406b450 0x7f52a414ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.022 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a9200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52a4070070 0x7f52a4159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.022 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a9200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52a415dba0 0x7f52a4159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.022 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a9200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a415e100 con 0x7f52a4070070 2024-03-19T06:20:45.022 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a9200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a415df80 con 0x7f52a415dba0 2024-03-19T06:20:45.022 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a9200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a416b850 con 0x7f52a406b450 2024-03-19T06:20:45.022 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a1e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52a406b450 0x7f52a414ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.028+0000 7f52a2800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52a415dba0 0x7f52a4159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f52a2800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52a415dba0 0x7f52a4159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:43424/0 (socket says 172.21.15.171:43424) 2024-03-19T06:20:45.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f52a1e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52a406b450 0x7f52a414ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:37372/0 (socket says 172.21.15.171:37372) 2024-03-19T06:20:45.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f52a2800640 1 -- 172.21.15.171:0/2545507060 learned_addr learned my addr 172.21.15.171:0/2545507060 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-03-19T06:20:45.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f529be00640 1 --2- 172.21.15.171:0/2545507060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52a4070070 0x7f52a4159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f52a2800640 1 -- 172.21.15.171:0/2545507060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52a406b450 msgr2=0x7f52a414ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f52a2800640 1 --2- 172.21.15.171:0/2545507060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52a406b450 0x7f52a414ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f52a2800640 1 -- 172.21.15.171:0/2545507060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52a4070070 msgr2=0x7f52a4159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f52a2800640 1 --2- 172.21.15.171:0/2545507060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52a4070070 0x7f52a4159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f52a2800640 1 -- 172.21.15.171:0/2545507060 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a4155ba0 con 0x7f52a415dba0 2024-03-19T06:20:45.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f52a2800640 1 --2- 172.21.15.171:0/2545507060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52a415dba0 0x7f52a4159670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f529c00c7a0 tx=0x7f529c00cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:45.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f529a000640 1 -- 172.21.15.171:0/2545507060 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c017070 con 0x7f52a415dba0 2024-03-19T06:20:45.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f529a000640 1 -- 172.21.15.171:0/2545507060 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c00a640 con 0x7f52a415dba0 2024-03-19T06:20:45.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f529a000640 1 -- 172.21.15.171:0/2545507060 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c00a9f0 con 0x7f52a415dba0 2024-03-19T06:20:45.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f52a9200640 1 -- 172.21.15.171:0/2545507060 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a4158650 con 0x7f52a415dba0 2024-03-19T06:20:45.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f52a9200640 1 -- 172.21.15.171:0/2545507060 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a4158c10 con 0x7f52a415dba0 2024-03-19T06:20:45.024 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f529a000640 1 -- 172.21.15.171:0/2545507060 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f529c01a070 con 0x7f52a415dba0 2024-03-19T06:20:45.024 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f529a000640 1 -- 172.21.15.171:0/2545507060 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f529c01c7f0 con 0x7f52a415dba0 2024-03-19T06:20:45.024 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.032+0000 7f52a9200640 1 -- 172.21.15.171:0/2545507060 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a4158440 con 0x7f52a415dba0 2024-03-19T06:20:45.025 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.036+0000 7f529a000640 1 -- 172.21.15.171:0/2545507060 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f529c00aca0 con 0x7f52a415dba0 2024-03-19T06:20:45.047 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:45.056+0000 7f94806c8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-19T06:20:45.080 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:45.089+0000 7ff4555db180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-19T06:20:45.093 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.104+0000 7f52a9200640 1 -- 172.21.15.171:0/2545507060 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ac890403-9829-40d7-8d50-80a17597ab63", "id": 1} v 0) v1 -- 0x7f52a40749e0 con 0x7f52a415dba0 2024-03-19T06:20:45.097 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.108+0000 7f529a000640 1 -- 172.21.15.171:0/2545507060 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ac890403-9829-40d7-8d50-80a17597ab63", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f529c007960 con 0x7f52a415dba0 2024-03-19T06:20:45.097 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-03-19T06:20:45.098 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.108+0000 7f52a9200640 1 -- 172.21.15.171:0/2545507060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52a415dba0 msgr2=0x7f52a4159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.108+0000 7f52a9200640 1 --2- 172.21.15.171:0/2545507060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52a415dba0 0x7f52a4159670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f529c00c7a0 tx=0x7f529c00cc60 comp rx=0 tx=0).stop 2024-03-19T06:20:45.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.108+0000 7f52a9200640 1 -- 172.21.15.171:0/2545507060 shutdown_connections 2024-03-19T06:20:45.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.108+0000 7f52a9200640 1 --2- 172.21.15.171:0/2545507060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52a415dba0 0x7f52a4159670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.108+0000 7f52a9200640 1 --2- 172.21.15.171:0/2545507060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52a4070070 0x7f52a4159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.108+0000 7f52a9200640 1 --2- 172.21.15.171:0/2545507060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52a406b450 0x7f52a414ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.108+0000 7f52a9200640 1 -- 172.21.15.171:0/2545507060 >> 172.21.15.171:0/2545507060 conn(0x7f52a4099a70 msgr2=0x7f52a415efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:45.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.108+0000 7f52a9200640 1 -- 172.21.15.171:0/2545507060 shutdown_connections 2024-03-19T06:20:45.099 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.108+0000 7f52a9200640 1 -- 172.21.15.171:0/2545507060 wait complete. 2024-03-19T06:20:45.117 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new bf6c84c8-4914-45d4-97f3-cdf0fe1e682c 2 2024-03-19T06:20:45.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.260+0000 7fdcb5c00640 1 Processor -- start 2024-03-19T06:20:45.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.260+0000 7fdcb5c00640 1 -- start start 2024-03-19T06:20:45.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.264+0000 7fdcb5c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcb015dbb0 0x7fdcb006c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.264+0000 7fdcb5c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdcb006c5a0 0x7fdcb00b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.264+0000 7fdcb5c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb00cbf00 con 0x7fdcb00b3b60 2024-03-19T06:20:45.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.264+0000 7fdcb5c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb00b3fb0 con 0x7fdcb006c5a0 2024-03-19T06:20:45.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.264+0000 7fdcb5c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb006cb20 con 0x7fdcb015dbb0 2024-03-19T06:20:45.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.264+0000 7fdcaea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcb015dbb0 0x7fdcb006c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.264+0000 7fdca6000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdcb006c5a0 0x7fdcb00b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.264+0000 7fdca6000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdcb006c5a0 0x7fdcb00b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:43436/0 (socket says 172.21.15.171:43436) 2024-03-19T06:20:45.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.264+0000 7fdcaea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcb015dbb0 0x7fdcb006c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:37388/0 (socket says 172.21.15.171:37388) 2024-03-19T06:20:45.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.264+0000 7fdca6000640 1 -- 172.21.15.171:0/522516077 learned_addr learned my addr 172.21.15.171:0/522516077 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-03-19T06:20:45.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.264+0000 7fdcaea00640 1 -- 172.21.15.171:0/522516077 >> v2:172.21.15.171:3300/0 conn(0x7fdcb006c5a0 msgr2=0x7fdcb00b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:20:45.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.264+0000 7fdcaea00640 1 --2- 172.21.15.171:0/522516077 >> v2:172.21.15.171:3300/0 conn(0x7fdcb006c5a0 0x7fdcb00b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.264+0000 7fdcaea00640 1 -- 172.21.15.171:0/522516077 >> v1:172.21.15.171:6789/0 conn(0x7fdcb00b3b60 legacy=0x7fdcb00d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.264+0000 7fdcaea00640 1 -- 172.21.15.171:0/522516077 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb006ce00 con 0x7fdcb015dbb0 2024-03-19T06:20:45.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.264+0000 7fdca6000640 1 --2- 172.21.15.171:0/522516077 >> v2:172.21.15.171:3300/0 conn(0x7fdcb006c5a0 0x7fdcb00b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:20:45.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcaea00640 1 --2- 172.21.15.171:0/522516077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcb015dbb0 0x7fdcb006c060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdca00097c0 tx=0x7fdca001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60ca92e0a3b901ec server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:45.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcae000640 1 -- 172.21.15.171:0/522516077 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca00b5070 con 0x7fdcb015dbb0 2024-03-19T06:20:45.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcae000640 1 -- 172.21.15.171:0/522516077 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca00a8990 con 0x7fdcb015dbb0 2024-03-19T06:20:45.257 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcae000640 1 -- 172.21.15.171:0/522516077 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca00a8d60 con 0x7fdcb015dbb0 2024-03-19T06:20:45.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcb5c00640 1 -- 172.21.15.171:0/522516077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcb015dbb0 msgr2=0x7fdcb006c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcb5c00640 1 --2- 172.21.15.171:0/522516077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcb015dbb0 0x7fdcb006c060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdca00097c0 tx=0x7fdca001ec90 comp rx=0 tx=0).stop 2024-03-19T06:20:45.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcb5c00640 1 -- 172.21.15.171:0/522516077 shutdown_connections 2024-03-19T06:20:45.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcb5c00640 1 --2- 172.21.15.171:0/522516077 >> v2:172.21.15.171:3300/0 conn(0x7fdcb006c5a0 0x7fdcb00b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcb5c00640 1 --2- 172.21.15.171:0/522516077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcb015dbb0 0x7fdcb006c060 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcb5c00640 1 -- 172.21.15.171:0/522516077 >> 172.21.15.171:0/522516077 conn(0x7fdcb0066ca0 msgr2=0x7fdcb00670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:45.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcb5c00640 1 -- 172.21.15.171:0/522516077 shutdown_connections 2024-03-19T06:20:45.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcb5c00640 1 -- 172.21.15.171:0/522516077 wait complete. 2024-03-19T06:20:45.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcb5c00640 1 Processor -- start 2024-03-19T06:20:45.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcb5c00640 1 -- start start 2024-03-19T06:20:45.262 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcb5c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcb006c5a0 0x7fdcb0153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.262 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcb5c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcb00b3b60 0x7fdcb00c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcb5c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcb015dbb0 0x7fdcb0152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcb5c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb006d910 con 0x7fdcb015dbb0 2024-03-19T06:20:45.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcb5c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00cc1a0 con 0x7fdcb006c5a0 2024-03-19T06:20:45.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcb5c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb015df90 con 0x7fdcb00b3b60 2024-03-19T06:20:45.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdcaea00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcb006c5a0 0x7fdcb0153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.268+0000 7fdca6000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcb00b3b60 0x7fdcb00c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdcaea00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcb006c5a0 0x7fdcb0153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:43442/0 (socket says 172.21.15.171:43442) 2024-03-19T06:20:45.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdcaea00640 1 -- 172.21.15.171:0/2534112012 learned_addr learned my addr 172.21.15.171:0/2534112012 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-03-19T06:20:45.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdca6000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcb00b3b60 0x7fdcb00c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:37396/0 (socket says 172.21.15.171:37396) 2024-03-19T06:20:45.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdcaf400640 1 --2- 172.21.15.171:0/2534112012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcb015dbb0 0x7fdcb0152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdca6000640 1 -- 172.21.15.171:0/2534112012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcb006c5a0 msgr2=0x7fdcb0153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdca6000640 1 --2- 172.21.15.171:0/2534112012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcb006c5a0 0x7fdcb0153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdca6000640 1 -- 172.21.15.171:0/2534112012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcb015dbb0 msgr2=0x7fdcb0152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdca6000640 1 --2- 172.21.15.171:0/2534112012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcb015dbb0 0x7fdcb0152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdca6000640 1 -- 172.21.15.171:0/2534112012 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb00c5b10 con 0x7fdcb00b3b60 2024-03-19T06:20:45.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdcaea00640 1 --2- 172.21.15.171:0/2534112012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcb006c5a0 0x7fdcb0153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:20:45.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdca6000640 1 --2- 172.21.15.171:0/2534112012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcb00b3b60 0x7fdcb00c55d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800e8b0 tx=0x7fdc9800ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:45.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdca7400640 1 -- 172.21.15.171:0/2534112012 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98004030 con 0x7fdcb00b3b60 2024-03-19T06:20:45.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdca7400640 1 -- 172.21.15.171:0/2534112012 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc980041d0 con 0x7fdcb00b3b60 2024-03-19T06:20:45.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdca7400640 1 -- 172.21.15.171:0/2534112012 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9800c940 con 0x7fdcb00b3b60 2024-03-19T06:20:45.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdcb5c00640 1 -- 172.21.15.171:0/2534112012 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb01545a0 con 0x7fdcb00b3b60 2024-03-19T06:20:45.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdcb5c00640 1 -- 172.21.15.171:0/2534112012 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb0154b60 con 0x7fdcb00b3b60 2024-03-19T06:20:45.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdca7400640 1 -- 172.21.15.171:0/2534112012 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fdc980059a0 con 0x7fdcb00b3b60 2024-03-19T06:20:45.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdca7400640 1 -- 172.21.15.171:0/2534112012 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fdc980093d0 con 0x7fdcb00b3b60 2024-03-19T06:20:45.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.272+0000 7fdcb5c00640 1 -- 172.21.15.171:0/2534112012 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb00749e0 con 0x7fdcb00b3b60 2024-03-19T06:20:45.265 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.276+0000 7fdca7400640 1 -- 172.21.15.171:0/2534112012 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fdc98017020 con 0x7fdcb00b3b60 2024-03-19T06:20:45.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.340+0000 7fdcb5c00640 1 -- 172.21.15.171:0/2534112012 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bf6c84c8-4914-45d4-97f3-cdf0fe1e682c", "id": 2} v 0) v1 -- 0x7fdcb00cf040 con 0x7fdcb00b3b60 2024-03-19T06:20:45.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.344+0000 7fdca7400640 1 -- 172.21.15.171:0/2534112012 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bf6c84c8-4914-45d4-97f3-cdf0fe1e682c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdc98005c90 con 0x7fdcb00b3b60 2024-03-19T06:20:45.336 INFO:teuthology.orchestra.run.smithi171.stdout:2 2024-03-19T06:20:45.337 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.348+0000 7fdcb5c00640 1 -- 172.21.15.171:0/2534112012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcb00b3b60 msgr2=0x7fdcb00c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.337 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.348+0000 7fdcb5c00640 1 --2- 172.21.15.171:0/2534112012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcb00b3b60 0x7fdcb00c55d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800e8b0 tx=0x7fdc9800ed70 comp rx=0 tx=0).stop 2024-03-19T06:20:45.337 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.348+0000 7fdcb5c00640 1 -- 172.21.15.171:0/2534112012 shutdown_connections 2024-03-19T06:20:45.337 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.348+0000 7fdcb5c00640 1 --2- 172.21.15.171:0/2534112012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcb015dbb0 0x7fdcb0152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.337 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.348+0000 7fdcb5c00640 1 --2- 172.21.15.171:0/2534112012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcb00b3b60 0x7fdcb00c55d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.337 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.348+0000 7fdcb5c00640 1 --2- 172.21.15.171:0/2534112012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcb006c5a0 0x7fdcb0153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.337 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.348+0000 7fdcb5c00640 1 -- 172.21.15.171:0/2534112012 >> 172.21.15.171:0/2534112012 conn(0x7fdcb0066ca0 msgr2=0x7fdcb00b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:45.338 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.348+0000 7fdcb5c00640 1 -- 172.21.15.171:0/2534112012 shutdown_connections 2024-03-19T06:20:45.338 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.348+0000 7fdcb5c00640 1 -- 172.21.15.171:0/2534112012 wait complete. 2024-03-19T06:20:45.355 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 6f68c8b3-3ec5-4d1b-85da-c683be6545dd 3 2024-03-19T06:20:45.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.500+0000 7f6b2d800640 1 Processor -- start 2024-03-19T06:20:45.491 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.500+0000 7f6b2d800640 1 -- start start 2024-03-19T06:20:45.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.500+0000 7f6b2d800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b2815dbb0 0x7f6b2806c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.500+0000 7f6b2d800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6b280b3d30 0x7f6b280cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.500+0000 7f6b2d800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b280cbf00 con 0x7f6b2806c5a0 2024-03-19T06:20:45.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.500+0000 7f6b2d800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2806cb20 con 0x7f6b280b3d30 2024-03-19T06:20:45.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.500+0000 7f6b2d800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2806ce00 con 0x7f6b2815dbb0 2024-03-19T06:20:45.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.500+0000 7f6b26a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b2815dbb0 0x7f6b2806c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.500+0000 7f6b26a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b2815dbb0 0x7f6b2806c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:37408/0 (socket says 172.21.15.171:37408) 2024-03-19T06:20:45.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.500+0000 7f6b26a00640 1 -- 172.21.15.171:0/3379118788 learned_addr learned my addr 172.21.15.171:0/3379118788 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-03-19T06:20:45.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.500+0000 7f6b27400640 1 --2- 172.21.15.171:0/3379118788 >> v2:172.21.15.32:3300/0 conn(0x7f6b280b3d30 0x7f6b280cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.504+0000 7f6b26a00640 1 -- 172.21.15.171:0/3379118788 >> v2:172.21.15.32:3300/0 conn(0x7f6b280b3d30 msgr2=0x7f6b280cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:20:45.493 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.504+0000 7f6b26a00640 1 --2- 172.21.15.171:0/3379118788 >> v2:172.21.15.32:3300/0 conn(0x7f6b280b3d30 0x7f6b280cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.494 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.504+0000 7f6b26a00640 1 -- 172.21.15.171:0/3379118788 >> v1:172.21.15.32:6789/0 conn(0x7f6b2806c5a0 legacy=0x7f6b280b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.494 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.504+0000 7f6b26a00640 1 -- 172.21.15.171:0/3379118788 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2806d0e0 con 0x7f6b2815dbb0 2024-03-19T06:20:45.495 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.504+0000 7f6b26a00640 1 --2- 172.21.15.171:0/3379118788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b2815dbb0 0x7f6b2806c060 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6b18009870 tx=0x7f6b1801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32a5e84509d12a32 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:45.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.504+0000 7f6b26000640 1 -- 172.21.15.171:0/3379118788 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b180b5070 con 0x7f6b2815dbb0 2024-03-19T06:20:45.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.504+0000 7f6b26000640 1 -- 172.21.15.171:0/3379118788 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b180a8a50 con 0x7f6b2815dbb0 2024-03-19T06:20:45.496 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.504+0000 7f6b26000640 1 -- 172.21.15.171:0/3379118788 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b180a8e20 con 0x7f6b2815dbb0 2024-03-19T06:20:45.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b2d800640 1 -- 172.21.15.171:0/3379118788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b2815dbb0 msgr2=0x7f6b2806c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b2d800640 1 --2- 172.21.15.171:0/3379118788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b2815dbb0 0x7f6b2806c060 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6b18009870 tx=0x7f6b1801ed50 comp rx=0 tx=0).stop 2024-03-19T06:20:45.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b2d800640 1 -- 172.21.15.171:0/3379118788 shutdown_connections 2024-03-19T06:20:45.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b2d800640 1 --2- 172.21.15.171:0/3379118788 >> v2:172.21.15.32:3300/0 conn(0x7f6b280b3d30 0x7f6b280cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b2d800640 1 --2- 172.21.15.171:0/3379118788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b2815dbb0 0x7f6b2806c060 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.497 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b2d800640 1 -- 172.21.15.171:0/3379118788 >> 172.21.15.171:0/3379118788 conn(0x7f6b28066ca0 msgr2=0x7f6b280670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:45.498 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b2d800640 1 -- 172.21.15.171:0/3379118788 shutdown_connections 2024-03-19T06:20:45.498 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b2d800640 1 -- 172.21.15.171:0/3379118788 wait complete. 2024-03-19T06:20:45.498 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b2d800640 1 Processor -- start 2024-03-19T06:20:45.498 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b2d800640 1 -- start start 2024-03-19T06:20:45.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b2d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b2806c5a0 0x7f6b280c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b2d800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b280b3d30 0x7f6b28149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b2d800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b2815dbb0 0x7f6b280c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b2d800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2815df90 con 0x7f6b2806c5a0 2024-03-19T06:20:45.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b2d800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2806d910 con 0x7f6b280b3d30 2024-03-19T06:20:45.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b2d800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280ccc00 con 0x7f6b2815dbb0 2024-03-19T06:20:45.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b27400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b2815dbb0 0x7f6b280c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.500 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b26a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b2806c5a0 0x7f6b280c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.501 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b1fe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b280b3d30 0x7f6b28149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.501 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b27400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b2815dbb0 0x7f6b280c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:37418/0 (socket says 172.21.15.171:37418) 2024-03-19T06:20:45.501 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b27400640 1 -- 172.21.15.171:0/2117369393 learned_addr learned my addr 172.21.15.171:0/2117369393 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-03-19T06:20:45.501 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b26a00640 1 -- 172.21.15.171:0/2117369393 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b2815dbb0 msgr2=0x7f6b280c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.501 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b26a00640 1 --2- 172.21.15.171:0/2117369393 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b2815dbb0 0x7f6b280c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.501 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b26a00640 1 -- 172.21.15.171:0/2117369393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b280b3d30 msgr2=0x7f6b28149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.501 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b26a00640 1 --2- 172.21.15.171:0/2117369393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b280b3d30 0x7f6b28149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.501 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b26a00640 1 -- 172.21.15.171:0/2117369393 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b280cb960 con 0x7f6b2806c5a0 2024-03-19T06:20:45.502 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.508+0000 7f6b26a00640 1 --2- 172.21.15.171:0/2117369393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b2806c5a0 0x7f6b280c5330 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6b180af000 tx=0x7f6b1801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:45.502 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.512+0000 7f6b1ea00640 1 -- 172.21.15.171:0/2117369393 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b180c0070 con 0x7f6b2806c5a0 2024-03-19T06:20:45.502 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.512+0000 7f6b1ea00640 1 -- 172.21.15.171:0/2117369393 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b180ae550 con 0x7f6b2806c5a0 2024-03-19T06:20:45.502 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.512+0000 7f6b1ea00640 1 -- 172.21.15.171:0/2117369393 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b180b5070 con 0x7f6b2806c5a0 2024-03-19T06:20:45.502 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.512+0000 7f6b2d800640 1 -- 172.21.15.171:0/2117369393 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b280cb680 con 0x7f6b2806c5a0 2024-03-19T06:20:45.502 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.512+0000 7f6b2d800640 1 -- 172.21.15.171:0/2117369393 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b280c7c40 con 0x7f6b2806c5a0 2024-03-19T06:20:45.503 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.512+0000 7f6b1ea00640 1 -- 172.21.15.171:0/2117369393 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f6b180c3070 con 0x7f6b2806c5a0 2024-03-19T06:20:45.503 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.512+0000 7f6b1ea00640 1 -- 172.21.15.171:0/2117369393 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6b180bb640 con 0x7f6b2806c5a0 2024-03-19T06:20:45.503 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.512+0000 7f6b2d800640 1 -- 172.21.15.171:0/2117369393 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b280749e0 con 0x7f6b2806c5a0 2024-03-19T06:20:45.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.512+0000 7f6b1ea00640 1 -- 172.21.15.171:0/2117369393 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6b180188b0 con 0x7f6b2806c5a0 2024-03-19T06:20:45.567 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:45.576+0000 7f94806c8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-19T06:20:45.571 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.580+0000 7f6b2d800640 1 -- 172.21.15.171:0/2117369393 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6f68c8b3-3ec5-4d1b-85da-c683be6545dd", "id": 3} v 0) v1 -- 0x7f6b2815d2b0 con 0x7f6b2806c5a0 2024-03-19T06:20:45.574 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.584+0000 7f6b1ea00640 1 -- 172.21.15.171:0/2117369393 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6f68c8b3-3ec5-4d1b-85da-c683be6545dd", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6b180ae960 con 0x7f6b2806c5a0 2024-03-19T06:20:45.574 INFO:teuthology.orchestra.run.smithi171.stdout:3 2024-03-19T06:20:45.575 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.584+0000 7f6b2d800640 1 -- 172.21.15.171:0/2117369393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b2806c5a0 msgr2=0x7f6b280c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.575 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.584+0000 7f6b2d800640 1 --2- 172.21.15.171:0/2117369393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b2806c5a0 0x7f6b280c5330 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6b180af000 tx=0x7f6b1801baf0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.575 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.584+0000 7f6b2d800640 1 -- 172.21.15.171:0/2117369393 shutdown_connections 2024-03-19T06:20:45.575 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.584+0000 7f6b2d800640 1 --2- 172.21.15.171:0/2117369393 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b2815dbb0 0x7f6b280c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.575 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.584+0000 7f6b2d800640 1 --2- 172.21.15.171:0/2117369393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b280b3d30 0x7f6b28149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.575 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.584+0000 7f6b2d800640 1 --2- 172.21.15.171:0/2117369393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b2806c5a0 0x7f6b280c5330 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.575 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.584+0000 7f6b2d800640 1 -- 172.21.15.171:0/2117369393 >> 172.21.15.171:0/2117369393 conn(0x7f6b28066ca0 msgr2=0x7f6b280b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:45.575 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.584+0000 7f6b2d800640 1 -- 172.21.15.171:0/2117369393 shutdown_connections 2024-03-19T06:20:45.576 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.584+0000 7f6b2d800640 1 -- 172.21.15.171:0/2117369393 wait complete. 2024-03-19T06:20:45.591 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:45.601+0000 7ff4555db180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-19T06:20:45.593 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new d41e788a-6f9d-4f6b-901a-a06adad2da3c 4 2024-03-19T06:20:45.728 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.736+0000 7f54c0e00640 1 Processor -- start 2024-03-19T06:20:45.728 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.736+0000 7f54c0e00640 1 -- start start 2024-03-19T06:20:45.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.740+0000 7f54c0e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54bc0b3620 0x7f54bc0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.740+0000 7f54c0e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f54bc0cc6c0 0x7f54bc0ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.740+0000 7f54c0e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54bc0cbf00 con 0x7f54bc15dbb0 2024-03-19T06:20:45.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.740+0000 7f54c0e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54bc0b3fa0 con 0x7f54bc0cc6c0 2024-03-19T06:20:45.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.740+0000 7f54c0e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc06cb20 con 0x7f54bc0b3620 2024-03-19T06:20:45.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.740+0000 7f54b1400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54bc0b3620 0x7f54bc0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.740+0000 7f54b9e00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f54bc15dbb0 0x7f54bc06c060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:42978/0 (socket says 172.21.15.171:42978) 2024-03-19T06:20:45.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.740+0000 7f54b9e00640 1 -- 172.21.15.171:0/1524779161 learned_addr learned my addr 172.21.15.171:0/1524779161 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-03-19T06:20:45.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.740+0000 7f54ba800640 1 --2- 172.21.15.171:0/1524779161 >> v2:172.21.15.171:3300/0 conn(0x7f54bc0cc6c0 0x7f54bc0ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.740+0000 7f54b1400640 1 -- 172.21.15.171:0/1524779161 >> v2:172.21.15.171:3300/0 conn(0x7f54bc0cc6c0 msgr2=0x7f54bc0ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:20:45.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.740+0000 7f54b1400640 1 --2- 172.21.15.171:0/1524779161 >> v2:172.21.15.171:3300/0 conn(0x7f54bc0cc6c0 0x7f54bc0ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.740+0000 7f54b1400640 1 -- 172.21.15.171:0/1524779161 >> v1:172.21.15.171:6789/0 conn(0x7f54bc15dbb0 legacy=0x7f54bc06c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.731 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.740+0000 7f54b1400640 1 -- 172.21.15.171:0/1524779161 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc06ce00 con 0x7f54bc0b3620 2024-03-19T06:20:45.731 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.740+0000 7f54b9400640 1 -- 172.21.15.171:0/1524779161 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491434121 0 0) 0x7f54bc0cbf00 con 0x7f54bc15dbb0 2024-03-19T06:20:45.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.740+0000 7f54b1400640 1 --2- 172.21.15.171:0/1524779161 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54bc0b3620 0x7f54bc0b3a60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f54a40097c0 tx=0x7f54a401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72c64945a4d17c90 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:45.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54b9400640 1 -- 172.21.15.171:0/1524779161 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a40b5070 con 0x7f54bc0b3620 2024-03-19T06:20:45.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54b9400640 1 -- 172.21.15.171:0/1524779161 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a40a8990 con 0x7f54bc0b3620 2024-03-19T06:20:45.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54b9400640 1 -- 172.21.15.171:0/1524779161 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a40a8d60 con 0x7f54bc0b3620 2024-03-19T06:20:45.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54c0e00640 1 -- 172.21.15.171:0/1524779161 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54bc0b3620 msgr2=0x7f54bc0b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54c0e00640 1 --2- 172.21.15.171:0/1524779161 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54bc0b3620 0x7f54bc0b3a60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f54a40097c0 tx=0x7f54a401ec90 comp rx=0 tx=0).stop 2024-03-19T06:20:45.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54c0e00640 1 -- 172.21.15.171:0/1524779161 shutdown_connections 2024-03-19T06:20:45.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54c0e00640 1 --2- 172.21.15.171:0/1524779161 >> v2:172.21.15.171:3300/0 conn(0x7f54bc0cc6c0 0x7f54bc0ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54c0e00640 1 --2- 172.21.15.171:0/1524779161 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54bc0b3620 0x7f54bc0b3a60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54c0e00640 1 -- 172.21.15.171:0/1524779161 >> 172.21.15.171:0/1524779161 conn(0x7f54bc066ca0 msgr2=0x7f54bc0670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:45.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54c0e00640 1 -- 172.21.15.171:0/1524779161 shutdown_connections 2024-03-19T06:20:45.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54c0e00640 1 -- 172.21.15.171:0/1524779161 wait complete. 2024-03-19T06:20:45.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54c0e00640 1 Processor -- start 2024-03-19T06:20:45.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54c0e00640 1 -- start start 2024-03-19T06:20:45.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54c0e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54bc0b3620 0x7f54bc1f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54c0e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54bc0cc6c0 0x7f54bc0b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54c0e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54bc15dbb0 0x7f54bc15ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54c0e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc06d910 con 0x7f54bc15dbb0 2024-03-19T06:20:45.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54c0e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc0cc1a0 con 0x7f54bc0cc6c0 2024-03-19T06:20:45.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54c0e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc15df90 con 0x7f54bc0b3620 2024-03-19T06:20:45.737 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54b9e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54bc0b3620 0x7f54bc1f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.738 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54b1400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54bc0cc6c0 0x7f54bc0b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.738 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54b9e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54bc0b3620 0x7f54bc1f2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:37428/0 (socket says 172.21.15.171:37428) 2024-03-19T06:20:45.738 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54b9e00640 1 -- 172.21.15.171:0/3677494452 learned_addr learned my addr 172.21.15.171:0/3677494452 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-03-19T06:20:45.738 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.744+0000 7f54b1400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54bc0cc6c0 0x7f54bc0b6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:43454/0 (socket says 172.21.15.171:43454) 2024-03-19T06:20:45.738 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.748+0000 7f54b1400640 1 -- 172.21.15.171:0/3677494452 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54bc0b3620 msgr2=0x7f54bc1f2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.738 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.748+0000 7f54b1400640 1 --2- 172.21.15.171:0/3677494452 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54bc0b3620 0x7f54bc1f2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.738 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.748+0000 7f54b1400640 1 -- 172.21.15.171:0/3677494452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54bc15dbb0 msgr2=0x7f54bc15ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.738 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.748+0000 7f54b1400640 1 --2- 172.21.15.171:0/3677494452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54bc15dbb0 0x7f54bc15ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.738 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.748+0000 7f54b1400640 1 -- 172.21.15.171:0/3677494452 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc1f6ac0 con 0x7f54bc0cc6c0 2024-03-19T06:20:45.738 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.748+0000 7f54b1400640 1 --2- 172.21.15.171:0/3677494452 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54bc0cc6c0 0x7f54bc0b6b20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f54a40af000 tx=0x7f54a401ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:45.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.748+0000 7f54b2a00640 1 -- 172.21.15.171:0/3677494452 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a40bf070 con 0x7f54bc0cc6c0 2024-03-19T06:20:45.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.748+0000 7f54b2a00640 1 -- 172.21.15.171:0/3677494452 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a40b0720 con 0x7f54bc0cc6c0 2024-03-19T06:20:45.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.748+0000 7f54b2a00640 1 -- 172.21.15.171:0/3677494452 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a40b5040 con 0x7f54bc0cc6c0 2024-03-19T06:20:45.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.748+0000 7f54c0e00640 1 -- 172.21.15.171:0/3677494452 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54bc1f6da0 con 0x7f54bc0cc6c0 2024-03-19T06:20:45.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.748+0000 7f54c0e00640 1 -- 172.21.15.171:0/3677494452 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54bc1f7360 con 0x7f54bc0cc6c0 2024-03-19T06:20:45.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.748+0000 7f54b2a00640 1 -- 172.21.15.171:0/3677494452 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f54a40b0b10 con 0x7f54bc0cc6c0 2024-03-19T06:20:45.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.748+0000 7f54b2a00640 1 -- 172.21.15.171:0/3677494452 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f54a40b0e00 con 0x7f54bc0cc6c0 2024-03-19T06:20:45.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.748+0000 7f54c0e00640 1 -- 172.21.15.171:0/3677494452 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54bc0749e0 con 0x7f54bc0cc6c0 2024-03-19T06:20:45.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.752+0000 7f54b2a00640 1 -- 172.21.15.171:0/3677494452 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f54a40c9020 con 0x7f54bc0cc6c0 2024-03-19T06:20:45.809 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.816+0000 7f54c0e00640 1 -- 172.21.15.171:0/3677494452 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d41e788a-6f9d-4f6b-901a-a06adad2da3c", "id": 4} v 0) v1 -- 0x7f54bc0673c0 con 0x7f54bc0cc6c0 2024-03-19T06:20:45.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.820+0000 7f54b2a00640 1 -- 172.21.15.171:0/3677494452 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d41e788a-6f9d-4f6b-901a-a06adad2da3c", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f54a40187f0 con 0x7f54bc0cc6c0 2024-03-19T06:20:45.813 INFO:teuthology.orchestra.run.smithi171.stdout:4 2024-03-19T06:20:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.824+0000 7f54c0e00640 1 -- 172.21.15.171:0/3677494452 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54bc0cc6c0 msgr2=0x7f54bc0b6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.824+0000 7f54c0e00640 1 --2- 172.21.15.171:0/3677494452 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54bc0cc6c0 0x7f54bc0b6b20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f54a40af000 tx=0x7f54a401ba30 comp rx=0 tx=0).stop 2024-03-19T06:20:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.824+0000 7f54c0e00640 1 -- 172.21.15.171:0/3677494452 shutdown_connections 2024-03-19T06:20:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.824+0000 7f54c0e00640 1 --2- 172.21.15.171:0/3677494452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54bc15dbb0 0x7f54bc15ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.824+0000 7f54c0e00640 1 --2- 172.21.15.171:0/3677494452 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54bc0cc6c0 0x7f54bc0b6b20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.824+0000 7f54c0e00640 1 --2- 172.21.15.171:0/3677494452 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54bc0b3620 0x7f54bc1f2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.824+0000 7f54c0e00640 1 -- 172.21.15.171:0/3677494452 >> 172.21.15.171:0/3677494452 conn(0x7f54bc066ca0 msgr2=0x7f54bc0b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.824+0000 7f54c0e00640 1 -- 172.21.15.171:0/3677494452 shutdown_connections 2024-03-19T06:20:45.814 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.824+0000 7f54c0e00640 1 -- 172.21.15.171:0/3677494452 wait complete. 2024-03-19T06:20:45.815 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:45.824+0000 7f94806c8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-19T06:20:45.816 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:45.825+0000 7ff4555db180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-19T06:20:45.832 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 0fbf6c55-4612-4c22-b803-1ed93ad316b9 5 2024-03-19T06:20:45.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.976+0000 7f1c77c00640 1 Processor -- start 2024-03-19T06:20:45.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.976+0000 7f1c77c00640 1 -- start start 2024-03-19T06:20:45.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.976+0000 7f1c77c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c7015ba00 0x7f1c700b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.976+0000 7f1c77c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1c700b3de0 0x7f1c700cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.976+0000 7f1c77c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c700d14b0 con 0x7f1c700b7530 2024-03-19T06:20:45.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.976+0000 7f1c77c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c700d20c0 con 0x7f1c700b3de0 2024-03-19T06:20:45.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.976+0000 7f1c77c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700d1790 con 0x7f1c7015ba00 2024-03-19T06:20:45.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.980+0000 7f1c6fe00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f1c700b7530 0x7f1c700b36d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:42988/0 (socket says 172.21.15.171:42988) 2024-03-19T06:20:45.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.980+0000 7f1c6fe00640 1 -- 172.21.15.171:0/4004171783 learned_addr learned my addr 172.21.15.171:0/4004171783 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-03-19T06:20:45.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.980+0000 7f1c75200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c7015ba00 0x7f1c700b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.980+0000 7f1c75c00640 1 --2- 172.21.15.171:0/4004171783 >> v2:172.21.15.32:3300/0 conn(0x7f1c700b3de0 0x7f1c700cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.980+0000 7f1c75200640 1 -- 172.21.15.171:0/4004171783 >> v2:172.21.15.32:3300/0 conn(0x7f1c700b3de0 msgr2=0x7f1c700cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:20:45.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.980+0000 7f1c75200640 1 --2- 172.21.15.171:0/4004171783 >> v2:172.21.15.32:3300/0 conn(0x7f1c700b3de0 0x7f1c700cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.980+0000 7f1c75200640 1 -- 172.21.15.171:0/4004171783 >> v1:172.21.15.171:6789/0 conn(0x7f1c700b7530 legacy=0x7f1c700b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.980+0000 7f1c6f400640 1 -- 172.21.15.171:0/4004171783 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727759111 0 0) 0x7f1c700d14b0 con 0x7f1c700b7530 2024-03-19T06:20:45.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.980+0000 7f1c75200640 1 -- 172.21.15.171:0/4004171783 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c700d1a70 con 0x7f1c7015ba00 2024-03-19T06:20:45.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.980+0000 7f1c75200640 1 --2- 172.21.15.171:0/4004171783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c7015ba00 0x7f1c700b6ff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1c640097c0 tx=0x7f1c6401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2793974e77179416 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:45.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.980+0000 7f1c6f400640 1 -- 172.21.15.171:0/4004171783 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640b5070 con 0x7f1c7015ba00 2024-03-19T06:20:45.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.980+0000 7f1c6f400640 1 -- 172.21.15.171:0/4004171783 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c640a8990 con 0x7f1c7015ba00 2024-03-19T06:20:45.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.980+0000 7f1c6f400640 1 -- 172.21.15.171:0/4004171783 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640a8d60 con 0x7f1c7015ba00 2024-03-19T06:20:45.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c77c00640 1 -- 172.21.15.171:0/4004171783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c7015ba00 msgr2=0x7f1c700b6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c77c00640 1 --2- 172.21.15.171:0/4004171783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c7015ba00 0x7f1c700b6ff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1c640097c0 tx=0x7f1c6401ec90 comp rx=0 tx=0).stop 2024-03-19T06:20:45.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c77c00640 1 -- 172.21.15.171:0/4004171783 shutdown_connections 2024-03-19T06:20:45.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c77c00640 1 --2- 172.21.15.171:0/4004171783 >> v2:172.21.15.32:3300/0 conn(0x7f1c700b3de0 0x7f1c700cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c77c00640 1 --2- 172.21.15.171:0/4004171783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c7015ba00 0x7f1c700b6ff0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c77c00640 1 -- 172.21.15.171:0/4004171783 >> 172.21.15.171:0/4004171783 conn(0x7f1c70066ca0 msgr2=0x7f1c700670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:45.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c77c00640 1 -- 172.21.15.171:0/4004171783 shutdown_connections 2024-03-19T06:20:45.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c77c00640 1 -- 172.21.15.171:0/4004171783 wait complete. 2024-03-19T06:20:45.975 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c77c00640 1 Processor -- start 2024-03-19T06:20:45.975 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c77c00640 1 -- start start 2024-03-19T06:20:45.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c77c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c700b3de0 0x7f1c7015ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c77c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c700b7530 0x7f1c7015cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c77c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c7015ba00 0x7f1c700ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:45.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c77c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7015bf60 con 0x7f1c700b3de0 2024-03-19T06:20:45.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c77c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7015bde0 con 0x7f1c7015ba00 2024-03-19T06:20:45.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c77c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700d10f0 con 0x7f1c700b7530 2024-03-19T06:20:45.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c6fe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c700b7530 0x7f1c7015cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c75c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c7015ba00 0x7f1c700ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c6fe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c700b7530 0x7f1c7015cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:37450/0 (socket says 172.21.15.171:37450) 2024-03-19T06:20:45.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c6fe00640 1 -- 172.21.15.171:0/371800490 learned_addr learned my addr 172.21.15.171:0/371800490 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-03-19T06:20:45.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c75200640 1 --2- 172.21.15.171:0/371800490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c700b3de0 0x7f1c7015ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:45.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c75c00640 1 -- 172.21.15.171:0/371800490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c700b7530 msgr2=0x7f1c7015cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c75c00640 1 --2- 172.21.15.171:0/371800490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c700b7530 0x7f1c7015cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c75c00640 1 -- 172.21.15.171:0/371800490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c700b3de0 msgr2=0x7f1c7015ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:45.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c75c00640 1 --2- 172.21.15.171:0/371800490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c700b3de0 0x7f1c7015ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:45.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.984+0000 7f1c75c00640 1 -- 172.21.15.171:0/371800490 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7015f110 con 0x7f1c7015ba00 2024-03-19T06:20:45.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.988+0000 7f1c75c00640 1 --2- 172.21.15.171:0/371800490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c7015ba00 0x7f1c700ca790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1c700cbe00 tx=0x7f1c6800ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:45.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.988+0000 7f1c6cc00640 1 -- 172.21.15.171:0/371800490 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68018020 con 0x7f1c7015ba00 2024-03-19T06:20:45.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.988+0000 7f1c6cc00640 1 -- 172.21.15.171:0/371800490 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c68014480 con 0x7f1c7015ba00 2024-03-19T06:20:45.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.988+0000 7f1c6cc00640 1 -- 172.21.15.171:0/371800490 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68014870 con 0x7f1c7015ba00 2024-03-19T06:20:45.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.988+0000 7f1c77c00640 1 -- 172.21.15.171:0/371800490 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7015db30 con 0x7f1c7015ba00 2024-03-19T06:20:45.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.988+0000 7f1c77c00640 1 -- 172.21.15.171:0/371800490 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7015e0f0 con 0x7f1c7015ba00 2024-03-19T06:20:45.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.988+0000 7f1c6cc00640 1 -- 172.21.15.171:0/371800490 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f1c6801b020 con 0x7f1c7015ba00 2024-03-19T06:20:45.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.988+0000 7f1c6cc00640 1 -- 172.21.15.171:0/371800490 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f1c6801de00 con 0x7f1c7015ba00 2024-03-19T06:20:45.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.988+0000 7f1c77c00640 1 -- 172.21.15.171:0/371800490 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c700749e0 con 0x7f1c7015ba00 2024-03-19T06:20:45.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:45.988+0000 7f1c6cc00640 1 -- 172.21.15.171:0/371800490 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1c68022030 con 0x7f1c7015ba00 2024-03-19T06:20:46.050 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.056+0000 7f1c77c00640 1 -- 172.21.15.171:0/371800490 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0fbf6c55-4612-4c22-b803-1ed93ad316b9", "id": 5} v 0) v1 -- 0x7f1c700cf0b0 con 0x7f1c7015ba00 2024-03-19T06:20:46.051 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.060+0000 7f1c6cc00640 1 -- 172.21.15.171:0/371800490 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0fbf6c55-4612-4c22-b803-1ed93ad316b9", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1c68010040 con 0x7f1c7015ba00 2024-03-19T06:20:46.052 INFO:teuthology.orchestra.run.smithi171.stdout:5 2024-03-19T06:20:46.053 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.060+0000 7f1c77c00640 1 -- 172.21.15.171:0/371800490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c7015ba00 msgr2=0x7f1c700ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:46.053 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.060+0000 7f1c77c00640 1 --2- 172.21.15.171:0/371800490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c7015ba00 0x7f1c700ca790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1c700cbe00 tx=0x7f1c6800ef90 comp rx=0 tx=0).stop 2024-03-19T06:20:46.053 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.060+0000 7f1c77c00640 1 -- 172.21.15.171:0/371800490 shutdown_connections 2024-03-19T06:20:46.053 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.060+0000 7f1c77c00640 1 --2- 172.21.15.171:0/371800490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c7015ba00 0x7f1c700ca790 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.053 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.060+0000 7f1c77c00640 1 --2- 172.21.15.171:0/371800490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c700b7530 0x7f1c7015cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.053 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.060+0000 7f1c77c00640 1 --2- 172.21.15.171:0/371800490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c700b3de0 0x7f1c7015ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.053 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.060+0000 7f1c77c00640 1 -- 172.21.15.171:0/371800490 >> 172.21.15.171:0/371800490 conn(0x7f1c70066ca0 msgr2=0x7f1c700b36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:46.053 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.064+0000 7f1c77c00640 1 -- 172.21.15.171:0/371800490 shutdown_connections 2024-03-19T06:20:46.053 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.064+0000 7f1c77c00640 1 -- 172.21.15.171:0/371800490 wait complete. 2024-03-19T06:20:46.071 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 9a47209c-4cdd-4a80-9b5b-711e4972c996 6 2024-03-19T06:20:46.207 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.216+0000 7f2cfc000640 1 Processor -- start 2024-03-19T06:20:46.207 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.216+0000 7f2cfc000640 1 -- start start 2024-03-19T06:20:46.208 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.216+0000 7f2cfc000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2cf415bae0 0x7f2cf40700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:46.209 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.216+0000 7f2cfc000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2cf415fb20 0x7f2cf406b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:46.209 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.216+0000 7f2cfc000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf415bf70 con 0x7f2cf415b700 2024-03-19T06:20:46.209 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.216+0000 7f2cfc000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf40705f0 con 0x7f2cf415fb20 2024-03-19T06:20:46.209 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.216+0000 7f2cfc000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf406b250 con 0x7f2cf415bae0 2024-03-19T06:20:46.209 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.216+0000 7f2cf8c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2cf415bae0 0x7f2cf40700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:46.209 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.216+0000 7f2cf8c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2cf415bae0 0x7f2cf40700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:43474/0 (socket says 172.21.15.171:43474) 2024-03-19T06:20:46.209 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.216+0000 7f2cf8c00640 1 -- 172.21.15.171:0/1309060342 learned_addr learned my addr 172.21.15.171:0/1309060342 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-03-19T06:20:46.209 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.216+0000 7f2cfa000640 1 --2- 172.21.15.171:0/1309060342 >> v2:172.21.15.32:3300/0 conn(0x7f2cf415fb20 0x7f2cf406b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:46.209 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.216+0000 7f2cf8c00640 1 -- 172.21.15.171:0/1309060342 >> v2:172.21.15.32:3300/0 conn(0x7f2cf415fb20 msgr2=0x7f2cf406b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:20:46.209 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.220+0000 7f2cf8c00640 1 --2- 172.21.15.171:0/1309060342 >> v2:172.21.15.32:3300/0 conn(0x7f2cf415fb20 0x7f2cf406b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.209 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.220+0000 7f2cf8c00640 1 -- 172.21.15.171:0/1309060342 >> v1:172.21.15.32:6789/0 conn(0x7f2cf415b700 legacy=0x7f2cf415f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:46.209 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.220+0000 7f2cf8c00640 1 -- 172.21.15.171:0/1309060342 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf406ec40 con 0x7f2cf415bae0 2024-03-19T06:20:46.211 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.220+0000 7f2cf8c00640 1 --2- 172.21.15.171:0/1309060342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cf415bae0 0x7f2cf40700b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40b5440 tx=0x7f2ce001c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33e42d02c2fe4465 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:46.212 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.220+0000 7f2cf3e00640 1 -- 172.21.15.171:0/1309060342 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00aa650 con 0x7f2cf415bae0 2024-03-19T06:20:46.212 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.220+0000 7f2cf3e00640 1 -- 172.21.15.171:0/1309060342 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce00af070 con 0x7f2cf415bae0 2024-03-19T06:20:46.212 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.220+0000 7f2cf3e00640 1 -- 172.21.15.171:0/1309060342 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00aaa10 con 0x7f2cf415bae0 2024-03-19T06:20:46.212 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.220+0000 7f2cfc000640 1 -- 172.21.15.171:0/1309060342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cf415bae0 msgr2=0x7f2cf40700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:46.212 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.220+0000 7f2cfc000640 1 --2- 172.21.15.171:0/1309060342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cf415bae0 0x7f2cf40700b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40b5440 tx=0x7f2ce001c4f0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.213 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.220+0000 7f2cfc000640 1 -- 172.21.15.171:0/1309060342 shutdown_connections 2024-03-19T06:20:46.213 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.220+0000 7f2cfc000640 1 --2- 172.21.15.171:0/1309060342 >> v2:172.21.15.32:3300/0 conn(0x7f2cf415fb20 0x7f2cf406b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.213 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.220+0000 7f2cfc000640 1 --2- 172.21.15.171:0/1309060342 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cf415bae0 0x7f2cf40700b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.213 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.220+0000 7f2cfc000640 1 -- 172.21.15.171:0/1309060342 >> 172.21.15.171:0/1309060342 conn(0x7f2cf40d0490 msgr2=0x7f2cf40d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:46.213 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.220+0000 7f2cfc000640 1 -- 172.21.15.171:0/1309060342 shutdown_connections 2024-03-19T06:20:46.213 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cfc000640 1 -- 172.21.15.171:0/1309060342 wait complete. 2024-03-19T06:20:46.214 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cfc000640 1 Processor -- start 2024-03-19T06:20:46.214 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cfc000640 1 -- start start 2024-03-19T06:20:46.216 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cfc000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cf415b700 0x7f2cf413f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:46.216 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cfc000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cf415bae0 0x7f2cf413eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:46.216 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cfc000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cf415fb20 0x7f2cf4142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:46.216 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cfc000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf406c5b0 con 0x7f2cf415b700 2024-03-19T06:20:46.216 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cfc000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf406c430 con 0x7f2cf415fb20 2024-03-19T06:20:46.216 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cfc000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf406c730 con 0x7f2cf415bae0 2024-03-19T06:20:46.216 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cf8c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cf415bae0 0x7f2cf413eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:46.216 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cfa000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cf415fb20 0x7f2cf4142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:46.216 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cfa000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cf415fb20 0x7f2cf4142130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:43482/0 (socket says 172.21.15.171:43482) 2024-03-19T06:20:46.216 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cfa000640 1 -- 172.21.15.171:0/2004884656 learned_addr learned my addr 172.21.15.171:0/2004884656 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-03-19T06:20:46.217 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cf9600640 1 --2- 172.21.15.171:0/2004884656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cf415b700 0x7f2cf413f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:46.217 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cf8c00640 1 -- 172.21.15.171:0/2004884656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cf415fb20 msgr2=0x7f2cf4142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:46.217 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cf8c00640 1 --2- 172.21.15.171:0/2004884656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cf415fb20 0x7f2cf4142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.217 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cf8c00640 1 -- 172.21.15.171:0/2004884656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cf415b700 msgr2=0x7f2cf413f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:46.217 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cf8c00640 1 --2- 172.21.15.171:0/2004884656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cf415b700 0x7f2cf413f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.217 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cf8c00640 1 -- 172.21.15.171:0/2004884656 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf4157e20 con 0x7f2cf415bae0 2024-03-19T06:20:46.217 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cfa000640 1 --2- 172.21.15.171:0/2004884656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cf415fb20 0x7f2cf4142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:20:46.218 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cf8c00640 1 --2- 172.21.15.171:0/2004884656 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cf415bae0 0x7f2cf413eed0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00ab000 tx=0x7f2ce001ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:46.218 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cf1600640 1 -- 172.21.15.171:0/2004884656 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00bd5f0 con 0x7f2cf415bae0 2024-03-19T06:20:46.218 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.224+0000 7f2cf1600640 1 -- 172.21.15.171:0/2004884656 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce00a6040 con 0x7f2cf415bae0 2024-03-19T06:20:46.218 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.228+0000 7f2cfc000640 1 -- 172.21.15.171:0/2004884656 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf4142670 con 0x7f2cf415bae0 2024-03-19T06:20:46.218 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.228+0000 7f2cf1600640 1 -- 172.21.15.171:0/2004884656 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00bd9f0 con 0x7f2cf415bae0 2024-03-19T06:20:46.218 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.228+0000 7f2cfc000640 1 -- 172.21.15.171:0/2004884656 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf4157b40 con 0x7f2cf415bae0 2024-03-19T06:20:46.219 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.228+0000 7f2cf1600640 1 -- 172.21.15.171:0/2004884656 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f2ce00b33f0 con 0x7f2cf415bae0 2024-03-19T06:20:46.219 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.228+0000 7f2cf1600640 1 -- 172.21.15.171:0/2004884656 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f2ce00b3cd0 con 0x7f2cf415bae0 2024-03-19T06:20:46.219 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.228+0000 7f2cfc000640 1 -- 172.21.15.171:0/2004884656 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf4067ff0 con 0x7f2cf415bae0 2024-03-19T06:20:46.220 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.228+0000 7f2cf1600640 1 -- 172.21.15.171:0/2004884656 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f2cf4142670 con 0x7f2cf415bae0 2024-03-19T06:20:46.286 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.296+0000 7f2cfc000640 1 -- 172.21.15.171:0/2004884656 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9a47209c-4cdd-4a80-9b5b-711e4972c996", "id": 6} v 0) v1 -- 0x7f2cf415aea0 con 0x7f2cf415bae0 2024-03-19T06:20:46.290 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.300+0000 7f2cf1600640 1 -- 172.21.15.171:0/2004884656 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9a47209c-4cdd-4a80-9b5b-711e4972c996", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2ce00c3060 con 0x7f2cf415bae0 2024-03-19T06:20:46.290 INFO:teuthology.orchestra.run.smithi171.stdout:6 2024-03-19T06:20:46.291 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.300+0000 7f2cfc000640 1 -- 172.21.15.171:0/2004884656 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cf415bae0 msgr2=0x7f2cf413eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:46.291 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.300+0000 7f2cfc000640 1 --2- 172.21.15.171:0/2004884656 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cf415bae0 0x7f2cf413eed0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00ab000 tx=0x7f2ce001ad30 comp rx=0 tx=0).stop 2024-03-19T06:20:46.291 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.300+0000 7f2cfc000640 1 -- 172.21.15.171:0/2004884656 shutdown_connections 2024-03-19T06:20:46.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.300+0000 7f2cfc000640 1 --2- 172.21.15.171:0/2004884656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cf415fb20 0x7f2cf4142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.300+0000 7f2cfc000640 1 --2- 172.21.15.171:0/2004884656 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cf415bae0 0x7f2cf413eed0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.300+0000 7f2cfc000640 1 --2- 172.21.15.171:0/2004884656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cf415b700 0x7f2cf413f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.300+0000 7f2cfc000640 1 -- 172.21.15.171:0/2004884656 >> 172.21.15.171:0/2004884656 conn(0x7f2cf40d0490 msgr2=0x7f2cf415f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:46.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.300+0000 7f2cfc000640 1 -- 172.21.15.171:0/2004884656 shutdown_connections 2024-03-19T06:20:46.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.300+0000 7f2cfc000640 1 -- 172.21.15.171:0/2004884656 wait complete. 2024-03-19T06:20:46.309 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 1a87a320-7f3e-4a5e-ac33-5006d45551ff 7 2024-03-19T06:20:46.445 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.456+0000 7fe30f000640 1 Processor -- start 2024-03-19T06:20:46.445 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.456+0000 7fe30f000640 1 -- start start 2024-03-19T06:20:46.447 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.456+0000 7fe30f000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe30815ba00 0x7fe3080b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:46.447 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.456+0000 7fe30f000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe3080b7530 0x7fe3080b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:46.447 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.456+0000 7fe30f000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3080b4010 con 0x7fe3080b3c10 2024-03-19T06:20:46.447 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.456+0000 7fe30f000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3080d20c0 con 0x7fe30815ba00 2024-03-19T06:20:46.447 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.456+0000 7fe30f000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3080d08f0 con 0x7fe3080b7530 2024-03-19T06:20:46.447 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.456+0000 7fe307400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe3080b7530 0x7fe3080b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:46.447 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.456+0000 7fe307400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe3080b7530 0x7fe3080b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:43498/0 (socket says 172.21.15.171:43498) 2024-03-19T06:20:46.447 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.456+0000 7fe307400640 1 -- 172.21.15.171:0/781138578 learned_addr learned my addr 172.21.15.171:0/781138578 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-03-19T06:20:46.447 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.456+0000 7fe307e00640 1 --2- 172.21.15.171:0/781138578 >> v2:172.21.15.32:3300/0 conn(0x7fe30815ba00 0x7fe3080b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:46.447 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.456+0000 7fe307400640 1 -- 172.21.15.171:0/781138578 >> v2:172.21.15.32:3300/0 conn(0x7fe30815ba00 msgr2=0x7fe3080b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:20:46.448 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.456+0000 7fe307400640 1 --2- 172.21.15.171:0/781138578 >> v2:172.21.15.32:3300/0 conn(0x7fe30815ba00 0x7fe3080b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.448 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.456+0000 7fe307400640 1 -- 172.21.15.171:0/781138578 >> v1:172.21.15.32:6789/0 conn(0x7fe3080b3c10 legacy=0x7fe30815f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:46.448 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.456+0000 7fe307400640 1 -- 172.21.15.171:0/781138578 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3080d14b0 con 0x7fe3080b7530 2024-03-19T06:20:46.448 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.456+0000 7fe307e00640 1 --2- 172.21.15.171:0/781138578 >> v2:172.21.15.32:3300/0 conn(0x7fe30815ba00 0x7fe3080b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:20:46.450 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.460+0000 7fe307400640 1 --2- 172.21.15.171:0/781138578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3080b7530 0x7fe3080b36d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe3080ce4b0 tx=0x7fe2f401ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b250abc5533a7bb0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:46.450 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.460+0000 7fe306a00640 1 -- 172.21.15.171:0/781138578 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40b5070 con 0x7fe3080b7530 2024-03-19T06:20:46.450 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.460+0000 7fe306a00640 1 -- 172.21.15.171:0/781138578 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f40a8a10 con 0x7fe3080b7530 2024-03-19T06:20:46.450 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.460+0000 7fe306a00640 1 -- 172.21.15.171:0/781138578 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40a8de0 con 0x7fe3080b7530 2024-03-19T06:20:46.451 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.460+0000 7fe30f000640 1 -- 172.21.15.171:0/781138578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3080b7530 msgr2=0x7fe3080b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:46.451 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.460+0000 7fe30f000640 1 --2- 172.21.15.171:0/781138578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3080b7530 0x7fe3080b36d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe3080ce4b0 tx=0x7fe2f401ed10 comp rx=0 tx=0).stop 2024-03-19T06:20:46.451 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.460+0000 7fe30f000640 1 -- 172.21.15.171:0/781138578 shutdown_connections 2024-03-19T06:20:46.451 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.460+0000 7fe30f000640 1 --2- 172.21.15.171:0/781138578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3080b7530 0x7fe3080b36d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.451 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.460+0000 7fe30f000640 1 --2- 172.21.15.171:0/781138578 >> v2:172.21.15.32:3300/0 conn(0x7fe30815ba00 0x7fe3080b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.452 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.460+0000 7fe30f000640 1 -- 172.21.15.171:0/781138578 >> 172.21.15.171:0/781138578 conn(0x7fe308066ca0 msgr2=0x7fe3080670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:46.452 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.460+0000 7fe30f000640 1 -- 172.21.15.171:0/781138578 shutdown_connections 2024-03-19T06:20:46.452 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.460+0000 7fe30f000640 1 -- 172.21.15.171:0/781138578 wait complete. 2024-03-19T06:20:46.452 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.460+0000 7fe30f000640 1 Processor -- start 2024-03-19T06:20:46.453 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe30f000640 1 -- start start 2024-03-19T06:20:46.458 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe30f000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3080b3c10 0x7fe3080c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:46.458 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe30f000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3080b7530 0x7fe30815c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:46.458 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe30f000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe30815ba00 0x7fe30815c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:46.458 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe30f000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080d1d50 con 0x7fe30815ba00 2024-03-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe30f000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080d1a70 con 0x7fe3080b7530 2024-03-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe30f000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30815bde0 con 0x7fe3080b3c10 2024-03-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe307400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3080b7530 0x7fe30815c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe307400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3080b7530 0x7fe30815c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:43514/0 (socket says 172.21.15.171:43514) 2024-03-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe307400640 1 -- 172.21.15.171:0/4094543069 learned_addr learned my addr 172.21.15.171:0/4094543069 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-03-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe307e00640 1 --2- 172.21.15.171:0/4094543069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3080b3c10 0x7fe3080c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe30d000640 1 --2- 172.21.15.171:0/4094543069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe30815ba00 0x7fe30815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe307400640 1 -- 172.21.15.171:0/4094543069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3080b3c10 msgr2=0x7fe3080c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe307400640 1 --2- 172.21.15.171:0/4094543069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3080b3c10 0x7fe3080c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe307400640 1 -- 172.21.15.171:0/4094543069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe30815ba00 msgr2=0x7fe30815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe307400640 1 --2- 172.21.15.171:0/4094543069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe30815ba00 0x7fe30815c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe307400640 1 -- 172.21.15.171:0/4094543069 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3080c9e60 con 0x7fe3080b7530 2024-03-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe307e00640 1 --2- 172.21.15.171:0/4094543069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3080b3c10 0x7fe3080c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:20:46.460 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe307400640 1 --2- 172.21.15.171:0/4094543069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3080b7530 0x7fe30815c0e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40b3040 tx=0x7fe2f401bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:46.460 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe2ffe00640 1 -- 172.21.15.171:0/4094543069 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40b5070 con 0x7fe3080b7530 2024-03-19T06:20:46.460 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe2ffe00640 1 -- 172.21.15.171:0/4094543069 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f40b0a90 con 0x7fe3080b7530 2024-03-19T06:20:46.460 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe2ffe00640 1 -- 172.21.15.171:0/4094543069 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40bb410 con 0x7fe3080b7530 2024-03-19T06:20:46.460 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe30f000640 1 -- 172.21.15.171:0/4094543069 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3080ca100 con 0x7fe3080b7530 2024-03-19T06:20:46.460 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe30f000640 1 -- 172.21.15.171:0/4094543069 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3080ca6c0 con 0x7fe3080b7530 2024-03-19T06:20:46.460 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe2ffe00640 1 -- 172.21.15.171:0/4094543069 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe2f40c2060 con 0x7fe3080b7530 2024-03-19T06:20:46.460 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe2ffe00640 1 -- 172.21.15.171:0/4094543069 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fe2f40ba3c0 con 0x7fe3080b7530 2024-03-19T06:20:46.460 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.464+0000 7fe30f000640 1 -- 172.21.15.171:0/4094543069 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3080749e0 con 0x7fe3080b7530 2024-03-19T06:20:46.460 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:46.464+0000 7f94806c8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-19T06:20:46.461 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.468+0000 7fe2ffe00640 1 -- 172.21.15.171:0/4094543069 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fe2f40dbdd0 con 0x7fe3080b7530 2024-03-19T06:20:46.466 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:46.473+0000 7ff4555db180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-19T06:20:46.521 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:46.532+0000 7f94806c8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-19T06:20:46.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.536+0000 7fe30f000640 1 -- 172.21.15.171:0/4094543069 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1a87a320-7f3e-4a5e-ac33-5006d45551ff", "id": 7} v 0) v1 -- 0x7fe3080cf0b0 con 0x7fe3080b7530 2024-03-19T06:20:46.530 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.540+0000 7fe2ffe00640 1 -- 172.21.15.171:0/4094543069 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1a87a320-7f3e-4a5e-ac33-5006d45551ff", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe2f40ca070 con 0x7fe3080b7530 2024-03-19T06:20:46.531 INFO:teuthology.orchestra.run.smithi171.stdout:7 2024-03-19T06:20:46.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.540+0000 7fe30f000640 1 -- 172.21.15.171:0/4094543069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3080b7530 msgr2=0x7fe30815c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:46.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.540+0000 7fe30f000640 1 --2- 172.21.15.171:0/4094543069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3080b7530 0x7fe30815c0e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40b3040 tx=0x7fe2f401bab0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.540+0000 7fe30f000640 1 -- 172.21.15.171:0/4094543069 shutdown_connections 2024-03-19T06:20:46.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.540+0000 7fe30f000640 1 --2- 172.21.15.171:0/4094543069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe30815ba00 0x7fe30815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.540+0000 7fe30f000640 1 --2- 172.21.15.171:0/4094543069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3080b7530 0x7fe30815c0e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.540+0000 7fe30f000640 1 --2- 172.21.15.171:0/4094543069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3080b3c10 0x7fe3080c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.540+0000 7fe30f000640 1 -- 172.21.15.171:0/4094543069 >> 172.21.15.171:0/4094543069 conn(0x7fe308066ca0 msgr2=0x7fe3080b6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:46.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.540+0000 7fe30f000640 1 -- 172.21.15.171:0/4094543069 shutdown_connections 2024-03-19T06:20:46.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:20:46.540+0000 7fe30f000640 1 -- 172.21.15.171:0/4094543069 wait complete. 2024-03-19T06:20:46.533 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:46.541+0000 7ff4555db180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-19T06:20:46.550 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-19T06:20:46.550 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-19T06:20:46.553 INFO:tasks.ceph.osd.0:Started 2024-03-19T06:20:46.553 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-19T06:20:46.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-19T06:20:46.557 INFO:tasks.ceph.osd.1:Started 2024-03-19T06:20:46.557 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-19T06:20:46.557 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-19T06:20:46.560 INFO:tasks.ceph.osd.2:Started 2024-03-19T06:20:46.560 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-19T06:20:46.560 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-19T06:20:46.564 INFO:tasks.ceph.osd.3:Started 2024-03-19T06:20:46.564 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-19T06:20:46.564 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-19T06:20:46.567 INFO:tasks.ceph.osd.4:Started 2024-03-19T06:20:46.568 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-19T06:20:46.568 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-19T06:20:46.570 INFO:tasks.ceph.osd.5:Started 2024-03-19T06:20:46.571 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-19T06:20:46.571 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-19T06:20:46.574 INFO:tasks.ceph.osd.6:Started 2024-03-19T06:20:46.574 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-19T06:20:46.574 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-19T06:20:46.580 INFO:tasks.ceph.osd.7:Started 2024-03-19T06:20:46.580 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:20:46.586 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:46.596+0000 7f94806c8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-19T06:20:46.617 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:46.625+0000 7ff4555db180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-19T06:20:46.712 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:46.720+0000 7f94806c8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-19T06:20:46.729 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:46.737+0000 7ff4555db180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-19T06:20:46.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f1906a00640 1 Processor -- start 2024-03-19T06:20:46.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f1906a00640 1 -- start start 2024-03-19T06:20:46.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f1906a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1900159ed0 0x7f19000cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:46.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f1906a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f190015a2b0 0x7f19000caf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:46.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f1906a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19000ce3e0 con 0x7f19000cdb40 2024-03-19T06:20:46.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f1906a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19000ca1d0 con 0x7f190015a2b0 2024-03-19T06:20:46.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f1906a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19000ca4b0 con 0x7f1900159ed0 2024-03-19T06:20:46.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f18ff400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f190015a2b0 0x7f19000caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:46.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f18ff400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f190015a2b0 0x7f19000caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39000/0 (socket says 172.21.15.32:39000) 2024-03-19T06:20:46.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f1904a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f19000cdb40 0x7f1900071350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42826/0 (socket says 172.21.15.32:42826) 2024-03-19T06:20:46.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f18ff400640 1 -- 172.21.15.32:0/1937022555 learned_addr learned my addr 172.21.15.32:0/1937022555 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:20:46.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f18ffe00640 1 --2- 172.21.15.32:0/1937022555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1900159ed0 0x7f19000cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:46.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f18ff400640 1 -- 172.21.15.32:0/1937022555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1900159ed0 msgr2=0x7f19000cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:20:46.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f18ff400640 1 --2- 172.21.15.32:0/1937022555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1900159ed0 0x7f19000cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f18ff400640 1 -- 172.21.15.32:0/1937022555 >> v1:172.21.15.32:6789/0 conn(0x7f19000cdb40 legacy=0x7f1900071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:46.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f18ff400640 1 -- 172.21.15.32:0/1937022555 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19000ca790 con 0x7f190015a2b0 2024-03-19T06:20:46.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.777+0000 7f18fea00640 1 -- 172.21.15.32:0/1937022555 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852873971 0 0) 0x7f19000ce3e0 con 0x7f19000cdb40 2024-03-19T06:20:46.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.781+0000 7f18ff400640 1 --2- 172.21.15.32:0/1937022555 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f190015a2b0 0x7f19000caf90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f18ec009870 tx=0x7f18ec01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d38c1c2bd8f8d77 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:46.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.781+0000 7f18fea00640 1 -- 172.21.15.32:0/1937022555 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0ab640 con 0x7f190015a2b0 2024-03-19T06:20:46.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.781+0000 7f18fea00640 1 -- 172.21.15.32:0/1937022555 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec0b0070 con 0x7f190015a2b0 2024-03-19T06:20:46.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.781+0000 7f18fea00640 1 -- 172.21.15.32:0/1937022555 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0aba00 con 0x7f190015a2b0 2024-03-19T06:20:46.773 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:46.784+0000 7f94806c8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-19T06:20:46.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.781+0000 7f1906a00640 1 -- 172.21.15.32:0/1937022555 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f190015a2b0 msgr2=0x7f19000caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:46.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.781+0000 7f1906a00640 1 --2- 172.21.15.32:0/1937022555 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f190015a2b0 0x7f19000caf90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f18ec009870 tx=0x7f18ec01c4a0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.781+0000 7f1906a00640 1 -- 172.21.15.32:0/1937022555 shutdown_connections 2024-03-19T06:20:46.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.781+0000 7f1906a00640 1 --2- 172.21.15.32:0/1937022555 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f190015a2b0 0x7f19000caf90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.781+0000 7f1906a00640 1 --2- 172.21.15.32:0/1937022555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1900159ed0 0x7f19000cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.781+0000 7f1906a00640 1 -- 172.21.15.32:0/1937022555 >> 172.21.15.32:0/1937022555 conn(0x7f19000b1280 msgr2=0x7f19000b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:46.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.781+0000 7f1906a00640 1 -- 172.21.15.32:0/1937022555 shutdown_connections 2024-03-19T06:20:46.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.781+0000 7f1906a00640 1 -- 172.21.15.32:0/1937022555 wait complete. 2024-03-19T06:20:46.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f1906a00640 1 Processor -- start 2024-03-19T06:20:46.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f1906a00640 1 -- start start 2024-03-19T06:20:46.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f1906a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19000cdb40 0x7f19000b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:46.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f1906a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1900159ed0 0x7f19000ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:46.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f1906a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f190015a2b0 0x7f19000a97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:46.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f1906a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1900071a60 con 0x7f19000cdb40 2024-03-19T06:20:46.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f1906a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19000ce1a0 con 0x7f190015a2b0 2024-03-19T06:20:46.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f1906a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1900071be0 con 0x7f1900159ed0 2024-03-19T06:20:46.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f18ffe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19000cdb40 0x7f19000b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:46.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f18ffe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19000cdb40 0x7f19000b4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39016/0 (socket says 172.21.15.32:39016) 2024-03-19T06:20:46.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f18ffe00640 1 -- 172.21.15.32:0/946832098 learned_addr learned my addr 172.21.15.32:0/946832098 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:20:46.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f18ff400640 1 --2- 172.21.15.32:0/946832098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1900159ed0 0x7f19000ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:46.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f1904a00640 1 --2- 172.21.15.32:0/946832098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f190015a2b0 0x7f19000a97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:46.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f18ffe00640 1 -- 172.21.15.32:0/946832098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1900159ed0 msgr2=0x7f19000ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:46.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f18ffe00640 1 --2- 172.21.15.32:0/946832098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1900159ed0 0x7f19000ad9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f18ffe00640 1 -- 172.21.15.32:0/946832098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f190015a2b0 msgr2=0x7f19000a97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:46.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f18ffe00640 1 --2- 172.21.15.32:0/946832098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f190015a2b0 0x7f19000a97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f18ffe00640 1 -- 172.21.15.32:0/946832098 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19000b3690 con 0x7f19000cdb40 2024-03-19T06:20:46.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f18ffe00640 1 --2- 172.21.15.32:0/946832098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19000cdb40 0x7f19000b4730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18f000e870 tx=0x7f18f000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:46.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f18f7e00640 1 -- 172.21.15.32:0/946832098 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0017070 con 0x7f19000cdb40 2024-03-19T06:20:46.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f18f7e00640 1 -- 172.21.15.32:0/946832098 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f000c940 con 0x7f19000cdb40 2024-03-19T06:20:46.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f18f7e00640 1 -- 172.21.15.32:0/946832098 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f000ccf0 con 0x7f19000cdb40 2024-03-19T06:20:46.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f1906a00640 1 -- 172.21.15.32:0/946832098 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19000b3970 con 0x7f19000cdb40 2024-03-19T06:20:46.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f1906a00640 1 -- 172.21.15.32:0/946832098 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19000b3f30 con 0x7f19000cdb40 2024-03-19T06:20:46.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f18f7e00640 1 -- 172.21.15.32:0/946832098 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f18f001a070 con 0x7f19000cdb40 2024-03-19T06:20:46.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.785+0000 7f18f7e00640 1 -- 172.21.15.32:0/946832098 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f18f001cb20 con 0x7f19000cdb40 2024-03-19T06:20:46.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.789+0000 7f1906a00640 1 -- 172.21.15.32:0/946832098 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19000749e0 con 0x7f19000cdb40 2024-03-19T06:20:46.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.793+0000 7f18f7e00640 1 -- 172.21.15.32:0/946832098 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f18f001c450 con 0x7f19000cdb40 2024-03-19T06:20:46.797 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:46.805+0000 7ff4555db180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-19T06:20:46.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.849+0000 7f1906a00640 1 -- 172.21.15.32:0/946832098 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1900072600 con 0x7f19000cdb40 2024-03-19T06:20:46.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.853+0000 7f18f7e00640 1 -- 172.21.15.32:0/946832098 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f18f001c630 con 0x7f19000cdb40 2024-03-19T06:20:46.843 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:20:46.843 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":10,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:20:46.540624+0000","last_up_change":"0.000000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:20:46.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.853+0000 7f1906a00640 1 -- 172.21.15.32:0/946832098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19000cdb40 msgr2=0x7f19000b4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:46.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.853+0000 7f1906a00640 1 --2- 172.21.15.32:0/946832098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19000cdb40 0x7f19000b4730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18f000e870 tx=0x7f18f000ec70 comp rx=0 tx=0).stop 2024-03-19T06:20:46.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.853+0000 7f1906a00640 1 -- 172.21.15.32:0/946832098 shutdown_connections 2024-03-19T06:20:46.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.853+0000 7f1906a00640 1 --2- 172.21.15.32:0/946832098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f190015a2b0 0x7f19000a97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.853+0000 7f1906a00640 1 --2- 172.21.15.32:0/946832098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1900159ed0 0x7f19000ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.853+0000 7f1906a00640 1 --2- 172.21.15.32:0/946832098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19000cdb40 0x7f19000b4730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:46.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.853+0000 7f1906a00640 1 -- 172.21.15.32:0/946832098 >> 172.21.15.32:0/946832098 conn(0x7f19000b1280 msgr2=0x7f1900159080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:46.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.853+0000 7f1906a00640 1 -- 172.21.15.32:0/946832098 shutdown_connections 2024-03-19T06:20:46.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:20:46.853+0000 7f1906a00640 1 -- 172.21.15.32:0/946832098 wait complete. 2024-03-19T06:20:46.863 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-19T06:20:46.863 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-19T06:20:46.863 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:46.872+0000 7f94806c8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-19T06:20:46.892 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:46.901+0000 7ff4555db180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-19T06:20:46.925 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:46.936+0000 7f94806c8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-19T06:20:46.959 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:46.969+0000 7ff4555db180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-19T06:20:47.092 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:47.100+0000 7f94806c8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-19T06:20:47.133 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:47.141+0000 7ff4555db180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-19T06:20:47.163 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:47.172+0000 7f94806c8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-19T06:20:47.200 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-03-19T06:20:47.209+0000 7f4d1a1d67c0 -1 Falling back to public interface 2024-03-19T06:20:47.206 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-03-19T06:20:47.216+0000 7eff958487c0 -1 Falling back to public interface 2024-03-19T06:20:47.208 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:47.217+0000 7ff4555db180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-19T06:20:47.211 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-03-19T06:20:47.221+0000 7f29e46957c0 -1 Falling back to public interface 2024-03-19T06:20:47.222 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-03-19T06:20:47.232+0000 7f90e064a7c0 -1 Falling back to public interface 2024-03-19T06:20:47.224 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-03-19T06:20:47.233+0000 7f364882c7c0 -1 Falling back to public interface 2024-03-19T06:20:47.239 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-03-19T06:20:47.248+0000 7f34d659d7c0 -1 Falling back to public interface 2024-03-19T06:20:47.240 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-03-19T06:20:47.249+0000 7f73a28d47c0 -1 Falling back to public interface 2024-03-19T06:20:47.267 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-03-19T06:20:47.276+0000 7fc724b0b7c0 -1 Falling back to public interface 2024-03-19T06:20:47.669 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-19T06:20:47.799 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.809+0000 7f0906c00640 1 Processor -- start 2024-03-19T06:20:47.800 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.809+0000 7f0906c00640 1 -- start start 2024-03-19T06:20:47.801 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.809+0000 7f0906c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09000b0b40 0x7f09000cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:47.801 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.809+0000 7f0906c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0900073400 con 0x7f09000b0f20 2024-03-19T06:20:47.801 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.809+0000 7f0906c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09000ce690 con 0x7f09000d03a0 2024-03-19T06:20:47.801 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.809+0000 7f0906c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09000ccbc0 con 0x7f09000b0b40 2024-03-19T06:20:47.801 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.809+0000 7f08f7400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f09000b0f20 0x7f09000cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42828/0 (socket says 172.21.15.32:42828) 2024-03-19T06:20:47.801 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.809+0000 7f08f7400640 1 -- 172.21.15.32:0/2089347506 learned_addr learned my addr 172.21.15.32:0/2089347506 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:20:47.801 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.809+0000 7f08ffe00640 1 --2- 172.21.15.32:0/2089347506 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09000b0b40 0x7f09000cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:47.802 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.809+0000 7f08ff400640 1 -- 172.21.15.32:0/2089347506 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364607753 0 0) 0x7f0900073400 con 0x7f09000b0f20 2024-03-19T06:20:47.802 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.809+0000 7f08ff400640 1 -- 172.21.15.32:0/2089347506 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08e4003530 con 0x7f09000b0f20 2024-03-19T06:20:47.803 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.809+0000 7f08ff400640 1 -- 172.21.15.32:0/2089347506 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411660502 0 0) 0x7f09000ce690 con 0x7f09000d03a0 2024-03-19T06:20:47.803 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.809+0000 7f08ff400640 1 -- 172.21.15.32:0/2089347506 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0900073400 con 0x7f09000d03a0 2024-03-19T06:20:47.803 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.809+0000 7f08ffe00640 1 -- 172.21.15.32:0/2089347506 >> v1:172.21.15.171:6789/0 conn(0x7f09000d03a0 legacy=0x7f090006adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:47.803 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.809+0000 7f08ffe00640 1 -- 172.21.15.32:0/2089347506 >> v1:172.21.15.32:6789/0 conn(0x7f09000b0f20 legacy=0x7f09000cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:47.803 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.809+0000 7f08ffe00640 1 -- 172.21.15.32:0/2089347506 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09000ccea0 con 0x7f09000b0b40 2024-03-19T06:20:47.806 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.813+0000 7f08ffe00640 1 --2- 172.21.15.32:0/2089347506 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09000b0b40 0x7f09000cdc60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f08f00097f0 tx=0x7f08f001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe5783cdcdc25a93 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:47.807 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.813+0000 7f08ff400640 1 -- 172.21.15.32:0/2089347506 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f00ab620 con 0x7f09000b0b40 2024-03-19T06:20:47.807 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.813+0000 7f08ff400640 1 -- 172.21.15.32:0/2089347506 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f00b0070 con 0x7f09000b0b40 2024-03-19T06:20:47.807 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.813+0000 7f08ff400640 1 -- 172.21.15.32:0/2089347506 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f00ab9c0 con 0x7f09000b0b40 2024-03-19T06:20:47.807 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.813+0000 7f0906c00640 1 -- 172.21.15.32:0/2089347506 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09000b0b40 msgr2=0x7f09000cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:47.807 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.813+0000 7f0906c00640 1 --2- 172.21.15.32:0/2089347506 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09000b0b40 0x7f09000cdc60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f08f00097f0 tx=0x7f08f001c420 comp rx=0 tx=0).stop 2024-03-19T06:20:47.807 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.813+0000 7f0906c00640 1 -- 172.21.15.32:0/2089347506 shutdown_connections 2024-03-19T06:20:47.807 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.813+0000 7f0906c00640 1 --2- 172.21.15.32:0/2089347506 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09000b0b40 0x7f09000cdc60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:47.807 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.813+0000 7f0906c00640 1 -- 172.21.15.32:0/2089347506 >> 172.21.15.32:0/2089347506 conn(0x7f09000b2310 msgr2=0x7f09000b26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:47.807 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.813+0000 7f0906c00640 1 -- 172.21.15.32:0/2089347506 shutdown_connections 2024-03-19T06:20:47.807 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.813+0000 7f0906c00640 1 -- 172.21.15.32:0/2089347506 wait complete. 2024-03-19T06:20:47.808 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f0906c00640 1 Processor -- start 2024-03-19T06:20:47.808 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f0906c00640 1 -- start start 2024-03-19T06:20:47.810 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f0906c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09000b0b40 0x7f09000c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:47.810 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f0906c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09000b0f20 0x7f0900155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:47.811 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f0906c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09001557d0 0x7f09000c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:47.811 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f0906c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090006b650 con 0x7f09000b0f20 2024-03-19T06:20:47.811 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f0906c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090006b4d0 con 0x7f09001557d0 2024-03-19T06:20:47.811 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f0906c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090015bc70 con 0x7f09000b0b40 2024-03-19T06:20:47.811 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f08f7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09000b0f20 0x7f0900155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:47.811 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f08f7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09000b0f20 0x7f0900155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39020/0 (socket says 172.21.15.32:39020) 2024-03-19T06:20:47.811 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f08f7400640 1 -- 172.21.15.32:0/1868406571 learned_addr learned my addr 172.21.15.32:0/1868406571 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:20:47.811 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f08ffe00640 1 --2- 172.21.15.32:0/1868406571 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09000b0b40 0x7f09000c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:47.811 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f0904c00640 1 --2- 172.21.15.32:0/1868406571 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09001557d0 0x7f09000c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:47.811 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f08f7400640 1 -- 172.21.15.32:0/1868406571 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09000b0b40 msgr2=0x7f09000c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:47.811 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f08f7400640 1 --2- 172.21.15.32:0/1868406571 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09000b0b40 0x7f09000c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:47.811 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f08f7400640 1 -- 172.21.15.32:0/1868406571 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09001557d0 msgr2=0x7f09000c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:47.811 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f08f7400640 1 --2- 172.21.15.32:0/1868406571 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09001557d0 0x7f09000c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:47.811 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f08f7400640 1 -- 172.21.15.32:0/1868406571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0900155c80 con 0x7f09000b0f20 2024-03-19T06:20:47.812 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f08f7400640 1 --2- 172.21.15.32:0/1868406571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09000b0f20 0x7f0900155290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f08e800cbf0 tx=0x7f08e800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:47.812 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f08fcc00640 1 -- 172.21.15.32:0/1868406571 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8017070 con 0x7f09000b0f20 2024-03-19T06:20:47.812 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f08fcc00640 1 -- 172.21.15.32:0/1868406571 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e800ad50 con 0x7f09000b0f20 2024-03-19T06:20:47.812 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f08fcc00640 1 -- 172.21.15.32:0/1868406571 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8012620 con 0x7f09000b0f20 2024-03-19T06:20:47.812 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f0906c00640 1 -- 172.21.15.32:0/1868406571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09000c73a0 con 0x7f09000b0f20 2024-03-19T06:20:47.812 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f0906c00640 1 -- 172.21.15.32:0/1868406571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09000c65d0 con 0x7f09000b0f20 2024-03-19T06:20:47.812 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f08fcc00640 1 -- 172.21.15.32:0/1868406571 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f08e801a070 con 0x7f09000b0f20 2024-03-19T06:20:47.812 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.817+0000 7f08fcc00640 1 -- 172.21.15.32:0/1868406571 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f08e801c440 con 0x7f09000b0f20 2024-03-19T06:20:47.812 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.821+0000 7f0906c00640 1 -- 172.21.15.32:0/1868406571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09000750b0 con 0x7f09000b0f20 2024-03-19T06:20:47.813 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.821+0000 7f08fcc00640 1 -- 172.21.15.32:0/1868406571 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f08e8021020 con 0x7f09000b0f20 2024-03-19T06:20:47.836 INFO:tasks.ceph.mgr.x.smithi171.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-19T06:20:47.836 INFO:tasks.ceph.mgr.x.smithi171.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-19T06:20:47.836 INFO:tasks.ceph.mgr.x.smithi171.stderr: from numpy import show_config as show_numpy_config 2024-03-19T06:20:47.846 INFO:tasks.ceph.mgr.y.smithi032.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-19T06:20:47.847 INFO:tasks.ceph.mgr.y.smithi032.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-19T06:20:47.847 INFO:tasks.ceph.mgr.y.smithi032.stderr: from numpy import show_config as show_numpy_config 2024-03-19T06:20:47.879 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.889+0000 7f0906c00640 1 -- 172.21.15.32:0/1868406571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0900066ff0 con 0x7f09000b0f20 2024-03-19T06:20:47.880 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.889+0000 7f08fcc00640 1 -- 172.21.15.32:0/1868406571 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f08e8007070 con 0x7f09000b0f20 2024-03-19T06:20:47.880 INFO:teuthology.misc.health.smithi032.stdout: 2024-03-19T06:20:47.880 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":10,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:20:46.540624+0000","last_up_change":"0.000000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:20:47.881 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:47.888+0000 7f94806c8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-19T06:20:47.882 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.889+0000 7f0906c00640 1 -- 172.21.15.32:0/1868406571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09000b0f20 msgr2=0x7f0900155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:47.882 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.889+0000 7f0906c00640 1 --2- 172.21.15.32:0/1868406571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09000b0f20 0x7f0900155290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f08e800cbf0 tx=0x7f08e800a430 comp rx=0 tx=0).stop 2024-03-19T06:20:47.882 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.889+0000 7f0906c00640 1 -- 172.21.15.32:0/1868406571 shutdown_connections 2024-03-19T06:20:47.882 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.889+0000 7f0906c00640 1 --2- 172.21.15.32:0/1868406571 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09001557d0 0x7f09000c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:47.882 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.889+0000 7f0906c00640 1 --2- 172.21.15.32:0/1868406571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09000b0f20 0x7f0900155290 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:47.882 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.889+0000 7f0906c00640 1 --2- 172.21.15.32:0/1868406571 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09000b0b40 0x7f09000c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:47.882 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.889+0000 7f0906c00640 1 -- 172.21.15.32:0/1868406571 >> 172.21.15.32:0/1868406571 conn(0x7f09000b2310 msgr2=0x7f090006e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:47.882 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.889+0000 7f0906c00640 1 -- 172.21.15.32:0/1868406571 shutdown_connections 2024-03-19T06:20:47.882 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:47.889+0000 7f0906c00640 1 -- 172.21.15.32:0/1868406571 wait complete. 2024-03-19T06:20:47.889 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:47.897+0000 7ff4555db180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-19T06:20:47.898 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-19T06:20:48.029 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:48.040+0000 7f94806c8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-19T06:20:48.046 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:48.053+0000 7ff4555db180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-19T06:20:48.197 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:48.204+0000 7f94806c8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-19T06:20:48.240 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:48.249+0000 7ff4555db180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-19T06:20:48.271 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:48.280+0000 7f94806c8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-19T06:20:48.317 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:48.325+0000 7ff4555db180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-19T06:20:48.419 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:48.428+0000 7f94806c8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-19T06:20:48.476 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:48.485+0000 7ff4555db180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-19T06:20:49.110 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:49.120+0000 7f94806c8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-19T06:20:49.182 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:49.189+0000 7ff4555db180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-19T06:20:49.197 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:49.208+0000 7f94806c8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-19T06:20:49.279 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:49.285+0000 7ff4555db180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-19T06:20:49.398 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:49.408+0000 7f94806c8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-19T06:20:49.484 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:49.492+0000 7f94806c8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-19T06:20:49.490 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:49.497+0000 7ff4555db180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-19T06:20:49.581 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:49.589+0000 7ff4555db180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-19T06:20:49.818 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:49.828+0000 7f94806c8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-19T06:20:49.888 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:49.896+0000 7f94806c8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-19T06:20:49.952 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:49.961+0000 7ff4555db180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-19T06:20:50.056 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-03-19T06:20:50.065+0000 7ff4555db180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-19T06:20:50.857 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-03-19T06:20:50.865+0000 7f364882c7c0 -1 osd.3 0 log_to_monitors true 2024-03-19T06:20:50.879 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-03-19T06:20:50.888+0000 7eff958487c0 -1 osd.4 0 log_to_monitors true 2024-03-19T06:20:50.910 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:50.920+0000 7f9426800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-19T06:20:50.911 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-03-19T06:20:50.920+0000 7f9426800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-19T06:20:50.944 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-03-19T06:20:50.952+0000 7f90e064a7c0 -1 osd.5 0 log_to_monitors true 2024-03-19T06:20:50.981 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-03-19T06:20:50.989+0000 7f73a28d47c0 -1 osd.2 0 log_to_monitors true 2024-03-19T06:20:51.019 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-03-19T06:20:51.029+0000 7f4d1a1d67c0 -1 osd.1 0 log_to_monitors true 2024-03-19T06:20:51.072 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-03-19T06:20:51.080+0000 7f34d659d7c0 -1 osd.7 0 log_to_monitors true 2024-03-19T06:20:51.075 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-03-19T06:20:51.085+0000 7f29e46957c0 -1 osd.0 0 log_to_monitors true 2024-03-19T06:20:51.183 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-03-19T06:20:51.192+0000 7fc724b0b7c0 -1 osd.6 0 log_to_monitors true 2024-03-19T06:20:52.934 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-03-19T06:20:52.941+0000 7f3642400640 -1 osd.3 0 waiting for initial osdmap 2024-03-19T06:20:52.944 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-03-19T06:20:52.952+0000 7eff8fe00640 -1 osd.4 0 waiting for initial osdmap 2024-03-19T06:20:52.969 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-03-19T06:20:52.977+0000 7f3638e00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:20:53.016 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-03-19T06:20:53.024+0000 7eff86800640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:20:54.330 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-03-19T06:20:54.337+0000 7f4d16400640 -1 osd.1 0 waiting for initial osdmap 2024-03-19T06:20:54.332 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-03-19T06:20:54.341+0000 7f739ec00640 -1 osd.2 0 waiting for initial osdmap 2024-03-19T06:20:54.352 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-03-19T06:20:54.361+0000 7f4d0b000640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:20:54.368 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-03-19T06:20:54.377+0000 7f7393800640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:20:54.383 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-03-19T06:20:54.389+0000 7f29dec00640 -1 osd.0 0 waiting for initial osdmap 2024-03-19T06:20:54.424 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-03-19T06:20:54.433+0000 7f29d5600640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:20:54.704 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-19T06:20:54.734 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-03-19T06:20:54.744+0000 7f90dac00640 -1 osd.5 0 waiting for initial osdmap 2024-03-19T06:20:54.751 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-03-19T06:20:54.760+0000 7fc71f000640 -1 osd.6 0 waiting for initial osdmap 2024-03-19T06:20:54.766 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-03-19T06:20:54.776+0000 7f90d1600640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:20:54.767 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-03-19T06:20:54.776+0000 7f34d2800640 -1 osd.7 0 waiting for initial osdmap 2024-03-19T06:20:54.786 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-03-19T06:20:54.796+0000 7fc715a00640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:20:54.798 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-03-19T06:20:54.808+0000 7f34c7400640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:20:54.839 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.845+0000 7f9ed1200640 1 Processor -- start 2024-03-19T06:20:54.839 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.845+0000 7f9ed1200640 1 -- start start 2024-03-19T06:20:54.840 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.849+0000 7f9ed1200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9ecc15da20 0x7f9ecc0b5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:54.840 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.849+0000 7f9ed1200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ecc15de00 0x7f9ecc0b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:54.840 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.849+0000 7f9ed1200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ecc0d3800 con 0x7f9ecc0d1a70 2024-03-19T06:20:54.840 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.849+0000 7f9ed1200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ecc0d2760 con 0x7f9ecc15da20 2024-03-19T06:20:54.840 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.849+0000 7f9ed1200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0d2a40 con 0x7f9ecc15de00 2024-03-19T06:20:54.840 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.849+0000 7f9ec3e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ecc15de00 0x7f9ecc0b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:54.840 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.849+0000 7f9ecb400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9ecc15da20 0x7f9ecc0b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:54.841 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.849+0000 7f9ecbe00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f9ecc0d1a70 0x7f9ecc0d1ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:53000/0 (socket says 172.21.15.32:53000) 2024-03-19T06:20:54.841 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.849+0000 7f9ecbe00640 1 -- 172.21.15.32:0/4220240027 learned_addr learned my addr 172.21.15.32:0/4220240027 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:20:54.841 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.849+0000 7f9ecb400640 1 -- 172.21.15.32:0/4220240027 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ecc15de00 msgr2=0x7f9ecc0b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:20:54.841 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.849+0000 7f9ecb400640 1 --2- 172.21.15.32:0/4220240027 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ecc15de00 0x7f9ecc0b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:54.841 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.849+0000 7f9ecb400640 1 -- 172.21.15.32:0/4220240027 >> v1:172.21.15.171:6789/0 conn(0x7f9ecc0d1a70 legacy=0x7f9ecc0d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:54.841 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.849+0000 7f9ecb400640 1 -- 172.21.15.32:0/4220240027 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0d2d20 con 0x7f9ecc15da20 2024-03-19T06:20:54.841 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.849+0000 7f9ec3e00640 1 --2- 172.21.15.32:0/4220240027 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ecc15de00 0x7f9ecc0b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:20:54.844 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.853+0000 7f9ecb400640 1 --2- 172.21.15.32:0/4220240027 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ecc15da20 0x7f9ecc0b5470 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0097c0 tx=0x7f9ebc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a139c89c2c5e83a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:54.844 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.853+0000 7f9ecaa00640 1 -- 172.21.15.32:0/4220240027 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0b2070 con 0x7f9ecc15da20 2024-03-19T06:20:54.844 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.853+0000 7f9ecaa00640 1 -- 172.21.15.32:0/4220240027 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc0ad640 con 0x7f9ecc15da20 2024-03-19T06:20:54.844 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.853+0000 7f9ecaa00640 1 -- 172.21.15.32:0/4220240027 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0ada10 con 0x7f9ecc15da20 2024-03-19T06:20:54.845 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.853+0000 7f9ed1200640 1 -- 172.21.15.32:0/4220240027 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ecc15da20 msgr2=0x7f9ecc0b5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:54.846 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.853+0000 7f9ed1200640 1 --2- 172.21.15.32:0/4220240027 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ecc15da20 0x7f9ecc0b5470 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0097c0 tx=0x7f9ebc01c4a0 comp rx=0 tx=0).stop 2024-03-19T06:20:54.846 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.853+0000 7f9ed1200640 1 -- 172.21.15.32:0/4220240027 shutdown_connections 2024-03-19T06:20:54.846 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.853+0000 7f9ed1200640 1 --2- 172.21.15.32:0/4220240027 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ecc15de00 0x7f9ecc0b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:54.847 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.853+0000 7f9ed1200640 1 --2- 172.21.15.32:0/4220240027 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ecc15da20 0x7f9ecc0b5470 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:54.847 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.853+0000 7f9ed1200640 1 -- 172.21.15.32:0/4220240027 >> 172.21.15.32:0/4220240027 conn(0x7f9ecc072af0 msgr2=0x7f9ecc0d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:54.847 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.853+0000 7f9ed1200640 1 -- 172.21.15.32:0/4220240027 shutdown_connections 2024-03-19T06:20:54.847 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.853+0000 7f9ed1200640 1 -- 172.21.15.32:0/4220240027 wait complete. 2024-03-19T06:20:54.849 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.853+0000 7f9ed1200640 1 Processor -- start 2024-03-19T06:20:54.850 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.853+0000 7f9ed1200640 1 -- start start 2024-03-19T06:20:54.850 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ed1200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ecc0d1a70 0x7f9ecc14bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:54.850 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ed1200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ecc15da20 0x7f9ecc0c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:54.850 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ed1200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ecc15de00 0x7f9ecc155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:54.850 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ed1200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0b7740 con 0x7f9ecc0d1a70 2024-03-19T06:20:54.850 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ed1200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0b75c0 con 0x7f9ecc15de00 2024-03-19T06:20:54.850 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ed1200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0b78c0 con 0x7f9ecc15da20 2024-03-19T06:20:54.850 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ecb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ecc0d1a70 0x7f9ecc14bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:54.850 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ecb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ecc0d1a70 0x7f9ecc14bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42882/0 (socket says 172.21.15.32:42882) 2024-03-19T06:20:54.850 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ecb400640 1 -- 172.21.15.32:0/2212020223 learned_addr learned my addr 172.21.15.32:0/2212020223 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:20:54.850 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ecbe00640 1 --2- 172.21.15.32:0/2212020223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ecc15de00 0x7f9ecc155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:54.850 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ec3e00640 1 --2- 172.21.15.32:0/2212020223 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ecc15da20 0x7f9ecc0c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:54.850 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ecb400640 1 -- 172.21.15.32:0/2212020223 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ecc15da20 msgr2=0x7f9ecc0c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:54.851 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ecb400640 1 --2- 172.21.15.32:0/2212020223 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ecc15da20 0x7f9ecc0c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:54.851 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ecb400640 1 -- 172.21.15.32:0/2212020223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ecc15de00 msgr2=0x7f9ecc155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:54.851 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ecb400640 1 --2- 172.21.15.32:0/2212020223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ecc15de00 0x7f9ecc155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:54.851 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ecb400640 1 -- 172.21.15.32:0/2212020223 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc14c070 con 0x7f9ecc0d1a70 2024-03-19T06:20:54.851 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ecb400640 1 --2- 172.21.15.32:0/2212020223 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ecc0d1a70 0x7f9ecc14bb30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0b0040 tx=0x7f9ebc019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:54.851 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ec3400640 1 -- 172.21.15.32:0/2212020223 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0ba020 con 0x7f9ecc0d1a70 2024-03-19T06:20:54.851 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ec3400640 1 -- 172.21.15.32:0/2212020223 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc0b6410 con 0x7f9ecc0d1a70 2024-03-19T06:20:54.851 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ec3400640 1 -- 172.21.15.32:0/2212020223 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0b2040 con 0x7f9ecc0d1a70 2024-03-19T06:20:54.851 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ed1200640 1 -- 172.21.15.32:0/2212020223 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ecc13b800 con 0x7f9ecc0d1a70 2024-03-19T06:20:54.851 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ed1200640 1 -- 172.21.15.32:0/2212020223 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ecc13bdc0 con 0x7f9ecc0d1a70 2024-03-19T06:20:54.851 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ed1200640 1 -- 172.21.15.32:0/2212020223 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ecc075040 con 0x7f9ecc0d1a70 2024-03-19T06:20:54.852 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.857+0000 7f9ec3400640 1 -- 172.21.15.32:0/2212020223 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 4) v1 ==== 87027+0+0 (secure 0 0 0) 0x7f9ebc0bd020 con 0x7f9ecc0d1a70 2024-03-19T06:20:54.852 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.861+0000 7f9ec3400640 1 --2- 172.21.15.32:0/2212020223 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9ea80675d0 0x7f9ea8069a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:20:54.852 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.861+0000 7f9ec3400640 1 -- 172.21.15.32:0/2212020223 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2791+0+0 (secure 0 0 0) 0x7f9ebc11e8f0 con 0x7f9ecc0d1a70 2024-03-19T06:20:54.852 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.861+0000 7f9ec3e00640 1 --2- 172.21.15.32:0/2212020223 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9ea80675d0 0x7f9ea8069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:20:54.852 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.861+0000 7f9ec3e00640 1 --2- 172.21.15.32:0/2212020223 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9ea80675d0 0x7f9ea8069a90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009580 tx=0x7f9eb4009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:20:54.856 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:54.865+0000 7f9ec3400640 1 -- 172.21.15.32:0/2212020223 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f9ebc0c4030 con 0x7f9ecc0d1a70 2024-03-19T06:20:55.023 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:55.033+0000 7f9ed1200640 1 -- 172.21.15.32:0/2212020223 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ecc154a80 con 0x7f9ecc0d1a70 2024-03-19T06:20:55.024 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:55.033+0000 7f9ec3400640 1 -- 172.21.15.32:0/2212020223 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8041 (secure 0 0 0) 0x7f9ebc016090 con 0x7f9ecc0d1a70 2024-03-19T06:20:55.024 INFO:teuthology.misc.health.smithi032.stdout: 2024-03-19T06:20:55.024 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":14,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:20:53.971405+0000","last_up_change":"2024-03-19T06:20:53.971405+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:20:55.026 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:55.033+0000 7f9ed1200640 1 -- 172.21.15.32:0/2212020223 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9ea80675d0 msgr2=0x7f9ea8069a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:55.026 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:55.033+0000 7f9ed1200640 1 --2- 172.21.15.32:0/2212020223 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9ea80675d0 0x7f9ea8069a90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009580 tx=0x7f9eb4009190 comp rx=0 tx=0).stop 2024-03-19T06:20:55.027 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:55.033+0000 7f9ed1200640 1 -- 172.21.15.32:0/2212020223 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ecc0d1a70 msgr2=0x7f9ecc14bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:20:55.027 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:55.033+0000 7f9ed1200640 1 --2- 172.21.15.32:0/2212020223 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ecc0d1a70 0x7f9ecc14bb30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0b0040 tx=0x7f9ebc019240 comp rx=0 tx=0).stop 2024-03-19T06:20:55.027 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:55.033+0000 7f9ed1200640 1 -- 172.21.15.32:0/2212020223 shutdown_connections 2024-03-19T06:20:55.027 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:55.033+0000 7f9ed1200640 1 --2- 172.21.15.32:0/2212020223 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9ea80675d0 0x7f9ea8069a90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:55.027 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:55.033+0000 7f9ed1200640 1 --2- 172.21.15.32:0/2212020223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ecc15de00 0x7f9ecc155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:55.027 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:55.033+0000 7f9ed1200640 1 --2- 172.21.15.32:0/2212020223 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ecc15da20 0x7f9ecc0c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:55.027 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:55.033+0000 7f9ed1200640 1 --2- 172.21.15.32:0/2212020223 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ecc0d1a70 0x7f9ecc14bb30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:20:55.027 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:55.033+0000 7f9ed1200640 1 -- 172.21.15.32:0/2212020223 >> 172.21.15.32:0/2212020223 conn(0x7f9ecc072af0 msgr2=0x7f9ecc15edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:20:55.027 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:55.033+0000 7f9ed1200640 1 -- 172.21.15.32:0/2212020223 shutdown_connections 2024-03-19T06:20:55.027 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:20:55.033+0000 7f9ed1200640 1 -- 172.21.15.32:0/2212020223 wait complete. 2024-03-19T06:20:55.043 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-03-19T06:21:01.850 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:01.992 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1ea600640 1 Processor -- start 2024-03-19T06:21:01.993 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1ea600640 1 -- start start 2024-03-19T06:21:01.995 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1ea600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff1e4155060 0x7ff1e40b3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:01.995 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1ea600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1e406ea20 0x7ff1e406eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:01.995 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1ea600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e40d0970 con 0x7ff1e415ae70 2024-03-19T06:21:01.995 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1ea600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e40b3bc0 con 0x7ff1e4155060 2024-03-19T06:21:01.995 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1ea600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40cf9b0 con 0x7ff1e406ea20 2024-03-19T06:21:01.995 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1e3e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff1e415ae70 0x7ff1e40718b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49068/0 (socket says 172.21.15.32:49068) 2024-03-19T06:21:01.995 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1e3e00640 1 -- 172.21.15.32:0/529912719 learned_addr learned my addr 172.21.15.32:0/529912719 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:01.995 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1e3400640 1 --2- 172.21.15.32:0/529912719 >> v2:172.21.15.171:3300/0 conn(0x7ff1e4155060 0x7ff1e40b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:01.995 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1dbe00640 1 --2- 172.21.15.32:0/529912719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1e406ea20 0x7ff1e406eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:01.995 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1e2a00640 1 -- 172.21.15.32:0/529912719 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131674856 0 0) 0x7ff1e40d0970 con 0x7ff1e415ae70 2024-03-19T06:21:01.995 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1e2a00640 1 -- 172.21.15.32:0/529912719 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1c8003530 con 0x7ff1e415ae70 2024-03-19T06:21:01.995 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1dbe00640 1 -- 172.21.15.32:0/529912719 >> v2:172.21.15.171:3300/0 conn(0x7ff1e4155060 msgr2=0x7ff1e40b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:01.995 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1dbe00640 1 --2- 172.21.15.32:0/529912719 >> v2:172.21.15.171:3300/0 conn(0x7ff1e4155060 0x7ff1e40b3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:01.996 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1dbe00640 1 -- 172.21.15.32:0/529912719 >> v1:172.21.15.32:6789/0 conn(0x7ff1e415ae70 legacy=0x7ff1e40718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:01.996 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.001+0000 7ff1dbe00640 1 -- 172.21.15.32:0/529912719 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e415ba50 con 0x7ff1e406ea20 2024-03-19T06:21:01.997 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.005+0000 7ff1dbe00640 1 --2- 172.21.15.32:0/529912719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1e406ea20 0x7ff1e406eea0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0097c0 tx=0x7ff1cc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e114be212d4d918d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:01.998 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.005+0000 7ff1e2a00640 1 -- 172.21.15.32:0/529912719 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc0b2070 con 0x7ff1e406ea20 2024-03-19T06:21:01.998 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.005+0000 7ff1e2a00640 1 -- 172.21.15.32:0/529912719 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1cc0ad640 con 0x7ff1e406ea20 2024-03-19T06:21:01.998 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.005+0000 7ff1e2a00640 1 -- 172.21.15.32:0/529912719 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc0ada10 con 0x7ff1e406ea20 2024-03-19T06:21:01.998 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.005+0000 7ff1ea600640 1 -- 172.21.15.32:0/529912719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1e406ea20 msgr2=0x7ff1e406eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:01.998 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.005+0000 7ff1ea600640 1 --2- 172.21.15.32:0/529912719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1e406ea20 0x7ff1e406eea0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0097c0 tx=0x7ff1cc01c4a0 comp rx=0 tx=0).stop 2024-03-19T06:21:01.998 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.005+0000 7ff1ea600640 1 -- 172.21.15.32:0/529912719 shutdown_connections 2024-03-19T06:21:01.998 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.005+0000 7ff1ea600640 1 --2- 172.21.15.32:0/529912719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1e406ea20 0x7ff1e406eea0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:01.998 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.005+0000 7ff1ea600640 1 --2- 172.21.15.32:0/529912719 >> v2:172.21.15.171:3300/0 conn(0x7ff1e4155060 0x7ff1e40b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:01.998 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.005+0000 7ff1ea600640 1 -- 172.21.15.32:0/529912719 >> 172.21.15.32:0/529912719 conn(0x7ff1e40cfb70 msgr2=0x7ff1e40cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:01.999 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.005+0000 7ff1ea600640 1 -- 172.21.15.32:0/529912719 shutdown_connections 2024-03-19T06:21:01.999 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.005+0000 7ff1ea600640 1 -- 172.21.15.32:0/529912719 wait complete. 2024-03-19T06:21:01.999 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1ea600640 1 Processor -- start 2024-03-19T06:21:01.999 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1ea600640 1 -- start start 2024-03-19T06:21:02.002 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1ea600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1e406ea20 0x7ff1e414fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.002 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1ea600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1e4155060 0x7ff1e414f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.002 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1ea600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1e415ae70 0x7ff1e4157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.003 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1ea600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40723d0 con 0x7ff1e415ae70 2024-03-19T06:21:02.003 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1ea600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40b3160 con 0x7ff1e406ea20 2024-03-19T06:21:02.003 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1ea600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e415b690 con 0x7ff1e4155060 2024-03-19T06:21:02.003 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1e3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1e415ae70 0x7ff1e4157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.003 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1e3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1e415ae70 0x7ff1e4157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42888/0 (socket says 172.21.15.32:42888) 2024-03-19T06:21:02.003 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1e3e00640 1 -- 172.21.15.32:0/2141501822 learned_addr learned my addr 172.21.15.32:0/2141501822 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:02.003 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1e3400640 1 --2- 172.21.15.32:0/2141501822 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1e406ea20 0x7ff1e414fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.003 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1dbe00640 1 --2- 172.21.15.32:0/2141501822 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1e4155060 0x7ff1e414f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.003 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1e3e00640 1 -- 172.21.15.32:0/2141501822 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1e4155060 msgr2=0x7ff1e414f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:02.003 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1e3e00640 1 --2- 172.21.15.32:0/2141501822 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1e4155060 0x7ff1e414f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.003 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1e3e00640 1 -- 172.21.15.32:0/2141501822 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1e406ea20 msgr2=0x7ff1e414fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:02.003 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1e3e00640 1 --2- 172.21.15.32:0/2141501822 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1e406ea20 0x7ff1e414fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.003 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1e3e00640 1 -- 172.21.15.32:0/2141501822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e4150f40 con 0x7ff1e415ae70 2024-03-19T06:21:02.003 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1e3e00640 1 --2- 172.21.15.32:0/2141501822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1e415ae70 0x7ff1e4157d80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00cb40 tx=0x7ff1dc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:02.004 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1db400640 1 -- 172.21.15.32:0/2141501822 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc017070 con 0x7ff1e415ae70 2024-03-19T06:21:02.004 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1db400640 1 -- 172.21.15.32:0/2141501822 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc00aca0 con 0x7ff1e415ae70 2024-03-19T06:21:02.004 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1db400640 1 -- 172.21.15.32:0/2141501822 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc012620 con 0x7ff1e415ae70 2024-03-19T06:21:02.004 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1ea600640 1 -- 172.21.15.32:0/2141501822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e4151200 con 0x7ff1e415ae70 2024-03-19T06:21:02.004 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.009+0000 7ff1ea600640 1 -- 172.21.15.32:0/2141501822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e41517c0 con 0x7ff1e415ae70 2024-03-19T06:21:02.004 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.013+0000 7ff1ea600640 1 -- 172.21.15.32:0/2141501822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e40750b0 con 0x7ff1e415ae70 2024-03-19T06:21:02.004 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.013+0000 7ff1db400640 1 -- 172.21.15.32:0/2141501822 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff1dc01a070 con 0x7ff1e415ae70 2024-03-19T06:21:02.006 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.013+0000 7ff1db400640 1 --2- 172.21.15.32:0/2141501822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff1c0067660 0x7ff1c0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.006 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.013+0000 7ff1db400640 1 -- 172.21.15.32:0/2141501822 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff1dc085380 con 0x7ff1e415ae70 2024-03-19T06:21:02.006 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.013+0000 7ff1e3400640 1 --2- 172.21.15.32:0/2141501822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff1c0067660 0x7ff1c0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.007 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.017+0000 7ff1e3400640 1 --2- 172.21.15.32:0/2141501822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff1c0067660 0x7ff1c0069b20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009ac0 tx=0x7ff1d4009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:02.011 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.021+0000 7ff1db400640 1 -- 172.21.15.32:0/2141501822 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7ff1dc055c60 con 0x7ff1e415ae70 2024-03-19T06:21:02.178 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.185+0000 7ff1ea600640 1 -- 172.21.15.32:0/2141501822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1e40747e0 con 0x7ff1e415ae70 2024-03-19T06:21:02.179 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.189+0000 7ff1db400640 1 -- 172.21.15.32:0/2141501822 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12896 (secure 0 0 0) 0x7ff1dc059d00 con 0x7ff1e415ae70 2024-03-19T06:21:02.180 INFO:teuthology.misc.health.smithi032.stdout: 2024-03-19T06:21:02.180 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":18,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:20:58.367584+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:02.182 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.189+0000 7ff1ea600640 1 -- 172.21.15.32:0/2141501822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff1c0067660 msgr2=0x7ff1c0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:02.182 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.189+0000 7ff1ea600640 1 --2- 172.21.15.32:0/2141501822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff1c0067660 0x7ff1c0069b20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009ac0 tx=0x7ff1d4009190 comp rx=0 tx=0).stop 2024-03-19T06:21:02.182 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.189+0000 7ff1ea600640 1 -- 172.21.15.32:0/2141501822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1e415ae70 msgr2=0x7ff1e4157d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:02.182 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.189+0000 7ff1ea600640 1 --2- 172.21.15.32:0/2141501822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1e415ae70 0x7ff1e4157d80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00cb40 tx=0x7ff1dc00a060 comp rx=0 tx=0).stop 2024-03-19T06:21:02.182 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.189+0000 7ff1ea600640 1 -- 172.21.15.32:0/2141501822 shutdown_connections 2024-03-19T06:21:02.182 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.189+0000 7ff1ea600640 1 --2- 172.21.15.32:0/2141501822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff1c0067660 0x7ff1c0069b20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.182 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.189+0000 7ff1ea600640 1 --2- 172.21.15.32:0/2141501822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1e415ae70 0x7ff1e4157d80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.182 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.189+0000 7ff1ea600640 1 --2- 172.21.15.32:0/2141501822 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1e4155060 0x7ff1e414f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.183 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.189+0000 7ff1ea600640 1 --2- 172.21.15.32:0/2141501822 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1e406ea20 0x7ff1e414fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.183 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.189+0000 7ff1ea600640 1 -- 172.21.15.32:0/2141501822 >> 172.21.15.32:0/2141501822 conn(0x7ff1e40cfb70 msgr2=0x7ff1e40cdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:02.183 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.189+0000 7ff1ea600640 1 -- 172.21.15.32:0/2141501822 shutdown_connections 2024-03-19T06:21:02.183 INFO:teuthology.misc.health.smithi032.stderr:2024-03-19T06:21:02.189+0000 7ff1ea600640 1 -- 172.21.15.32:0/2141501822 wait complete. 2024-03-19T06:21:02.199 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-19T06:21:02.199 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-19T06:21:02.199 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-19T06:21:02.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-19T06:21:02.203 INFO:tasks.ceph.mds.a:Started 2024-03-19T06:21:02.203 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-19T06:21:02.203 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-19T06:21:02.206 INFO:tasks.ceph.mds.c:Started 2024-03-19T06:21:02.206 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-19T06:21:02.206 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-19T06:21:02.210 INFO:tasks.ceph.mds.b:Started 2024-03-19T06:21:02.210 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-19T06:21:02.210 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-19T06:21:02.213 INFO:tasks.ceph.mds.d:Started 2024-03-19T06:21:02.213 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-19T06:21:02.214 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:02.312 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-03-19T06:21:02.312 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-03-19T06:21:02.313 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2024-03-19T06:21:02.313 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2024-03-19T06:21:02.314 INFO:tasks.ceph.mds.d.smithi171.stderr:2024-03-19T06:21:02.324+0000 7fa134600640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-03-19T06:21:02.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.365+0000 7f7ee3000640 1 Processor -- start 2024-03-19T06:21:02.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.365+0000 7f7ee3000640 1 -- start start 2024-03-19T06:21:02.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.369+0000 7f7ee3000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7edc099a70 0x7f7edc099e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.369+0000 7f7ee3000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7edc06c060 0x7f7edc15e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.369+0000 7f7ee3000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7edc06fbe0 con 0x7f7edc161860 2024-03-19T06:21:02.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.369+0000 7f7ee3000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc09a390 con 0x7f7edc06c060 2024-03-19T06:21:02.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.369+0000 7f7ee3000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc15e940 con 0x7f7edc099a70 2024-03-19T06:21:02.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.369+0000 7f7ed3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7edc06c060 0x7f7edc15e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.369+0000 7f7ed3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7edc06c060 0x7f7edc15e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42910/0 (socket says 172.21.15.32:42910) 2024-03-19T06:21:02.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.369+0000 7f7ed3e00640 1 -- 172.21.15.32:0/3975854647 learned_addr learned my addr 172.21.15.32:0/3975854647 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:02.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.369+0000 7f7edbe00640 1 --2- 172.21.15.32:0/3975854647 >> v2:172.21.15.171:3300/0 conn(0x7f7edc099a70 0x7f7edc099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.369+0000 7f7ed3e00640 1 -- 172.21.15.32:0/3975854647 >> v2:172.21.15.171:3300/0 conn(0x7f7edc099a70 msgr2=0x7f7edc099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:02.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.369+0000 7f7ed3e00640 1 --2- 172.21.15.32:0/3975854647 >> v2:172.21.15.171:3300/0 conn(0x7f7edc099a70 0x7f7edc099e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.369+0000 7f7ed3e00640 1 -- 172.21.15.32:0/3975854647 >> v1:172.21.15.171:6789/0 conn(0x7f7edc161860 legacy=0x7f7edc161c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:02.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.369+0000 7f7ed3e00640 1 -- 172.21.15.32:0/3975854647 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc15ec20 con 0x7f7edc06c060 2024-03-19T06:21:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.373+0000 7f7ed3e00640 1 --2- 172.21.15.32:0/3975854647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7edc06c060 0x7f7edc15e010 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0725b0 tx=0x7f7ec401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558264fa715ebe38 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.373+0000 7f7edb400640 1 -- 172.21.15.32:0/3975854647 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40ab610 con 0x7f7edc06c060 2024-03-19T06:21:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.373+0000 7f7edb400640 1 -- 172.21.15.32:0/3975854647 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec40b0070 con 0x7f7edc06c060 2024-03-19T06:21:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.373+0000 7f7edb400640 1 -- 172.21.15.32:0/3975854647 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40ab9d0 con 0x7f7edc06c060 2024-03-19T06:21:02.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.373+0000 7f7ee3000640 1 -- 172.21.15.32:0/3975854647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7edc06c060 msgr2=0x7f7edc15e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:02.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.373+0000 7f7ee3000640 1 --2- 172.21.15.32:0/3975854647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7edc06c060 0x7f7edc15e010 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0725b0 tx=0x7f7ec401c520 comp rx=0 tx=0).stop 2024-03-19T06:21:02.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.373+0000 7f7ee3000640 1 -- 172.21.15.32:0/3975854647 shutdown_connections 2024-03-19T06:21:02.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.373+0000 7f7ee3000640 1 --2- 172.21.15.32:0/3975854647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7edc06c060 0x7f7edc15e010 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.373+0000 7f7ee3000640 1 --2- 172.21.15.32:0/3975854647 >> v2:172.21.15.171:3300/0 conn(0x7f7edc099a70 0x7f7edc099e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.373+0000 7f7ee3000640 1 -- 172.21.15.32:0/3975854647 >> 172.21.15.32:0/3975854647 conn(0x7f7edc0b3300 msgr2=0x7f7edc0b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:02.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.373+0000 7f7ee3000640 1 -- 172.21.15.32:0/3975854647 shutdown_connections 2024-03-19T06:21:02.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.373+0000 7f7ee3000640 1 -- 172.21.15.32:0/3975854647 wait complete. 2024-03-19T06:21:02.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.373+0000 7f7ee3000640 1 Processor -- start 2024-03-19T06:21:02.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.373+0000 7f7ee3000640 1 -- start start 2024-03-19T06:21:02.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7ee3000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7edc06c060 0x7f7edc1520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7ee3000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7edc099a70 0x7f7edc0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7ee3000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7edc161860 0x7f7edc15a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7ee3000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc15e6d0 con 0x7f7edc06c060 2024-03-19T06:21:02.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7ee3000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc15e550 con 0x7f7edc161860 2024-03-19T06:21:02.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7ee3000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc16b410 con 0x7f7edc099a70 2024-03-19T06:21:02.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7edbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7edc06c060 0x7f7edc1520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7edbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7edc06c060 0x7f7edc1520c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42916/0 (socket says 172.21.15.32:42916) 2024-03-19T06:21:02.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7ed3e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7edc099a70 0x7f7edc0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7edbe00640 1 -- 172.21.15.32:0/2652993901 learned_addr learned my addr 172.21.15.32:0/2652993901 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:02.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7ee1000640 1 --2- 172.21.15.32:0/2652993901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7edc161860 0x7f7edc15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7edbe00640 1 -- 172.21.15.32:0/2652993901 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7edc099a70 msgr2=0x7f7edc0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7edbe00640 1 --2- 172.21.15.32:0/2652993901 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7edc099a70 0x7f7edc0aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7edbe00640 1 -- 172.21.15.32:0/2652993901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7edc161860 msgr2=0x7f7edc15a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7edbe00640 1 --2- 172.21.15.32:0/2652993901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7edc161860 0x7f7edc15a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7edbe00640 1 -- 172.21.15.32:0/2652993901 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc152600 con 0x7f7edc06c060 2024-03-19T06:21:02.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7edbe00640 1 --2- 172.21.15.32:0/2652993901 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7edc06c060 0x7f7edc1520c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00e870 tx=0x7f7ecc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:02.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7ed8c00640 1 -- 172.21.15.32:0/2652993901 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc017070 con 0x7f7edc06c060 2024-03-19T06:21:02.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7ed8c00640 1 -- 172.21.15.32:0/2652993901 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc00c940 con 0x7f7edc06c060 2024-03-19T06:21:02.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7ee3000640 1 -- 172.21.15.32:0/2652993901 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7edc156b70 con 0x7f7edc06c060 2024-03-19T06:21:02.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7ed8c00640 1 -- 172.21.15.32:0/2652993901 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc00ccf0 con 0x7f7edc06c060 2024-03-19T06:21:02.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.377+0000 7f7ee3000640 1 -- 172.21.15.32:0/2652993901 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc0cd320 con 0x7f7edc06c060 2024-03-19T06:21:02.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.381+0000 7f7ee3000640 1 -- 172.21.15.32:0/2652993901 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7edc157090 con 0x7f7edc06c060 2024-03-19T06:21:02.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.381+0000 7f7ed8c00640 1 -- 172.21.15.32:0/2652993901 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7ecc01a070 con 0x7f7edc06c060 2024-03-19T06:21:02.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.381+0000 7f7ed8c00640 1 --2- 172.21.15.32:0/2652993901 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7eb8067690 0x7f7eb8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.381+0000 7f7ed8c00640 1 -- 172.21.15.32:0/2652993901 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7ecc0856f0 con 0x7f7edc06c060 2024-03-19T06:21:02.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.381+0000 7f7ed3e00640 1 --2- 172.21.15.32:0/2652993901 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7eb8067690 0x7f7eb8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.381+0000 7f7ed3e00640 1 --2- 172.21.15.32:0/2652993901 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7eb8067690 0x7f7eb8069b50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7ec40af000 tx=0x7f7ec40a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:02.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.385+0000 7f7ed8c00640 1 -- 172.21.15.32:0/2652993901 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f7ecc056060 con 0x7f7edc06c060 2024-03-19T06:21:02.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.549+0000 7f7ee3000640 1 -- 172.21.15.32:0/2652993901 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7edc0749e0 con 0x7f7edc06c060 2024-03-19T06:21:02.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.549+0000 7f7ed8c00640 1 -- 172.21.15.32:0/2652993901 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12896 (secure 0 0 0) 0x7f7ecc05a100 con 0x7f7edc06c060 2024-03-19T06:21:02.541 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:02.541 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":18,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:20:58.367584+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:02.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.549+0000 7f7ee3000640 1 -- 172.21.15.32:0/2652993901 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7eb8067690 msgr2=0x7f7eb8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:02.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.549+0000 7f7ee3000640 1 --2- 172.21.15.32:0/2652993901 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7eb8067690 0x7f7eb8069b50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7ec40af000 tx=0x7f7ec40a7000 comp rx=0 tx=0).stop 2024-03-19T06:21:02.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.549+0000 7f7ee3000640 1 -- 172.21.15.32:0/2652993901 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7edc06c060 msgr2=0x7f7edc1520c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:02.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.549+0000 7f7ee3000640 1 --2- 172.21.15.32:0/2652993901 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7edc06c060 0x7f7edc1520c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00e870 tx=0x7f7ecc00ec70 comp rx=0 tx=0).stop 2024-03-19T06:21:02.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.549+0000 7f7ee3000640 1 -- 172.21.15.32:0/2652993901 shutdown_connections 2024-03-19T06:21:02.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.549+0000 7f7ee3000640 1 --2- 172.21.15.32:0/2652993901 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7eb8067690 0x7f7eb8069b50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.549+0000 7f7ee3000640 1 --2- 172.21.15.32:0/2652993901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7edc161860 0x7f7edc15a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.549+0000 7f7ee3000640 1 --2- 172.21.15.32:0/2652993901 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7edc099a70 0x7f7edc0aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.549+0000 7f7ee3000640 1 --2- 172.21.15.32:0/2652993901 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7edc06c060 0x7f7edc1520c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.553+0000 7f7ee3000640 1 -- 172.21.15.32:0/2652993901 >> 172.21.15.32:0/2652993901 conn(0x7f7edc0b3300 msgr2=0x7f7edc0b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:02.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.553+0000 7f7ee3000640 1 -- 172.21.15.32:0/2652993901 shutdown_connections 2024-03-19T06:21:02.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.553+0000 7f7ee3000640 1 -- 172.21.15.32:0/2652993901 wait complete. 2024-03-19T06:21:02.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:02.562 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:02.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.713+0000 7f76de600640 1 Processor -- start 2024-03-19T06:21:02.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.713+0000 7f76de600640 1 -- start start 2024-03-19T06:21:02.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.713+0000 7f76de600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f76d806ad40 0x7f76d806b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.713+0000 7f76de600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76d806eed0 0x7f76d80ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.713+0000 7f76de600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f76d806e320 0x7f76d815bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.713+0000 7f76de600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d806dbb0 con 0x7f76d806ad40 2024-03-19T06:21:02.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.713+0000 7f76de600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d806b660 con 0x7f76d806e320 2024-03-19T06:21:02.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.713+0000 7f76de600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d80cc290 con 0x7f76d806eed0 2024-03-19T06:21:02.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.717+0000 7f76d7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f76d806ad40 0x7f76d806b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.717+0000 7f76d7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f76d806ad40 0x7f76d806b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42920/0 (socket says 172.21.15.32:42920) 2024-03-19T06:21:02.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.717+0000 7f76d7400640 1 -- 172.21.15.32:0/4019442510 learned_addr learned my addr 172.21.15.32:0/4019442510 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:02.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.717+0000 7f76cfe00640 1 --2- 172.21.15.32:0/4019442510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76d806eed0 0x7f76d80ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.717+0000 7f76d7e00640 1 --2- 172.21.15.32:0/4019442510 >> v2:172.21.15.171:3300/0 conn(0x7f76d806e320 0x7f76d815bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.717+0000 7f76d7400640 1 -- 172.21.15.32:0/4019442510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76d806eed0 msgr2=0x7f76d80ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:02.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.717+0000 7f76d7400640 1 --2- 172.21.15.32:0/4019442510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76d806eed0 0x7f76d80ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.717+0000 7f76d7400640 1 -- 172.21.15.32:0/4019442510 >> v2:172.21.15.171:3300/0 conn(0x7f76d806e320 msgr2=0x7f76d815bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:02.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.717+0000 7f76d7400640 1 --2- 172.21.15.32:0/4019442510 >> v2:172.21.15.171:3300/0 conn(0x7f76d806e320 0x7f76d815bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.717+0000 7f76d7400640 1 -- 172.21.15.32:0/4019442510 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d80cc570 con 0x7f76d806ad40 2024-03-19T06:21:02.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.717+0000 7f76d7e00640 1 --2- 172.21.15.32:0/4019442510 >> v2:172.21.15.171:3300/0 conn(0x7f76d806e320 0x7f76d815bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:02.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.717+0000 7f76d7400640 1 --2- 172.21.15.32:0/4019442510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d806ad40 0x7f76d806b120 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f76d80b2940 tx=0x7f76c801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0a1cccf1ab9679 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:02.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.717+0000 7f76d6a00640 1 -- 172.21.15.32:0/4019442510 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c80ab620 con 0x7f76d806ad40 2024-03-19T06:21:02.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.717+0000 7f76d6a00640 1 -- 172.21.15.32:0/4019442510 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c80b0070 con 0x7f76d806ad40 2024-03-19T06:21:02.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.717+0000 7f76d6a00640 1 -- 172.21.15.32:0/4019442510 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c80ab9e0 con 0x7f76d806ad40 2024-03-19T06:21:02.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 -- 172.21.15.32:0/4019442510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d806ad40 msgr2=0x7f76d806b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:02.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 --2- 172.21.15.32:0/4019442510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d806ad40 0x7f76d806b120 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f76d80b2940 tx=0x7f76c801c460 comp rx=0 tx=0).stop 2024-03-19T06:21:02.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 -- 172.21.15.32:0/4019442510 shutdown_connections 2024-03-19T06:21:02.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 --2- 172.21.15.32:0/4019442510 >> v2:172.21.15.171:3300/0 conn(0x7f76d806e320 0x7f76d815bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 --2- 172.21.15.32:0/4019442510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76d806eed0 0x7f76d80ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 --2- 172.21.15.32:0/4019442510 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d806ad40 0x7f76d806b120 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 -- 172.21.15.32:0/4019442510 >> 172.21.15.32:0/4019442510 conn(0x7f76d80b1590 msgr2=0x7f76d80b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:02.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 -- 172.21.15.32:0/4019442510 shutdown_connections 2024-03-19T06:21:02.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 -- 172.21.15.32:0/4019442510 wait complete. 2024-03-19T06:21:02.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 Processor -- start 2024-03-19T06:21:02.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 -- start start 2024-03-19T06:21:02.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76d806ad40 0x7f76d8154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76d806e320 0x7f76d813c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d806eed0 0x7f76d814e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d80716d0 con 0x7f76d806eed0 2024-03-19T06:21:02.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d8071550 con 0x7f76d806e320 2024-03-19T06:21:02.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76de600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d8071850 con 0x7f76d806ad40 2024-03-19T06:21:02.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76d7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d806eed0 0x7f76d814e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76d7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d806eed0 0x7f76d814e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42926/0 (socket says 172.21.15.32:42926) 2024-03-19T06:21:02.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76d7e00640 1 -- 172.21.15.32:0/3224026913 learned_addr learned my addr 172.21.15.32:0/3224026913 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76d7400640 1 --2- 172.21.15.32:0/3224026913 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76d806ad40 0x7f76d8154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.721+0000 7f76cfe00640 1 --2- 172.21.15.32:0/3224026913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76d806e320 0x7f76d813c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.725+0000 7f76d7e00640 1 -- 172.21.15.32:0/3224026913 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76d806ad40 msgr2=0x7f76d8154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.725+0000 7f76d7e00640 1 --2- 172.21.15.32:0/3224026913 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76d806ad40 0x7f76d8154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.725+0000 7f76d7e00640 1 -- 172.21.15.32:0/3224026913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76d806e320 msgr2=0x7f76d813c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.725+0000 7f76d7e00640 1 --2- 172.21.15.32:0/3224026913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76d806e320 0x7f76d813c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.725+0000 7f76d7e00640 1 -- 172.21.15.32:0/3224026913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d813c8a0 con 0x7f76d806eed0 2024-03-19T06:21:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.725+0000 7f76d7400640 1 --2- 172.21.15.32:0/3224026913 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76d806ad40 0x7f76d8154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.725+0000 7f76d7e00640 1 --2- 172.21.15.32:0/3224026913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d806eed0 0x7f76d814e210 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f76d000efc0 tx=0x7f76d0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.725+0000 7f76cf400640 1 -- 172.21.15.32:0/3224026913 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0018030 con 0x7f76d806eed0 2024-03-19T06:21:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.725+0000 7f76cf400640 1 -- 172.21.15.32:0/3224026913 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d000cde0 con 0x7f76d806eed0 2024-03-19T06:21:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.725+0000 7f76cf400640 1 -- 172.21.15.32:0/3224026913 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0003bc0 con 0x7f76d806eed0 2024-03-19T06:21:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.725+0000 7f76de600640 1 -- 172.21.15.32:0/3224026913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d8153d70 con 0x7f76d806eed0 2024-03-19T06:21:02.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.725+0000 7f76de600640 1 -- 172.21.15.32:0/3224026913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d80b08d0 con 0x7f76d806eed0 2024-03-19T06:21:02.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.725+0000 7f76de600640 1 -- 172.21.15.32:0/3224026913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d80749e0 con 0x7f76d806eed0 2024-03-19T06:21:02.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.725+0000 7f76cf400640 1 -- 172.21.15.32:0/3224026913 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f76d001b070 con 0x7f76d806eed0 2024-03-19T06:21:02.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.725+0000 7f76cf400640 1 --2- 172.21.15.32:0/3224026913 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f76b4067660 0x7f76b4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:02.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.725+0000 7f76cf400640 1 -- 172.21.15.32:0/3224026913 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f76d0085e90 con 0x7f76d806eed0 2024-03-19T06:21:02.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.729+0000 7f76d7400640 1 --2- 172.21.15.32:0/3224026913 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f76b4067660 0x7f76b4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:02.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.729+0000 7f76d7400640 1 --2- 172.21.15.32:0/3224026913 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f76b4067660 0x7f76b4069b20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f76c80af000 tx=0x7f76c80a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:02.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.729+0000 7f76cf400640 1 -- 172.21.15.32:0/3224026913 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f76d0022070 con 0x7f76d806eed0 2024-03-19T06:21:02.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.893+0000 7f76de600640 1 -- 172.21.15.32:0/3224026913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76d8158820 con 0x7f76d806eed0 2024-03-19T06:21:02.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.893+0000 7f76cf400640 1 -- 172.21.15.32:0/3224026913 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76d00870a0 con 0x7f76d806eed0 2024-03-19T06:21:02.886 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:02.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.897+0000 7f76de600640 1 -- 172.21.15.32:0/3224026913 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f76b4067660 msgr2=0x7f76b4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:02.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.897+0000 7f76de600640 1 --2- 172.21.15.32:0/3224026913 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f76b4067660 0x7f76b4069b20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f76c80af000 tx=0x7f76c80a7000 comp rx=0 tx=0).stop 2024-03-19T06:21:02.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.897+0000 7f76de600640 1 -- 172.21.15.32:0/3224026913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d806eed0 msgr2=0x7f76d814e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:02.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.897+0000 7f76de600640 1 --2- 172.21.15.32:0/3224026913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d806eed0 0x7f76d814e210 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f76d000efc0 tx=0x7f76d0009f90 comp rx=0 tx=0).stop 2024-03-19T06:21:02.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.897+0000 7f76de600640 1 -- 172.21.15.32:0/3224026913 shutdown_connections 2024-03-19T06:21:02.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.897+0000 7f76de600640 1 --2- 172.21.15.32:0/3224026913 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f76b4067660 0x7f76b4069b20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.897+0000 7f76de600640 1 --2- 172.21.15.32:0/3224026913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d806eed0 0x7f76d814e210 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.897+0000 7f76de600640 1 --2- 172.21.15.32:0/3224026913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76d806e320 0x7f76d813c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.897+0000 7f76de600640 1 --2- 172.21.15.32:0/3224026913 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76d806ad40 0x7f76d8154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:02.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.897+0000 7f76de600640 1 -- 172.21.15.32:0/3224026913 >> 172.21.15.32:0/3224026913 conn(0x7f76d80b1590 msgr2=0x7f76d80b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:02.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.897+0000 7f76de600640 1 -- 172.21.15.32:0/3224026913 shutdown_connections 2024-03-19T06:21:02.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:02.897+0000 7f76de600640 1 -- 172.21.15.32:0/3224026913 wait complete. 2024-03-19T06:21:02.907 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:21:03.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.053+0000 7f6b99800640 1 Processor -- start 2024-03-19T06:21:03.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.057+0000 7f6b99800640 1 -- start start 2024-03-19T06:21:03.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.057+0000 7f6b99800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6b94099a70 0x7f6b94099e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:03.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.057+0000 7f6b99800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b9406c060 0x7f6b9415e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:03.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.057+0000 7f6b99800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b9406fbe0 con 0x7f6b94161860 2024-03-19T06:21:03.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.057+0000 7f6b99800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9409a390 con 0x7f6b94099a70 2024-03-19T06:21:03.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.057+0000 7f6b99800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9415e940 con 0x7f6b9406c060 2024-03-19T06:21:03.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.057+0000 7f6b8a000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b9406c060 0x7f6b9415e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:03.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.057+0000 7f6b8a000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b9406c060 0x7f6b9415e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:41386/0 (socket says 172.21.15.32:41386) 2024-03-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.057+0000 7f6b8a000640 1 -- 172.21.15.32:0/3942727698 learned_addr learned my addr 172.21.15.32:0/3942727698 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.057+0000 7f6b92a00640 1 --2- 172.21.15.32:0/3942727698 >> v2:172.21.15.171:3300/0 conn(0x7f6b94099a70 0x7f6b94099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.057+0000 7f6b8a000640 1 -- 172.21.15.32:0/3942727698 >> v2:172.21.15.171:3300/0 conn(0x7f6b94099a70 msgr2=0x7f6b94099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.057+0000 7f6b8a000640 1 --2- 172.21.15.32:0/3942727698 >> v2:172.21.15.171:3300/0 conn(0x7f6b94099a70 0x7f6b94099e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.057+0000 7f6b8a000640 1 -- 172.21.15.32:0/3942727698 >> v1:172.21.15.171:6789/0 conn(0x7f6b94161860 legacy=0x7f6b94161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.057+0000 7f6b8a000640 1 -- 172.21.15.32:0/3942727698 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9415ec20 con 0x7f6b9406c060 2024-03-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.057+0000 7f6b92000640 1 -- 172.21.15.32:0/3942727698 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44018561 0 0) 0x7f6b8c0014a0 con 0x7f6b94161860 2024-03-19T06:21:03.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.061+0000 7f6b8a000640 1 --2- 172.21.15.32:0/3942727698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b9406c060 0x7f6b9415e010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c009870 tx=0x7f6b7c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cb7f4576f37d417 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:03.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.061+0000 7f6b92000640 1 -- 172.21.15.32:0/3942727698 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c0ab650 con 0x7f6b9406c060 2024-03-19T06:21:03.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.061+0000 7f6b92000640 1 -- 172.21.15.32:0/3942727698 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c0b0070 con 0x7f6b9406c060 2024-03-19T06:21:03.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.061+0000 7f6b92000640 1 -- 172.21.15.32:0/3942727698 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c0aba10 con 0x7f6b9406c060 2024-03-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.061+0000 7f6b99800640 1 -- 172.21.15.32:0/3942727698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b9406c060 msgr2=0x7f6b9415e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.061+0000 7f6b99800640 1 --2- 172.21.15.32:0/3942727698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b9406c060 0x7f6b9415e010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c009870 tx=0x7f6b7c01c560 comp rx=0 tx=0).stop 2024-03-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.061+0000 7f6b99800640 1 -- 172.21.15.32:0/3942727698 shutdown_connections 2024-03-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.061+0000 7f6b99800640 1 --2- 172.21.15.32:0/3942727698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b9406c060 0x7f6b9415e010 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.061+0000 7f6b99800640 1 --2- 172.21.15.32:0/3942727698 >> v2:172.21.15.171:3300/0 conn(0x7f6b94099a70 0x7f6b94099e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.061+0000 7f6b99800640 1 -- 172.21.15.32:0/3942727698 >> 172.21.15.32:0/3942727698 conn(0x7f6b940b3300 msgr2=0x7f6b940b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.061+0000 7f6b99800640 1 -- 172.21.15.32:0/3942727698 shutdown_connections 2024-03-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.061+0000 7f6b99800640 1 -- 172.21.15.32:0/3942727698 wait complete. 2024-03-19T06:21:03.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.061+0000 7f6b99800640 1 Processor -- start 2024-03-19T06:21:03.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.061+0000 7f6b99800640 1 -- start start 2024-03-19T06:21:03.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b99800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b9406c060 0x7f6b94150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:03.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b99800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b94099a70 0x7f6b94156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:03.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b99800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b94161860 0x7f6b940cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:03.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b99800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9415e6d0 con 0x7f6b94099a70 2024-03-19T06:21:03.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b99800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9415e550 con 0x7f6b9406c060 2024-03-19T06:21:03.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b99800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9416b410 con 0x7f6b94161860 2024-03-19T06:21:03.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b8a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b94099a70 0x7f6b94156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:03.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b8a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b94099a70 0x7f6b94156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42940/0 (socket says 172.21.15.32:42940) 2024-03-19T06:21:03.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b8a000640 1 -- 172.21.15.32:0/3188769507 learned_addr learned my addr 172.21.15.32:0/3188769507 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:03.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b92a00640 1 --2- 172.21.15.32:0/3188769507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b9406c060 0x7f6b94150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:03.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b93400640 1 --2- 172.21.15.32:0/3188769507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b94161860 0x7f6b940cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:03.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b8a000640 1 -- 172.21.15.32:0/3188769507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b94161860 msgr2=0x7f6b940cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:03.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b8a000640 1 --2- 172.21.15.32:0/3188769507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b94161860 0x7f6b940cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:03.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b8a000640 1 -- 172.21.15.32:0/3188769507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b9406c060 msgr2=0x7f6b94150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:03.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b8a000640 1 --2- 172.21.15.32:0/3188769507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b9406c060 0x7f6b94150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:03.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b8a000640 1 -- 172.21.15.32:0/3188769507 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b94150ac0 con 0x7f6b94099a70 2024-03-19T06:21:03.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b8a000640 1 --2- 172.21.15.32:0/3188769507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b94099a70 0x7f6b94156e70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0ad040 tx=0x7f6b7c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:03.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b8b400640 1 -- 172.21.15.32:0/3188769507 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c0be5f0 con 0x7f6b94099a70 2024-03-19T06:21:03.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b8b400640 1 -- 172.21.15.32:0/3188769507 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c0be790 con 0x7f6b94099a70 2024-03-19T06:21:03.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b8b400640 1 -- 172.21.15.32:0/3188769507 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c0beb80 con 0x7f6b94099a70 2024-03-19T06:21:03.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b99800640 1 -- 172.21.15.32:0/3188769507 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9415a730 con 0x7f6b94099a70 2024-03-19T06:21:03.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b99800640 1 -- 172.21.15.32:0/3188769507 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b94159690 con 0x7f6b94099a70 2024-03-19T06:21:03.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.065+0000 7f6b99800640 1 -- 172.21.15.32:0/3188769507 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b940749e0 con 0x7f6b94099a70 2024-03-19T06:21:03.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.069+0000 7f6b8b400640 1 -- 172.21.15.32:0/3188769507 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6b7c0b43f0 con 0x7f6b94099a70 2024-03-19T06:21:03.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.069+0000 7f6b8b400640 1 --2- 172.21.15.32:0/3188769507 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6b70067690 0x7f6b70069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:03.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.069+0000 7f6b8b400640 1 -- 172.21.15.32:0/3188769507 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6b7c11fe80 con 0x7f6b94099a70 2024-03-19T06:21:03.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.069+0000 7f6b92a00640 1 --2- 172.21.15.32:0/3188769507 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6b70067690 0x7f6b70069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:03.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.069+0000 7f6b92a00640 1 --2- 172.21.15.32:0/3188769507 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6b70067690 0x7f6b70069b50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009ac0 tx=0x7f6b84009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:03.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.073+0000 7f6b8b400640 1 -- 172.21.15.32:0/3188769507 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f6b7c016150 con 0x7f6b94099a70 2024-03-19T06:21:03.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.273+0000 7f6b99800640 1 -- 172.21.15.32:0/3188769507 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b940b4100 con 0x7f6b94099a70 2024-03-19T06:21:03.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.273+0000 7f6b8b400640 1 -- 172.21.15.32:0/3188769507 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f6b7c0f0760 con 0x7f6b94099a70 2024-03-19T06:21:03.265 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:03.265 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/3555048948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3555048948},{"type":"v1","addr":"172.21.15.32:6834","nonce":3555048948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-19T06:21:03.265 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 2 2024-03-19T06:21:03.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.273+0000 7f6b99800640 1 -- 172.21.15.32:0/3188769507 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6b70067690 msgr2=0x7f6b70069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:03.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.273+0000 7f6b99800640 1 --2- 172.21.15.32:0/3188769507 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6b70067690 0x7f6b70069b50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009ac0 tx=0x7f6b84009190 comp rx=0 tx=0).stop 2024-03-19T06:21:03.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.273+0000 7f6b99800640 1 -- 172.21.15.32:0/3188769507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b94099a70 msgr2=0x7f6b94156e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:03.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.273+0000 7f6b99800640 1 --2- 172.21.15.32:0/3188769507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b94099a70 0x7f6b94156e70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0ad040 tx=0x7f6b7c01ada0 comp rx=0 tx=0).stop 2024-03-19T06:21:03.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.273+0000 7f6b99800640 1 -- 172.21.15.32:0/3188769507 shutdown_connections 2024-03-19T06:21:03.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.273+0000 7f6b99800640 1 --2- 172.21.15.32:0/3188769507 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6b70067690 0x7f6b70069b50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:03.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.273+0000 7f6b99800640 1 --2- 172.21.15.32:0/3188769507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b94161860 0x7f6b940cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:03.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.273+0000 7f6b99800640 1 --2- 172.21.15.32:0/3188769507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b94099a70 0x7f6b94156e70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:03.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.273+0000 7f6b99800640 1 --2- 172.21.15.32:0/3188769507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b9406c060 0x7f6b94150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:03.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.273+0000 7f6b99800640 1 -- 172.21.15.32:0/3188769507 >> 172.21.15.32:0/3188769507 conn(0x7f6b940b3300 msgr2=0x7f6b940b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:03.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.273+0000 7f6b99800640 1 -- 172.21.15.32:0/3188769507 shutdown_connections 2024-03-19T06:21:03.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:03.273+0000 7f6b99800640 1 -- 172.21.15.32:0/3188769507 wait complete. 2024-03-19T06:21:04.158 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:21:04.162 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:21:05.286 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:21:05.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.449+0000 7facec800640 1 Processor -- start 2024-03-19T06:21:05.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.449+0000 7facec800640 1 -- start start 2024-03-19T06:21:05.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.453+0000 7facec800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face415c010 0x7face415f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:05.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.453+0000 7facec800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face415fe20 con 0x7face406d6c0 2024-03-19T06:21:05.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.453+0000 7facec800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face4160100 con 0x7face40aecf0 2024-03-19T06:21:05.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.453+0000 7facec800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face41603e0 con 0x7face415c010 2024-03-19T06:21:05.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.453+0000 7facea800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7face406d6c0 0x7face40cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36280/0 (socket says 172.21.15.32:36280) 2024-03-19T06:21:05.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.453+0000 7facea800640 1 -- 172.21.15.32:0/3918679994 learned_addr learned my addr 172.21.15.32:0/3918679994 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:05.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.453+0000 7face9400640 1 --2- 172.21.15.32:0/3918679994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face415c010 0x7face415f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:05.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.453+0000 7face8a00640 1 -- 172.21.15.32:0/3918679994 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311663390 0 0) 0x7face415fe20 con 0x7face406d6c0 2024-03-19T06:21:05.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.453+0000 7face8a00640 1 -- 172.21.15.32:0/3918679994 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faccc003530 con 0x7face406d6c0 2024-03-19T06:21:05.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.453+0000 7face8a00640 1 -- 172.21.15.32:0/3918679994 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244501185 0 0) 0x7face4160100 con 0x7face40aecf0 2024-03-19T06:21:05.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.453+0000 7face8a00640 1 -- 172.21.15.32:0/3918679994 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face415fe20 con 0x7face40aecf0 2024-03-19T06:21:05.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.453+0000 7face9400640 1 -- 172.21.15.32:0/3918679994 >> v1:172.21.15.171:6789/0 conn(0x7face40aecf0 legacy=0x7face40ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:05.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.453+0000 7face9400640 1 -- 172.21.15.32:0/3918679994 >> v1:172.21.15.32:6789/0 conn(0x7face406d6c0 legacy=0x7face40cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:05.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.453+0000 7face9400640 1 -- 172.21.15.32:0/3918679994 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face40ca1f0 con 0x7face415c010 2024-03-19T06:21:05.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.457+0000 7face9400640 1 --2- 172.21.15.32:0/3918679994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face415c010 0x7face415f520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7face4160560 tx=0x7facd401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c11cc81c0cbb82ab server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:05.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.457+0000 7face8a00640 1 -- 172.21.15.32:0/3918679994 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40b0070 con 0x7face415c010 2024-03-19T06:21:05.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.457+0000 7face8a00640 1 -- 172.21.15.32:0/3918679994 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd40ab600 con 0x7face415c010 2024-03-19T06:21:05.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.457+0000 7face8a00640 1 -- 172.21.15.32:0/3918679994 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40ab9d0 con 0x7face415c010 2024-03-19T06:21:05.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.457+0000 7facec800640 1 -- 172.21.15.32:0/3918679994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face415c010 msgr2=0x7face415f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:05.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.457+0000 7facec800640 1 --2- 172.21.15.32:0/3918679994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face415c010 0x7face415f520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7face4160560 tx=0x7facd401c430 comp rx=0 tx=0).stop 2024-03-19T06:21:05.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.457+0000 7facec800640 1 -- 172.21.15.32:0/3918679994 shutdown_connections 2024-03-19T06:21:05.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.457+0000 7facec800640 1 --2- 172.21.15.32:0/3918679994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face415c010 0x7face415f520 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:05.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.457+0000 7facec800640 1 -- 172.21.15.32:0/3918679994 >> 172.21.15.32:0/3918679994 conn(0x7face40b1280 msgr2=0x7face40b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:05.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.457+0000 7facec800640 1 -- 172.21.15.32:0/3918679994 shutdown_connections 2024-03-19T06:21:05.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.457+0000 7facec800640 1 -- 172.21.15.32:0/3918679994 wait complete. 2024-03-19T06:21:05.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.457+0000 7facec800640 1 Processor -- start 2024-03-19T06:21:05.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.457+0000 7facec800640 1 -- start start 2024-03-19T06:21:05.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7facec800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7face406d6c0 0x7face4157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:05.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7facec800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face40aecf0 0x7face40b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:05.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7facec800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face415c010 0x7face41525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:05.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7facec800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face416a030 con 0x7face40aecf0 2024-03-19T06:21:05.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7facec800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face4169eb0 con 0x7face406d6c0 2024-03-19T06:21:05.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7facec800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face416a1b0 con 0x7face415c010 2024-03-19T06:21:05.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7face9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face40aecf0 0x7face40b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:05.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7face9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face40aecf0 0x7face40b26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47408/0 (socket says 172.21.15.32:47408) 2024-03-19T06:21:05.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7face9400640 1 -- 172.21.15.32:0/4010692045 learned_addr learned my addr 172.21.15.32:0/4010692045 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:05.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7face9e00640 1 --2- 172.21.15.32:0/4010692045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7face406d6c0 0x7face4157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:05.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7facea800640 1 --2- 172.21.15.32:0/4010692045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face415c010 0x7face41525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:05.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7face9400640 1 -- 172.21.15.32:0/4010692045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face415c010 msgr2=0x7face41525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:05.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7face9400640 1 --2- 172.21.15.32:0/4010692045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face415c010 0x7face41525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:05.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7face9400640 1 -- 172.21.15.32:0/4010692045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7face406d6c0 msgr2=0x7face4157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:05.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7face9400640 1 --2- 172.21.15.32:0/4010692045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7face406d6c0 0x7face4157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:05.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7face9400640 1 -- 172.21.15.32:0/4010692045 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face4155f00 con 0x7face40aecf0 2024-03-19T06:21:05.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7face9e00640 1 --2- 172.21.15.32:0/4010692045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7face406d6c0 0x7face4157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:05.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7face9400640 1 --2- 172.21.15.32:0/4010692045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face40aecf0 0x7face40b26c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7facd4019040 tx=0x7facd401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:05.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7facde000640 1 -- 172.21.15.32:0/4010692045 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40b0050 con 0x7face40aecf0 2024-03-19T06:21:05.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7facde000640 1 -- 172.21.15.32:0/4010692045 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd40bc070 con 0x7face40aecf0 2024-03-19T06:21:05.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7facde000640 1 -- 172.21.15.32:0/4010692045 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4006e20 con 0x7face40aecf0 2024-03-19T06:21:05.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7facec800640 1 -- 172.21.15.32:0/4010692045 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face4155c20 con 0x7face40aecf0 2024-03-19T06:21:05.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7facec800640 1 -- 172.21.15.32:0/4010692045 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face40cd570 con 0x7face40aecf0 2024-03-19T06:21:05.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7facec800640 1 -- 172.21.15.32:0/4010692045 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face40749e0 con 0x7face40aecf0 2024-03-19T06:21:05.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.461+0000 7facde000640 1 -- 172.21.15.32:0/4010692045 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7facd40b5870 con 0x7face40aecf0 2024-03-19T06:21:05.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.465+0000 7facde000640 1 --2- 172.21.15.32:0/4010692045 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7facc8067690 0x7facc8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:05.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.465+0000 7facde000640 1 -- 172.21.15.32:0/4010692045 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7facd411f530 con 0x7face40aecf0 2024-03-19T06:21:05.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.465+0000 7face9e00640 1 --2- 172.21.15.32:0/4010692045 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7facc8067690 0x7facc8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:05.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.465+0000 7face9e00640 1 --2- 172.21.15.32:0/4010692045 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7facc8067690 0x7facc8069b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7facd8001740 tx=0x7facd8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:05.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.469+0000 7facde000640 1 -- 172.21.15.32:0/4010692045 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7facd40c5020 con 0x7face40aecf0 2024-03-19T06:21:05.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.665+0000 7facec800640 1 -- 172.21.15.32:0/4010692045 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7face40b53e0 con 0x7face40aecf0 2024-03-19T06:21:05.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.665+0000 7facde000640 1 -- 172.21.15.32:0/4010692045 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7facd40160b0 con 0x7face40aecf0 2024-03-19T06:21:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:05.659 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/3555048948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3555048948},{"type":"v1","addr":"172.21.15.32:6834","nonce":3555048948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3484789829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3484789829},{"type":"v1","addr":"172.21.15.171:6836","nonce":3484789829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/851750022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":851750022},{"type":"v1","addr":"172.21.15.171:6837","nonce":851750022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1902889035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":1902889035},{"type":"v1","addr":"172.21.15.32:6835","nonce":1902889035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-19T06:21:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 3 2024-03-19T06:21:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.669+0000 7facec800640 1 -- 172.21.15.32:0/4010692045 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7facc8067690 msgr2=0x7facc8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.669+0000 7facec800640 1 --2- 172.21.15.32:0/4010692045 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7facc8067690 0x7facc8069b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7facd8001740 tx=0x7facd8009040 comp rx=0 tx=0).stop 2024-03-19T06:21:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.669+0000 7facec800640 1 -- 172.21.15.32:0/4010692045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face40aecf0 msgr2=0x7face40b26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.669+0000 7facec800640 1 --2- 172.21.15.32:0/4010692045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face40aecf0 0x7face40b26c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7facd4019040 tx=0x7facd401ac70 comp rx=0 tx=0).stop 2024-03-19T06:21:05.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.669+0000 7facec800640 1 -- 172.21.15.32:0/4010692045 shutdown_connections 2024-03-19T06:21:05.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.669+0000 7facec800640 1 --2- 172.21.15.32:0/4010692045 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7facc8067690 0x7facc8069b50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:05.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.669+0000 7facec800640 1 --2- 172.21.15.32:0/4010692045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7face415c010 0x7face41525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:05.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.669+0000 7facec800640 1 --2- 172.21.15.32:0/4010692045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7face40aecf0 0x7face40b26c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:05.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.669+0000 7facec800640 1 --2- 172.21.15.32:0/4010692045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7face406d6c0 0x7face4157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:05.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.669+0000 7facec800640 1 -- 172.21.15.32:0/4010692045 >> 172.21.15.32:0/4010692045 conn(0x7face40b1280 msgr2=0x7face415d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:05.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.669+0000 7facec800640 1 -- 172.21.15.32:0/4010692045 shutdown_connections 2024-03-19T06:21:05.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.669+0000 7facec800640 1 -- 172.21.15.32:0/4010692045 wait complete. 2024-03-19T06:21:05.680 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:05.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5ef9c00640 1 Processor -- start 2024-03-19T06:21:05.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5ef9c00640 1 -- start start 2024-03-19T06:21:05.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5ef9c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5ef409a480 0x7f5ef40cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:05.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5ef9c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ef40cd390 0x7f5ef40cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:05.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5ef9c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef415bf00 con 0x7f5ef415bb20 2024-03-19T06:21:05.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5ef9c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef40cc3a0 con 0x7f5ef409a480 2024-03-19T06:21:05.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5ef9c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40cfbb0 con 0x7f5ef40cd390 2024-03-19T06:21:05.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5ef3400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ef40cd390 0x7f5ef40cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:05.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5eea000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5ef409a480 0x7f5ef40cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:05.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5ef2a00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f5ef415bb20 0x7f5ef40c53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:42508/0 (socket says 172.21.15.32:42508) 2024-03-19T06:21:05.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5ef2a00640 1 -- 172.21.15.32:0/1126396441 learned_addr learned my addr 172.21.15.32:0/1126396441 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:05.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5ef2000640 1 -- 172.21.15.32:0/1126396441 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817079637 0 0) 0x7f5ef415bf00 con 0x7f5ef415bb20 2024-03-19T06:21:05.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5ef2000640 1 -- 172.21.15.32:0/1126396441 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed8003530 con 0x7f5ef415bb20 2024-03-19T06:21:05.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5ef3400640 1 -- 172.21.15.32:0/1126396441 >> v2:172.21.15.171:3300/0 conn(0x7f5ef409a480 msgr2=0x7f5ef40cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:05.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5ef3400640 1 --2- 172.21.15.32:0/1126396441 >> v2:172.21.15.171:3300/0 conn(0x7f5ef409a480 0x7f5ef40cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:05.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5ef3400640 1 -- 172.21.15.32:0/1126396441 >> v1:172.21.15.171:6789/0 conn(0x7f5ef415bb20 legacy=0x7f5ef40c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:05.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5ef3400640 1 -- 172.21.15.32:0/1126396441 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef40cc5d0 con 0x7f5ef40cd390 2024-03-19T06:21:05.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.829+0000 7f5eea000640 1 --2- 172.21.15.32:0/1126396441 >> v2:172.21.15.171:3300/0 conn(0x7f5ef409a480 0x7f5ef40cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:05.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.833+0000 7f5ef3400640 1 --2- 172.21.15.32:0/1126396441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ef40cd390 0x7f5ef40cd820 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009d90 tx=0x7f5eec01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73a20d4559a42572 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:05.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.833+0000 7f5ef2000640 1 -- 172.21.15.32:0/1126396441 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0b2070 con 0x7f5ef40cd390 2024-03-19T06:21:05.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.833+0000 7f5ef2000640 1 -- 172.21.15.32:0/1126396441 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec0a5830 con 0x7f5ef40cd390 2024-03-19T06:21:05.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.833+0000 7f5ef2000640 1 -- 172.21.15.32:0/1126396441 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0a5c00 con 0x7f5ef40cd390 2024-03-19T06:21:05.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.833+0000 7f5ef9c00640 1 -- 172.21.15.32:0/1126396441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ef40cd390 msgr2=0x7f5ef40cd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:05.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.833+0000 7f5ef9c00640 1 --2- 172.21.15.32:0/1126396441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ef40cd390 0x7f5ef40cd820 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009d90 tx=0x7f5eec01c970 comp rx=0 tx=0).stop 2024-03-19T06:21:05.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.833+0000 7f5ef9c00640 1 -- 172.21.15.32:0/1126396441 shutdown_connections 2024-03-19T06:21:05.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.833+0000 7f5ef9c00640 1 --2- 172.21.15.32:0/1126396441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ef40cd390 0x7f5ef40cd820 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:05.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.833+0000 7f5ef9c00640 1 --2- 172.21.15.32:0/1126396441 >> v2:172.21.15.171:3300/0 conn(0x7f5ef409a480 0x7f5ef40cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:05.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.833+0000 7f5ef9c00640 1 -- 172.21.15.32:0/1126396441 >> 172.21.15.32:0/1126396441 conn(0x7f5ef40d1890 msgr2=0x7f5ef40d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:05.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.833+0000 7f5ef9c00640 1 -- 172.21.15.32:0/1126396441 shutdown_connections 2024-03-19T06:21:05.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.833+0000 7f5ef9c00640 1 -- 172.21.15.32:0/1126396441 wait complete. 2024-03-19T06:21:05.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef9c00640 1 Processor -- start 2024-03-19T06:21:05.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef9c00640 1 -- start start 2024-03-19T06:21:05.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef9c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ef409a480 0x7f5ef415ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:05.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef9c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ef40cd390 0x7f5ef40c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:05.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef9c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ef415bb20 0x7f5ef41596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:05.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef9c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40c5af0 con 0x7f5ef415bb20 2024-03-19T06:21:05.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef9c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef409a890 con 0x7f5ef40cd390 2024-03-19T06:21:05.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef9c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef4168940 con 0x7f5ef409a480 2024-03-19T06:21:05.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ef415bb20 0x7f5ef41596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:05.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ef415bb20 0x7f5ef41596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47414/0 (socket says 172.21.15.32:47414) 2024-03-19T06:21:05.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef3400640 1 -- 172.21.15.32:0/4220961610 learned_addr learned my addr 172.21.15.32:0/4220961610 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:05.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5eea000640 1 --2- 172.21.15.32:0/4220961610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ef40cd390 0x7f5ef40c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:05.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef2a00640 1 --2- 172.21.15.32:0/4220961610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ef409a480 0x7f5ef415ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:05.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef3400640 1 -- 172.21.15.32:0/4220961610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ef409a480 msgr2=0x7f5ef415ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:05.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef3400640 1 --2- 172.21.15.32:0/4220961610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ef409a480 0x7f5ef415ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:05.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef3400640 1 -- 172.21.15.32:0/4220961610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ef40cd390 msgr2=0x7f5ef40c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:05.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef3400640 1 --2- 172.21.15.32:0/4220961610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ef40cd390 0x7f5ef40c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:05.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef3400640 1 -- 172.21.15.32:0/4220961610 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef415dd20 con 0x7f5ef415bb20 2024-03-19T06:21:05.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef3400640 1 --2- 172.21.15.32:0/4220961610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ef415bb20 0x7f5ef41596f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0b0040 tx=0x7f5eec019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:05.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5eeb400640 1 -- 172.21.15.32:0/4220961610 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0b2050 con 0x7f5ef415bb20 2024-03-19T06:21:05.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5eeb400640 1 -- 172.21.15.32:0/4220961610 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec0be070 con 0x7f5ef415bb20 2024-03-19T06:21:05.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef9c00640 1 -- 172.21.15.32:0/4220961610 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef415e000 con 0x7f5ef415bb20 2024-03-19T06:21:05.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5eeb400640 1 -- 172.21.15.32:0/4220961610 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0ad870 con 0x7f5ef415bb20 2024-03-19T06:21:05.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.837+0000 7f5ef9c00640 1 -- 172.21.15.32:0/4220961610 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef415e5c0 con 0x7f5ef415bb20 2024-03-19T06:21:05.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.841+0000 7f5ef9c00640 1 -- 172.21.15.32:0/4220961610 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef40749e0 con 0x7f5ef415bb20 2024-03-19T06:21:05.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.841+0000 7f5eeb400640 1 -- 172.21.15.32:0/4220961610 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5eec0ada10 con 0x7f5ef415bb20 2024-03-19T06:21:05.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.841+0000 7f5eeb400640 1 --2- 172.21.15.32:0/4220961610 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5ed0067660 0x7f5ed0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:05.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.841+0000 7f5eeb400640 1 -- 172.21.15.32:0/4220961610 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5eec120910 con 0x7f5ef415bb20 2024-03-19T06:21:05.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.841+0000 7f5ef2a00640 1 --2- 172.21.15.32:0/4220961610 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5ed0067660 0x7f5ed0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:05.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.841+0000 7f5ef2a00640 1 --2- 172.21.15.32:0/4220961610 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5ed0067660 0x7f5ed0069b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4007fd0 tx=0x7f5ee4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:05.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:05.845+0000 7f5eeb400640 1 -- 172.21.15.32:0/4220961610 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f5eec016560 con 0x7f5ef415bb20 2024-03-19T06:21:06.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.009+0000 7f5ef9c00640 1 -- 172.21.15.32:0/4220961610 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ef40b7810 con 0x7f5ef415bb20 2024-03-19T06:21:06.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.009+0000 7f5eeb400640 1 -- 172.21.15.32:0/4220961610 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12896 (secure 0 0 0) 0x7f5eec0add00 con 0x7f5ef415bb20 2024-03-19T06:21:06.002 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:06.002 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":18,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:20:58.367584+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:06.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.013+0000 7f5ef9c00640 1 -- 172.21.15.32:0/4220961610 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5ed0067660 msgr2=0x7f5ed0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.013+0000 7f5ef9c00640 1 --2- 172.21.15.32:0/4220961610 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5ed0067660 0x7f5ed0069b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4007fd0 tx=0x7f5ee4009040 comp rx=0 tx=0).stop 2024-03-19T06:21:06.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.013+0000 7f5ef9c00640 1 -- 172.21.15.32:0/4220961610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ef415bb20 msgr2=0x7f5ef41596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.013+0000 7f5ef9c00640 1 --2- 172.21.15.32:0/4220961610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ef415bb20 0x7f5ef41596f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0b0040 tx=0x7f5eec019710 comp rx=0 tx=0).stop 2024-03-19T06:21:06.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.013+0000 7f5ef9c00640 1 -- 172.21.15.32:0/4220961610 shutdown_connections 2024-03-19T06:21:06.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.013+0000 7f5ef9c00640 1 --2- 172.21.15.32:0/4220961610 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5ed0067660 0x7f5ed0069b20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.013+0000 7f5ef9c00640 1 --2- 172.21.15.32:0/4220961610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ef415bb20 0x7f5ef41596f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.013+0000 7f5ef9c00640 1 --2- 172.21.15.32:0/4220961610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ef40cd390 0x7f5ef40c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.013+0000 7f5ef9c00640 1 --2- 172.21.15.32:0/4220961610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ef409a480 0x7f5ef415ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.013+0000 7f5ef9c00640 1 -- 172.21.15.32:0/4220961610 >> 172.21.15.32:0/4220961610 conn(0x7f5ef40d1890 msgr2=0x7f5ef406ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:06.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.013+0000 7f5ef9c00640 1 -- 172.21.15.32:0/4220961610 shutdown_connections 2024-03-19T06:21:06.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.013+0000 7f5ef9c00640 1 -- 172.21.15.32:0/4220961610 wait complete. 2024-03-19T06:21:06.022 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:06.023 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:06.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.173+0000 7f564ce00640 1 Processor -- start 2024-03-19T06:21:06.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.173+0000 7f564ce00640 1 -- start start 2024-03-19T06:21:06.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f564ce00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f564815a840 0x7f564806f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f564ce00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56480af2d0 con 0x7f56480aea70 2024-03-19T06:21:06.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f564ce00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564815eea0 con 0x7f564806b450 2024-03-19T06:21:06.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f564ce00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56480cdc20 con 0x7f564815a840 2024-03-19T06:21:06.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f563d400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f56480aea70 0x7f564806ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36282/0 (socket says 172.21.15.32:36282) 2024-03-19T06:21:06.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f563d400640 1 -- 172.21.15.32:0/2170059730 learned_addr learned my addr 172.21.15.32:0/2170059730 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:06.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645e00640 1 --2- 172.21.15.32:0/2170059730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f564815a840 0x7f564806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645400640 1 -- 172.21.15.32:0/2170059730 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932635562 0 0) 0x7f56480af2d0 con 0x7f56480aea70 2024-03-19T06:21:06.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645400640 1 -- 172.21.15.32:0/2170059730 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f562c003530 con 0x7f56480aea70 2024-03-19T06:21:06.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645400640 1 -- 172.21.15.32:0/2170059730 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2477408980 0 0) 0x7f562c003530 con 0x7f56480aea70 2024-03-19T06:21:06.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645400640 1 -- 172.21.15.32:0/2170059730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f564815a840 msgr2=0x7f564806f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:06.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645400640 1 --2- 172.21.15.32:0/2170059730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f564815a840 0x7f564806f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645400640 1 -- 172.21.15.32:0/2170059730 >> v1:172.21.15.171:6789/0 conn(0x7f564806b450 legacy=0x7f56480ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645400640 1 -- 172.21.15.32:0/2170059730 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564815f180 con 0x7f56480aea70 2024-03-19T06:21:06.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645400640 1 -- 172.21.15.32:0/2170059730 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f5630001680 con 0x7f56480aea70 2024-03-19T06:21:06.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645400640 1 -- 172.21.15.32:0/2170059730 >> v1:172.21.15.32:6789/0 conn(0x7f56480aea70 legacy=0x7f564806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645400640 1 --2- 172.21.15.32:0/2170059730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f562c0039f0 0x7f562c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645400640 1 --2- 172.21.15.32:0/2170059730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f562c004810 0x7f562c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645400640 1 --2- 172.21.15.32:0/2170059730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f564815a840 0x7f562c005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645400640 1 -- 172.21.15.32:0/2170059730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56480cdc20 con 0x7f562c004810 2024-03-19T06:21:06.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645400640 1 -- 172.21.15.32:0/2170059730 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c00bb60 con 0x7f562c0039f0 2024-03-19T06:21:06.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645400640 1 -- 172.21.15.32:0/2170059730 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562c00df70 con 0x7f564815a840 2024-03-19T06:21:06.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f563d400640 1 --2- 172.21.15.32:0/2170059730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f562c004810 0x7f562c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5646800640 1 --2- 172.21.15.32:0/2170059730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f564815a840 0x7f562c005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645e00640 1 --2- 172.21.15.32:0/2170059730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f562c0039f0 0x7f562c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f563d400640 1 -- 172.21.15.32:0/2170059730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f564815a840 msgr2=0x7f562c005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:06.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f563d400640 1 --2- 172.21.15.32:0/2170059730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f564815a840 0x7f562c005280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f563d400640 1 -- 172.21.15.32:0/2170059730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f562c0039f0 msgr2=0x7f562c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:06.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f563d400640 1 --2- 172.21.15.32:0/2170059730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f562c0039f0 0x7f562c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f563d400640 1 -- 172.21.15.32:0/2170059730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562c003530 con 0x7f562c004810 2024-03-19T06:21:06.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5646800640 1 --2- 172.21.15.32:0/2170059730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f564815a840 0x7f562c005280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:06.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.177+0000 7f5645e00640 1 --2- 172.21.15.32:0/2170059730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f562c0039f0 0x7f562c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:06.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.181+0000 7f563d400640 1 --2- 172.21.15.32:0/2170059730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f562c004810 0x7f562c004c90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f563000c0e0 tx=0x7f563001cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a63d10b54d3bcf5 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:06.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.181+0000 7f5645400640 1 -- 172.21.15.32:0/2170059730 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630007c30 con 0x7f562c004810 2024-03-19T06:21:06.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.181+0000 7f5645400640 1 -- 172.21.15.32:0/2170059730 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56300a9020 con 0x7f562c004810 2024-03-19T06:21:06.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.181+0000 7f5645400640 1 -- 172.21.15.32:0/2170059730 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630005ae0 con 0x7f562c004810 2024-03-19T06:21:06.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.181+0000 7f564ce00640 1 -- 172.21.15.32:0/2170059730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f562c004810 msgr2=0x7f562c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.181+0000 7f564ce00640 1 --2- 172.21.15.32:0/2170059730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f562c004810 0x7f562c004c90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f563000c0e0 tx=0x7f563001cb20 comp rx=0 tx=0).stop 2024-03-19T06:21:06.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.181+0000 7f5646800640 1 -- 172.21.15.32:0/2170059730 reap_dead start 2024-03-19T06:21:06.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.181+0000 7f564ce00640 1 -- 172.21.15.32:0/2170059730 shutdown_connections 2024-03-19T06:21:06.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.181+0000 7f564ce00640 1 -- 172.21.15.32:0/2170059730 >> 172.21.15.32:0/2170059730 conn(0x7f56480b1590 msgr2=0x7f56480b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:06.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.181+0000 7f564ce00640 1 -- 172.21.15.32:0/2170059730 shutdown_connections 2024-03-19T06:21:06.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.181+0000 7f564ce00640 1 -- 172.21.15.32:0/2170059730 wait complete. 2024-03-19T06:21:06.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f564ce00640 1 Processor -- start 2024-03-19T06:21:06.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f564ce00640 1 -- start start 2024-03-19T06:21:06.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f564ce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f562c004810 0x7f56481555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f564ce00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56481f7be0 0x7f5648158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f564ce00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56481f8060 0x7f5648159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f564ce00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56480cf150 con 0x7f562c004810 2024-03-19T06:21:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f564ce00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56480cefd0 con 0x7f56481f8060 2024-03-19T06:21:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f564ce00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56480cf2d0 con 0x7f56481f7be0 2024-03-19T06:21:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f5645e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f562c004810 0x7f56481555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f5645e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f562c004810 0x7f56481555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47432/0 (socket says 172.21.15.32:47432) 2024-03-19T06:21:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f5645e00640 1 -- 172.21.15.32:0/4108272788 learned_addr learned my addr 172.21.15.32:0/4108272788 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f5646800640 1 --2- 172.21.15.32:0/4108272788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56481f8060 0x7f5648159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f563d400640 1 --2- 172.21.15.32:0/4108272788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56481f7be0 0x7f5648158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f5645e00640 1 -- 172.21.15.32:0/4108272788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56481f7be0 msgr2=0x7f5648158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f5645e00640 1 --2- 172.21.15.32:0/4108272788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56481f7be0 0x7f5648158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f5645e00640 1 -- 172.21.15.32:0/4108272788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56481f8060 msgr2=0x7f5648159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f5645e00640 1 --2- 172.21.15.32:0/4108272788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56481f8060 0x7f5648159390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f5645e00640 1 -- 172.21.15.32:0/4108272788 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5648155b30 con 0x7f562c004810 2024-03-19T06:21:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f5645e00640 1 --2- 172.21.15.32:0/4108272788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f562c004810 0x7f56481555f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f56380116a0 tx=0x7f5638011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:06.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f563ea00640 1 -- 172.21.15.32:0/4108272788 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638004220 con 0x7f562c004810 2024-03-19T06:21:06.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f563ea00640 1 -- 172.21.15.32:0/4108272788 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56380043c0 con 0x7f562c004810 2024-03-19T06:21:06.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f564ce00640 1 -- 172.21.15.32:0/4108272788 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564815ccc0 con 0x7f562c004810 2024-03-19T06:21:06.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f563ea00640 1 -- 172.21.15.32:0/4108272788 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800f9e0 con 0x7f562c004810 2024-03-19T06:21:06.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f564ce00640 1 -- 172.21.15.32:0/4108272788 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564815d240 con 0x7f562c004810 2024-03-19T06:21:06.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.185+0000 7f564ce00640 1 -- 172.21.15.32:0/4108272788 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56480749e0 con 0x7f562c004810 2024-03-19T06:21:06.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.189+0000 7f563ea00640 1 -- 172.21.15.32:0/4108272788 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f563800fb80 con 0x7f562c004810 2024-03-19T06:21:06.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.189+0000 7f563ea00640 1 --2- 172.21.15.32:0/4108272788 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5624067660 0x7f5624069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.189+0000 7f563ea00640 1 -- 172.21.15.32:0/4108272788 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5638085c10 con 0x7f562c004810 2024-03-19T06:21:06.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.189+0000 7f563d400640 1 --2- 172.21.15.32:0/4108272788 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5624067660 0x7f5624069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.189+0000 7f563d400640 1 --2- 172.21.15.32:0/4108272788 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5624067660 0x7f5624069b20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f563000c0e0 tx=0x7f564815f070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:06.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.193+0000 7f563ea00640 1 -- 172.21.15.32:0/4108272788 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f5638019030 con 0x7f562c004810 2024-03-19T06:21:06.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.357+0000 7f564ce00640 1 -- 172.21.15.32:0/4108272788 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56480b10a0 con 0x7f562c004810 2024-03-19T06:21:06.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.357+0000 7f563ea00640 1 -- 172.21.15.32:0/4108272788 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5638056bd0 con 0x7f562c004810 2024-03-19T06:21:06.348 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.357+0000 7f564ce00640 1 -- 172.21.15.32:0/4108272788 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5624067660 msgr2=0x7f5624069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.357+0000 7f564ce00640 1 --2- 172.21.15.32:0/4108272788 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5624067660 0x7f5624069b20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f563000c0e0 tx=0x7f564815f070 comp rx=0 tx=0).stop 2024-03-19T06:21:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.357+0000 7f564ce00640 1 -- 172.21.15.32:0/4108272788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f562c004810 msgr2=0x7f56481555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.357+0000 7f564ce00640 1 --2- 172.21.15.32:0/4108272788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f562c004810 0x7f56481555f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f56380116a0 tx=0x7f5638011b60 comp rx=0 tx=0).stop 2024-03-19T06:21:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.357+0000 7f564ce00640 1 -- 172.21.15.32:0/4108272788 shutdown_connections 2024-03-19T06:21:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.357+0000 7f564ce00640 1 --2- 172.21.15.32:0/4108272788 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5624067660 0x7f5624069b20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.357+0000 7f564ce00640 1 --2- 172.21.15.32:0/4108272788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56481f8060 0x7f5648159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.357+0000 7f564ce00640 1 --2- 172.21.15.32:0/4108272788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56481f7be0 0x7f5648158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.357+0000 7f564ce00640 1 --2- 172.21.15.32:0/4108272788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f562c004810 0x7f56481555f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.357+0000 7f564ce00640 1 -- 172.21.15.32:0/4108272788 >> 172.21.15.32:0/4108272788 conn(0x7f56480b1590 msgr2=0x7f5648071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:06.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.357+0000 7f564ce00640 1 -- 172.21.15.32:0/4108272788 shutdown_connections 2024-03-19T06:21:06.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.357+0000 7f564ce00640 1 -- 172.21.15.32:0/4108272788 wait complete. 2024-03-19T06:21:06.369 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-19T06:21:06.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.517+0000 7f5d4e600640 1 Processor -- start 2024-03-19T06:21:06.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.517+0000 7f5d4e600640 1 -- start start 2024-03-19T06:21:06.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.521+0000 7f5d4e600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d48099a70 0x7f5d48099e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.521+0000 7f5d4e600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5d4806c060 0x7f5d4815e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.521+0000 7f5d4e600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4806fbe0 con 0x7f5d48161860 2024-03-19T06:21:06.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.521+0000 7f5d4e600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4809a390 con 0x7f5d4806c060 2024-03-19T06:21:06.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.521+0000 7f5d4e600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4815e940 con 0x7f5d48099a70 2024-03-19T06:21:06.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.521+0000 7f5d47e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5d48161860 0x7f5d48161cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36286/0 (socket says 172.21.15.32:36286) 2024-03-19T06:21:06.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.521+0000 7f5d47e00640 1 -- 172.21.15.32:0/4114552870 learned_addr learned my addr 172.21.15.32:0/4114552870 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:06.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.521+0000 7f5d47400640 1 --2- 172.21.15.32:0/4114552870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d48099a70 0x7f5d48099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.521+0000 7f5d3ea00640 1 --2- 172.21.15.32:0/4114552870 >> v2:172.21.15.171:3300/0 conn(0x7f5d4806c060 0x7f5d4815e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.521+0000 7f5d46a00640 1 -- 172.21.15.32:0/4114552870 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090142101 0 0) 0x7f5d400014a0 con 0x7f5d48161860 2024-03-19T06:21:06.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.521+0000 7f5d46a00640 1 -- 172.21.15.32:0/4114552870 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d2c003530 con 0x7f5d48161860 2024-03-19T06:21:06.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.521+0000 7f5d47400640 1 -- 172.21.15.32:0/4114552870 >> v2:172.21.15.171:3300/0 conn(0x7f5d4806c060 msgr2=0x7f5d4815e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:06.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.521+0000 7f5d47400640 1 --2- 172.21.15.32:0/4114552870 >> v2:172.21.15.171:3300/0 conn(0x7f5d4806c060 0x7f5d4815e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.521+0000 7f5d47400640 1 -- 172.21.15.32:0/4114552870 >> v1:172.21.15.32:6789/0 conn(0x7f5d48161860 legacy=0x7f5d48161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.521+0000 7f5d46a00640 1 -- 172.21.15.32:0/4114552870 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2400164230 0 0) 0x7f5d2c003530 con 0x7f5d48161860 2024-03-19T06:21:06.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.521+0000 7f5d47400640 1 -- 172.21.15.32:0/4114552870 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4815ec20 con 0x7f5d48099a70 2024-03-19T06:21:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.525+0000 7f5d47400640 1 --2- 172.21.15.32:0/4114552870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d48099a70 0x7f5d48099e50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5d380097c0 tx=0x7f5d3801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27262730d715d0f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:06.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.525+0000 7f5d46a00640 1 -- 172.21.15.32:0/4114552870 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d380b2070 con 0x7f5d48099a70 2024-03-19T06:21:06.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.525+0000 7f5d46a00640 1 -- 172.21.15.32:0/4114552870 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d380ad640 con 0x7f5d48099a70 2024-03-19T06:21:06.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.525+0000 7f5d46a00640 1 -- 172.21.15.32:0/4114552870 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d380ada10 con 0x7f5d48099a70 2024-03-19T06:21:06.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.525+0000 7f5d4e600640 1 -- 172.21.15.32:0/4114552870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d48099a70 msgr2=0x7f5d48099e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.525+0000 7f5d4e600640 1 --2- 172.21.15.32:0/4114552870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d48099a70 0x7f5d48099e50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5d380097c0 tx=0x7f5d3801c4a0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.525+0000 7f5d4e600640 1 -- 172.21.15.32:0/4114552870 shutdown_connections 2024-03-19T06:21:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.525+0000 7f5d4e600640 1 --2- 172.21.15.32:0/4114552870 >> v2:172.21.15.171:3300/0 conn(0x7f5d4806c060 0x7f5d4815e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.525+0000 7f5d4e600640 1 --2- 172.21.15.32:0/4114552870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d48099a70 0x7f5d48099e50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.525+0000 7f5d4e600640 1 -- 172.21.15.32:0/4114552870 >> 172.21.15.32:0/4114552870 conn(0x7f5d480b3300 msgr2=0x7f5d480b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.525+0000 7f5d4e600640 1 -- 172.21.15.32:0/4114552870 shutdown_connections 2024-03-19T06:21:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.525+0000 7f5d4e600640 1 -- 172.21.15.32:0/4114552870 wait complete. 2024-03-19T06:21:06.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.525+0000 7f5d4e600640 1 Processor -- start 2024-03-19T06:21:06.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.525+0000 7f5d4e600640 1 -- start start 2024-03-19T06:21:06.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d4e600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d4806c060 0x7f5d481596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d4e600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d48099a70 0x7f5d4814d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d4e600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d48161860 0x7f5d480c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d4e600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4815e6d0 con 0x7f5d4806c060 2024-03-19T06:21:06.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d4e600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4815e550 con 0x7f5d48161860 2024-03-19T06:21:06.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d4e600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4816b410 con 0x7f5d48099a70 2024-03-19T06:21:06.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d47400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d4806c060 0x7f5d481596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d47400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d4806c060 0x7f5d481596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47440/0 (socket says 172.21.15.32:47440) 2024-03-19T06:21:06.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d47400640 1 -- 172.21.15.32:0/3165550543 learned_addr learned my addr 172.21.15.32:0/3165550543 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:06.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d3ea00640 1 --2- 172.21.15.32:0/3165550543 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d48099a70 0x7f5d4814d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d47400640 1 -- 172.21.15.32:0/3165550543 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d48099a70 msgr2=0x7f5d4814d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d47400640 1 --2- 172.21.15.32:0/3165550543 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d48099a70 0x7f5d4814d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d47400640 1 -- 172.21.15.32:0/3165550543 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d48161860 msgr2=0x7f5d480c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d47400640 1 --2- 172.21.15.32:0/3165550543 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d48161860 0x7f5d480c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d47400640 1 -- 172.21.15.32:0/3165550543 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4814d8c0 con 0x7f5d4806c060 2024-03-19T06:21:06.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d47400640 1 --2- 172.21.15.32:0/3165550543 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d4806c060 0x7f5d481596d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5d3801a0d0 tx=0x7f5d38019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:06.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d3fe00640 1 -- 172.21.15.32:0/3165550543 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d380b2040 con 0x7f5d4806c060 2024-03-19T06:21:06.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d3fe00640 1 -- 172.21.15.32:0/3165550543 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d380ad440 con 0x7f5d4806c060 2024-03-19T06:21:06.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d3fe00640 1 -- 172.21.15.32:0/3165550543 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38006e20 con 0x7f5d4806c060 2024-03-19T06:21:06.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d4e600640 1 -- 172.21.15.32:0/3165550543 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d480ca690 con 0x7f5d4806c060 2024-03-19T06:21:06.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d4e600640 1 -- 172.21.15.32:0/3165550543 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d480cac50 con 0x7f5d4806c060 2024-03-19T06:21:06.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d4e600640 1 -- 172.21.15.32:0/3165550543 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d480749e0 con 0x7f5d4806c060 2024-03-19T06:21:06.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.529+0000 7f5d3fe00640 1 -- 172.21.15.32:0/3165550543 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5d380be020 con 0x7f5d4806c060 2024-03-19T06:21:06.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.533+0000 7f5d3fe00640 1 --2- 172.21.15.32:0/3165550543 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5d24067660 0x7f5d24069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.533+0000 7f5d3fe00640 1 -- 172.21.15.32:0/3165550543 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5d3811eef0 con 0x7f5d4806c060 2024-03-19T06:21:06.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.533+0000 7f5d3ea00640 1 --2- 172.21.15.32:0/3165550543 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5d24067660 0x7f5d24069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.533+0000 7f5d3ea00640 1 --2- 172.21.15.32:0/3165550543 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5d24067660 0x7f5d24069b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5d48158500 tx=0x7f5d30008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:06.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.537+0000 7f5d3fe00640 1 -- 172.21.15.32:0/3165550543 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f5d38016090 con 0x7f5d4806c060 2024-03-19T06:21:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.697+0000 7f5d4e600640 1 -- 172.21.15.32:0/3165550543 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5d480b4100 con 0x7f5d4806c060 2024-03-19T06:21:06.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.697+0000 7f5d3fe00640 1 -- 172.21.15.32:0/3165550543 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5d380eff40 con 0x7f5d4806c060 2024-03-19T06:21:06.690 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:06.690 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2024-03-19T06:21:06.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:21:06.690 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2024-03-19T06:21:06.691 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2024-03-19T06:21:06.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:21:06.691 INFO:teuthology.orchestra.run.smithi032.stdout:] 2024-03-19T06:21:06.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.701+0000 7f5d4e600640 1 -- 172.21.15.32:0/3165550543 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5d24067660 msgr2=0x7f5d24069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.701+0000 7f5d4e600640 1 --2- 172.21.15.32:0/3165550543 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5d24067660 0x7f5d24069b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5d48158500 tx=0x7f5d30008040 comp rx=0 tx=0).stop 2024-03-19T06:21:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.701+0000 7f5d4e600640 1 -- 172.21.15.32:0/3165550543 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d4806c060 msgr2=0x7f5d481596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.701+0000 7f5d4e600640 1 --2- 172.21.15.32:0/3165550543 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d4806c060 0x7f5d481596d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5d3801a0d0 tx=0x7f5d38019240 comp rx=0 tx=0).stop 2024-03-19T06:21:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.701+0000 7f5d4e600640 1 -- 172.21.15.32:0/3165550543 shutdown_connections 2024-03-19T06:21:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.701+0000 7f5d4e600640 1 --2- 172.21.15.32:0/3165550543 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5d24067660 0x7f5d24069b20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.701+0000 7f5d4e600640 1 --2- 172.21.15.32:0/3165550543 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d48161860 0x7f5d480c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.701+0000 7f5d4e600640 1 --2- 172.21.15.32:0/3165550543 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d48099a70 0x7f5d4814d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.701+0000 7f5d4e600640 1 --2- 172.21.15.32:0/3165550543 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d4806c060 0x7f5d481596d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.701+0000 7f5d4e600640 1 -- 172.21.15.32:0/3165550543 >> 172.21.15.32:0/3165550543 conn(0x7f5d480b3300 msgr2=0x7f5d48160dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.701+0000 7f5d4e600640 1 -- 172.21.15.32:0/3165550543 shutdown_connections 2024-03-19T06:21:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.701+0000 7f5d4e600640 1 -- 172.21.15.32:0/3165550543 wait complete. 2024-03-19T06:21:06.711 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-19T06:21:06.711 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-19T06:21:06.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.861+0000 7f504be00640 1 Processor -- start 2024-03-19T06:21:06.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.861+0000 7f504be00640 1 -- start start 2024-03-19T06:21:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.865+0000 7f504be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f504c0b0f80 0x7f504c0af690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.865+0000 7f504be00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504c0cec40 con 0x7f504c15dd10 2024-03-19T06:21:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.865+0000 7f504be00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504c0ceee0 con 0x7f504c0afbd0 2024-03-19T06:21:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.865+0000 7f504be00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504c15e0f0 con 0x7f504c0b0f80 2024-03-19T06:21:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.865+0000 7f5043e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f504c0b0f80 0x7f504c0af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.865+0000 7f5043e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f504c0b0f80 0x7f504c0af690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47444/0 (socket says 172.21.15.32:47444) 2024-03-19T06:21:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.865+0000 7f5043e00640 1 -- 172.21.15.32:0/3305742999 learned_addr learned my addr 172.21.15.32:0/3305742999 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.865+0000 7f504aa00640 1 --1- 172.21.15.32:0/3305742999 >> v1:172.21.15.32:6789/0 conn(0x7f504c15dd10 0x7f504c0b0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36288/0 (socket says 172.21.15.32:36288) 2024-03-19T06:21:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.865+0000 7f5043e00640 1 -- 172.21.15.32:0/3305742999 >> v1:172.21.15.171:6789/0 conn(0x7f504c0afbd0 legacy=0x7f504c0ad360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.865+0000 7f5043e00640 1 -- 172.21.15.32:0/3305742999 >> v1:172.21.15.32:6789/0 conn(0x7f504c15dd10 legacy=0x7f504c0b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.865+0000 7f5043e00640 1 -- 172.21.15.32:0/3305742999 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c0cf1c0 con 0x7f504c0b0f80 2024-03-19T06:21:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.865+0000 7f504a000640 1 -- 172.21.15.32:0/3305742999 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262423911 0 0) 0x7f504c0cec40 con 0x7f504c15dd10 2024-03-19T06:21:06.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.869+0000 7f5043e00640 1 --2- 172.21.15.32:0/3305742999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504c0b0f80 0x7f504c0af690 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5034009870 tx=0x7f503401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389e1130407d86e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:06.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.869+0000 7f504a000640 1 -- 172.21.15.32:0/3305742999 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50340b1070 con 0x7f504c0b0f80 2024-03-19T06:21:06.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.869+0000 7f504a000640 1 -- 172.21.15.32:0/3305742999 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50340ac620 con 0x7f504c0b0f80 2024-03-19T06:21:06.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.869+0000 7f504a000640 1 -- 172.21.15.32:0/3305742999 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50340ac9f0 con 0x7f504c0b0f80 2024-03-19T06:21:06.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.869+0000 7f504be00640 1 -- 172.21.15.32:0/3305742999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504c0b0f80 msgr2=0x7f504c0af690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.869+0000 7f504be00640 1 --2- 172.21.15.32:0/3305742999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504c0b0f80 0x7f504c0af690 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5034009870 tx=0x7f503401c4d0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.869+0000 7f504be00640 1 -- 172.21.15.32:0/3305742999 shutdown_connections 2024-03-19T06:21:06.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.869+0000 7f504be00640 1 --2- 172.21.15.32:0/3305742999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504c0b0f80 0x7f504c0af690 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.869+0000 7f504be00640 1 -- 172.21.15.32:0/3305742999 >> 172.21.15.32:0/3305742999 conn(0x7f504c0b58e0 msgr2=0x7f504c0b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:06.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.869+0000 7f504be00640 1 -- 172.21.15.32:0/3305742999 shutdown_connections 2024-03-19T06:21:06.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.869+0000 7f504be00640 1 -- 172.21.15.32:0/3305742999 wait complete. 2024-03-19T06:21:06.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.869+0000 7f504be00640 1 Processor -- start 2024-03-19T06:21:06.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.869+0000 7f504be00640 1 -- start start 2024-03-19T06:21:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504c0afbd0 0x7f504c160c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504be00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f504c0b0f80 0x7f504c15a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504be00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f504c15dd10 0x7f504c15b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504be00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c16b7f0 con 0x7f504c0afbd0 2024-03-19T06:21:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504be00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c0cff80 con 0x7f504c0b0f80 2024-03-19T06:21:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504be00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504c16b970 con 0x7f504c15dd10 2024-03-19T06:21:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504c0afbd0 0x7f504c160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504c0afbd0 0x7f504c160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47446/0 (socket says 172.21.15.32:47446) 2024-03-19T06:21:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504aa00640 1 -- 172.21.15.32:0/1115168017 learned_addr learned my addr 172.21.15.32:0/1115168017 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f5043e00640 1 --2- 172.21.15.32:0/1115168017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f504c0b0f80 0x7f504c15a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504b400640 1 --2- 172.21.15.32:0/1115168017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f504c15dd10 0x7f504c15b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504aa00640 1 -- 172.21.15.32:0/1115168017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f504c15dd10 msgr2=0x7f504c15b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504aa00640 1 --2- 172.21.15.32:0/1115168017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f504c15dd10 0x7f504c15b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504aa00640 1 -- 172.21.15.32:0/1115168017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f504c0b0f80 msgr2=0x7f504c15a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504aa00640 1 --2- 172.21.15.32:0/1115168017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f504c0b0f80 0x7f504c15a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504aa00640 1 -- 172.21.15.32:0/1115168017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c15ab70 con 0x7f504c0afbd0 2024-03-19T06:21:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504b400640 1 --2- 172.21.15.32:0/1115168017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f504c15dd10 0x7f504c15b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504aa00640 1 --2- 172.21.15.32:0/1115168017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504c0afbd0 0x7f504c160c70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f503c00c4a0 tx=0x7f503c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f5042a00640 1 -- 172.21.15.32:0/1115168017 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c018070 con 0x7f504c0afbd0 2024-03-19T06:21:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f5042a00640 1 -- 172.21.15.32:0/1115168017 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c0074e0 con 0x7f504c0afbd0 2024-03-19T06:21:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f5042a00640 1 -- 172.21.15.32:0/1115168017 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c004a30 con 0x7f504c0afbd0 2024-03-19T06:21:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504be00640 1 -- 172.21.15.32:0/1115168017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504c15ae50 con 0x7f504c0afbd0 2024-03-19T06:21:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504be00640 1 -- 172.21.15.32:0/1115168017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504c15e610 con 0x7f504c0afbd0 2024-03-19T06:21:06.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f504be00640 1 -- 172.21.15.32:0/1115168017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504c075090 con 0x7f504c0afbd0 2024-03-19T06:21:06.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.873+0000 7f5042a00640 1 -- 172.21.15.32:0/1115168017 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f503c004bd0 con 0x7f504c0afbd0 2024-03-19T06:21:06.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.877+0000 7f5042a00640 1 --2- 172.21.15.32:0/1115168017 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5028067660 0x7f5028069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:06.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.877+0000 7f5042a00640 1 -- 172.21.15.32:0/1115168017 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f503c0848f0 con 0x7f504c0afbd0 2024-03-19T06:21:06.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.877+0000 7f5043e00640 1 --2- 172.21.15.32:0/1115168017 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5028067660 0x7f5028069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:06.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.877+0000 7f5043e00640 1 --2- 172.21.15.32:0/1115168017 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5028067660 0x7f5028069b20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f50340ae000 tx=0x7f50340a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:06.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:06.881+0000 7f5042a00640 1 -- 172.21.15.32:0/1115168017 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f503c0551d0 con 0x7f504c0afbd0 2024-03-19T06:21:07.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.041+0000 7f504be00640 1 -- 172.21.15.32:0/1115168017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f504c0d05a0 con 0x7f504c0afbd0 2024-03-19T06:21:07.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.393+0000 7f5042a00640 1 -- 172.21.15.32:0/1115168017 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f503c059270 con 0x7f504c0afbd0 2024-03-19T06:21:07.387 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' created 2024-03-19T06:21:07.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.397+0000 7f504be00640 1 -- 172.21.15.32:0/1115168017 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5028067660 msgr2=0x7f5028069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:07.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.397+0000 7f504be00640 1 --2- 172.21.15.32:0/1115168017 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5028067660 0x7f5028069b20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f50340ae000 tx=0x7f50340a7000 comp rx=0 tx=0).stop 2024-03-19T06:21:07.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.397+0000 7f504be00640 1 -- 172.21.15.32:0/1115168017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504c0afbd0 msgr2=0x7f504c160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:07.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.397+0000 7f504be00640 1 --2- 172.21.15.32:0/1115168017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504c0afbd0 0x7f504c160c70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f503c00c4a0 tx=0x7f503c00c960 comp rx=0 tx=0).stop 2024-03-19T06:21:07.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.397+0000 7f504be00640 1 -- 172.21.15.32:0/1115168017 shutdown_connections 2024-03-19T06:21:07.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.397+0000 7f504be00640 1 --2- 172.21.15.32:0/1115168017 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5028067660 0x7f5028069b20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:07.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.397+0000 7f504be00640 1 --2- 172.21.15.32:0/1115168017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f504c15dd10 0x7f504c15b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:07.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.397+0000 7f504be00640 1 --2- 172.21.15.32:0/1115168017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f504c0b0f80 0x7f504c15a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:07.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.397+0000 7f504be00640 1 --2- 172.21.15.32:0/1115168017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f504c0afbd0 0x7f504c160c70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:07.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.397+0000 7f504be00640 1 -- 172.21.15.32:0/1115168017 >> 172.21.15.32:0/1115168017 conn(0x7f504c0b58e0 msgr2=0x7f504c0d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:07.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.397+0000 7f504be00640 1 -- 172.21.15.32:0/1115168017 shutdown_connections 2024-03-19T06:21:07.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.397+0000 7f504be00640 1 -- 172.21.15.32:0/1115168017 wait complete. 2024-03-19T06:21:07.416 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-19T06:21:07.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f7684a00640 1 Processor -- start 2024-03-19T06:21:07.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f7684a00640 1 -- start start 2024-03-19T06:21:07.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f7684a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7680161560 0x7f76800b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:07.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f7684a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f76800b2280 0x7f7680161940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:07.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f7684a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76800b1310 con 0x7f7680161e80 2024-03-19T06:21:07.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f7684a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768006be50 con 0x7f76800b2280 2024-03-19T06:21:07.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f7684a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76800d04e0 con 0x7f7680161560 2024-03-19T06:21:07.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f7677e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f76800b2280 0x7f7680161940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:07.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f767fe00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f7680161e80 0x7f768006c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:42550/0 (socket says 172.21.15.32:42550) 2024-03-19T06:21:07.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f767fe00640 1 -- 172.21.15.32:0/2810812803 learned_addr learned my addr 172.21.15.32:0/2810812803 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:07.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f767f400640 1 --2- 172.21.15.32:0/2810812803 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7680161560 0x7f76800b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:07.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f767ea00640 1 -- 172.21.15.32:0/2810812803 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782396581 0 0) 0x7f76800b1310 con 0x7f7680161e80 2024-03-19T06:21:07.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f767ea00640 1 -- 172.21.15.32:0/2810812803 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7664003530 con 0x7f7680161e80 2024-03-19T06:21:07.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f767f400640 1 -- 172.21.15.32:0/2810812803 >> v2:172.21.15.171:3300/0 conn(0x7f76800b2280 msgr2=0x7f7680161940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:07.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f767f400640 1 --2- 172.21.15.32:0/2810812803 >> v2:172.21.15.171:3300/0 conn(0x7f76800b2280 0x7f7680161940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:07.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f767f400640 1 -- 172.21.15.32:0/2810812803 >> v1:172.21.15.171:6789/0 conn(0x7f7680161e80 legacy=0x7f768006c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:07.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f767f400640 1 -- 172.21.15.32:0/2810812803 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76800d07c0 con 0x7f7680161560 2024-03-19T06:21:07.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.573+0000 7f7677e00640 1 --2- 172.21.15.32:0/2810812803 >> v2:172.21.15.171:3300/0 conn(0x7f76800b2280 0x7f7680161940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:07.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.577+0000 7f767f400640 1 --2- 172.21.15.32:0/2810812803 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7680161560 0x7f76800b0dd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f76700097c0 tx=0x7f767001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bf2664ebe6c6e91 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:07.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.577+0000 7f767ea00640 1 -- 172.21.15.32:0/2810812803 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76700b0070 con 0x7f7680161560 2024-03-19T06:21:07.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.577+0000 7f767ea00640 1 -- 172.21.15.32:0/2810812803 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76700ab600 con 0x7f7680161560 2024-03-19T06:21:07.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.577+0000 7f767ea00640 1 -- 172.21.15.32:0/2810812803 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76700ab9d0 con 0x7f7680161560 2024-03-19T06:21:07.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.577+0000 7f7684a00640 1 -- 172.21.15.32:0/2810812803 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7680161560 msgr2=0x7f76800b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:07.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.577+0000 7f7684a00640 1 --2- 172.21.15.32:0/2810812803 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7680161560 0x7f76800b0dd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f76700097c0 tx=0x7f767001c4a0 comp rx=0 tx=0).stop 2024-03-19T06:21:07.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.577+0000 7f7684a00640 1 -- 172.21.15.32:0/2810812803 shutdown_connections 2024-03-19T06:21:07.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.577+0000 7f7684a00640 1 --2- 172.21.15.32:0/2810812803 >> v2:172.21.15.171:3300/0 conn(0x7f76800b2280 0x7f7680161940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:07.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.577+0000 7f7684a00640 1 --2- 172.21.15.32:0/2810812803 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7680161560 0x7f76800b0dd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:07.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.577+0000 7f7684a00640 1 -- 172.21.15.32:0/2810812803 >> 172.21.15.32:0/2810812803 conn(0x7f76800b3120 msgr2=0x7f76800b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:07.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.577+0000 7f7684a00640 1 -- 172.21.15.32:0/2810812803 shutdown_connections 2024-03-19T06:21:07.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.577+0000 7f7684a00640 1 -- 172.21.15.32:0/2810812803 wait complete. 2024-03-19T06:21:07.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f7684a00640 1 Processor -- start 2024-03-19T06:21:07.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f7684a00640 1 -- start start 2024-03-19T06:21:07.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f7684a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76800b2280 0x7f76801537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:07.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f7684a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7680161560 0x7f7680156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:07.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f7684a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7680161e80 0x7f7680155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:07.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f7684a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76800b27e0 con 0x7f7680161e80 2024-03-19T06:21:07.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f7684a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76800b2660 con 0x7f76800b2280 2024-03-19T06:21:07.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f7684a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7680162290 con 0x7f7680161560 2024-03-19T06:21:07.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f767fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7680161e80 0x7f7680155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:07.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f767fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7680161e80 0x7f7680155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47462/0 (socket says 172.21.15.32:47462) 2024-03-19T06:21:07.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f767fe00640 1 -- 172.21.15.32:0/133712958 learned_addr learned my addr 172.21.15.32:0/133712958 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:07.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f7677e00640 1 --2- 172.21.15.32:0/133712958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7680161560 0x7f7680156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:07.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f767f400640 1 --2- 172.21.15.32:0/133712958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76800b2280 0x7f76801537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:07.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f767f400640 1 -- 172.21.15.32:0/133712958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7680161560 msgr2=0x7f7680156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:07.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f767f400640 1 --2- 172.21.15.32:0/133712958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7680161560 0x7f7680156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:07.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f767f400640 1 -- 172.21.15.32:0/133712958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7680161e80 msgr2=0x7f7680155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:07.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f767f400640 1 --2- 172.21.15.32:0/133712958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7680161e80 0x7f7680155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:07.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f767f400640 1 -- 172.21.15.32:0/133712958 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7680157230 con 0x7f76800b2280 2024-03-19T06:21:07.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f767fe00640 1 --2- 172.21.15.32:0/133712958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7680161e80 0x7f7680155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:07.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f767f400640 1 --2- 172.21.15.32:0/133712958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76800b2280 0x7f76801537d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f76700ab000 tx=0x7f7670019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:07.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f7677400640 1 -- 172.21.15.32:0/133712958 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76700b8020 con 0x7f76800b2280 2024-03-19T06:21:07.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f7677400640 1 -- 172.21.15.32:0/133712958 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76700b4410 con 0x7f76800b2280 2024-03-19T06:21:07.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f7684a00640 1 -- 172.21.15.32:0/133712958 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7680157510 con 0x7f76800b2280 2024-03-19T06:21:07.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f7677400640 1 -- 172.21.15.32:0/133712958 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76700b0040 con 0x7f76800b2280 2024-03-19T06:21:07.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.581+0000 7f7684a00640 1 -- 172.21.15.32:0/133712958 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7680157ad0 con 0x7f76800b2280 2024-03-19T06:21:07.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.585+0000 7f7684a00640 1 -- 172.21.15.32:0/133712958 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76800b4b90 con 0x7f76800b2280 2024-03-19T06:21:07.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.585+0000 7f7677400640 1 -- 172.21.15.32:0/133712958 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f76700bb020 con 0x7f76800b2280 2024-03-19T06:21:07.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.585+0000 7f7677400640 1 --2- 172.21.15.32:0/133712958 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f765c067660 0x7f765c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:07.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.585+0000 7f7677400640 1 -- 172.21.15.32:0/133712958 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f767011f440 con 0x7f76800b2280 2024-03-19T06:21:07.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.585+0000 7f7677e00640 1 --2- 172.21.15.32:0/133712958 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f765c067660 0x7f765c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:07.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.585+0000 7f7677e00640 1 --2- 172.21.15.32:0/133712958 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f765c067660 0x7f765c069b20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7668009580 tx=0x7f7668009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:07.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.589+0000 7f7677400640 1 -- 172.21.15.32:0/133712958 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f76700c2030 con 0x7f76800b2280 2024-03-19T06:21:07.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:07.753+0000 7f7684a00640 1 -- 172.21.15.32:0/133712958 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7680075090 con 0x7f76800b2280 2024-03-19T06:21:08.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.413+0000 7f7677400640 1 -- 172.21.15.32:0/133712958 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7670016090 con 0x7f76800b2280 2024-03-19T06:21:08.406 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' created 2024-03-19T06:21:08.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.421+0000 7f7684a00640 1 -- 172.21.15.32:0/133712958 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f765c067660 msgr2=0x7f765c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:08.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.421+0000 7f7684a00640 1 --2- 172.21.15.32:0/133712958 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f765c067660 0x7f765c069b20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7668009580 tx=0x7f7668009190 comp rx=0 tx=0).stop 2024-03-19T06:21:08.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.421+0000 7f7684a00640 1 -- 172.21.15.32:0/133712958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76800b2280 msgr2=0x7f76801537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:08.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.421+0000 7f7684a00640 1 --2- 172.21.15.32:0/133712958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76800b2280 0x7f76801537d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f76700ab000 tx=0x7f7670019240 comp rx=0 tx=0).stop 2024-03-19T06:21:08.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.421+0000 7f7684a00640 1 -- 172.21.15.32:0/133712958 shutdown_connections 2024-03-19T06:21:08.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.421+0000 7f7684a00640 1 --2- 172.21.15.32:0/133712958 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f765c067660 0x7f765c069b20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:08.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.421+0000 7f7684a00640 1 --2- 172.21.15.32:0/133712958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7680161e80 0x7f7680155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:08.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.421+0000 7f7684a00640 1 --2- 172.21.15.32:0/133712958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7680161560 0x7f7680156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:08.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.421+0000 7f7684a00640 1 --2- 172.21.15.32:0/133712958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76800b2280 0x7f76801537d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:08.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.421+0000 7f7684a00640 1 -- 172.21.15.32:0/133712958 >> 172.21.15.32:0/133712958 conn(0x7f76800b3120 msgr2=0x7f76800b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:08.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.425+0000 7f7684a00640 1 -- 172.21.15.32:0/133712958 shutdown_connections 2024-03-19T06:21:08.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.425+0000 7f7684a00640 1 -- 172.21.15.32:0/133712958 wait complete. 2024-03-19T06:21:08.444 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-19T06:21:08.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff41ec00640 1 Processor -- start 2024-03-19T06:21:08.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff41ec00640 1 -- start start 2024-03-19T06:21:08.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff41ec00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff41815a840 0x7ff41806f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:08.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff41ec00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff41806b450 0x7ff4180ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:08.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff41ec00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4180af2d0 con 0x7ff4180aea70 2024-03-19T06:21:08.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff41ec00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4180cdc20 con 0x7ff41815a840 2024-03-19T06:21:08.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff41ec00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41815eea0 con 0x7ff41806b450 2024-03-19T06:21:08.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff417400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff4180aea70 0x7ff41806ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36290/0 (socket says 172.21.15.32:36290) 2024-03-19T06:21:08.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff417400640 1 -- 172.21.15.32:0/1710797891 learned_addr learned my addr 172.21.15.32:0/1710797891 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:08.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff41cc00640 1 --2- 172.21.15.32:0/1710797891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff41806b450 0x7ff4180ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:08.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff417e00640 1 --2- 172.21.15.32:0/1710797891 >> v2:172.21.15.171:3300/0 conn(0x7ff41815a840 0x7ff41806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:08.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff416a00640 1 -- 172.21.15.32:0/1710797891 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998934307 0 0) 0x7ff4180af2d0 con 0x7ff4180aea70 2024-03-19T06:21:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff416a00640 1 -- 172.21.15.32:0/1710797891 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3fc003530 con 0x7ff4180aea70 2024-03-19T06:21:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff416a00640 1 -- 172.21.15.32:0/1710797891 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 463321779 0 0) 0x7ff3fc003530 con 0x7ff4180aea70 2024-03-19T06:21:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff416a00640 1 -- 172.21.15.32:0/1710797891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff41806b450 msgr2=0x7ff4180ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff416a00640 1 --2- 172.21.15.32:0/1710797891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff41806b450 0x7ff4180ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff416a00640 1 -- 172.21.15.32:0/1710797891 >> v2:172.21.15.171:3300/0 conn(0x7ff41815a840 msgr2=0x7ff41806f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff416a00640 1 --2- 172.21.15.32:0/1710797891 >> v2:172.21.15.171:3300/0 conn(0x7ff41815a840 0x7ff41806f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff416a00640 1 -- 172.21.15.32:0/1710797891 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41815f180 con 0x7ff4180aea70 2024-03-19T06:21:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff416a00640 1 -- 172.21.15.32:0/1710797891 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7ff404001680 con 0x7ff4180aea70 2024-03-19T06:21:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff416a00640 1 -- 172.21.15.32:0/1710797891 >> v1:172.21.15.32:6789/0 conn(0x7ff4180aea70 legacy=0x7ff41806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff416a00640 1 --2- 172.21.15.32:0/1710797891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3fc0039c0 0x7ff3fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff416a00640 1 --2- 172.21.15.32:0/1710797891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3fc004810 0x7ff3fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff416a00640 1 --2- 172.21.15.32:0/1710797891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff41806b450 0x7ff3fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff416a00640 1 -- 172.21.15.32:0/1710797891 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4180cdc20 con 0x7ff3fc0039c0 2024-03-19T06:21:08.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff416a00640 1 -- 172.21.15.32:0/1710797891 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41815eea0 con 0x7ff3fc004810 2024-03-19T06:21:08.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff416a00640 1 -- 172.21.15.32:0/1710797891 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc00bb30 con 0x7ff41806b450 2024-03-19T06:21:08.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff417e00640 1 --2- 172.21.15.32:0/1710797891 >> v2:172.21.15.171:3300/0 conn(0x7ff41815a840 0x7ff41806f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:08.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff417e00640 1 --2- 172.21.15.32:0/1710797891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3fc0039c0 0x7ff3fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:08.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff417400640 1 --2- 172.21.15.32:0/1710797891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3fc004810 0x7ff3fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:08.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff41cc00640 1 --2- 172.21.15.32:0/1710797891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff41806b450 0x7ff3fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:08.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff417e00640 1 -- 172.21.15.32:0/1710797891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff41806b450 msgr2=0x7ff3fc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:08.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff417e00640 1 --2- 172.21.15.32:0/1710797891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff41806b450 0x7ff3fc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:08.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff417e00640 1 -- 172.21.15.32:0/1710797891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3fc004810 msgr2=0x7ff3fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:08.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff417e00640 1 --2- 172.21.15.32:0/1710797891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3fc004810 0x7ff3fc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:08.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.597+0000 7ff417e00640 1 -- 172.21.15.32:0/1710797891 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc003530 con 0x7ff3fc0039c0 2024-03-19T06:21:08.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.601+0000 7ff417e00640 1 --2- 172.21.15.32:0/1710797891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3fc0039c0 0x7ff3fc003de0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff4080098b0 tx=0x7ff40801c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e856c8e191fb43f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:08.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.601+0000 7ff416a00640 1 -- 172.21.15.32:0/1710797891 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4080ac070 con 0x7ff3fc0039c0 2024-03-19T06:21:08.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.601+0000 7ff416a00640 1 -- 172.21.15.32:0/1710797891 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff408004220 con 0x7ff3fc0039c0 2024-03-19T06:21:08.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.601+0000 7ff416a00640 1 -- 172.21.15.32:0/1710797891 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40800f040 con 0x7ff3fc0039c0 2024-03-19T06:21:08.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.601+0000 7ff41ec00640 1 -- 172.21.15.32:0/1710797891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3fc0039c0 msgr2=0x7ff3fc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:08.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.601+0000 7ff41ec00640 1 --2- 172.21.15.32:0/1710797891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3fc0039c0 0x7ff3fc003de0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff4080098b0 tx=0x7ff40801c5f0 comp rx=0 tx=0).stop 2024-03-19T06:21:08.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.601+0000 7ff41cc00640 1 -- 172.21.15.32:0/1710797891 reap_dead start 2024-03-19T06:21:08.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.601+0000 7ff41ec00640 1 -- 172.21.15.32:0/1710797891 shutdown_connections 2024-03-19T06:21:08.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.601+0000 7ff41ec00640 1 -- 172.21.15.32:0/1710797891 >> 172.21.15.32:0/1710797891 conn(0x7ff4180b1590 msgr2=0x7ff4180b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:08.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.601+0000 7ff41ec00640 1 -- 172.21.15.32:0/1710797891 shutdown_connections 2024-03-19T06:21:08.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.601+0000 7ff41ec00640 1 -- 172.21.15.32:0/1710797891 wait complete. 2024-03-19T06:21:08.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff41ec00640 1 Processor -- start 2024-03-19T06:21:08.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff41ec00640 1 -- start start 2024-03-19T06:21:08.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff41ec00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3fc0039c0 0x7ff4180b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:08.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff41ec00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff418153e50 0x7ff418154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:08.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff41ec00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff418154fe0 0x7ff418155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:08.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff41ec00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4180cea20 con 0x7ff418153e50 2024-03-19T06:21:08.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff41ec00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4180ce8a0 con 0x7ff3fc0039c0 2024-03-19T06:21:08.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff41ec00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4180ceba0 con 0x7ff418154fe0 2024-03-19T06:21:08.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff417400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff418153e50 0x7ff418154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:08.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff417400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff418153e50 0x7ff418154750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47484/0 (socket says 172.21.15.32:47484) 2024-03-19T06:21:08.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff417400640 1 -- 172.21.15.32:0/2803665550 learned_addr learned my addr 172.21.15.32:0/2803665550 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:08.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff417e00640 1 --2- 172.21.15.32:0/2803665550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3fc0039c0 0x7ff4180b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff41cc00640 1 --2- 172.21.15.32:0/2803665550 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff418154fe0 0x7ff418155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff417400640 1 -- 172.21.15.32:0/2803665550 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff418154fe0 msgr2=0x7ff418155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff417400640 1 --2- 172.21.15.32:0/2803665550 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff418154fe0 0x7ff418155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff417400640 1 -- 172.21.15.32:0/2803665550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3fc0039c0 msgr2=0x7ff4180b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff417400640 1 --2- 172.21.15.32:0/2803665550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3fc0039c0 0x7ff4180b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff417400640 1 -- 172.21.15.32:0/2803665550 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4180b39a0 con 0x7ff418153e50 2024-03-19T06:21:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff417e00640 1 --2- 172.21.15.32:0/2803665550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3fc0039c0 0x7ff4180b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff417400640 1 --2- 172.21.15.32:0/2803665550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff418153e50 0x7ff418154750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff404007370 tx=0x7ff404007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff40fe00640 1 -- 172.21.15.32:0/2803665550 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40401a070 con 0x7ff418153e50 2024-03-19T06:21:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff40fe00640 1 -- 172.21.15.32:0/2803665550 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff404007e20 con 0x7ff418153e50 2024-03-19T06:21:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff40fe00640 1 -- 172.21.15.32:0/2803665550 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40400fbe0 con 0x7ff418153e50 2024-03-19T06:21:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff41ec00640 1 -- 172.21.15.32:0/2803665550 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4180b3c80 con 0x7ff418153e50 2024-03-19T06:21:08.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.605+0000 7ff41ec00640 1 -- 172.21.15.32:0/2803665550 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4180b4240 con 0x7ff418153e50 2024-03-19T06:21:08.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.609+0000 7ff41ec00640 1 -- 172.21.15.32:0/2803665550 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4180749e0 con 0x7ff418153e50 2024-03-19T06:21:08.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.609+0000 7ff40fe00640 1 -- 172.21.15.32:0/2803665550 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff40401d360 con 0x7ff418153e50 2024-03-19T06:21:08.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.609+0000 7ff40fe00640 1 --2- 172.21.15.32:0/2803665550 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff3f8067660 0x7ff3f8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:08.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.609+0000 7ff40fe00640 1 -- 172.21.15.32:0/2803665550 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7ff404085200 con 0x7ff418153e50 2024-03-19T06:21:08.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.609+0000 7ff417e00640 1 --2- 172.21.15.32:0/2803665550 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff3f8067660 0x7ff3f8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:08.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.609+0000 7ff417e00640 1 --2- 172.21.15.32:0/2803665550 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff3f8067660 0x7ff3f8069b20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff4080ad000 tx=0x7ff4080046d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:08.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.613+0000 7ff40fe00640 1 -- 172.21.15.32:0/2803665550 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7ff404055e40 con 0x7ff418153e50 2024-03-19T06:21:08.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:08.813+0000 7ff41ec00640 1 -- 172.21.15.32:0/2803665550 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff41806e6c0 con 0x7ff418153e50 2024-03-19T06:21:09.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.408+0000 7ff40fe00640 1 -- 172.21.15.32:0/2803665550 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff404055740 con 0x7ff418153e50 2024-03-19T06:21:09.399 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 2 and data pool 3 2024-03-19T06:21:09.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.412+0000 7ff41ec00640 1 -- 172.21.15.32:0/2803665550 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff3f8067660 msgr2=0x7ff3f8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:09.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.412+0000 7ff41ec00640 1 --2- 172.21.15.32:0/2803665550 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff3f8067660 0x7ff3f8069b20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff4080ad000 tx=0x7ff4080046d0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.412+0000 7ff41ec00640 1 -- 172.21.15.32:0/2803665550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff418153e50 msgr2=0x7ff418154750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:09.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.412+0000 7ff41ec00640 1 --2- 172.21.15.32:0/2803665550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff418153e50 0x7ff418154750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff404007370 tx=0x7ff404007830 comp rx=0 tx=0).stop 2024-03-19T06:21:09.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.412+0000 7ff41ec00640 1 -- 172.21.15.32:0/2803665550 shutdown_connections 2024-03-19T06:21:09.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.412+0000 7ff41ec00640 1 --2- 172.21.15.32:0/2803665550 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff3f8067660 0x7ff3f8069b20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.412+0000 7ff41ec00640 1 --2- 172.21.15.32:0/2803665550 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff418154fe0 0x7ff418155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.412+0000 7ff41ec00640 1 --2- 172.21.15.32:0/2803665550 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff418153e50 0x7ff418154750 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.412+0000 7ff41ec00640 1 --2- 172.21.15.32:0/2803665550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3fc0039c0 0x7ff4180b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.412+0000 7ff41ec00640 1 -- 172.21.15.32:0/2803665550 >> 172.21.15.32:0/2803665550 conn(0x7ff4180b1590 msgr2=0x7ff41806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:09.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.412+0000 7ff41ec00640 1 -- 172.21.15.32:0/2803665550 shutdown_connections 2024-03-19T06:21:09.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.416+0000 7ff41ec00640 1 -- 172.21.15.32:0/2803665550 wait complete. 2024-03-19T06:21:09.457 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:09.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.608+0000 7f8689a00640 1 Processor -- start 2024-03-19T06:21:09.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.608+0000 7f8689a00640 1 -- start start 2024-03-19T06:21:09.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.608+0000 7f8689a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8684099a70 0x7f8684099e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:09.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.608+0000 7f8689a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f868406c060 0x7f868415e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:09.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.608+0000 7f8689a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868406fbe0 con 0x7f8684161860 2024-03-19T06:21:09.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.608+0000 7f8689a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868409a390 con 0x7f868406c060 2024-03-19T06:21:09.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.608+0000 7f8689a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868415e940 con 0x7f8684099a70 2024-03-19T06:21:09.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.608+0000 7f867be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f868406c060 0x7f868415e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:09.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.608+0000 7f867be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f868406c060 0x7f868415e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47490/0 (socket says 172.21.15.32:47490) 2024-03-19T06:21:09.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.608+0000 7f867be00640 1 -- 172.21.15.32:0/1919256248 learned_addr learned my addr 172.21.15.32:0/1919256248 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:09.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.608+0000 7f8682a00640 1 --2- 172.21.15.32:0/1919256248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8684099a70 0x7f8684099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:09.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.608+0000 7f867be00640 1 -- 172.21.15.32:0/1919256248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8684099a70 msgr2=0x7f8684099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:09.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.608+0000 7f867be00640 1 --2- 172.21.15.32:0/1919256248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8684099a70 0x7f8684099e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.608+0000 7f867be00640 1 -- 172.21.15.32:0/1919256248 >> v1:172.21.15.32:6789/0 conn(0x7f8684161860 legacy=0x7f8684161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:09.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.608+0000 7f867be00640 1 -- 172.21.15.32:0/1919256248 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868415ec20 con 0x7f868406c060 2024-03-19T06:21:09.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.608+0000 7f8682000640 1 -- 172.21.15.32:0/1919256248 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528683180 0 0) 0x7f867c0014a0 con 0x7f8684161860 2024-03-19T06:21:09.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.612+0000 7f867be00640 1 --2- 172.21.15.32:0/1919256248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f868406c060 0x7f868415e010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f866c009870 tx=0x7f866c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f7d1363fb47623 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:09.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.612+0000 7f8682000640 1 -- 172.21.15.32:0/1919256248 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c0ab650 con 0x7f868406c060 2024-03-19T06:21:09.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.612+0000 7f8682000640 1 -- 172.21.15.32:0/1919256248 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c0b0070 con 0x7f868406c060 2024-03-19T06:21:09.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.612+0000 7f8682000640 1 -- 172.21.15.32:0/1919256248 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c0aba10 con 0x7f868406c060 2024-03-19T06:21:09.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.612+0000 7f8689a00640 1 -- 172.21.15.32:0/1919256248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f868406c060 msgr2=0x7f868415e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:09.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.612+0000 7f8689a00640 1 --2- 172.21.15.32:0/1919256248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f868406c060 0x7f868415e010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f866c009870 tx=0x7f866c01c560 comp rx=0 tx=0).stop 2024-03-19T06:21:09.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.612+0000 7f8689a00640 1 -- 172.21.15.32:0/1919256248 shutdown_connections 2024-03-19T06:21:09.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.612+0000 7f8689a00640 1 --2- 172.21.15.32:0/1919256248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f868406c060 0x7f868415e010 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.612+0000 7f8689a00640 1 --2- 172.21.15.32:0/1919256248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8684099a70 0x7f8684099e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.612+0000 7f8689a00640 1 -- 172.21.15.32:0/1919256248 >> 172.21.15.32:0/1919256248 conn(0x7f86840b3300 msgr2=0x7f86840b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:09.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.612+0000 7f8689a00640 1 -- 172.21.15.32:0/1919256248 shutdown_connections 2024-03-19T06:21:09.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.612+0000 7f8689a00640 1 -- 172.21.15.32:0/1919256248 wait complete. 2024-03-19T06:21:09.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8689a00640 1 Processor -- start 2024-03-19T06:21:09.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8689a00640 1 -- start start 2024-03-19T06:21:09.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8689a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f868406c060 0x7f86840cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:09.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8689a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8684099a70 0x7f86840b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:09.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8689a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8684161860 0x7f86840b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:09.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8689a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868415e6d0 con 0x7f8684161860 2024-03-19T06:21:09.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8689a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868415e550 con 0x7f8684099a70 2024-03-19T06:21:09.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8689a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868416b410 con 0x7f868406c060 2024-03-19T06:21:09.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8683400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8684161860 0x7f86840b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:09.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8682a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f868406c060 0x7f86840cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:09.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8683400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8684161860 0x7f86840b6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47504/0 (socket says 172.21.15.32:47504) 2024-03-19T06:21:09.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8683400640 1 -- 172.21.15.32:0/287032570 learned_addr learned my addr 172.21.15.32:0/287032570 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:09.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f867be00640 1 --2- 172.21.15.32:0/287032570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8684099a70 0x7f86840b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:09.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8683400640 1 -- 172.21.15.32:0/287032570 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f868406c060 msgr2=0x7f86840cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:09.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8683400640 1 --2- 172.21.15.32:0/287032570 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f868406c060 0x7f86840cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8683400640 1 -- 172.21.15.32:0/287032570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8684099a70 msgr2=0x7f86840b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:09.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8683400640 1 --2- 172.21.15.32:0/287032570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8684099a70 0x7f86840b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8683400640 1 -- 172.21.15.32:0/287032570 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86840cdfb0 con 0x7f8684161860 2024-03-19T06:21:09.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8683400640 1 --2- 172.21.15.32:0/287032570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8684161860 0x7f86840b6530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f867c00c780 tx=0x7f867c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:09.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f867aa00640 1 -- 172.21.15.32:0/287032570 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c003db0 con 0x7f8684161860 2024-03-19T06:21:09.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f867aa00640 1 -- 172.21.15.32:0/287032570 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c005070 con 0x7f8684161860 2024-03-19T06:21:09.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8689a00640 1 -- 172.21.15.32:0/287032570 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8684159250 con 0x7f8684161860 2024-03-19T06:21:09.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f867aa00640 1 -- 172.21.15.32:0/287032570 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0054a0 con 0x7f8684161860 2024-03-19T06:21:09.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8689a00640 1 -- 172.21.15.32:0/287032570 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8684159810 con 0x7f8684161860 2024-03-19T06:21:09.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.616+0000 7f8689a00640 1 -- 172.21.15.32:0/287032570 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86840749e0 con 0x7f8684161860 2024-03-19T06:21:09.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.620+0000 7f867aa00640 1 -- 172.21.15.32:0/287032570 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f867c005640 con 0x7f8684161860 2024-03-19T06:21:09.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.620+0000 7f867aa00640 1 --2- 172.21.15.32:0/287032570 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8660067660 0x7f8660069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:09.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.620+0000 7f867aa00640 1 -- 172.21.15.32:0/287032570 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f867c085760 con 0x7f8684161860 2024-03-19T06:21:09.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.620+0000 7f8682a00640 1 --2- 172.21.15.32:0/287032570 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8660067660 0x7f8660069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:09.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.620+0000 7f8682a00640 1 --2- 172.21.15.32:0/287032570 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8660067660 0x7f8660069b20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f86740079c0 tx=0x7f8674008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:09.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.624+0000 7f867aa00640 1 -- 172.21.15.32:0/287032570 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f86840cdfb0 con 0x7f8684161860 2024-03-19T06:21:09.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.788+0000 7f8689a00640 1 -- 172.21.15.32:0/287032570 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86840cfdf0 con 0x7f8684161860 2024-03-19T06:21:09.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.792+0000 7f867aa00640 1 -- 172.21.15.32:0/287032570 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16630 (secure 0 0 0) 0x7f868406fbe0 con 0x7f8684161860 2024-03-19T06:21:09.783 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:09.783 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:08.817223+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:09.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.792+0000 7f8689a00640 1 -- 172.21.15.32:0/287032570 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8660067660 msgr2=0x7f8660069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:09.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.792+0000 7f8689a00640 1 --2- 172.21.15.32:0/287032570 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8660067660 0x7f8660069b20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f86740079c0 tx=0x7f8674008040 comp rx=0 tx=0).stop 2024-03-19T06:21:09.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.792+0000 7f8689a00640 1 -- 172.21.15.32:0/287032570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8684161860 msgr2=0x7f86840b6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:09.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.792+0000 7f8689a00640 1 --2- 172.21.15.32:0/287032570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8684161860 0x7f86840b6530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f867c00c780 tx=0x7f867c00cc40 comp rx=0 tx=0).stop 2024-03-19T06:21:09.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.792+0000 7f8689a00640 1 -- 172.21.15.32:0/287032570 shutdown_connections 2024-03-19T06:21:09.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.792+0000 7f8689a00640 1 --2- 172.21.15.32:0/287032570 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8660067660 0x7f8660069b20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.792+0000 7f8689a00640 1 --2- 172.21.15.32:0/287032570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8684161860 0x7f86840b6530 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.792+0000 7f8689a00640 1 --2- 172.21.15.32:0/287032570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8684099a70 0x7f86840b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.792+0000 7f8689a00640 1 --2- 172.21.15.32:0/287032570 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f868406c060 0x7f86840cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.792+0000 7f8689a00640 1 -- 172.21.15.32:0/287032570 >> 172.21.15.32:0/287032570 conn(0x7f86840b3300 msgr2=0x7f86840d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:09.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.792+0000 7f8689a00640 1 -- 172.21.15.32:0/287032570 shutdown_connections 2024-03-19T06:21:09.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.792+0000 7f8689a00640 1 -- 172.21.15.32:0/287032570 wait complete. 2024-03-19T06:21:09.805 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:09.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.952+0000 7ff439e00640 1 Processor -- start 2024-03-19T06:21:09.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.952+0000 7ff439e00640 1 -- start start 2024-03-19T06:21:09.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.952+0000 7ff439e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff4340ae0b0 0x7ff4340acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:09.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.952+0000 7ff439e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43415dff0 0x7ff43406bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:09.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.952+0000 7ff439e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43415e520 con 0x7ff43406c290 2024-03-19T06:21:09.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.956+0000 7ff439e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff43415f1b0 con 0x7ff4340ae0b0 2024-03-19T06:21:09.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.956+0000 7ff439e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43415e800 con 0x7ff43415dff0 2024-03-19T06:21:09.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.956+0000 7ff42a000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43415dff0 0x7ff43406bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:09.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.956+0000 7ff433400640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7ff43406c290 0x7ff434154130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:42552/0 (socket says 172.21.15.32:42552) 2024-03-19T06:21:09.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.956+0000 7ff42a000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43415dff0 0x7ff43406bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:38472/0 (socket says 172.21.15.32:38472) 2024-03-19T06:21:09.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.956+0000 7ff432a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff4340ae0b0 0x7ff4340acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:09.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.956+0000 7ff433400640 1 -- 172.21.15.32:0/2991390747 learned_addr learned my addr 172.21.15.32:0/2991390747 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:09.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.956+0000 7ff42a000640 1 -- 172.21.15.32:0/2991390747 >> v2:172.21.15.171:3300/0 conn(0x7ff4340ae0b0 msgr2=0x7ff4340acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:09.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.956+0000 7ff42a000640 1 --2- 172.21.15.32:0/2991390747 >> v2:172.21.15.171:3300/0 conn(0x7ff4340ae0b0 0x7ff4340acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.956+0000 7ff42a000640 1 -- 172.21.15.32:0/2991390747 >> v1:172.21.15.171:6789/0 conn(0x7ff43406c290 legacy=0x7ff434154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:09.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.956+0000 7ff42a000640 1 -- 172.21.15.32:0/2991390747 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43415eae0 con 0x7ff43415dff0 2024-03-19T06:21:09.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.956+0000 7ff42a000640 1 --2- 172.21.15.32:0/2991390747 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43415dff0 0x7ff43406bd50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0097c0 tx=0x7ff41c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6f1df2a071fb893 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:09.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff432000640 1 -- 172.21.15.32:0/2991390747 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c0b0070 con 0x7ff43415dff0 2024-03-19T06:21:09.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff432000640 1 -- 172.21.15.32:0/2991390747 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c0ab600 con 0x7ff43415dff0 2024-03-19T06:21:09.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff432000640 1 -- 172.21.15.32:0/2991390747 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c0ab9d0 con 0x7ff43415dff0 2024-03-19T06:21:09.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff439e00640 1 -- 172.21.15.32:0/2991390747 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43415dff0 msgr2=0x7ff43406bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:09.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff439e00640 1 --2- 172.21.15.32:0/2991390747 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43415dff0 0x7ff43406bd50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0097c0 tx=0x7ff41c01c3e0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff439e00640 1 -- 172.21.15.32:0/2991390747 shutdown_connections 2024-03-19T06:21:09.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff439e00640 1 --2- 172.21.15.32:0/2991390747 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43415dff0 0x7ff43406bd50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff439e00640 1 --2- 172.21.15.32:0/2991390747 >> v2:172.21.15.171:3300/0 conn(0x7ff4340ae0b0 0x7ff4340acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff439e00640 1 -- 172.21.15.32:0/2991390747 >> 172.21.15.32:0/2991390747 conn(0x7ff434071c50 msgr2=0x7ff434072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:09.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff439e00640 1 -- 172.21.15.32:0/2991390747 shutdown_connections 2024-03-19T06:21:09.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff439e00640 1 -- 172.21.15.32:0/2991390747 wait complete. 2024-03-19T06:21:09.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff439e00640 1 Processor -- start 2024-03-19T06:21:09.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff439e00640 1 -- start start 2024-03-19T06:21:09.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff439e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43406c290 0x7ff434150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:09.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff439e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4340ae0b0 0x7ff434162710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:09.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff439e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff43415dff0 0x7ff434163f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:09.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff439e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43415f640 con 0x7ff43415dff0 2024-03-19T06:21:09.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff439e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43406c6a0 con 0x7ff4340ae0b0 2024-03-19T06:21:09.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff439e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43415f7c0 con 0x7ff43406c290 2024-03-19T06:21:09.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff433400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff43415dff0 0x7ff434163f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:09.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff433400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff43415dff0 0x7ff434163f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47510/0 (socket says 172.21.15.32:47510) 2024-03-19T06:21:09.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff433400640 1 -- 172.21.15.32:0/2000080719 learned_addr learned my addr 172.21.15.32:0/2000080719 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:09.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff432a00640 1 --2- 172.21.15.32:0/2000080719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43406c290 0x7ff434150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:09.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.960+0000 7ff42a000640 1 --2- 172.21.15.32:0/2000080719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4340ae0b0 0x7ff434162710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:09.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.964+0000 7ff433400640 1 -- 172.21.15.32:0/2000080719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43406c290 msgr2=0x7ff434150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:09.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.964+0000 7ff433400640 1 --2- 172.21.15.32:0/2000080719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43406c290 0x7ff434150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.964+0000 7ff433400640 1 -- 172.21.15.32:0/2000080719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4340ae0b0 msgr2=0x7ff434162710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:09.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.964+0000 7ff433400640 1 --2- 172.21.15.32:0/2000080719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4340ae0b0 0x7ff434162710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:09.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.964+0000 7ff433400640 1 -- 172.21.15.32:0/2000080719 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff434164460 con 0x7ff43415dff0 2024-03-19T06:21:09.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.964+0000 7ff433400640 1 --2- 172.21.15.32:0/2000080719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff43415dff0 0x7ff434163f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00c400 tx=0x7ff42c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:09.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.964+0000 7ff42be00640 1 -- 172.21.15.32:0/2000080719 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c017070 con 0x7ff43415dff0 2024-03-19T06:21:09.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.964+0000 7ff42be00640 1 -- 172.21.15.32:0/2000080719 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c005cf0 con 0x7ff43415dff0 2024-03-19T06:21:09.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.964+0000 7ff42be00640 1 -- 172.21.15.32:0/2000080719 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c0072d0 con 0x7ff43415dff0 2024-03-19T06:21:09.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.964+0000 7ff439e00640 1 -- 172.21.15.32:0/2000080719 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff434162e80 con 0x7ff43415dff0 2024-03-19T06:21:09.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.964+0000 7ff439e00640 1 -- 172.21.15.32:0/2000080719 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff434163440 con 0x7ff43415dff0 2024-03-19T06:21:09.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.964+0000 7ff439e00640 1 -- 172.21.15.32:0/2000080719 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4340749e0 con 0x7ff43415dff0 2024-03-19T06:21:09.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.964+0000 7ff42be00640 1 -- 172.21.15.32:0/2000080719 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff42c01a070 con 0x7ff43415dff0 2024-03-19T06:21:09.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.964+0000 7ff42be00640 1 --2- 172.21.15.32:0/2000080719 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff410067660 0x7ff410069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:09.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.964+0000 7ff42be00640 1 -- 172.21.15.32:0/2000080719 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff42c084b90 con 0x7ff43415dff0 2024-03-19T06:21:09.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.968+0000 7ff432a00640 1 --2- 172.21.15.32:0/2000080719 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff410067660 0x7ff410069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:09.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.968+0000 7ff432a00640 1 --2- 172.21.15.32:0/2000080719 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff410067660 0x7ff410069b20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff4240113e0 tx=0x7ff42400b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:09.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:09.968+0000 7ff42be00640 1 -- 172.21.15.32:0/2000080719 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7ff42c0551b0 con 0x7ff43415dff0 2024-03-19T06:21:10.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.136+0000 7ff439e00640 1 -- 172.21.15.32:0/2000080719 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4340728b0 con 0x7ff43415dff0 2024-03-19T06:21:10.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.136+0000 7ff42be00640 1 -- 172.21.15.32:0/2000080719 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16630 (secure 0 0 0) 0x7ff42c059250 con 0x7ff43415dff0 2024-03-19T06:21:10.130 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:10.131 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:08.817223+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:10.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.140+0000 7ff439e00640 1 -- 172.21.15.32:0/2000080719 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff410067660 msgr2=0x7ff410069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:10.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.140+0000 7ff439e00640 1 --2- 172.21.15.32:0/2000080719 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff410067660 0x7ff410069b20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff4240113e0 tx=0x7ff42400b040 comp rx=0 tx=0).stop 2024-03-19T06:21:10.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.140+0000 7ff439e00640 1 -- 172.21.15.32:0/2000080719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff43415dff0 msgr2=0x7ff434163f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:10.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.140+0000 7ff439e00640 1 --2- 172.21.15.32:0/2000080719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff43415dff0 0x7ff434163f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00c400 tx=0x7ff42c00c8c0 comp rx=0 tx=0).stop 2024-03-19T06:21:10.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.140+0000 7ff439e00640 1 -- 172.21.15.32:0/2000080719 shutdown_connections 2024-03-19T06:21:10.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.140+0000 7ff439e00640 1 --2- 172.21.15.32:0/2000080719 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff410067660 0x7ff410069b20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:10.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.140+0000 7ff439e00640 1 --2- 172.21.15.32:0/2000080719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff43415dff0 0x7ff434163f20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:10.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.140+0000 7ff439e00640 1 --2- 172.21.15.32:0/2000080719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4340ae0b0 0x7ff434162710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:10.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.140+0000 7ff439e00640 1 --2- 172.21.15.32:0/2000080719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43406c290 0x7ff434150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:10.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.140+0000 7ff439e00640 1 -- 172.21.15.32:0/2000080719 >> 172.21.15.32:0/2000080719 conn(0x7ff434071c50 msgr2=0x7ff4340b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:10.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.140+0000 7ff439e00640 1 -- 172.21.15.32:0/2000080719 shutdown_connections 2024-03-19T06:21:10.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.140+0000 7ff439e00640 1 -- 172.21.15.32:0/2000080719 wait complete. 2024-03-19T06:21:10.152 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-19T06:21:10.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.304+0000 7f1438e00640 1 Processor -- start 2024-03-19T06:21:10.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.304+0000 7f1438e00640 1 -- start start 2024-03-19T06:21:10.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.304+0000 7f1438e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f143406ad40 0x7f143406b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:10.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.304+0000 7f1438e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f143406eed0 0x7f14340ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:10.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.304+0000 7f1438e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143406b660 con 0x7f143406e320 2024-03-19T06:21:10.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.304+0000 7f1438e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143406dbb0 con 0x7f143406ad40 2024-03-19T06:21:10.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.304+0000 7f1438e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14340cc290 con 0x7f143406eed0 2024-03-19T06:21:10.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.304+0000 7f1431e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f143406ad40 0x7f143406b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:10.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.304+0000 7f1431e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f143406ad40 0x7f143406b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47518/0 (socket says 172.21.15.32:47518) 2024-03-19T06:21:10.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.304+0000 7f1431e00640 1 -- 172.21.15.32:0/2254352002 learned_addr learned my addr 172.21.15.32:0/2254352002 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:10.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.304+0000 7f1432800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f143406e320 0x7f143415bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36318/0 (socket says 172.21.15.32:36318) 2024-03-19T06:21:10.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.304+0000 7f142be00640 1 --2- 172.21.15.32:0/2254352002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f143406eed0 0x7f14340ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:10.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.304+0000 7f1431e00640 1 -- 172.21.15.32:0/2254352002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f143406eed0 msgr2=0x7f14340ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:10.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.304+0000 7f1431e00640 1 --2- 172.21.15.32:0/2254352002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f143406eed0 0x7f14340ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:10.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.304+0000 7f1431e00640 1 -- 172.21.15.32:0/2254352002 >> v1:172.21.15.32:6789/0 conn(0x7f143406e320 legacy=0x7f143415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:10.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.304+0000 7f1431e00640 1 -- 172.21.15.32:0/2254352002 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14340cc570 con 0x7f143406ad40 2024-03-19T06:21:10.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.308+0000 7f1431e00640 1 --2- 172.21.15.32:0/2254352002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f143406ad40 0x7f143406b120 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1424009870 tx=0x7f142401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992dbde8af698905 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:10.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.308+0000 7f1431400640 1 -- 172.21.15.32:0/2254352002 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14240aa600 con 0x7f143406ad40 2024-03-19T06:21:10.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.308+0000 7f1431400640 1 -- 172.21.15.32:0/2254352002 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14240af070 con 0x7f143406ad40 2024-03-19T06:21:10.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.308+0000 7f1431400640 1 -- 172.21.15.32:0/2254352002 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14240aa9c0 con 0x7f143406ad40 2024-03-19T06:21:10.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.308+0000 7f1438e00640 1 -- 172.21.15.32:0/2254352002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f143406ad40 msgr2=0x7f143406b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:10.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.308+0000 7f1438e00640 1 --2- 172.21.15.32:0/2254352002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f143406ad40 0x7f143406b120 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1424009870 tx=0x7f142401c4a0 comp rx=0 tx=0).stop 2024-03-19T06:21:10.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.308+0000 7f1438e00640 1 -- 172.21.15.32:0/2254352002 shutdown_connections 2024-03-19T06:21:10.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.308+0000 7f1438e00640 1 --2- 172.21.15.32:0/2254352002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f143406eed0 0x7f14340ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:10.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.308+0000 7f1438e00640 1 --2- 172.21.15.32:0/2254352002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f143406ad40 0x7f143406b120 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:10.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.308+0000 7f1438e00640 1 -- 172.21.15.32:0/2254352002 >> 172.21.15.32:0/2254352002 conn(0x7f14340b1590 msgr2=0x7f14340b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:10.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.308+0000 7f1438e00640 1 -- 172.21.15.32:0/2254352002 shutdown_connections 2024-03-19T06:21:10.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.308+0000 7f1438e00640 1 -- 172.21.15.32:0/2254352002 wait complete. 2024-03-19T06:21:10.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.308+0000 7f1438e00640 1 Processor -- start 2024-03-19T06:21:10.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.308+0000 7f1438e00640 1 -- start start 2024-03-19T06:21:10.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1438e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f143406ad40 0x7f14340ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:10.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1438e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f143406e320 0x7f143413dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:10.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1438e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f143406eed0 0x7f14341521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:10.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1438e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143415c8f0 con 0x7f143406ad40 2024-03-19T06:21:10.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1438e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143415c770 con 0x7f143406e320 2024-03-19T06:21:10.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1438e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1434168d20 con 0x7f143406eed0 2024-03-19T06:21:10.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1431e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f143406ad40 0x7f14340ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:10.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1431e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f143406ad40 0x7f14340ae270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47526/0 (socket says 172.21.15.32:47526) 2024-03-19T06:21:10.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1431e00640 1 -- 172.21.15.32:0/1139803404 learned_addr learned my addr 172.21.15.32:0/1139803404 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:10.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f142be00640 1 --2- 172.21.15.32:0/1139803404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f143406e320 0x7f143413dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:10.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1432800640 1 --2- 172.21.15.32:0/1139803404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f143406eed0 0x7f14341521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:10.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1431e00640 1 -- 172.21.15.32:0/1139803404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f143406eed0 msgr2=0x7f14341521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:10.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1431e00640 1 --2- 172.21.15.32:0/1139803404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f143406eed0 0x7f14341521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:10.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1431e00640 1 -- 172.21.15.32:0/1139803404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f143406e320 msgr2=0x7f143413dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:10.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1431e00640 1 --2- 172.21.15.32:0/1139803404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f143406e320 0x7f143413dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:10.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1431e00640 1 -- 172.21.15.32:0/1139803404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143413eab0 con 0x7f143406ad40 2024-03-19T06:21:10.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1431e00640 1 --2- 172.21.15.32:0/1139803404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f143406ad40 0x7f14340ae270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f142401a0d0 tx=0x7f142401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:10.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f142a000640 1 -- 172.21.15.32:0/1139803404 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14240bd5f0 con 0x7f143406ad40 2024-03-19T06:21:10.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f142a000640 1 -- 172.21.15.32:0/1139803404 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14240bd7b0 con 0x7f143406ad40 2024-03-19T06:21:10.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f142a000640 1 -- 172.21.15.32:0/1139803404 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14240bdba0 con 0x7f143406ad40 2024-03-19T06:21:10.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1438e00640 1 -- 172.21.15.32:0/1139803404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143413ed90 con 0x7f143406ad40 2024-03-19T06:21:10.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1438e00640 1 -- 172.21.15.32:0/1139803404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143414f800 con 0x7f143406ad40 2024-03-19T06:21:10.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f1438e00640 1 -- 172.21.15.32:0/1139803404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14340749e0 con 0x7f143406ad40 2024-03-19T06:21:10.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.312+0000 7f142a000640 1 -- 172.21.15.32:0/1139803404 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f14240a9070 con 0x7f143406ad40 2024-03-19T06:21:10.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.316+0000 7f142a000640 1 --2- 172.21.15.32:0/1139803404 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f14100676b0 0x7f1410069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:10.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.316+0000 7f142a000640 1 -- 172.21.15.32:0/1139803404 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1424120080 con 0x7f143406ad40 2024-03-19T06:21:10.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.316+0000 7f142be00640 1 --2- 172.21.15.32:0/1139803404 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f14100676b0 0x7f1410069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:10.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.316+0000 7f142be00640 1 --2- 172.21.15.32:0/1139803404 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f14100676b0 0x7f1410069b70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f143414fa90 tx=0x7f141c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:10.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.320+0000 7f142a000640 1 -- 172.21.15.32:0/1139803404 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f1424016150 con 0x7f143406ad40 2024-03-19T06:21:10.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:10.516+0000 7f1438e00640 1 -- 172.21.15.32:0/1139803404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f14340b1cf0 con 0x7f143406ad40 2024-03-19T06:21:11.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.436+0000 7f142a000640 1 -- 172.21.15.32:0/1139803404 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f14240f0d70 con 0x7f143406ad40 2024-03-19T06:21:11.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.436+0000 7f1438e00640 1 -- 172.21.15.32:0/1139803404 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f14100676b0 msgr2=0x7f1410069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:11.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.436+0000 7f1438e00640 1 --2- 172.21.15.32:0/1139803404 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f14100676b0 0x7f1410069b70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f143414fa90 tx=0x7f141c008040 comp rx=0 tx=0).stop 2024-03-19T06:21:11.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.436+0000 7f1438e00640 1 -- 172.21.15.32:0/1139803404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f143406ad40 msgr2=0x7f14340ae270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:11.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.436+0000 7f1438e00640 1 --2- 172.21.15.32:0/1139803404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f143406ad40 0x7f14340ae270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f142401a0d0 tx=0x7f142401ace0 comp rx=0 tx=0).stop 2024-03-19T06:21:11.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.436+0000 7f1438e00640 1 -- 172.21.15.32:0/1139803404 shutdown_connections 2024-03-19T06:21:11.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.436+0000 7f1438e00640 1 --2- 172.21.15.32:0/1139803404 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f14100676b0 0x7f1410069b70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:11.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.436+0000 7f1438e00640 1 --2- 172.21.15.32:0/1139803404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f143406eed0 0x7f14341521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:11.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.436+0000 7f1438e00640 1 --2- 172.21.15.32:0/1139803404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f143406e320 0x7f143413dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:11.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.436+0000 7f1438e00640 1 --2- 172.21.15.32:0/1139803404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f143406ad40 0x7f14340ae270 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:11.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.436+0000 7f1438e00640 1 -- 172.21.15.32:0/1139803404 >> 172.21.15.32:0/1139803404 conn(0x7f14340b1590 msgr2=0x7f14340af160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:11.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.440+0000 7f1438e00640 1 -- 172.21.15.32:0/1139803404 shutdown_connections 2024-03-19T06:21:11.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.440+0000 7f1438e00640 1 -- 172.21.15.32:0/1139803404 wait complete. 2024-03-19T06:21:11.452 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-19T06:21:11.453 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-19T06:21:11.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a13800640 1 Processor -- start 2024-03-19T06:21:11.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a13800640 1 -- start start 2024-03-19T06:21:11.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a13800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a0c15a840 0x7f8a0c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:11.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a13800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8a0c0aea70 0x7f8a0c06ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:11.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a13800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8a0c06b280 0x7f8a0c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:11.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a13800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c0cdc20 con 0x7f8a0c0aea70 2024-03-19T06:21:11.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a13800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c0af2d0 con 0x7f8a0c06b280 2024-03-19T06:21:11.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a13800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c15eea0 con 0x7f8a0c15a840 2024-03-19T06:21:11.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a03e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8a0c0aea70 0x7f8a0c06ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:11.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a03e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8a0c0aea70 0x7f8a0c06ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47528/0 (socket says 172.21.15.32:47528) 2024-03-19T06:21:11.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a03e00640 1 -- 172.21.15.32:0/3983507612 learned_addr learned my addr 172.21.15.32:0/3983507612 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:11.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a11800640 1 --2- 172.21.15.32:0/3983507612 >> v2:172.21.15.171:3300/0 conn(0x7f8a0c06b280 0x7f8a0c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:11.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a10e00640 1 --2- 172.21.15.32:0/3983507612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a0c15a840 0x7f8a0c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:11.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a03e00640 1 -- 172.21.15.32:0/3983507612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a0c15a840 msgr2=0x7f8a0c06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:11.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a03e00640 1 --2- 172.21.15.32:0/3983507612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a0c15a840 0x7f8a0c06f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:11.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a03e00640 1 -- 172.21.15.32:0/3983507612 >> v2:172.21.15.171:3300/0 conn(0x7f8a0c06b280 msgr2=0x7f8a0c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:11.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a03e00640 1 --2- 172.21.15.32:0/3983507612 >> v2:172.21.15.171:3300/0 conn(0x7f8a0c06b280 0x7f8a0c06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:11.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a03e00640 1 -- 172.21.15.32:0/3983507612 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c15f180 con 0x7f8a0c0aea70 2024-03-19T06:21:11.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.608+0000 7f8a10e00640 1 --2- 172.21.15.32:0/3983507612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a0c15a840 0x7f8a0c06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:11.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.612+0000 7f8a03e00640 1 --2- 172.21.15.32:0/3983507612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a0c0aea70 0x7f8a0c06ad40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c06bcb0 tx=0x7f89fc01c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc354f56ef05e684 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:11.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.612+0000 7f8a0be00640 1 -- 172.21.15.32:0/3983507612 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0b0070 con 0x7f8a0c0aea70 2024-03-19T06:21:11.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.612+0000 7f8a0be00640 1 -- 172.21.15.32:0/3983507612 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc0ab600 con 0x7f8a0c0aea70 2024-03-19T06:21:11.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.612+0000 7f8a0be00640 1 -- 172.21.15.32:0/3983507612 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0ab9d0 con 0x7f8a0c0aea70 2024-03-19T06:21:11.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.612+0000 7f8a13800640 1 -- 172.21.15.32:0/3983507612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a0c0aea70 msgr2=0x7f8a0c06ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:11.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.612+0000 7f8a13800640 1 --2- 172.21.15.32:0/3983507612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a0c0aea70 0x7f8a0c06ad40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c06bcb0 tx=0x7f89fc01c140 comp rx=0 tx=0).stop 2024-03-19T06:21:11.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.612+0000 7f8a13800640 1 -- 172.21.15.32:0/3983507612 shutdown_connections 2024-03-19T06:21:11.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.612+0000 7f8a13800640 1 --2- 172.21.15.32:0/3983507612 >> v2:172.21.15.171:3300/0 conn(0x7f8a0c06b280 0x7f8a0c06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:11.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.612+0000 7f8a13800640 1 --2- 172.21.15.32:0/3983507612 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a0c0aea70 0x7f8a0c06ad40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:11.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.612+0000 7f8a13800640 1 --2- 172.21.15.32:0/3983507612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a0c15a840 0x7f8a0c06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:11.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.612+0000 7f8a13800640 1 -- 172.21.15.32:0/3983507612 >> 172.21.15.32:0/3983507612 conn(0x7f8a0c0b1590 msgr2=0x7f8a0c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:11.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.612+0000 7f8a13800640 1 -- 172.21.15.32:0/3983507612 shutdown_connections 2024-03-19T06:21:11.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.612+0000 7f8a13800640 1 -- 172.21.15.32:0/3983507612 wait complete. 2024-03-19T06:21:11.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a13800640 1 Processor -- start 2024-03-19T06:21:11.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a13800640 1 -- start start 2024-03-19T06:21:11.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a13800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a0c06b280 0x7f8a0c13f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:11.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a13800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a0c0aea70 0x7f8a0c15b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:11.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a13800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a0c15a840 0x7f8a0c15be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:11.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a13800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0716d0 con 0x7f8a0c06b280 2024-03-19T06:21:11.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a13800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c071550 con 0x7f8a0c0aea70 2024-03-19T06:21:11.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a13800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c071850 con 0x7f8a0c15a840 2024-03-19T06:21:11.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a10e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a0c06b280 0x7f8a0c13f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:11.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a10e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a0c06b280 0x7f8a0c13f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47538/0 (socket says 172.21.15.32:47538) 2024-03-19T06:21:11.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a10e00640 1 -- 172.21.15.32:0/3359445137 learned_addr learned my addr 172.21.15.32:0/3359445137 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:11.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a03e00640 1 --2- 172.21.15.32:0/3359445137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a0c0aea70 0x7f8a0c15b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:11.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a11800640 1 --2- 172.21.15.32:0/3359445137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a0c15a840 0x7f8a0c15be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:11.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a10e00640 1 -- 172.21.15.32:0/3359445137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a0c15a840 msgr2=0x7f8a0c15be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:11.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a10e00640 1 --2- 172.21.15.32:0/3359445137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a0c15a840 0x7f8a0c15be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:11.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a10e00640 1 -- 172.21.15.32:0/3359445137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a0c0aea70 msgr2=0x7f8a0c15b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:11.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a10e00640 1 --2- 172.21.15.32:0/3359445137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a0c0aea70 0x7f8a0c15b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:11.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a10e00640 1 -- 172.21.15.32:0/3359445137 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c153ee0 con 0x7f8a0c06b280 2024-03-19T06:21:11.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a10e00640 1 --2- 172.21.15.32:0/3359445137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a0c06b280 0x7f8a0c13f300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f89f400d830 tx=0x7f89f400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:11.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a09600640 1 -- 172.21.15.32:0/3359445137 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f4018020 con 0x7f8a0c06b280 2024-03-19T06:21:11.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a09600640 1 -- 172.21.15.32:0/3359445137 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f40096c0 con 0x7f8a0c06b280 2024-03-19T06:21:11.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a09600640 1 -- 172.21.15.32:0/3359445137 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f4009ab0 con 0x7f8a0c06b280 2024-03-19T06:21:11.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a13800640 1 -- 172.21.15.32:0/3359445137 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c15e6c0 con 0x7f8a0c06b280 2024-03-19T06:21:11.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a13800640 1 -- 172.21.15.32:0/3359445137 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c14d880 con 0x7f8a0c06b280 2024-03-19T06:21:11.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.616+0000 7f8a13800640 1 -- 172.21.15.32:0/3359445137 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0c0749e0 con 0x7f8a0c06b280 2024-03-19T06:21:11.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.620+0000 7f8a09600640 1 -- 172.21.15.32:0/3359445137 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f89f401b020 con 0x7f8a0c06b280 2024-03-19T06:21:11.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.620+0000 7f8a09600640 1 --2- 172.21.15.32:0/3359445137 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f89e8067660 0x7f89e8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:11.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.620+0000 7f8a09600640 1 -- 172.21.15.32:0/3359445137 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89f4085f10 con 0x7f8a0c06b280 2024-03-19T06:21:11.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.620+0000 7f8a03e00640 1 --2- 172.21.15.32:0/3359445137 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f89e8067660 0x7f89e8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:11.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.620+0000 7f8a03e00640 1 --2- 172.21.15.32:0/3359445137 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f89e8067660 0x7f89e8069b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f89fc0ad000 tx=0x7f89fc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:11.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.624+0000 7f8a09600640 1 -- 172.21.15.32:0/3359445137 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f89f4022020 con 0x7f8a0c06b280 2024-03-19T06:21:11.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:11.824+0000 7f8a13800640 1 -- 172.21.15.32:0/3359445137 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8a0c0b3c60 con 0x7f8a0c06b280 2024-03-19T06:21:12.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.440+0000 7f8a09600640 1 -- 172.21.15.32:0/3359445137 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f89f4056530 con 0x7f8a0c06b280 2024-03-19T06:21:12.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.444+0000 7f8a13800640 1 -- 172.21.15.32:0/3359445137 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f89e8067660 msgr2=0x7f89e8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:12.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.444+0000 7f8a13800640 1 --2- 172.21.15.32:0/3359445137 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f89e8067660 0x7f89e8069b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f89fc0ad000 tx=0x7f89fc008040 comp rx=0 tx=0).stop 2024-03-19T06:21:12.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.444+0000 7f8a13800640 1 -- 172.21.15.32:0/3359445137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a0c06b280 msgr2=0x7f8a0c13f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:12.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.444+0000 7f8a13800640 1 --2- 172.21.15.32:0/3359445137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a0c06b280 0x7f8a0c13f300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f89f400d830 tx=0x7f89f400dcf0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.444+0000 7f8a13800640 1 -- 172.21.15.32:0/3359445137 shutdown_connections 2024-03-19T06:21:12.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.444+0000 7f8a13800640 1 --2- 172.21.15.32:0/3359445137 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f89e8067660 0x7f89e8069b20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.444+0000 7f8a13800640 1 --2- 172.21.15.32:0/3359445137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a0c15a840 0x7f8a0c15be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.444+0000 7f8a13800640 1 --2- 172.21.15.32:0/3359445137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a0c0aea70 0x7f8a0c15b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.444+0000 7f8a13800640 1 --2- 172.21.15.32:0/3359445137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a0c06b280 0x7f8a0c13f300 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.444+0000 7f8a13800640 1 -- 172.21.15.32:0/3359445137 >> 172.21.15.32:0/3359445137 conn(0x7f8a0c0b1590 msgr2=0x7f8a0c150f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:12.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.444+0000 7f8a13800640 1 -- 172.21.15.32:0/3359445137 shutdown_connections 2024-03-19T06:21:12.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.444+0000 7f8a13800640 1 -- 172.21.15.32:0/3359445137 wait complete. 2024-03-19T06:21:12.459 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-19T06:21:12.460 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:21:12.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.608+0000 7f01fda00640 1 Processor -- start 2024-03-19T06:21:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.608+0000 7f01fda00640 1 -- start start 2024-03-19T06:21:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.612+0000 7f01fda00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f01f80cc2e0 0x7f01f80ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.612+0000 7f01fda00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01f80d0180 0x7f01f80cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.612+0000 7f01fda00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f806ad40 con 0x7f01f8161270 2024-03-19T06:21:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.612+0000 7f01fda00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f806b020 con 0x7f01f80d0180 2024-03-19T06:21:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.612+0000 7f01fda00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f806b300 con 0x7f01f80cc2e0 2024-03-19T06:21:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.612+0000 7f01f7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01f80d0180 0x7f01f80cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.612+0000 7f01f6a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f01f8161270 0x7f01f80cfa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36326/0 (socket says 172.21.15.32:36326) 2024-03-19T06:21:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.612+0000 7f01f7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01f80d0180 0x7f01f80cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47546/0 (socket says 172.21.15.32:47546) 2024-03-19T06:21:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.612+0000 7f01f6a00640 1 -- 172.21.15.32:0/3378555878 learned_addr learned my addr 172.21.15.32:0/3378555878 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.612+0000 7f01efe00640 1 --2- 172.21.15.32:0/3378555878 >> v2:172.21.15.171:3300/0 conn(0x7f01f80cc2e0 0x7f01f80ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.612+0000 7f01f7400640 1 -- 172.21.15.32:0/3378555878 >> v2:172.21.15.171:3300/0 conn(0x7f01f80cc2e0 msgr2=0x7f01f80ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.612+0000 7f01f7400640 1 --2- 172.21.15.32:0/3378555878 >> v2:172.21.15.171:3300/0 conn(0x7f01f80cc2e0 0x7f01f80ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.612+0000 7f01f7400640 1 -- 172.21.15.32:0/3378555878 >> v1:172.21.15.32:6789/0 conn(0x7f01f8161270 legacy=0x7f01f80cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.612+0000 7f01f7400640 1 -- 172.21.15.32:0/3378555878 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f806b5e0 con 0x7f01f80d0180 2024-03-19T06:21:12.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.616+0000 7f01f7400640 1 --2- 172.21.15.32:0/3378555878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01f80d0180 0x7f01f80cc950 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f01f8070ea0 tx=0x7f01f001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1995c177077bab8 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:12.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.616+0000 7f01f6000640 1 -- 172.21.15.32:0/3378555878 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f00b2070 con 0x7f01f80d0180 2024-03-19T06:21:12.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.616+0000 7f01f6000640 1 -- 172.21.15.32:0/3378555878 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f00a5900 con 0x7f01f80d0180 2024-03-19T06:21:12.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.616+0000 7f01f6000640 1 -- 172.21.15.32:0/3378555878 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f00a5cd0 con 0x7f01f80d0180 2024-03-19T06:21:12.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.616+0000 7f01fda00640 1 -- 172.21.15.32:0/3378555878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01f80d0180 msgr2=0x7f01f80cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:12.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.616+0000 7f01fda00640 1 --2- 172.21.15.32:0/3378555878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01f80d0180 0x7f01f80cc950 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f01f8070ea0 tx=0x7f01f001c930 comp rx=0 tx=0).stop 2024-03-19T06:21:12.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.616+0000 7f01fda00640 1 -- 172.21.15.32:0/3378555878 shutdown_connections 2024-03-19T06:21:12.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.616+0000 7f01fda00640 1 --2- 172.21.15.32:0/3378555878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01f80d0180 0x7f01f80cc950 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.616+0000 7f01fda00640 1 --2- 172.21.15.32:0/3378555878 >> v2:172.21.15.171:3300/0 conn(0x7f01f80cc2e0 0x7f01f80ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.616+0000 7f01fda00640 1 -- 172.21.15.32:0/3378555878 >> 172.21.15.32:0/3378555878 conn(0x7f01f80b2250 msgr2=0x7f01f80b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:12.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.616+0000 7f01fda00640 1 -- 172.21.15.32:0/3378555878 shutdown_connections 2024-03-19T06:21:12.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.616+0000 7f01fda00640 1 -- 172.21.15.32:0/3378555878 wait complete. 2024-03-19T06:21:12.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.616+0000 7f01fda00640 1 Processor -- start 2024-03-19T06:21:12.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.616+0000 7f01fda00640 1 -- start start 2024-03-19T06:21:12.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01fda00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01f80cc2e0 0x7f01f8157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:12.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01fda00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01f80d0180 0x7f01f80b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:12.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01fda00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01f8161270 0x7f01f80b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:12.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01fda00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f80cda30 con 0x7f01f80d0180 2024-03-19T06:21:12.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01fda00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f80cd8b0 con 0x7f01f80cc2e0 2024-03-19T06:21:12.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01fda00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f80cdbb0 con 0x7f01f8161270 2024-03-19T06:21:12.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01efe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01f80d0180 0x7f01f80b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:12.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01efe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01f80d0180 0x7f01f80b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47560/0 (socket says 172.21.15.32:47560) 2024-03-19T06:21:12.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01efe00640 1 -- 172.21.15.32:0/3137207577 learned_addr learned my addr 172.21.15.32:0/3137207577 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:12.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01f6a00640 1 --2- 172.21.15.32:0/3137207577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01f80cc2e0 0x7f01f8157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:12.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01f7400640 1 --2- 172.21.15.32:0/3137207577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01f8161270 0x7f01f80b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:12.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01efe00640 1 -- 172.21.15.32:0/3137207577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01f8161270 msgr2=0x7f01f80b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:12.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01efe00640 1 --2- 172.21.15.32:0/3137207577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01f8161270 0x7f01f80b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01efe00640 1 -- 172.21.15.32:0/3137207577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01f80cc2e0 msgr2=0x7f01f8157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:12.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01efe00640 1 --2- 172.21.15.32:0/3137207577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01f80cc2e0 0x7f01f8157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01efe00640 1 -- 172.21.15.32:0/3137207577 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f8159300 con 0x7f01f80d0180 2024-03-19T06:21:12.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01efe00640 1 --2- 172.21.15.32:0/3137207577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01f80d0180 0x7f01f80b3340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f01e000d800 tx=0x7f01e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:12.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01eea00640 1 -- 172.21.15.32:0/3137207577 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e000b6c0 con 0x7f01f80d0180 2024-03-19T06:21:12.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01eea00640 1 -- 172.21.15.32:0/3137207577 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e0019070 con 0x7f01f80d0180 2024-03-19T06:21:12.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01fda00640 1 -- 172.21.15.32:0/3137207577 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f81595e0 con 0x7f01f80d0180 2024-03-19T06:21:12.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01eea00640 1 -- 172.21.15.32:0/3137207577 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e000ba60 con 0x7f01f80d0180 2024-03-19T06:21:12.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01fda00640 1 -- 172.21.15.32:0/3137207577 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f8158190 con 0x7f01f80d0180 2024-03-19T06:21:12.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01fda00640 1 -- 172.21.15.32:0/3137207577 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f80749e0 con 0x7f01f80d0180 2024-03-19T06:21:12.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.620+0000 7f01eea00640 1 -- 172.21.15.32:0/3137207577 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f01e000bc00 con 0x7f01f80d0180 2024-03-19T06:21:12.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.624+0000 7f01eea00640 1 --2- 172.21.15.32:0/3137207577 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f01d4067660 0x7f01d4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:12.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.624+0000 7f01eea00640 1 -- 172.21.15.32:0/3137207577 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01e0085d80 con 0x7f01f80d0180 2024-03-19T06:21:12.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.624+0000 7f01f6a00640 1 --2- 172.21.15.32:0/3137207577 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f01d4067660 0x7f01d4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:12.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.624+0000 7f01f6a00640 1 --2- 172.21.15.32:0/3137207577 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f01d4067660 0x7f01d4069b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f01f80702b0 tx=0x7f01e8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:12.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.628+0000 7f01eea00640 1 -- 172.21.15.32:0/3137207577 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f01e00569f0 con 0x7f01f80d0180 2024-03-19T06:21:12.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.820+0000 7f01fda00640 1 -- 172.21.15.32:0/3137207577 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01f80d0700 con 0x7f01f80d0180 2024-03-19T06:21:12.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.820+0000 7f01eea00640 1 -- 172.21.15.32:0/3137207577 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4935 (secure 0 0 0) 0x7f01e00562f0 con 0x7f01f80d0180 2024-03-19T06:21:12.815 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:12.815 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/3555048948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3555048948},{"type":"v1","addr":"172.21.15.32:6834","nonce":3555048948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3484789829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3484789829},{"type":"v1","addr":"172.21.15.171:6836","nonce":3484789829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/851750022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":851750022},{"type":"v1","addr":"172.21.15.171:6837","nonce":851750022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:21:08.817580+0000","modified":"2024-03-19T06:21:11.829499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/1902889035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":1902889035},{"type":"v1","addr":"172.21.15.32:6835","nonce":1902889035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-19T06:21:12.815 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-03-19T06:21:12.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.824+0000 7f01fda00640 1 -- 172.21.15.32:0/3137207577 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f01d4067660 msgr2=0x7f01d4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:12.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.824+0000 7f01fda00640 1 --2- 172.21.15.32:0/3137207577 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f01d4067660 0x7f01d4069b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f01f80702b0 tx=0x7f01e8009040 comp rx=0 tx=0).stop 2024-03-19T06:21:12.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.824+0000 7f01fda00640 1 -- 172.21.15.32:0/3137207577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01f80d0180 msgr2=0x7f01f80b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:12.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.824+0000 7f01fda00640 1 --2- 172.21.15.32:0/3137207577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01f80d0180 0x7f01f80b3340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f01e000d800 tx=0x7f01e000dcc0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.824+0000 7f01fda00640 1 -- 172.21.15.32:0/3137207577 shutdown_connections 2024-03-19T06:21:12.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.824+0000 7f01fda00640 1 --2- 172.21.15.32:0/3137207577 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f01d4067660 0x7f01d4069b20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.824+0000 7f01fda00640 1 --2- 172.21.15.32:0/3137207577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01f8161270 0x7f01f80b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.824+0000 7f01fda00640 1 --2- 172.21.15.32:0/3137207577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01f80d0180 0x7f01f80b3340 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.824+0000 7f01fda00640 1 --2- 172.21.15.32:0/3137207577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01f80cc2e0 0x7f01f8157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.824+0000 7f01fda00640 1 -- 172.21.15.32:0/3137207577 >> 172.21.15.32:0/3137207577 conn(0x7f01f80b2250 msgr2=0x7f01f8074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:12.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.824+0000 7f01fda00640 1 -- 172.21.15.32:0/3137207577 shutdown_connections 2024-03-19T06:21:12.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.824+0000 7f01fda00640 1 -- 172.21.15.32:0/3137207577 wait complete. 2024-03-19T06:21:12.836 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:12.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.984+0000 7f55d7e00640 1 Processor -- start 2024-03-19T06:21:12.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.984+0000 7f55d7e00640 1 -- start start 2024-03-19T06:21:12.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.984+0000 7f55d7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f55d00710b0 0x7f55d0168bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:12.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.984+0000 7f55d7e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d006fbe0 con 0x7f55d0099a70 2024-03-19T06:21:12.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.984+0000 7f55d7e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d015e940 con 0x7f55d006c060 2024-03-19T06:21:12.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.984+0000 7f55d7e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d015e720 con 0x7f55d00710b0 2024-03-19T06:21:12.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.984+0000 7f55d5400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f55d0099a70 0x7f55d0099e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36332/0 (socket says 172.21.15.32:36332) 2024-03-19T06:21:12.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.984+0000 7f55d5400640 1 -- 172.21.15.32:0/3389481965 learned_addr learned my addr 172.21.15.32:0/3389481965 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:12.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.984+0000 7f55d5e00640 1 --2- 172.21.15.32:0/3389481965 >> v2:172.21.15.32:3300/0 conn(0x7f55d00710b0 0x7f55d0168bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:12.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.984+0000 7f55cfe00640 1 -- 172.21.15.32:0/3389481965 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818483700 0 0) 0x7f55c4001120 con 0x7f55d0099a70 2024-03-19T06:21:12.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.984+0000 7f55cfe00640 1 -- 172.21.15.32:0/3389481965 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55b8003530 con 0x7f55d0099a70 2024-03-19T06:21:12.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.984+0000 7f55d5e00640 1 -- 172.21.15.32:0/3389481965 >> v1:172.21.15.171:6789/0 conn(0x7f55d006c060 legacy=0x7f55d015e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:12.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.984+0000 7f55d5e00640 1 -- 172.21.15.32:0/3389481965 >> v1:172.21.15.32:6789/0 conn(0x7f55d0099a70 legacy=0x7f55d0099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:12.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.984+0000 7f55d5e00640 1 -- 172.21.15.32:0/3389481965 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d015ec20 con 0x7f55d00710b0 2024-03-19T06:21:12.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.988+0000 7f55d5e00640 1 --2- 172.21.15.32:0/3389481965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d00710b0 0x7f55d0168bf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009d90 tx=0x7f55c801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d88441b043f49d0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:12.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.988+0000 7f55cfe00640 1 -- 172.21.15.32:0/3389481965 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c80b2070 con 0x7f55d00710b0 2024-03-19T06:21:12.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.988+0000 7f55cfe00640 1 -- 172.21.15.32:0/3389481965 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c80a5920 con 0x7f55d00710b0 2024-03-19T06:21:12.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.988+0000 7f55cfe00640 1 -- 172.21.15.32:0/3389481965 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c80a5cf0 con 0x7f55d00710b0 2024-03-19T06:21:12.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.988+0000 7f55d7e00640 1 -- 172.21.15.32:0/3389481965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d00710b0 msgr2=0x7f55d0168bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:12.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.988+0000 7f55d7e00640 1 --2- 172.21.15.32:0/3389481965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d00710b0 0x7f55d0168bf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009d90 tx=0x7f55c801c970 comp rx=0 tx=0).stop 2024-03-19T06:21:12.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.988+0000 7f55d7e00640 1 -- 172.21.15.32:0/3389481965 shutdown_connections 2024-03-19T06:21:12.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.988+0000 7f55d7e00640 1 --2- 172.21.15.32:0/3389481965 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d00710b0 0x7f55d0168bf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.988+0000 7f55d7e00640 1 -- 172.21.15.32:0/3389481965 >> 172.21.15.32:0/3389481965 conn(0x7f55d00b3300 msgr2=0x7f55d00b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:12.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.988+0000 7f55d7e00640 1 -- 172.21.15.32:0/3389481965 shutdown_connections 2024-03-19T06:21:12.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.988+0000 7f55d7e00640 1 -- 172.21.15.32:0/3389481965 wait complete. 2024-03-19T06:21:12.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d7e00640 1 Processor -- start 2024-03-19T06:21:12.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d7e00640 1 -- start start 2024-03-19T06:21:12.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55d006c060 0x7f55d0161f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:12.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d00710b0 0x7f55d00b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:12.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d7e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55d0099a70 0x7f55d00b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:12.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d7e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d016bad0 con 0x7f55d00710b0 2024-03-19T06:21:12.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d7e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d016b950 con 0x7f55d0099a70 2024-03-19T06:21:12.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d7e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d016bc50 con 0x7f55d006c060 2024-03-19T06:21:12.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d4a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d00710b0 0x7f55d00b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:12.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d4a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d00710b0 0x7f55d00b1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47574/0 (socket says 172.21.15.32:47574) 2024-03-19T06:21:12.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d4a00640 1 -- 172.21.15.32:0/463122141 learned_addr learned my addr 172.21.15.32:0/463122141 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:12.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d5400640 1 --2- 172.21.15.32:0/463122141 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55d006c060 0x7f55d0161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:12.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d5e00640 1 --2- 172.21.15.32:0/463122141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55d0099a70 0x7f55d00b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:12.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d4a00640 1 -- 172.21.15.32:0/463122141 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55d006c060 msgr2=0x7f55d0161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:12.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d4a00640 1 --2- 172.21.15.32:0/463122141 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55d006c060 0x7f55d0161f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d4a00640 1 -- 172.21.15.32:0/463122141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55d0099a70 msgr2=0x7f55d00b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:12.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d4a00640 1 --2- 172.21.15.32:0/463122141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55d0099a70 0x7f55d00b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:12.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d4a00640 1 -- 172.21.15.32:0/463122141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d00c7400 con 0x7f55d00710b0 2024-03-19T06:21:12.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d5400640 1 --2- 172.21.15.32:0/463122141 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55d006c060 0x7f55d0161f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:12.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d5e00640 1 --2- 172.21.15.32:0/463122141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55d0099a70 0x7f55d00b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:12.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d4a00640 1 --2- 172.21.15.32:0/463122141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d00710b0 0x7f55d00b1a60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00c370 tx=0x7f55bc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:12.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55cd600640 1 -- 172.21.15.32:0/463122141 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0052d0 con 0x7f55d00710b0 2024-03-19T06:21:12.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55cd600640 1 -- 172.21.15.32:0/463122141 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc005470 con 0x7f55d00710b0 2024-03-19T06:21:12.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55cd600640 1 -- 172.21.15.32:0/463122141 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc007260 con 0x7f55d00710b0 2024-03-19T06:21:12.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d7e00640 1 -- 172.21.15.32:0/463122141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d00c76e0 con 0x7f55d00710b0 2024-03-19T06:21:12.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.992+0000 7f55d7e00640 1 -- 172.21.15.32:0/463122141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d00c7ca0 con 0x7f55d00710b0 2024-03-19T06:21:12.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.996+0000 7f55d7e00640 1 -- 172.21.15.32:0/463122141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d00749e0 con 0x7f55d00710b0 2024-03-19T06:21:12.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.996+0000 7f55cd600640 1 -- 172.21.15.32:0/463122141 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f55bc007400 con 0x7f55d00710b0 2024-03-19T06:21:12.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.996+0000 7f55cd600640 1 --2- 172.21.15.32:0/463122141 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55b0067660 0x7f55b0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:12.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.996+0000 7f55cd600640 1 -- 172.21.15.32:0/463122141 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55bc084da0 con 0x7f55d00710b0 2024-03-19T06:21:12.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.996+0000 7f55d5400640 1 --2- 172.21.15.32:0/463122141 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55b0067660 0x7f55b0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:12.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:12.996+0000 7f55d5400640 1 --2- 172.21.15.32:0/463122141 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55b0067660 0x7f55b0069b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55c40012c0 tx=0x7f55c4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:12.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.000+0000 7f55cd600640 1 -- 172.21.15.32:0/463122141 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f55bc055990 con 0x7f55d00710b0 2024-03-19T06:21:13.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.164+0000 7f55d7e00640 1 -- 172.21.15.32:0/463122141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55d00b4100 con 0x7f55d00710b0 2024-03-19T06:21:13.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.164+0000 7f55cd600640 1 -- 172.21.15.32:0/463122141 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f55bc055290 con 0x7f55d00710b0 2024-03-19T06:21:13.159 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:13.159 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:10.423479+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.168+0000 7f55d7e00640 1 -- 172.21.15.32:0/463122141 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55b0067660 msgr2=0x7f55b0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.168+0000 7f55d7e00640 1 --2- 172.21.15.32:0/463122141 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55b0067660 0x7f55b0069b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55c40012c0 tx=0x7f55c4009040 comp rx=0 tx=0).stop 2024-03-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.168+0000 7f55d7e00640 1 -- 172.21.15.32:0/463122141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d00710b0 msgr2=0x7f55d00b1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.168+0000 7f55d7e00640 1 --2- 172.21.15.32:0/463122141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d00710b0 0x7f55d00b1a60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00c370 tx=0x7f55bc00c830 comp rx=0 tx=0).stop 2024-03-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.168+0000 7f55d7e00640 1 -- 172.21.15.32:0/463122141 shutdown_connections 2024-03-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.168+0000 7f55d7e00640 1 --2- 172.21.15.32:0/463122141 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55b0067660 0x7f55b0069b20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.168+0000 7f55d7e00640 1 --2- 172.21.15.32:0/463122141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55d0099a70 0x7f55d00b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.168+0000 7f55d7e00640 1 --2- 172.21.15.32:0/463122141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55d00710b0 0x7f55d00b1a60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.168+0000 7f55d7e00640 1 --2- 172.21.15.32:0/463122141 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55d006c060 0x7f55d0161f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.168+0000 7f55d7e00640 1 -- 172.21.15.32:0/463122141 >> 172.21.15.32:0/463122141 conn(0x7f55d00b3300 msgr2=0x7f55d00ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:13.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.168+0000 7f55d7e00640 1 -- 172.21.15.32:0/463122141 shutdown_connections 2024-03-19T06:21:13.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.168+0000 7f55d7e00640 1 -- 172.21.15.32:0/463122141 wait complete. 2024-03-19T06:21:13.179 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-19T06:21:13.180 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:21:13.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41c5400640 1 Processor -- start 2024-03-19T06:21:13.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41c5400640 1 -- start start 2024-03-19T06:21:13.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41c5400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f41c00aecf0 0x7f41c00ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:13.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41c5400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f41c015c010 0x7f41c015f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:13.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41c5400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41c006d6c0 0x7f41c006dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:13.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41c5400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c01603e0 con 0x7f41c00aecf0 2024-03-19T06:21:13.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41c5400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c006e000 con 0x7f41c015c010 2024-03-19T06:21:13.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41c5400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c015fe20 con 0x7f41c006d6c0 2024-03-19T06:21:13.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41be800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f41c00aecf0 0x7f41c00ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:13.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41be800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f41c00aecf0 0x7f41c00ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47586/0 (socket says 172.21.15.32:47586) 2024-03-19T06:21:13.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41be800640 1 -- 172.21.15.32:0/1044922925 learned_addr learned my addr 172.21.15.32:0/1044922925 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:13.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41bf200640 1 --2- 172.21.15.32:0/1044922925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41c006d6c0 0x7f41c006dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:13.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41b5e00640 1 --2- 172.21.15.32:0/1044922925 >> v2:172.21.15.171:3300/0 conn(0x7f41c015c010 0x7f41c015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:13.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41be800640 1 -- 172.21.15.32:0/1044922925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41c006d6c0 msgr2=0x7f41c006dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:13.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41be800640 1 --2- 172.21.15.32:0/1044922925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41c006d6c0 0x7f41c006dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41be800640 1 -- 172.21.15.32:0/1044922925 >> v2:172.21.15.171:3300/0 conn(0x7f41c015c010 msgr2=0x7f41c015f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:13.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41be800640 1 --2- 172.21.15.32:0/1044922925 >> v2:172.21.15.171:3300/0 conn(0x7f41c015c010 0x7f41c015f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41be800640 1 -- 172.21.15.32:0/1044922925 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c0160100 con 0x7f41c00aecf0 2024-03-19T06:21:13.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.328+0000 7f41b5e00640 1 --2- 172.21.15.32:0/1044922925 >> v2:172.21.15.171:3300/0 conn(0x7f41c015c010 0x7f41c015f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:13.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.332+0000 7f41be800640 1 --2- 172.21.15.32:0/1044922925 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41c00aecf0 0x7f41c00ca9f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f41c0068930 tx=0x7f41b001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de43b0b563016971 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:13.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.332+0000 7f41bde00640 1 -- 172.21.15.32:0/1044922925 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b00b2070 con 0x7f41c00aecf0 2024-03-19T06:21:13.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.332+0000 7f41bde00640 1 -- 172.21.15.32:0/1044922925 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b00a9070 con 0x7f41c00aecf0 2024-03-19T06:21:13.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.332+0000 7f41bde00640 1 -- 172.21.15.32:0/1044922925 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b00ad880 con 0x7f41c00aecf0 2024-03-19T06:21:13.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.332+0000 7f41c5400640 1 -- 172.21.15.32:0/1044922925 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41c00aecf0 msgr2=0x7f41c00ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:13.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.332+0000 7f41c5400640 1 --2- 172.21.15.32:0/1044922925 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41c00aecf0 0x7f41c00ca9f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f41c0068930 tx=0x7f41b001c490 comp rx=0 tx=0).stop 2024-03-19T06:21:13.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.332+0000 7f41c5400640 1 -- 172.21.15.32:0/1044922925 shutdown_connections 2024-03-19T06:21:13.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.332+0000 7f41c5400640 1 --2- 172.21.15.32:0/1044922925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41c006d6c0 0x7f41c006dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.332+0000 7f41c5400640 1 --2- 172.21.15.32:0/1044922925 >> v2:172.21.15.171:3300/0 conn(0x7f41c015c010 0x7f41c015f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.332+0000 7f41c5400640 1 --2- 172.21.15.32:0/1044922925 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41c00aecf0 0x7f41c00ca9f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.332+0000 7f41c5400640 1 -- 172.21.15.32:0/1044922925 >> 172.21.15.32:0/1044922925 conn(0x7f41c00b1280 msgr2=0x7f41c00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:13.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.332+0000 7f41c5400640 1 -- 172.21.15.32:0/1044922925 shutdown_connections 2024-03-19T06:21:13.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.332+0000 7f41c5400640 1 -- 172.21.15.32:0/1044922925 wait complete. 2024-03-19T06:21:13.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41c5400640 1 Processor -- start 2024-03-19T06:21:13.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41c5400640 1 -- start start 2024-03-19T06:21:13.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41c5400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41c006d6c0 0x7f41c01f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:13.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41c5400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41c00aecf0 0x7f41c00b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:13.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41c5400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41c015c010 0x7f41c0156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:13.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41c5400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c015fbe0 con 0x7f41c00aecf0 2024-03-19T06:21:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41c5400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c015fa60 con 0x7f41c015c010 2024-03-19T06:21:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41c5400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c00cbc60 con 0x7f41c006d6c0 2024-03-19T06:21:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41b5e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41c00aecf0 0x7f41c00b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41b5e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41c00aecf0 0x7f41c00b2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47594/0 (socket says 172.21.15.32:47594) 2024-03-19T06:21:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41b5e00640 1 -- 172.21.15.32:0/1793421645 learned_addr learned my addr 172.21.15.32:0/1793421645 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41be800640 1 --2- 172.21.15.32:0/1793421645 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41c006d6c0 0x7f41c01f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41bf200640 1 --2- 172.21.15.32:0/1793421645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41c015c010 0x7f41c0156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41b5e00640 1 -- 172.21.15.32:0/1793421645 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41c006d6c0 msgr2=0x7f41c01f5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41b5e00640 1 --2- 172.21.15.32:0/1793421645 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41c006d6c0 0x7f41c01f5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41b5e00640 1 -- 172.21.15.32:0/1793421645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41c015c010 msgr2=0x7f41c0156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41b5e00640 1 --2- 172.21.15.32:0/1793421645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41c015c010 0x7f41c0156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41b5e00640 1 -- 172.21.15.32:0/1793421645 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c01fa6d0 con 0x7f41c00aecf0 2024-03-19T06:21:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41bf200640 1 --2- 172.21.15.32:0/1793421645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41c015c010 0x7f41c0156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41b5e00640 1 --2- 172.21.15.32:0/1793421645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41c00aecf0 0x7f41c00b2f50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41a800c820 tx=0x7f41a800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41b7400640 1 -- 172.21.15.32:0/1793421645 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a8015070 con 0x7f41c00aecf0 2024-03-19T06:21:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41b7400640 1 -- 172.21.15.32:0/1793421645 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a80079d0 con 0x7f41c00aecf0 2024-03-19T06:21:13.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41b7400640 1 -- 172.21.15.32:0/1793421645 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a8007de0 con 0x7f41c00aecf0 2024-03-19T06:21:13.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41c5400640 1 -- 172.21.15.32:0/1793421645 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c00cd200 con 0x7f41c00aecf0 2024-03-19T06:21:13.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.336+0000 7f41c5400640 1 -- 172.21.15.32:0/1793421645 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c00cd7c0 con 0x7f41c00aecf0 2024-03-19T06:21:13.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.340+0000 7f41c5400640 1 -- 172.21.15.32:0/1793421645 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c00749e0 con 0x7f41c00aecf0 2024-03-19T06:21:13.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.340+0000 7f41b7400640 1 -- 172.21.15.32:0/1793421645 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f41a8018070 con 0x7f41c00aecf0 2024-03-19T06:21:13.333 INFO:tasks.ceph.mds.c.smithi032.stderr:2024-03-19T06:21:13.340+0000 7f0f03200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-19T06:21:13.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.340+0000 7f41b7400640 1 --2- 172.21.15.32:0/1793421645 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f419c067690 0x7f419c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:13.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.340+0000 7f41b7400640 1 -- 172.21.15.32:0/1793421645 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41a8085660 con 0x7f41c00aecf0 2024-03-19T06:21:13.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.340+0000 7f41be800640 1 --2- 172.21.15.32:0/1793421645 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f419c067690 0x7f419c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:13.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.340+0000 7f41be800640 1 --2- 172.21.15.32:0/1793421645 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f419c067690 0x7f419c069b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f41b00af000 tx=0x7f41b0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:13.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.344+0000 7f41b7400640 1 -- 172.21.15.32:0/1793421645 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f41a8055c80 con 0x7f41c00aecf0 2024-03-19T06:21:13.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.504+0000 7f41c5400640 1 -- 172.21.15.32:0/1793421645 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41c015ec50 con 0x7f419c067690 2024-03-19T06:21:13.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.512+0000 7f41b7400640 1 -- 172.21.15.32:0/1793421645 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251907 (secure 0 0 0) 0x7f41c015ec50 con 0x7f419c067690 2024-03-19T06:21:13.508 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:13.509 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:21:13.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.516+0000 7f41c5400640 1 -- 172.21.15.32:0/1793421645 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f419c067690 msgr2=0x7f419c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:13.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.516+0000 7f41c5400640 1 --2- 172.21.15.32:0/1793421645 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f419c067690 0x7f419c069b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f41b00af000 tx=0x7f41b0008040 comp rx=0 tx=0).stop 2024-03-19T06:21:13.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.516+0000 7f41c5400640 1 -- 172.21.15.32:0/1793421645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41c00aecf0 msgr2=0x7f41c00b2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:13.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.516+0000 7f41c5400640 1 --2- 172.21.15.32:0/1793421645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41c00aecf0 0x7f41c00b2f50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41a800c820 tx=0x7f41a800cce0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.516+0000 7f41c5400640 1 -- 172.21.15.32:0/1793421645 shutdown_connections 2024-03-19T06:21:13.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.516+0000 7f41c5400640 1 --2- 172.21.15.32:0/1793421645 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f419c067690 0x7f419c069b50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.516+0000 7f41c5400640 1 --2- 172.21.15.32:0/1793421645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41c015c010 0x7f41c0156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.516+0000 7f41c5400640 1 --2- 172.21.15.32:0/1793421645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41c00aecf0 0x7f41c00b2f50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.516+0000 7f41c5400640 1 --2- 172.21.15.32:0/1793421645 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41c006d6c0 0x7f41c01f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.516+0000 7f41c5400640 1 -- 172.21.15.32:0/1793421645 >> 172.21.15.32:0/1793421645 conn(0x7f41c00b1280 msgr2=0x7f41c00b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:13.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.516+0000 7f41c5400640 1 -- 172.21.15.32:0/1793421645 shutdown_connections 2024-03-19T06:21:13.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.516+0000 7f41c5400640 1 -- 172.21.15.32:0/1793421645 wait complete. 2024-03-19T06:21:13.528 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-19T06:21:11.921175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235684,"kb_used_data":2868,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739036,"statfs":{"total":773094113280,"available":772852772864,"internally_reserved":0,"allocated":2936832,"data_stored":1756320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.516713"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439338+0000","last_change":"2024-03-19T06:21:09.452313+0000","last_active":"2024-03-19T06:21:10.439338+0000","last_peered":"2024-03-19T06:21:10.439338+0000","last_clean":"2024-03-19T06:21:10.439338+0000","last_became_active":"2024-03-19T06:21:09.452026+0000","last_became_peered":"2024-03-19T06:21:09.452026+0000","last_unstale":"2024-03-19T06:21:10.439338+0000","last_undegraded":"2024-03-19T06:21:10.439338+0000","last_fullsized":"2024-03-19T06:21:10.439338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:42.199087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431525+0000","last_change":"2024-03-19T06:21:09.451446+0000","last_active":"2024-03-19T06:21:10.431525+0000","last_peered":"2024-03-19T06:21:10.431525+0000","last_clean":"2024-03-19T06:21:10.431525+0000","last_became_active":"2024-03-19T06:21:09.451150+0000","last_became_peered":"2024-03-19T06:21:09.451150+0000","last_unstale":"2024-03-19T06:21:10.431525+0000","last_undegraded":"2024-03-19T06:21:10.431525+0000","last_fullsized":"2024-03-19T06:21:10.431525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:10:38.991785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.458567+0000","last_change":"2024-03-19T06:21:09.456587+0000","last_active":"2024-03-19T06:21:09.458567+0000","last_peered":"2024-03-19T06:21:09.458567+0000","last_clean":"2024-03-19T06:21:09.458567+0000","last_became_active":"2024-03-19T06:21:09.454920+0000","last_became_peered":"2024-03-19T06:21:09.454920+0000","last_unstale":"2024-03-19T06:21:09.458567+0000","last_undegraded":"2024-03-19T06:21:09.458567+0000","last_fullsized":"2024-03-19T06:21:09.458567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:28:35.542944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438703+0000","last_change":"2024-03-19T06:21:09.440118+0000","last_active":"2024-03-19T06:21:10.438703+0000","last_peered":"2024-03-19T06:21:10.438703+0000","last_clean":"2024-03-19T06:21:10.438703+0000","last_became_active":"2024-03-19T06:21:09.434539+0000","last_became_peered":"2024-03-19T06:21:09.434539+0000","last_unstale":"2024-03-19T06:21:10.438703+0000","last_undegraded":"2024-03-19T06:21:10.438703+0000","last_fullsized":"2024-03-19T06:21:10.438703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:05:23.173353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438953+0000","last_change":"2024-03-19T06:21:09.443312+0000","last_active":"2024-03-19T06:21:10.438953+0000","last_peered":"2024-03-19T06:21:10.438953+0000","last_clean":"2024-03-19T06:21:10.438953+0000","last_became_active":"2024-03-19T06:21:09.442978+0000","last_became_peered":"2024-03-19T06:21:09.442978+0000","last_unstale":"2024-03-19T06:21:10.438953+0000","last_undegraded":"2024-03-19T06:21:10.438953+0000","last_fullsized":"2024-03-19T06:21:10.438953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:39:52.224305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437914+0000","last_change":"2024-03-19T06:21:09.450442+0000","last_active":"2024-03-19T06:21:10.437914+0000","last_peered":"2024-03-19T06:21:10.437914+0000","last_clean":"2024-03-19T06:21:10.437914+0000","last_became_active":"2024-03-19T06:21:09.450149+0000","last_became_peered":"2024-03-19T06:21:09.450149+0000","last_unstale":"2024-03-19T06:21:10.437914+0000","last_undegraded":"2024-03-19T06:21:10.437914+0000","last_fullsized":"2024-03-19T06:21:10.437914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:54:53.443608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438253+0000","last_change":"2024-03-19T06:21:09.450859+0000","last_active":"2024-03-19T06:21:10.438253+0000","last_peered":"2024-03-19T06:21:10.438253+0000","last_clean":"2024-03-19T06:21:10.438253+0000","last_became_active":"2024-03-19T06:21:09.450658+0000","last_became_peered":"2024-03-19T06:21:09.450658+0000","last_unstale":"2024-03-19T06:21:10.438253+0000","last_undegraded":"2024-03-19T06:21:10.438253+0000","last_fullsized":"2024-03-19T06:21:10.438253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:05:23.173353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.447936+0000","last_change":"2024-03-19T06:21:09.445477+0000","last_active":"2024-03-19T06:21:09.447936+0000","last_peered":"2024-03-19T06:21:09.447936+0000","last_clean":"2024-03-19T06:21:09.447936+0000","last_became_active":"2024-03-19T06:21:09.445221+0000","last_became_peered":"2024-03-19T06:21:09.445221+0000","last_unstale":"2024-03-19T06:21:09.447936+0000","last_undegraded":"2024-03-19T06:21:09.447936+0000","last_fullsized":"2024-03-19T06:21:09.447936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:27:33.554426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439471+0000","last_change":"2024-03-19T06:21:09.450867+0000","last_active":"2024-03-19T06:21:10.439471+0000","last_peered":"2024-03-19T06:21:10.439471+0000","last_clean":"2024-03-19T06:21:10.439471+0000","last_became_active":"2024-03-19T06:21:09.449220+0000","last_became_peered":"2024-03-19T06:21:09.449220+0000","last_unstale":"2024-03-19T06:21:10.439471+0000","last_undegraded":"2024-03-19T06:21:10.439471+0000","last_fullsized":"2024-03-19T06:21:10.439471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:33:35.251645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.449987+0000","last_change":"2024-03-19T06:21:09.446487+0000","last_active":"2024-03-19T06:21:09.449987+0000","last_peered":"2024-03-19T06:21:09.449987+0000","last_clean":"2024-03-19T06:21:09.449987+0000","last_became_active":"2024-03-19T06:21:09.445934+0000","last_became_peered":"2024-03-19T06:21:09.445934+0000","last_unstale":"2024-03-19T06:21:09.449987+0000","last_undegraded":"2024-03-19T06:21:09.449987+0000","last_fullsized":"2024-03-19T06:21:09.449987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:28:35.542944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.450163+0000","last_change":"2024-03-19T06:21:09.446685+0000","last_active":"2024-03-19T06:21:09.450163+0000","last_peered":"2024-03-19T06:21:09.450163+0000","last_clean":"2024-03-19T06:21:09.450163+0000","last_became_active":"2024-03-19T06:21:09.446022+0000","last_became_peered":"2024-03-19T06:21:09.446022+0000","last_unstale":"2024-03-19T06:21:09.450163+0000","last_undegraded":"2024-03-19T06:21:09.450163+0000","last_fullsized":"2024-03-19T06:21:09.450163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:55:31.037416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.440335+0000","last_change":"2024-03-19T06:21:09.434969+0000","last_active":"2024-03-19T06:21:09.440335+0000","last_peered":"2024-03-19T06:21:09.440335+0000","last_clean":"2024-03-19T06:21:09.440335+0000","last_became_active":"2024-03-19T06:21:09.434675+0000","last_became_peered":"2024-03-19T06:21:09.434675+0000","last_unstale":"2024-03-19T06:21:09.440335+0000","last_undegraded":"2024-03-19T06:21:09.440335+0000","last_fullsized":"2024-03-19T06:21:09.440335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:18:07.111674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.442034+0000","last_change":"2024-03-19T06:21:09.434060+0000","last_active":"2024-03-19T06:21:09.442034+0000","last_peered":"2024-03-19T06:21:09.442034+0000","last_clean":"2024-03-19T06:21:09.442034+0000","last_became_active":"2024-03-19T06:21:09.433679+0000","last_became_peered":"2024-03-19T06:21:09.433679+0000","last_unstale":"2024-03-19T06:21:09.442034+0000","last_undegraded":"2024-03-19T06:21:09.442034+0000","last_fullsized":"2024-03-19T06:21:09.442034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:34:32.017603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456364+0000","last_change":"2024-03-19T06:21:09.447522+0000","last_active":"2024-03-19T06:21:09.456364+0000","last_peered":"2024-03-19T06:21:09.456364+0000","last_clean":"2024-03-19T06:21:09.456364+0000","last_became_active":"2024-03-19T06:21:09.447175+0000","last_became_peered":"2024-03-19T06:21:09.447175+0000","last_unstale":"2024-03-19T06:21:09.456364+0000","last_undegraded":"2024-03-19T06:21:09.456364+0000","last_fullsized":"2024-03-19T06:21:09.456364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:32:25.197980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431070+0000","last_change":"2024-03-19T06:21:09.424398+0000","last_active":"2024-03-19T06:21:10.431070+0000","last_peered":"2024-03-19T06:21:10.431070+0000","last_clean":"2024-03-19T06:21:10.431070+0000","last_became_active":"2024-03-19T06:21:09.424002+0000","last_became_peered":"2024-03-19T06:21:09.424002+0000","last_unstale":"2024-03-19T06:21:10.431070+0000","last_undegraded":"2024-03-19T06:21:10.431070+0000","last_fullsized":"2024-03-19T06:21:10.431070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:33:13.994451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437639+0000","last_change":"2024-03-19T06:21:09.451772+0000","last_active":"2024-03-19T06:21:10.437639+0000","last_peered":"2024-03-19T06:21:10.437639+0000","last_clean":"2024-03-19T06:21:10.437639+0000","last_became_active":"2024-03-19T06:21:09.451466+0000","last_became_peered":"2024-03-19T06:21:09.451466+0000","last_unstale":"2024-03-19T06:21:10.437639+0000","last_undegraded":"2024-03-19T06:21:10.437639+0000","last_fullsized":"2024-03-19T06:21:10.437639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:06.036992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439498+0000","last_change":"2024-03-19T06:21:09.447850+0000","last_active":"2024-03-19T06:21:10.439498+0000","last_peered":"2024-03-19T06:21:10.439498+0000","last_clean":"2024-03-19T06:21:10.439498+0000","last_became_active":"2024-03-19T06:21:09.446058+0000","last_became_peered":"2024-03-19T06:21:09.446058+0000","last_unstale":"2024-03-19T06:21:10.439498+0000","last_undegraded":"2024-03-19T06:21:10.439498+0000","last_fullsized":"2024-03-19T06:21:10.439498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:42.199087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.437668+0000","last_change":"2024-03-19T06:21:09.435147+0000","last_active":"2024-03-19T06:21:09.437668+0000","last_peered":"2024-03-19T06:21:09.437668+0000","last_clean":"2024-03-19T06:21:09.437668+0000","last_became_active":"2024-03-19T06:21:09.434845+0000","last_became_peered":"2024-03-19T06:21:09.434845+0000","last_unstale":"2024-03-19T06:21:09.437668+0000","last_undegraded":"2024-03-19T06:21:09.437668+0000","last_fullsized":"2024-03-19T06:21:09.437668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:23.154581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438335+0000","last_change":"2024-03-19T06:21:09.452917+0000","last_active":"2024-03-19T06:21:10.438335+0000","last_peered":"2024-03-19T06:21:10.438335+0000","last_clean":"2024-03-19T06:21:10.438335+0000","last_became_active":"2024-03-19T06:21:09.452649+0000","last_became_peered":"2024-03-19T06:21:09.452649+0000","last_unstale":"2024-03-19T06:21:10.438335+0000","last_undegraded":"2024-03-19T06:21:10.438335+0000","last_fullsized":"2024-03-19T06:21:10.438335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:21:16.347465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.448620+0000","last_change":"2024-03-19T06:21:09.441874+0000","last_active":"2024-03-19T06:21:09.448620+0000","last_peered":"2024-03-19T06:21:09.448620+0000","last_clean":"2024-03-19T06:21:09.448620+0000","last_became_active":"2024-03-19T06:21:09.441614+0000","last_became_peered":"2024-03-19T06:21:09.441614+0000","last_unstale":"2024-03-19T06:21:09.448620+0000","last_undegraded":"2024-03-19T06:21:09.448620+0000","last_fullsized":"2024-03-19T06:21:09.448620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:17:40.182730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456392+0000","last_change":"2024-03-19T06:21:09.442717+0000","last_active":"2024-03-19T06:21:09.456392+0000","last_peered":"2024-03-19T06:21:09.456392+0000","last_clean":"2024-03-19T06:21:09.456392+0000","last_became_active":"2024-03-19T06:21:09.441979+0000","last_became_peered":"2024-03-19T06:21:09.441979+0000","last_unstale":"2024-03-19T06:21:09.456392+0000","last_undegraded":"2024-03-19T06:21:09.456392+0000","last_fullsized":"2024-03-19T06:21:09.456392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:57.281722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438065+0000","last_change":"2024-03-19T06:21:09.444519+0000","last_active":"2024-03-19T06:21:10.438065+0000","last_peered":"2024-03-19T06:21:10.438065+0000","last_clean":"2024-03-19T06:21:10.438065+0000","last_became_active":"2024-03-19T06:21:09.444304+0000","last_became_peered":"2024-03-19T06:21:09.444304+0000","last_unstale":"2024-03-19T06:21:10.438065+0000","last_undegraded":"2024-03-19T06:21:10.438065+0000","last_fullsized":"2024-03-19T06:21:10.438065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:29:55.294290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.443682+0000","last_change":"2024-03-19T06:21:09.439225+0000","last_active":"2024-03-19T06:21:09.443682+0000","last_peered":"2024-03-19T06:21:09.443682+0000","last_clean":"2024-03-19T06:21:09.443682+0000","last_became_active":"2024-03-19T06:21:09.437400+0000","last_became_peered":"2024-03-19T06:21:09.437400+0000","last_unstale":"2024-03-19T06:21:09.443682+0000","last_undegraded":"2024-03-19T06:21:09.443682+0000","last_fullsized":"2024-03-19T06:21:09.443682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:04:20.539454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437740+0000","last_change":"2024-03-19T06:21:09.438758+0000","last_active":"2024-03-19T06:21:10.437740+0000","last_peered":"2024-03-19T06:21:10.437740+0000","last_clean":"2024-03-19T06:21:10.437740+0000","last_became_active":"2024-03-19T06:21:09.438493+0000","last_became_peered":"2024-03-19T06:21:09.438493+0000","last_unstale":"2024-03-19T06:21:10.437740+0000","last_undegraded":"2024-03-19T06:21:10.437740+0000","last_fullsized":"2024-03-19T06:21:10.437740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:10:38.991785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.444543+0000","last_change":"2024-03-19T06:21:09.442133+0000","last_active":"2024-03-19T06:21:09.444543+0000","last_peered":"2024-03-19T06:21:09.444543+0000","last_clean":"2024-03-19T06:21:09.444543+0000","last_became_active":"2024-03-19T06:21:09.438450+0000","last_became_peered":"2024-03-19T06:21:09.438450+0000","last_unstale":"2024-03-19T06:21:09.444543+0000","last_undegraded":"2024-03-19T06:21:09.444543+0000","last_fullsized":"2024-03-19T06:21:09.444543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:10:44.620921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.460629+0000","last_change":"2024-03-19T06:21:09.452119+0000","last_active":"2024-03-19T06:21:09.460629+0000","last_peered":"2024-03-19T06:21:09.460629+0000","last_clean":"2024-03-19T06:21:09.460629+0000","last_became_active":"2024-03-19T06:21:09.446514+0000","last_became_peered":"2024-03-19T06:21:09.446514+0000","last_unstale":"2024-03-19T06:21:09.460629+0000","last_undegraded":"2024-03-19T06:21:09.460629+0000","last_fullsized":"2024-03-19T06:21:09.460629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:30:08.169277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431419+0000","last_change":"2024-03-19T06:21:09.431512+0000","last_active":"2024-03-19T06:21:10.431419+0000","last_peered":"2024-03-19T06:21:10.431419+0000","last_clean":"2024-03-19T06:21:10.431419+0000","last_became_active":"2024-03-19T06:21:09.431222+0000","last_became_peered":"2024-03-19T06:21:09.431222+0000","last_unstale":"2024-03-19T06:21:10.431419+0000","last_undegraded":"2024-03-19T06:21:10.431419+0000","last_fullsized":"2024-03-19T06:21:10.431419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:06.036992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.443069+0000","last_change":"2024-03-19T06:21:09.439110+0000","last_active":"2024-03-19T06:21:09.443069+0000","last_peered":"2024-03-19T06:21:09.443069+0000","last_clean":"2024-03-19T06:21:09.443069+0000","last_became_active":"2024-03-19T06:21:09.437439+0000","last_became_peered":"2024-03-19T06:21:09.437439+0000","last_unstale":"2024-03-19T06:21:09.443069+0000","last_undegraded":"2024-03-19T06:21:09.443069+0000","last_fullsized":"2024-03-19T06:21:09.443069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:41:23.004327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456372+0000","last_change":"2024-03-19T06:21:09.442438+0000","last_active":"2024-03-19T06:21:09.456372+0000","last_peered":"2024-03-19T06:21:09.456372+0000","last_clean":"2024-03-19T06:21:09.456372+0000","last_became_active":"2024-03-19T06:21:09.441595+0000","last_became_peered":"2024-03-19T06:21:09.441595+0000","last_unstale":"2024-03-19T06:21:09.456372+0000","last_undegraded":"2024-03-19T06:21:09.456372+0000","last_fullsized":"2024-03-19T06:21:09.456372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:12:56.208388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438209+0000","last_change":"2024-03-19T06:21:09.445182+0000","last_active":"2024-03-19T06:21:10.438209+0000","last_peered":"2024-03-19T06:21:10.438209+0000","last_clean":"2024-03-19T06:21:10.438209+0000","last_became_active":"2024-03-19T06:21:09.442331+0000","last_became_peered":"2024-03-19T06:21:09.442331+0000","last_unstale":"2024-03-19T06:21:10.438209+0000","last_undegraded":"2024-03-19T06:21:10.438209+0000","last_fullsized":"2024-03-19T06:21:10.438209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:20.797571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.437414+0000","last_change":"2024-03-19T06:21:09.432846+0000","last_active":"2024-03-19T06:21:09.437414+0000","last_peered":"2024-03-19T06:21:09.437414+0000","last_clean":"2024-03-19T06:21:09.437414+0000","last_became_active":"2024-03-19T06:21:09.432568+0000","last_became_peered":"2024-03-19T06:21:09.432568+0000","last_unstale":"2024-03-19T06:21:09.437414+0000","last_undegraded":"2024-03-19T06:21:09.437414+0000","last_fullsized":"2024-03-19T06:21:09.437414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:32:25.197980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.460721+0000","last_change":"2024-03-19T06:21:09.455461+0000","last_active":"2024-03-19T06:21:09.460721+0000","last_peered":"2024-03-19T06:21:09.460721+0000","last_clean":"2024-03-19T06:21:09.460721+0000","last_became_active":"2024-03-19T06:21:09.452616+0000","last_became_peered":"2024-03-19T06:21:09.452616+0000","last_unstale":"2024-03-19T06:21:09.460721+0000","last_undegraded":"2024-03-19T06:21:09.460721+0000","last_fullsized":"2024-03-19T06:21:09.460721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:54:33.924115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.436125+0000","last_change":"2024-03-19T06:21:09.429726+0000","last_active":"2024-03-19T06:21:09.436125+0000","last_peered":"2024-03-19T06:21:09.436125+0000","last_clean":"2024-03-19T06:21:09.436125+0000","last_became_active":"2024-03-19T06:21:09.428690+0000","last_became_peered":"2024-03-19T06:21:09.428690+0000","last_unstale":"2024-03-19T06:21:09.436125+0000","last_undegraded":"2024-03-19T06:21:09.436125+0000","last_fullsized":"2024-03-19T06:21:09.436125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:44:51.397622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.457792+0000","last_change":"2024-03-19T06:21:08.435558+0000","last_active":"2024-03-19T06:21:09.457792+0000","last_peered":"2024-03-19T06:21:09.457792+0000","last_clean":"2024-03-19T06:21:09.457792+0000","last_became_active":"2024-03-19T06:21:08.435230+0000","last_became_peered":"2024-03-19T06:21:08.435230+0000","last_unstale":"2024-03-19T06:21:09.457792+0000","last_undegraded":"2024-03-19T06:21:09.457792+0000","last_fullsized":"2024-03-19T06:21:09.457792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:57:49.073834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456545+0000","last_change":"2024-03-19T06:21:09.449204+0000","last_active":"2024-03-19T06:21:09.456545+0000","last_peered":"2024-03-19T06:21:09.456545+0000","last_clean":"2024-03-19T06:21:09.456545+0000","last_became_active":"2024-03-19T06:21:09.448927+0000","last_became_peered":"2024-03-19T06:21:09.448927+0000","last_unstale":"2024-03-19T06:21:09.456545+0000","last_undegraded":"2024-03-19T06:21:09.456545+0000","last_fullsized":"2024-03-19T06:21:09.456545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:42.809555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.460691+0000","last_change":"2024-03-19T06:21:08.439097+0000","last_active":"2024-03-19T06:21:09.460691+0000","last_peered":"2024-03-19T06:21:09.460691+0000","last_clean":"2024-03-19T06:21:09.460691+0000","last_became_active":"2024-03-19T06:21:08.438783+0000","last_became_peered":"2024-03-19T06:21:08.438783+0000","last_unstale":"2024-03-19T06:21:09.460691+0000","last_undegraded":"2024-03-19T06:21:09.460691+0000","last_fullsized":"2024-03-19T06:21:09.460691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:37.056055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.428090+0000","last_change":"2024-03-19T06:21:08.427804+0000","last_active":"2024-03-19T06:21:09.428090+0000","last_peered":"2024-03-19T06:21:09.428090+0000","last_clean":"2024-03-19T06:21:09.428090+0000","last_became_active":"2024-03-19T06:21:08.427129+0000","last_became_peered":"2024-03-19T06:21:08.427129+0000","last_unstale":"2024-03-19T06:21:09.428090+0000","last_undegraded":"2024-03-19T06:21:09.428090+0000","last_fullsized":"2024-03-19T06:21:09.428090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:13:25.373226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.451746+0000","last_change":"2024-03-19T06:21:09.449579+0000","last_active":"2024-03-19T06:21:09.451746+0000","last_peered":"2024-03-19T06:21:09.451746+0000","last_clean":"2024-03-19T06:21:09.451746+0000","last_became_active":"2024-03-19T06:21:09.448892+0000","last_became_peered":"2024-03-19T06:21:09.448892+0000","last_unstale":"2024-03-19T06:21:09.451746+0000","last_undegraded":"2024-03-19T06:21:09.451746+0000","last_fullsized":"2024-03-19T06:21:09.451746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:51:33.332224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437736+0000","last_change":"2024-03-19T06:21:08.441838+0000","last_active":"2024-03-19T06:21:10.437736+0000","last_peered":"2024-03-19T06:21:10.437736+0000","last_clean":"2024-03-19T06:21:10.437736+0000","last_became_active":"2024-03-19T06:21:08.441169+0000","last_became_peered":"2024-03-19T06:21:08.441169+0000","last_unstale":"2024-03-19T06:21:10.437736+0000","last_undegraded":"2024-03-19T06:21:10.437736+0000","last_fullsized":"2024-03-19T06:21:10.437736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:32:24.190836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431070+0000","last_change":"2024-03-19T06:21:09.430021+0000","last_active":"2024-03-19T06:21:10.431070+0000","last_peered":"2024-03-19T06:21:10.431070+0000","last_clean":"2024-03-19T06:21:10.431070+0000","last_became_active":"2024-03-19T06:21:09.429679+0000","last_became_peered":"2024-03-19T06:21:09.429679+0000","last_unstale":"2024-03-19T06:21:10.431070+0000","last_undegraded":"2024-03-19T06:21:10.431070+0000","last_fullsized":"2024-03-19T06:21:10.431070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:55.809405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.426899+0000","last_change":"2024-03-19T06:21:08.447659+0000","last_active":"2024-03-19T06:21:09.426899+0000","last_peered":"2024-03-19T06:21:09.426899+0000","last_clean":"2024-03-19T06:21:09.426899+0000","last_became_active":"2024-03-19T06:21:08.447310+0000","last_became_peered":"2024-03-19T06:21:08.447310+0000","last_unstale":"2024-03-19T06:21:09.426899+0000","last_undegraded":"2024-03-19T06:21:09.426899+0000","last_fullsized":"2024-03-19T06:21:09.426899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:22.147438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439182+0000","last_change":"2024-03-19T06:21:09.445774+0000","last_active":"2024-03-19T06:21:10.439182+0000","last_peered":"2024-03-19T06:21:10.439182+0000","last_clean":"2024-03-19T06:21:10.439182+0000","last_became_active":"2024-03-19T06:21:09.445517+0000","last_became_peered":"2024-03-19T06:21:09.445517+0000","last_unstale":"2024-03-19T06:21:10.439182+0000","last_undegraded":"2024-03-19T06:21:10.439182+0000","last_fullsized":"2024-03-19T06:21:10.439182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:14:58.974751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439282+0000","last_change":"2024-03-19T06:21:08.447265+0000","last_active":"2024-03-19T06:21:10.439282+0000","last_peered":"2024-03-19T06:21:10.439282+0000","last_clean":"2024-03-19T06:21:10.439282+0000","last_became_active":"2024-03-19T06:21:08.447009+0000","last_became_peered":"2024-03-19T06:21:08.447009+0000","last_unstale":"2024-03-19T06:21:10.439282+0000","last_undegraded":"2024-03-19T06:21:10.439282+0000","last_fullsized":"2024-03-19T06:21:10.439282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:22.147438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456976+0000","last_change":"2024-03-19T06:21:09.453099+0000","last_active":"2024-03-19T06:21:09.456976+0000","last_peered":"2024-03-19T06:21:09.456976+0000","last_clean":"2024-03-19T06:21:09.456976+0000","last_became_active":"2024-03-19T06:21:09.448991+0000","last_became_peered":"2024-03-19T06:21:09.448991+0000","last_unstale":"2024-03-19T06:21:09.456976+0000","last_undegraded":"2024-03-19T06:21:09.456976+0000","last_fullsized":"2024-03-19T06:21:09.456976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:27:52.195605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431373+0000","last_change":"2024-03-19T06:21:08.439829+0000","last_active":"2024-03-19T06:21:10.431373+0000","last_peered":"2024-03-19T06:21:10.431373+0000","last_clean":"2024-03-19T06:21:10.431373+0000","last_became_active":"2024-03-19T06:21:08.439454+0000","last_became_peered":"2024-03-19T06:21:08.439454+0000","last_unstale":"2024-03-19T06:21:10.431373+0000","last_undegraded":"2024-03-19T06:21:10.431373+0000","last_fullsized":"2024-03-19T06:21:10.431373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:41.802412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.454857+0000","last_change":"2024-03-19T06:21:09.449268+0000","last_active":"2024-03-19T06:21:09.454857+0000","last_peered":"2024-03-19T06:21:09.454857+0000","last_clean":"2024-03-19T06:21:09.454857+0000","last_became_active":"2024-03-19T06:21:09.448827+0000","last_became_peered":"2024-03-19T06:21:09.448827+0000","last_unstale":"2024-03-19T06:21:09.454857+0000","last_undegraded":"2024-03-19T06:21:09.454857+0000","last_fullsized":"2024-03-19T06:21:09.454857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:13:26.380370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.464548+0000","last_change":"2024-03-19T06:21:08.445760+0000","last_active":"2024-03-19T06:21:09.464548+0000","last_peered":"2024-03-19T06:21:09.464548+0000","last_clean":"2024-03-19T06:21:09.464548+0000","last_became_active":"2024-03-19T06:21:08.445560+0000","last_became_peered":"2024-03-19T06:21:08.445560+0000","last_unstale":"2024-03-19T06:21:09.464548+0000","last_undegraded":"2024-03-19T06:21:09.464548+0000","last_fullsized":"2024-03-19T06:21:09.464548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:32:24.190836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438055+0000","last_change":"2024-03-19T06:21:09.447310+0000","last_active":"2024-03-19T06:21:10.438055+0000","last_peered":"2024-03-19T06:21:10.438055+0000","last_clean":"2024-03-19T06:21:10.438055+0000","last_became_active":"2024-03-19T06:21:09.446811+0000","last_became_peered":"2024-03-19T06:21:09.446811+0000","last_unstale":"2024-03-19T06:21:10.438055+0000","last_undegraded":"2024-03-19T06:21:10.438055+0000","last_fullsized":"2024-03-19T06:21:10.438055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:29:55.294290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456897+0000","last_change":"2024-03-19T06:21:08.437505+0000","last_active":"2024-03-19T06:21:09.456897+0000","last_peered":"2024-03-19T06:21:09.456897+0000","last_clean":"2024-03-19T06:21:09.456897+0000","last_became_active":"2024-03-19T06:21:08.437190+0000","last_became_peered":"2024-03-19T06:21:08.437190+0000","last_unstale":"2024-03-19T06:21:09.456897+0000","last_undegraded":"2024-03-19T06:21:09.456897+0000","last_fullsized":"2024-03-19T06:21:09.456897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:53:34.745415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456086+0000","last_change":"2024-03-19T06:21:09.447509+0000","last_active":"2024-03-19T06:21:09.456086+0000","last_peered":"2024-03-19T06:21:09.456086+0000","last_clean":"2024-03-19T06:21:09.456086+0000","last_became_active":"2024-03-19T06:21:09.447154+0000","last_became_peered":"2024-03-19T06:21:09.447154+0000","last_unstale":"2024-03-19T06:21:09.456086+0000","last_undegraded":"2024-03-19T06:21:09.456086+0000","last_fullsized":"2024-03-19T06:21:09.456086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:38.063198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438312+0000","last_change":"2024-03-19T06:21:08.440830+0000","last_active":"2024-03-19T06:21:10.438312+0000","last_peered":"2024-03-19T06:21:10.438312+0000","last_clean":"2024-03-19T06:21:10.438312+0000","last_became_active":"2024-03-19T06:21:08.439995+0000","last_became_peered":"2024-03-19T06:21:08.439995+0000","last_unstale":"2024-03-19T06:21:10.438312+0000","last_undegraded":"2024-03-19T06:21:10.438312+0000","last_fullsized":"2024-03-19T06:21:10.438312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:56.274578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439288+0000","last_change":"2024-03-19T06:21:09.442975+0000","last_active":"2024-03-19T06:21:10.439288+0000","last_peered":"2024-03-19T06:21:10.439288+0000","last_clean":"2024-03-19T06:21:10.439288+0000","last_became_active":"2024-03-19T06:21:09.442638+0000","last_became_peered":"2024-03-19T06:21:09.442638+0000","last_unstale":"2024-03-19T06:21:10.439288+0000","last_undegraded":"2024-03-19T06:21:10.439288+0000","last_fullsized":"2024-03-19T06:21:10.439288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:14:58.974751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.424683+0000","last_change":"2024-03-19T06:21:08.439829+0000","last_active":"2024-03-19T06:21:09.424683+0000","last_peered":"2024-03-19T06:21:09.424683+0000","last_clean":"2024-03-19T06:21:09.424683+0000","last_became_active":"2024-03-19T06:21:08.439524+0000","last_became_peered":"2024-03-19T06:21:08.439524+0000","last_unstale":"2024-03-19T06:21:09.424683+0000","last_undegraded":"2024-03-19T06:21:09.424683+0000","last_fullsized":"2024-03-19T06:21:09.424683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:56.274578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.460641+0000","last_change":"2024-03-19T06:21:09.454721+0000","last_active":"2024-03-19T06:21:09.460641+0000","last_peered":"2024-03-19T06:21:09.460641+0000","last_clean":"2024-03-19T06:21:09.460641+0000","last_became_active":"2024-03-19T06:21:09.451915+0000","last_became_peered":"2024-03-19T06:21:09.451915+0000","last_unstale":"2024-03-19T06:21:09.460641+0000","last_undegraded":"2024-03-19T06:21:09.460641+0000","last_fullsized":"2024-03-19T06:21:09.460641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:15:19.406708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.461949+0000","last_change":"2024-03-19T06:21:08.434264+0000","last_active":"2024-03-19T06:21:09.461949+0000","last_peered":"2024-03-19T06:21:09.461949+0000","last_clean":"2024-03-19T06:21:09.461949+0000","last_became_active":"2024-03-19T06:21:08.433960+0000","last_became_peered":"2024-03-19T06:21:08.433960+0000","last_unstale":"2024-03-19T06:21:09.461949+0000","last_undegraded":"2024-03-19T06:21:09.461949+0000","last_fullsized":"2024-03-19T06:21:09.461949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:14:50.420085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438491+0000","last_change":"2024-03-19T06:21:09.444684+0000","last_active":"2024-03-19T06:21:10.438491+0000","last_peered":"2024-03-19T06:21:10.438491+0000","last_clean":"2024-03-19T06:21:10.438491+0000","last_became_active":"2024-03-19T06:21:09.444451+0000","last_became_peered":"2024-03-19T06:21:09.444451+0000","last_unstale":"2024-03-19T06:21:10.438491+0000","last_undegraded":"2024-03-19T06:21:10.438491+0000","last_fullsized":"2024-03-19T06:21:10.438491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:42:31.622101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.458886+0000","last_change":"2024-03-19T06:21:08.437032+0000","last_active":"2024-03-19T06:21:09.458886+0000","last_peered":"2024-03-19T06:21:09.458886+0000","last_clean":"2024-03-19T06:21:09.458886+0000","last_became_active":"2024-03-19T06:21:08.436518+0000","last_became_peered":"2024-03-19T06:21:08.436518+0000","last_unstale":"2024-03-19T06:21:09.458886+0000","last_undegraded":"2024-03-19T06:21:09.458886+0000","last_fullsized":"2024-03-19T06:21:09.458886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:37:38.410985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438943+0000","last_change":"2024-03-19T06:21:09.454018+0000","last_active":"2024-03-19T06:21:10.438943+0000","last_peered":"2024-03-19T06:21:10.438943+0000","last_clean":"2024-03-19T06:21:10.438943+0000","last_became_active":"2024-03-19T06:21:09.453715+0000","last_became_peered":"2024-03-19T06:21:09.453715+0000","last_unstale":"2024-03-19T06:21:10.438943+0000","last_undegraded":"2024-03-19T06:21:10.438943+0000","last_fullsized":"2024-03-19T06:21:10.438943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:08:07.201487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.452446+0000","last_change":"2024-03-19T06:21:08.426349+0000","last_active":"2024-03-19T06:21:09.452446+0000","last_peered":"2024-03-19T06:21:09.452446+0000","last_clean":"2024-03-19T06:21:09.452446+0000","last_became_active":"2024-03-19T06:21:08.426057+0000","last_became_peered":"2024-03-19T06:21:08.426057+0000","last_unstale":"2024-03-19T06:21:09.452446+0000","last_undegraded":"2024-03-19T06:21:09.452446+0000","last_fullsized":"2024-03-19T06:21:09.452446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:56.274578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439569+0000","last_change":"2024-03-19T06:21:09.453273+0000","last_active":"2024-03-19T06:21:10.439569+0000","last_peered":"2024-03-19T06:21:10.439569+0000","last_clean":"2024-03-19T06:21:10.439569+0000","last_became_active":"2024-03-19T06:21:09.453008+0000","last_became_peered":"2024-03-19T06:21:09.453008+0000","last_unstale":"2024-03-19T06:21:10.439569+0000","last_undegraded":"2024-03-19T06:21:10.439569+0000","last_fullsized":"2024-03-19T06:21:10.439569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:06:46.783271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431445+0000","last_change":"2024-03-19T06:21:08.436955+0000","last_active":"2024-03-19T06:21:10.431445+0000","last_peered":"2024-03-19T06:21:10.431445+0000","last_clean":"2024-03-19T06:21:10.431445+0000","last_became_active":"2024-03-19T06:21:08.436695+0000","last_became_peered":"2024-03-19T06:21:08.436695+0000","last_unstale":"2024-03-19T06:21:10.431445+0000","last_undegraded":"2024-03-19T06:21:10.431445+0000","last_fullsized":"2024-03-19T06:21:10.431445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:27:51.188461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438972+0000","last_change":"2024-03-19T06:21:09.440792+0000","last_active":"2024-03-19T06:21:10.438972+0000","last_peered":"2024-03-19T06:21:10.438972+0000","last_clean":"2024-03-19T06:21:10.438972+0000","last_became_active":"2024-03-19T06:21:09.433674+0000","last_became_peered":"2024-03-19T06:21:09.433674+0000","last_unstale":"2024-03-19T06:21:10.438972+0000","last_undegraded":"2024-03-19T06:21:10.438972+0000","last_fullsized":"2024-03-19T06:21:10.438972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:08:07.201487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.425290+0000","last_change":"2024-03-19T06:21:08.437235+0000","last_active":"2024-03-19T06:21:09.425290+0000","last_peered":"2024-03-19T06:21:09.425290+0000","last_clean":"2024-03-19T06:21:09.425290+0000","last_became_active":"2024-03-19T06:21:08.436874+0000","last_became_peered":"2024-03-19T06:21:08.436874+0000","last_unstale":"2024-03-19T06:21:09.425290+0000","last_undegraded":"2024-03-19T06:21:09.425290+0000","last_fullsized":"2024-03-19T06:21:09.425290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:37.056055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438152+0000","last_change":"2024-03-19T06:21:09.452749+0000","last_active":"2024-03-19T06:21:10.438152+0000","last_peered":"2024-03-19T06:21:10.438152+0000","last_clean":"2024-03-19T06:21:10.438152+0000","last_became_active":"2024-03-19T06:21:09.452386+0000","last_became_peered":"2024-03-19T06:21:09.452386+0000","last_unstale":"2024-03-19T06:21:10.438152+0000","last_undegraded":"2024-03-19T06:21:10.438152+0000","last_fullsized":"2024-03-19T06:21:10.438152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:20.797571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438011+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:21:10.438011+0000","last_peered":"2024-03-19T06:21:10.438011+0000","last_clean":"2024-03-19T06:21:10.438011+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:21:10.438011+0000","last_undegraded":"2024-03-19T06:21:10.438011+0000","last_fullsized":"2024-03-19T06:21:10.438011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439152+0000","last_change":"2024-03-19T06:21:08.436525+0000","last_active":"2024-03-19T06:21:10.439152+0000","last_peered":"2024-03-19T06:21:10.439152+0000","last_clean":"2024-03-19T06:21:10.439152+0000","last_became_active":"2024-03-19T06:21:08.434902+0000","last_became_peered":"2024-03-19T06:21:08.434902+0000","last_unstale":"2024-03-19T06:21:10.439152+0000","last_undegraded":"2024-03-19T06:21:10.439152+0000","last_fullsized":"2024-03-19T06:21:10.439152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:12:55.201245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.450663+0000","last_change":"2024-03-19T06:21:09.446879+0000","last_active":"2024-03-19T06:21:09.450663+0000","last_peered":"2024-03-19T06:21:09.450663+0000","last_clean":"2024-03-19T06:21:09.450663+0000","last_became_active":"2024-03-19T06:21:09.446625+0000","last_became_peered":"2024-03-19T06:21:09.446625+0000","last_unstale":"2024-03-19T06:21:09.450663+0000","last_undegraded":"2024-03-19T06:21:09.450663+0000","last_fullsized":"2024-03-19T06:21:09.450663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:15.328672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437951+0000","last_change":"2024-03-19T06:21:08.441736+0000","last_active":"2024-03-19T06:21:10.437951+0000","last_peered":"2024-03-19T06:21:10.437951+0000","last_clean":"2024-03-19T06:21:10.437951+0000","last_became_active":"2024-03-19T06:21:08.441408+0000","last_became_peered":"2024-03-19T06:21:08.441408+0000","last_unstale":"2024-03-19T06:21:10.437951+0000","last_undegraded":"2024-03-19T06:21:10.437951+0000","last_fullsized":"2024-03-19T06:21:10.437951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:27:51.188461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.446994+0000","last_change":"2024-03-19T06:21:09.435944+0000","last_active":"2024-03-19T06:21:09.446994+0000","last_peered":"2024-03-19T06:21:09.446994+0000","last_clean":"2024-03-19T06:21:09.446994+0000","last_became_active":"2024-03-19T06:21:09.435521+0000","last_became_peered":"2024-03-19T06:21:09.435521+0000","last_unstale":"2024-03-19T06:21:09.446994+0000","last_undegraded":"2024-03-19T06:21:09.446994+0000","last_fullsized":"2024-03-19T06:21:09.446994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:14:51.427228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.422318+0000","last_change":"2024-03-19T06:21:08.428501+0000","last_active":"2024-03-19T06:21:09.422318+0000","last_peered":"2024-03-19T06:21:09.422318+0000","last_clean":"2024-03-19T06:21:09.422318+0000","last_became_active":"2024-03-19T06:21:08.428240+0000","last_became_peered":"2024-03-19T06:21:08.428240+0000","last_unstale":"2024-03-19T06:21:09.422318+0000","last_undegraded":"2024-03-19T06:21:09.422318+0000","last_fullsized":"2024-03-19T06:21:09.422318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:12:55.201245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431078+0000","last_change":"2024-03-19T06:21:09.437604+0000","last_active":"2024-03-19T06:21:10.431078+0000","last_peered":"2024-03-19T06:21:10.431078+0000","last_clean":"2024-03-19T06:21:10.431078+0000","last_became_active":"2024-03-19T06:21:09.436485+0000","last_became_peered":"2024-03-19T06:21:09.436485+0000","last_unstale":"2024-03-19T06:21:10.431078+0000","last_undegraded":"2024-03-19T06:21:10.431078+0000","last_fullsized":"2024-03-19T06:21:10.431078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:48:33.849430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438404+0000","last_change":"2024-03-19T06:21:08.435260+0000","last_active":"2024-03-19T06:21:10.438404+0000","last_peered":"2024-03-19T06:21:10.438404+0000","last_clean":"2024-03-19T06:21:10.438404+0000","last_became_active":"2024-03-19T06:21:08.434842+0000","last_became_peered":"2024-03-19T06:21:08.434842+0000","last_unstale":"2024-03-19T06:21:10.438404+0000","last_undegraded":"2024-03-19T06:21:10.438404+0000","last_fullsized":"2024-03-19T06:21:10.438404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:37.056055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.455023+0000","last_change":"2024-03-19T06:21:09.449799+0000","last_active":"2024-03-19T06:21:09.455023+0000","last_peered":"2024-03-19T06:21:09.455023+0000","last_clean":"2024-03-19T06:21:09.455023+0000","last_became_active":"2024-03-19T06:21:09.448305+0000","last_became_peered":"2024-03-19T06:21:09.448305+0000","last_unstale":"2024-03-19T06:21:09.455023+0000","last_undegraded":"2024-03-19T06:21:09.455023+0000","last_fullsized":"2024-03-19T06:21:09.455023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:57:56.280549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431407+0000","last_change":"2024-03-19T06:21:08.429361+0000","last_active":"2024-03-19T06:21:10.431407+0000","last_peered":"2024-03-19T06:21:10.431407+0000","last_clean":"2024-03-19T06:21:10.431407+0000","last_became_active":"2024-03-19T06:21:08.429138+0000","last_became_peered":"2024-03-19T06:21:08.429138+0000","last_unstale":"2024-03-19T06:21:10.431407+0000","last_undegraded":"2024-03-19T06:21:10.431407+0000","last_fullsized":"2024-03-19T06:21:10.431407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:32:24.190836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439077+0000","last_change":"2024-03-19T06:21:09.438743+0000","last_active":"2024-03-19T06:21:10.439077+0000","last_peered":"2024-03-19T06:21:10.439077+0000","last_clean":"2024-03-19T06:21:10.439077+0000","last_became_active":"2024-03-19T06:21:09.433760+0000","last_became_peered":"2024-03-19T06:21:09.433760+0000","last_unstale":"2024-03-19T06:21:10.439077+0000","last_undegraded":"2024-03-19T06:21:10.439077+0000","last_fullsized":"2024-03-19T06:21:10.439077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:39:52.224305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438397+0000","last_change":"2024-03-19T06:21:08.443003+0000","last_active":"2024-03-19T06:21:10.438397+0000","last_peered":"2024-03-19T06:21:10.438397+0000","last_clean":"2024-03-19T06:21:10.438397+0000","last_became_active":"2024-03-19T06:21:08.442704+0000","last_became_peered":"2024-03-19T06:21:08.442704+0000","last_unstale":"2024-03-19T06:21:10.438397+0000","last_undegraded":"2024-03-19T06:21:10.438397+0000","last_fullsized":"2024-03-19T06:21:10.438397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:55:30.030272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431303+0000","last_change":"2024-03-19T06:21:09.440061+0000","last_active":"2024-03-19T06:21:10.431303+0000","last_peered":"2024-03-19T06:21:10.431303+0000","last_clean":"2024-03-19T06:21:10.431303+0000","last_became_active":"2024-03-19T06:21:09.439732+0000","last_became_peered":"2024-03-19T06:21:09.439732+0000","last_unstale":"2024-03-19T06:21:10.431303+0000","last_undegraded":"2024-03-19T06:21:10.431303+0000","last_fullsized":"2024-03-19T06:21:10.431303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:24:35.271835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431611+0000","last_change":"2024-03-19T06:21:08.443381+0000","last_active":"2024-03-19T06:21:10.431611+0000","last_peered":"2024-03-19T06:21:10.431611+0000","last_clean":"2024-03-19T06:21:10.431611+0000","last_became_active":"2024-03-19T06:21:08.443148+0000","last_became_peered":"2024-03-19T06:21:08.443148+0000","last_unstale":"2024-03-19T06:21:10.431611+0000","last_undegraded":"2024-03-19T06:21:10.431611+0000","last_fullsized":"2024-03-19T06:21:10.431611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:22.147438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.447061+0000","last_change":"2024-03-19T06:21:09.444826+0000","last_active":"2024-03-19T06:21:09.447061+0000","last_peered":"2024-03-19T06:21:09.447061+0000","last_clean":"2024-03-19T06:21:09.447061+0000","last_became_active":"2024-03-19T06:21:09.444361+0000","last_became_peered":"2024-03-19T06:21:09.444361+0000","last_unstale":"2024-03-19T06:21:09.447061+0000","last_undegraded":"2024-03-19T06:21:09.447061+0000","last_fullsized":"2024-03-19T06:21:09.447061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:40:01.712719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.459592+0000","last_change":"2024-03-19T06:21:08.447890+0000","last_active":"2024-03-19T06:21:09.459592+0000","last_peered":"2024-03-19T06:21:09.459592+0000","last_clean":"2024-03-19T06:21:09.459592+0000","last_became_active":"2024-03-19T06:21:08.447369+0000","last_became_peered":"2024-03-19T06:21:08.447369+0000","last_unstale":"2024-03-19T06:21:09.459592+0000","last_undegraded":"2024-03-19T06:21:09.459592+0000","last_fullsized":"2024-03-19T06:21:09.459592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:41.802412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456391+0000","last_change":"2024-03-19T06:21:09.448599+0000","last_active":"2024-03-19T06:21:09.456391+0000","last_peered":"2024-03-19T06:21:09.456391+0000","last_clean":"2024-03-19T06:21:09.456391+0000","last_became_active":"2024-03-19T06:21:09.448321+0000","last_became_peered":"2024-03-19T06:21:09.448321+0000","last_unstale":"2024-03-19T06:21:09.456391+0000","last_undegraded":"2024-03-19T06:21:09.456391+0000","last_fullsized":"2024-03-19T06:21:09.456391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:23.154581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437834+0000","last_change":"2024-03-19T06:21:08.442999+0000","last_active":"2024-03-19T06:21:10.437834+0000","last_peered":"2024-03-19T06:21:10.437834+0000","last_clean":"2024-03-19T06:21:10.437834+0000","last_became_active":"2024-03-19T06:21:08.442712+0000","last_became_peered":"2024-03-19T06:21:08.442712+0000","last_unstale":"2024-03-19T06:21:10.437834+0000","last_undegraded":"2024-03-19T06:21:10.437834+0000","last_fullsized":"2024-03-19T06:21:10.437834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:41.802412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.446382+0000","last_change":"2024-03-19T06:21:09.439036+0000","last_active":"2024-03-19T06:21:09.446382+0000","last_peered":"2024-03-19T06:21:09.446382+0000","last_clean":"2024-03-19T06:21:09.446382+0000","last_became_active":"2024-03-19T06:21:09.437278+0000","last_became_peered":"2024-03-19T06:21:09.437278+0000","last_unstale":"2024-03-19T06:21:09.446382+0000","last_undegraded":"2024-03-19T06:21:09.446382+0000","last_fullsized":"2024-03-19T06:21:09.446382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:57:50.080977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431175+0000","last_change":"2024-03-19T06:21:08.426050+0000","last_active":"2024-03-19T06:21:10.431175+0000","last_peered":"2024-03-19T06:21:10.431175+0000","last_clean":"2024-03-19T06:21:10.431175+0000","last_became_active":"2024-03-19T06:21:08.425685+0000","last_became_peered":"2024-03-19T06:21:08.425685+0000","last_unstale":"2024-03-19T06:21:10.431175+0000","last_undegraded":"2024-03-19T06:21:10.431175+0000","last_fullsized":"2024-03-19T06:21:10.431175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:17:39.175587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.430816+0000","last_change":"2024-03-19T06:21:09.429673+0000","last_active":"2024-03-19T06:21:09.430816+0000","last_peered":"2024-03-19T06:21:09.430816+0000","last_clean":"2024-03-19T06:21:09.430816+0000","last_became_active":"2024-03-19T06:21:09.429200+0000","last_became_peered":"2024-03-19T06:21:09.429200+0000","last_unstale":"2024-03-19T06:21:09.430816+0000","last_undegraded":"2024-03-19T06:21:09.430816+0000","last_fullsized":"2024-03-19T06:21:09.430816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:31:24.597225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431295+0000","last_change":"2024-03-19T06:21:08.432937+0000","last_active":"2024-03-19T06:21:10.431295+0000","last_peered":"2024-03-19T06:21:10.431295+0000","last_clean":"2024-03-19T06:21:10.431295+0000","last_became_active":"2024-03-19T06:21:08.432643+0000","last_became_peered":"2024-03-19T06:21:08.432643+0000","last_unstale":"2024-03-19T06:21:10.431295+0000","last_undegraded":"2024-03-19T06:21:10.431295+0000","last_fullsized":"2024-03-19T06:21:10.431295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:37.056055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.452876+0000","last_change":"2024-03-19T06:21:09.450656+0000","last_active":"2024-03-19T06:21:09.452876+0000","last_peered":"2024-03-19T06:21:09.452876+0000","last_clean":"2024-03-19T06:21:09.452876+0000","last_became_active":"2024-03-19T06:21:09.450267+0000","last_became_peered":"2024-03-19T06:21:09.450267+0000","last_unstale":"2024-03-19T06:21:09.452876+0000","last_undegraded":"2024-03-19T06:21:09.452876+0000","last_fullsized":"2024-03-19T06:21:09.452876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:03:23.131283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439491+0000","last_change":"2024-03-19T06:21:08.444057+0000","last_active":"2024-03-19T06:21:10.439491+0000","last_peered":"2024-03-19T06:21:10.439491+0000","last_clean":"2024-03-19T06:21:10.439491+0000","last_became_active":"2024-03-19T06:21:08.443651+0000","last_became_peered":"2024-03-19T06:21:08.443651+0000","last_unstale":"2024-03-19T06:21:10.439491+0000","last_undegraded":"2024-03-19T06:21:10.439491+0000","last_fullsized":"2024-03-19T06:21:10.439491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:17:39.175587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.437616+0000","last_change":"2024-03-19T06:21:09.434472+0000","last_active":"2024-03-19T06:21:09.437616+0000","last_peered":"2024-03-19T06:21:09.437616+0000","last_clean":"2024-03-19T06:21:09.437616+0000","last_became_active":"2024-03-19T06:21:09.434201+0000","last_became_peered":"2024-03-19T06:21:09.434201+0000","last_unstale":"2024-03-19T06:21:09.437616+0000","last_undegraded":"2024-03-19T06:21:09.437616+0000","last_fullsized":"2024-03-19T06:21:09.437616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:27:52.195605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438926+0000","last_change":"2024-03-19T06:21:09.431782+0000","last_active":"2024-03-19T06:21:10.438926+0000","last_peered":"2024-03-19T06:21:10.438926+0000","last_clean":"2024-03-19T06:21:10.438926+0000","last_became_active":"2024-03-19T06:21:09.431490+0000","last_became_peered":"2024-03-19T06:21:09.431490+0000","last_unstale":"2024-03-19T06:21:10.438926+0000","last_undegraded":"2024-03-19T06:21:10.438926+0000","last_fullsized":"2024-03-19T06:21:10.438926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:42:31.622101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438627+0000","last_change":"2024-03-19T06:21:08.446728+0000","last_active":"2024-03-19T06:21:10.438627+0000","last_peered":"2024-03-19T06:21:10.438627+0000","last_clean":"2024-03-19T06:21:10.438627+0000","last_became_active":"2024-03-19T06:21:08.446423+0000","last_became_peered":"2024-03-19T06:21:08.446423+0000","last_unstale":"2024-03-19T06:21:10.438627+0000","last_undegraded":"2024-03-19T06:21:10.438627+0000","last_fullsized":"2024-03-19T06:21:10.438627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:22.147438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438843+0000","last_change":"2024-03-19T06:21:09.431353+0000","last_active":"2024-03-19T06:21:10.438843+0000","last_peered":"2024-03-19T06:21:10.438843+0000","last_clean":"2024-03-19T06:21:10.438843+0000","last_became_active":"2024-03-19T06:21:09.431060+0000","last_became_peered":"2024-03-19T06:21:09.431060+0000","last_unstale":"2024-03-19T06:21:10.438843+0000","last_undegraded":"2024-03-19T06:21:10.438843+0000","last_fullsized":"2024-03-19T06:21:10.438843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:21:16.347465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438235+0000","last_change":"2024-03-19T06:21:08.447987+0000","last_active":"2024-03-19T06:21:10.438235+0000","last_peered":"2024-03-19T06:21:10.438235+0000","last_clean":"2024-03-19T06:21:10.438235+0000","last_became_active":"2024-03-19T06:21:08.447692+0000","last_became_peered":"2024-03-19T06:21:08.447692+0000","last_unstale":"2024-03-19T06:21:10.438235+0000","last_undegraded":"2024-03-19T06:21:10.438235+0000","last_fullsized":"2024-03-19T06:21:10.438235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:28:34.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456987+0000","last_change":"2024-03-19T06:21:09.453284+0000","last_active":"2024-03-19T06:21:09.456987+0000","last_peered":"2024-03-19T06:21:09.456987+0000","last_clean":"2024-03-19T06:21:09.456987+0000","last_became_active":"2024-03-19T06:21:09.452881+0000","last_became_peered":"2024-03-19T06:21:09.452881+0000","last_unstale":"2024-03-19T06:21:09.456987+0000","last_undegraded":"2024-03-19T06:21:09.456987+0000","last_fullsized":"2024-03-19T06:21:09.456987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:17:40.182730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.457371+0000","last_change":"2024-03-19T06:21:08.431484+0000","last_active":"2024-03-19T06:21:09.457371+0000","last_peered":"2024-03-19T06:21:09.457371+0000","last_clean":"2024-03-19T06:21:09.457371+0000","last_became_active":"2024-03-19T06:21:08.430999+0000","last_became_peered":"2024-03-19T06:21:08.430999+0000","last_unstale":"2024-03-19T06:21:09.457371+0000","last_undegraded":"2024-03-19T06:21:09.457371+0000","last_fullsized":"2024-03-19T06:21:09.457371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:57:55.273406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.444330+0000","last_change":"2024-03-19T06:21:09.442579+0000","last_active":"2024-03-19T06:21:09.444330+0000","last_peered":"2024-03-19T06:21:09.444330+0000","last_clean":"2024-03-19T06:21:09.444330+0000","last_became_active":"2024-03-19T06:21:09.442277+0000","last_became_peered":"2024-03-19T06:21:09.442277+0000","last_unstale":"2024-03-19T06:21:09.444330+0000","last_undegraded":"2024-03-19T06:21:09.444330+0000","last_fullsized":"2024-03-19T06:21:09.444330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:18:03.542251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.458011+0000","last_change":"2024-03-19T06:21:08.436289+0000","last_active":"2024-03-19T06:21:09.458011+0000","last_peered":"2024-03-19T06:21:09.458011+0000","last_clean":"2024-03-19T06:21:09.458011+0000","last_became_active":"2024-03-19T06:21:08.436007+0000","last_became_peered":"2024-03-19T06:21:08.436007+0000","last_unstale":"2024-03-19T06:21:09.458011+0000","last_undegraded":"2024-03-19T06:21:09.458011+0000","last_fullsized":"2024-03-19T06:21:09.458011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:29:42.390366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":72170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":70648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":70558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":70718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":661564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":70684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":72170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:21:13.533 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:21:13.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f066e200640 1 Processor -- start 2024-03-19T06:21:13.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f066e200640 1 -- start start 2024-03-19T06:21:13.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f066e200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f066815bb20 0x7f066809a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:13.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f066e200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f06680cf460 0x7f06680c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:13.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f066e200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f066815bf00 con 0x7f06680c5920 2024-03-19T06:21:13.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f066e200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06680cc3a0 con 0x7f06680cf460 2024-03-19T06:21:13.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f066e200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06680cfbb0 con 0x7f066815bb20 2024-03-19T06:21:13.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f0667e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f06680c5920 0x7f06680cd390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47546/0 (socket says 172.21.15.32:47546) 2024-03-19T06:21:13.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f0667e00640 1 -- 172.21.15.32:0/1114687718 learned_addr learned my addr 172.21.15.32:0/1114687718 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:13.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f065ea00640 1 --2- 172.21.15.32:0/1114687718 >> v2:172.21.15.171:3300/0 conn(0x7f06680cf460 0x7f06680c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:13.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f0667400640 1 --2- 172.21.15.32:0/1114687718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f066815bb20 0x7f066809a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:13.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f0666a00640 1 -- 172.21.15.32:0/1114687718 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691205368 0 0) 0x7f066815bf00 con 0x7f06680c5920 2024-03-19T06:21:13.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f0666a00640 1 -- 172.21.15.32:0/1114687718 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f064c003530 con 0x7f06680c5920 2024-03-19T06:21:13.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f0667400640 1 -- 172.21.15.32:0/1114687718 >> v2:172.21.15.171:3300/0 conn(0x7f06680cf460 msgr2=0x7f06680c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:13.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f0667400640 1 --2- 172.21.15.32:0/1114687718 >> v2:172.21.15.171:3300/0 conn(0x7f06680cf460 0x7f06680c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f0667400640 1 -- 172.21.15.32:0/1114687718 >> v1:172.21.15.32:6789/0 conn(0x7f06680c5920 legacy=0x7f06680cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:13.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.720+0000 7f0667400640 1 -- 172.21.15.32:0/1114687718 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06680cc5d0 con 0x7f066815bb20 2024-03-19T06:21:13.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.724+0000 7f0667400640 1 --2- 172.21.15.32:0/1114687718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f066815bb20 0x7f066809a480 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f06500097c0 tx=0x7f065001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb88fc90aedab701 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:13.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.724+0000 7f0666a00640 1 -- 172.21.15.32:0/1114687718 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500a7070 con 0x7f066815bb20 2024-03-19T06:21:13.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.724+0000 7f0666a00640 1 -- 172.21.15.32:0/1114687718 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06500b0070 con 0x7f066815bb20 2024-03-19T06:21:13.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.724+0000 7f0666a00640 1 -- 172.21.15.32:0/1114687718 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500ab890 con 0x7f066815bb20 2024-03-19T06:21:13.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.724+0000 7f066e200640 1 -- 172.21.15.32:0/1114687718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f066815bb20 msgr2=0x7f066809a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:13.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.724+0000 7f066e200640 1 --2- 172.21.15.32:0/1114687718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f066815bb20 0x7f066809a480 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f06500097c0 tx=0x7f065001c470 comp rx=0 tx=0).stop 2024-03-19T06:21:13.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.724+0000 7f066e200640 1 -- 172.21.15.32:0/1114687718 shutdown_connections 2024-03-19T06:21:13.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.724+0000 7f066e200640 1 --2- 172.21.15.32:0/1114687718 >> v2:172.21.15.171:3300/0 conn(0x7f06680cf460 0x7f06680c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.724+0000 7f066e200640 1 --2- 172.21.15.32:0/1114687718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f066815bb20 0x7f066809a480 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.724+0000 7f066e200640 1 -- 172.21.15.32:0/1114687718 >> 172.21.15.32:0/1114687718 conn(0x7f06680d1890 msgr2=0x7f06680d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:13.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.724+0000 7f066e200640 1 -- 172.21.15.32:0/1114687718 shutdown_connections 2024-03-19T06:21:13.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.724+0000 7f066e200640 1 -- 172.21.15.32:0/1114687718 wait complete. 2024-03-19T06:21:13.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f066e200640 1 Processor -- start 2024-03-19T06:21:13.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f066e200640 1 -- start start 2024-03-19T06:21:13.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f066e200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06680c5920 0x7f0668150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:13.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f066e200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06680cf460 0x7f0668150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:13.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f066e200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f066815bb20 0x7f06681fa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:13.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f066e200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0668168940 con 0x7f06680cf460 2024-03-19T06:21:13.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f066e200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06680cf840 con 0x7f066815bb20 2024-03-19T06:21:13.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f066e200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0668168ac0 con 0x7f06680c5920 2024-03-19T06:21:13.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f065ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06680cf460 0x7f0668150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:13.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f065ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06680cf460 0x7f0668150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45148/0 (socket says 172.21.15.32:45148) 2024-03-19T06:21:13.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f065ea00640 1 -- 172.21.15.32:0/3854788332 learned_addr learned my addr 172.21.15.32:0/3854788332 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:13.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f0667400640 1 --2- 172.21.15.32:0/3854788332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06680c5920 0x7f0668150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:13.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f0667e00640 1 --2- 172.21.15.32:0/3854788332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f066815bb20 0x7f06681fa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:13.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f065ea00640 1 -- 172.21.15.32:0/3854788332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06680c5920 msgr2=0x7f0668150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:13.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f065ea00640 1 --2- 172.21.15.32:0/3854788332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06680c5920 0x7f0668150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f065ea00640 1 -- 172.21.15.32:0/3854788332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f066815bb20 msgr2=0x7f06681fa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:13.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f065ea00640 1 --2- 172.21.15.32:0/3854788332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f066815bb20 0x7f06681fa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f065ea00640 1 -- 172.21.15.32:0/3854788332 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0668157380 con 0x7f06680cf460 2024-03-19T06:21:13.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f0667e00640 1 --2- 172.21.15.32:0/3854788332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f066815bb20 0x7f06681fa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:13.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f065ea00640 1 --2- 172.21.15.32:0/3854788332 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06680cf460 0x7f0668150fd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f065800e930 tx=0x7f065800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:13.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f065fe00640 1 -- 172.21.15.32:0/3854788332 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658017070 con 0x7f06680cf460 2024-03-19T06:21:13.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f065fe00640 1 -- 172.21.15.32:0/3854788332 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065800ca00 con 0x7f06680cf460 2024-03-19T06:21:13.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f066e200640 1 -- 172.21.15.32:0/3854788332 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06681575f0 con 0x7f06680cf460 2024-03-19T06:21:13.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f065fe00640 1 -- 172.21.15.32:0/3854788332 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065800cdb0 con 0x7f06680cf460 2024-03-19T06:21:13.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f066e200640 1 -- 172.21.15.32:0/3854788332 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0668157bb0 con 0x7f06680cf460 2024-03-19T06:21:13.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.728+0000 7f066e200640 1 -- 172.21.15.32:0/3854788332 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06680749e0 con 0x7f06680cf460 2024-03-19T06:21:13.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.732+0000 7f065fe00640 1 -- 172.21.15.32:0/3854788332 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f065801a070 con 0x7f06680cf460 2024-03-19T06:21:13.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.732+0000 7f065fe00640 1 --2- 172.21.15.32:0/3854788332 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0644067660 0x7f0644069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:13.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.732+0000 7f065fe00640 1 -- 172.21.15.32:0/3854788332 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0658085900 con 0x7f06680cf460 2024-03-19T06:21:13.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.732+0000 7f0667400640 1 --2- 172.21.15.32:0/3854788332 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0644067660 0x7f0644069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:13.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.732+0000 7f0667400640 1 --2- 172.21.15.32:0/3854788332 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0644067660 0x7f0644069b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f06500af000 tx=0x7f06500b6040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:13.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.736+0000 7f065fe00640 1 -- 172.21.15.32:0/3854788332 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f0658056640 con 0x7f06680cf460 2024-03-19T06:21:13.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.896+0000 7f066e200640 1 -- 172.21.15.32:0/3854788332 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06680b7810 con 0x7f0644067660 2024-03-19T06:21:13.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.904+0000 7f065fe00640 1 -- 172.21.15.32:0/3854788332 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251907 (secure 0 0 0) 0x7f06680b7810 con 0x7f0644067660 2024-03-19T06:21:13.899 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:13.900 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:21:13.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.908+0000 7f066e200640 1 -- 172.21.15.32:0/3854788332 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0644067660 msgr2=0x7f0644069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:13.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.908+0000 7f066e200640 1 --2- 172.21.15.32:0/3854788332 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0644067660 0x7f0644069b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f06500af000 tx=0x7f06500b6040 comp rx=0 tx=0).stop 2024-03-19T06:21:13.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.908+0000 7f066e200640 1 -- 172.21.15.32:0/3854788332 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06680cf460 msgr2=0x7f0668150fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:13.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.908+0000 7f066e200640 1 --2- 172.21.15.32:0/3854788332 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06680cf460 0x7f0668150fd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f065800e930 tx=0x7f065800edf0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.908+0000 7f066e200640 1 -- 172.21.15.32:0/3854788332 shutdown_connections 2024-03-19T06:21:13.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.908+0000 7f066e200640 1 --2- 172.21.15.32:0/3854788332 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0644067660 0x7f0644069b20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.908+0000 7f066e200640 1 --2- 172.21.15.32:0/3854788332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f066815bb20 0x7f06681fa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.908+0000 7f066e200640 1 --2- 172.21.15.32:0/3854788332 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06680cf460 0x7f0668150fd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.908+0000 7f066e200640 1 --2- 172.21.15.32:0/3854788332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06680c5920 0x7f0668150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:13.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.908+0000 7f066e200640 1 -- 172.21.15.32:0/3854788332 >> 172.21.15.32:0/3854788332 conn(0x7f06680d1890 msgr2=0x7f0668155d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:13.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.908+0000 7f066e200640 1 -- 172.21.15.32:0/3854788332 shutdown_connections 2024-03-19T06:21:13.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:13.908+0000 7f066e200640 1 -- 172.21.15.32:0/3854788332 wait complete. 2024-03-19T06:21:13.919 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-19T06:21:11.921175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235684,"kb_used_data":2868,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739036,"statfs":{"total":773094113280,"available":772852772864,"internally_reserved":0,"allocated":2936832,"data_stored":1756320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.516713"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439338+0000","last_change":"2024-03-19T06:21:09.452313+0000","last_active":"2024-03-19T06:21:10.439338+0000","last_peered":"2024-03-19T06:21:10.439338+0000","last_clean":"2024-03-19T06:21:10.439338+0000","last_became_active":"2024-03-19T06:21:09.452026+0000","last_became_peered":"2024-03-19T06:21:09.452026+0000","last_unstale":"2024-03-19T06:21:10.439338+0000","last_undegraded":"2024-03-19T06:21:10.439338+0000","last_fullsized":"2024-03-19T06:21:10.439338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:42.199087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431525+0000","last_change":"2024-03-19T06:21:09.451446+0000","last_active":"2024-03-19T06:21:10.431525+0000","last_peered":"2024-03-19T06:21:10.431525+0000","last_clean":"2024-03-19T06:21:10.431525+0000","last_became_active":"2024-03-19T06:21:09.451150+0000","last_became_peered":"2024-03-19T06:21:09.451150+0000","last_unstale":"2024-03-19T06:21:10.431525+0000","last_undegraded":"2024-03-19T06:21:10.431525+0000","last_fullsized":"2024-03-19T06:21:10.431525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:10:38.991785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.458567+0000","last_change":"2024-03-19T06:21:09.456587+0000","last_active":"2024-03-19T06:21:09.458567+0000","last_peered":"2024-03-19T06:21:09.458567+0000","last_clean":"2024-03-19T06:21:09.458567+0000","last_became_active":"2024-03-19T06:21:09.454920+0000","last_became_peered":"2024-03-19T06:21:09.454920+0000","last_unstale":"2024-03-19T06:21:09.458567+0000","last_undegraded":"2024-03-19T06:21:09.458567+0000","last_fullsized":"2024-03-19T06:21:09.458567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:28:35.542944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438703+0000","last_change":"2024-03-19T06:21:09.440118+0000","last_active":"2024-03-19T06:21:10.438703+0000","last_peered":"2024-03-19T06:21:10.438703+0000","last_clean":"2024-03-19T06:21:10.438703+0000","last_became_active":"2024-03-19T06:21:09.434539+0000","last_became_peered":"2024-03-19T06:21:09.434539+0000","last_unstale":"2024-03-19T06:21:10.438703+0000","last_undegraded":"2024-03-19T06:21:10.438703+0000","last_fullsized":"2024-03-19T06:21:10.438703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:05:23.173353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438953+0000","last_change":"2024-03-19T06:21:09.443312+0000","last_active":"2024-03-19T06:21:10.438953+0000","last_peered":"2024-03-19T06:21:10.438953+0000","last_clean":"2024-03-19T06:21:10.438953+0000","last_became_active":"2024-03-19T06:21:09.442978+0000","last_became_peered":"2024-03-19T06:21:09.442978+0000","last_unstale":"2024-03-19T06:21:10.438953+0000","last_undegraded":"2024-03-19T06:21:10.438953+0000","last_fullsized":"2024-03-19T06:21:10.438953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:39:52.224305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437914+0000","last_change":"2024-03-19T06:21:09.450442+0000","last_active":"2024-03-19T06:21:10.437914+0000","last_peered":"2024-03-19T06:21:10.437914+0000","last_clean":"2024-03-19T06:21:10.437914+0000","last_became_active":"2024-03-19T06:21:09.450149+0000","last_became_peered":"2024-03-19T06:21:09.450149+0000","last_unstale":"2024-03-19T06:21:10.437914+0000","last_undegraded":"2024-03-19T06:21:10.437914+0000","last_fullsized":"2024-03-19T06:21:10.437914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:54:53.443608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438253+0000","last_change":"2024-03-19T06:21:09.450859+0000","last_active":"2024-03-19T06:21:10.438253+0000","last_peered":"2024-03-19T06:21:10.438253+0000","last_clean":"2024-03-19T06:21:10.438253+0000","last_became_active":"2024-03-19T06:21:09.450658+0000","last_became_peered":"2024-03-19T06:21:09.450658+0000","last_unstale":"2024-03-19T06:21:10.438253+0000","last_undegraded":"2024-03-19T06:21:10.438253+0000","last_fullsized":"2024-03-19T06:21:10.438253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:05:23.173353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.447936+0000","last_change":"2024-03-19T06:21:09.445477+0000","last_active":"2024-03-19T06:21:09.447936+0000","last_peered":"2024-03-19T06:21:09.447936+0000","last_clean":"2024-03-19T06:21:09.447936+0000","last_became_active":"2024-03-19T06:21:09.445221+0000","last_became_peered":"2024-03-19T06:21:09.445221+0000","last_unstale":"2024-03-19T06:21:09.447936+0000","last_undegraded":"2024-03-19T06:21:09.447936+0000","last_fullsized":"2024-03-19T06:21:09.447936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:27:33.554426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439471+0000","last_change":"2024-03-19T06:21:09.450867+0000","last_active":"2024-03-19T06:21:10.439471+0000","last_peered":"2024-03-19T06:21:10.439471+0000","last_clean":"2024-03-19T06:21:10.439471+0000","last_became_active":"2024-03-19T06:21:09.449220+0000","last_became_peered":"2024-03-19T06:21:09.449220+0000","last_unstale":"2024-03-19T06:21:10.439471+0000","last_undegraded":"2024-03-19T06:21:10.439471+0000","last_fullsized":"2024-03-19T06:21:10.439471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:33:35.251645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.449987+0000","last_change":"2024-03-19T06:21:09.446487+0000","last_active":"2024-03-19T06:21:09.449987+0000","last_peered":"2024-03-19T06:21:09.449987+0000","last_clean":"2024-03-19T06:21:09.449987+0000","last_became_active":"2024-03-19T06:21:09.445934+0000","last_became_peered":"2024-03-19T06:21:09.445934+0000","last_unstale":"2024-03-19T06:21:09.449987+0000","last_undegraded":"2024-03-19T06:21:09.449987+0000","last_fullsized":"2024-03-19T06:21:09.449987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:28:35.542944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.450163+0000","last_change":"2024-03-19T06:21:09.446685+0000","last_active":"2024-03-19T06:21:09.450163+0000","last_peered":"2024-03-19T06:21:09.450163+0000","last_clean":"2024-03-19T06:21:09.450163+0000","last_became_active":"2024-03-19T06:21:09.446022+0000","last_became_peered":"2024-03-19T06:21:09.446022+0000","last_unstale":"2024-03-19T06:21:09.450163+0000","last_undegraded":"2024-03-19T06:21:09.450163+0000","last_fullsized":"2024-03-19T06:21:09.450163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:55:31.037416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.440335+0000","last_change":"2024-03-19T06:21:09.434969+0000","last_active":"2024-03-19T06:21:09.440335+0000","last_peered":"2024-03-19T06:21:09.440335+0000","last_clean":"2024-03-19T06:21:09.440335+0000","last_became_active":"2024-03-19T06:21:09.434675+0000","last_became_peered":"2024-03-19T06:21:09.434675+0000","last_unstale":"2024-03-19T06:21:09.440335+0000","last_undegraded":"2024-03-19T06:21:09.440335+0000","last_fullsized":"2024-03-19T06:21:09.440335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:18:07.111674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.442034+0000","last_change":"2024-03-19T06:21:09.434060+0000","last_active":"2024-03-19T06:21:09.442034+0000","last_peered":"2024-03-19T06:21:09.442034+0000","last_clean":"2024-03-19T06:21:09.442034+0000","last_became_active":"2024-03-19T06:21:09.433679+0000","last_became_peered":"2024-03-19T06:21:09.433679+0000","last_unstale":"2024-03-19T06:21:09.442034+0000","last_undegraded":"2024-03-19T06:21:09.442034+0000","last_fullsized":"2024-03-19T06:21:09.442034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:34:32.017603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456364+0000","last_change":"2024-03-19T06:21:09.447522+0000","last_active":"2024-03-19T06:21:09.456364+0000","last_peered":"2024-03-19T06:21:09.456364+0000","last_clean":"2024-03-19T06:21:09.456364+0000","last_became_active":"2024-03-19T06:21:09.447175+0000","last_became_peered":"2024-03-19T06:21:09.447175+0000","last_unstale":"2024-03-19T06:21:09.456364+0000","last_undegraded":"2024-03-19T06:21:09.456364+0000","last_fullsized":"2024-03-19T06:21:09.456364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:32:25.197980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431070+0000","last_change":"2024-03-19T06:21:09.424398+0000","last_active":"2024-03-19T06:21:10.431070+0000","last_peered":"2024-03-19T06:21:10.431070+0000","last_clean":"2024-03-19T06:21:10.431070+0000","last_became_active":"2024-03-19T06:21:09.424002+0000","last_became_peered":"2024-03-19T06:21:09.424002+0000","last_unstale":"2024-03-19T06:21:10.431070+0000","last_undegraded":"2024-03-19T06:21:10.431070+0000","last_fullsized":"2024-03-19T06:21:10.431070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:33:13.994451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437639+0000","last_change":"2024-03-19T06:21:09.451772+0000","last_active":"2024-03-19T06:21:10.437639+0000","last_peered":"2024-03-19T06:21:10.437639+0000","last_clean":"2024-03-19T06:21:10.437639+0000","last_became_active":"2024-03-19T06:21:09.451466+0000","last_became_peered":"2024-03-19T06:21:09.451466+0000","last_unstale":"2024-03-19T06:21:10.437639+0000","last_undegraded":"2024-03-19T06:21:10.437639+0000","last_fullsized":"2024-03-19T06:21:10.437639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:06.036992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439498+0000","last_change":"2024-03-19T06:21:09.447850+0000","last_active":"2024-03-19T06:21:10.439498+0000","last_peered":"2024-03-19T06:21:10.439498+0000","last_clean":"2024-03-19T06:21:10.439498+0000","last_became_active":"2024-03-19T06:21:09.446058+0000","last_became_peered":"2024-03-19T06:21:09.446058+0000","last_unstale":"2024-03-19T06:21:10.439498+0000","last_undegraded":"2024-03-19T06:21:10.439498+0000","last_fullsized":"2024-03-19T06:21:10.439498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:42.199087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.437668+0000","last_change":"2024-03-19T06:21:09.435147+0000","last_active":"2024-03-19T06:21:09.437668+0000","last_peered":"2024-03-19T06:21:09.437668+0000","last_clean":"2024-03-19T06:21:09.437668+0000","last_became_active":"2024-03-19T06:21:09.434845+0000","last_became_peered":"2024-03-19T06:21:09.434845+0000","last_unstale":"2024-03-19T06:21:09.437668+0000","last_undegraded":"2024-03-19T06:21:09.437668+0000","last_fullsized":"2024-03-19T06:21:09.437668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:23.154581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438335+0000","last_change":"2024-03-19T06:21:09.452917+0000","last_active":"2024-03-19T06:21:10.438335+0000","last_peered":"2024-03-19T06:21:10.438335+0000","last_clean":"2024-03-19T06:21:10.438335+0000","last_became_active":"2024-03-19T06:21:09.452649+0000","last_became_peered":"2024-03-19T06:21:09.452649+0000","last_unstale":"2024-03-19T06:21:10.438335+0000","last_undegraded":"2024-03-19T06:21:10.438335+0000","last_fullsized":"2024-03-19T06:21:10.438335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:21:16.347465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.448620+0000","last_change":"2024-03-19T06:21:09.441874+0000","last_active":"2024-03-19T06:21:09.448620+0000","last_peered":"2024-03-19T06:21:09.448620+0000","last_clean":"2024-03-19T06:21:09.448620+0000","last_became_active":"2024-03-19T06:21:09.441614+0000","last_became_peered":"2024-03-19T06:21:09.441614+0000","last_unstale":"2024-03-19T06:21:09.448620+0000","last_undegraded":"2024-03-19T06:21:09.448620+0000","last_fullsized":"2024-03-19T06:21:09.448620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:17:40.182730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456392+0000","last_change":"2024-03-19T06:21:09.442717+0000","last_active":"2024-03-19T06:21:09.456392+0000","last_peered":"2024-03-19T06:21:09.456392+0000","last_clean":"2024-03-19T06:21:09.456392+0000","last_became_active":"2024-03-19T06:21:09.441979+0000","last_became_peered":"2024-03-19T06:21:09.441979+0000","last_unstale":"2024-03-19T06:21:09.456392+0000","last_undegraded":"2024-03-19T06:21:09.456392+0000","last_fullsized":"2024-03-19T06:21:09.456392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:57.281722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438065+0000","last_change":"2024-03-19T06:21:09.444519+0000","last_active":"2024-03-19T06:21:10.438065+0000","last_peered":"2024-03-19T06:21:10.438065+0000","last_clean":"2024-03-19T06:21:10.438065+0000","last_became_active":"2024-03-19T06:21:09.444304+0000","last_became_peered":"2024-03-19T06:21:09.444304+0000","last_unstale":"2024-03-19T06:21:10.438065+0000","last_undegraded":"2024-03-19T06:21:10.438065+0000","last_fullsized":"2024-03-19T06:21:10.438065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:29:55.294290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.443682+0000","last_change":"2024-03-19T06:21:09.439225+0000","last_active":"2024-03-19T06:21:09.443682+0000","last_peered":"2024-03-19T06:21:09.443682+0000","last_clean":"2024-03-19T06:21:09.443682+0000","last_became_active":"2024-03-19T06:21:09.437400+0000","last_became_peered":"2024-03-19T06:21:09.437400+0000","last_unstale":"2024-03-19T06:21:09.443682+0000","last_undegraded":"2024-03-19T06:21:09.443682+0000","last_fullsized":"2024-03-19T06:21:09.443682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:04:20.539454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437740+0000","last_change":"2024-03-19T06:21:09.438758+0000","last_active":"2024-03-19T06:21:10.437740+0000","last_peered":"2024-03-19T06:21:10.437740+0000","last_clean":"2024-03-19T06:21:10.437740+0000","last_became_active":"2024-03-19T06:21:09.438493+0000","last_became_peered":"2024-03-19T06:21:09.438493+0000","last_unstale":"2024-03-19T06:21:10.437740+0000","last_undegraded":"2024-03-19T06:21:10.437740+0000","last_fullsized":"2024-03-19T06:21:10.437740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:10:38.991785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.444543+0000","last_change":"2024-03-19T06:21:09.442133+0000","last_active":"2024-03-19T06:21:09.444543+0000","last_peered":"2024-03-19T06:21:09.444543+0000","last_clean":"2024-03-19T06:21:09.444543+0000","last_became_active":"2024-03-19T06:21:09.438450+0000","last_became_peered":"2024-03-19T06:21:09.438450+0000","last_unstale":"2024-03-19T06:21:09.444543+0000","last_undegraded":"2024-03-19T06:21:09.444543+0000","last_fullsized":"2024-03-19T06:21:09.444543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:10:44.620921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.460629+0000","last_change":"2024-03-19T06:21:09.452119+0000","last_active":"2024-03-19T06:21:09.460629+0000","last_peered":"2024-03-19T06:21:09.460629+0000","last_clean":"2024-03-19T06:21:09.460629+0000","last_became_active":"2024-03-19T06:21:09.446514+0000","last_became_peered":"2024-03-19T06:21:09.446514+0000","last_unstale":"2024-03-19T06:21:09.460629+0000","last_undegraded":"2024-03-19T06:21:09.460629+0000","last_fullsized":"2024-03-19T06:21:09.460629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:30:08.169277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431419+0000","last_change":"2024-03-19T06:21:09.431512+0000","last_active":"2024-03-19T06:21:10.431419+0000","last_peered":"2024-03-19T06:21:10.431419+0000","last_clean":"2024-03-19T06:21:10.431419+0000","last_became_active":"2024-03-19T06:21:09.431222+0000","last_became_peered":"2024-03-19T06:21:09.431222+0000","last_unstale":"2024-03-19T06:21:10.431419+0000","last_undegraded":"2024-03-19T06:21:10.431419+0000","last_fullsized":"2024-03-19T06:21:10.431419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:06.036992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.443069+0000","last_change":"2024-03-19T06:21:09.439110+0000","last_active":"2024-03-19T06:21:09.443069+0000","last_peered":"2024-03-19T06:21:09.443069+0000","last_clean":"2024-03-19T06:21:09.443069+0000","last_became_active":"2024-03-19T06:21:09.437439+0000","last_became_peered":"2024-03-19T06:21:09.437439+0000","last_unstale":"2024-03-19T06:21:09.443069+0000","last_undegraded":"2024-03-19T06:21:09.443069+0000","last_fullsized":"2024-03-19T06:21:09.443069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:41:23.004327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456372+0000","last_change":"2024-03-19T06:21:09.442438+0000","last_active":"2024-03-19T06:21:09.456372+0000","last_peered":"2024-03-19T06:21:09.456372+0000","last_clean":"2024-03-19T06:21:09.456372+0000","last_became_active":"2024-03-19T06:21:09.441595+0000","last_became_peered":"2024-03-19T06:21:09.441595+0000","last_unstale":"2024-03-19T06:21:09.456372+0000","last_undegraded":"2024-03-19T06:21:09.456372+0000","last_fullsized":"2024-03-19T06:21:09.456372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:12:56.208388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438209+0000","last_change":"2024-03-19T06:21:09.445182+0000","last_active":"2024-03-19T06:21:10.438209+0000","last_peered":"2024-03-19T06:21:10.438209+0000","last_clean":"2024-03-19T06:21:10.438209+0000","last_became_active":"2024-03-19T06:21:09.442331+0000","last_became_peered":"2024-03-19T06:21:09.442331+0000","last_unstale":"2024-03-19T06:21:10.438209+0000","last_undegraded":"2024-03-19T06:21:10.438209+0000","last_fullsized":"2024-03-19T06:21:10.438209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:20.797571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.437414+0000","last_change":"2024-03-19T06:21:09.432846+0000","last_active":"2024-03-19T06:21:09.437414+0000","last_peered":"2024-03-19T06:21:09.437414+0000","last_clean":"2024-03-19T06:21:09.437414+0000","last_became_active":"2024-03-19T06:21:09.432568+0000","last_became_peered":"2024-03-19T06:21:09.432568+0000","last_unstale":"2024-03-19T06:21:09.437414+0000","last_undegraded":"2024-03-19T06:21:09.437414+0000","last_fullsized":"2024-03-19T06:21:09.437414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:32:25.197980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.460721+0000","last_change":"2024-03-19T06:21:09.455461+0000","last_active":"2024-03-19T06:21:09.460721+0000","last_peered":"2024-03-19T06:21:09.460721+0000","last_clean":"2024-03-19T06:21:09.460721+0000","last_became_active":"2024-03-19T06:21:09.452616+0000","last_became_peered":"2024-03-19T06:21:09.452616+0000","last_unstale":"2024-03-19T06:21:09.460721+0000","last_undegraded":"2024-03-19T06:21:09.460721+0000","last_fullsized":"2024-03-19T06:21:09.460721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:54:33.924115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.436125+0000","last_change":"2024-03-19T06:21:09.429726+0000","last_active":"2024-03-19T06:21:09.436125+0000","last_peered":"2024-03-19T06:21:09.436125+0000","last_clean":"2024-03-19T06:21:09.436125+0000","last_became_active":"2024-03-19T06:21:09.428690+0000","last_became_peered":"2024-03-19T06:21:09.428690+0000","last_unstale":"2024-03-19T06:21:09.436125+0000","last_undegraded":"2024-03-19T06:21:09.436125+0000","last_fullsized":"2024-03-19T06:21:09.436125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:44:51.397622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.457792+0000","last_change":"2024-03-19T06:21:08.435558+0000","last_active":"2024-03-19T06:21:09.457792+0000","last_peered":"2024-03-19T06:21:09.457792+0000","last_clean":"2024-03-19T06:21:09.457792+0000","last_became_active":"2024-03-19T06:21:08.435230+0000","last_became_peered":"2024-03-19T06:21:08.435230+0000","last_unstale":"2024-03-19T06:21:09.457792+0000","last_undegraded":"2024-03-19T06:21:09.457792+0000","last_fullsized":"2024-03-19T06:21:09.457792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:57:49.073834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456545+0000","last_change":"2024-03-19T06:21:09.449204+0000","last_active":"2024-03-19T06:21:09.456545+0000","last_peered":"2024-03-19T06:21:09.456545+0000","last_clean":"2024-03-19T06:21:09.456545+0000","last_became_active":"2024-03-19T06:21:09.448927+0000","last_became_peered":"2024-03-19T06:21:09.448927+0000","last_unstale":"2024-03-19T06:21:09.456545+0000","last_undegraded":"2024-03-19T06:21:09.456545+0000","last_fullsized":"2024-03-19T06:21:09.456545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:42.809555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.460691+0000","last_change":"2024-03-19T06:21:08.439097+0000","last_active":"2024-03-19T06:21:09.460691+0000","last_peered":"2024-03-19T06:21:09.460691+0000","last_clean":"2024-03-19T06:21:09.460691+0000","last_became_active":"2024-03-19T06:21:08.438783+0000","last_became_peered":"2024-03-19T06:21:08.438783+0000","last_unstale":"2024-03-19T06:21:09.460691+0000","last_undegraded":"2024-03-19T06:21:09.460691+0000","last_fullsized":"2024-03-19T06:21:09.460691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:37.056055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.428090+0000","last_change":"2024-03-19T06:21:08.427804+0000","last_active":"2024-03-19T06:21:09.428090+0000","last_peered":"2024-03-19T06:21:09.428090+0000","last_clean":"2024-03-19T06:21:09.428090+0000","last_became_active":"2024-03-19T06:21:08.427129+0000","last_became_peered":"2024-03-19T06:21:08.427129+0000","last_unstale":"2024-03-19T06:21:09.428090+0000","last_undegraded":"2024-03-19T06:21:09.428090+0000","last_fullsized":"2024-03-19T06:21:09.428090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:13:25.373226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.451746+0000","last_change":"2024-03-19T06:21:09.449579+0000","last_active":"2024-03-19T06:21:09.451746+0000","last_peered":"2024-03-19T06:21:09.451746+0000","last_clean":"2024-03-19T06:21:09.451746+0000","last_became_active":"2024-03-19T06:21:09.448892+0000","last_became_peered":"2024-03-19T06:21:09.448892+0000","last_unstale":"2024-03-19T06:21:09.451746+0000","last_undegraded":"2024-03-19T06:21:09.451746+0000","last_fullsized":"2024-03-19T06:21:09.451746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:51:33.332224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437736+0000","last_change":"2024-03-19T06:21:08.441838+0000","last_active":"2024-03-19T06:21:10.437736+0000","last_peered":"2024-03-19T06:21:10.437736+0000","last_clean":"2024-03-19T06:21:10.437736+0000","last_became_active":"2024-03-19T06:21:08.441169+0000","last_became_peered":"2024-03-19T06:21:08.441169+0000","last_unstale":"2024-03-19T06:21:10.437736+0000","last_undegraded":"2024-03-19T06:21:10.437736+0000","last_fullsized":"2024-03-19T06:21:10.437736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:32:24.190836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431070+0000","last_change":"2024-03-19T06:21:09.430021+0000","last_active":"2024-03-19T06:21:10.431070+0000","last_peered":"2024-03-19T06:21:10.431070+0000","last_clean":"2024-03-19T06:21:10.431070+0000","last_became_active":"2024-03-19T06:21:09.429679+0000","last_became_peered":"2024-03-19T06:21:09.429679+0000","last_unstale":"2024-03-19T06:21:10.431070+0000","last_undegraded":"2024-03-19T06:21:10.431070+0000","last_fullsized":"2024-03-19T06:21:10.431070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:55.809405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.426899+0000","last_change":"2024-03-19T06:21:08.447659+0000","last_active":"2024-03-19T06:21:09.426899+0000","last_peered":"2024-03-19T06:21:09.426899+0000","last_clean":"2024-03-19T06:21:09.426899+0000","last_became_active":"2024-03-19T06:21:08.447310+0000","last_became_peered":"2024-03-19T06:21:08.447310+0000","last_unstale":"2024-03-19T06:21:09.426899+0000","last_undegraded":"2024-03-19T06:21:09.426899+0000","last_fullsized":"2024-03-19T06:21:09.426899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:22.147438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439182+0000","last_change":"2024-03-19T06:21:09.445774+0000","last_active":"2024-03-19T06:21:10.439182+0000","last_peered":"2024-03-19T06:21:10.439182+0000","last_clean":"2024-03-19T06:21:10.439182+0000","last_became_active":"2024-03-19T06:21:09.445517+0000","last_became_peered":"2024-03-19T06:21:09.445517+0000","last_unstale":"2024-03-19T06:21:10.439182+0000","last_undegraded":"2024-03-19T06:21:10.439182+0000","last_fullsized":"2024-03-19T06:21:10.439182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:14:58.974751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439282+0000","last_change":"2024-03-19T06:21:08.447265+0000","last_active":"2024-03-19T06:21:10.439282+0000","last_peered":"2024-03-19T06:21:10.439282+0000","last_clean":"2024-03-19T06:21:10.439282+0000","last_became_active":"2024-03-19T06:21:08.447009+0000","last_became_peered":"2024-03-19T06:21:08.447009+0000","last_unstale":"2024-03-19T06:21:10.439282+0000","last_undegraded":"2024-03-19T06:21:10.439282+0000","last_fullsized":"2024-03-19T06:21:10.439282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:22.147438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456976+0000","last_change":"2024-03-19T06:21:09.453099+0000","last_active":"2024-03-19T06:21:09.456976+0000","last_peered":"2024-03-19T06:21:09.456976+0000","last_clean":"2024-03-19T06:21:09.456976+0000","last_became_active":"2024-03-19T06:21:09.448991+0000","last_became_peered":"2024-03-19T06:21:09.448991+0000","last_unstale":"2024-03-19T06:21:09.456976+0000","last_undegraded":"2024-03-19T06:21:09.456976+0000","last_fullsized":"2024-03-19T06:21:09.456976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:27:52.195605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431373+0000","last_change":"2024-03-19T06:21:08.439829+0000","last_active":"2024-03-19T06:21:10.431373+0000","last_peered":"2024-03-19T06:21:10.431373+0000","last_clean":"2024-03-19T06:21:10.431373+0000","last_became_active":"2024-03-19T06:21:08.439454+0000","last_became_peered":"2024-03-19T06:21:08.439454+0000","last_unstale":"2024-03-19T06:21:10.431373+0000","last_undegraded":"2024-03-19T06:21:10.431373+0000","last_fullsized":"2024-03-19T06:21:10.431373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:41.802412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.454857+0000","last_change":"2024-03-19T06:21:09.449268+0000","last_active":"2024-03-19T06:21:09.454857+0000","last_peered":"2024-03-19T06:21:09.454857+0000","last_clean":"2024-03-19T06:21:09.454857+0000","last_became_active":"2024-03-19T06:21:09.448827+0000","last_became_peered":"2024-03-19T06:21:09.448827+0000","last_unstale":"2024-03-19T06:21:09.454857+0000","last_undegraded":"2024-03-19T06:21:09.454857+0000","last_fullsized":"2024-03-19T06:21:09.454857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:13:26.380370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.464548+0000","last_change":"2024-03-19T06:21:08.445760+0000","last_active":"2024-03-19T06:21:09.464548+0000","last_peered":"2024-03-19T06:21:09.464548+0000","last_clean":"2024-03-19T06:21:09.464548+0000","last_became_active":"2024-03-19T06:21:08.445560+0000","last_became_peered":"2024-03-19T06:21:08.445560+0000","last_unstale":"2024-03-19T06:21:09.464548+0000","last_undegraded":"2024-03-19T06:21:09.464548+0000","last_fullsized":"2024-03-19T06:21:09.464548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:32:24.190836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438055+0000","last_change":"2024-03-19T06:21:09.447310+0000","last_active":"2024-03-19T06:21:10.438055+0000","last_peered":"2024-03-19T06:21:10.438055+0000","last_clean":"2024-03-19T06:21:10.438055+0000","last_became_active":"2024-03-19T06:21:09.446811+0000","last_became_peered":"2024-03-19T06:21:09.446811+0000","last_unstale":"2024-03-19T06:21:10.438055+0000","last_undegraded":"2024-03-19T06:21:10.438055+0000","last_fullsized":"2024-03-19T06:21:10.438055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:29:55.294290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456897+0000","last_change":"2024-03-19T06:21:08.437505+0000","last_active":"2024-03-19T06:21:09.456897+0000","last_peered":"2024-03-19T06:21:09.456897+0000","last_clean":"2024-03-19T06:21:09.456897+0000","last_became_active":"2024-03-19T06:21:08.437190+0000","last_became_peered":"2024-03-19T06:21:08.437190+0000","last_unstale":"2024-03-19T06:21:09.456897+0000","last_undegraded":"2024-03-19T06:21:09.456897+0000","last_fullsized":"2024-03-19T06:21:09.456897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:53:34.745415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456086+0000","last_change":"2024-03-19T06:21:09.447509+0000","last_active":"2024-03-19T06:21:09.456086+0000","last_peered":"2024-03-19T06:21:09.456086+0000","last_clean":"2024-03-19T06:21:09.456086+0000","last_became_active":"2024-03-19T06:21:09.447154+0000","last_became_peered":"2024-03-19T06:21:09.447154+0000","last_unstale":"2024-03-19T06:21:09.456086+0000","last_undegraded":"2024-03-19T06:21:09.456086+0000","last_fullsized":"2024-03-19T06:21:09.456086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:38.063198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438312+0000","last_change":"2024-03-19T06:21:08.440830+0000","last_active":"2024-03-19T06:21:10.438312+0000","last_peered":"2024-03-19T06:21:10.438312+0000","last_clean":"2024-03-19T06:21:10.438312+0000","last_became_active":"2024-03-19T06:21:08.439995+0000","last_became_peered":"2024-03-19T06:21:08.439995+0000","last_unstale":"2024-03-19T06:21:10.438312+0000","last_undegraded":"2024-03-19T06:21:10.438312+0000","last_fullsized":"2024-03-19T06:21:10.438312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:56.274578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439288+0000","last_change":"2024-03-19T06:21:09.442975+0000","last_active":"2024-03-19T06:21:10.439288+0000","last_peered":"2024-03-19T06:21:10.439288+0000","last_clean":"2024-03-19T06:21:10.439288+0000","last_became_active":"2024-03-19T06:21:09.442638+0000","last_became_peered":"2024-03-19T06:21:09.442638+0000","last_unstale":"2024-03-19T06:21:10.439288+0000","last_undegraded":"2024-03-19T06:21:10.439288+0000","last_fullsized":"2024-03-19T06:21:10.439288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:14:58.974751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.424683+0000","last_change":"2024-03-19T06:21:08.439829+0000","last_active":"2024-03-19T06:21:09.424683+0000","last_peered":"2024-03-19T06:21:09.424683+0000","last_clean":"2024-03-19T06:21:09.424683+0000","last_became_active":"2024-03-19T06:21:08.439524+0000","last_became_peered":"2024-03-19T06:21:08.439524+0000","last_unstale":"2024-03-19T06:21:09.424683+0000","last_undegraded":"2024-03-19T06:21:09.424683+0000","last_fullsized":"2024-03-19T06:21:09.424683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:56.274578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.460641+0000","last_change":"2024-03-19T06:21:09.454721+0000","last_active":"2024-03-19T06:21:09.460641+0000","last_peered":"2024-03-19T06:21:09.460641+0000","last_clean":"2024-03-19T06:21:09.460641+0000","last_became_active":"2024-03-19T06:21:09.451915+0000","last_became_peered":"2024-03-19T06:21:09.451915+0000","last_unstale":"2024-03-19T06:21:09.460641+0000","last_undegraded":"2024-03-19T06:21:09.460641+0000","last_fullsized":"2024-03-19T06:21:09.460641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:15:19.406708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.461949+0000","last_change":"2024-03-19T06:21:08.434264+0000","last_active":"2024-03-19T06:21:09.461949+0000","last_peered":"2024-03-19T06:21:09.461949+0000","last_clean":"2024-03-19T06:21:09.461949+0000","last_became_active":"2024-03-19T06:21:08.433960+0000","last_became_peered":"2024-03-19T06:21:08.433960+0000","last_unstale":"2024-03-19T06:21:09.461949+0000","last_undegraded":"2024-03-19T06:21:09.461949+0000","last_fullsized":"2024-03-19T06:21:09.461949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:14:50.420085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438491+0000","last_change":"2024-03-19T06:21:09.444684+0000","last_active":"2024-03-19T06:21:10.438491+0000","last_peered":"2024-03-19T06:21:10.438491+0000","last_clean":"2024-03-19T06:21:10.438491+0000","last_became_active":"2024-03-19T06:21:09.444451+0000","last_became_peered":"2024-03-19T06:21:09.444451+0000","last_unstale":"2024-03-19T06:21:10.438491+0000","last_undegraded":"2024-03-19T06:21:10.438491+0000","last_fullsized":"2024-03-19T06:21:10.438491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:42:31.622101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.458886+0000","last_change":"2024-03-19T06:21:08.437032+0000","last_active":"2024-03-19T06:21:09.458886+0000","last_peered":"2024-03-19T06:21:09.458886+0000","last_clean":"2024-03-19T06:21:09.458886+0000","last_became_active":"2024-03-19T06:21:08.436518+0000","last_became_peered":"2024-03-19T06:21:08.436518+0000","last_unstale":"2024-03-19T06:21:09.458886+0000","last_undegraded":"2024-03-19T06:21:09.458886+0000","last_fullsized":"2024-03-19T06:21:09.458886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:37:38.410985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438943+0000","last_change":"2024-03-19T06:21:09.454018+0000","last_active":"2024-03-19T06:21:10.438943+0000","last_peered":"2024-03-19T06:21:10.438943+0000","last_clean":"2024-03-19T06:21:10.438943+0000","last_became_active":"2024-03-19T06:21:09.453715+0000","last_became_peered":"2024-03-19T06:21:09.453715+0000","last_unstale":"2024-03-19T06:21:10.438943+0000","last_undegraded":"2024-03-19T06:21:10.438943+0000","last_fullsized":"2024-03-19T06:21:10.438943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:08:07.201487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.452446+0000","last_change":"2024-03-19T06:21:08.426349+0000","last_active":"2024-03-19T06:21:09.452446+0000","last_peered":"2024-03-19T06:21:09.452446+0000","last_clean":"2024-03-19T06:21:09.452446+0000","last_became_active":"2024-03-19T06:21:08.426057+0000","last_became_peered":"2024-03-19T06:21:08.426057+0000","last_unstale":"2024-03-19T06:21:09.452446+0000","last_undegraded":"2024-03-19T06:21:09.452446+0000","last_fullsized":"2024-03-19T06:21:09.452446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:56.274578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439569+0000","last_change":"2024-03-19T06:21:09.453273+0000","last_active":"2024-03-19T06:21:10.439569+0000","last_peered":"2024-03-19T06:21:10.439569+0000","last_clean":"2024-03-19T06:21:10.439569+0000","last_became_active":"2024-03-19T06:21:09.453008+0000","last_became_peered":"2024-03-19T06:21:09.453008+0000","last_unstale":"2024-03-19T06:21:10.439569+0000","last_undegraded":"2024-03-19T06:21:10.439569+0000","last_fullsized":"2024-03-19T06:21:10.439569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:06:46.783271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431445+0000","last_change":"2024-03-19T06:21:08.436955+0000","last_active":"2024-03-19T06:21:10.431445+0000","last_peered":"2024-03-19T06:21:10.431445+0000","last_clean":"2024-03-19T06:21:10.431445+0000","last_became_active":"2024-03-19T06:21:08.436695+0000","last_became_peered":"2024-03-19T06:21:08.436695+0000","last_unstale":"2024-03-19T06:21:10.431445+0000","last_undegraded":"2024-03-19T06:21:10.431445+0000","last_fullsized":"2024-03-19T06:21:10.431445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:27:51.188461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438972+0000","last_change":"2024-03-19T06:21:09.440792+0000","last_active":"2024-03-19T06:21:10.438972+0000","last_peered":"2024-03-19T06:21:10.438972+0000","last_clean":"2024-03-19T06:21:10.438972+0000","last_became_active":"2024-03-19T06:21:09.433674+0000","last_became_peered":"2024-03-19T06:21:09.433674+0000","last_unstale":"2024-03-19T06:21:10.438972+0000","last_undegraded":"2024-03-19T06:21:10.438972+0000","last_fullsized":"2024-03-19T06:21:10.438972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:08:07.201487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.425290+0000","last_change":"2024-03-19T06:21:08.437235+0000","last_active":"2024-03-19T06:21:09.425290+0000","last_peered":"2024-03-19T06:21:09.425290+0000","last_clean":"2024-03-19T06:21:09.425290+0000","last_became_active":"2024-03-19T06:21:08.436874+0000","last_became_peered":"2024-03-19T06:21:08.436874+0000","last_unstale":"2024-03-19T06:21:09.425290+0000","last_undegraded":"2024-03-19T06:21:09.425290+0000","last_fullsized":"2024-03-19T06:21:09.425290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:37.056055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438152+0000","last_change":"2024-03-19T06:21:09.452749+0000","last_active":"2024-03-19T06:21:10.438152+0000","last_peered":"2024-03-19T06:21:10.438152+0000","last_clean":"2024-03-19T06:21:10.438152+0000","last_became_active":"2024-03-19T06:21:09.452386+0000","last_became_peered":"2024-03-19T06:21:09.452386+0000","last_unstale":"2024-03-19T06:21:10.438152+0000","last_undegraded":"2024-03-19T06:21:10.438152+0000","last_fullsized":"2024-03-19T06:21:10.438152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:20.797571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438011+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:21:10.438011+0000","last_peered":"2024-03-19T06:21:10.438011+0000","last_clean":"2024-03-19T06:21:10.438011+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:21:10.438011+0000","last_undegraded":"2024-03-19T06:21:10.438011+0000","last_fullsized":"2024-03-19T06:21:10.438011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439152+0000","last_change":"2024-03-19T06:21:08.436525+0000","last_active":"2024-03-19T06:21:10.439152+0000","last_peered":"2024-03-19T06:21:10.439152+0000","last_clean":"2024-03-19T06:21:10.439152+0000","last_became_active":"2024-03-19T06:21:08.434902+0000","last_became_peered":"2024-03-19T06:21:08.434902+0000","last_unstale":"2024-03-19T06:21:10.439152+0000","last_undegraded":"2024-03-19T06:21:10.439152+0000","last_fullsized":"2024-03-19T06:21:10.439152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:12:55.201245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.450663+0000","last_change":"2024-03-19T06:21:09.446879+0000","last_active":"2024-03-19T06:21:09.450663+0000","last_peered":"2024-03-19T06:21:09.450663+0000","last_clean":"2024-03-19T06:21:09.450663+0000","last_became_active":"2024-03-19T06:21:09.446625+0000","last_became_peered":"2024-03-19T06:21:09.446625+0000","last_unstale":"2024-03-19T06:21:09.450663+0000","last_undegraded":"2024-03-19T06:21:09.450663+0000","last_fullsized":"2024-03-19T06:21:09.450663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:15.328672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437951+0000","last_change":"2024-03-19T06:21:08.441736+0000","last_active":"2024-03-19T06:21:10.437951+0000","last_peered":"2024-03-19T06:21:10.437951+0000","last_clean":"2024-03-19T06:21:10.437951+0000","last_became_active":"2024-03-19T06:21:08.441408+0000","last_became_peered":"2024-03-19T06:21:08.441408+0000","last_unstale":"2024-03-19T06:21:10.437951+0000","last_undegraded":"2024-03-19T06:21:10.437951+0000","last_fullsized":"2024-03-19T06:21:10.437951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:27:51.188461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.446994+0000","last_change":"2024-03-19T06:21:09.435944+0000","last_active":"2024-03-19T06:21:09.446994+0000","last_peered":"2024-03-19T06:21:09.446994+0000","last_clean":"2024-03-19T06:21:09.446994+0000","last_became_active":"2024-03-19T06:21:09.435521+0000","last_became_peered":"2024-03-19T06:21:09.435521+0000","last_unstale":"2024-03-19T06:21:09.446994+0000","last_undegraded":"2024-03-19T06:21:09.446994+0000","last_fullsized":"2024-03-19T06:21:09.446994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:14:51.427228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.422318+0000","last_change":"2024-03-19T06:21:08.428501+0000","last_active":"2024-03-19T06:21:09.422318+0000","last_peered":"2024-03-19T06:21:09.422318+0000","last_clean":"2024-03-19T06:21:09.422318+0000","last_became_active":"2024-03-19T06:21:08.428240+0000","last_became_peered":"2024-03-19T06:21:08.428240+0000","last_unstale":"2024-03-19T06:21:09.422318+0000","last_undegraded":"2024-03-19T06:21:09.422318+0000","last_fullsized":"2024-03-19T06:21:09.422318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:12:55.201245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431078+0000","last_change":"2024-03-19T06:21:09.437604+0000","last_active":"2024-03-19T06:21:10.431078+0000","last_peered":"2024-03-19T06:21:10.431078+0000","last_clean":"2024-03-19T06:21:10.431078+0000","last_became_active":"2024-03-19T06:21:09.436485+0000","last_became_peered":"2024-03-19T06:21:09.436485+0000","last_unstale":"2024-03-19T06:21:10.431078+0000","last_undegraded":"2024-03-19T06:21:10.431078+0000","last_fullsized":"2024-03-19T06:21:10.431078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:48:33.849430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438404+0000","last_change":"2024-03-19T06:21:08.435260+0000","last_active":"2024-03-19T06:21:10.438404+0000","last_peered":"2024-03-19T06:21:10.438404+0000","last_clean":"2024-03-19T06:21:10.438404+0000","last_became_active":"2024-03-19T06:21:08.434842+0000","last_became_peered":"2024-03-19T06:21:08.434842+0000","last_unstale":"2024-03-19T06:21:10.438404+0000","last_undegraded":"2024-03-19T06:21:10.438404+0000","last_fullsized":"2024-03-19T06:21:10.438404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:37.056055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.455023+0000","last_change":"2024-03-19T06:21:09.449799+0000","last_active":"2024-03-19T06:21:09.455023+0000","last_peered":"2024-03-19T06:21:09.455023+0000","last_clean":"2024-03-19T06:21:09.455023+0000","last_became_active":"2024-03-19T06:21:09.448305+0000","last_became_peered":"2024-03-19T06:21:09.448305+0000","last_unstale":"2024-03-19T06:21:09.455023+0000","last_undegraded":"2024-03-19T06:21:09.455023+0000","last_fullsized":"2024-03-19T06:21:09.455023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:57:56.280549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431407+0000","last_change":"2024-03-19T06:21:08.429361+0000","last_active":"2024-03-19T06:21:10.431407+0000","last_peered":"2024-03-19T06:21:10.431407+0000","last_clean":"2024-03-19T06:21:10.431407+0000","last_became_active":"2024-03-19T06:21:08.429138+0000","last_became_peered":"2024-03-19T06:21:08.429138+0000","last_unstale":"2024-03-19T06:21:10.431407+0000","last_undegraded":"2024-03-19T06:21:10.431407+0000","last_fullsized":"2024-03-19T06:21:10.431407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:32:24.190836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439077+0000","last_change":"2024-03-19T06:21:09.438743+0000","last_active":"2024-03-19T06:21:10.439077+0000","last_peered":"2024-03-19T06:21:10.439077+0000","last_clean":"2024-03-19T06:21:10.439077+0000","last_became_active":"2024-03-19T06:21:09.433760+0000","last_became_peered":"2024-03-19T06:21:09.433760+0000","last_unstale":"2024-03-19T06:21:10.439077+0000","last_undegraded":"2024-03-19T06:21:10.439077+0000","last_fullsized":"2024-03-19T06:21:10.439077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:39:52.224305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438397+0000","last_change":"2024-03-19T06:21:08.443003+0000","last_active":"2024-03-19T06:21:10.438397+0000","last_peered":"2024-03-19T06:21:10.438397+0000","last_clean":"2024-03-19T06:21:10.438397+0000","last_became_active":"2024-03-19T06:21:08.442704+0000","last_became_peered":"2024-03-19T06:21:08.442704+0000","last_unstale":"2024-03-19T06:21:10.438397+0000","last_undegraded":"2024-03-19T06:21:10.438397+0000","last_fullsized":"2024-03-19T06:21:10.438397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:55:30.030272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431303+0000","last_change":"2024-03-19T06:21:09.440061+0000","last_active":"2024-03-19T06:21:10.431303+0000","last_peered":"2024-03-19T06:21:10.431303+0000","last_clean":"2024-03-19T06:21:10.431303+0000","last_became_active":"2024-03-19T06:21:09.439732+0000","last_became_peered":"2024-03-19T06:21:09.439732+0000","last_unstale":"2024-03-19T06:21:10.431303+0000","last_undegraded":"2024-03-19T06:21:10.431303+0000","last_fullsized":"2024-03-19T06:21:10.431303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:24:35.271835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431611+0000","last_change":"2024-03-19T06:21:08.443381+0000","last_active":"2024-03-19T06:21:10.431611+0000","last_peered":"2024-03-19T06:21:10.431611+0000","last_clean":"2024-03-19T06:21:10.431611+0000","last_became_active":"2024-03-19T06:21:08.443148+0000","last_became_peered":"2024-03-19T06:21:08.443148+0000","last_unstale":"2024-03-19T06:21:10.431611+0000","last_undegraded":"2024-03-19T06:21:10.431611+0000","last_fullsized":"2024-03-19T06:21:10.431611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:22.147438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.447061+0000","last_change":"2024-03-19T06:21:09.444826+0000","last_active":"2024-03-19T06:21:09.447061+0000","last_peered":"2024-03-19T06:21:09.447061+0000","last_clean":"2024-03-19T06:21:09.447061+0000","last_became_active":"2024-03-19T06:21:09.444361+0000","last_became_peered":"2024-03-19T06:21:09.444361+0000","last_unstale":"2024-03-19T06:21:09.447061+0000","last_undegraded":"2024-03-19T06:21:09.447061+0000","last_fullsized":"2024-03-19T06:21:09.447061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:40:01.712719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.459592+0000","last_change":"2024-03-19T06:21:08.447890+0000","last_active":"2024-03-19T06:21:09.459592+0000","last_peered":"2024-03-19T06:21:09.459592+0000","last_clean":"2024-03-19T06:21:09.459592+0000","last_became_active":"2024-03-19T06:21:08.447369+0000","last_became_peered":"2024-03-19T06:21:08.447369+0000","last_unstale":"2024-03-19T06:21:09.459592+0000","last_undegraded":"2024-03-19T06:21:09.459592+0000","last_fullsized":"2024-03-19T06:21:09.459592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:41.802412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456391+0000","last_change":"2024-03-19T06:21:09.448599+0000","last_active":"2024-03-19T06:21:09.456391+0000","last_peered":"2024-03-19T06:21:09.456391+0000","last_clean":"2024-03-19T06:21:09.456391+0000","last_became_active":"2024-03-19T06:21:09.448321+0000","last_became_peered":"2024-03-19T06:21:09.448321+0000","last_unstale":"2024-03-19T06:21:09.456391+0000","last_undegraded":"2024-03-19T06:21:09.456391+0000","last_fullsized":"2024-03-19T06:21:09.456391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:23.154581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437834+0000","last_change":"2024-03-19T06:21:08.442999+0000","last_active":"2024-03-19T06:21:10.437834+0000","last_peered":"2024-03-19T06:21:10.437834+0000","last_clean":"2024-03-19T06:21:10.437834+0000","last_became_active":"2024-03-19T06:21:08.442712+0000","last_became_peered":"2024-03-19T06:21:08.442712+0000","last_unstale":"2024-03-19T06:21:10.437834+0000","last_undegraded":"2024-03-19T06:21:10.437834+0000","last_fullsized":"2024-03-19T06:21:10.437834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:41.802412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.446382+0000","last_change":"2024-03-19T06:21:09.439036+0000","last_active":"2024-03-19T06:21:09.446382+0000","last_peered":"2024-03-19T06:21:09.446382+0000","last_clean":"2024-03-19T06:21:09.446382+0000","last_became_active":"2024-03-19T06:21:09.437278+0000","last_became_peered":"2024-03-19T06:21:09.437278+0000","last_unstale":"2024-03-19T06:21:09.446382+0000","last_undegraded":"2024-03-19T06:21:09.446382+0000","last_fullsized":"2024-03-19T06:21:09.446382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:57:50.080977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431175+0000","last_change":"2024-03-19T06:21:08.426050+0000","last_active":"2024-03-19T06:21:10.431175+0000","last_peered":"2024-03-19T06:21:10.431175+0000","last_clean":"2024-03-19T06:21:10.431175+0000","last_became_active":"2024-03-19T06:21:08.425685+0000","last_became_peered":"2024-03-19T06:21:08.425685+0000","last_unstale":"2024-03-19T06:21:10.431175+0000","last_undegraded":"2024-03-19T06:21:10.431175+0000","last_fullsized":"2024-03-19T06:21:10.431175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:17:39.175587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.430816+0000","last_change":"2024-03-19T06:21:09.429673+0000","last_active":"2024-03-19T06:21:09.430816+0000","last_peered":"2024-03-19T06:21:09.430816+0000","last_clean":"2024-03-19T06:21:09.430816+0000","last_became_active":"2024-03-19T06:21:09.429200+0000","last_became_peered":"2024-03-19T06:21:09.429200+0000","last_unstale":"2024-03-19T06:21:09.430816+0000","last_undegraded":"2024-03-19T06:21:09.430816+0000","last_fullsized":"2024-03-19T06:21:09.430816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:31:24.597225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431295+0000","last_change":"2024-03-19T06:21:08.432937+0000","last_active":"2024-03-19T06:21:10.431295+0000","last_peered":"2024-03-19T06:21:10.431295+0000","last_clean":"2024-03-19T06:21:10.431295+0000","last_became_active":"2024-03-19T06:21:08.432643+0000","last_became_peered":"2024-03-19T06:21:08.432643+0000","last_unstale":"2024-03-19T06:21:10.431295+0000","last_undegraded":"2024-03-19T06:21:10.431295+0000","last_fullsized":"2024-03-19T06:21:10.431295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:37.056055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.452876+0000","last_change":"2024-03-19T06:21:09.450656+0000","last_active":"2024-03-19T06:21:09.452876+0000","last_peered":"2024-03-19T06:21:09.452876+0000","last_clean":"2024-03-19T06:21:09.452876+0000","last_became_active":"2024-03-19T06:21:09.450267+0000","last_became_peered":"2024-03-19T06:21:09.450267+0000","last_unstale":"2024-03-19T06:21:09.452876+0000","last_undegraded":"2024-03-19T06:21:09.452876+0000","last_fullsized":"2024-03-19T06:21:09.452876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:03:23.131283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439491+0000","last_change":"2024-03-19T06:21:08.444057+0000","last_active":"2024-03-19T06:21:10.439491+0000","last_peered":"2024-03-19T06:21:10.439491+0000","last_clean":"2024-03-19T06:21:10.439491+0000","last_became_active":"2024-03-19T06:21:08.443651+0000","last_became_peered":"2024-03-19T06:21:08.443651+0000","last_unstale":"2024-03-19T06:21:10.439491+0000","last_undegraded":"2024-03-19T06:21:10.439491+0000","last_fullsized":"2024-03-19T06:21:10.439491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:17:39.175587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.437616+0000","last_change":"2024-03-19T06:21:09.434472+0000","last_active":"2024-03-19T06:21:09.437616+0000","last_peered":"2024-03-19T06:21:09.437616+0000","last_clean":"2024-03-19T06:21:09.437616+0000","last_became_active":"2024-03-19T06:21:09.434201+0000","last_became_peered":"2024-03-19T06:21:09.434201+0000","last_unstale":"2024-03-19T06:21:09.437616+0000","last_undegraded":"2024-03-19T06:21:09.437616+0000","last_fullsized":"2024-03-19T06:21:09.437616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:27:52.195605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438926+0000","last_change":"2024-03-19T06:21:09.431782+0000","last_active":"2024-03-19T06:21:10.438926+0000","last_peered":"2024-03-19T06:21:10.438926+0000","last_clean":"2024-03-19T06:21:10.438926+0000","last_became_active":"2024-03-19T06:21:09.431490+0000","last_became_peered":"2024-03-19T06:21:09.431490+0000","last_unstale":"2024-03-19T06:21:10.438926+0000","last_undegraded":"2024-03-19T06:21:10.438926+0000","last_fullsized":"2024-03-19T06:21:10.438926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:42:31.622101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438627+0000","last_change":"2024-03-19T06:21:08.446728+0000","last_active":"2024-03-19T06:21:10.438627+0000","last_peered":"2024-03-19T06:21:10.438627+0000","last_clean":"2024-03-19T06:21:10.438627+0000","last_became_active":"2024-03-19T06:21:08.446423+0000","last_became_peered":"2024-03-19T06:21:08.446423+0000","last_unstale":"2024-03-19T06:21:10.438627+0000","last_undegraded":"2024-03-19T06:21:10.438627+0000","last_fullsized":"2024-03-19T06:21:10.438627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:22.147438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438843+0000","last_change":"2024-03-19T06:21:09.431353+0000","last_active":"2024-03-19T06:21:10.438843+0000","last_peered":"2024-03-19T06:21:10.438843+0000","last_clean":"2024-03-19T06:21:10.438843+0000","last_became_active":"2024-03-19T06:21:09.431060+0000","last_became_peered":"2024-03-19T06:21:09.431060+0000","last_unstale":"2024-03-19T06:21:10.438843+0000","last_undegraded":"2024-03-19T06:21:10.438843+0000","last_fullsized":"2024-03-19T06:21:10.438843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:21:16.347465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438235+0000","last_change":"2024-03-19T06:21:08.447987+0000","last_active":"2024-03-19T06:21:10.438235+0000","last_peered":"2024-03-19T06:21:10.438235+0000","last_clean":"2024-03-19T06:21:10.438235+0000","last_became_active":"2024-03-19T06:21:08.447692+0000","last_became_peered":"2024-03-19T06:21:08.447692+0000","last_unstale":"2024-03-19T06:21:10.438235+0000","last_undegraded":"2024-03-19T06:21:10.438235+0000","last_fullsized":"2024-03-19T06:21:10.438235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:28:34.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.456987+0000","last_change":"2024-03-19T06:21:09.453284+0000","last_active":"2024-03-19T06:21:09.456987+0000","last_peered":"2024-03-19T06:21:09.456987+0000","last_clean":"2024-03-19T06:21:09.456987+0000","last_became_active":"2024-03-19T06:21:09.452881+0000","last_became_peered":"2024-03-19T06:21:09.452881+0000","last_unstale":"2024-03-19T06:21:09.456987+0000","last_undegraded":"2024-03-19T06:21:09.456987+0000","last_fullsized":"2024-03-19T06:21:09.456987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:17:40.182730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.457371+0000","last_change":"2024-03-19T06:21:08.431484+0000","last_active":"2024-03-19T06:21:09.457371+0000","last_peered":"2024-03-19T06:21:09.457371+0000","last_clean":"2024-03-19T06:21:09.457371+0000","last_became_active":"2024-03-19T06:21:08.430999+0000","last_became_peered":"2024-03-19T06:21:08.430999+0000","last_unstale":"2024-03-19T06:21:09.457371+0000","last_undegraded":"2024-03-19T06:21:09.457371+0000","last_fullsized":"2024-03-19T06:21:09.457371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:57:55.273406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.444330+0000","last_change":"2024-03-19T06:21:09.442579+0000","last_active":"2024-03-19T06:21:09.444330+0000","last_peered":"2024-03-19T06:21:09.444330+0000","last_clean":"2024-03-19T06:21:09.444330+0000","last_became_active":"2024-03-19T06:21:09.442277+0000","last_became_peered":"2024-03-19T06:21:09.442277+0000","last_unstale":"2024-03-19T06:21:09.444330+0000","last_undegraded":"2024-03-19T06:21:09.444330+0000","last_fullsized":"2024-03-19T06:21:09.444330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:18:03.542251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-19T06:21:09.458011+0000","last_change":"2024-03-19T06:21:08.436289+0000","last_active":"2024-03-19T06:21:09.458011+0000","last_peered":"2024-03-19T06:21:09.458011+0000","last_clean":"2024-03-19T06:21:09.458011+0000","last_became_active":"2024-03-19T06:21:08.436007+0000","last_became_peered":"2024-03-19T06:21:08.436007+0000","last_unstale":"2024-03-19T06:21:09.458011+0000","last_undegraded":"2024-03-19T06:21:09.458011+0000","last_fullsized":"2024-03-19T06:21:09.458011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:29:42.390366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":72170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":70648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":70558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":70718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":661564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":70684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":72170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:21:13.923 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-19T06:21:13.924 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-19T06:21:13.924 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-19T06:21:13.924 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-19T06:21:13.925 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-19T06:21:14.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.116+0000 7f26c6000640 1 Processor -- start 2024-03-19T06:21:14.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.116+0000 7f26c6000640 1 -- start start 2024-03-19T06:21:14.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.116+0000 7f26c6000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f26c009a180 0x7f26c00cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.116+0000 7f26c6000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f26c006c060 0x7f26c006c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.116+0000 7f26c6000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c00d1290 con 0x7f26c015d910 2024-03-19T06:21:14.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.116+0000 7f26c6000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c009b040 con 0x7f26c006c060 2024-03-19T06:21:14.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.116+0000 7f26c6000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c00d01f0 con 0x7f26c009a180 2024-03-19T06:21:14.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.116+0000 7f26c5600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f26c006c060 0x7f26c006c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.116+0000 7f26c5600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f26c006c060 0x7f26c006c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45156/0 (socket says 172.21.15.32:45156) 2024-03-19T06:21:14.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.116+0000 7f26c5600640 1 -- 172.21.15.32:0/1020724933 learned_addr learned my addr 172.21.15.32:0/1020724933 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:14.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.116+0000 7f26bfe00640 1 --2- 172.21.15.32:0/1020724933 >> v2:172.21.15.171:3300/0 conn(0x7f26c009a180 0x7f26c00cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.116+0000 7f26c5600640 1 -- 172.21.15.32:0/1020724933 >> v2:172.21.15.171:3300/0 conn(0x7f26c009a180 msgr2=0x7f26c00cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:14.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.116+0000 7f26c5600640 1 --2- 172.21.15.32:0/1020724933 >> v2:172.21.15.171:3300/0 conn(0x7f26c009a180 0x7f26c00cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.116+0000 7f26c5600640 1 -- 172.21.15.32:0/1020724933 >> v1:172.21.15.171:6789/0 conn(0x7f26c015d910 legacy=0x7f26c0099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.116+0000 7f26c5600640 1 -- 172.21.15.32:0/1020724933 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c00d04d0 con 0x7f26c006c060 2024-03-19T06:21:14.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.120+0000 7f26c5600640 1 --2- 172.21.15.32:0/1020724933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26c006c060 0x7f26c006c860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f26c00725e0 tx=0x7f26b801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcedf2c060037c21 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:14.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.120+0000 7f26bf400640 1 -- 172.21.15.32:0/1020724933 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b80b4070 con 0x7f26c006c060 2024-03-19T06:21:14.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.120+0000 7f26bf400640 1 -- 172.21.15.32:0/1020724933 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b80af400 con 0x7f26c006c060 2024-03-19T06:21:14.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.120+0000 7f26bf400640 1 -- 172.21.15.32:0/1020724933 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b80af7d0 con 0x7f26c006c060 2024-03-19T06:21:14.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.120+0000 7f26c6000640 1 -- 172.21.15.32:0/1020724933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26c006c060 msgr2=0x7f26c006c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.120+0000 7f26c6000640 1 --2- 172.21.15.32:0/1020724933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26c006c060 0x7f26c006c860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f26c00725e0 tx=0x7f26b801f1e0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.120+0000 7f26c6000640 1 -- 172.21.15.32:0/1020724933 shutdown_connections 2024-03-19T06:21:14.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.120+0000 7f26c6000640 1 --2- 172.21.15.32:0/1020724933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26c006c060 0x7f26c006c860 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.120+0000 7f26c6000640 1 --2- 172.21.15.32:0/1020724933 >> v2:172.21.15.171:3300/0 conn(0x7f26c009a180 0x7f26c00cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.120+0000 7f26c6000640 1 -- 172.21.15.32:0/1020724933 >> 172.21.15.32:0/1020724933 conn(0x7f26c00b3170 msgr2=0x7f26c00b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:14.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.120+0000 7f26c6000640 1 -- 172.21.15.32:0/1020724933 shutdown_connections 2024-03-19T06:21:14.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.120+0000 7f26c6000640 1 -- 172.21.15.32:0/1020724933 wait complete. 2024-03-19T06:21:14.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.120+0000 7f26c6000640 1 Processor -- start 2024-03-19T06:21:14.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c6000640 1 -- start start 2024-03-19T06:21:14.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26c006c060 0x7f26c00b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c6000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26c009a180 0x7f26c00b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c6000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26c015d910 0x7f26c00c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c6000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c00d0d70 con 0x7f26c006c060 2024-03-19T06:21:14.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c6000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c00d0a90 con 0x7f26c009a180 2024-03-19T06:21:14.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c6000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c015dcf0 con 0x7f26c015d910 2024-03-19T06:21:14.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c4c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26c006c060 0x7f26c00b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c4c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26c006c060 0x7f26c00b1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45162/0 (socket says 172.21.15.32:45162) 2024-03-19T06:21:14.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c4c00640 1 -- 172.21.15.32:0/726572691 learned_addr learned my addr 172.21.15.32:0/726572691 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:14.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c5600640 1 --2- 172.21.15.32:0/726572691 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26c015d910 0x7f26c00c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26bfe00640 1 --2- 172.21.15.32:0/726572691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26c009a180 0x7f26c00b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c4c00640 1 -- 172.21.15.32:0/726572691 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26c015d910 msgr2=0x7f26c00c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c4c00640 1 --2- 172.21.15.32:0/726572691 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26c015d910 0x7f26c00c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c4c00640 1 -- 172.21.15.32:0/726572691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26c009a180 msgr2=0x7f26c00b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c4c00640 1 --2- 172.21.15.32:0/726572691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26c009a180 0x7f26c00b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c4c00640 1 -- 172.21.15.32:0/726572691 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c00c65f0 con 0x7f26c006c060 2024-03-19T06:21:14.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c4c00640 1 --2- 172.21.15.32:0/726572691 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26c006c060 0x7f26c00b1c10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f26b400c370 tx=0x7f26b400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:14.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26bcc00640 1 -- 172.21.15.32:0/726572691 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b40052d0 con 0x7f26c006c060 2024-03-19T06:21:14.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26bcc00640 1 -- 172.21.15.32:0/726572691 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b4005470 con 0x7f26c006c060 2024-03-19T06:21:14.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c6000640 1 -- 172.21.15.32:0/726572691 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c00c68d0 con 0x7f26c006c060 2024-03-19T06:21:14.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26bcc00640 1 -- 172.21.15.32:0/726572691 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4007260 con 0x7f26c006c060 2024-03-19T06:21:14.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c6000640 1 -- 172.21.15.32:0/726572691 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c00c6e90 con 0x7f26c006c060 2024-03-19T06:21:14.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.124+0000 7f26c6000640 1 -- 172.21.15.32:0/726572691 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c0075090 con 0x7f26c006c060 2024-03-19T06:21:14.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.128+0000 7f26bcc00640 1 -- 172.21.15.32:0/726572691 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f26b4007400 con 0x7f26c006c060 2024-03-19T06:21:14.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.128+0000 7f26bcc00640 1 --2- 172.21.15.32:0/726572691 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f26a0067660 0x7f26a0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.128+0000 7f26bcc00640 1 -- 172.21.15.32:0/726572691 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26b4084d20 con 0x7f26c006c060 2024-03-19T06:21:14.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.128+0000 7f26bfe00640 1 --2- 172.21.15.32:0/726572691 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f26a0067660 0x7f26a0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.128+0000 7f26bfe00640 1 --2- 172.21.15.32:0/726572691 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f26a0067660 0x7f26a0069b20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f26c00713e0 tx=0x7f26ac008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:14.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.132+0000 7f26bcc00640 1 -- 172.21.15.32:0/726572691 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f26b4055990 con 0x7f26c006c060 2024-03-19T06:21:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.336+0000 7f26c6000640 1 -- 172.21.15.32:0/726572691 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f26c00cddf0 con 0x7f26c006c060 2024-03-19T06:21:14.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.336+0000 7f26bcc00640 1 -- 172.21.15.32:0/726572691 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+166533 (secure 0 0 0) 0x7f26b4055290 con 0x7f26c006c060 2024-03-19T06:21:14.332 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:14.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.340+0000 7f26c6000640 1 -- 172.21.15.32:0/726572691 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f26a0067660 msgr2=0x7f26a0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.340+0000 7f26c6000640 1 --2- 172.21.15.32:0/726572691 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f26a0067660 0x7f26a0069b20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f26c00713e0 tx=0x7f26ac008040 comp rx=0 tx=0).stop 2024-03-19T06:21:14.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.340+0000 7f26c6000640 1 -- 172.21.15.32:0/726572691 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26c006c060 msgr2=0x7f26c00b1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.340+0000 7f26c6000640 1 --2- 172.21.15.32:0/726572691 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26c006c060 0x7f26c00b1c10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f26b400c370 tx=0x7f26b400c830 comp rx=0 tx=0).stop 2024-03-19T06:21:14.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.340+0000 7f26c6000640 1 -- 172.21.15.32:0/726572691 shutdown_connections 2024-03-19T06:21:14.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.340+0000 7f26c6000640 1 --2- 172.21.15.32:0/726572691 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f26a0067660 0x7f26a0069b20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.340+0000 7f26c6000640 1 --2- 172.21.15.32:0/726572691 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26c015d910 0x7f26c00c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.340+0000 7f26c6000640 1 --2- 172.21.15.32:0/726572691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26c009a180 0x7f26c00b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.340+0000 7f26c6000640 1 --2- 172.21.15.32:0/726572691 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26c006c060 0x7f26c00b1c10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.340+0000 7f26c6000640 1 -- 172.21.15.32:0/726572691 >> 172.21.15.32:0/726572691 conn(0x7f26c00b3170 msgr2=0x7f26c00ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:14.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.340+0000 7f26c6000640 1 -- 172.21.15.32:0/726572691 shutdown_connections 2024-03-19T06:21:14.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.340+0000 7f26c6000640 1 -- 172.21.15.32:0/726572691 wait complete. 2024-03-19T06:21:14.352 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":5,"flags":0,"active_gid":4109,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":2098850483},{"type":"v1","addr":"172.21.15.171:6833","nonce":2098850483}]},"active_addr":"172.21.15.171:6833/2098850483","active_change":"2024-03-19T06:20:49.903733+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4119,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":2005443085}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":3582527382}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":593641607}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":3868265768}]}]} 2024-03-19T06:21:14.355 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-19T06:21:14.356 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-19T06:21:14.356 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:14.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.504+0000 7fad46c00640 1 Processor -- start 2024-03-19T06:21:14.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.504+0000 7fad46c00640 1 -- start start 2024-03-19T06:21:14.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.504+0000 7fad46c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fad4006c460 0x7fad400acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.504+0000 7fad46c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4015e520 con 0x7fad400ae0b0 2024-03-19T06:21:14.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.504+0000 7fad46c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4015e800 con 0x7fad4015dff0 2024-03-19T06:21:14.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.504+0000 7fad46c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4015f1b0 con 0x7fad4006c460 2024-03-19T06:21:14.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.504+0000 7fad3fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fad400ae0b0 0x7fad4006bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47558/0 (socket says 172.21.15.32:47558) 2024-03-19T06:21:14.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.504+0000 7fad3fe00640 1 -- 172.21.15.32:0/3576608303 learned_addr learned my addr 172.21.15.32:0/3576608303 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:14.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.504+0000 7fad3f400640 1 -- 172.21.15.32:0/3576608303 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437624379 0 0) 0x7fad4015e520 con 0x7fad400ae0b0 2024-03-19T06:21:14.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.504+0000 7fad3f400640 1 -- 172.21.15.32:0/3576608303 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad24003530 con 0x7fad400ae0b0 2024-03-19T06:21:14.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.504+0000 7fad37400640 1 --2- 172.21.15.32:0/3576608303 >> v2:172.21.15.171:3300/0 conn(0x7fad4006c460 0x7fad400acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad3f400640 1 -- 172.21.15.32:0/3576608303 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3384424673 0 0) 0x7fad24003530 con 0x7fad400ae0b0 2024-03-19T06:21:14.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad3f400640 1 -- 172.21.15.32:0/3576608303 >> v2:172.21.15.171:3300/0 conn(0x7fad4006c460 msgr2=0x7fad400acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:14.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad3f400640 1 --2- 172.21.15.32:0/3576608303 >> v2:172.21.15.171:3300/0 conn(0x7fad4006c460 0x7fad400acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad3f400640 1 -- 172.21.15.32:0/3576608303 >> v1:172.21.15.171:6789/0 conn(0x7fad4015dff0 legacy=0x7fad40154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad3f400640 1 -- 172.21.15.32:0/3576608303 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4015eae0 con 0x7fad400ae0b0 2024-03-19T06:21:14.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad3f400640 1 -- 172.21.15.32:0/3576608303 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fad30001680 con 0x7fad400ae0b0 2024-03-19T06:21:14.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad3f400640 1 -- 172.21.15.32:0/3576608303 >> v1:172.21.15.32:6789/0 conn(0x7fad400ae0b0 legacy=0x7fad4006bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad3f400640 1 --2- 172.21.15.32:0/3576608303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad240039c0 0x7fad24003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad3f400640 1 --2- 172.21.15.32:0/3576608303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad240043e0 0x7fad240048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad3f400640 1 --2- 172.21.15.32:0/3576608303 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad240050b0 0x7fad2400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad3f400640 1 -- 172.21.15.32:0/3576608303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4015f1b0 con 0x7fad240043e0 2024-03-19T06:21:14.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad3f400640 1 -- 172.21.15.32:0/3576608303 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2400bff0 con 0x7fad240039c0 2024-03-19T06:21:14.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad3f400640 1 -- 172.21.15.32:0/3576608303 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2400c1f0 con 0x7fad240050b0 2024-03-19T06:21:14.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad37400640 1 --2- 172.21.15.32:0/3576608303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad240043e0 0x7fad240048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad3fe00640 1 --2- 172.21.15.32:0/3576608303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad240039c0 0x7fad24003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad44c00640 1 --2- 172.21.15.32:0/3576608303 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad240050b0 0x7fad2400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad37400640 1 -- 172.21.15.32:0/3576608303 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad240050b0 msgr2=0x7fad2400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:14.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad37400640 1 --2- 172.21.15.32:0/3576608303 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad240050b0 0x7fad2400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad37400640 1 -- 172.21.15.32:0/3576608303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad240039c0 msgr2=0x7fad24003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:14.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad37400640 1 --2- 172.21.15.32:0/3576608303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad240039c0 0x7fad24003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad37400640 1 -- 172.21.15.32:0/3576608303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad24003530 con 0x7fad240043e0 2024-03-19T06:21:14.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad44c00640 1 -- 172.21.15.32:0/3576608303 reap_dead start 2024-03-19T06:21:14.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.508+0000 7fad37400640 1 --2- 172.21.15.32:0/3576608303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad240043e0 0x7fad240048b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad28009ae0 tx=0x7fad2801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1cb63e6f8ecd956 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:14.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad3f400640 1 -- 172.21.15.32:0/3576608303 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad280b2070 con 0x7fad240043e0 2024-03-19T06:21:14.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad3f400640 1 -- 172.21.15.32:0/3576608303 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad280a5660 con 0x7fad240043e0 2024-03-19T06:21:14.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad3f400640 1 -- 172.21.15.32:0/3576608303 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad280096b0 con 0x7fad240043e0 2024-03-19T06:21:14.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad46c00640 1 -- 172.21.15.32:0/3576608303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad240043e0 msgr2=0x7fad240048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad46c00640 1 --2- 172.21.15.32:0/3576608303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad240043e0 0x7fad240048b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad28009ae0 tx=0x7fad2801ca70 comp rx=0 tx=0).stop 2024-03-19T06:21:14.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad46c00640 1 -- 172.21.15.32:0/3576608303 shutdown_connections 2024-03-19T06:21:14.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad46c00640 1 --2- 172.21.15.32:0/3576608303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad240043e0 0x7fad240048b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad46c00640 1 -- 172.21.15.32:0/3576608303 >> 172.21.15.32:0/3576608303 conn(0x7fad40071c50 msgr2=0x7fad40072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:14.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad46c00640 1 -- 172.21.15.32:0/3576608303 shutdown_connections 2024-03-19T06:21:14.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad46c00640 1 -- 172.21.15.32:0/3576608303 wait complete. 2024-03-19T06:21:14.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad46c00640 1 Processor -- start 2024-03-19T06:21:14.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad46c00640 1 -- start start 2024-03-19T06:21:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad46c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad240043e0 0x7fad401f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad46c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad40154270 0x7fad40152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad46c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad40152870 0x7fad40148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad46c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad400ae490 con 0x7fad240043e0 2024-03-19T06:21:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad46c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad40072d60 con 0x7fad40152870 2024-03-19T06:21:14.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad46c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad400acdb0 con 0x7fad40154270 2024-03-19T06:21:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad3fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad240043e0 0x7fad401f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad3fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad240043e0 0x7fad401f7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45182/0 (socket says 172.21.15.32:45182) 2024-03-19T06:21:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.512+0000 7fad3fe00640 1 -- 172.21.15.32:0/1939667602 learned_addr learned my addr 172.21.15.32:0/1939667602 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad37400640 1 --2- 172.21.15.32:0/1939667602 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad40154270 0x7fad40152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad44c00640 1 --2- 172.21.15.32:0/1939667602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad40152870 0x7fad40148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad3fe00640 1 -- 172.21.15.32:0/1939667602 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad40154270 msgr2=0x7fad40152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad3fe00640 1 --2- 172.21.15.32:0/1939667602 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad40154270 0x7fad40152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad3fe00640 1 -- 172.21.15.32:0/1939667602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad40152870 msgr2=0x7fad40148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad3fe00640 1 --2- 172.21.15.32:0/1939667602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad40152870 0x7fad40148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad3fe00640 1 -- 172.21.15.32:0/1939667602 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad40154a30 con 0x7fad240043e0 2024-03-19T06:21:14.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad3fe00640 1 --2- 172.21.15.32:0/1939667602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad240043e0 0x7fad401f7e60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fad30007370 tx=0x7fad30007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:14.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad3cc00640 1 -- 172.21.15.32:0/1939667602 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3001a070 con 0x7fad240043e0 2024-03-19T06:21:14.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad3cc00640 1 -- 172.21.15.32:0/1939667602 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3000f8e0 con 0x7fad240043e0 2024-03-19T06:21:14.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad46c00640 1 -- 172.21.15.32:0/1939667602 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad40154d10 con 0x7fad240043e0 2024-03-19T06:21:14.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad3cc00640 1 -- 172.21.15.32:0/1939667602 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3000fcd0 con 0x7fad240043e0 2024-03-19T06:21:14.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad46c00640 1 -- 172.21.15.32:0/1939667602 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad401552d0 con 0x7fad240043e0 2024-03-19T06:21:14.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad46c00640 1 -- 172.21.15.32:0/1939667602 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad400749e0 con 0x7fad240043e0 2024-03-19T06:21:14.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad3cc00640 1 -- 172.21.15.32:0/1939667602 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fad3001d070 con 0x7fad240043e0 2024-03-19T06:21:14.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad3cc00640 1 --2- 172.21.15.32:0/1939667602 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fad1c067660 0x7fad1c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.516+0000 7fad3cc00640 1 -- 172.21.15.32:0/1939667602 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad300850d0 con 0x7fad240043e0 2024-03-19T06:21:14.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.520+0000 7fad37400640 1 --2- 172.21.15.32:0/1939667602 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fad1c067660 0x7fad1c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.520+0000 7fad37400640 1 --2- 172.21.15.32:0/1939667602 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fad1c067660 0x7fad1c069b20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fad280af000 tx=0x7fad280046d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:14.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.524+0000 7fad3cc00640 1 -- 172.21.15.32:0/1939667602 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fad30055660 con 0x7fad240043e0 2024-03-19T06:21:14.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.684+0000 7fad46c00640 1 -- 172.21.15.32:0/1939667602 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad40152c50 con 0x7fad240043e0 2024-03-19T06:21:14.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.688+0000 7fad3cc00640 1 -- 172.21.15.32:0/1939667602 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16617 (secure 0 0 0) 0x7fad30059700 con 0x7fad240043e0 2024-03-19T06:21:14.679 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:14.679 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:10.423479+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:14.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.688+0000 7fad46c00640 1 -- 172.21.15.32:0/1939667602 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fad1c067660 msgr2=0x7fad1c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.688+0000 7fad46c00640 1 --2- 172.21.15.32:0/1939667602 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fad1c067660 0x7fad1c069b20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fad280af000 tx=0x7fad280046d0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.688+0000 7fad46c00640 1 -- 172.21.15.32:0/1939667602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad240043e0 msgr2=0x7fad401f7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.688+0000 7fad46c00640 1 --2- 172.21.15.32:0/1939667602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad240043e0 0x7fad401f7e60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fad30007370 tx=0x7fad30007830 comp rx=0 tx=0).stop 2024-03-19T06:21:14.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.688+0000 7fad46c00640 1 -- 172.21.15.32:0/1939667602 shutdown_connections 2024-03-19T06:21:14.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.688+0000 7fad46c00640 1 --2- 172.21.15.32:0/1939667602 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fad1c067660 0x7fad1c069b20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.688+0000 7fad46c00640 1 --2- 172.21.15.32:0/1939667602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad40152870 0x7fad40148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.688+0000 7fad46c00640 1 --2- 172.21.15.32:0/1939667602 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad40154270 0x7fad40152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.688+0000 7fad46c00640 1 --2- 172.21.15.32:0/1939667602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad240043e0 0x7fad401f7e60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.688+0000 7fad46c00640 1 -- 172.21.15.32:0/1939667602 >> 172.21.15.32:0/1939667602 conn(0x7fad40071c50 msgr2=0x7fad400ad140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:14.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.688+0000 7fad46c00640 1 -- 172.21.15.32:0/1939667602 shutdown_connections 2024-03-19T06:21:14.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.688+0000 7fad46c00640 1 -- 172.21.15.32:0/1939667602 wait complete. 2024-03-19T06:21:14.701 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-19T06:21:14.701 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:14.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba55200640 1 Processor -- start 2024-03-19T06:21:14.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba55200640 1 -- start start 2024-03-19T06:21:14.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba55200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fba5009a480 0x7fba500cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba55200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba500cd390 0x7fba500cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba55200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5015bf00 con 0x7fba5015bb20 2024-03-19T06:21:14.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba55200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba500cc3a0 con 0x7fba5009a480 2024-03-19T06:21:14.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba55200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba500cfbb0 con 0x7fba500cd390 2024-03-19T06:21:14.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4de00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fba5015bb20 0x7fba500c53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47574/0 (socket says 172.21.15.32:47574) 2024-03-19T06:21:14.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4de00640 1 -- 172.21.15.32:0/3811592173 learned_addr learned my addr 172.21.15.32:0/3811592173 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:14.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4e800640 1 --2- 172.21.15.32:0/3811592173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba500cd390 0x7fba500cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4d400640 1 -- 172.21.15.32:0/3811592173 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349249532 0 0) 0x7fba5015bf00 con 0x7fba5015bb20 2024-03-19T06:21:14.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4d400640 1 -- 172.21.15.32:0/3811592173 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba34003530 con 0x7fba5015bb20 2024-03-19T06:21:14.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba47e00640 1 --2- 172.21.15.32:0/3811592173 >> v2:172.21.15.171:3300/0 conn(0x7fba5009a480 0x7fba500cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4d400640 1 -- 172.21.15.32:0/3811592173 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3792958515 0 0) 0x7fba34003530 con 0x7fba5015bb20 2024-03-19T06:21:14.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4d400640 1 -- 172.21.15.32:0/3811592173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba500cd390 msgr2=0x7fba500cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:14.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4d400640 1 --2- 172.21.15.32:0/3811592173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba500cd390 0x7fba500cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4d400640 1 -- 172.21.15.32:0/3811592173 >> v2:172.21.15.171:3300/0 conn(0x7fba5009a480 msgr2=0x7fba500cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:14.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4d400640 1 --2- 172.21.15.32:0/3811592173 >> v2:172.21.15.171:3300/0 conn(0x7fba5009a480 0x7fba500cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4d400640 1 -- 172.21.15.32:0/3811592173 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba500cc5d0 con 0x7fba5015bb20 2024-03-19T06:21:14.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4d400640 1 -- 172.21.15.32:0/3811592173 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fba40001680 con 0x7fba5015bb20 2024-03-19T06:21:14.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4d400640 1 -- 172.21.15.32:0/3811592173 >> v1:172.21.15.32:6789/0 conn(0x7fba5015bb20 legacy=0x7fba500c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4d400640 1 --2- 172.21.15.32:0/3811592173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba500cd390 0x7fba340039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4d400640 1 --2- 172.21.15.32:0/3811592173 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba34003f40 0x7fba34004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4d400640 1 --2- 172.21.15.32:0/3811592173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba34004d50 0x7fba340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4d400640 1 -- 172.21.15.32:0/3811592173 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba500cfbb0 con 0x7fba34003f40 2024-03-19T06:21:14.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4d400640 1 -- 172.21.15.32:0/3811592173 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3400b9d0 con 0x7fba34004d50 2024-03-19T06:21:14.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.848+0000 7fba4d400640 1 -- 172.21.15.32:0/3811592173 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3400bb50 con 0x7fba500cd390 2024-03-19T06:21:14.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.852+0000 7fba47e00640 1 --2- 172.21.15.32:0/3811592173 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba34003f40 0x7fba34004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.852+0000 7fba4e800640 1 --2- 172.21.15.32:0/3811592173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba34004d50 0x7fba340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.852+0000 7fba4de00640 1 --2- 172.21.15.32:0/3811592173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba500cd390 0x7fba340039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.852+0000 7fba47e00640 1 -- 172.21.15.32:0/3811592173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba500cd390 msgr2=0x7fba340039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:14.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.852+0000 7fba47e00640 1 --2- 172.21.15.32:0/3811592173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba500cd390 0x7fba340039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.852+0000 7fba47e00640 1 -- 172.21.15.32:0/3811592173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba34004d50 msgr2=0x7fba340051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:14.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.852+0000 7fba47e00640 1 --2- 172.21.15.32:0/3811592173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba34004d50 0x7fba340051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.852+0000 7fba47e00640 1 -- 172.21.15.32:0/3811592173 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba34003530 con 0x7fba34003f40 2024-03-19T06:21:14.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.852+0000 7fba47e00640 1 --2- 172.21.15.32:0/3811592173 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba34003f40 0x7fba34004810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fba38009ae0 tx=0x7fba3801c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49086567e852d993 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:14.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.852+0000 7fba4d400640 1 -- 172.21.15.32:0/3811592173 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba380b1070 con 0x7fba34003f40 2024-03-19T06:21:14.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.852+0000 7fba4d400640 1 -- 172.21.15.32:0/3811592173 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba380a49d0 con 0x7fba34003f40 2024-03-19T06:21:14.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.852+0000 7fba4d400640 1 -- 172.21.15.32:0/3811592173 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba380096b0 con 0x7fba34003f40 2024-03-19T06:21:14.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.852+0000 7fba55200640 1 -- 172.21.15.32:0/3811592173 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba34003f40 msgr2=0x7fba34004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.852+0000 7fba55200640 1 --2- 172.21.15.32:0/3811592173 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba34003f40 0x7fba34004810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fba38009ae0 tx=0x7fba3801c730 comp rx=0 tx=0).stop 2024-03-19T06:21:14.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba4e800640 1 -- 172.21.15.32:0/3811592173 reap_dead start 2024-03-19T06:21:14.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba55200640 1 -- 172.21.15.32:0/3811592173 shutdown_connections 2024-03-19T06:21:14.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba55200640 1 -- 172.21.15.32:0/3811592173 >> 172.21.15.32:0/3811592173 conn(0x7fba500d1890 msgr2=0x7fba500d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:14.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba55200640 1 -- 172.21.15.32:0/3811592173 shutdown_connections 2024-03-19T06:21:14.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba55200640 1 -- 172.21.15.32:0/3811592173 wait complete. 2024-03-19T06:21:14.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba55200640 1 Processor -- start 2024-03-19T06:21:14.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba55200640 1 -- start start 2024-03-19T06:21:14.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba55200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba34003f40 0x7fba500ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba55200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba50156d70 0x7fba5015df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba55200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba5015e450 0x7fba500b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba55200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba500cdb80 con 0x7fba50156d70 2024-03-19T06:21:14.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba55200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba500c5af0 con 0x7fba5015e450 2024-03-19T06:21:14.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba55200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba500cdd00 con 0x7fba34003f40 2024-03-19T06:21:14.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba47e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba50156d70 0x7fba5015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba47e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba50156d70 0x7fba5015df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45210/0 (socket says 172.21.15.32:45210) 2024-03-19T06:21:14.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba47e00640 1 -- 172.21.15.32:0/1431286207 learned_addr learned my addr 172.21.15.32:0/1431286207 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:14.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba47e00640 1 -- 172.21.15.32:0/1431286207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba34003f40 msgr2=0x7fba500ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba47e00640 1 --2- 172.21.15.32:0/1431286207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba34003f40 0x7fba500ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba47e00640 1 -- 172.21.15.32:0/1431286207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba5015e450 msgr2=0x7fba500b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:14.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba47e00640 1 --2- 172.21.15.32:0/1431286207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba5015e450 0x7fba500b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:14.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba47e00640 1 -- 172.21.15.32:0/1431286207 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba500c9370 con 0x7fba50156d70 2024-03-19T06:21:14.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba47e00640 1 --2- 172.21.15.32:0/1431286207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba50156d70 0x7fba5015df10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fba3801c560 tx=0x7fba34005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:14.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.856+0000 7fba46000640 1 -- 172.21.15.32:0/1431286207 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba380bb030 con 0x7fba50156d70 2024-03-19T06:21:14.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.860+0000 7fba46000640 1 -- 172.21.15.32:0/1431286207 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3800f000 con 0x7fba50156d70 2024-03-19T06:21:14.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.860+0000 7fba46000640 1 -- 172.21.15.32:0/1431286207 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba380b1040 con 0x7fba50156d70 2024-03-19T06:21:14.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.860+0000 7fba55200640 1 -- 172.21.15.32:0/1431286207 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba500c9610 con 0x7fba50156d70 2024-03-19T06:21:14.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.860+0000 7fba55200640 1 -- 172.21.15.32:0/1431286207 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba500c9bd0 con 0x7fba50156d70 2024-03-19T06:21:14.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.860+0000 7fba55200640 1 -- 172.21.15.32:0/1431286207 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba500749e0 con 0x7fba50156d70 2024-03-19T06:21:14.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.860+0000 7fba46000640 1 -- 172.21.15.32:0/1431286207 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fba380be070 con 0x7fba50156d70 2024-03-19T06:21:14.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.860+0000 7fba46000640 1 --2- 172.21.15.32:0/1431286207 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba2c067660 0x7fba2c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:14.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.860+0000 7fba46000640 1 -- 172.21.15.32:0/1431286207 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba3811e540 con 0x7fba50156d70 2024-03-19T06:21:14.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.860+0000 7fba4de00640 1 --2- 172.21.15.32:0/1431286207 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba2c067660 0x7fba2c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:14.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.864+0000 7fba4de00640 1 --2- 172.21.15.32:0/1431286207 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba2c067660 0x7fba2c069b20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fba40001060 tx=0x7fba40001120 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:14.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:14.864+0000 7fba46000640 1 -- 172.21.15.32:0/1431286207 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fba380167c0 con 0x7fba50156d70 2024-03-19T06:21:15.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.032+0000 7fba55200640 1 -- 172.21.15.32:0/1431286207 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba5006de40 con 0x7fba50156d70 2024-03-19T06:21:15.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.032+0000 7fba46000640 1 -- 172.21.15.32:0/1431286207 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16617 (secure 0 0 0) 0x7fba380eeb60 con 0x7fba50156d70 2024-03-19T06:21:15.025 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:15.025 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:10.423479+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:15.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.032+0000 7fba55200640 1 -- 172.21.15.32:0/1431286207 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba2c067660 msgr2=0x7fba2c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.032+0000 7fba55200640 1 --2- 172.21.15.32:0/1431286207 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba2c067660 0x7fba2c069b20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fba40001060 tx=0x7fba40001120 comp rx=0 tx=0).stop 2024-03-19T06:21:15.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.032+0000 7fba55200640 1 -- 172.21.15.32:0/1431286207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba50156d70 msgr2=0x7fba5015df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.032+0000 7fba55200640 1 --2- 172.21.15.32:0/1431286207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba50156d70 0x7fba5015df10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fba3801c560 tx=0x7fba34005840 comp rx=0 tx=0).stop 2024-03-19T06:21:15.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.032+0000 7fba55200640 1 -- 172.21.15.32:0/1431286207 shutdown_connections 2024-03-19T06:21:15.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.032+0000 7fba55200640 1 --2- 172.21.15.32:0/1431286207 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba2c067660 0x7fba2c069b20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.032+0000 7fba55200640 1 --2- 172.21.15.32:0/1431286207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba5015e450 0x7fba500b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.032+0000 7fba55200640 1 --2- 172.21.15.32:0/1431286207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba50156d70 0x7fba5015df10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.032+0000 7fba55200640 1 --2- 172.21.15.32:0/1431286207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba34003f40 0x7fba500ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.032+0000 7fba55200640 1 -- 172.21.15.32:0/1431286207 >> 172.21.15.32:0/1431286207 conn(0x7fba500d1890 msgr2=0x7fba500d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.032+0000 7fba55200640 1 -- 172.21.15.32:0/1431286207 shutdown_connections 2024-03-19T06:21:15.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.032+0000 7fba55200640 1 -- 172.21.15.32:0/1431286207 wait complete. 2024-03-19T06:21:15.046 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-19T06:21:15.046 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-19T06:21:15.046 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-19T06:21:15.047 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-19T06:21:15.047 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-19T06:21:15.047 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-19T06:21:15.048 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-19T06:21:15.048 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-19T06:21:15.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.296+0000 7fb439e00640 1 Processor -- start 2024-03-19T06:21:15.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.296+0000 7fb439e00640 1 -- start start 2024-03-19T06:21:15.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb439e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb42c034460 0x7fb42c0080f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb439e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42c0389a0 con 0x7fb42c04f9b0 2024-03-19T06:21:15.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb439e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42c007420 con 0x7fb42c034840 2024-03-19T06:21:15.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb439e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb42c054f50 con 0x7fb42c034460 2024-03-19T06:21:15.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433e00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fb42c034840 0x7fb42c0381b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:56854/0 (socket says 172.21.15.32:56854) 2024-03-19T06:21:15.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433e00640 1 -- 172.21.15.32:0/346693408 learned_addr learned my addr 172.21.15.32:0/346693408 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:15.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433400640 1 -- 172.21.15.32:0/346693408 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660421796 0 0) 0x7fb42c007420 con 0x7fb42c034840 2024-03-19T06:21:15.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433400640 1 -- 172.21.15.32:0/346693408 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb41c003530 con 0x7fb42c034840 2024-03-19T06:21:15.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb438a00640 1 --2- 172.21.15.32:0/346693408 >> v2:172.21.15.171:3300/0 conn(0x7fb42c034460 0x7fb42c0080f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433400640 1 -- 172.21.15.32:0/346693408 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3578804656 0 0) 0x7fb41c003530 con 0x7fb42c034840 2024-03-19T06:21:15.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433400640 1 -- 172.21.15.32:0/346693408 >> v2:172.21.15.171:3300/0 conn(0x7fb42c034460 msgr2=0x7fb42c0080f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433400640 1 --2- 172.21.15.32:0/346693408 >> v2:172.21.15.171:3300/0 conn(0x7fb42c034460 0x7fb42c0080f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433400640 1 -- 172.21.15.32:0/346693408 >> v1:172.21.15.32:6789/0 conn(0x7fb42c04f9b0 legacy=0x7fb42c0e4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433400640 1 -- 172.21.15.32:0/346693408 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c006e60 con 0x7fb42c034840 2024-03-19T06:21:15.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433400640 1 -- 172.21.15.32:0/346693408 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fb420001680 con 0x7fb42c034840 2024-03-19T06:21:15.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433400640 1 -- 172.21.15.32:0/346693408 >> v1:172.21.15.171:6789/0 conn(0x7fb42c034840 legacy=0x7fb42c0381b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433400640 1 --2- 172.21.15.32:0/346693408 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb41c0039c0 0x7fb41c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433400640 1 --2- 172.21.15.32:0/346693408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb41c004810 0x7fb41c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433400640 1 --2- 172.21.15.32:0/346693408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb41c0051d0 0x7fb41c0099c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433400640 1 -- 172.21.15.32:0/346693408 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c054f50 con 0x7fb41c0051d0 2024-03-19T06:21:15.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433400640 1 -- 172.21.15.32:0/346693408 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c00a110 con 0x7fb41c004810 2024-03-19T06:21:15.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433400640 1 -- 172.21.15.32:0/346693408 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c00a310 con 0x7fb41c0039c0 2024-03-19T06:21:15.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb433e00640 1 --2- 172.21.15.32:0/346693408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb41c004810 0x7fb41c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.300+0000 7fb438a00640 1 --2- 172.21.15.32:0/346693408 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb41c0039c0 0x7fb41c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.304+0000 7fb439400640 1 --2- 172.21.15.32:0/346693408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb41c0051d0 0x7fb41c0099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.304+0000 7fb438a00640 1 -- 172.21.15.32:0/346693408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb41c004810 msgr2=0x7fb41c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.304+0000 7fb438a00640 1 --2- 172.21.15.32:0/346693408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb41c004810 0x7fb41c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.304+0000 7fb438a00640 1 -- 172.21.15.32:0/346693408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb41c0051d0 msgr2=0x7fb41c0099c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.304+0000 7fb438a00640 1 --2- 172.21.15.32:0/346693408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb41c0051d0 0x7fb41c0099c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.304+0000 7fb439400640 1 -- 172.21.15.32:0/346693408 reap_dead start 2024-03-19T06:21:15.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.304+0000 7fb438a00640 1 -- 172.21.15.32:0/346693408 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c006e60 con 0x7fb41c0039c0 2024-03-19T06:21:15.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.304+0000 7fd7e9400640 1 Processor -- start 2024-03-19T06:21:15.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.304+0000 7fd7e9400640 1 -- start start 2024-03-19T06:21:15.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.304+0000 7f008ca00640 1 Processor -- start 2024-03-19T06:21:15.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.304+0000 7fd7e9400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd7e4153fe0 0x7fd7e4071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7fd7e9400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e40cadb0 con 0x7fd7e4071890 2024-03-19T06:21:15.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f7eeb000640 1 Processor -- start 2024-03-19T06:21:15.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7fd7e9400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e40cb090 con 0x7fd7e40ca790 2024-03-19T06:21:15.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7fd7e9400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e40cb370 con 0x7fd7e4153fe0 2024-03-19T06:21:15.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f7eeb000640 1 -- start start 2024-03-19T06:21:15.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.304+0000 7f008ca00640 1 -- start start 2024-03-19T06:21:15.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7fd7d9e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd7e4071890 0x7fd7e40ca080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47594/0 (socket says 172.21.15.32:47594) 2024-03-19T06:21:15.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7fd7d9e00640 1 -- 172.21.15.32:0/3447777218 learned_addr learned my addr 172.21.15.32:0/3447777218 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:15.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7fd7e2800640 1 --2- 172.21.15.32:0/3447777218 >> v2:172.21.15.32:3300/0 conn(0x7fd7e4153fe0 0x7fd7e4071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f008ca00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f008815db10 0x7f00880b9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f008ca00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f00880b6960 0x7f0088161610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f008ca00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00880d1b90 0x7f0088161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f0086800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f008815db10 0x7f00880b9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f0086800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f008815db10 0x7f00880b9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57086/0 (socket says 172.21.15.32:57086) 2024-03-19T06:21:15.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f7eeb000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7ee40d00d0 0x7f7ee4153d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f7eeb000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ee41542c0 0x7f7ee4071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f7eeb000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee4160a30 con 0x7f7ee4071890 2024-03-19T06:21:15.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f7eeb000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee4071d00 con 0x7f7ee40d00d0 2024-03-19T06:21:15.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f7eeb000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee40cb090 con 0x7f7ee41542c0 2024-03-19T06:21:15.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f0086800640 1 -- 172.21.15.32:0/635470617 learned_addr learned my addr 172.21.15.32:0/635470617 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f7ee3400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ee41542c0 0x7f7ee4071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f7ee3400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ee41542c0 0x7f7ee4071350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:50126/0 (socket says 172.21.15.32:50126) 2024-03-19T06:21:15.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f7ee3400640 1 -- 172.21.15.32:0/3034978525 learned_addr learned my addr 172.21.15.32:0/3034978525 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f008ca00640 1 -- 172.21.15.32:0/635470617 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008815def0 con 0x7f00880b6960 2024-03-19T06:21:15.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f0087200640 1 --2- 172.21.15.32:0/635470617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00880d1b90 0x7f0088161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f008ca00640 1 -- 172.21.15.32:0/635470617 --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00880b6e40 con 0x7f008815db10 2024-03-19T06:21:15.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f008ca00640 1 -- 172.21.15.32:0/635470617 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00880b7120 con 0x7f00880d1b90 2024-03-19T06:21:15.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f0085e00640 1 --2- 172.21.15.32:0/635470617 >> v2:172.21.15.32:3300/0 conn(0x7f00880b6960 0x7f0088161610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f7ee3400640 1 -- 172.21.15.32:0/3034978525 >> v2:172.21.15.32:3300/0 conn(0x7f7ee40d00d0 msgr2=0x7f7ee4153d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:21:15.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7fd7e2800640 1 -- 172.21.15.32:0/3447777218 >> v1:172.21.15.171:6789/0 conn(0x7fd7e40ca790 legacy=0x7fd7e406e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f7ee3400640 1 --2- 172.21.15.32:0/3034978525 >> v2:172.21.15.32:3300/0 conn(0x7f7ee40d00d0 0x7f7ee4153d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.308+0000 7f7ee3400640 1 -- 172.21.15.32:0/3034978525 >> v1:172.21.15.171:6789/0 conn(0x7f7ee4071890 legacy=0x7f7ee40ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7f7ee3400640 1 -- 172.21.15.32:0/3034978525 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee40cb370 con 0x7f7ee41542c0 2024-03-19T06:21:15.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7f0087200640 1 -- 172.21.15.32:0/635470617 >> v2:172.21.15.171:3300/0 conn(0x7f008815db10 msgr2=0x7f00880b9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7f0087200640 1 --2- 172.21.15.32:0/635470617 >> v2:172.21.15.171:3300/0 conn(0x7f008815db10 0x7f00880b9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7f0087200640 1 -- 172.21.15.32:0/635470617 >> v2:172.21.15.32:3300/0 conn(0x7f00880b6960 msgr2=0x7f0088161610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7f0087200640 1 --2- 172.21.15.32:0/635470617 >> v2:172.21.15.32:3300/0 conn(0x7f00880b6960 0x7f0088161610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7f0087200640 1 -- 172.21.15.32:0/635470617 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00880b7400 con 0x7f00880d1b90 2024-03-19T06:21:15.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7fb438a00640 1 --2- 172.21.15.32:0/346693408 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb41c0039c0 0x7fb41c003de0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb428009ae0 tx=0x7fb42801ca20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26f325d12ea38caa server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7fb433400640 1 -- 172.21.15.32:0/346693408 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4280b2070 con 0x7fb41c0039c0 2024-03-19T06:21:15.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7fb433400640 1 -- 172.21.15.32:0/346693408 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4280a5560 con 0x7fb41c0039c0 2024-03-19T06:21:15.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7fb433400640 1 -- 172.21.15.32:0/346693408 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4280096b0 con 0x7fb41c0039c0 2024-03-19T06:21:15.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7fd7e2800640 1 -- 172.21.15.32:0/3447777218 >> v1:172.21.15.32:6789/0 conn(0x7fd7e4071890 legacy=0x7fd7e40ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7fd7e2800640 1 -- 172.21.15.32:0/3447777218 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e40cb650 con 0x7fd7e4153fe0 2024-03-19T06:21:15.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7f1e30c00640 1 Processor -- start 2024-03-19T06:21:15.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7fb439e00640 1 -- 172.21.15.32:0/346693408 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb41c0039c0 msgr2=0x7fb41c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7fb439e00640 1 --2- 172.21.15.32:0/346693408 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb41c0039c0 0x7fb41c003de0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb428009ae0 tx=0x7fb42801ca20 comp rx=0 tx=0).stop 2024-03-19T06:21:15.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7f0fe6000640 1 Processor -- start 2024-03-19T06:21:15.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7f0fe6000640 1 -- start start 2024-03-19T06:21:15.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7fb439e00640 1 -- 172.21.15.32:0/346693408 shutdown_connections 2024-03-19T06:21:15.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7fb439e00640 1 --2- 172.21.15.32:0/346693408 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb41c0039c0 0x7fb41c003de0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7fb439e00640 1 -- 172.21.15.32:0/346693408 >> 172.21.15.32:0/346693408 conn(0x7fb42c055360 msgr2=0x7fb42c055770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7fb439e00640 1 -- 172.21.15.32:0/346693408 shutdown_connections 2024-03-19T06:21:15.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0087200640 1 --2- 172.21.15.32:0/635470617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00880d1b90 0x7f0088161b50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f008808be20 tx=0x7f008001c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ed958c4a341dfd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.312+0000 7f1e30c00640 1 -- start start 2024-03-19T06:21:15.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f1e30c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1e240535e0 0x7f1e240381e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f1e30c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1e240e7a50 0x7f1e24057d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f1e30c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e24056f50 con 0x7f1e2403eb70 2024-03-19T06:21:15.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f1e30c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e24057230 con 0x7f1e240535e0 2024-03-19T06:21:15.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f1e30c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e24057510 con 0x7f1e240e7a50 2024-03-19T06:21:15.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f7ee3400640 1 --2- 172.21.15.32:0/3034978525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ee41542c0 0x7f7ee4071350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009870 tx=0x7f7ed401c580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb1906af03aadc67 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0085400640 1 -- 172.21.15.32:0/635470617 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00800b2070 con 0x7f00880d1b90 2024-03-19T06:21:15.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0fe6000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0fe0162050 0x7f0fe00c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0fe6000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe006d590 0x7f0fe00cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0fe6000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0fe006d9f0 0x7f0fe00cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0fe6000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe0165c40 con 0x7f0fe0162050 2024-03-19T06:21:15.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0fe6000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe00cdcf0 con 0x7f0fe006d9f0 2024-03-19T06:21:15.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0fe6000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe00cdfd0 con 0x7f0fe006d590 2024-03-19T06:21:15.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0085400640 1 -- 172.21.15.32:0/635470617 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00800a5880 con 0x7f00880d1b90 2024-03-19T06:21:15.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0085400640 1 -- 172.21.15.32:0/635470617 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00800a5c50 con 0x7f00880d1b90 2024-03-19T06:21:15.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7fb439e00640 1 -- 172.21.15.32:0/346693408 wait complete. 2024-03-19T06:21:15.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f7ee2a00640 1 -- 172.21.15.32:0/3034978525 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed40b2070 con 0x7f7ee41542c0 2024-03-19T06:21:15.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f7ee2a00640 1 -- 172.21.15.32:0/3034978525 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed40ad680 con 0x7f7ee41542c0 2024-03-19T06:21:15.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f7ee2a00640 1 -- 172.21.15.32:0/3034978525 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed40ada50 con 0x7f7ee41542c0 2024-03-19T06:21:15.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f1e2aa00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1e240e7a50 0x7f1e24057d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f54eae00640 1 Processor -- start 2024-03-19T06:21:15.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f54eae00640 1 -- start start 2024-03-19T06:21:15.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f008ca00640 1 -- 172.21.15.32:0/635470617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00880d1b90 msgr2=0x7f0088161b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f008ca00640 1 --2- 172.21.15.32:0/635470617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00880d1b90 0x7f0088161b50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f008808be20 tx=0x7f008001c910 comp rx=0 tx=0).stop 2024-03-19T06:21:15.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f1e2b400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1e240535e0 0x7f1e240381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f1e2b400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1e240535e0 0x7f1e240381e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45236/0 (socket says 172.21.15.32:45236) 2024-03-19T06:21:15.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f1e2b400640 1 -- 172.21.15.32:0/1176114262 learned_addr learned my addr 172.21.15.32:0/1176114262 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0fdfe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0fe006d9f0 0x7f0fe00cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0fdfe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0fe006d9f0 0x7f0fe00cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57106/0 (socket says 172.21.15.32:57106) 2024-03-19T06:21:15.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0fdfe00640 1 -- 172.21.15.32:0/3639415922 learned_addr learned my addr 172.21.15.32:0/3639415922 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0fdfe00640 1 -- 172.21.15.32:0/3639415922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe006d590 msgr2=0x7f0fe00cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0fdea00640 1 --2- 172.21.15.32:0/3639415922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe006d590 0x7f0fe00cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0fdfe00640 1 --2- 172.21.15.32:0/3639415922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe006d590 0x7f0fe00cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0fdfe00640 1 -- 172.21.15.32:0/3639415922 >> v2:172.21.15.32:3300/0 conn(0x7f0fe0162050 msgr2=0x7f0fe00c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0fdfe00640 1 --2- 172.21.15.32:0/3639415922 >> v2:172.21.15.32:3300/0 conn(0x7f0fe0162050 0x7f0fe00c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0fdfe00640 1 -- 172.21.15.32:0/3639415922 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe00ce2b0 con 0x7f0fe006d9f0 2024-03-19T06:21:15.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f0fdea00640 1 --2- 172.21.15.32:0/3639415922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe006d590 0x7f0fe00cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:15.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7fd7e2800640 1 --2- 172.21.15.32:0/3447777218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e4153fe0 0x7fd7e4071350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40097c0 tx=0x7fd7d401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a5e5811265b018 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f008ca00640 1 -- 172.21.15.32:0/635470617 shutdown_connections 2024-03-19T06:21:15.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f008ca00640 1 --2- 172.21.15.32:0/635470617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00880d1b90 0x7f0088161b50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f008ca00640 1 --2- 172.21.15.32:0/635470617 >> v2:172.21.15.32:3300/0 conn(0x7f00880b6960 0x7f0088161610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f008ca00640 1 --2- 172.21.15.32:0/635470617 >> v2:172.21.15.171:3300/0 conn(0x7f008815db10 0x7f00880b9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f008ca00640 1 -- 172.21.15.32:0/635470617 >> 172.21.15.32:0/635470617 conn(0x7f008806c030 msgr2=0x7f008806c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f008ca00640 1 -- 172.21.15.32:0/635470617 shutdown_connections 2024-03-19T06:21:15.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7fb439e00640 1 Processor -- start 2024-03-19T06:21:15.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f7eeb000640 1 -- 172.21.15.32:0/3034978525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ee41542c0 msgr2=0x7f7ee4071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f7eeb000640 1 --2- 172.21.15.32:0/3034978525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ee41542c0 0x7f7ee4071350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009870 tx=0x7f7ed401c580 comp rx=0 tx=0).stop 2024-03-19T06:21:15.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7fb439e00640 1 -- start start 2024-03-19T06:21:15.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7fd7e1e00640 1 -- 172.21.15.32:0/3447777218 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d40b0070 con 0x7fd7e4153fe0 2024-03-19T06:21:15.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f7eeb000640 1 -- 172.21.15.32:0/3034978525 shutdown_connections 2024-03-19T06:21:15.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f7eeb000640 1 --2- 172.21.15.32:0/3034978525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ee41542c0 0x7f7ee4071350 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f7eeb000640 1 --2- 172.21.15.32:0/3034978525 >> v2:172.21.15.32:3300/0 conn(0x7f7ee40d00d0 0x7f7ee4153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f7eeb000640 1 -- 172.21.15.32:0/3034978525 >> 172.21.15.32:0/3034978525 conn(0x7f7ee40cf5b0 msgr2=0x7f7ee40cf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7f008ca00640 1 -- 172.21.15.32:0/635470617 wait complete. 2024-03-19T06:21:15.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.316+0000 7fd7e1e00640 1 -- 172.21.15.32:0/3447777218 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d40ab600 con 0x7fd7e4153fe0 2024-03-19T06:21:15.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f7eeb000640 1 -- 172.21.15.32:0/3034978525 shutdown_connections 2024-03-19T06:21:15.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f1e2aa00640 1 -- 172.21.15.32:0/1176114262 >> v2:172.21.15.32:3300/0 conn(0x7f1e240535e0 msgr2=0x7f1e240381e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f1e2aa00640 1 --2- 172.21.15.32:0/1176114262 >> v2:172.21.15.32:3300/0 conn(0x7f1e240535e0 0x7f1e240381e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f1e2aa00640 1 -- 172.21.15.32:0/1176114262 >> v1:172.21.15.32:6789/0 conn(0x7f1e2403eb70 legacy=0x7f1e240539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f1e2aa00640 1 -- 172.21.15.32:0/1176114262 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e240577f0 con 0x7f1e240e7a50 2024-03-19T06:21:15.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fd7e9400640 1 -- 172.21.15.32:0/3447777218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e4153fe0 msgr2=0x7fd7e4071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fd7e9400640 1 --2- 172.21.15.32:0/3447777218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e4153fe0 0x7fd7e4071350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40097c0 tx=0x7fd7d401c3d0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f54eae00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54e406c460 0x7f54e40acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f54eae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54e415dff0 0x7f54e4154130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f54eae00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e415e520 con 0x7f54e40ae0b0 2024-03-19T06:21:15.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f54eae00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e415f1b0 con 0x7f54e406c460 2024-03-19T06:21:15.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f54eae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e415e800 con 0x7f54e415dff0 2024-03-19T06:21:15.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f1e2b400640 1 --2- 172.21.15.32:0/1176114262 >> v2:172.21.15.32:3300/0 conn(0x7f1e240535e0 0x7f1e240381e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:15.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fd7e9400640 1 -- 172.21.15.32:0/3447777218 shutdown_connections 2024-03-19T06:21:15.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fd7e9400640 1 --2- 172.21.15.32:0/3447777218 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e4153fe0 0x7fd7e4071350 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fb439e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb41c0039c0 0x7fb42c0d1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fd7e9400640 1 -- 172.21.15.32:0/3447777218 >> 172.21.15.32:0/3447777218 conn(0x7fd7e40cf5b0 msgr2=0x7fd7e40cf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f54e3400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54e406c460 0x7f54e40acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fd7e9400640 1 -- 172.21.15.32:0/3447777218 shutdown_connections 2024-03-19T06:21:15.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fd7e9400640 1 -- 172.21.15.32:0/3447777218 wait complete. 2024-03-19T06:21:15.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fb439e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb42c04c430 0x7fb42c04c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f54e8e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54e415dff0 0x7f54e4154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f54e8e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54e415dff0 0x7f54e4154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:50142/0 (socket says 172.21.15.32:50142) 2024-03-19T06:21:15.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f54e8e00640 1 -- 172.21.15.32:0/1951543778 learned_addr learned my addr 172.21.15.32:0/1951543778 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f54e3e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f54e40ae0b0 0x7f54e406bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47618/0 (socket says 172.21.15.32:47618) 2024-03-19T06:21:15.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fb438a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb41c0039c0 0x7fb42c0d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fb438a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb41c0039c0 0x7fb42c0d1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57112/0 (socket says 172.21.15.32:57112) 2024-03-19T06:21:15.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fb439e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb42c0d20a0 0x7fb42c0d2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f008ca00640 1 Processor -- start 2024-03-19T06:21:15.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f7eeb000640 1 -- 172.21.15.32:0/3034978525 wait complete. 2024-03-19T06:21:15.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f7eeb000640 1 Processor -- start 2024-03-19T06:21:15.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f165d000640 1 Processor -- start 2024-03-19T06:21:15.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fb438a00640 1 -- 172.21.15.32:0/927422867 learned_addr learned my addr 172.21.15.32:0/927422867 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f54e8e00640 1 -- 172.21.15.32:0/1951543778 >> v2:172.21.15.32:3300/0 conn(0x7f54e406c460 msgr2=0x7f54e40acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f54e8e00640 1 --2- 172.21.15.32:0/1951543778 >> v2:172.21.15.32:3300/0 conn(0x7f54e406c460 0x7f54e40acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f54e2a00640 1 -- 172.21.15.32:0/1951543778 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082195067 0 0) 0x7f54e415e520 con 0x7f54e40ae0b0 2024-03-19T06:21:15.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fb433e00640 1 --2- 172.21.15.32:0/927422867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb42c04c430 0x7fb42c04c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f165d000640 1 -- start start 2024-03-19T06:21:15.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f008ca00640 1 -- start start 2024-03-19T06:21:15.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f54e8e00640 1 -- 172.21.15.32:0/1951543778 >> v1:172.21.15.32:6789/0 conn(0x7f54e40ae0b0 legacy=0x7f54e406bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f0fdfe00640 1 --2- 172.21.15.32:0/3639415922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe006d9f0 0x7f0fe00cc4d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0068a70 tx=0x7f0fd001c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24feebb7a44fb2ca server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7f54e8e00640 1 -- 172.21.15.32:0/1951543778 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e415eae0 con 0x7f54e415dff0 2024-03-19T06:21:15.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fb439400640 1 --2- 172.21.15.32:0/927422867 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb42c0d20a0 0x7fb42c0d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fb439e00640 1 -- 172.21.15.32:0/927422867 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c008270 con 0x7fb42c04c430 2024-03-19T06:21:15.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.320+0000 7fb439e00640 1 -- 172.21.15.32:0/927422867 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c0080f0 con 0x7fb41c0039c0 2024-03-19T06:21:15.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fb439e00640 1 -- 172.21.15.32:0/927422867 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c0083f0 con 0x7fb42c0d20a0 2024-03-19T06:21:15.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fd7e9400640 1 Processor -- start 2024-03-19T06:21:15.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f0fde000640 1 -- 172.21.15.32:0/3639415922 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd00b0070 con 0x7f0fe006d9f0 2024-03-19T06:21:15.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f7eeb000640 1 -- start start 2024-03-19T06:21:15.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f0fde000640 1 -- 172.21.15.32:0/3639415922 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd00ab600 con 0x7f0fe006d9f0 2024-03-19T06:21:15.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f0fde000640 1 -- 172.21.15.32:0/3639415922 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd00ab9d0 con 0x7f0fe006d9f0 2024-03-19T06:21:15.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f165d000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f165815db20 0x7f16580b9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f165d000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f16580b5b60 0x7f16580d2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f165d000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165806ca10 con 0x7f165806c230 2024-03-19T06:21:15.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f165d000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16580d1e10 con 0x7f16580b5b60 2024-03-19T06:21:15.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f165d000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165806ccf0 con 0x7f165815db20 2024-03-19T06:21:15.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fd7e9400640 1 -- start start 2024-03-19T06:21:15.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fb439400640 1 -- 172.21.15.32:0/927422867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb41c0039c0 msgr2=0x7fb42c0d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fb439400640 1 --2- 172.21.15.32:0/927422867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb41c0039c0 0x7fb42c0d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fb439400640 1 -- 172.21.15.32:0/927422867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb42c04c430 msgr2=0x7fb42c04c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f008ca00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00880b6960 0x7f00880c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fb439400640 1 --2- 172.21.15.32:0/927422867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb42c04c430 0x7fb42c04c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fb439400640 1 -- 172.21.15.32:0/927422867 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c04cef0 con 0x7fb42c0d20a0 2024-03-19T06:21:15.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f1e2aa00640 1 --2- 172.21.15.32:0/1176114262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e240e7a50 0x7f1e24057d10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1e240085a0 tx=0x7f1e1801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ffb0080afd297ef server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f008ca00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00880d1b90 0x7f008814cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fb433e00640 1 --2- 172.21.15.32:0/927422867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb42c04c430 0x7fb42c04c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:15.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f008ca00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f008815db10 0x7f008815e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f1655400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f165806c230 0x7f16580b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47632/0 (socket says 172.21.15.32:47632) 2024-03-19T06:21:15.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f1655400640 1 -- 172.21.15.32:0/354878000 learned_addr learned my addr 172.21.15.32:0/354878000 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:15.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f1655e00640 1 --2- 172.21.15.32:0/354878000 >> v2:172.21.15.171:3300/0 conn(0x7f165815db20 0x7f16580b9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fb439400640 1 --2- 172.21.15.32:0/927422867 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb42c0d20a0 0x7fb42c0d2520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb4340694d0 tx=0x7fb4340688a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f7eeb000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ee4071890 0x7f7ee415f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f7eeb000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ee40d00d0 0x7f7ee415ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f7eeb000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ee41542c0 0x7f7ee415d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f008ca00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00880d09d0 con 0x7f00880b6960 2024-03-19T06:21:15.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f008ca00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00880d0850 con 0x7f00880d1b90 2024-03-19T06:21:15.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f008ca00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00880d0b50 con 0x7f008815db10 2024-03-19T06:21:15.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f0087200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f008815db10 0x7f008815e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f0087200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f008815db10 0x7f008815e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:50162/0 (socket says 172.21.15.32:50162) 2024-03-19T06:21:15.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f0087200640 1 -- 172.21.15.32:0/3180192165 learned_addr learned my addr 172.21.15.32:0/3180192165 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f0085e00640 1 --2- 172.21.15.32:0/3180192165 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00880d1b90 0x7f008814cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f0086800640 1 --2- 172.21.15.32:0/3180192165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00880b6960 0x7f00880c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f7ee3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ee4071890 0x7f7ee415f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f7ee3400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ee40d00d0 0x7f7ee415ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f7ee3400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ee40d00d0 0x7f7ee415ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57152/0 (socket says 172.21.15.32:57152) 2024-03-19T06:21:15.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f7eeb000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee406f1c0 con 0x7f7ee4071890 2024-03-19T06:21:15.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f7ee3400640 1 -- 172.21.15.32:0/365862160 learned_addr learned my addr 172.21.15.32:0/365862160 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f0087200640 1 -- 172.21.15.32:0/3180192165 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00880d1b90 msgr2=0x7f008814cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f0087200640 1 --2- 172.21.15.32:0/3180192165 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00880d1b90 0x7f008814cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f0087200640 1 -- 172.21.15.32:0/3180192165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00880b6960 msgr2=0x7f00880c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f0087200640 1 --2- 172.21.15.32:0/3180192165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00880b6960 0x7f00880c9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f0087200640 1 -- 172.21.15.32:0/3180192165 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0088153720 con 0x7f008815db10 2024-03-19T06:21:15.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f1656800640 1 --2- 172.21.15.32:0/354878000 >> v2:172.21.15.32:3300/0 conn(0x7f16580b5b60 0x7f16580d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fb430c00640 1 -- 172.21.15.32:0/927422867 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434097070 con 0x7fb42c0d20a0 2024-03-19T06:21:15.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fb439e00640 1 -- 172.21.15.32:0/927422867 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42c04d1d0 con 0x7fb42c0d20a0 2024-03-19T06:21:15.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fd7e9400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7e4071890 0x7fd7e414ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fd7e9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e40ca790 0x7fd7e414f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fd7e9400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7e4153fe0 0x7fd7e40af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fd7e9400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e41545d0 con 0x7fd7e40ca790 2024-03-19T06:21:15.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fd7e9400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e40d0320 con 0x7fd7e4071890 2024-03-19T06:21:15.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fd7e9400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e406f540 con 0x7fd7e4153fe0 2024-03-19T06:21:15.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f7ee9000640 1 --2- 172.21.15.32:0/365862160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ee41542c0 0x7f7ee415d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f7eeb000640 1 -- 172.21.15.32:0/365862160 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee406f040 con 0x7f7ee40d00d0 2024-03-19T06:21:15.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f7eeb000640 1 -- 172.21.15.32:0/365862160 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee406f340 con 0x7f7ee41542c0 2024-03-19T06:21:15.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f1655e00640 1 -- 172.21.15.32:0/354878000 >> v2:172.21.15.32:3300/0 conn(0x7f16580b5b60 msgr2=0x7f16580d2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f1655e00640 1 --2- 172.21.15.32:0/354878000 >> v2:172.21.15.32:3300/0 conn(0x7f16580b5b60 0x7f16580d2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f1655e00640 1 -- 172.21.15.32:0/354878000 >> v1:172.21.15.32:6789/0 conn(0x7f165806c230 legacy=0x7f16580b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f1655e00640 1 -- 172.21.15.32:0/354878000 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165806cfd0 con 0x7f165815db20 2024-03-19T06:21:15.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f1656800640 1 --2- 172.21.15.32:0/354878000 >> v2:172.21.15.32:3300/0 conn(0x7f16580b5b60 0x7f16580d2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:15.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fd7d9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e40ca790 0x7fd7e414f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fd7d9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e40ca790 0x7fd7e414f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45308/0 (socket says 172.21.15.32:45308) 2024-03-19T06:21:15.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fd7d9e00640 1 -- 172.21.15.32:0/3476223569 learned_addr learned my addr 172.21.15.32:0/3476223569 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f0085e00640 1 --2- 172.21.15.32:0/3180192165 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00880d1b90 0x7f008814cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:15.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f0087200640 1 --2- 172.21.15.32:0/3180192165 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f008815db10 0x7f008815e070 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f008001d1b0 tx=0x7f00800196b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f1e2a000640 1 -- 172.21.15.32:0/1176114262 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e180b5070 con 0x7f1e240e7a50 2024-03-19T06:21:15.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f1e2a000640 1 -- 172.21.15.32:0/1176114262 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e180a8970 con 0x7f1e240e7a50 2024-03-19T06:21:15.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7f1e2a000640 1 -- 172.21.15.32:0/1176114262 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e180a8d40 con 0x7f1e240e7a50 2024-03-19T06:21:15.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.324+0000 7fb430c00640 1 -- 172.21.15.32:0/927422867 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4340746a0 con 0x7fb42c0d20a0 2024-03-19T06:21:15.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7fb430c00640 1 -- 172.21.15.32:0/927422867 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434097070 con 0x7fb42c0d20a0 2024-03-19T06:21:15.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f007ea00640 1 -- 172.21.15.32:0/3180192165 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00800bb020 con 0x7f008815db10 2024-03-19T06:21:15.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f007ea00640 1 -- 172.21.15.32:0/3180192165 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00800ad640 con 0x7f008815db10 2024-03-19T06:21:15.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f007ea00640 1 -- 172.21.15.32:0/3180192165 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00800b2040 con 0x7f008815db10 2024-03-19T06:21:15.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f008ca00640 1 -- 172.21.15.32:0/3180192165 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00880cba00 con 0x7f008815db10 2024-03-19T06:21:15.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f008ca00640 1 -- 172.21.15.32:0/3180192165 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00880cbfc0 con 0x7f008815db10 2024-03-19T06:21:15.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f0fe6000640 1 -- 172.21.15.32:0/3639415922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe006d9f0 msgr2=0x7f0fe00cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f0fe6000640 1 --2- 172.21.15.32:0/3639415922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe006d9f0 0x7f0fe00cc4d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0068a70 tx=0x7f0fd001c520 comp rx=0 tx=0).stop 2024-03-19T06:21:15.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f0fe6000640 1 -- 172.21.15.32:0/3639415922 shutdown_connections 2024-03-19T06:21:15.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f0fe6000640 1 --2- 172.21.15.32:0/3639415922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe006d9f0 0x7f0fe00cc4d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7fd7d9e00640 1 -- 172.21.15.32:0/3476223569 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7e4153fe0 msgr2=0x7fd7e40af1b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-19T06:21:15.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f0fe6000640 1 --2- 172.21.15.32:0/3639415922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe006d590 0x7f0fe00cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7fd7d9e00640 1 --2- 172.21.15.32:0/3476223569 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7e4153fe0 0x7fd7e40af1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7fd7d9e00640 1 -- 172.21.15.32:0/3476223569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7e4071890 msgr2=0x7fd7e414ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7fd7d9e00640 1 --2- 172.21.15.32:0/3476223569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7e4071890 0x7fd7e414ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7fd7d9e00640 1 -- 172.21.15.32:0/3476223569 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e414dd20 con 0x7fd7e40ca790 2024-03-19T06:21:15.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f1e30c00640 1 -- 172.21.15.32:0/1176114262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e240e7a50 msgr2=0x7f1e24057d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f7ee9000640 1 -- 172.21.15.32:0/365862160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ee40d00d0 msgr2=0x7f7ee415ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f1e30c00640 1 --2- 172.21.15.32:0/1176114262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e240e7a50 0x7f1e24057d10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1e240085a0 tx=0x7f1e1801ec70 comp rx=0 tx=0).stop 2024-03-19T06:21:15.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f0fe6000640 1 --2- 172.21.15.32:0/3639415922 >> v2:172.21.15.32:3300/0 conn(0x7f0fe0162050 0x7f0fe00c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f7ee9000640 1 --2- 172.21.15.32:0/365862160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ee40d00d0 0x7f7ee415ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f7ee9000640 1 -- 172.21.15.32:0/365862160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ee4071890 msgr2=0x7f7ee415f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f7ee9000640 1 --2- 172.21.15.32:0/365862160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ee4071890 0x7f7ee415f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f7ee9000640 1 -- 172.21.15.32:0/365862160 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee4168e90 con 0x7f7ee41542c0 2024-03-19T06:21:15.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f0fe6000640 1 -- 172.21.15.32:0/3639415922 >> 172.21.15.32:0/3639415922 conn(0x7f0fe00b1280 msgr2=0x7f0fe00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f7ee3e00640 1 --2- 172.21.15.32:0/365862160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ee4071890 0x7f7ee415f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:15.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7fb439e00640 1 -- 172.21.15.32:0/927422867 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42c0d86a0 con 0x7fb42c0d20a0 2024-03-19T06:21:15.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f1e30c00640 1 -- 172.21.15.32:0/1176114262 shutdown_connections 2024-03-19T06:21:15.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f1e30c00640 1 --2- 172.21.15.32:0/1176114262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e240e7a50 0x7f1e24057d10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f1e30c00640 1 --2- 172.21.15.32:0/1176114262 >> v2:172.21.15.32:3300/0 conn(0x7f1e240535e0 0x7f1e240381e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f1e30c00640 1 -- 172.21.15.32:0/1176114262 >> 172.21.15.32:0/1176114262 conn(0x7f1e2400ff20 msgr2=0x7f1e24010330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f0fe6000640 1 -- 172.21.15.32:0/3639415922 shutdown_connections 2024-03-19T06:21:15.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f0fe6000640 1 -- 172.21.15.32:0/3639415922 wait complete. 2024-03-19T06:21:15.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f7ee9000640 1 --2- 172.21.15.32:0/365862160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ee41542c0 0x7f7ee415d650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00c730 tx=0x7f7edc00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7fd7d9e00640 1 --2- 172.21.15.32:0/3476223569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e40ca790 0x7fd7e414f270 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc00c420 tx=0x7fd7cc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f54e8e00640 1 --2- 172.21.15.32:0/1951543778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54e415dff0 0x7f54e4154130 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009e50 tx=0x7f54dc01ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec835cb2966be7d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f008ca00640 1 -- 172.21.15.32:0/3180192165 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00880cb820 con 0x7f008815db10 2024-03-19T06:21:15.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f54e2a00640 1 -- 172.21.15.32:0/1951543778 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc0a5700 con 0x7f54e415dff0 2024-03-19T06:21:15.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f54e2a00640 1 -- 172.21.15.32:0/1951543778 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc0a58a0 con 0x7f54e415dff0 2024-03-19T06:21:15.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f54e2a00640 1 -- 172.21.15.32:0/1951543778 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc0a5700 con 0x7f54e415dff0 2024-03-19T06:21:15.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7fb439e00640 1 -- 172.21.15.32:0/927422867 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb42c0057f0 con 0x7fb42c0d20a0 2024-03-19T06:21:15.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f1e30c00640 1 -- 172.21.15.32:0/1176114262 shutdown_connections 2024-03-19T06:21:15.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f7edbe00640 1 -- 172.21.15.32:0/365862160 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc016020 con 0x7f7ee41542c0 2024-03-19T06:21:15.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f7edbe00640 1 -- 172.21.15.32:0/365862160 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc006d60 con 0x7f7ee41542c0 2024-03-19T06:21:15.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f7edbe00640 1 -- 172.21.15.32:0/365862160 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc003bc0 con 0x7f7ee41542c0 2024-03-19T06:21:15.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f007ea00640 1 -- 172.21.15.32:0/3180192165 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f00800be020 con 0x7f008815db10 2024-03-19T06:21:15.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f54eae00640 1 -- 172.21.15.32:0/1951543778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54e415dff0 msgr2=0x7f54e4154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f54eae00640 1 --2- 172.21.15.32:0/1951543778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54e415dff0 0x7f54e4154130 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009e50 tx=0x7f54dc01ca30 comp rx=0 tx=0).stop 2024-03-19T06:21:15.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f1e30c00640 1 -- 172.21.15.32:0/1176114262 wait complete. 2024-03-19T06:21:15.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f54eae00640 1 -- 172.21.15.32:0/1951543778 shutdown_connections 2024-03-19T06:21:15.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f54eae00640 1 --2- 172.21.15.32:0/1951543778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54e415dff0 0x7f54e4154130 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f54eae00640 1 --2- 172.21.15.32:0/1951543778 >> v2:172.21.15.32:3300/0 conn(0x7f54e406c460 0x7f54e40acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.328+0000 7f54eae00640 1 -- 172.21.15.32:0/1951543778 >> 172.21.15.32:0/1951543778 conn(0x7f54e4071c50 msgr2=0x7f54e4072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f007ea00640 1 --2- 172.21.15.32:0/3180192165 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f00680676e0 0x7f0068069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f007ea00640 1 -- 172.21.15.32:0/3180192165 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0080002020 con 0x7f008815db10 2024-03-19T06:21:15.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f007ea00640 1 --2- 172.21.15.32:0/3180192165 >> [v2:172.21.15.32:6824/1835843146,v1:172.21.15.32:6825/1835843146] conn(0x7f006806f960 0x7f0068071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f007ea00640 1 -- 172.21.15.32:0/3180192165 --> [v2:172.21.15.32:6824/1835843146,v1:172.21.15.32:6825/1835843146] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00800b0e70 con 0x7f006806f960 2024-03-19T06:21:15.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f007ea00640 1 -- 172.21.15.32:0/3180192165 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00801242a0 con 0x7f008815db10 2024-03-19T06:21:15.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f7eeb000640 1 -- 172.21.15.32:0/365862160 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee415fd60 con 0x7f7ee41542c0 2024-03-19T06:21:15.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f7eeb000640 1 -- 172.21.15.32:0/365862160 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee4163390 con 0x7f7ee41542c0 2024-03-19T06:21:15.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f54eae00640 1 -- 172.21.15.32:0/1951543778 shutdown_connections 2024-03-19T06:21:15.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f54eae00640 1 -- 172.21.15.32:0/1951543778 wait complete. 2024-03-19T06:21:15.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7fd7db400640 1 -- 172.21.15.32:0/3476223569 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc017070 con 0x7fd7e40ca790 2024-03-19T06:21:15.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7fd7db400640 1 -- 172.21.15.32:0/3476223569 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc005cf0 con 0x7fd7e40ca790 2024-03-19T06:21:15.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7fd7db400640 1 -- 172.21.15.32:0/3476223569 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc0072d0 con 0x7fd7e40ca790 2024-03-19T06:21:15.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f0fe6000640 1 Processor -- start 2024-03-19T06:21:15.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f0086800640 1 --2- 172.21.15.32:0/3180192165 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f00680676e0 0x7f0068069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7fb430c00640 1 -- 172.21.15.32:0/927422867 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb43409a070 con 0x7fb42c0d20a0 2024-03-19T06:21:15.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f0085e00640 1 --2- 172.21.15.32:0/3180192165 >> [v2:172.21.15.32:6824/1835843146,v1:172.21.15.32:6825/1835843146] conn(0x7f006806f960 0x7f0068071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f0fe6000640 1 -- start start 2024-03-19T06:21:15.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f7eeb000640 1 -- 172.21.15.32:0/365862160 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ee40749e0 con 0x7f7ee41542c0 2024-03-19T06:21:15.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7fd7e9400640 1 -- 172.21.15.32:0/3476223569 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e414dfc0 con 0x7fd7e40ca790 2024-03-19T06:21:15.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f1e30c00640 1 Processor -- start 2024-03-19T06:21:15.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f1e30c00640 1 -- start start 2024-03-19T06:21:15.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f0085e00640 1 --2- 172.21.15.32:0/3180192165 >> [v2:172.21.15.32:6824/1835843146,v1:172.21.15.32:6825/1835843146] conn(0x7f006806f960 0x7f0068071d80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f0fe6000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe006d590 0x7f0fe0156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7fb430c00640 1 --2- 172.21.15.32:0/927422867 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb414067820 0x7fb414069ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7fb430c00640 1 -- 172.21.15.32:0/927422867 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4340ffab0 con 0x7fb42c0d20a0 2024-03-19T06:21:15.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7fb430c00640 1 --2- 172.21.15.32:0/927422867 >> [v2:172.21.15.32:6808/2787806963,v1:172.21.15.32:6809/2787806963] conn(0x7fb41406fa40 0x7fb414071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7fb430c00640 1 -- 172.21.15.32:0/927422867 --> [v2:172.21.15.32:6808/2787806963,v1:172.21.15.32:6809/2787806963] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb434072fb0 con 0x7fb41406fa40 2024-03-19T06:21:15.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7fb430c00640 1 -- 172.21.15.32:0/927422867 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4340ffea0 con 0x7fb42c0d20a0 2024-03-19T06:21:15.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7fb438a00640 1 --2- 172.21.15.32:0/927422867 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb414067820 0x7fb414069ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7fd7e9400640 1 -- 172.21.15.32:0/3476223569 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e414e580 con 0x7fd7e40ca790 2024-03-19T06:21:15.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7fd7e9400640 1 -- 172.21.15.32:0/3476223569 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7e40749e0 con 0x7fd7e40ca790 2024-03-19T06:21:15.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f0086800640 1 --2- 172.21.15.32:0/3180192165 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f00680676e0 0x7f0068069ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0078009ab0 tx=0x7f0078009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f0fe6000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe006d9f0 0x7f0fe01361a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f0fdf400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe006d590 0x7f0fe0156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f0fdf400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe006d590 0x7f0fe0156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:50186/0 (socket says 172.21.15.32:50186) 2024-03-19T06:21:15.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f0fdea00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe006d9f0 0x7f0fe01361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f0fdea00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe006d9f0 0x7f0fe01361a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57164/0 (socket says 172.21.15.32:57164) 2024-03-19T06:21:15.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f0fdf400640 1 -- 172.21.15.32:0/4207996421 learned_addr learned my addr 172.21.15.32:0/4207996421 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f0fe6000640 1 --2- 172.21.15.32:0/4207996421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fe0162050 0x7f0fe0149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f1655e00640 1 --2- 172.21.15.32:0/354878000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f165815db20 0x7f16580b9590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f165806aea0 tx=0x7f165001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c1fdb308e5fde14 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f54eae00640 1 Processor -- start 2024-03-19T06:21:15.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f54eae00640 1 -- start start 2024-03-19T06:21:15.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f0fdfe00640 1 --2- 172.21.15.32:0/4207996421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fe0162050 0x7f0fe0149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e30c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e2403eb70 0x7f1e240e3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e30c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e240535e0 0x7f1e2404d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e30c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e240e7a50 0x7f1e240e97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e30c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2403bf60 con 0x7f1e2403eb70 2024-03-19T06:21:15.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e30c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2403bde0 con 0x7f1e240e7a50 2024-03-19T06:21:15.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e30c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2403c0e0 con 0x7f1e240535e0 2024-03-19T06:21:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f0fe6000640 1 -- 172.21.15.32:0/4207996421 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe00ca2c0 con 0x7f0fe0162050 2024-03-19T06:21:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f0fe6000640 1 -- 172.21.15.32:0/4207996421 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe00ca140 con 0x7f0fe006d9f0 2024-03-19T06:21:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f0fe6000640 1 -- 172.21.15.32:0/4207996421 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe01668e0 con 0x7f0fe006d590 2024-03-19T06:21:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.332+0000 7f7edbe00640 1 -- 172.21.15.32:0/365862160 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7edc0050d0 con 0x7f7ee41542c0 2024-03-19T06:21:15.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1654a00640 1 -- 172.21.15.32:0/354878000 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16500b2070 con 0x7f165815db20 2024-03-19T06:21:15.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1654a00640 1 -- 172.21.15.32:0/354878000 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16500a59a0 con 0x7f165815db20 2024-03-19T06:21:15.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1654a00640 1 -- 172.21.15.32:0/354878000 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16500a5d70 con 0x7f165815db20 2024-03-19T06:21:15.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f007ea00640 1 -- 172.21.15.32:0/3180192165 <== osd.2 v2:172.21.15.32:6824/1835843146 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f00800b0e70 con 0x7f006806f960 2024-03-19T06:21:15.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7fb438a00640 1 --2- 172.21.15.32:0/927422867 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb414067820 0x7fb414069ce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0df4d0 tx=0x7fb428008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e2be00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e240e7a50 0x7f1e240e97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f7edbe00640 1 --2- 172.21.15.32:0/365862160 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7ec40676b0 0x7f7ec4069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f54eae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54e406c460 0x7f54e4147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f54eae00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54e40ae0b0 0x7f54e4133910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f7edbe00640 1 -- 172.21.15.32:0/365862160 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7edc0855b0 con 0x7f7ee41542c0 2024-03-19T06:21:15.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f7edbe00640 1 --2- 172.21.15.32:0/365862160 >> [v2:172.21.15.171:6808/3784639902,v1:172.21.15.171:6809/3784639902] conn(0x7f7ec406f8d0 0x7f7ec4071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f54eae00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54e415dff0 0x7f54e40b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f54eae00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e415f7c0 con 0x7f54e40ae0b0 2024-03-19T06:21:15.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f54eae00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e415f640 con 0x7f54e415dff0 2024-03-19T06:21:15.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f54eae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e415f940 con 0x7f54e406c460 2024-03-19T06:21:15.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7fb433e00640 1 --2- 172.21.15.32:0/927422867 >> [v2:172.21.15.32:6808/2787806963,v1:172.21.15.32:6809/2787806963] conn(0x7fb41406fa40 0x7fb414071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f0fdf400640 1 -- 172.21.15.32:0/4207996421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe006d9f0 msgr2=0x7f0fe01361a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f0fdf400640 1 --2- 172.21.15.32:0/4207996421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe006d9f0 0x7f0fe01361a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f0fdf400640 1 -- 172.21.15.32:0/4207996421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fe0162050 msgr2=0x7f0fe0149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f0fdf400640 1 --2- 172.21.15.32:0/4207996421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fe0162050 0x7f0fe0149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f0fdf400640 1 -- 172.21.15.32:0/4207996421 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe0156850 con 0x7f0fe006d590 2024-03-19T06:21:15.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f7edbe00640 1 -- 172.21.15.32:0/365862160 --> [v2:172.21.15.171:6808/3784639902,v1:172.21.15.171:6809/3784639902] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7edc01ae50 con 0x7f7ec406f8d0 2024-03-19T06:21:15.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e2be00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e240e7a50 0x7f1e240e97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57174/0 (socket says 172.21.15.32:57174) 2024-03-19T06:21:15.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e2aa00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e240535e0 0x7f1e2404d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e2aa00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e240535e0 0x7f1e2404d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:50198/0 (socket says 172.21.15.32:50198) 2024-03-19T06:21:15.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f7edbe00640 1 -- 172.21.15.32:0/365862160 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7edc085a90 con 0x7f7ee41542c0 2024-03-19T06:21:15.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f165d000640 1 -- 172.21.15.32:0/354878000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f165815db20 msgr2=0x7f16580b9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f165d000640 1 --2- 172.21.15.32:0/354878000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f165815db20 0x7f16580b9590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f165806aea0 tx=0x7f165001c920 comp rx=0 tx=0).stop 2024-03-19T06:21:15.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e2aa00640 1 -- 172.21.15.32:0/4164056125 learned_addr learned my addr 172.21.15.32:0/4164056125 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f7ee3e00640 1 --2- 172.21.15.32:0/365862160 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7ec40676b0 0x7f7ec4069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f0fdf400640 1 --2- 172.21.15.32:0/4207996421 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe006d590 0x7f0fe0156150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800b440 tx=0x7f0fc800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f165d000640 1 -- 172.21.15.32:0/354878000 shutdown_connections 2024-03-19T06:21:15.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f165d000640 1 --2- 172.21.15.32:0/354878000 >> v2:172.21.15.32:3300/0 conn(0x7f16580b5b60 0x7f16580d2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f165d000640 1 --2- 172.21.15.32:0/354878000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f165815db20 0x7f16580b9590 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f165d000640 1 -- 172.21.15.32:0/354878000 >> 172.21.15.32:0/354878000 conn(0x7f16580d0450 msgr2=0x7f16580d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f54e8e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54e415dff0 0x7f54e40b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f54e8e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54e415dff0 0x7f54e40b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57184/0 (socket says 172.21.15.32:57184) 2024-03-19T06:21:15.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f54e8e00640 1 -- 172.21.15.32:0/3641414914 learned_addr learned my addr 172.21.15.32:0/3641414914 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f7ee3400640 1 --2- 172.21.15.32:0/365862160 >> [v2:172.21.15.171:6808/3784639902,v1:172.21.15.171:6809/3784639902] conn(0x7f7ec406f8d0 0x7f7ec4071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f165d000640 1 -- 172.21.15.32:0/354878000 shutdown_connections 2024-03-19T06:21:15.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f165d000640 1 -- 172.21.15.32:0/354878000 wait complete. 2024-03-19T06:21:15.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f0fd7400640 1 -- 172.21.15.32:0/4207996421 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8015020 con 0x7f0fe006d590 2024-03-19T06:21:15.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f0fd7400640 1 -- 172.21.15.32:0/4207996421 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc80118b0 con 0x7f0fe006d590 2024-03-19T06:21:15.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f0fd7400640 1 -- 172.21.15.32:0/4207996421 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8011ca0 con 0x7f0fe006d590 2024-03-19T06:21:15.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f0fe6000640 1 -- 172.21.15.32:0/4207996421 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe0156b30 con 0x7f0fe006d590 2024-03-19T06:21:15.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e2be00640 1 -- 172.21.15.32:0/4164056125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e240535e0 msgr2=0x7f1e2404d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f7ee3400640 1 --2- 172.21.15.32:0/365862160 >> [v2:172.21.15.171:6808/3784639902,v1:172.21.15.171:6809/3784639902] conn(0x7f7ec406f8d0 0x7f7ec4071cf0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e2be00640 1 --2- 172.21.15.32:0/4164056125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e240535e0 0x7f1e2404d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e2b400640 1 --2- 172.21.15.32:0/4164056125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e2403eb70 0x7f1e240e3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e2be00640 1 -- 172.21.15.32:0/4164056125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e2403eb70 msgr2=0x7f1e240e3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f0fe6000640 1 -- 172.21.15.32:0/4207996421 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe015c3b0 con 0x7f0fe006d590 2024-03-19T06:21:15.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f54e3e00640 1 --2- 172.21.15.32:0/3641414914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54e406c460 0x7f54e4147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f54e3400640 1 --2- 172.21.15.32:0/3641414914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54e40ae0b0 0x7f54e4133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e2be00640 1 --2- 172.21.15.32:0/4164056125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e2403eb70 0x7f1e240e3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e2be00640 1 -- 172.21.15.32:0/4164056125 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e240ea1b0 con 0x7f1e240e7a50 2024-03-19T06:21:15.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f1e2b400640 1 --2- 172.21.15.32:0/4164056125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1e2403eb70 0x7f1e240e3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:15.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.336+0000 7f7ee3e00640 1 --2- 172.21.15.32:0/365862160 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7ec40676b0 0x7f7ec4069b70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009920 tx=0x7f7ed0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f54e3400640 1 -- 172.21.15.32:0/3641414914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54e406c460 msgr2=0x7f54e4147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f54e3400640 1 --2- 172.21.15.32:0/3641414914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54e406c460 0x7f54e4147750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f7edbe00640 1 -- 172.21.15.32:0/365862160 <== osd.5 v2:172.21.15.171:6808/3784639902 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7edc01ae50 con 0x7f7ec406f8d0 2024-03-19T06:21:15.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f54e3400640 1 -- 172.21.15.32:0/3641414914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54e415dff0 msgr2=0x7f54e40b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f54e3400640 1 --2- 172.21.15.32:0/3641414914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54e415dff0 0x7f54e40b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7fd7db400640 1 -- 172.21.15.32:0/3476223569 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd7cc01a070 con 0x7fd7e40ca790 2024-03-19T06:21:15.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f1e2be00640 1 --2- 172.21.15.32:0/4164056125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e240e7a50 0x7f1e240e97f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0694d0 tx=0x7f1e2c074520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f54e3400640 1 -- 172.21.15.32:0/3641414914 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e4134210 con 0x7f54e40ae0b0 2024-03-19T06:21:15.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f54e3e00640 1 --2- 172.21.15.32:0/3641414914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54e406c460 0x7f54e4147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:15.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f165d000640 1 Processor -- start 2024-03-19T06:21:15.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f0fe6000640 1 -- 172.21.15.32:0/4207996421 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0fe00749e0 con 0x7f0fe006d590 2024-03-19T06:21:15.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f165d000640 1 -- start start 2024-03-19T06:21:15.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7fb433e00640 1 --2- 172.21.15.32:0/927422867 >> [v2:172.21.15.32:6808/2787806963,v1:172.21.15.32:6809/2787806963] conn(0x7fb41406fa40 0x7fb414071e60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f54e3400640 1 --2- 172.21.15.32:0/3641414914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54e40ae0b0 0x7f54e4133910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f54d000d620 tx=0x7f54d000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f1e1f400640 1 -- 172.21.15.32:0/4164056125 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0731c0 con 0x7f1e240e7a50 2024-03-19T06:21:15.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f1e1f400640 1 -- 172.21.15.32:0/4164056125 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c073360 con 0x7f1e240e7a50 2024-03-19T06:21:15.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7fd7db400640 1 --2- 172.21.15.32:0/3476223569 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd7c0067730 0x7fd7c0069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7fd7db400640 1 -- 172.21.15.32:0/3476223569 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7cc084dd0 con 0x7fd7e40ca790 2024-03-19T06:21:15.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7fd7db400640 1 --2- 172.21.15.32:0/3476223569 >> [v2:172.21.15.32:6800/3354910175,v1:172.21.15.32:6801/3354910175] conn(0x7fd7c006f950 0x7fd7c0071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f1e1f400640 1 -- 172.21.15.32:0/4164056125 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0731c0 con 0x7f1e240e7a50 2024-03-19T06:21:15.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f1e30c00640 1 -- 172.21.15.32:0/4164056125 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e240ea490 con 0x7f1e240e7a50 2024-03-19T06:21:15.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7fd7db400640 1 -- 172.21.15.32:0/3476223569 --> [v2:172.21.15.32:6800/3354910175,v1:172.21.15.32:6801/3354910175] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7c0072420 con 0x7fd7c006f950 2024-03-19T06:21:15.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7fd7db400640 1 -- 172.21.15.32:0/3476223569 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7cc0851c0 con 0x7fd7e40ca790 2024-03-19T06:21:15.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7fb430c00640 1 -- 172.21.15.32:0/927422867 <== osd.0 v2:172.21.15.32:6808/2787806963 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb434072fb0 con 0x7fb41406fa40 2024-03-19T06:21:15.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7fd7e2800640 1 --2- 172.21.15.32:0/3476223569 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd7c0067730 0x7fd7c0069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f1e30c00640 1 -- 172.21.15.32:0/4164056125 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2404cf20 con 0x7f1e240e7a50 2024-03-19T06:21:15.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7fd7e3200640 1 --2- 172.21.15.32:0/3476223569 >> [v2:172.21.15.32:6800/3354910175,v1:172.21.15.32:6801/3354910175] conn(0x7fd7c006f950 0x7fd7c0071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f165d000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f165806c230 0x7f16581631e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f165d000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16580b5b60 0x7f1658163720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f165d000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f165815db20 0x7f165815f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f165d000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16580d32d0 con 0x7f16580b5b60 2024-03-19T06:21:15.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f165d000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165806c680 con 0x7f165815db20 2024-03-19T06:21:15.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f165d000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16580d3450 con 0x7f165806c230 2024-03-19T06:21:15.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f54dbe00640 1 -- 172.21.15.32:0/3641414914 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d000b620 con 0x7f54e40ae0b0 2024-03-19T06:21:15.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f54dbe00640 1 -- 172.21.15.32:0/3641414914 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d0019070 con 0x7f54e40ae0b0 2024-03-19T06:21:15.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f54dbe00640 1 -- 172.21.15.32:0/3641414914 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d000ba00 con 0x7f54e40ae0b0 2024-03-19T06:21:15.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f1e30c00640 1 -- 172.21.15.32:0/4164056125 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1e240ea6d0 con 0x7f1e240e7a50 2024-03-19T06:21:15.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f1655400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16580b5b60 0x7f1658163720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f1655400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16580b5b60 0x7f1658163720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45334/0 (socket says 172.21.15.32:45334) 2024-03-19T06:21:15.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f1655400640 1 -- 172.21.15.32:0/3810331094 learned_addr learned my addr 172.21.15.32:0/3810331094 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f1656800640 1 --2- 172.21.15.32:0/3810331094 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f165815db20 0x7f165815f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f0fd7400640 1 -- 172.21.15.32:0/4207996421 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0fc8018020 con 0x7f0fe006d590 2024-03-19T06:21:15.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f1656800640 1 -- 172.21.15.32:0/3810331094 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f165806c230 msgr2=0x7f16581631e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-19T06:21:15.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f1656800640 1 --2- 172.21.15.32:0/3810331094 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f165806c230 0x7f16581631e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f1656800640 1 -- 172.21.15.32:0/3810331094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16580b5b60 msgr2=0x7f1658163720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f1656800640 1 --2- 172.21.15.32:0/3810331094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16580b5b60 0x7f1658163720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f1656800640 1 -- 172.21.15.32:0/3810331094 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1658160110 con 0x7f165815db20 2024-03-19T06:21:15.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7fd7e3200640 1 --2- 172.21.15.32:0/3476223569 >> [v2:172.21.15.32:6800/3354910175,v1:172.21.15.32:6801/3354910175] conn(0x7fd7c006f950 0x7fd7c0071d70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f1e1f400640 1 -- 172.21.15.32:0/4164056125 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1e2c0b24a0 con 0x7f1e240e7a50 2024-03-19T06:21:15.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f0fd7400640 1 --2- 172.21.15.32:0/4207996421 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0fbc067730 0x7f0fbc069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f0fd7400640 1 -- 172.21.15.32:0/4207996421 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fc8085a90 con 0x7f0fe006d590 2024-03-19T06:21:15.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f0fd7400640 1 --2- 172.21.15.32:0/4207996421 >> [v2:172.21.15.171:6800/2358501242,v1:172.21.15.171:6801/2358501242] conn(0x7f0fbc06f9b0 0x7f0fbc071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f0fd7400640 1 -- 172.21.15.32:0/4207996421 --> [v2:172.21.15.171:6800/2358501242,v1:172.21.15.171:6801/2358501242] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0fbc072480 con 0x7f0fbc06f9b0 2024-03-19T06:21:15.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f0fd7400640 1 -- 172.21.15.32:0/4207996421 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fc8085e80 con 0x7f0fe006d590 2024-03-19T06:21:15.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f0fdea00640 1 --2- 172.21.15.32:0/4207996421 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0fbc067730 0x7f0fbc069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f0fdfe00640 1 --2- 172.21.15.32:0/4207996421 >> [v2:172.21.15.171:6800/2358501242,v1:172.21.15.171:6801/2358501242] conn(0x7f0fbc06f9b0 0x7f0fbc071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f1e1f400640 1 --2- 172.21.15.32:0/4164056125 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1e0c067890 0x7f1e0c069d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7fd7e2800640 1 --2- 172.21.15.32:0/3476223569 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd7c0067730 0x7fd7c0069bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40ad000 tx=0x7fd7d4004740 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f1e1f400640 1 -- 172.21.15.32:0/4164056125 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e2c04f5d0 con 0x7f1e240e7a50 2024-03-19T06:21:15.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f0fdfe00640 1 --2- 172.21.15.32:0/4207996421 >> [v2:172.21.15.171:6800/2358501242,v1:172.21.15.171:6801/2358501242] conn(0x7f0fbc06f9b0 0x7f0fbc071dd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f0fdea00640 1 --2- 172.21.15.32:0/4207996421 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0fbc067730 0x7f0fbc069bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0fe01fe3a0 tx=0x7f0fd8007810 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f1e1f400640 1 --2- 172.21.15.32:0/4164056125 >> [v2:172.21.15.32:6816/3701174485,v1:172.21.15.32:6817/3701174485] conn(0x7f1e0c06fa30 0x7f1e0c071e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f1e2b400640 1 --2- 172.21.15.32:0/4164056125 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1e0c067890 0x7f1e0c069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.340+0000 7f54eae00640 1 -- 172.21.15.32:0/3641414914 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e41344f0 con 0x7f54e40ae0b0 2024-03-19T06:21:15.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f54eae00640 1 -- 172.21.15.32:0/3641414914 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e4131920 con 0x7f54e40ae0b0 2024-03-19T06:21:15.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f54eae00640 1 -- 172.21.15.32:0/3641414914 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f54e40749e0 con 0x7f54e40ae0b0 2024-03-19T06:21:15.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.344+0000 7f54dbe00640 1 -- 172.21.15.32:0/3641414914 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f54d000bba0 con 0x7f54e40ae0b0 2024-03-19T06:21:15.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f1656800640 1 --2- 172.21.15.32:0/3810331094 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f165815db20 0x7f165815f390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f164800c610 tx=0x7f164800cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f164e000640 1 -- 172.21.15.32:0/3810331094 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648015070 con 0x7f165815db20 2024-03-19T06:21:15.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f164e000640 1 -- 172.21.15.32:0/3810331094 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1648011800 con 0x7f165815db20 2024-03-19T06:21:15.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f164e000640 1 -- 172.21.15.32:0/3810331094 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648011bf0 con 0x7f165815db20 2024-03-19T06:21:15.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f1e2b400640 1 --2- 172.21.15.32:0/4164056125 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1e0c067890 0x7f1e0c069d50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1e200099e0 tx=0x7f1e20008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f0fd7400640 1 -- 172.21.15.32:0/4207996421 <== osd.4 v2:172.21.15.171:6800/2358501242 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0fbc072480 con 0x7f0fbc06f9b0 2024-03-19T06:21:15.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f165d000640 1 -- 172.21.15.32:0/3810331094 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16581603f0 con 0x7f165815db20 2024-03-19T06:21:15.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f54dbe00640 1 --2- 172.21.15.32:0/3641414914 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f54c4067730 0x7f54c4069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f54dbe00640 1 -- 172.21.15.32:0/3641414914 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54d0085c40 con 0x7f54e40ae0b0 2024-03-19T06:21:15.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f1e1f400640 1 -- 172.21.15.32:0/4164056125 --> [v2:172.21.15.32:6816/3701174485,v1:172.21.15.32:6817/3701174485] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e2c06de80 con 0x7f1e0c06fa30 2024-03-19T06:21:15.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f1e1f400640 1 -- 172.21.15.32:0/4164056125 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e2c0ffe40 con 0x7f1e240e7a50 2024-03-19T06:21:15.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f54dbe00640 1 --2- 172.21.15.32:0/3641414914 >> [v2:172.21.15.171:6816/2899212924,v1:172.21.15.171:6817/2899212924] conn(0x7f54c406f9b0 0x7f54c4071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f54dbe00640 1 -- 172.21.15.32:0/3641414914 --> [v2:172.21.15.171:6816/2899212924,v1:172.21.15.171:6817/2899212924] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54c4072480 con 0x7f54c406f9b0 2024-03-19T06:21:15.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f54dbe00640 1 -- 172.21.15.32:0/3641414914 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54d008c020 con 0x7f54e40ae0b0 2024-03-19T06:21:15.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f54e3e00640 1 --2- 172.21.15.32:0/3641414914 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f54c4067730 0x7f54c4069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f165d000640 1 -- 172.21.15.32:0/3810331094 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16581609b0 con 0x7f165815db20 2024-03-19T06:21:15.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f54e8e00640 1 --2- 172.21.15.32:0/3641414914 >> [v2:172.21.15.171:6816/2899212924,v1:172.21.15.171:6817/2899212924] conn(0x7f54c406f9b0 0x7f54c4071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f1e2aa00640 1 --2- 172.21.15.32:0/4164056125 >> [v2:172.21.15.32:6816/3701174485,v1:172.21.15.32:6817/3701174485] conn(0x7f1e0c06fa30 0x7f1e0c071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f54e3e00640 1 --2- 172.21.15.32:0/3641414914 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f54c4067730 0x7f54c4069bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f54d4007fd0 tx=0x7f54d4007c80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7fd7db400640 1 -- 172.21.15.32:0/3476223569 <== osd.1 v2:172.21.15.32:6800/3354910175 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd7c0072420 con 0x7fd7c006f950 2024-03-19T06:21:15.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f54e8e00640 1 --2- 172.21.15.32:0/3641414914 >> [v2:172.21.15.171:6816/2899212924,v1:172.21.15.171:6817/2899212924] conn(0x7f54c406f9b0 0x7f54c4071dd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.348+0000 7f1e2aa00640 1 --2- 172.21.15.32:0/4164056125 >> [v2:172.21.15.32:6816/3701174485,v1:172.21.15.32:6817/3701174485] conn(0x7f1e0c06fa30 0x7f1e0c071e50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.352+0000 7f1647400640 1 -- 172.21.15.32:0/3810331094 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f16580749e0 con 0x7f165815db20 2024-03-19T06:21:15.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.352+0000 7f54dbe00640 1 -- 172.21.15.32:0/3641414914 <== osd.7 v2:172.21.15.171:6816/2899212924 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f54c4072480 con 0x7f54c406f9b0 2024-03-19T06:21:15.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.352+0000 7f1e1f400640 1 -- 172.21.15.32:0/4164056125 <== osd.3 v2:172.21.15.32:6816/3701174485 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1e2c06de80 con 0x7f1e0c06fa30 2024-03-19T06:21:15.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.352+0000 7f164e000640 1 -- 172.21.15.32:0/3810331094 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1648018070 con 0x7f165815db20 2024-03-19T06:21:15.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.352+0000 7f164e000640 1 --2- 172.21.15.32:0/3810331094 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1634067690 0x7f1634069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.352+0000 7f164e000640 1 -- 172.21.15.32:0/3810331094 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1648085780 con 0x7f165815db20 2024-03-19T06:21:15.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.352+0000 7f1655e00640 1 --2- 172.21.15.32:0/3810331094 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1634067690 0x7f1634069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.356+0000 7f164e000640 1 --2- 172.21.15.32:0/3810331094 >> [v2:172.21.15.171:6824/1372815214,v1:172.21.15.171:6825/1372815214] conn(0x7f163406f910 0x7f1634071d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.356+0000 7f164e000640 1 -- 172.21.15.32:0/3810331094 --> [v2:172.21.15.171:6824/1372815214,v1:172.21.15.171:6825/1372815214] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f16340723e0 con 0x7f163406f910 2024-03-19T06:21:15.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.356+0000 7f164e000640 1 -- 172.21.15.32:0/3810331094 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f164808c050 con 0x7f165815db20 2024-03-19T06:21:15.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.360+0000 7f1655e00640 1 --2- 172.21.15.32:0/3810331094 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1634067690 0x7f1634069b50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16500af000 tx=0x7f16500a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.360+0000 7f1655400640 1 --2- 172.21.15.32:0/3810331094 >> [v2:172.21.15.171:6824/1372815214,v1:172.21.15.171:6825/1372815214] conn(0x7f163406f910 0x7f1634071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.360+0000 7f1655400640 1 --2- 172.21.15.32:0/3810331094 >> [v2:172.21.15.171:6824/1372815214,v1:172.21.15.171:6825/1372815214] conn(0x7f163406f910 0x7f1634071d30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.364+0000 7f164e000640 1 -- 172.21.15.32:0/3810331094 <== osd.6 v2:172.21.15.171:6824/1372815214 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f16340723e0 con 0x7f163406f910 2024-03-19T06:21:15.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.368+0000 7f008ca00640 1 -- 172.21.15.32:0/3180192165 --> [v2:172.21.15.32:6824/1835843146,v1:172.21.15.32:6825/1835843146] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f008815e800 con 0x7f006806f960 2024-03-19T06:21:15.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.368+0000 7f0fe6000640 1 -- 172.21.15.32:0/4207996421 --> [v2:172.21.15.171:6800/2358501242,v1:172.21.15.171:6801/2358501242] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0fe0158030 con 0x7f0fbc06f9b0 2024-03-19T06:21:15.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f0fd7400640 1 -- 172.21.15.32:0/4207996421 <== osd.4 v2:172.21.15.171:6800/2358501242 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0fe0158030 con 0x7f0fbc06f9b0 2024-03-19T06:21:15.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f007ea00640 1 -- 172.21.15.32:0/3180192165 <== osd.2 v2:172.21.15.32:6824/1835843146 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f008815e800 con 0x7f006806f960 2024-03-19T06:21:15.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f008ca00640 1 -- 172.21.15.32:0/3180192165 >> [v2:172.21.15.32:6824/1835843146,v1:172.21.15.32:6825/1835843146] conn(0x7f006806f960 msgr2=0x7f0068071d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f008ca00640 1 --2- 172.21.15.32:0/3180192165 >> [v2:172.21.15.32:6824/1835843146,v1:172.21.15.32:6825/1835843146] conn(0x7f006806f960 0x7f0068071d80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f0fe6000640 1 -- 172.21.15.32:0/4207996421 >> [v2:172.21.15.171:6800/2358501242,v1:172.21.15.171:6801/2358501242] conn(0x7f0fbc06f9b0 msgr2=0x7f0fbc071dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7fb439e00640 1 -- 172.21.15.32:0/927422867 --> [v2:172.21.15.32:6808/2787806963,v1:172.21.15.32:6809/2787806963] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb42c033fc0 con 0x7fb41406fa40 2024-03-19T06:21:15.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f0fe6000640 1 --2- 172.21.15.32:0/4207996421 >> [v2:172.21.15.171:6800/2358501242,v1:172.21.15.171:6801/2358501242] conn(0x7f0fbc06f9b0 0x7f0fbc071dd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f0fe6000640 1 -- 172.21.15.32:0/4207996421 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0fbc067730 msgr2=0x7f0fbc069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f008ca00640 1 -- 172.21.15.32:0/3180192165 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f00680676e0 msgr2=0x7f0068069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f008ca00640 1 --2- 172.21.15.32:0/3180192165 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f00680676e0 0x7f0068069ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0078009ab0 tx=0x7f0078009240 comp rx=0 tx=0).stop 2024-03-19T06:21:15.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f008ca00640 1 -- 172.21.15.32:0/3180192165 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f008815db10 msgr2=0x7f008815e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f008ca00640 1 --2- 172.21.15.32:0/3180192165 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f008815db10 0x7f008815e070 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f008001d1b0 tx=0x7f00800196b0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f0087200640 1 -- 172.21.15.32:0/3180192165 reap_dead start 2024-03-19T06:21:15.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f008ca00640 1 -- 172.21.15.32:0/3180192165 shutdown_connections 2024-03-19T06:21:15.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f008ca00640 1 -- 172.21.15.32:0/3180192165 >> 172.21.15.32:0/3180192165 conn(0x7f008806c030 msgr2=0x7f0088159870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f008ca00640 1 -- 172.21.15.32:0/3180192165 shutdown_connections 2024-03-19T06:21:15.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f0fe6000640 1 --2- 172.21.15.32:0/4207996421 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0fbc067730 0x7f0fbc069bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0fe01fe3a0 tx=0x7f0fd8007810 comp rx=0 tx=0).stop 2024-03-19T06:21:15.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f0fe6000640 1 -- 172.21.15.32:0/4207996421 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe006d590 msgr2=0x7f0fe0156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f0fe6000640 1 --2- 172.21.15.32:0/4207996421 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe006d590 0x7f0fe0156150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800b440 tx=0x7f0fc800b900 comp rx=0 tx=0).stop 2024-03-19T06:21:15.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f0fdfe00640 1 -- 172.21.15.32:0/4207996421 reap_dead start 2024-03-19T06:21:15.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f0fe6000640 1 -- 172.21.15.32:0/4207996421 shutdown_connections 2024-03-19T06:21:15.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f0fe6000640 1 -- 172.21.15.32:0/4207996421 >> 172.21.15.32:0/4207996421 conn(0x7f0fe00b1280 msgr2=0x7f0fe0155020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7fb430c00640 1 -- 172.21.15.32:0/927422867 <== osd.0 v2:172.21.15.32:6808/2787806963 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb42c033fc0 con 0x7fb41406fa40 2024-03-19T06:21:15.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f008ca00640 1 -- 172.21.15.32:0/3180192165 wait complete. 2024-03-19T06:21:15.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f0fe6000640 1 -- 172.21.15.32:0/4207996421 shutdown_connections 2024-03-19T06:21:15.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f7eeb000640 1 -- 172.21.15.32:0/365862160 --> [v2:172.21.15.171:6808/3784639902,v1:172.21.15.171:6809/3784639902] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ee40723f0 con 0x7f7ec406f8d0 2024-03-19T06:21:15.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f7edbe00640 1 -- 172.21.15.32:0/365862160 <== osd.5 v2:172.21.15.171:6808/3784639902 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7ee40723f0 con 0x7f7ec406f8d0 2024-03-19T06:21:15.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f7eeb000640 1 -- 172.21.15.32:0/365862160 >> [v2:172.21.15.171:6808/3784639902,v1:172.21.15.171:6809/3784639902] conn(0x7f7ec406f8d0 msgr2=0x7f7ec4071cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f0fe6000640 1 -- 172.21.15.32:0/4207996421 wait complete. 2024-03-19T06:21:15.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f7eeb000640 1 --2- 172.21.15.32:0/365862160 >> [v2:172.21.15.171:6808/3784639902,v1:172.21.15.171:6809/3784639902] conn(0x7f7ec406f8d0 0x7f7ec4071cf0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f7eeb000640 1 -- 172.21.15.32:0/365862160 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7ec40676b0 msgr2=0x7f7ec4069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f7eeb000640 1 --2- 172.21.15.32:0/365862160 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7ec40676b0 0x7f7ec4069b70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009920 tx=0x7f7ed0008040 comp rx=0 tx=0).stop 2024-03-19T06:21:15.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f7eeb000640 1 -- 172.21.15.32:0/365862160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ee41542c0 msgr2=0x7f7ee415d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f7eeb000640 1 --2- 172.21.15.32:0/365862160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ee41542c0 0x7f7ee415d650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00c730 tx=0x7f7edc00cbf0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f7ee9000640 1 -- 172.21.15.32:0/365862160 reap_dead start 2024-03-19T06:21:15.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7fb439e00640 1 -- 172.21.15.32:0/927422867 >> [v2:172.21.15.32:6808/2787806963,v1:172.21.15.32:6809/2787806963] conn(0x7fb41406fa40 msgr2=0x7fb414071e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7fb439e00640 1 --2- 172.21.15.32:0/927422867 >> [v2:172.21.15.32:6808/2787806963,v1:172.21.15.32:6809/2787806963] conn(0x7fb41406fa40 0x7fb414071e60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f7eeb000640 1 -- 172.21.15.32:0/365862160 shutdown_connections 2024-03-19T06:21:15.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.372+0000 7f7eeb000640 1 -- 172.21.15.32:0/365862160 >> 172.21.15.32:0/365862160 conn(0x7f7ee40cf5b0 msgr2=0x7f7ee40af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.376+0000 7fb439e00640 1 -- 172.21.15.32:0/927422867 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb414067820 msgr2=0x7fb414069ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.376+0000 7f7eeb000640 1 -- 172.21.15.32:0/365862160 shutdown_connections 2024-03-19T06:21:15.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.376+0000 7f7eeb000640 1 -- 172.21.15.32:0/365862160 wait complete. 2024-03-19T06:21:15.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.376+0000 7fb439e00640 1 --2- 172.21.15.32:0/927422867 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb414067820 0x7fb414069ce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0df4d0 tx=0x7fb428008040 comp rx=0 tx=0).stop 2024-03-19T06:21:15.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.376+0000 7fb439e00640 1 -- 172.21.15.32:0/927422867 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb42c0d20a0 msgr2=0x7fb42c0d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.376+0000 7fb439e00640 1 --2- 172.21.15.32:0/927422867 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb42c0d20a0 0x7fb42c0d2520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb4340694d0 tx=0x7fb4340688a0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.376+0000 7fb439400640 1 -- 172.21.15.32:0/927422867 reap_dead start 2024-03-19T06:21:15.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.376+0000 7fb439e00640 1 -- 172.21.15.32:0/927422867 shutdown_connections 2024-03-19T06:21:15.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.376+0000 7fb439e00640 1 -- 172.21.15.32:0/927422867 >> 172.21.15.32:0/927422867 conn(0x7fb42c055360 msgr2=0x7fb42c0d4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.376+0000 7fb439e00640 1 -- 172.21.15.32:0/927422867 shutdown_connections 2024-03-19T06:21:15.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.376+0000 7fb439e00640 1 -- 172.21.15.32:0/927422867 wait complete. 2024-03-19T06:21:15.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.376+0000 7f54eae00640 1 -- 172.21.15.32:0/3641414914 --> [v2:172.21.15.171:6816/2899212924,v1:172.21.15.171:6817/2899212924] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f54e40728b0 con 0x7f54c406f9b0 2024-03-19T06:21:15.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.380+0000 7fd7e9400640 1 -- 172.21.15.32:0/3476223569 --> [v2:172.21.15.32:6800/3354910175,v1:172.21.15.32:6801/3354910175] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7e40723f0 con 0x7fd7c006f950 2024-03-19T06:21:15.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.380+0000 7f54dbe00640 1 -- 172.21.15.32:0/3641414914 <== osd.7 v2:172.21.15.171:6816/2899212924 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f54e40728b0 con 0x7f54c406f9b0 2024-03-19T06:21:15.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.380+0000 7fd7db400640 1 -- 172.21.15.32:0/3476223569 <== osd.1 v2:172.21.15.32:6800/3354910175 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd7e40723f0 con 0x7fd7c006f950 2024-03-19T06:21:15.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.380+0000 7f54eae00640 1 -- 172.21.15.32:0/3641414914 >> [v2:172.21.15.171:6816/2899212924,v1:172.21.15.171:6817/2899212924] conn(0x7f54c406f9b0 msgr2=0x7f54c4071dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.380+0000 7f54eae00640 1 --2- 172.21.15.32:0/3641414914 >> [v2:172.21.15.171:6816/2899212924,v1:172.21.15.171:6817/2899212924] conn(0x7f54c406f9b0 0x7f54c4071dd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.380+0000 7f54eae00640 1 -- 172.21.15.32:0/3641414914 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f54c4067730 msgr2=0x7f54c4069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.380+0000 7f54eae00640 1 --2- 172.21.15.32:0/3641414914 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f54c4067730 0x7f54c4069bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f54d4007fd0 tx=0x7f54d4007c80 comp rx=0 tx=0).stop 2024-03-19T06:21:15.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.380+0000 7f54eae00640 1 -- 172.21.15.32:0/3641414914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54e40ae0b0 msgr2=0x7f54e4133910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.380+0000 7f54eae00640 1 --2- 172.21.15.32:0/3641414914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54e40ae0b0 0x7f54e4133910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f54d000d620 tx=0x7f54d000dae0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.380+0000 7f54e8e00640 1 -- 172.21.15.32:0/3641414914 reap_dead start 2024-03-19T06:21:15.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7fd7e9400640 1 -- 172.21.15.32:0/3476223569 >> [v2:172.21.15.32:6800/3354910175,v1:172.21.15.32:6801/3354910175] conn(0x7fd7c006f950 msgr2=0x7fd7c0071d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7fd7e9400640 1 --2- 172.21.15.32:0/3476223569 >> [v2:172.21.15.32:6800/3354910175,v1:172.21.15.32:6801/3354910175] conn(0x7fd7c006f950 0x7fd7c0071d70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7f54eae00640 1 -- 172.21.15.32:0/3641414914 shutdown_connections 2024-03-19T06:21:15.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7f54eae00640 1 -- 172.21.15.32:0/3641414914 >> 172.21.15.32:0/3641414914 conn(0x7f54e4071c50 msgr2=0x7f54e40afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7f54eae00640 1 -- 172.21.15.32:0/3641414914 shutdown_connections 2024-03-19T06:21:15.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7f54eae00640 1 -- 172.21.15.32:0/3641414914 wait complete. 2024-03-19T06:21:15.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7fd7e9400640 1 -- 172.21.15.32:0/3476223569 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd7c0067730 msgr2=0x7fd7c0069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7fd7e9400640 1 --2- 172.21.15.32:0/3476223569 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd7c0067730 0x7fd7c0069bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40ad000 tx=0x7fd7d4004740 comp rx=0 tx=0).stop 2024-03-19T06:21:15.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7fd7e9400640 1 -- 172.21.15.32:0/3476223569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e40ca790 msgr2=0x7fd7e414f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7fd7e9400640 1 --2- 172.21.15.32:0/3476223569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7e40ca790 0x7fd7e414f270 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc00c420 tx=0x7fd7cc00c8e0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7fd7e3200640 1 -- 172.21.15.32:0/3476223569 reap_dead start 2024-03-19T06:21:15.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7fd7e9400640 1 -- 172.21.15.32:0/3476223569 shutdown_connections 2024-03-19T06:21:15.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7fd7e9400640 1 -- 172.21.15.32:0/3476223569 >> 172.21.15.32:0/3476223569 conn(0x7fd7e40cf5b0 msgr2=0x7fd7e40ceaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7f1e30c00640 1 -- 172.21.15.32:0/4164056125 --> [v2:172.21.15.32:6816/3701174485,v1:172.21.15.32:6817/3701174485] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1e240064e0 con 0x7f1e0c06fa30 2024-03-19T06:21:15.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7f1e1f400640 1 -- 172.21.15.32:0/4164056125 <== osd.3 v2:172.21.15.32:6816/3701174485 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1e240064e0 con 0x7f1e0c06fa30 2024-03-19T06:21:15.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7fd7e9400640 1 -- 172.21.15.32:0/3476223569 shutdown_connections 2024-03-19T06:21:15.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7fd7e9400640 1 -- 172.21.15.32:0/3476223569 wait complete. 2024-03-19T06:21:15.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7f1e30c00640 1 -- 172.21.15.32:0/4164056125 >> [v2:172.21.15.32:6816/3701174485,v1:172.21.15.32:6817/3701174485] conn(0x7f1e0c06fa30 msgr2=0x7f1e0c071e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7f1e30c00640 1 --2- 172.21.15.32:0/4164056125 >> [v2:172.21.15.32:6816/3701174485,v1:172.21.15.32:6817/3701174485] conn(0x7f1e0c06fa30 0x7f1e0c071e50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7f1e30c00640 1 -- 172.21.15.32:0/4164056125 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1e0c067890 msgr2=0x7f1e0c069d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7f1e30c00640 1 --2- 172.21.15.32:0/4164056125 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1e0c067890 0x7f1e0c069d50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1e200099e0 tx=0x7f1e20008040 comp rx=0 tx=0).stop 2024-03-19T06:21:15.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7f1e30c00640 1 -- 172.21.15.32:0/4164056125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e240e7a50 msgr2=0x7f1e240e97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7f1e30c00640 1 --2- 172.21.15.32:0/4164056125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e240e7a50 0x7f1e240e97f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0694d0 tx=0x7f1e2c074520 comp rx=0 tx=0).stop 2024-03-19T06:21:15.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7f1e2be00640 1 -- 172.21.15.32:0/4164056125 reap_dead start 2024-03-19T06:21:15.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7f1e30c00640 1 -- 172.21.15.32:0/4164056125 shutdown_connections 2024-03-19T06:21:15.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7f1e30c00640 1 -- 172.21.15.32:0/4164056125 >> 172.21.15.32:0/4164056125 conn(0x7f1e2400ff20 msgr2=0x7f1e240e5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.384+0000 7f1e30c00640 1 -- 172.21.15.32:0/4164056125 shutdown_connections 2024-03-19T06:21:15.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.388+0000 7f1e30c00640 1 -- 172.21.15.32:0/4164056125 wait complete. 2024-03-19T06:21:15.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.388+0000 7f1647400640 1 -- 172.21.15.32:0/3810331094 --> [v2:172.21.15.171:6824/1372815214,v1:172.21.15.171:6825/1372815214] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1658162fc0 con 0x7f163406f910 2024-03-19T06:21:15.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.396+0000 7f164e000640 1 -- 172.21.15.32:0/3810331094 <== osd.6 v2:172.21.15.171:6824/1372815214 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1658162fc0 con 0x7f163406f910 2024-03-19T06:21:15.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.396+0000 7f1647400640 1 -- 172.21.15.32:0/3810331094 >> [v2:172.21.15.171:6824/1372815214,v1:172.21.15.171:6825/1372815214] conn(0x7f163406f910 msgr2=0x7f1634071d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.396+0000 7f1647400640 1 --2- 172.21.15.32:0/3810331094 >> [v2:172.21.15.171:6824/1372815214,v1:172.21.15.171:6825/1372815214] conn(0x7f163406f910 0x7f1634071d30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.400+0000 7f1647400640 1 -- 172.21.15.32:0/3810331094 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1634067690 msgr2=0x7f1634069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.400+0000 7f1647400640 1 --2- 172.21.15.32:0/3810331094 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1634067690 0x7f1634069b50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16500af000 tx=0x7f16500a7070 comp rx=0 tx=0).stop 2024-03-19T06:21:15.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.400+0000 7f1647400640 1 -- 172.21.15.32:0/3810331094 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f165815db20 msgr2=0x7f165815f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.400+0000 7f1647400640 1 --2- 172.21.15.32:0/3810331094 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f165815db20 0x7f165815f390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f164800c610 tx=0x7f164800cad0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.400+0000 7f1656800640 1 -- 172.21.15.32:0/3810331094 reap_dead start 2024-03-19T06:21:15.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.400+0000 7f1647400640 1 -- 172.21.15.32:0/3810331094 shutdown_connections 2024-03-19T06:21:15.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.400+0000 7f1647400640 1 -- 172.21.15.32:0/3810331094 >> 172.21.15.32:0/3810331094 conn(0x7f16580d0450 msgr2=0x7f165815b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.400+0000 7f1647400640 1 -- 172.21.15.32:0/3810331094 shutdown_connections 2024-03-19T06:21:15.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.400+0000 7f1647400640 1 -- 172.21.15.32:0/3810331094 wait complete. 2024-03-19T06:21:15.419 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2024-03-19T06:21:15.419 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2024-03-19T06:21:15.420 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-19T06:21:15.421 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-19T06:21:15.421 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2024-03-19T06:21:15.422 INFO:teuthology.orchestra.run.smithi032.stdout:60129542153 2024-03-19T06:21:15.422 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-19T06:21:15.423 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-19T06:21:15.424 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2024-03-19T06:21:15.424 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-19T06:21:15.425 INFO:teuthology.orchestra.run.smithi032.stdout:60129542150 2024-03-19T06:21:15.425 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-19T06:21:15.426 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2024-03-19T06:21:15.427 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-19T06:21:15.428 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2024-03-19T06:21:15.428 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-19T06:21:15.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.708+0000 7f3caf200640 1 Processor -- start 2024-03-19T06:21:15.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.708+0000 7f3caf200640 1 -- start start 2024-03-19T06:21:15.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caf200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80e5060 0x7f3ca803a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7fc7d4e00640 1 Processor -- start 2024-03-19T06:21:15.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7fc7d4e00640 1 -- start start 2024-03-19T06:21:15.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caf200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca80e5440 con 0x7f3ca8007430 2024-03-19T06:21:15.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caf200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca8006390 con 0x7f3ca804fbf0 2024-03-19T06:21:15.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caf200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca8006670 con 0x7f3ca80e5060 2024-03-19T06:21:15.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3cad400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3ca8007430 0x7f3ca804f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47636/0 (socket says 172.21.15.32:47636) 2024-03-19T06:21:15.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3cad400640 1 -- 172.21.15.32:0/3014326098 learned_addr learned my addr 172.21.15.32:0/3014326098 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:15.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caca00640 1 -- 172.21.15.32:0/3014326098 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509874125 0 0) 0x7f3c9c001120 con 0x7f3ca8007430 2024-03-19T06:21:15.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caca00640 1 -- 172.21.15.32:0/3014326098 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c94003530 con 0x7f3ca8007430 2024-03-19T06:21:15.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caca00640 1 -- 172.21.15.32:0/3014326098 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584128226 0 0) 0x7f3ca8006390 con 0x7f3ca804fbf0 2024-03-19T06:21:15.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caca00640 1 -- 172.21.15.32:0/3014326098 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c9c001120 con 0x7f3ca804fbf0 2024-03-19T06:21:15.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7fc7d4e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc7d015d5e0 0x7fc7d015a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7fc7d4e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d015db10 con 0x7fc7d0150c70 2024-03-19T06:21:15.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7fc7d4e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d015ddf0 con 0x7fc7d0150890 2024-03-19T06:21:15.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7fc7d4e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d015e0d0 con 0x7fc7d015d5e0 2024-03-19T06:21:15.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caca00640 1 -- 172.21.15.32:0/3014326098 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1217950150 0 0) 0x7f3c94003530 con 0x7f3ca8007430 2024-03-19T06:21:15.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caca00640 1 -- 172.21.15.32:0/3014326098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80e5060 msgr2=0x7f3ca803a930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:21:15.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caca00640 1 --2- 172.21.15.32:0/3014326098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80e5060 0x7f3ca803a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caca00640 1 -- 172.21.15.32:0/3014326098 >> v1:172.21.15.171:6789/0 conn(0x7f3ca804fbf0 legacy=0x7f3ca8033950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caca00640 1 -- 172.21.15.32:0/3014326098 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca8006950 con 0x7f3ca8007430 2024-03-19T06:21:15.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7fc7cfe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc7d015d5e0 0x7fc7d015a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7c6a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc7d0150c70 0x7fc7d00cf370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47642/0 (socket says 172.21.15.32:47642) 2024-03-19T06:21:15.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7c6a00640 1 -- 172.21.15.32:0/1960734112 learned_addr learned my addr 172.21.15.32:0/1960734112 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:15.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caca00640 1 -- 172.21.15.32:0/3014326098 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f3c9c001850 con 0x7f3ca8007430 2024-03-19T06:21:15.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caca00640 1 -- 172.21.15.32:0/3014326098 >> v1:172.21.15.32:6789/0 conn(0x7f3ca8007430 legacy=0x7f3ca804f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caca00640 1 --2- 172.21.15.32:0/3014326098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c94004c10 0x7f3c94004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caca00640 1 --2- 172.21.15.32:0/3014326098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c940037b0 0x7f3c94003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caca00640 1 --2- 172.21.15.32:0/3014326098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80e5060 0x7f3c940041b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.712+0000 7f3caca00640 1 -- 172.21.15.32:0/3014326098 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca8006670 con 0x7f3c94004c10 2024-03-19T06:21:15.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7f3caca00640 1 -- 172.21.15.32:0/3014326098 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9400bb00 con 0x7f3c940037b0 2024-03-19T06:21:15.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7f3caca00640 1 -- 172.21.15.32:0/3014326098 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9400bd00 con 0x7f3ca80e5060 2024-03-19T06:21:15.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7f3cade00640 1 --2- 172.21.15.32:0/3014326098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c94004c10 0x7f3c94004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7f3cad400640 1 --2- 172.21.15.32:0/3014326098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c940037b0 0x7f3c94003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7f3cade00640 1 -- 172.21.15.32:0/3014326098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80e5060 msgr2=0x7f3c940041b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7f3cade00640 1 --2- 172.21.15.32:0/3014326098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80e5060 0x7f3c940041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7f3cade00640 1 -- 172.21.15.32:0/3014326098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c940037b0 msgr2=0x7f3c94003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7f3cade00640 1 --2- 172.21.15.32:0/3014326098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c940037b0 0x7f3c94003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7f3cade00640 1 -- 172.21.15.32:0/3014326098 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca8006950 con 0x7f3c94004c10 2024-03-19T06:21:15.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7f3cad400640 1 --2- 172.21.15.32:0/3014326098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c940037b0 0x7f3c94003c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:15.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7cea00640 1 -- 172.21.15.32:0/1960734112 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284543920 0 0) 0x7fc7d015db10 con 0x7fc7d0150c70 2024-03-19T06:21:15.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7cea00640 1 -- 172.21.15.32:0/1960734112 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b4007940 con 0x7fc7d0150c70 2024-03-19T06:21:15.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7cea00640 1 -- 172.21.15.32:0/1960734112 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3298260173 0 0) 0x7fc7b4007940 con 0x7fc7d0150c70 2024-03-19T06:21:15.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7cea00640 1 -- 172.21.15.32:0/1960734112 >> v2:172.21.15.32:3300/0 conn(0x7fc7d015d5e0 msgr2=0x7fc7d015a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7cea00640 1 --2- 172.21.15.32:0/1960734112 >> v2:172.21.15.32:3300/0 conn(0x7fc7d015d5e0 0x7fc7d015a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7cea00640 1 -- 172.21.15.32:0/1960734112 >> v1:172.21.15.171:6789/0 conn(0x7fc7d0150890 legacy=0x7fc7d006e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7cea00640 1 -- 172.21.15.32:0/1960734112 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d015a100 con 0x7fc7d0150c70 2024-03-19T06:21:15.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7cea00640 1 -- 172.21.15.32:0/1960734112 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fc7b8001680 con 0x7fc7d0150c70 2024-03-19T06:21:15.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7cea00640 1 -- 172.21.15.32:0/1960734112 >> v1:172.21.15.32:6789/0 conn(0x7fc7d0150c70 legacy=0x7fc7d00cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7cea00640 1 --2- 172.21.15.32:0/1960734112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7b4007e20 0x7fc7b4008240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7cea00640 1 --2- 172.21.15.32:0/1960734112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7b4008c20 0x7fc7b40090a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7cea00640 1 --2- 172.21.15.32:0/1960734112 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7b4007470 0x7fc7b4009660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7cea00640 1 -- 172.21.15.32:0/1960734112 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d015e0d0 con 0x7fc7b4008c20 2024-03-19T06:21:15.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7cea00640 1 -- 172.21.15.32:0/1960734112 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b400c160 con 0x7fc7b4007e20 2024-03-19T06:21:15.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7cea00640 1 -- 172.21.15.32:0/1960734112 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b400c360 con 0x7fc7b4007470 2024-03-19T06:21:15.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7c6a00640 1 --2- 172.21.15.32:0/1960734112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7b4008c20 0x7fc7b40090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7cf400640 1 --2- 172.21.15.32:0/1960734112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7b4007e20 0x7fc7b4008240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7c6a00640 1 -- 172.21.15.32:0/1960734112 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7b4007470 msgr2=0x7fc7b4009660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:21:15.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7c6a00640 1 --2- 172.21.15.32:0/1960734112 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7b4007470 0x7fc7b4009660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7c6a00640 1 -- 172.21.15.32:0/1960734112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7b4007e20 msgr2=0x7fc7b4008240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7c6a00640 1 --2- 172.21.15.32:0/1960734112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7b4007e20 0x7fc7b4008240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.716+0000 7fc7c6a00640 1 -- 172.21.15.32:0/1960734112 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b4007940 con 0x7fc7b4008c20 2024-03-19T06:21:15.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.720+0000 7fc7cf400640 1 --2- 172.21.15.32:0/1960734112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7b4007e20 0x7fc7b4008240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:15.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.720+0000 7fc7c6a00640 1 --2- 172.21.15.32:0/1960734112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7b4008c20 0x7fc7b40090a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c160 tx=0x7fc7b8041340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f924ef9fecf0ad server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.720+0000 7fc7cea00640 1 -- 172.21.15.32:0/1960734112 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8007c70 con 0x7fc7b4008c20 2024-03-19T06:21:15.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.720+0000 7fc7cfe00640 1 -- 172.21.15.32:0/1960734112 reap_dead start 2024-03-19T06:21:15.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.720+0000 7fc7cea00640 1 -- 172.21.15.32:0/1960734112 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b8005ae0 con 0x7fc7b4008c20 2024-03-19T06:21:15.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.720+0000 7fc7cea00640 1 -- 172.21.15.32:0/1960734112 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8007070 con 0x7fc7b4008c20 2024-03-19T06:21:15.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.720+0000 7f3cade00640 1 --2- 172.21.15.32:0/3014326098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c94004c10 0x7f3c94004ff0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00097e0 tx=0x7f3ca001c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24f05379a864058 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.720+0000 7fc7d4e00640 1 -- 172.21.15.32:0/1960734112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7b4008c20 msgr2=0x7fc7b40090a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.720+0000 7fc7d4e00640 1 --2- 172.21.15.32:0/1960734112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7b4008c20 0x7fc7b40090a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c160 tx=0x7fc7b8041340 comp rx=0 tx=0).stop 2024-03-19T06:21:15.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.720+0000 7fc7d4e00640 1 -- 172.21.15.32:0/1960734112 shutdown_connections 2024-03-19T06:21:15.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.720+0000 7fc7d4e00640 1 --2- 172.21.15.32:0/1960734112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7b4008c20 0x7fc7b40090a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.720+0000 7fc7d4e00640 1 -- 172.21.15.32:0/1960734112 >> 172.21.15.32:0/1960734112 conn(0x7fc7d0066ed0 msgr2=0x7fc7d006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.724+0000 7fc7d4e00640 1 -- 172.21.15.32:0/1960734112 shutdown_connections 2024-03-19T06:21:15.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.724+0000 7fc7d4e00640 1 -- 172.21.15.32:0/1960734112 wait complete. 2024-03-19T06:21:15.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.724+0000 7f3caca00640 1 -- 172.21.15.32:0/3014326098 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00b0070 con 0x7f3c94004c10 2024-03-19T06:21:15.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.724+0000 7f3caca00640 1 -- 172.21.15.32:0/3014326098 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca00ab620 con 0x7f3c94004c10 2024-03-19T06:21:15.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.724+0000 7f3caca00640 1 -- 172.21.15.32:0/3014326098 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00093b0 con 0x7f3c94004c10 2024-03-19T06:21:15.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.724+0000 7f3caf200640 1 -- 172.21.15.32:0/3014326098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c94004c10 msgr2=0x7f3c94004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.724+0000 7f3caf200640 1 --2- 172.21.15.32:0/3014326098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c94004c10 0x7f3c94004ff0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00097e0 tx=0x7f3ca001c300 comp rx=0 tx=0).stop 2024-03-19T06:21:15.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.724+0000 7f3cae800640 1 -- 172.21.15.32:0/3014326098 reap_dead start 2024-03-19T06:21:15.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.724+0000 7f3caf200640 1 -- 172.21.15.32:0/3014326098 shutdown_connections 2024-03-19T06:21:15.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.724+0000 7f3caf200640 1 -- 172.21.15.32:0/3014326098 >> 172.21.15.32:0/3014326098 conn(0x7f3ca800a410 msgr2=0x7f3ca800a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.724+0000 7f3caf200640 1 -- 172.21.15.32:0/3014326098 shutdown_connections 2024-03-19T06:21:15.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.724+0000 7fc7d4e00640 1 Processor -- start 2024-03-19T06:21:15.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.724+0000 7f3caf200640 1 -- 172.21.15.32:0/3014326098 wait complete. 2024-03-19T06:21:15.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7f0774400640 1 Processor -- start 2024-03-19T06:21:15.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7f0774400640 1 -- start start 2024-03-19T06:21:15.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.724+0000 7fc7d4e00640 1 -- start start 2024-03-19T06:21:15.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7fc7d4e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7b4008c20 0x7fc7d0155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7fc7d4e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7d0156b00 0x7fc7d013de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7fc7d4e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d0153390 0x7fc7d0153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7fc7d4e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d006b450 con 0x7fc7d0153390 2024-03-19T06:21:15.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7fc7d4e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d015e3b0 con 0x7fc7b4008c20 2024-03-19T06:21:15.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7fc7d4e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d006b5d0 con 0x7fc7d0156b00 2024-03-19T06:21:15.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7f3caf200640 1 Processor -- start 2024-03-19T06:21:15.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7fc7cf400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7b4008c20 0x7fc7d0155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7fc7cf400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7b4008c20 0x7fc7d0155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57212/0 (socket says 172.21.15.32:57212) 2024-03-19T06:21:15.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7fc7cf400640 1 -- 172.21.15.32:0/3513507593 learned_addr learned my addr 172.21.15.32:0/3513507593 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7fc7c6a00640 1 --2- 172.21.15.32:0/3513507593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7d0156b00 0x7fc7d013de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7f3caf200640 1 -- start start 2024-03-19T06:21:15.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7fc7cfe00640 1 --2- 172.21.15.32:0/3513507593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d0153390 0x7fc7d0153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7fc7c6a00640 1 -- 172.21.15.32:0/3513507593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7b4008c20 msgr2=0x7fc7d0155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7fc7c6a00640 1 --2- 172.21.15.32:0/3513507593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7b4008c20 0x7fc7d0155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7fc7c6a00640 1 -- 172.21.15.32:0/3513507593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d0153390 msgr2=0x7fc7d0153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7fc7c6a00640 1 --2- 172.21.15.32:0/3513507593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d0153390 0x7fc7d0153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7fc7c6a00640 1 -- 172.21.15.32:0/3513507593 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d0151080 con 0x7fc7d0156b00 2024-03-19T06:21:15.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7fc7cfe00640 1 --2- 172.21.15.32:0/3513507593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d0153390 0x7fc7d0153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:15.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3caf200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c94004c10 0x7f3ca8036e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3caf200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80e3d00 0x7f3ca8053ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3caf200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80541e0 0x7f3ca8049b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3caf200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca8034430 con 0x7f3ca80541e0 2024-03-19T06:21:15.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3caf200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80342b0 con 0x7f3c94004c10 2024-03-19T06:21:15.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3caf200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80345b0 con 0x7f3ca80e3d00 2024-03-19T06:21:15.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3cad400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80e3d00 0x7f3ca8053ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3cade00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c94004c10 0x7f3ca8036e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3cad400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80e3d00 0x7f3ca8053ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:50226/0 (socket says 172.21.15.32:50226) 2024-03-19T06:21:15.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3cad400640 1 -- 172.21.15.32:0/3034229989 learned_addr learned my addr 172.21.15.32:0/3034229989 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7fc7c6a00640 1 --2- 172.21.15.32:0/3513507593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7d0156b00 0x7fc7d013de00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400c130 tx=0x7fc7b4009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3cae800640 1 --2- 172.21.15.32:0/3034229989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80541e0 0x7f3ca8049b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7fc7c7e00640 1 -- 172.21.15.32:0/3513507593 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8001680 con 0x7fc7d0156b00 2024-03-19T06:21:15.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7f0774400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f076c09a480 0x7f076c0cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7f0774400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f076c0cd390 0x7f076c0cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7f0774400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076c15bf00 con 0x7f076c15bb20 2024-03-19T06:21:15.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7f0774400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076c0cc3a0 con 0x7f076c09a480 2024-03-19T06:21:15.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7f0774400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076c0cfbb0 con 0x7f076c0cd390 2024-03-19T06:21:15.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7f0771000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f076c09a480 0x7f076c0cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7f0772400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f076c0cd390 0x7f076c0cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7f0771000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f076c09a480 0x7f076c0cf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45370/0 (socket says 172.21.15.32:45370) 2024-03-19T06:21:15.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.728+0000 7f0771000640 1 -- 172.21.15.32:0/625934489 learned_addr learned my addr 172.21.15.32:0/625934489 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f0772400640 1 -- 172.21.15.32:0/625934489 >> v2:172.21.15.32:3300/0 conn(0x7f076c09a480 msgr2=0x7f076c0cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f0772400640 1 --2- 172.21.15.32:0/625934489 >> v2:172.21.15.32:3300/0 conn(0x7f076c09a480 0x7f076c0cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f0772400640 1 -- 172.21.15.32:0/625934489 >> v1:172.21.15.32:6789/0 conn(0x7f076c15bb20 legacy=0x7f076c0c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f0772400640 1 -- 172.21.15.32:0/625934489 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c0cc5d0 con 0x7f076c0cd390 2024-03-19T06:21:15.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7fc7c7e00640 1 -- 172.21.15.32:0/3513507593 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b80d8070 con 0x7fc7d0156b00 2024-03-19T06:21:15.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7fc7c7e00640 1 -- 172.21.15.32:0/3513507593 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8004a50 con 0x7fc7d0156b00 2024-03-19T06:21:15.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7fc7d4e00640 1 -- 172.21.15.32:0/3513507593 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d0155930 con 0x7fc7d0156b00 2024-03-19T06:21:15.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7fc7d4e00640 1 -- 172.21.15.32:0/3513507593 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d0155ef0 con 0x7fc7d0156b00 2024-03-19T06:21:15.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3cad400640 1 -- 172.21.15.32:0/3034229989 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c94004c10 msgr2=0x7f3ca8036e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3cad400640 1 --2- 172.21.15.32:0/3034229989 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c94004c10 0x7f3ca8036e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3cad400640 1 -- 172.21.15.32:0/3034229989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80541e0 msgr2=0x7f3ca8049b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3cad400640 1 --2- 172.21.15.32:0/3034229989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80541e0 0x7f3ca8049b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3cad400640 1 -- 172.21.15.32:0/3034229989 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca804a8b0 con 0x7f3ca80e3d00 2024-03-19T06:21:15.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3cad400640 1 --2- 172.21.15.32:0/3034229989 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80e3d00 0x7f3ca8053ca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c007fd0 tx=0x7f3c9c00dcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3ca6000640 1 -- 172.21.15.32:0/3034229989 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c019070 con 0x7f3ca80e3d00 2024-03-19T06:21:15.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.732+0000 7f3ca6000640 1 -- 172.21.15.32:0/3034229989 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c0074e0 con 0x7f3ca80e3d00 2024-03-19T06:21:15.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7f3ca6000640 1 -- 172.21.15.32:0/3034229989 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c0049f0 con 0x7f3ca80e3d00 2024-03-19T06:21:15.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7f3caf200640 1 -- 172.21.15.32:0/3034229989 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca8036370 con 0x7f3ca80e3d00 2024-03-19T06:21:15.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7f3caf200640 1 -- 172.21.15.32:0/3034229989 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca8036930 con 0x7f3ca80e3d00 2024-03-19T06:21:15.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7f0772400640 1 --2- 172.21.15.32:0/625934489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f076c0cd390 0x7f076c0cd820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f076c06e960 tx=0x7f076402d810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78d8f526f42b967a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7f076be00640 1 -- 172.21.15.32:0/625934489 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640b9440 con 0x7f076c0cd390 2024-03-19T06:21:15.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7f076be00640 1 -- 172.21.15.32:0/625934489 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07640b95e0 con 0x7f076c0cd390 2024-03-19T06:21:15.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7f076be00640 1 -- 172.21.15.32:0/625934489 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640b99b0 con 0x7f076c0cd390 2024-03-19T06:21:15.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7f0774400640 1 -- 172.21.15.32:0/625934489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f076c0cd390 msgr2=0x7f076c0cd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7f0774400640 1 --2- 172.21.15.32:0/625934489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f076c0cd390 0x7f076c0cd820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f076c06e960 tx=0x7f076402d810 comp rx=0 tx=0).stop 2024-03-19T06:21:15.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7f0774400640 1 -- 172.21.15.32:0/625934489 shutdown_connections 2024-03-19T06:21:15.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7f0774400640 1 --2- 172.21.15.32:0/625934489 >> v2:172.21.15.32:3300/0 conn(0x7f076c09a480 0x7f076c0cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7f0774400640 1 --2- 172.21.15.32:0/625934489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f076c0cd390 0x7f076c0cd820 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7f0774400640 1 -- 172.21.15.32:0/625934489 >> 172.21.15.32:0/625934489 conn(0x7f076c0d1890 msgr2=0x7f076c0d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7fc7d4e00640 1 -- 172.21.15.32:0/3513507593 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a80052a0 con 0x7fc7d0156b00 2024-03-19T06:21:15.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7fc7c7e00640 1 -- 172.21.15.32:0/3513507593 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc7b80da020 con 0x7fc7d0156b00 2024-03-19T06:21:15.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7fc554600640 1 Processor -- start 2024-03-19T06:21:15.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7f3caf200640 1 -- 172.21.15.32:0/3034229989 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c880052a0 con 0x7f3ca80e3d00 2024-03-19T06:21:15.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7f3ca6000640 1 -- 172.21.15.32:0/3034229989 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3c9c01c070 con 0x7f3ca80e3d00 2024-03-19T06:21:15.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7fc7c7e00640 1 --2- 172.21.15.32:0/3513507593 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc7ac0676e0 0x7fc7ac069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7fc7c7e00640 1 -- 172.21.15.32:0/3513507593 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7b8144440 con 0x7fc7d0156b00 2024-03-19T06:21:15.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.736+0000 7fc554600640 1 -- start start 2024-03-19T06:21:15.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7f0774400640 1 -- 172.21.15.32:0/625934489 shutdown_connections 2024-03-19T06:21:15.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7f0774400640 1 -- 172.21.15.32:0/625934489 wait complete. 2024-03-19T06:21:15.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7f3ca6000640 1 --2- 172.21.15.32:0/3034229989 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c900676e0 0x7f3c90069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc7cf400640 1 --2- 172.21.15.32:0/3513507593 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc7ac0676e0 0x7fc7ac069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7f3ca6000640 1 -- 172.21.15.32:0/3034229989 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c9c0852f0 con 0x7f3ca80e3d00 2024-03-19T06:21:15.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc554600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc54c154aa0 0x7fc54c0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc554600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc54c06f270 0x7fc54c06f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7f3cade00640 1 --2- 172.21.15.32:0/3034229989 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c900676e0 0x7f3c90069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc554600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54c0cf130 con 0x7fc54c15ed80 2024-03-19T06:21:15.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc554600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54c06fc10 con 0x7fc54c154aa0 2024-03-19T06:21:15.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc554600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54c15e8f0 con 0x7fc54c06f270 2024-03-19T06:21:15.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7f0774400640 1 Processor -- start 2024-03-19T06:21:15.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7f0774400640 1 -- start start 2024-03-19T06:21:15.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc552600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc54c06f270 0x7fc54c06f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc552600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc54c06f270 0x7fc54c06f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57238/0 (socket says 172.21.15.32:57238) 2024-03-19T06:21:15.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc552600640 1 -- 172.21.15.32:0/2301437680 learned_addr learned my addr 172.21.15.32:0/2301437680 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc551200640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fc54c15ed80 0x7fc54c0cb840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:56902/0 (socket says 172.21.15.32:56902) 2024-03-19T06:21:15.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc551c00640 1 --2- 172.21.15.32:0/2301437680 >> v2:172.21.15.32:3300/0 conn(0x7fc54c154aa0 0x7fc54c0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7f3cade00640 1 --2- 172.21.15.32:0/3034229989 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c900676e0 0x7f3c90069ba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00ad000 tx=0x7f3ca0004780 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc54be00640 1 -- 172.21.15.32:0/2301437680 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764562473 0 0) 0x7fc54c0cf130 con 0x7fc54c15ed80 2024-03-19T06:21:15.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc54be00640 1 -- 172.21.15.32:0/2301437680 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc534003530 con 0x7fc54c15ed80 2024-03-19T06:21:15.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc552600640 1 -- 172.21.15.32:0/2301437680 >> v2:172.21.15.32:3300/0 conn(0x7fc54c154aa0 msgr2=0x7fc54c0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc552600640 1 --2- 172.21.15.32:0/2301437680 >> v2:172.21.15.32:3300/0 conn(0x7fc54c154aa0 0x7fc54c0ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc552600640 1 -- 172.21.15.32:0/2301437680 >> v1:172.21.15.171:6789/0 conn(0x7fc54c15ed80 legacy=0x7fc54c0cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc552600640 1 -- 172.21.15.32:0/2301437680 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c15e2a0 con 0x7fc54c06f270 2024-03-19T06:21:15.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.740+0000 7fc551c00640 1 --2- 172.21.15.32:0/2301437680 >> v2:172.21.15.32:3300/0 conn(0x7fc54c154aa0 0x7fc54c0ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:15.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fc7cf400640 1 --2- 172.21.15.32:0/3513507593 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc7ac0676e0 0x7fc7ac069ba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0001370 tx=0x7fc7c0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0774400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f076c09a480 0x7f076c152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0774400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f076c0cd390 0x7f076c15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0774400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f076c15bb20 0x7f076c1f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0774400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c0c5af0 con 0x7f076c15bb20 2024-03-19T06:21:15.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0774400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c09a890 con 0x7f076c0cd390 2024-03-19T06:21:15.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0774400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c166930 con 0x7f076c09a480 2024-03-19T06:21:15.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0771000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f076c0cd390 0x7f076c15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fa20e200640 1 Processor -- start 2024-03-19T06:21:15.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0771a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f076c09a480 0x7f076c152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0771a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f076c09a480 0x7f076c152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:50230/0 (socket says 172.21.15.32:50230) 2024-03-19T06:21:15.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0771a00640 1 -- 172.21.15.32:0/1503660652 learned_addr learned my addr 172.21.15.32:0/1503660652 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0772400640 1 --2- 172.21.15.32:0/1503660652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f076c15bb20 0x7f076c1f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0772400640 1 -- 172.21.15.32:0/1503660652 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f076c09a480 msgr2=0x7f076c152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0772400640 1 --2- 172.21.15.32:0/1503660652 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f076c09a480 0x7f076c152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0772400640 1 -- 172.21.15.32:0/1503660652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f076c0cd390 msgr2=0x7f076c15caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0772400640 1 --2- 172.21.15.32:0/1503660652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f076c0cd390 0x7f076c15caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0772400640 1 -- 172.21.15.32:0/1503660652 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c15e8a0 con 0x7f076c15bb20 2024-03-19T06:21:15.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fa20e200640 1 -- start start 2024-03-19T06:21:15.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fc7c7e00640 1 -- 172.21.15.32:0/3513507593 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fc7b803b050 con 0x7fc7d0156b00 2024-03-19T06:21:15.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0772400640 1 --2- 172.21.15.32:0/1503660652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f076c15bb20 0x7f076c1f5d30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f07640bd000 tx=0x7f076402a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fa20e200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa20815e6f0 0x7fa20815dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fa20e200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa208157c80 0x7fa20815e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fa20e200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2080b3ef0 con 0x7fa2081578a0 2024-03-19T06:21:15.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fa20e200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20806e590 con 0x7fa20815e6f0 2024-03-19T06:21:15.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fa20e200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20806e870 con 0x7fa208157c80 2024-03-19T06:21:15.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0769600640 1 -- 172.21.15.32:0/1503660652 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640c9810 con 0x7f076c15bb20 2024-03-19T06:21:15.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fa207400640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fa2081578a0 0x7fa2080b37e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:56916/0 (socket says 172.21.15.32:56916) 2024-03-19T06:21:15.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fa207400640 1 -- 172.21.15.32:0/2696384254 learned_addr learned my addr 172.21.15.32:0/2696384254 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:15.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fa206a00640 1 --2- 172.21.15.32:0/2696384254 >> v2:172.21.15.171:3300/0 conn(0x7fa20815e6f0 0x7fa20815dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fa207e00640 1 --2- 172.21.15.32:0/2696384254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa208157c80 0x7fa20815e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0769600640 1 -- 172.21.15.32:0/1503660652 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07640cf070 con 0x7f076c15bb20 2024-03-19T06:21:15.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fa207e00640 1 -- 172.21.15.32:0/2696384254 >> v2:172.21.15.171:3300/0 conn(0x7fa20815e6f0 msgr2=0x7fa20815dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fa207e00640 1 --2- 172.21.15.32:0/2696384254 >> v2:172.21.15.171:3300/0 conn(0x7fa20815e6f0 0x7fa20815dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0769600640 1 -- 172.21.15.32:0/1503660652 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640c9bf0 con 0x7f076c15bb20 2024-03-19T06:21:15.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7f0774400640 1 -- 172.21.15.32:0/1503660652 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076c15eb40 con 0x7f076c15bb20 2024-03-19T06:21:15.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fa207e00640 1 -- 172.21.15.32:0/2696384254 >> v1:172.21.15.171:6789/0 conn(0x7fa2081578a0 legacy=0x7fa2080b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.744+0000 7fa207e00640 1 -- 172.21.15.32:0/2696384254 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2080b41b0 con 0x7fa208157c80 2024-03-19T06:21:15.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.748+0000 7f0774400640 1 -- 172.21.15.32:0/1503660652 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076c152d80 con 0x7f076c15bb20 2024-03-19T06:21:15.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.748+0000 7fc552600640 1 --2- 172.21.15.32:0/2301437680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc54c06f270 0x7fc54c06f6d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0af190 tx=0x7fc54401c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29ff3c07bf7fdf0b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.748+0000 7fc54be00640 1 -- 172.21.15.32:0/2301437680 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440a5620 con 0x7fc54c06f270 2024-03-19T06:21:15.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.748+0000 7fc54be00640 1 -- 172.21.15.32:0/2301437680 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5440a57c0 con 0x7fc54c06f270 2024-03-19T06:21:15.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.748+0000 7fc54be00640 1 -- 172.21.15.32:0/2301437680 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440a5b90 con 0x7fc54c06f270 2024-03-19T06:21:15.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.748+0000 7fc554600640 1 -- 172.21.15.32:0/2301437680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc54c06f270 msgr2=0x7fc54c06f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.748+0000 7fc554600640 1 --2- 172.21.15.32:0/2301437680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc54c06f270 0x7fc54c06f6d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0af190 tx=0x7fc54401c960 comp rx=0 tx=0).stop 2024-03-19T06:21:15.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.748+0000 7f3ca6000640 1 -- 172.21.15.32:0/3034229989 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f3ca80e5440 con 0x7f3ca80e3d00 2024-03-19T06:21:15.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.748+0000 7fa207e00640 1 --2- 172.21.15.32:0/2696384254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa208157c80 0x7fa20815e020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa20806e710 tx=0x7fa1f001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c774086e07de16e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fc554600640 1 -- 172.21.15.32:0/2301437680 shutdown_connections 2024-03-19T06:21:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fc554600640 1 --2- 172.21.15.32:0/2301437680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc54c06f270 0x7fc54c06f6d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fc554600640 1 --2- 172.21.15.32:0/2301437680 >> v2:172.21.15.32:3300/0 conn(0x7fc54c154aa0 0x7fc54c0ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fc554600640 1 -- 172.21.15.32:0/2301437680 >> 172.21.15.32:0/2301437680 conn(0x7fc54c0cf5b0 msgr2=0x7fc54c0cf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7f075ea00640 1 -- 172.21.15.32:0/1503660652 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076c0749e0 con 0x7f076c15bb20 2024-03-19T06:21:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7f0769600640 1 -- 172.21.15.32:0/1503660652 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f07640c8070 con 0x7f076c15bb20 2024-03-19T06:21:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fa206000640 1 -- 172.21.15.32:0/2696384254 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f00b0070 con 0x7fa208157c80 2024-03-19T06:21:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fa206000640 1 -- 172.21.15.32:0/2696384254 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f00ab600 con 0x7fa208157c80 2024-03-19T06:21:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fa206000640 1 -- 172.21.15.32:0/2696384254 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f00ab9d0 con 0x7fa208157c80 2024-03-19T06:21:15.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fa20e200640 1 -- 172.21.15.32:0/2696384254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa208157c80 msgr2=0x7fa20815e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fa20e200640 1 --2- 172.21.15.32:0/2696384254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa208157c80 0x7fa20815e020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa20806e710 tx=0x7fa1f001c430 comp rx=0 tx=0).stop 2024-03-19T06:21:15.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fc554600640 1 -- 172.21.15.32:0/2301437680 shutdown_connections 2024-03-19T06:21:15.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fc554600640 1 -- 172.21.15.32:0/2301437680 wait complete. 2024-03-19T06:21:15.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7f4ce2a00640 1 Processor -- start 2024-03-19T06:21:15.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7f0974a00640 1 Processor -- start 2024-03-19T06:21:15.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fa20e200640 1 -- 172.21.15.32:0/2696384254 shutdown_connections 2024-03-19T06:21:15.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fa20e200640 1 --2- 172.21.15.32:0/2696384254 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa208157c80 0x7fa20815e020 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fa20e200640 1 --2- 172.21.15.32:0/2696384254 >> v2:172.21.15.171:3300/0 conn(0x7fa20815e6f0 0x7fa20815dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fa20e200640 1 -- 172.21.15.32:0/2696384254 >> 172.21.15.32:0/2696384254 conn(0x7fa2080cfec0 msgr2=0x7fa2080d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fa20e200640 1 -- 172.21.15.32:0/2696384254 shutdown_connections 2024-03-19T06:21:15.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fa20e200640 1 -- 172.21.15.32:0/2696384254 wait complete. 2024-03-19T06:21:15.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7fc554600640 1 Processor -- start 2024-03-19T06:21:15.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7fa20e200640 1 Processor -- start 2024-03-19T06:21:15.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7fa20e200640 1 -- start start 2024-03-19T06:21:15.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7f4ce2a00640 1 -- start start 2024-03-19T06:21:15.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f4ce2a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4cdc071a60 0x7f4cdc0ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f4ce2a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cdc0ca5c0 0x7f4cdc06e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f4ce2a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cdc0cadb0 con 0x7f4cdc153fe0 2024-03-19T06:21:15.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f4ce2a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cdc0cb090 con 0x7f4cdc071a60 2024-03-19T06:21:15.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f4ce2a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc0cb370 con 0x7f4cdc0ca5c0 2024-03-19T06:21:15.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7fa20e200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2081578a0 0x7fa20814caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7fa20e200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa208157c80 0x7fa2080b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7fa20e200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa20815e6f0 0x7fa208156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7fa206a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa208157c80 0x7fa2080b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7fa206a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa208157c80 0x7fa2080b0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57280/0 (socket says 172.21.15.32:57280) 2024-03-19T06:21:15.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7f0974a00640 1 -- start start 2024-03-19T06:21:15.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f0974a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f097015dbd0 0x7f09700b92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f0974a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09700b7390 con 0x7f09700b6f40 2024-03-19T06:21:15.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f0974a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097015dfb0 con 0x7f09700b6b00 2024-03-19T06:21:15.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f0974a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09700d1ac0 con 0x7f097015dbd0 2024-03-19T06:21:15.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096d400640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f09700b6b00 0x7f09700d2db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:56918/0 (socket says 172.21.15.32:56918) 2024-03-19T06:21:15.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096d400640 1 -- 172.21.15.32:0/3448027763 learned_addr learned my addr 172.21.15.32:0/3448027763 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096ca00640 1 -- 172.21.15.32:0/3448027763 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953820206 0 0) 0x7f097015dfb0 con 0x7f09700b6b00 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096ca00640 1 -- 172.21.15.32:0/3448027763 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0954003530 con 0x7f09700b6b00 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096ca00640 1 -- 172.21.15.32:0/3448027763 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3193924644 0 0) 0x7f0954003530 con 0x7f09700b6b00 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096ca00640 1 -- 172.21.15.32:0/3448027763 >> v2:172.21.15.32:3300/0 conn(0x7f097015dbd0 msgr2=0x7f09700b92f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096ca00640 1 --2- 172.21.15.32:0/3448027763 >> v2:172.21.15.32:3300/0 conn(0x7f097015dbd0 0x7f09700b92f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096ca00640 1 -- 172.21.15.32:0/3448027763 >> v1:172.21.15.32:6789/0 conn(0x7f09700b6f40 legacy=0x7f09700b5450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096ca00640 1 -- 172.21.15.32:0/3448027763 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09700d1d10 con 0x7f09700b6b00 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096ca00640 1 -- 172.21.15.32:0/3448027763 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f095c001660 con 0x7f09700b6b00 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096ca00640 1 -- 172.21.15.32:0/3448027763 >> v1:172.21.15.171:6789/0 conn(0x7f09700b6b00 legacy=0x7f09700d2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096ca00640 1 --2- 172.21.15.32:0/3448027763 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0954003a10 0x7f0954003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096ca00640 1 --2- 172.21.15.32:0/3448027763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0954004810 0x7f0954004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096ca00640 1 --2- 172.21.15.32:0/3448027763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09540053b0 0x7f095400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096ca00640 1 -- 172.21.15.32:0/3448027763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09700d1ac0 con 0x7f0954004810 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096ca00640 1 -- 172.21.15.32:0/3448027763 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095402e2f0 con 0x7f09540053b0 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096ca00640 1 -- 172.21.15.32:0/3448027763 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095402e4f0 con 0x7f0954003a10 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096d400640 1 --2- 172.21.15.32:0/3448027763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0954004810 0x7f0954004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096e800640 1 --2- 172.21.15.32:0/3448027763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09540053b0 0x7f095400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7f096de00640 1 --2- 172.21.15.32:0/3448027763 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0954003a10 0x7f0954003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7f0769600640 1 --2- 172.21.15.32:0/1503660652 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f074c067730 0x7f074c069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.752+0000 7f0769600640 1 -- 172.21.15.32:0/1503660652 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0764131170 con 0x7f076c15bb20 2024-03-19T06:21:15.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7fa206a00640 1 -- 172.21.15.32:0/3160349430 learned_addr learned my addr 172.21.15.32:0/3160349430 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7fa207e00640 1 --2- 172.21.15.32:0/3160349430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa20815e6f0 0x7fa208156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7fa20e200640 1 -- 172.21.15.32:0/3160349430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20815a880 con 0x7fa2081578a0 2024-03-19T06:21:15.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.756+0000 7fc554600640 1 -- start start 2024-03-19T06:21:15.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f4ce0a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cdc0ca5c0 0x7f4cdc06e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f4ce0a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cdc0ca5c0 0x7f4cdc06e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:50262/0 (socket says 172.21.15.32:50262) 2024-03-19T06:21:15.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f4ce0a00640 1 -- 172.21.15.32:0/1504053155 learned_addr learned my addr 172.21.15.32:0/1504053155 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f0771a00640 1 --2- 172.21.15.32:0/1503660652 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f074c067730 0x7f074c069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f096de00640 1 -- 172.21.15.32:0/3448027763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09540053b0 msgr2=0x7f095400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f096de00640 1 --2- 172.21.15.32:0/3448027763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09540053b0 0x7f095400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f096de00640 1 -- 172.21.15.32:0/3448027763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0954004810 msgr2=0x7f0954004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f096de00640 1 --2- 172.21.15.32:0/3448027763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0954004810 0x7f0954004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f096de00640 1 -- 172.21.15.32:0/3448027763 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0954003530 con 0x7f0954003a10 2024-03-19T06:21:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f096e800640 1 -- 172.21.15.32:0/3448027763 reap_dead start 2024-03-19T06:21:15.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f4cdb400640 1 --2- 172.21.15.32:0/1504053155 >> v2:172.21.15.32:3300/0 conn(0x7f4cdc071a60 0x7f4cdc0ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f3bdc800640 1 Processor -- start 2024-03-19T06:21:15.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f0771a00640 1 --2- 172.21.15.32:0/1503660652 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f074c067730 0x7f074c069bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0758001810 tx=0x7f0758009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f4cdb400640 1 -- 172.21.15.32:0/1504053155 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cdc0ca5c0 msgr2=0x7f4cdc06e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f4cdb400640 1 --2- 172.21.15.32:0/1504053155 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cdc0ca5c0 0x7f4cdc06e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f4cdb400640 1 -- 172.21.15.32:0/1504053155 >> v1:172.21.15.32:6789/0 conn(0x7f4cdc153fe0 legacy=0x7f4cdc071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7fc554600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc54c06f270 0x7fc54c169170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7fc554600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc54c154aa0 0x7fc54c0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7fc554600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc54c15ed80 0x7fc54c0b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7fc554600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c0c94e0 con 0x7fc54c06f270 2024-03-19T06:21:15.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7fc554600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c0c9360 con 0x7fc54c154aa0 2024-03-19T06:21:15.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7fc554600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c161680 con 0x7fc54c15ed80 2024-03-19T06:21:15.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f4cdb400640 1 -- 172.21.15.32:0/1504053155 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc0cb650 con 0x7f4cdc071a60 2024-03-19T06:21:15.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f0769600640 1 -- 172.21.15.32:0/1503660652 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f07640bd030 con 0x7f076c15bb20 2024-03-19T06:21:15.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7fa20e200640 1 -- 172.21.15.32:0/3160349430 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20815a700 con 0x7fa208157c80 2024-03-19T06:21:15.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fa20e200640 1 -- 172.21.15.32:0/3160349430 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20815aa00 con 0x7fa20815e6f0 2024-03-19T06:21:15.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fa207400640 1 --2- 172.21.15.32:0/3160349430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2081578a0 0x7fa20814caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7fc552600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc54c15ed80 0x7fc54c0b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7fc552600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc54c15ed80 0x7fc54c0b0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:50284/0 (socket says 172.21.15.32:50284) 2024-03-19T06:21:15.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7fc552600640 1 -- 172.21.15.32:0/278561424 learned_addr learned my addr 172.21.15.32:0/278561424 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fc551200640 1 --2- 172.21.15.32:0/278561424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc54c154aa0 0x7fc54c0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fc551c00640 1 --2- 172.21.15.32:0/278561424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc54c06f270 0x7fc54c169170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f3bdc800640 1 -- start start 2024-03-19T06:21:15.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f3bdc800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3bd415bb20 0x7f3bd409a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f3bdc800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3bd40cd390 0x7f3bd40cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f3bdc800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd415bf00 con 0x7f3bd40cf460 2024-03-19T06:21:15.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f3bdc800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd40cc3a0 con 0x7f3bd415bb20 2024-03-19T06:21:15.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.760+0000 7f3bdc800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd40cfbb0 con 0x7f3bd40cd390 2024-03-19T06:21:15.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7f3bd9400640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f3bd40cf460 0x7f3bd40c53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:56920/0 (socket says 172.21.15.32:56920) 2024-03-19T06:21:15.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7f3bd9400640 1 -- 172.21.15.32:0/1664783204 learned_addr learned my addr 172.21.15.32:0/1664783204 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:15.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7f3bd9e00640 1 --2- 172.21.15.32:0/1664783204 >> v2:172.21.15.32:3300/0 conn(0x7f3bd415bb20 0x7f3bd409a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7f3bda800640 1 --2- 172.21.15.32:0/1664783204 >> v2:172.21.15.171:3300/0 conn(0x7f3bd40cd390 0x7f3bd40cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fc551200640 1 -- 172.21.15.32:0/278561424 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc54c15ed80 msgr2=0x7fc54c0b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fc551200640 1 --2- 172.21.15.32:0/278561424 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc54c15ed80 0x7fc54c0b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fa207400640 1 -- 172.21.15.32:0/3160349430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa20815e6f0 msgr2=0x7fa208156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fa207400640 1 --2- 172.21.15.32:0/3160349430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa20815e6f0 0x7fa208156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fa207400640 1 -- 172.21.15.32:0/3160349430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa208157c80 msgr2=0x7fa2080b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fa207400640 1 --2- 172.21.15.32:0/3160349430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa208157c80 0x7fa2080b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fa207400640 1 -- 172.21.15.32:0/3160349430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20815afe0 con 0x7fa2081578a0 2024-03-19T06:21:15.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fa207400640 1 --2- 172.21.15.32:0/3160349430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2081578a0 0x7fa20814caa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa20000caf0 tx=0x7fa20000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fa206a00640 1 --2- 172.21.15.32:0/3160349430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa208157c80 0x7fa2080b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:15.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fa207e00640 1 --2- 172.21.15.32:0/3160349430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa20815e6f0 0x7fa208156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:15.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7f3bd8a00640 1 -- 172.21.15.32:0/1664783204 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150452567 0 0) 0x7f3bd415bf00 con 0x7f3bd40cf460 2024-03-19T06:21:15.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7f3bd8a00640 1 -- 172.21.15.32:0/1664783204 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bbc003530 con 0x7f3bd40cf460 2024-03-19T06:21:15.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7f3bda800640 1 -- 172.21.15.32:0/1664783204 >> v2:172.21.15.32:3300/0 conn(0x7f3bd415bb20 msgr2=0x7f3bd409a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:15.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7f3bda800640 1 --2- 172.21.15.32:0/1664783204 >> v2:172.21.15.32:3300/0 conn(0x7f3bd415bb20 0x7f3bd409a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7f3bd8a00640 1 -- 172.21.15.32:0/1664783204 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 626685481 0 0) 0x7f3bbc003530 con 0x7f3bd40cf460 2024-03-19T06:21:15.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fa1ff400640 1 -- 172.21.15.32:0/3160349430 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20000aca0 con 0x7fa2081578a0 2024-03-19T06:21:15.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7f3bda800640 1 -- 172.21.15.32:0/1664783204 >> v1:172.21.15.171:6789/0 conn(0x7f3bd40cf460 legacy=0x7f3bd40c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7f3bda800640 1 -- 172.21.15.32:0/1664783204 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd40cc5d0 con 0x7f3bd40cd390 2024-03-19T06:21:15.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7f4cdb400640 1 --2- 172.21.15.32:0/1504053155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cdc071a60 0x7f4cdc0ca080 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0097c0 tx=0x7f4ccc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf2ae5e2361d5ac server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fa1ff400640 1 -- 172.21.15.32:0/3160349430 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20000ae40 con 0x7fa2081578a0 2024-03-19T06:21:15.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fa20e200640 1 -- 172.21.15.32:0/3160349430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20815b2c0 con 0x7fa2081578a0 2024-03-19T06:21:15.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fa20e200640 1 -- 172.21.15.32:0/3160349430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20815b880 con 0x7fa2081578a0 2024-03-19T06:21:15.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7fa1ff400640 1 -- 172.21.15.32:0/3160349430 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200012600 con 0x7fa2081578a0 2024-03-19T06:21:15.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.764+0000 7fc551200640 1 -- 172.21.15.32:0/278561424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc54c06f270 msgr2=0x7fc54c169170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7fc551200640 1 --2- 172.21.15.32:0/278561424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc54c06f270 0x7fc54c169170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7fc551200640 1 -- 172.21.15.32:0/278561424 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c0cee30 con 0x7fc54c154aa0 2024-03-19T06:21:15.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7fc551c00640 1 --2- 172.21.15.32:0/278561424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc54c06f270 0x7fc54c169170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:15.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7f4cdaa00640 1 -- 172.21.15.32:0/1504053155 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0b0070 con 0x7f4cdc071a60 2024-03-19T06:21:15.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7f4cdaa00640 1 -- 172.21.15.32:0/1504053155 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc0ab600 con 0x7f4cdc071a60 2024-03-19T06:21:15.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7f4cdaa00640 1 -- 172.21.15.32:0/1504053155 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0ab9d0 con 0x7f4cdc071a60 2024-03-19T06:21:15.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7fc551200640 1 --2- 172.21.15.32:0/278561424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc54c154aa0 0x7fc54c0b00e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc53800c390 tx=0x7fc53800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7fc549600640 1 -- 172.21.15.32:0/278561424 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5380074e0 con 0x7fc54c154aa0 2024-03-19T06:21:15.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7fc549600640 1 -- 172.21.15.32:0/278561424 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5380076a0 con 0x7fc54c154aa0 2024-03-19T06:21:15.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7fc549600640 1 -- 172.21.15.32:0/278561424 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc538004a30 con 0x7fc54c154aa0 2024-03-19T06:21:15.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7fc554600640 1 -- 172.21.15.32:0/278561424 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54c143e80 con 0x7fc54c154aa0 2024-03-19T06:21:15.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7fc554600640 1 -- 172.21.15.32:0/278561424 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54c144440 con 0x7fc54c154aa0 2024-03-19T06:21:15.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7fa20e200640 1 -- 172.21.15.32:0/3160349430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e00052a0 con 0x7fa2081578a0 2024-03-19T06:21:15.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7f3bd9e00640 1 --2- 172.21.15.32:0/1664783204 >> v2:172.21.15.32:3300/0 conn(0x7f3bd415bb20 0x7f3bd409a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:15.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7f4ce2a00640 1 -- 172.21.15.32:0/1504053155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cdc071a60 msgr2=0x7f4cdc0ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7f4ce2a00640 1 --2- 172.21.15.32:0/1504053155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cdc071a60 0x7f4cdc0ca080 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0097c0 tx=0x7f4ccc01c410 comp rx=0 tx=0).stop 2024-03-19T06:21:15.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7f3bda800640 1 --2- 172.21.15.32:0/1664783204 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bd40cd390 0x7f3bd40cd820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3bd406e960 tx=0x7f3bd001c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed4f23749808a2bb server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7f4ce2a00640 1 -- 172.21.15.32:0/1504053155 shutdown_connections 2024-03-19T06:21:15.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7f4ce2a00640 1 --2- 172.21.15.32:0/1504053155 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cdc0ca5c0 0x7f4cdc06e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7f4ce2a00640 1 --2- 172.21.15.32:0/1504053155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cdc071a60 0x7f4cdc0ca080 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7f4ce2a00640 1 -- 172.21.15.32:0/1504053155 >> 172.21.15.32:0/1504053155 conn(0x7f4cdc0cf5b0 msgr2=0x7f4cdc0cf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7fa1ff400640 1 -- 172.21.15.32:0/3160349430 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa2000127a0 con 0x7fa2081578a0 2024-03-19T06:21:15.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7fc554600640 1 -- 172.21.15.32:0/278561424 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5280052a0 con 0x7fc54c154aa0 2024-03-19T06:21:15.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7f4ce2a00640 1 -- 172.21.15.32:0/1504053155 shutdown_connections 2024-03-19T06:21:15.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.768+0000 7f4ce2a00640 1 -- 172.21.15.32:0/1504053155 wait complete. 2024-03-19T06:21:15.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7fc549600640 1 -- 172.21.15.32:0/278561424 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc53801a020 con 0x7fc54c154aa0 2024-03-19T06:21:15.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f3bd8a00640 1 -- 172.21.15.32:0/1664783204 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00b2070 con 0x7f3bd40cd390 2024-03-19T06:21:15.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f3bd8a00640 1 -- 172.21.15.32:0/1664783204 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd00a5580 con 0x7f3bd40cd390 2024-03-19T06:21:15.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f3bd8a00640 1 -- 172.21.15.32:0/1664783204 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0001680 con 0x7f3bd40cd390 2024-03-19T06:21:15.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7fa1ff400640 1 --2- 172.21.15.32:0/3160349430 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa1e4067730 0x7fa1e4069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7fc549600640 1 --2- 172.21.15.32:0/278561424 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc52c0676b0 0x7fc52c069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7fc549600640 1 -- 172.21.15.32:0/278561424 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc538084fe0 con 0x7fc54c154aa0 2024-03-19T06:21:15.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f4ce2a00640 1 Processor -- start 2024-03-19T06:21:15.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f3bdc800640 1 -- 172.21.15.32:0/1664783204 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bd40cd390 msgr2=0x7f3bd40cd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f3bdc800640 1 --2- 172.21.15.32:0/1664783204 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bd40cd390 0x7f3bd40cd820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3bd406e960 tx=0x7f3bd001c870 comp rx=0 tx=0).stop 2024-03-19T06:21:15.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7fc551c00640 1 --2- 172.21.15.32:0/278561424 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc52c0676b0 0x7fc52c069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f4ce2a00640 1 -- start start 2024-03-19T06:21:15.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f3bdc800640 1 -- 172.21.15.32:0/1664783204 shutdown_connections 2024-03-19T06:21:15.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f3bdc800640 1 --2- 172.21.15.32:0/1664783204 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bd40cd390 0x7f3bd40cd820 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f3bdc800640 1 --2- 172.21.15.32:0/1664783204 >> v2:172.21.15.32:3300/0 conn(0x7f3bd415bb20 0x7f3bd409a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f3bdc800640 1 -- 172.21.15.32:0/1664783204 >> 172.21.15.32:0/1664783204 conn(0x7f3bd40d1890 msgr2=0x7f3bd40d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f3bdc800640 1 -- 172.21.15.32:0/1664783204 shutdown_connections 2024-03-19T06:21:15.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7fa1ff400640 1 -- 172.21.15.32:0/3160349430 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa200085f80 con 0x7fa2081578a0 2024-03-19T06:21:15.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7fc551c00640 1 --2- 172.21.15.32:0/278561424 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc52c0676b0 0x7fc52c069b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc540009bc0 tx=0x7fc540008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f096de00640 1 --2- 172.21.15.32:0/3448027763 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0954003a10 0x7f0954003e50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f09600097e0 tx=0x7f096001c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d23d6800b1fbb9c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f4ce2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cdc071a60 0x7f4cdc0c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f4ce2a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cdc0ca5c0 0x7f4cdc1502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f3bdc800640 1 -- 172.21.15.32:0/1664783204 wait complete. 2024-03-19T06:21:15.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f4ce2a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cdc153fe0 0x7f4cdc13bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f4ce2a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc06f370 con 0x7f4cdc071a60 2024-03-19T06:21:15.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f4ce2a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc1545d0 con 0x7f4cdc153fe0 2024-03-19T06:21:15.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f4ce2a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc06f4f0 con 0x7f4cdc0ca5c0 2024-03-19T06:21:15.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7fa206a00640 1 --2- 172.21.15.32:0/3160349430 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa1e4067730 0x7fa1e4069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f4cdb400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cdc0ca5c0 0x7f4cdc1502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f4ce0a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cdc153fe0 0x7f4cdc13bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f4ce0a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cdc153fe0 0x7f4cdc13bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57308/0 (socket says 172.21.15.32:57308) 2024-03-19T06:21:15.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f4ce0a00640 1 -- 172.21.15.32:0/3109881491 learned_addr learned my addr 172.21.15.32:0/3109881491 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.772+0000 7f096ca00640 1 -- 172.21.15.32:0/3448027763 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09600b1070 con 0x7f0954003a10 2024-03-19T06:21:15.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f096ca00640 1 -- 172.21.15.32:0/3448027763 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09600a4e20 con 0x7f0954003a10 2024-03-19T06:21:15.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f4cdb400640 1 -- 172.21.15.32:0/3109881491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cdc153fe0 msgr2=0x7f4cdc13bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f4cdb400640 1 --2- 172.21.15.32:0/3109881491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cdc153fe0 0x7f4cdc13bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f4cdb400640 1 -- 172.21.15.32:0/3109881491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cdc071a60 msgr2=0x7f4cdc0c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f0974a00640 1 -- 172.21.15.32:0/3448027763 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0954003a10 msgr2=0x7f0954003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f0974a00640 1 --2- 172.21.15.32:0/3448027763 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0954003a10 0x7f0954003e50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f09600097e0 tx=0x7f096001c2e0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f0974a00640 1 -- 172.21.15.32:0/3448027763 shutdown_connections 2024-03-19T06:21:15.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f0974a00640 1 --2- 172.21.15.32:0/3448027763 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0954003a10 0x7f0954003e50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f0974a00640 1 -- 172.21.15.32:0/3448027763 >> 172.21.15.32:0/3448027763 conn(0x7f09700d0620 msgr2=0x7f09700d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:15.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f4cdbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cdc071a60 0x7f4cdc0c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f4cdb400640 1 --2- 172.21.15.32:0/3109881491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cdc071a60 0x7f4cdc0c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f4cdb400640 1 -- 172.21.15.32:0/3109881491 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc0b25c0 con 0x7f4cdc0ca5c0 2024-03-19T06:21:15.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f4cdbe00640 1 --2- 172.21.15.32:0/3109881491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cdc071a60 0x7f4cdc0c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:15.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7fc549600640 1 -- 172.21.15.32:0/278561424 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fc538055d10 con 0x7fc54c154aa0 2024-03-19T06:21:15.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f4cdb400640 1 --2- 172.21.15.32:0/3109881491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cdc0ca5c0 0x7f4cdc1502f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc06c000 tx=0x7f4ccc0191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f3bdc800640 1 Processor -- start 2024-03-19T06:21:15.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f3bdc800640 1 -- start start 2024-03-19T06:21:15.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f0974a00640 1 -- 172.21.15.32:0/3448027763 shutdown_connections 2024-03-19T06:21:15.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7f0974a00640 1 -- 172.21.15.32:0/3448027763 wait complete. 2024-03-19T06:21:15.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.776+0000 7fa206a00640 1 --2- 172.21.15.32:0/3160349430 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa1e4067730 0x7fa1e4069bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa208151550 tx=0x7fa1f8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f4cd3e00640 1 -- 172.21.15.32:0/3109881491 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0b0040 con 0x7f4cdc0ca5c0 2024-03-19T06:21:15.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f4cd3e00640 1 -- 172.21.15.32:0/3109881491 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc0ba070 con 0x7f4cdc0ca5c0 2024-03-19T06:21:15.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f4cd3e00640 1 -- 172.21.15.32:0/3109881491 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0b4650 con 0x7f4cdc0ca5c0 2024-03-19T06:21:15.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f4ce2a00640 1 -- 172.21.15.32:0/3109881491 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cdc0b28a0 con 0x7f4cdc0ca5c0 2024-03-19T06:21:15.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f4ce2a00640 1 -- 172.21.15.32:0/3109881491 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cdc0b2e60 con 0x7f4cdc0ca5c0 2024-03-19T06:21:15.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f4cd3e00640 1 -- 172.21.15.32:0/3109881491 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f4ccc0b47f0 con 0x7f4cdc0ca5c0 2024-03-19T06:21:15.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f4ce2a00640 1 -- 172.21.15.32:0/3109881491 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cdc0749e0 con 0x7f4cdc0ca5c0 2024-03-19T06:21:15.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f4cd3e00640 1 --2- 172.21.15.32:0/3109881491 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4cbc0676b0 0x7f4cbc069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f4cd3e00640 1 -- 172.21.15.32:0/3109881491 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ccc11f300 con 0x7f4cdc0ca5c0 2024-03-19T06:21:15.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f3bdc800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd40cd390 0x7f3bd4154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f3bdc800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bd40cf460 0x7f3bd4149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f3bdc800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bd415bb20 0x7f3bd4070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f3bdc800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40c5af0 con 0x7f3bd40cd390 2024-03-19T06:21:15.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f3bdc800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40cf8d0 con 0x7f3bd40cf460 2024-03-19T06:21:15.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f3bdc800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd4166930 con 0x7f3bd415bb20 2024-03-19T06:21:15.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f3bd9400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bd40cf460 0x7f3bd4149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f3bda800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bd415bb20 0x7f3bd4070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f3bd9400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bd40cf460 0x7f3bd4149f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57318/0 (socket says 172.21.15.32:57318) 2024-03-19T06:21:15.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f3bd9400640 1 -- 172.21.15.32:0/3719632992 learned_addr learned my addr 172.21.15.32:0/3719632992 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f3bd9e00640 1 --2- 172.21.15.32:0/3719632992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd40cd390 0x7f3bd4154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f3bda800640 1 -- 172.21.15.32:0/3719632992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bd40cf460 msgr2=0x7f3bd4149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f3bda800640 1 --2- 172.21.15.32:0/3719632992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bd40cf460 0x7f3bd4149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f3bda800640 1 -- 172.21.15.32:0/3719632992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd40cd390 msgr2=0x7f3bd4154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f3bda800640 1 --2- 172.21.15.32:0/3719632992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd40cd390 0x7f3bd4154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f3bda800640 1 -- 172.21.15.32:0/3719632992 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd41f5cf0 con 0x7f3bd415bb20 2024-03-19T06:21:15.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f3bd9400640 1 --2- 172.21.15.32:0/3719632992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bd40cf460 0x7f3bd4149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:15.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f3bda800640 1 --2- 172.21.15.32:0/3719632992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bd415bb20 0x7f3bd4070280 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00ac000 tx=0x7f3bd0019610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f3bce000640 1 -- 172.21.15.32:0/3719632992 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00b2070 con 0x7f3bd415bb20 2024-03-19T06:21:15.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f3bdc800640 1 -- 172.21.15.32:0/3719632992 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd41f5fd0 con 0x7f3bd415bb20 2024-03-19T06:21:15.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f3bdc800640 1 -- 172.21.15.32:0/3719632992 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd41f6590 con 0x7f3bd415bb20 2024-03-19T06:21:15.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f3bce000640 1 -- 172.21.15.32:0/3719632992 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd00b3040 con 0x7f3bd415bb20 2024-03-19T06:21:15.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f3bce000640 1 -- 172.21.15.32:0/3719632992 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00b96a0 con 0x7f3bd415bb20 2024-03-19T06:21:15.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f0974a00640 1 Processor -- start 2024-03-19T06:21:15.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.780+0000 7f0974a00640 1 -- start start 2024-03-19T06:21:15.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f0974a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0970089b30 0x7f097007e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f0974a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0970089f10 0x7f097014ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f096de00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0970089b30 0x7f097007e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f096de00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0970089b30 0x7f097007e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:50310/0 (socket says 172.21.15.32:50310) 2024-03-19T06:21:15.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f0974a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09700c88e0 0x7f09700c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f0974a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09700d25b0 con 0x7f09700c88e0 2024-03-19T06:21:15.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f0974a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09700d22d0 con 0x7f0970089f10 2024-03-19T06:21:15.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f0974a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09700d2890 con 0x7f0970089b30 2024-03-19T06:21:15.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f096d400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0970089f10 0x7f097014ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f096de00640 1 -- 172.21.15.32:0/473649333 learned_addr learned my addr 172.21.15.32:0/473649333 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:15.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f096e800640 1 --2- 172.21.15.32:0/473649333 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09700c88e0 0x7f09700c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f096de00640 1 -- 172.21.15.32:0/473649333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0970089f10 msgr2=0x7f097014ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f096de00640 1 --2- 172.21.15.32:0/473649333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0970089f10 0x7f097014ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f096de00640 1 -- 172.21.15.32:0/473649333 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09700c88e0 msgr2=0x7f09700c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:15.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f096de00640 1 --2- 172.21.15.32:0/473649333 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09700c88e0 0x7f09700c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:15.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.784+0000 7f096de00640 1 -- 172.21.15.32:0/473649333 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0970149380 con 0x7f0970089b30 2024-03-19T06:21:15.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.788+0000 7f096de00640 1 --2- 172.21.15.32:0/473649333 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0970089b30 0x7f097007e0b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f096001c110 tx=0x7f0954005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.788+0000 7f4cdbe00640 1 --2- 172.21.15.32:0/3109881491 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4cbc0676b0 0x7f4cbc069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.788+0000 7fa1ff400640 1 -- 172.21.15.32:0/3160349430 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fa200056be0 con 0x7fa2081578a0 2024-03-19T06:21:15.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.788+0000 7f3bdc800640 1 -- 172.21.15.32:0/3719632992 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb00052a0 con 0x7f3bd415bb20 2024-03-19T06:21:15.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.788+0000 7f4cdbe00640 1 --2- 172.21.15.32:0/3109881491 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4cbc0676b0 0x7f4cbc069b70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8000f70 tx=0x7f4cc8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.792+0000 7f4cd3e00640 1 -- 172.21.15.32:0/3109881491 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f4ccc0160b0 con 0x7f4cdc0ca5c0 2024-03-19T06:21:15.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.792+0000 7f0966000640 1 -- 172.21.15.32:0/473649333 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09600b1040 con 0x7f0970089b30 2024-03-19T06:21:15.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.792+0000 7f0966000640 1 -- 172.21.15.32:0/473649333 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09600bc070 con 0x7f0970089b30 2024-03-19T06:21:15.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.792+0000 7f0966000640 1 -- 172.21.15.32:0/473649333 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09600b5650 con 0x7f0970089b30 2024-03-19T06:21:15.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.792+0000 7f0974a00640 1 -- 172.21.15.32:0/473649333 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097014dbd0 con 0x7f0970089b30 2024-03-19T06:21:15.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.792+0000 7f0974a00640 1 -- 172.21.15.32:0/473649333 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097014e190 con 0x7f0970089b30 2024-03-19T06:21:15.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.792+0000 7f3bce000640 1 -- 172.21.15.32:0/3719632992 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3bd00c1020 con 0x7f3bd415bb20 2024-03-19T06:21:15.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.796+0000 7f0974a00640 1 -- 172.21.15.32:0/473649333 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097014eb80 con 0x7f0970089b30 2024-03-19T06:21:15.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.796+0000 7f3bce000640 1 --2- 172.21.15.32:0/3719632992 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3bb4067730 0x7f3bb4069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.796+0000 7f3bce000640 1 -- 172.21.15.32:0/3719632992 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bd0120670 con 0x7f3bd415bb20 2024-03-19T06:21:15.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.796+0000 7f3bce000640 1 -- 172.21.15.32:0/3719632992 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f3bd00c8020 con 0x7f3bd415bb20 2024-03-19T06:21:15.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.796+0000 7f3bd9e00640 1 --2- 172.21.15.32:0/3719632992 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3bb4067730 0x7f3bb4069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.796+0000 7f0966000640 1 -- 172.21.15.32:0/473649333 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f09600b57f0 con 0x7f0970089b30 2024-03-19T06:21:15.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.800+0000 7f3bd9e00640 1 --2- 172.21.15.32:0/3719632992 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3bb4067730 0x7f3bb4069bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009580 tx=0x7f3bc8009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:15.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.800+0000 7f0966000640 1 --2- 172.21.15.32:0/473649333 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0950067630 0x7f0950069af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:15.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.800+0000 7f0966000640 1 -- 172.21.15.32:0/473649333 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f096011ffe0 con 0x7f0970089b30 2024-03-19T06:21:15.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.800+0000 7f0966000640 1 -- 172.21.15.32:0/473649333 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f0960015ff0 con 0x7f0970089b30 2024-03-19T06:21:15.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.800+0000 7f096d400640 1 --2- 172.21.15.32:0/473649333 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0950067630 0x7f0950069af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:15.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:15.804+0000 7f096d400640 1 --2- 172.21.15.32:0/473649333 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0950067630 0x7f0950069af0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f095c000c10 tx=0x7f095c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:16.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.088+0000 7f3caf200640 1 -- 172.21.15.32:0/3034229989 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3c88005590 con 0x7f3ca80e3d00 2024-03-19T06:21:16.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.096+0000 7f3ca6000640 1 -- 172.21.15.32:0/3034229989 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c9c055900 con 0x7f3ca80e3d00 2024-03-19T06:21:16.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.096+0000 7fc7d4e00640 1 -- 172.21.15.32:0/3513507593 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc7a8005590 con 0x7fc7d0156b00 2024-03-19T06:21:16.088 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2024-03-19T06:21:16.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.096+0000 7fc7c7e00640 1 -- 172.21.15.32:0/3513507593 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc7b81150a0 con 0x7fc7d0156b00 2024-03-19T06:21:16.091 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2024-03-19T06:21:16.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7f3caf200640 1 -- 172.21.15.32:0/3034229989 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c900676e0 msgr2=0x7f3c90069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:16.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7f3caf200640 1 --2- 172.21.15.32:0/3034229989 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c900676e0 0x7f3c90069ba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00ad000 tx=0x7f3ca0004780 comp rx=0 tx=0).stop 2024-03-19T06:21:16.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7f3caf200640 1 -- 172.21.15.32:0/3034229989 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80e3d00 msgr2=0x7f3ca8053ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:16.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7f3caf200640 1 --2- 172.21.15.32:0/3034229989 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80e3d00 0x7f3ca8053ca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c007fd0 tx=0x7f3c9c00dcd0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7fc7d4e00640 1 -- 172.21.15.32:0/3513507593 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc7ac0676e0 msgr2=0x7fc7ac069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:16.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7f075ea00640 1 -- 172.21.15.32:0/1503660652 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f076c0b7810 con 0x7f076c15bb20 2024-03-19T06:21:16.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7fc7d4e00640 1 --2- 172.21.15.32:0/3513507593 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc7ac0676e0 0x7fc7ac069ba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0001370 tx=0x7fc7c0009040 comp rx=0 tx=0).stop 2024-03-19T06:21:16.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7fc7d4e00640 1 -- 172.21.15.32:0/3513507593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7d0156b00 msgr2=0x7fc7d013de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:16.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7fc7d4e00640 1 --2- 172.21.15.32:0/3513507593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7d0156b00 0x7fc7d013de00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400c130 tx=0x7fc7b4009c50 comp rx=0 tx=0).stop 2024-03-19T06:21:16.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7f3caf200640 1 -- 172.21.15.32:0/3034229989 shutdown_connections 2024-03-19T06:21:16.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7f3caf200640 1 --2- 172.21.15.32:0/3034229989 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c900676e0 0x7f3c90069ba0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7f3caf200640 1 --2- 172.21.15.32:0/3034229989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80541e0 0x7f3ca8049b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7f3caf200640 1 --2- 172.21.15.32:0/3034229989 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80e3d00 0x7f3ca8053ca0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7f3caf200640 1 --2- 172.21.15.32:0/3034229989 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c94004c10 0x7f3ca8036e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7f3caf200640 1 -- 172.21.15.32:0/3034229989 >> 172.21.15.32:0/3034229989 conn(0x7f3ca800a410 msgr2=0x7f3ca80e5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:16.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7f0769600640 1 -- 172.21.15.32:0/1503660652 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0764027400 con 0x7f076c15bb20 2024-03-19T06:21:16.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7fc7d4e00640 1 -- 172.21.15.32:0/3513507593 shutdown_connections 2024-03-19T06:21:16.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7f3caf200640 1 -- 172.21.15.32:0/3034229989 shutdown_connections 2024-03-19T06:21:16.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7fc7d4e00640 1 --2- 172.21.15.32:0/3513507593 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc7ac0676e0 0x7fc7ac069ba0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7fc7d4e00640 1 --2- 172.21.15.32:0/3513507593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d0153390 0x7fc7d0153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.096 INFO:teuthology.orchestra.run.smithi032.stdout:60129542151 2024-03-19T06:21:16.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7fc7d4e00640 1 --2- 172.21.15.32:0/3513507593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7d0156b00 0x7fc7d013de00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7fc7d4e00640 1 --2- 172.21.15.32:0/3513507593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7b4008c20 0x7fc7d0155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7fc7d4e00640 1 -- 172.21.15.32:0/3513507593 >> 172.21.15.32:0/3513507593 conn(0x7fc7d0066ed0 msgr2=0x7fc7d00cb620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:16.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7f3caf200640 1 -- 172.21.15.32:0/3034229989 wait complete. 2024-03-19T06:21:16.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7fc7d4e00640 1 -- 172.21.15.32:0/3513507593 shutdown_connections 2024-03-19T06:21:16.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.100+0000 7fc7d4e00640 1 -- 172.21.15.32:0/3513507593 wait complete. 2024-03-19T06:21:16.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.104+0000 7f075ea00640 1 -- 172.21.15.32:0/1503660652 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f074c067730 msgr2=0x7f074c069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:16.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.104+0000 7f075ea00640 1 --2- 172.21.15.32:0/1503660652 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f074c067730 0x7f074c069bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0758001810 tx=0x7f0758009040 comp rx=0 tx=0).stop 2024-03-19T06:21:16.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.104+0000 7f075ea00640 1 -- 172.21.15.32:0/1503660652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f076c15bb20 msgr2=0x7f076c1f5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:16.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.104+0000 7f075ea00640 1 --2- 172.21.15.32:0/1503660652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f076c15bb20 0x7f076c1f5d30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f07640bd000 tx=0x7f076402a5b0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.104+0000 7f075ea00640 1 -- 172.21.15.32:0/1503660652 shutdown_connections 2024-03-19T06:21:16.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.104+0000 7f075ea00640 1 --2- 172.21.15.32:0/1503660652 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f074c067730 0x7f074c069bf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.104+0000 7f075ea00640 1 --2- 172.21.15.32:0/1503660652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f076c15bb20 0x7f076c1f5d30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.104+0000 7f075ea00640 1 --2- 172.21.15.32:0/1503660652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f076c0cd390 0x7f076c15caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.104+0000 7f075ea00640 1 --2- 172.21.15.32:0/1503660652 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f076c09a480 0x7f076c152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.104+0000 7f075ea00640 1 -- 172.21.15.32:0/1503660652 >> 172.21.15.32:0/1503660652 conn(0x7f076c0d1890 msgr2=0x7f076c15ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:16.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.104+0000 7f075ea00640 1 -- 172.21.15.32:0/1503660652 shutdown_connections 2024-03-19T06:21:16.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.104+0000 7f075ea00640 1 -- 172.21.15.32:0/1503660652 wait complete. 2024-03-19T06:21:16.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.116+0000 7fc554600640 1 -- 172.21.15.32:0/278561424 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc528005590 con 0x7fc54c154aa0 2024-03-19T06:21:16.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.116+0000 7fc549600640 1 -- 172.21.15.32:0/278561424 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc538055610 con 0x7fc54c154aa0 2024-03-19T06:21:16.110 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2024-03-19T06:21:16.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.124+0000 7fc554600640 1 -- 172.21.15.32:0/278561424 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc52c0676b0 msgr2=0x7fc52c069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:16.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.124+0000 7fc554600640 1 --2- 172.21.15.32:0/278561424 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc52c0676b0 0x7fc52c069b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc540009bc0 tx=0x7fc540008040 comp rx=0 tx=0).stop 2024-03-19T06:21:16.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.124+0000 7fc554600640 1 -- 172.21.15.32:0/278561424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc54c154aa0 msgr2=0x7fc54c0b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:16.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.124+0000 7fc554600640 1 --2- 172.21.15.32:0/278561424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc54c154aa0 0x7fc54c0b00e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc53800c390 tx=0x7fc53800c850 comp rx=0 tx=0).stop 2024-03-19T06:21:16.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.128+0000 7fc554600640 1 -- 172.21.15.32:0/278561424 shutdown_connections 2024-03-19T06:21:16.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.128+0000 7fc554600640 1 --2- 172.21.15.32:0/278561424 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc52c0676b0 0x7fc52c069b70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.128+0000 7fc554600640 1 --2- 172.21.15.32:0/278561424 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc54c15ed80 0x7fc54c0b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.128+0000 7fc554600640 1 --2- 172.21.15.32:0/278561424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc54c154aa0 0x7fc54c0b00e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.128+0000 7fc554600640 1 --2- 172.21.15.32:0/278561424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc54c06f270 0x7fc54c169170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.128+0000 7fc554600640 1 -- 172.21.15.32:0/278561424 >> 172.21.15.32:0/278561424 conn(0x7fc54c0cf5b0 msgr2=0x7fc54c06e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:16.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.128+0000 7fc554600640 1 -- 172.21.15.32:0/278561424 shutdown_connections 2024-03-19T06:21:16.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.128+0000 7fc554600640 1 -- 172.21.15.32:0/278561424 wait complete. 2024-03-19T06:21:16.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.132+0000 7f4ce2a00640 1 -- 172.21.15.32:0/3109881491 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4cdc0723f0 con 0x7f4cdc0ca5c0 2024-03-19T06:21:16.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.132+0000 7f4cd3e00640 1 -- 172.21.15.32:0/3109881491 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ccc0effd0 con 0x7f4cdc0ca5c0 2024-03-19T06:21:16.127 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2024-03-19T06:21:16.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.0 2024-03-19T06:21:16.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.136+0000 7f4ce2a00640 1 -- 172.21.15.32:0/3109881491 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4cbc0676b0 msgr2=0x7f4cbc069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:16.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.136+0000 7f4ce2a00640 1 --2- 172.21.15.32:0/3109881491 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4cbc0676b0 0x7f4cbc069b70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8000f70 tx=0x7f4cc8009040 comp rx=0 tx=0).stop 2024-03-19T06:21:16.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.136+0000 7f4ce2a00640 1 -- 172.21.15.32:0/3109881491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cdc0ca5c0 msgr2=0x7f4cdc1502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:16.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.136+0000 7f4ce2a00640 1 --2- 172.21.15.32:0/3109881491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cdc0ca5c0 0x7f4cdc1502f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc06c000 tx=0x7f4ccc0191b0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.136+0000 7f4ce2a00640 1 -- 172.21.15.32:0/3109881491 shutdown_connections 2024-03-19T06:21:16.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.136+0000 7f4ce2a00640 1 --2- 172.21.15.32:0/3109881491 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4cbc0676b0 0x7f4cbc069b70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.136+0000 7f4ce2a00640 1 --2- 172.21.15.32:0/3109881491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cdc153fe0 0x7f4cdc13bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.136+0000 7f4ce2a00640 1 --2- 172.21.15.32:0/3109881491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cdc0ca5c0 0x7f4cdc1502f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.136+0000 7f4ce2a00640 1 --2- 172.21.15.32:0/3109881491 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cdc071a60 0x7f4cdc0c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.136+0000 7f4ce2a00640 1 -- 172.21.15.32:0/3109881491 >> 172.21.15.32:0/3109881491 conn(0x7f4cdc0cf5b0 msgr2=0x7f4cdc0af1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:16.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.136+0000 7f4ce2a00640 1 -- 172.21.15.32:0/3109881491 shutdown_connections 2024-03-19T06:21:16.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.136+0000 7f4ce2a00640 1 -- 172.21.15.32:0/3109881491 wait complete. 2024-03-19T06:21:16.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.136+0000 7fa20e200640 1 -- 172.21.15.32:0/3160349430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa1e0005590 con 0x7fa2081578a0 2024-03-19T06:21:16.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.136+0000 7fa1ff400640 1 -- 172.21.15.32:0/3160349430 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa2000564e0 con 0x7fa2081578a0 2024-03-19T06:21:16.131 INFO:teuthology.orchestra.run.smithi032.stdout:60129542148 2024-03-19T06:21:16.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-03-19T06:21:16.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.140+0000 7fa20e200640 1 -- 172.21.15.32:0/3160349430 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa1e4067730 msgr2=0x7fa1e4069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:16.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.140+0000 7fa20e200640 1 --2- 172.21.15.32:0/3160349430 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa1e4067730 0x7fa1e4069bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa208151550 tx=0x7fa1f8008040 comp rx=0 tx=0).stop 2024-03-19T06:21:16.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.140+0000 7fa20e200640 1 -- 172.21.15.32:0/3160349430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2081578a0 msgr2=0x7fa20814caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:16.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.140+0000 7fa20e200640 1 --2- 172.21.15.32:0/3160349430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2081578a0 0x7fa20814caa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa20000caf0 tx=0x7fa20000a060 comp rx=0 tx=0).stop 2024-03-19T06:21:16.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.144+0000 7fa20e200640 1 -- 172.21.15.32:0/3160349430 shutdown_connections 2024-03-19T06:21:16.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.144+0000 7fa20e200640 1 --2- 172.21.15.32:0/3160349430 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa1e4067730 0x7fa1e4069bf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.144+0000 7fa20e200640 1 --2- 172.21.15.32:0/3160349430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa20815e6f0 0x7fa208156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.144+0000 7fa20e200640 1 --2- 172.21.15.32:0/3160349430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa208157c80 0x7fa2080b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.144+0000 7fa20e200640 1 --2- 172.21.15.32:0/3160349430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2081578a0 0x7fa20814caa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.144+0000 7fa20e200640 1 -- 172.21.15.32:0/3160349430 >> 172.21.15.32:0/3160349430 conn(0x7fa2080cfec0 msgr2=0x7fa20815d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:16.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.144+0000 7fa20e200640 1 -- 172.21.15.32:0/3160349430 shutdown_connections 2024-03-19T06:21:16.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.144+0000 7fa20e200640 1 -- 172.21.15.32:0/3160349430 wait complete. 2024-03-19T06:21:16.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.144+0000 7f0974a00640 1 -- 172.21.15.32:0/473649333 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f09700749e0 con 0x7f0970089b30 2024-03-19T06:21:16.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.4 2024-03-19T06:21:16.138 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2024-03-19T06:21:16.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.144+0000 7f0966000640 1 -- 172.21.15.32:0/473649333 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0960015ff0 con 0x7f0970089b30 2024-03-19T06:21:16.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.148+0000 7f0974a00640 1 -- 172.21.15.32:0/473649333 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0950067630 msgr2=0x7f0950069af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:16.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.148+0000 7f0974a00640 1 --2- 172.21.15.32:0/473649333 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0950067630 0x7f0950069af0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f095c000c10 tx=0x7f095c009040 comp rx=0 tx=0).stop 2024-03-19T06:21:16.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.148+0000 7f0974a00640 1 -- 172.21.15.32:0/473649333 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0970089b30 msgr2=0x7f097007e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:16.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.148+0000 7f0974a00640 1 --2- 172.21.15.32:0/473649333 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0970089b30 0x7f097007e0b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f096001c110 tx=0x7f0954005840 comp rx=0 tx=0).stop 2024-03-19T06:21:16.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.148+0000 7f0974a00640 1 -- 172.21.15.32:0/473649333 shutdown_connections 2024-03-19T06:21:16.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.148+0000 7f0974a00640 1 --2- 172.21.15.32:0/473649333 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0950067630 0x7f0950069af0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.148+0000 7f0974a00640 1 --2- 172.21.15.32:0/473649333 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09700c88e0 0x7f09700c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.148+0000 7f0974a00640 1 --2- 172.21.15.32:0/473649333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0970089f10 0x7f097014ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.148+0000 7f0974a00640 1 --2- 172.21.15.32:0/473649333 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0970089b30 0x7f097007e0b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.148+0000 7f0974a00640 1 -- 172.21.15.32:0/473649333 >> 172.21.15.32:0/473649333 conn(0x7f09700d0620 msgr2=0x7f09700b5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:16.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.148+0000 7f0974a00640 1 -- 172.21.15.32:0/473649333 shutdown_connections 2024-03-19T06:21:16.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.148+0000 7f0974a00640 1 -- 172.21.15.32:0/473649333 wait complete. 2024-03-19T06:21:16.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.148+0000 7f3bdc800640 1 -- 172.21.15.32:0/3719632992 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3bb0005860 con 0x7f3bd415bb20 2024-03-19T06:21:16.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.148+0000 7f3bce000640 1 -- 172.21.15.32:0/3719632992 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3bd0016460 con 0x7f3bd415bb20 2024-03-19T06:21:16.141 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2024-03-19T06:21:16.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.152+0000 7f3bdc800640 1 -- 172.21.15.32:0/3719632992 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3bb4067730 msgr2=0x7f3bb4069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:16.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.152+0000 7f3bdc800640 1 --2- 172.21.15.32:0/3719632992 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3bb4067730 0x7f3bb4069bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009580 tx=0x7f3bc8009190 comp rx=0 tx=0).stop 2024-03-19T06:21:16.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.152+0000 7f3bdc800640 1 -- 172.21.15.32:0/3719632992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bd415bb20 msgr2=0x7f3bd4070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:16.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.152+0000 7f3bdc800640 1 --2- 172.21.15.32:0/3719632992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bd415bb20 0x7f3bd4070280 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00ac000 tx=0x7f3bd0019610 comp rx=0 tx=0).stop 2024-03-19T06:21:16.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.152+0000 7f3bdc800640 1 -- 172.21.15.32:0/3719632992 shutdown_connections 2024-03-19T06:21:16.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.152+0000 7f3bdc800640 1 --2- 172.21.15.32:0/3719632992 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3bb4067730 0x7f3bb4069bf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.152+0000 7f3bdc800640 1 --2- 172.21.15.32:0/3719632992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bd415bb20 0x7f3bd4070280 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.152+0000 7f3bdc800640 1 --2- 172.21.15.32:0/3719632992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bd40cf460 0x7f3bd4149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.152+0000 7f3bdc800640 1 --2- 172.21.15.32:0/3719632992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bd40cd390 0x7f3bd4154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:16.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.152+0000 7f3bdc800640 1 -- 172.21.15.32:0/3719632992 >> 172.21.15.32:0/3719632992 conn(0x7f3bd40d1890 msgr2=0x7f3bd40c6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:16.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.152+0000 7f3bdc800640 1 -- 172.21.15.32:0/3719632992 shutdown_connections 2024-03-19T06:21:16.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:16.152+0000 7f3bdc800640 1 -- 172.21.15.32:0/3719632992 wait complete. 2024-03-19T06:21:16.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2024-03-19T06:21:16.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.3 2024-03-19T06:21:16.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2024-03-19T06:21:16.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-03-19T06:21:16.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2024-03-19T06:21:17.129 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-19T06:21:17.132 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-19T06:21:17.138 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-19T06:21:17.149 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-19T06:21:17.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-19T06:21:17.166 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-19T06:21:17.171 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-19T06:21:17.173 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-19T06:21:17.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.356+0000 7f3e75800640 1 Processor -- start 2024-03-19T06:21:17.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.356+0000 7f3e75800640 1 -- start start 2024-03-19T06:21:17.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.356+0000 7f052e800640 1 Processor -- start 2024-03-19T06:21:17.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.356+0000 7f052e800640 1 -- start start 2024-03-19T06:21:17.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f052e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f052004f3e0 0x7f0520053420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f3e75800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e6804f3e0 0x7f3e68053420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f3e75800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3e6804f7c0 0x7f3e6804fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f3e75800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3e68104850 0x7f3e68104ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f3e75800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e68005ea0 con 0x7f3e68104850 2024-03-19T06:21:17.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f3e75800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e68006180 con 0x7f3e6804f7c0 2024-03-19T06:21:17.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f3e75800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e68101180 con 0x7f3e6804f3e0 2024-03-19T06:21:17.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f052e800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f052004f7c0 0x7f052004fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f052e800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0520101180 con 0x7f0520104850 2024-03-19T06:21:17.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f052e800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0520005ea0 con 0x7f052004f3e0 2024-03-19T06:21:17.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f052e800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0520006180 con 0x7f052004f7c0 2024-03-19T06:21:17.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f052de00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0520104850 0x7f0520104ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47670/0 (socket says 172.21.15.32:47670) 2024-03-19T06:21:17.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f052de00640 1 -- 172.21.15.32:0/3774370052 learned_addr learned my addr 172.21.15.32:0/3774370052 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:17.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f3e74e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3e68104850 0x7f3e68104ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f052d400640 1 --2- 172.21.15.32:0/3774370052 >> v2:172.21.15.32:3300/0 conn(0x7f052004f3e0 0x7f0520053420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f3e74e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3e68104850 0x7f3e68104ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45512/0 (socket says 172.21.15.32:45512) 2024-03-19T06:21:17.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f3e74e00640 1 -- 172.21.15.32:0/2705355946 learned_addr learned my addr 172.21.15.32:0/2705355946 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:17.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f0527e00640 1 -- 172.21.15.32:0/3774370052 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623869643 0 0) 0x7f0520101180 con 0x7f0520104850 2024-03-19T06:21:17.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.360+0000 7f0527e00640 1 -- 172.21.15.32:0/3774370052 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0510003530 con 0x7f0520104850 2024-03-19T06:21:17.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f0527e00640 1 -- 172.21.15.32:0/3774370052 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1696028579 0 0) 0x7f0510003530 con 0x7f0520104850 2024-03-19T06:21:17.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f0527e00640 1 -- 172.21.15.32:0/3774370052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f052004f7c0 msgr2=0x7f052004fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:17.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f0527e00640 1 --2- 172.21.15.32:0/3774370052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f052004f7c0 0x7f052004fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f0527e00640 1 -- 172.21.15.32:0/3774370052 >> v2:172.21.15.32:3300/0 conn(0x7f052004f3e0 msgr2=0x7f0520053420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:17.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f0527e00640 1 --2- 172.21.15.32:0/3774370052 >> v2:172.21.15.32:3300/0 conn(0x7f052004f3e0 0x7f0520053420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f0527e00640 1 -- 172.21.15.32:0/3774370052 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0520053960 con 0x7f0520104850 2024-03-19T06:21:17.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f3e6f400640 1 --2- 172.21.15.32:0/2705355946 >> v2:172.21.15.171:3300/0 conn(0x7f3e6804f7c0 0x7f3e6804fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f3e6fe00640 1 --2- 172.21.15.32:0/2705355946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e6804f3e0 0x7f3e68053420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f0527e00640 1 -- 172.21.15.32:0/3774370052 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f052804f8b0 con 0x7f0520104850 2024-03-19T06:21:17.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f0527e00640 1 -- 172.21.15.32:0/3774370052 >> v1:172.21.15.32:6789/0 conn(0x7f0520104850 legacy=0x7f0520104ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f0527e00640 1 --2- 172.21.15.32:0/3774370052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f052004f7c0 0x7f0510003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f0527e00640 1 --2- 172.21.15.32:0/3774370052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0510003fa0 0x7f0510004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f0527e00640 1 --2- 172.21.15.32:0/3774370052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0510004d50 0x7f05100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f0527e00640 1 -- 172.21.15.32:0/3774370052 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0520005ea0 con 0x7f0510003fa0 2024-03-19T06:21:17.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f0527e00640 1 -- 172.21.15.32:0/3774370052 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0520006180 con 0x7f0510004d50 2024-03-19T06:21:17.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f0527e00640 1 -- 172.21.15.32:0/3774370052 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051000bb60 con 0x7f052004f7c0 2024-03-19T06:21:17.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f3e74e00640 1 -- 172.21.15.32:0/2705355946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e6804f3e0 msgr2=0x7f3e68053420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:17.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f3e74e00640 1 --2- 172.21.15.32:0/2705355946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e6804f3e0 0x7f3e68053420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f3e74e00640 1 -- 172.21.15.32:0/2705355946 >> v2:172.21.15.171:3300/0 conn(0x7f3e6804f7c0 msgr2=0x7f3e6804fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:17.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f3e74e00640 1 --2- 172.21.15.32:0/2705355946 >> v2:172.21.15.171:3300/0 conn(0x7f3e6804f7c0 0x7f3e6804fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f3e74e00640 1 -- 172.21.15.32:0/2705355946 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e68053960 con 0x7f3e68104850 2024-03-19T06:21:17.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f052d400640 1 --2- 172.21.15.32:0/3774370052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f052004f7c0 0x7f0510003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f3e6fe00640 1 --2- 172.21.15.32:0/2705355946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e6804f3e0 0x7f3e68053420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:17.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f052de00640 1 --2- 172.21.15.32:0/3774370052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0510004d50 0x7f05100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f052ca00640 1 --2- 172.21.15.32:0/3774370052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0510003fa0 0x7f0510004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f052ca00640 1 -- 172.21.15.32:0/3774370052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f052004f7c0 msgr2=0x7f0510003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:17.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f052ca00640 1 --2- 172.21.15.32:0/3774370052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f052004f7c0 0x7f0510003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f052ca00640 1 -- 172.21.15.32:0/3774370052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0510004d50 msgr2=0x7f05100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:17.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f052ca00640 1 --2- 172.21.15.32:0/3774370052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0510004d50 0x7f05100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.364+0000 7f052ca00640 1 -- 172.21.15.32:0/3774370052 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051000be20 con 0x7f0510003fa0 2024-03-19T06:21:17.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.368+0000 7f3e74e00640 1 --2- 172.21.15.32:0/2705355946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e68104850 0x7f3e68104ce0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3e70068c70 tx=0x7f3e70086450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2427136bf23c899a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.368+0000 7f3e6ea00640 1 -- 172.21.15.32:0/2705355946 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7011a070 con 0x7f3e68104850 2024-03-19T06:21:17.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.368+0000 7f3e6ea00640 1 -- 172.21.15.32:0/2705355946 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e70115600 con 0x7f3e68104850 2024-03-19T06:21:17.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.368+0000 7f3e6ea00640 1 -- 172.21.15.32:0/2705355946 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70115a70 con 0x7f3e68104850 2024-03-19T06:21:17.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f052ca00640 1 --2- 172.21.15.32:0/3774370052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0510003fa0 0x7f0510004810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f051c009890 tx=0x7f051c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a788403b2a45d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f3e75800640 1 -- 172.21.15.32:0/2705355946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e68104850 msgr2=0x7f3e68104ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f3e75800640 1 --2- 172.21.15.32:0/2705355946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e68104850 0x7f3e68104ce0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3e70068c70 tx=0x7f3e70086450 comp rx=0 tx=0).stop 2024-03-19T06:21:17.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f0527e00640 1 -- 172.21.15.32:0/3774370052 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c0b0070 con 0x7f0510003fa0 2024-03-19T06:21:17.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f3e75800640 1 -- 172.21.15.32:0/2705355946 shutdown_connections 2024-03-19T06:21:17.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f3e75800640 1 --2- 172.21.15.32:0/2705355946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e68104850 0x7f3e68104ce0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f3e75800640 1 --2- 172.21.15.32:0/2705355946 >> v2:172.21.15.171:3300/0 conn(0x7f3e6804f7c0 0x7f3e6804fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f3e75800640 1 --2- 172.21.15.32:0/2705355946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e6804f3e0 0x7f3e68053420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f3e75800640 1 -- 172.21.15.32:0/2705355946 >> 172.21.15.32:0/2705355946 conn(0x7f3e68009fc0 msgr2=0x7f3e6800a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:17.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f3e75800640 1 -- 172.21.15.32:0/2705355946 shutdown_connections 2024-03-19T06:21:17.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f0527e00640 1 -- 172.21.15.32:0/3774370052 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051c0ab600 con 0x7f0510003fa0 2024-03-19T06:21:17.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f0527e00640 1 -- 172.21.15.32:0/3774370052 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c009460 con 0x7f0510003fa0 2024-03-19T06:21:17.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f052e800640 1 -- 172.21.15.32:0/3774370052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0510003fa0 msgr2=0x7f0510004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f052e800640 1 --2- 172.21.15.32:0/3774370052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0510003fa0 0x7f0510004810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f051c009890 tx=0x7f051c01c470 comp rx=0 tx=0).stop 2024-03-19T06:21:17.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f052de00640 1 -- 172.21.15.32:0/3774370052 reap_dead start 2024-03-19T06:21:17.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f052e800640 1 -- 172.21.15.32:0/3774370052 shutdown_connections 2024-03-19T06:21:17.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f052e800640 1 -- 172.21.15.32:0/3774370052 >> 172.21.15.32:0/3774370052 conn(0x7f0520009fc0 msgr2=0x7f052000a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:17.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f052e800640 1 -- 172.21.15.32:0/3774370052 shutdown_connections 2024-03-19T06:21:17.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f052e800640 1 -- 172.21.15.32:0/3774370052 wait complete. 2024-03-19T06:21:17.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.372+0000 7f3e75800640 1 -- 172.21.15.32:0/2705355946 wait complete. 2024-03-19T06:21:17.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.376+0000 7f3e75800640 1 Processor -- start 2024-03-19T06:21:17.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.376+0000 7f3e75800640 1 -- start start 2024-03-19T06:21:17.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.376+0000 7f3e75800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e6804f3e0 0x7f3e68103d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.376+0000 7f3e75800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e6804f7c0 0x7f3e680f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.376+0000 7f3e75800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e68104850 0x7f3e6804bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.376+0000 7f052e800640 1 Processor -- start 2024-03-19T06:21:17.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.376+0000 7f3e6f400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e6804f7c0 0x7f3e680f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.376+0000 7f3e6f400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e6804f7c0 0x7f3e680f2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57346/0 (socket says 172.21.15.32:57346) 2024-03-19T06:21:17.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.376+0000 7f052e800640 1 -- start start 2024-03-19T06:21:17.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.376+0000 7f3e74e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e68104850 0x7f3e6804bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.376+0000 7f3e74e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e68104850 0x7f3e6804bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45536/0 (socket says 172.21.15.32:45536) 2024-03-19T06:21:17.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.376+0000 7f3e6f400640 1 -- 172.21.15.32:0/348568914 learned_addr learned my addr 172.21.15.32:0/348568914 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:17.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.376+0000 7f3e75800640 1 -- 172.21.15.32:0/348568914 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e68050160 con 0x7f3e68104850 2024-03-19T06:21:17.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.376+0000 7f3e75800640 1 -- 172.21.15.32:0/348568914 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e68037b30 con 0x7f3e6804f7c0 2024-03-19T06:21:17.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f3e75800640 1 -- 172.21.15.32:0/348568914 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6810c390 con 0x7f3e6804f3e0 2024-03-19T06:21:17.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f052e800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0510003fa0 0x7f052018b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f052e800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05201036f0 0x7f0520103b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f3e6fe00640 1 --2- 172.21.15.32:0/348568914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e6804f3e0 0x7f3e68103d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f052d400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0510003fa0 0x7f052018b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f052e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05201a72b0 0x7f05201a7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f052d400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0510003fa0 0x7f052018b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57350/0 (socket says 172.21.15.32:57350) 2024-03-19T06:21:17.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f052d400640 1 -- 172.21.15.32:0/386336055 learned_addr learned my addr 172.21.15.32:0/386336055 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:17.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f3e6fe00640 1 -- 172.21.15.32:0/348568914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e6804f7c0 msgr2=0x7f3e680f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f3e6fe00640 1 --2- 172.21.15.32:0/348568914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e6804f7c0 0x7f3e680f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f3e6fe00640 1 -- 172.21.15.32:0/348568914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e68104850 msgr2=0x7f3e6804bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f3e6fe00640 1 --2- 172.21.15.32:0/348568914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e68104850 0x7f3e6804bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f3e6fe00640 1 -- 172.21.15.32:0/348568914 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e680ec020 con 0x7f3e6804f3e0 2024-03-19T06:21:17.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f3e74e00640 1 --2- 172.21.15.32:0/348568914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e68104850 0x7f3e6804bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:17.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f3e6f400640 1 --2- 172.21.15.32:0/348568914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e6804f7c0 0x7f3e680f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:17.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f3e6fe00640 1 --2- 172.21.15.32:0/348568914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e6804f3e0 0x7f3e68103d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00aee0 tx=0x7f3e5c007410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f3e63e00640 1 -- 172.21.15.32:0/348568914 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c004020 con 0x7f3e6804f3e0 2024-03-19T06:21:17.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f3e63e00640 1 -- 172.21.15.32:0/348568914 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c0041c0 con 0x7f3e6804f3e0 2024-03-19T06:21:17.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f3e63e00640 1 -- 172.21.15.32:0/348568914 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c013950 con 0x7f3e6804f3e0 2024-03-19T06:21:17.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f052de00640 1 --2- 172.21.15.32:0/386336055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05201a72b0 0x7f05201a7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f052e800640 1 -- 172.21.15.32:0/386336055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0520037b30 con 0x7f05201a72b0 2024-03-19T06:21:17.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f052e800640 1 -- 172.21.15.32:0/386336055 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052003a8a0 con 0x7f0510003fa0 2024-03-19T06:21:17.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f3e75800640 1 -- 172.21.15.32:0/348568914 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e680ec300 con 0x7f3e6804f3e0 2024-03-19T06:21:17.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f3e75800640 1 -- 172.21.15.32:0/348568914 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e68103850 con 0x7f3e6804f3e0 2024-03-19T06:21:17.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f052e800640 1 -- 172.21.15.32:0/386336055 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0520007620 con 0x7f05201036f0 2024-03-19T06:21:17.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f052d400640 1 -- 172.21.15.32:0/386336055 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05201036f0 msgr2=0x7f0520103b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-19T06:21:17.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f052d400640 1 --2- 172.21.15.32:0/386336055 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05201036f0 0x7f0520103b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f052d400640 1 -- 172.21.15.32:0/386336055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05201a72b0 msgr2=0x7f05201a7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f052d400640 1 --2- 172.21.15.32:0/386336055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05201a72b0 0x7f05201a7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.380+0000 7f052d400640 1 -- 172.21.15.32:0/386336055 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05201a8000 con 0x7f0510003fa0 2024-03-19T06:21:17.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.384+0000 7f052d400640 1 --2- 172.21.15.32:0/386336055 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0510003fa0 0x7f052018b8d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0514011a30 tx=0x7f0514011ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.384+0000 7f0525600640 1 -- 172.21.15.32:0/386336055 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051400b040 con 0x7f0510003fa0 2024-03-19T06:21:17.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.384+0000 7f0525600640 1 -- 172.21.15.32:0/386336055 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051400fdf0 con 0x7f0510003fa0 2024-03-19T06:21:17.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.384+0000 7f0525600640 1 -- 172.21.15.32:0/386336055 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051401c6a0 con 0x7f0510003fa0 2024-03-19T06:21:17.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.384+0000 7f052e800640 1 -- 172.21.15.32:0/386336055 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05201a82e0 con 0x7f0510003fa0 2024-03-19T06:21:17.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.384+0000 7f052e800640 1 -- 172.21.15.32:0/386336055 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05201a88a0 con 0x7f0510003fa0 2024-03-19T06:21:17.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.388+0000 7f0525600640 1 -- 172.21.15.32:0/386336055 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f051401c840 con 0x7f0510003fa0 2024-03-19T06:21:17.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.384+0000 7f3e63e00640 1 -- 172.21.15.32:0/348568914 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3e5c013af0 con 0x7f3e6804f3e0 2024-03-19T06:21:17.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.388+0000 7f3e75800640 1 -- 172.21.15.32:0/348568914 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c0052a0 con 0x7f3e6804f3e0 2024-03-19T06:21:17.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.388+0000 7f3e63e00640 1 --2- 172.21.15.32:0/348568914 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3e50067690 0x7f3e50069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.388+0000 7f3e63e00640 1 -- 172.21.15.32:0/348568914 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e5c08d710 con 0x7f3e6804f3e0 2024-03-19T06:21:17.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.388+0000 7f3e6f400640 1 --2- 172.21.15.32:0/348568914 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3e50067690 0x7f3e50069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.388+0000 7f0525600640 1 --2- 172.21.15.32:0/386336055 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0508067660 0x7f0508069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.388+0000 7f0525600640 1 -- 172.21.15.32:0/386336055 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05140866f0 con 0x7f0510003fa0 2024-03-19T06:21:17.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.388+0000 7f3e6f400640 1 --2- 172.21.15.32:0/348568914 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3e50067690 0x7f3e50069b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3e680f3890 tx=0x7f3e64008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.388+0000 7f052ca00640 1 --2- 172.21.15.32:0/386336055 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0508067660 0x7f0508069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.388+0000 7f052e800640 1 -- 172.21.15.32:0/386336055 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05200053a0 con 0x7f0510003fa0 2024-03-19T06:21:17.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.392+0000 7f052ca00640 1 --2- 172.21.15.32:0/386336055 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0508067660 0x7f0508069b20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f051c0ad000 tx=0x7f051c004850 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.396+0000 7f3e63e00640 1 -- 172.21.15.32:0/348568914 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f3e5c05dd40 con 0x7f3e6804f3e0 2024-03-19T06:21:17.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.400+0000 7f0525600640 1 -- 172.21.15.32:0/386336055 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f0514057360 con 0x7f0510003fa0 2024-03-19T06:21:17.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.440+0000 7f00a5600640 1 Processor -- start 2024-03-19T06:21:17.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.440+0000 7f00a5600640 1 -- start start 2024-03-19T06:21:17.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.444+0000 7f00a5600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0098039b90 0x7f009803c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.444+0000 7f00a5600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00980e3b50 con 0x7f0098056210 2024-03-19T06:21:17.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.444+0000 7f00a5600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f009803b730 con 0x7f0098052ff0 2024-03-19T06:21:17.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.444+0000 7f00a5600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f009803ba10 con 0x7f0098039b90 2024-03-19T06:21:17.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.444+0000 7f009fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0098056210 0x7f00980528e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47682/0 (socket says 172.21.15.32:47682) 2024-03-19T06:21:17.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.444+0000 7f00a4c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0098039b90 0x7f009803c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.444+0000 7f009fe00640 1 -- 172.21.15.32:0/2497886097 learned_addr learned my addr 172.21.15.32:0/2497886097 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:17.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.444+0000 7f00a4c00640 1 -- 172.21.15.32:0/2497886097 >> v1:172.21.15.171:6789/0 conn(0x7f0098052ff0 legacy=0x7f0098054880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-19T06:21:17.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.444+0000 7f00a4c00640 1 -- 172.21.15.32:0/2497886097 >> v1:172.21.15.32:6789/0 conn(0x7f0098056210 legacy=0x7f00980528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:17.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.444+0000 7f00a4c00640 1 -- 172.21.15.32:0/2497886097 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009803bcf0 con 0x7f0098039b90 2024-03-19T06:21:17.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.448+0000 7fd53c400640 1 Processor -- start 2024-03-19T06:21:17.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.448+0000 7fd53c400640 1 -- start start 2024-03-19T06:21:17.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.448+0000 7f4ee2000640 1 Processor -- start 2024-03-19T06:21:17.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f00a4c00640 1 --2- 172.21.15.32:0/2497886097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0098039b90 0x7f009803c7d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00a0000b70 tx=0x7f00a00973e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6acc9bf592f56b42 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f4ee2000640 1 -- start start 2024-03-19T06:21:17.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f009ea00640 1 -- 172.21.15.32:0/2497886097 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a012b070 con 0x7f0098039b90 2024-03-19T06:21:17.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f009ea00640 1 -- 172.21.15.32:0/2497886097 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a0126600 con 0x7f0098039b90 2024-03-19T06:21:17.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f009ea00640 1 -- 172.21.15.32:0/2497886097 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0126a70 con 0x7f0098039b90 2024-03-19T06:21:17.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7fd53c400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd53415a7c0 0x7fd5340cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7fd53c400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd5340b4c50 0x7fd5340b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7fd53c400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340cb670 con 0x7fd5340cc680 2024-03-19T06:21:17.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7fd53c400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53415f400 con 0x7fd53415a7c0 2024-03-19T06:21:17.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7fd53c400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53415e860 con 0x7fd5340b4c50 2024-03-19T06:21:17.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7fd539000640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fd5340cc680 0x7fd53415ecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:56926/0 (socket says 172.21.15.32:56926) 2024-03-19T06:21:17.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7fd539000640 1 -- 172.21.15.32:0/751252149 learned_addr learned my addr 172.21.15.32:0/751252149 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:17.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7fd53a400640 1 --2- 172.21.15.32:0/751252149 >> v2:172.21.15.171:3300/0 conn(0x7fd5340b4c50 0x7fd5340b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f4ee2000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4edc162050 0x7f4edc0c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f4ee2000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4edc06d590 0x7f4edc0cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f00a5600640 1 -- 172.21.15.32:0/2497886097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0098039b90 msgr2=0x7f009803c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f00a5600640 1 --2- 172.21.15.32:0/2497886097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0098039b90 0x7f009803c7d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00a0000b70 tx=0x7f00a00973e0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f00a5600640 1 -- 172.21.15.32:0/2497886097 shutdown_connections 2024-03-19T06:21:17.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f00a5600640 1 --2- 172.21.15.32:0/2497886097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0098039b90 0x7f009803c7d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f00a5600640 1 -- 172.21.15.32:0/2497886097 >> 172.21.15.32:0/2497886097 conn(0x7f00980537c0 msgr2=0x7f0098053bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:17.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f4ee2000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4edc0cdcf0 con 0x7f4edc06d9f0 2024-03-19T06:21:17.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f4edb400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4edc162050 0x7f4edc0c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f4ee2000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4edc165c40 con 0x7f4edc06d590 2024-03-19T06:21:17.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f4ee2000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc0cdfd0 con 0x7f4edc162050 2024-03-19T06:21:17.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f4edb400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4edc162050 0x7f4edc0c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:50354/0 (socket says 172.21.15.32:50354) 2024-03-19T06:21:17.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f4edb400640 1 -- 172.21.15.32:0/3190599696 learned_addr learned my addr 172.21.15.32:0/3190599696 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:17.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7fd533e00640 1 -- 172.21.15.32:0/751252149 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340008074 0 0) 0x7fd5340cb670 con 0x7fd5340cc680 2024-03-19T06:21:17.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7fd533e00640 1 -- 172.21.15.32:0/751252149 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd51c005740 con 0x7fd5340cc680 2024-03-19T06:21:17.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7fd53a400640 1 -- 172.21.15.32:0/751252149 >> v2:172.21.15.32:3300/0 conn(0x7fd53415a7c0 msgr2=0x7fd5340cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:17.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7fd53a400640 1 --2- 172.21.15.32:0/751252149 >> v2:172.21.15.32:3300/0 conn(0x7fd53415a7c0 0x7fd5340cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7fd53a400640 1 -- 172.21.15.32:0/751252149 >> v1:172.21.15.171:6789/0 conn(0x7fd5340cc680 legacy=0x7fd53415ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7fd53a400640 1 -- 172.21.15.32:0/751252149 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340cb950 con 0x7fd5340b4c50 2024-03-19T06:21:17.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f4ed3e00640 1 --2- 172.21.15.32:0/3190599696 >> v2:172.21.15.32:3300/0 conn(0x7f4edc06d590 0x7f4edc0cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f00a5600640 1 -- 172.21.15.32:0/2497886097 shutdown_connections 2024-03-19T06:21:17.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7f00a5600640 1 -- 172.21.15.32:0/2497886097 wait complete. 2024-03-19T06:21:17.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.456+0000 7f4edb400640 1 -- 172.21.15.32:0/3190599696 >> v2:172.21.15.32:3300/0 conn(0x7f4edc06d590 msgr2=0x7f4edc0cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:17.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.456+0000 7f4edb400640 1 --2- 172.21.15.32:0/3190599696 >> v2:172.21.15.32:3300/0 conn(0x7f4edc06d590 0x7f4edc0cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.456+0000 7f4edb400640 1 -- 172.21.15.32:0/3190599696 >> v1:172.21.15.32:6789/0 conn(0x7f4edc06d9f0 legacy=0x7f4edc1660d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:17.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.456+0000 7f4edb400640 1 -- 172.21.15.32:0/3190599696 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc0ce2b0 con 0x7f4edc162050 2024-03-19T06:21:17.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.452+0000 7fda6a600640 1 Processor -- start 2024-03-19T06:21:17.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.456+0000 7f00a5600640 1 Processor -- start 2024-03-19T06:21:17.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.456+0000 7f00a5600640 1 -- start start 2024-03-19T06:21:17.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.456+0000 7ff957e00640 1 Processor -- start 2024-03-19T06:21:17.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.456+0000 7ff957e00640 1 -- start start 2024-03-19T06:21:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.456+0000 7f4ed3e00640 1 --2- 172.21.15.32:0/3190599696 >> v2:172.21.15.32:3300/0 conn(0x7f4edc06d590 0x7f4edc0cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.456+0000 7fda6a600640 1 -- start start 2024-03-19T06:21:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.456+0000 7f00a5600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0098039b90 0x7f009800a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f00a5600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0098052ff0 0x7f009804a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7fd53a400640 1 --2- 172.21.15.32:0/751252149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5340b4c50 0x7fd5340b5080 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd5340c9b90 tx=0x7fd520020890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab9463ae87e9d921 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f009f400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0098052ff0 0x7f009804a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f009fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0098039b90 0x7f009800a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f009f400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0098052ff0 0x7f009804a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57366/0 (socket says 172.21.15.32:57366) 2024-03-19T06:21:17.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f00a5600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0098056210 0x7f009804ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f009f400640 1 -- 172.21.15.32:0/1854058042 learned_addr learned my addr 172.21.15.32:0/1854058042 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:17.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f009fe00640 1 --2- 172.21.15.32:0/1854058042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0098039b90 0x7f009800a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45582/0 (socket says 172.21.15.32:45582) 2024-03-19T06:21:17.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7ff957e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff9500e0fc0 0x7ff9500e5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7ff957e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff95003a5c0 0x7ff9500068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f00a5600640 1 -- 172.21.15.32:0/1854058042 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00980f1730 con 0x7f0098039b90 2024-03-19T06:21:17.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f00a5600640 1 -- 172.21.15.32:0/1854058042 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00980f15b0 con 0x7f0098052ff0 2024-03-19T06:21:17.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f00a5600640 1 -- 172.21.15.32:0/1854058042 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00980f18b0 con 0x7f0098056210 2024-03-19T06:21:17.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f00a4c00640 1 --2- 172.21.15.32:0/1854058042 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0098056210 0x7f009804ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7ff957e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff950006110 con 0x7ff950034120 2024-03-19T06:21:17.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7ff957e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff95004f500 con 0x7ff9500e0fc0 2024-03-19T06:21:17.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7ff957e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95004ecd0 con 0x7ff95003a5c0 2024-03-19T06:21:17.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7ff95de00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff95003a5c0 0x7ff9500068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7ff956000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff950034120 0x7ff950039eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47708/0 (socket says 172.21.15.32:47708) 2024-03-19T06:21:17.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7ff956000640 1 -- 172.21.15.32:0/296339710 learned_addr learned my addr 172.21.15.32:0/296339710 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:17.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f4edb400640 1 --2- 172.21.15.32:0/3190599696 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4edc162050 0x7f4edc0c9c00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009870 tx=0x7f4ecc01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91891135b56fbaca server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f009f400640 1 -- 172.21.15.32:0/1854058042 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0098056210 msgr2=0x7f009804ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f009f400640 1 --2- 172.21.15.32:0/1854058042 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0098056210 0x7f009804ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f009f400640 1 -- 172.21.15.32:0/1854058042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0098039b90 msgr2=0x7f009800a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f009f400640 1 --2- 172.21.15.32:0/1854058042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0098039b90 0x7f009800a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f009f400640 1 -- 172.21.15.32:0/1854058042 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0098038ba0 con 0x7f0098052ff0 2024-03-19T06:21:17.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7ff95de00640 1 -- 172.21.15.32:0/296339710 >> v2:172.21.15.32:3300/0 conn(0x7ff9500e0fc0 msgr2=0x7ff9500e5620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:21:17.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7ff95de00640 1 --2- 172.21.15.32:0/296339710 >> v2:172.21.15.32:3300/0 conn(0x7ff9500e0fc0 0x7ff9500e5620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7ff95de00640 1 -- 172.21.15.32:0/296339710 >> v1:172.21.15.32:6789/0 conn(0x7ff950034120 legacy=0x7ff950039eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:17.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7ff95de00640 1 -- 172.21.15.32:0/296339710 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9500063b0 con 0x7ff95003a5c0 2024-03-19T06:21:17.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f009f400640 1 --2- 172.21.15.32:0/1854058042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0098052ff0 0x7f009804a7e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f008c00b500 tx=0x7f008c00b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7fd533e00640 1 -- 172.21.15.32:0/751252149 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5200aa710 con 0x7fd5340b4c50 2024-03-19T06:21:17.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7fd533e00640 1 -- 172.21.15.32:0/751252149 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5200aa8b0 con 0x7fd5340b4c50 2024-03-19T06:21:17.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7fd533e00640 1 -- 172.21.15.32:0/751252149 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5200aac80 con 0x7fd5340b4c50 2024-03-19T06:21:17.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f4edaa00640 1 -- 172.21.15.32:0/3190599696 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc0ab5f0 con 0x7f4edc162050 2024-03-19T06:21:17.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f4edaa00640 1 -- 172.21.15.32:0/3190599696 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc0b0070 con 0x7f4edc162050 2024-03-19T06:21:17.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f4edaa00640 1 -- 172.21.15.32:0/3190599696 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc0ab9b0 con 0x7f4edc162050 2024-03-19T06:21:17.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7fda69200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fda6415da70 0x7fda640cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47710/0 (socket says 172.21.15.32:47710) 2024-03-19T06:21:17.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f0093e00640 1 -- 172.21.15.32:0/1854058042 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c014070 con 0x7f0098052ff0 2024-03-19T06:21:17.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7fda69200640 1 -- 172.21.15.32:0/1426232638 learned_addr learned my addr 172.21.15.32:0/1426232638 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:17.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f00a5600640 1 -- 172.21.15.32:0/1854058042 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009804b430 con 0x7f0098052ff0 2024-03-19T06:21:17.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f00a5600640 1 -- 172.21.15.32:0/1854058042 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00980db270 con 0x7f0098052ff0 2024-03-19T06:21:17.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f0093e00640 1 -- 172.21.15.32:0/1854058042 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c010890 con 0x7f0098052ff0 2024-03-19T06:21:17.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f0093e00640 1 -- 172.21.15.32:0/1854058042 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c010c80 con 0x7f0098052ff0 2024-03-19T06:21:17.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7fd53c400640 1 -- 172.21.15.32:0/751252149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5340b4c50 msgr2=0x7fd5340b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7fd53c400640 1 --2- 172.21.15.32:0/751252149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5340b4c50 0x7fd5340b5080 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd5340c9b90 tx=0x7fd520020890 comp rx=0 tx=0).stop 2024-03-19T06:21:17.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7fd53c400640 1 -- 172.21.15.32:0/751252149 shutdown_connections 2024-03-19T06:21:17.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7fd53c400640 1 --2- 172.21.15.32:0/751252149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5340b4c50 0x7fd5340b5080 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7fd53c400640 1 --2- 172.21.15.32:0/751252149 >> v2:172.21.15.32:3300/0 conn(0x7fd53415a7c0 0x7fd5340cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7fd53c400640 1 -- 172.21.15.32:0/751252149 >> 172.21.15.32:0/751252149 conn(0x7fd5340b1280 msgr2=0x7fd5340b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:17.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7fda6a600640 1 --2- 172.21.15.32:0/1426232638 >> v2:172.21.15.32:3300/0 conn(0x7fda640d18f0 0x7fda640d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f4ee2000640 1 -- 172.21.15.32:0/3190599696 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4edc162050 msgr2=0x7f4edc0c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.460+0000 7f4ee2000640 1 --2- 172.21.15.32:0/3190599696 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4edc162050 0x7f4edc0c9c00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009870 tx=0x7f4ecc01c540 comp rx=0 tx=0).stop 2024-03-19T06:21:17.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fd53c400640 1 -- 172.21.15.32:0/751252149 shutdown_connections 2024-03-19T06:21:17.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7f4ee2000640 1 -- 172.21.15.32:0/3190599696 shutdown_connections 2024-03-19T06:21:17.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7f4ee2000640 1 --2- 172.21.15.32:0/3190599696 >> v2:172.21.15.32:3300/0 conn(0x7f4edc06d590 0x7f4edc0cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7f4ee2000640 1 --2- 172.21.15.32:0/3190599696 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4edc162050 0x7f4edc0c9c00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7f4ee2000640 1 -- 172.21.15.32:0/3190599696 >> 172.21.15.32:0/3190599696 conn(0x7f4edc0b1280 msgr2=0x7f4edc0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:17.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fd53c400640 1 -- 172.21.15.32:0/751252149 wait complete. 2024-03-19T06:21:17.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda6a600640 1 -- 172.21.15.32:0/1426232638 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda640b6760 con 0x7fda6415da70 2024-03-19T06:21:17.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda6a600640 1 -- 172.21.15.32:0/1426232638 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda640b6a40 con 0x7fda640d2300 2024-03-19T06:21:17.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda6a600640 1 -- 172.21.15.32:0/1426232638 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda640cf920 con 0x7fda640d18f0 2024-03-19T06:21:17.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 -- 172.21.15.32:0/1426232638 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037205239 0 0) 0x7fda640b6760 con 0x7fda6415da70 2024-03-19T06:21:17.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 -- 172.21.15.32:0/1426232638 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda48003530 con 0x7fda6415da70 2024-03-19T06:21:17.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 -- 172.21.15.32:0/1426232638 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143071235 0 0) 0x7fda640b6a40 con 0x7fda640d2300 2024-03-19T06:21:17.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 -- 172.21.15.32:0/1426232638 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda640b6760 con 0x7fda640d2300 2024-03-19T06:21:17.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 -- 172.21.15.32:0/1426232638 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3298034766 0 0) 0x7fda48003530 con 0x7fda6415da70 2024-03-19T06:21:17.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 -- 172.21.15.32:0/1426232638 >> v2:172.21.15.32:3300/0 conn(0x7fda640d18f0 msgr2=0x7fda640d1dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:21:17.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63e00640 1 --2- 172.21.15.32:0/1426232638 >> v2:172.21.15.32:3300/0 conn(0x7fda640d18f0 0x7fda640d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7f4ee2000640 1 -- 172.21.15.32:0/3190599696 shutdown_connections 2024-03-19T06:21:17.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7f4ee2000640 1 -- 172.21.15.32:0/3190599696 wait complete. 2024-03-19T06:21:17.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7f0490a00640 1 Processor -- start 2024-03-19T06:21:17.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 --2- 172.21.15.32:0/1426232638 >> v2:172.21.15.32:3300/0 conn(0x7fda640d18f0 0x7fda640d1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 -- 172.21.15.32:0/1426232638 >> v1:172.21.15.171:6789/0 conn(0x7fda640d2300 legacy=0x7fda640b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 -- 172.21.15.32:0/1426232638 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda640b6d20 con 0x7fda6415da70 2024-03-19T06:21:17.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7ff95de00640 1 --2- 172.21.15.32:0/296339710 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff95003a5c0 0x7ff9500068d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff958069bb0 tx=0x7ff958097db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c405008138bda97 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7f0490a00640 1 -- start start 2024-03-19T06:21:17.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 -- 172.21.15.32:0/1426232638 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fda50001680 con 0x7fda6415da70 2024-03-19T06:21:17.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 -- 172.21.15.32:0/1426232638 >> v1:172.21.15.32:6789/0 conn(0x7fda6415da70 legacy=0x7fda640cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 --2- 172.21.15.32:0/1426232638 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda48004bb0 0x7fda48004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 --2- 172.21.15.32:0/1426232638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda480037b0 0x7fda48003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 --2- 172.21.15.32:0/1426232638 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda48004370 0x7fda4800ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 -- 172.21.15.32:0/1426232638 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda640cf920 con 0x7fda480037b0 2024-03-19T06:21:17.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 -- 172.21.15.32:0/1426232638 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4800c2e0 con 0x7fda48004bb0 2024-03-19T06:21:17.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63400640 1 -- 172.21.15.32:0/1426232638 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4800c4e0 con 0x7fda48004370 2024-03-19T06:21:17.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda63e00640 1 --2- 172.21.15.32:0/1426232638 >> v2:172.21.15.32:3300/0 conn(0x7fda640d18f0 0x7fda640d1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:17.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fd53c400640 1 Processor -- start 2024-03-19T06:21:17.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7ff955600640 1 -- 172.21.15.32:0/296339710 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958126640 con 0x7ff95003a5c0 2024-03-19T06:21:17.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7ff955600640 1 -- 172.21.15.32:0/296339710 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9581267e0 con 0x7ff95003a5c0 2024-03-19T06:21:17.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7ff955600640 1 -- 172.21.15.32:0/296339710 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958126c50 con 0x7ff95003a5c0 2024-03-19T06:21:17.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7fda69200640 1 --2- 172.21.15.32:0/1426232638 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda48004bb0 0x7fda48004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.464+0000 7f0093e00640 1 -- 172.21.15.32:0/1854058042 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f008c017070 con 0x7f0098052ff0 2024-03-19T06:21:17.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fda69c00640 1 --2- 172.21.15.32:0/1426232638 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda48004370 0x7fda4800ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f00a5600640 1 -- 172.21.15.32:0/1854058042 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c0052a0 con 0x7f0098052ff0 2024-03-19T06:21:17.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7ff957e00640 1 -- 172.21.15.32:0/296339710 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff95003a5c0 msgr2=0x7ff9500068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7ff957e00640 1 --2- 172.21.15.32:0/296339710 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff95003a5c0 0x7ff9500068d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff958069bb0 tx=0x7ff958097db0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fda63e00640 1 --2- 172.21.15.32:0/1426232638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda480037b0 0x7fda48003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f0093e00640 1 --2- 172.21.15.32:0/1854058042 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0080067730 0x7f0080069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4ee2000640 1 Processor -- start 2024-03-19T06:21:17.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fda69200640 1 -- 172.21.15.32:0/1426232638 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda48004370 msgr2=0x7fda4800ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:17.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fda69200640 1 --2- 172.21.15.32:0/1426232638 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda48004370 0x7fda4800ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fda69200640 1 -- 172.21.15.32:0/1426232638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda480037b0 msgr2=0x7fda48003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:17.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fda69200640 1 --2- 172.21.15.32:0/1426232638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda480037b0 0x7fda48003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4ee2000640 1 -- start start 2024-03-19T06:21:17.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fda69200640 1 -- 172.21.15.32:0/1426232638 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda640b6d20 con 0x7fda48004bb0 2024-03-19T06:21:17.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f0093e00640 1 -- 172.21.15.32:0/1854058042 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f008c0855b0 con 0x7f0098052ff0 2024-03-19T06:21:17.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fd53c400640 1 -- start start 2024-03-19T06:21:17.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7ff957e00640 1 -- 172.21.15.32:0/296339710 shutdown_connections 2024-03-19T06:21:17.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7ff957e00640 1 --2- 172.21.15.32:0/296339710 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff95003a5c0 0x7ff9500068d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7ff957e00640 1 --2- 172.21.15.32:0/296339710 >> v2:172.21.15.32:3300/0 conn(0x7ff9500e0fc0 0x7ff9500e5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7ff957e00640 1 -- 172.21.15.32:0/296339710 >> 172.21.15.32:0/296339710 conn(0x7ff950054ca0 msgr2=0x7ff9500550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:17.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fda69c00640 1 --2- 172.21.15.32:0/1426232638 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda48004370 0x7fda4800ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:17.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fda63e00640 1 --2- 172.21.15.32:0/1426232638 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda480037b0 0x7fda48003c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:17.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fda69c00640 1 -- 172.21.15.32:0/1426232638 reap_dead start 2024-03-19T06:21:17.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7ff957e00640 1 -- 172.21.15.32:0/296339710 shutdown_connections 2024-03-19T06:21:17.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7ff957e00640 1 -- 172.21.15.32:0/296339710 wait complete. 2024-03-19T06:21:17.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f009fe00640 1 --2- 172.21.15.32:0/1854058042 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0080067730 0x7f0080069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4ee2000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4edc06d590 0x7f4edc0c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4ee2000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4edc06d9f0 0x7f4edc153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4ee2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4edc162050 0x7f4edc1653f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4ee2000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc0cda90 con 0x7f4edc162050 2024-03-19T06:21:17.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4ee2000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc0cd910 con 0x7f4edc06d590 2024-03-19T06:21:17.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4ee2000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc0ca140 con 0x7f4edc06d9f0 2024-03-19T06:21:17.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4edbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4edc162050 0x7f4edc1653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4edbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4edc162050 0x7f4edc1653f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45604/0 (socket says 172.21.15.32:45604) 2024-03-19T06:21:17.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4edbe00640 1 -- 172.21.15.32:0/1531114100 learned_addr learned my addr 172.21.15.32:0/1531114100 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:17.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f009fe00640 1 --2- 172.21.15.32:0/1854058042 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0080067730 0x7f0080069bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0094005890 tx=0x7f0094007e20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4edbe00640 1 -- 172.21.15.32:0/1531114100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4edc06d9f0 msgr2=0x7f4edc153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4edbe00640 1 --2- 172.21.15.32:0/1531114100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4edc06d9f0 0x7f4edc153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4edbe00640 1 -- 172.21.15.32:0/1531114100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4edc06d590 msgr2=0x7f4edc0c44f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-19T06:21:17.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4edbe00640 1 --2- 172.21.15.32:0/1531114100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4edc06d590 0x7f4edc0c44f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4edbe00640 1 -- 172.21.15.32:0/1531114100 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc0b3d80 con 0x7f4edc162050 2024-03-19T06:21:17.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fd53c400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5340b4c50 0x7fd5340c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fd53c400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5340cc680 0x7fd5340c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f4edbe00640 1 --2- 172.21.15.32:0/1531114100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4edc162050 0x7f4edc1653f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400c780 tx=0x7f4ed400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fd53c400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd53415a7c0 0x7fd5340c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f0490a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f048c162050 0x7f048c0c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f0490a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f048c0cc6a0 0x7f048c1660d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f0490a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f048c0cdcf0 con 0x7f048c06d590 2024-03-19T06:21:17.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f0490a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f048c165c40 con 0x7f048c162050 2024-03-19T06:21:17.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7f0490a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f048c0cdfd0 con 0x7f048c0cc6a0 2024-03-19T06:21:17.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fd539a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5340b4c50 0x7fd5340c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fd53c400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340cbdb0 con 0x7fd53415a7c0 2024-03-19T06:21:17.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fd53c400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340cbc30 con 0x7fd5340cc680 2024-03-19T06:21:17.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fd53c400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd534071350 con 0x7fd5340b4c50 2024-03-19T06:21:17.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fd539a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5340b4c50 0x7fd5340c7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:50398/0 (socket says 172.21.15.32:50398) 2024-03-19T06:21:17.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fd539a00640 1 -- 172.21.15.32:0/2876019176 learned_addr learned my addr 172.21.15.32:0/2876019176 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:17.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.468+0000 7fd539000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5340cc680 0x7fd5340c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7f4ed3400640 1 -- 172.21.15.32:0/1531114100 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4017070 con 0x7f4edc162050 2024-03-19T06:21:17.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7f4ed3400640 1 -- 172.21.15.32:0/1531114100 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed4003db0 con 0x7f4edc162050 2024-03-19T06:21:17.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7f4ed3400640 1 -- 172.21.15.32:0/1531114100 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed40052b0 con 0x7f4edc162050 2024-03-19T06:21:17.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7f048a800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f048c0cc6a0 0x7f048c1660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7f048a800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f048c0cc6a0 0x7f048c1660d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57404/0 (socket says 172.21.15.32:57404) 2024-03-19T06:21:17.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7f048a800640 1 -- 172.21.15.32:0/3949614232 learned_addr learned my addr 172.21.15.32:0/3949614232 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:17.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7fd53a400640 1 --2- 172.21.15.32:0/2876019176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd53415a7c0 0x7fd5340c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7f0489e00640 1 --2- 172.21.15.32:0/3949614232 >> v2:172.21.15.32:3300/0 conn(0x7f048c162050 0x7f048c0c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7f4ee2000640 1 -- 172.21.15.32:0/1531114100 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc0b4060 con 0x7f4edc162050 2024-03-19T06:21:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7f4ee2000640 1 -- 172.21.15.32:0/1531114100 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4edc154320 con 0x7f4edc162050 2024-03-19T06:21:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7fd53a400640 1 -- 172.21.15.32:0/2876019176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5340b4c50 msgr2=0x7fd5340c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7fd53a400640 1 --2- 172.21.15.32:0/2876019176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5340b4c50 0x7fd5340c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7fd53a400640 1 -- 172.21.15.32:0/2876019176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5340cc680 msgr2=0x7fd5340c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7fd53a400640 1 --2- 172.21.15.32:0/2876019176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5340cc680 0x7fd5340c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7fd53a400640 1 -- 172.21.15.32:0/2876019176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340c8530 con 0x7fd53415a7c0 2024-03-19T06:21:17.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7fd539a00640 1 --2- 172.21.15.32:0/2876019176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5340b4c50 0x7fd5340c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:17.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7ff957e00640 1 Processor -- start 2024-03-19T06:21:17.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7f4ee2000640 1 -- 172.21.15.32:0/1531114100 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4edc0749e0 con 0x7f4edc162050 2024-03-19T06:21:17.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7fd53a400640 1 --2- 172.21.15.32:0/2876019176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd53415a7c0 0x7fd5340c44f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd53415e9e0 tx=0x7fd52001f0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7f0093e00640 1 -- 172.21.15.32:0/1854058042 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f008c010e20 con 0x7f0098052ff0 2024-03-19T06:21:17.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7fda69200640 1 --2- 172.21.15.32:0/1426232638 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda48004bb0 0x7fda48004f90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fda5000c260 tx=0x7fda5001cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd89938f504a794d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7fda63400640 1 -- 172.21.15.32:0/1426232638 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50007d40 con 0x7fda48004bb0 2024-03-19T06:21:17.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7f4ed3400640 1 -- 172.21.15.32:0/1531114100 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f4ed401a070 con 0x7f4edc162050 2024-03-19T06:21:17.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7fda63400640 1 -- 172.21.15.32:0/1426232638 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda500a9030 con 0x7fda48004bb0 2024-03-19T06:21:17.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7fda63400640 1 -- 172.21.15.32:0/1426232638 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50005d20 con 0x7fda48004bb0 2024-03-19T06:21:17.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7fda6a600640 1 -- 172.21.15.32:0/1426232638 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda48004bb0 msgr2=0x7fda48004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7fda6a600640 1 --2- 172.21.15.32:0/1426232638 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda48004bb0 0x7fda48004f90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fda5000c260 tx=0x7fda5001cc60 comp rx=0 tx=0).stop 2024-03-19T06:21:17.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7f048a800640 1 -- 172.21.15.32:0/3949614232 >> v2:172.21.15.32:3300/0 conn(0x7f048c162050 msgr2=0x7f048c0c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:17.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7f048a800640 1 --2- 172.21.15.32:0/3949614232 >> v2:172.21.15.32:3300/0 conn(0x7f048c162050 0x7f048c0c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7f048a800640 1 -- 172.21.15.32:0/3949614232 >> v1:172.21.15.171:6789/0 conn(0x7f048c06d590 legacy=0x7f048c0cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7f048a800640 1 -- 172.21.15.32:0/3949614232 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048c0ce2b0 con 0x7f048c0cc6a0 2024-03-19T06:21:17.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.472+0000 7f0489e00640 1 --2- 172.21.15.32:0/3949614232 >> v2:172.21.15.32:3300/0 conn(0x7f048c162050 0x7f048c0c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:17.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7ff957e00640 1 -- start start 2024-03-19T06:21:17.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7fda6a600640 1 -- 172.21.15.32:0/1426232638 shutdown_connections 2024-03-19T06:21:17.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7fda6a600640 1 --2- 172.21.15.32:0/1426232638 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda48004bb0 0x7fda48004f90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7fda6a600640 1 -- 172.21.15.32:0/1426232638 >> 172.21.15.32:0/1426232638 conn(0x7fda6408b000 msgr2=0x7fda640d37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:17.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7f4ed3400640 1 --2- 172.21.15.32:0/1531114100 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4eb80676b0 0x7f4eb8069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7f4ed3400640 1 -- 172.21.15.32:0/1531114100 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ed4085650 con 0x7f4edc162050 2024-03-19T06:21:17.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7f048a800640 1 --2- 172.21.15.32:0/3949614232 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f048c0cc6a0 0x7f048c1660d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f048c0712e0 tx=0x7f048401ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b1dbdaa8ea77040 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7f4edb400640 1 --2- 172.21.15.32:0/1531114100 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4eb80676b0 0x7f4eb8069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7fda6a600640 1 -- 172.21.15.32:0/1426232638 shutdown_connections 2024-03-19T06:21:17.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7fda6a600640 1 -- 172.21.15.32:0/1426232638 wait complete. 2024-03-19T06:21:17.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7f4edb400640 1 --2- 172.21.15.32:0/1531114100 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4eb80676b0 0x7f4eb8069b70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0af000 tx=0x7f4ecc0a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7ff957e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff950034120 0x7ff9500496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7ff957e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff95003a5c0 0x7ff9500caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7ff957e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9500e0fc0 0x7ff9500d2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7ff957e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9500077a0 con 0x7ff95003a5c0 2024-03-19T06:21:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7ff957e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff950007620 con 0x7ff950034120 2024-03-19T06:21:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7ff957e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff950007920 con 0x7ff9500e0fc0 2024-03-19T06:21:17.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7f0488a00640 1 -- 172.21.15.32:0/3949614232 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04840a56c0 con 0x7f048c0cc6a0 2024-03-19T06:21:17.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7f0488a00640 1 -- 172.21.15.32:0/3949614232 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04840a5860 con 0x7f048c0cc6a0 2024-03-19T06:21:17.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7ff956a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff950034120 0x7ff9500496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7f0488a00640 1 -- 172.21.15.32:0/3949614232 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04840a5c30 con 0x7f048c0cc6a0 2024-03-19T06:21:17.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7ff956a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff950034120 0x7ff9500496e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57410/0 (socket says 172.21.15.32:57410) 2024-03-19T06:21:17.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7ff956a00640 1 -- 172.21.15.32:0/3168092860 learned_addr learned my addr 172.21.15.32:0/3168092860 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:17.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7ff956000640 1 --2- 172.21.15.32:0/3168092860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff95003a5c0 0x7ff9500caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.476+0000 7ff95de00640 1 --2- 172.21.15.32:0/3168092860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9500e0fc0 0x7ff9500d2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7ff956a00640 1 -- 172.21.15.32:0/3168092860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9500e0fc0 msgr2=0x7ff9500d2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7ff956a00640 1 --2- 172.21.15.32:0/3168092860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9500e0fc0 0x7ff9500d2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7ff956a00640 1 -- 172.21.15.32:0/3168092860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff95003a5c0 msgr2=0x7ff9500caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7ff956a00640 1 --2- 172.21.15.32:0/3168092860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff95003a5c0 0x7ff9500caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7ff956a00640 1 -- 172.21.15.32:0/3168092860 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9500caf50 con 0x7ff950034120 2024-03-19T06:21:17.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7ff956a00640 1 --2- 172.21.15.32:0/3168092860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff950034120 0x7ff9500496e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff94800b3f0 tx=0x7ff94800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7ff94f400640 1 -- 172.21.15.32:0/3168092860 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948015020 con 0x7ff950034120 2024-03-19T06:21:17.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7ff94f400640 1 -- 172.21.15.32:0/3168092860 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff948011850 con 0x7ff950034120 2024-03-19T06:21:17.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7ff94f400640 1 -- 172.21.15.32:0/3168092860 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948011c40 con 0x7ff950034120 2024-03-19T06:21:17.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7fda6a600640 1 Processor -- start 2024-03-19T06:21:17.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7ff957e00640 1 -- 172.21.15.32:0/3168092860 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff950049cc0 con 0x7ff950034120 2024-03-19T06:21:17.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7ff957e00640 1 -- 172.21.15.32:0/3168092860 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95004a280 con 0x7ff950034120 2024-03-19T06:21:17.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7f0490a00640 1 -- 172.21.15.32:0/3949614232 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f048c0cc6a0 msgr2=0x7f048c1660d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7f0490a00640 1 --2- 172.21.15.32:0/3949614232 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f048c0cc6a0 0x7f048c1660d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f048c0712e0 tx=0x7f048401ca10 comp rx=0 tx=0).stop 2024-03-19T06:21:17.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7f0490a00640 1 -- 172.21.15.32:0/3949614232 shutdown_connections 2024-03-19T06:21:17.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7f0490a00640 1 --2- 172.21.15.32:0/3949614232 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f048c0cc6a0 0x7f048c1660d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7f0490a00640 1 --2- 172.21.15.32:0/3949614232 >> v2:172.21.15.32:3300/0 conn(0x7f048c162050 0x7f048c0c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7f0490a00640 1 -- 172.21.15.32:0/3949614232 >> 172.21.15.32:0/3949614232 conn(0x7f048c0b1280 msgr2=0x7f048c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:17.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7fda6a600640 1 -- start start 2024-03-19T06:21:17.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7f0490a00640 1 -- 172.21.15.32:0/3949614232 shutdown_connections 2024-03-19T06:21:17.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7f0490a00640 1 -- 172.21.15.32:0/3949614232 wait complete. 2024-03-19T06:21:17.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7ff94cc00640 1 -- 172.21.15.32:0/3168092860 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff92c0052a0 con 0x7ff950034120 2024-03-19T06:21:17.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7fd531600640 1 -- 172.21.15.32:0/2876019176 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5200c1070 con 0x7fd53415a7c0 2024-03-19T06:21:17.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7fd531600640 1 -- 172.21.15.32:0/2876019176 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5200b2420 con 0x7fd53415a7c0 2024-03-19T06:21:17.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.480+0000 7fd531600640 1 -- 172.21.15.32:0/2876019176 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5200b25d0 con 0x7fd53415a7c0 2024-03-19T06:21:17.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fd53c400640 1 -- 172.21.15.32:0/2876019176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5340c8810 con 0x7fd53415a7c0 2024-03-19T06:21:17.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fd53c400640 1 -- 172.21.15.32:0/2876019176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5340c8dd0 con 0x7fd53415a7c0 2024-03-19T06:21:17.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7f4ed3400640 1 -- 172.21.15.32:0/1531114100 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f4ed4055d60 con 0x7f4edc162050 2024-03-19T06:21:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fda6a600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda48004bb0 0x7fda640b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fda6a600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda640c9350 0x7fda6415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fda6a600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda6415b130 0x7fda640cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fda6a600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda640b4780 con 0x7fda48004bb0 2024-03-19T06:21:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fda6a600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda640b4600 con 0x7fda640c9350 2024-03-19T06:21:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fda6a600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda640b4900 con 0x7fda6415b130 2024-03-19T06:21:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fda69200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda48004bb0 0x7fda640b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fda63e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda640c9350 0x7fda6415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fda63e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda640c9350 0x7fda6415abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:57426/0 (socket says 172.21.15.32:57426) 2024-03-19T06:21:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fda63e00640 1 -- 172.21.15.32:0/1442733066 learned_addr learned my addr 172.21.15.32:0/1442733066 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:17.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7f0490a00640 1 Processor -- start 2024-03-19T06:21:17.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7f0490a00640 1 -- start start 2024-03-19T06:21:17.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7ff94f400640 1 -- 172.21.15.32:0/3168092860 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff948018020 con 0x7ff950034120 2024-03-19T06:21:17.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fda63e00640 1 -- 172.21.15.32:0/1442733066 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda6415b130 msgr2=0x7fda640cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fda63e00640 1 --2- 172.21.15.32:0/1442733066 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda6415b130 0x7fda640cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fda63e00640 1 -- 172.21.15.32:0/1442733066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda48004bb0 msgr2=0x7fda640b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fda63e00640 1 --2- 172.21.15.32:0/1442733066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda48004bb0 0x7fda640b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.484+0000 7fda63e00640 1 -- 172.21.15.32:0/1442733066 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda64203100 con 0x7fda640c9350 2024-03-19T06:21:17.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7ff94f400640 1 --2- 172.21.15.32:0/3168092860 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff938067660 0x7ff938069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0490a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f048c06d590 0x7f048c0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7ff94f400640 1 -- 172.21.15.32:0/3168092860 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9480856b0 con 0x7ff950034120 2024-03-19T06:21:17.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0490a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f048c0cc6a0 0x7f048c15a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0490a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f048c162050 0x7f048c149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0490a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048c0cda90 con 0x7f048c0cc6a0 2024-03-19T06:21:17.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0490a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048c0cd910 con 0x7f048c162050 2024-03-19T06:21:17.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0490a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048c0ca140 con 0x7f048c06d590 2024-03-19T06:21:17.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0489e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f048c06d590 0x7f048c0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0489e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f048c06d590 0x7f048c0c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:50428/0 (socket says 172.21.15.32:50428) 2024-03-19T06:21:17.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0489e00640 1 -- 172.21.15.32:0/535120390 learned_addr learned my addr 172.21.15.32:0/535120390 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:17.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7fd531600640 1 -- 172.21.15.32:0/2876019176 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd5200c4070 con 0x7fd53415a7c0 2024-03-19T06:21:17.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0489400640 1 --2- 172.21.15.32:0/535120390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f048c0cc6a0 0x7f048c15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f048a800640 1 --2- 172.21.15.32:0/535120390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f048c162050 0x7f048c149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7fda63e00640 1 --2- 172.21.15.32:0/1442733066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda640c9350 0x7fda6415abf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fda5400d5f0 tx=0x7fda5400dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7ff956000640 1 --2- 172.21.15.32:0/3168092860 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff938067660 0x7ff938069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0489e00640 1 -- 172.21.15.32:0/535120390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f048c162050 msgr2=0x7f048c149500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0489e00640 1 --2- 172.21.15.32:0/535120390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f048c162050 0x7f048c149500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0489e00640 1 -- 172.21.15.32:0/535120390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f048c0cc6a0 msgr2=0x7f048c15a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0489e00640 1 --2- 172.21.15.32:0/535120390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f048c0cc6a0 0x7f048c15a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0489e00640 1 -- 172.21.15.32:0/535120390 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048c14a1e0 con 0x7f048c06d590 2024-03-19T06:21:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0489400640 1 --2- 172.21.15.32:0/535120390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f048c0cc6a0 0x7f048c15a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:17.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7fd53c400640 1 -- 172.21.15.32:0/2876019176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5340749e0 con 0x7fd53415a7c0 2024-03-19T06:21:17.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0489e00640 1 --2- 172.21.15.32:0/535120390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f048c06d590 0x7f048c0c9900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f047c00e810 tx=0x7f047c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0482000640 1 -- 172.21.15.32:0/535120390 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c017070 con 0x7f048c06d590 2024-03-19T06:21:17.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7f0482000640 1 -- 172.21.15.32:0/535120390 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047c00c8d0 con 0x7f048c06d590 2024-03-19T06:21:17.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7fd531600640 1 --2- 172.21.15.32:0/2876019176 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd514067730 0x7fd514069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.488+0000 7fd531600640 1 -- 172.21.15.32:0/2876019176 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd52011fa40 con 0x7fd53415a7c0 2024-03-19T06:21:17.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.492+0000 7ff956000640 1 --2- 172.21.15.32:0/3168092860 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff938067660 0x7ff938069b20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff9440092c0 tx=0x7ff944009250 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.492+0000 7f0482000640 1 -- 172.21.15.32:0/535120390 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c00f040 con 0x7f048c06d590 2024-03-19T06:21:17.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.492+0000 7f0490a00640 1 -- 172.21.15.32:0/535120390 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048c14a4c0 con 0x7f048c06d590 2024-03-19T06:21:17.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.492+0000 7f0490a00640 1 -- 172.21.15.32:0/535120390 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048c14aa80 con 0x7f048c06d590 2024-03-19T06:21:17.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.492+0000 7fda60c00640 1 -- 172.21.15.32:0/1442733066 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54016070 con 0x7fda640c9350 2024-03-19T06:21:17.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.492+0000 7fd539a00640 1 --2- 172.21.15.32:0/2876019176 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd514067730 0x7fd514069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.492+0000 7fda60c00640 1 -- 172.21.15.32:0/1442733066 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda54012870 con 0x7fda640c9350 2024-03-19T06:21:17.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.492+0000 7fda60c00640 1 -- 172.21.15.32:0/1442733066 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54012c60 con 0x7fda640c9350 2024-03-19T06:21:17.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.492+0000 7fda6a600640 1 -- 172.21.15.32:0/1442733066 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda642033e0 con 0x7fda640c9350 2024-03-19T06:21:17.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.492+0000 7fda6a600640 1 -- 172.21.15.32:0/1442733066 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda642039a0 con 0x7fda640c9350 2024-03-19T06:21:17.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.492+0000 7f047b400640 1 -- 172.21.15.32:0/535120390 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045c0052a0 con 0x7f048c06d590 2024-03-19T06:21:17.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.492+0000 7fd539a00640 1 --2- 172.21.15.32:0/2876019176 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd514067730 0x7fd514069bf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00c530 tx=0x7fd52c00b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.492+0000 7ff94f400640 1 -- 172.21.15.32:0/3168092860 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7ff94801f020 con 0x7ff950034120 2024-03-19T06:21:17.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.496+0000 7fda6a600640 1 -- 172.21.15.32:0/1442733066 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda64075090 con 0x7fda640c9350 2024-03-19T06:21:17.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.496+0000 7fda60c00640 1 -- 172.21.15.32:0/1442733066 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fda54019070 con 0x7fda640c9350 2024-03-19T06:21:17.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.496+0000 7fd531600640 1 -- 172.21.15.32:0/2876019176 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fd52001a480 con 0x7fd53415a7c0 2024-03-19T06:21:17.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.496+0000 7f0482000640 1 -- 172.21.15.32:0/535120390 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f047c01a070 con 0x7f048c06d590 2024-03-19T06:21:17.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.496+0000 7fda60c00640 1 --2- 172.21.15.32:0/1442733066 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fda44067760 0x7fda44069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.496+0000 7fda60c00640 1 -- 172.21.15.32:0/1442733066 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda54085aa0 con 0x7fda640c9350 2024-03-19T06:21:17.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.496+0000 7f0482000640 1 --2- 172.21.15.32:0/535120390 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0468067690 0x7f0468069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:17.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.500+0000 7f0482000640 1 -- 172.21.15.32:0/535120390 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f047c0854c0 con 0x7f048c06d590 2024-03-19T06:21:17.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.500+0000 7fda60c00640 1 -- 172.21.15.32:0/1442733066 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fda54056700 con 0x7fda640c9350 2024-03-19T06:21:17.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.500+0000 7fda69200640 1 --2- 172.21.15.32:0/1442733066 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fda44067760 0x7fda44069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.504+0000 7fda69200640 1 --2- 172.21.15.32:0/1442733066 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fda44067760 0x7fda44069c20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fda500ac000 tx=0x7fda500b0040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.500+0000 7f0489400640 1 --2- 172.21.15.32:0/535120390 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0468067690 0x7f0468069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:17.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.504+0000 7f0489400640 1 --2- 172.21.15.32:0/535120390 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0468067690 0x7f0468069b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f048c1fea40 tx=0x7f0474009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:17.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.508+0000 7f0482000640 1 -- 172.21.15.32:0/535120390 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f047c056130 con 0x7f048c06d590 2024-03-19T06:21:17.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.740+0000 7f3e75800640 1 -- 172.21.15.32:0/348568914 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3e4c005860 con 0x7f3e6804f3e0 2024-03-19T06:21:17.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.740+0000 7f3e63e00640 1 -- 172.21.15.32:0/348568914 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e5c061de0 con 0x7f3e6804f3e0 2024-03-19T06:21:17.735 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2024-03-19T06:21:17.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.744+0000 7f3e75800640 1 -- 172.21.15.32:0/348568914 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3e50067690 msgr2=0x7f3e50069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.744+0000 7f3e75800640 1 --2- 172.21.15.32:0/348568914 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3e50067690 0x7f3e50069b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3e680f3890 tx=0x7f3e64008040 comp rx=0 tx=0).stop 2024-03-19T06:21:17.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.744+0000 7f3e75800640 1 -- 172.21.15.32:0/348568914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e6804f3e0 msgr2=0x7f3e68103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.744+0000 7f3e75800640 1 --2- 172.21.15.32:0/348568914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e6804f3e0 0x7f3e68103d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00aee0 tx=0x7f3e5c007410 comp rx=0 tx=0).stop 2024-03-19T06:21:17.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.744+0000 7f3e75800640 1 -- 172.21.15.32:0/348568914 shutdown_connections 2024-03-19T06:21:17.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.744+0000 7f3e75800640 1 --2- 172.21.15.32:0/348568914 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3e50067690 0x7f3e50069b50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.744+0000 7f3e75800640 1 --2- 172.21.15.32:0/348568914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e68104850 0x7f3e6804bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.744+0000 7f3e75800640 1 --2- 172.21.15.32:0/348568914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e6804f7c0 0x7f3e680f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.744+0000 7f3e75800640 1 --2- 172.21.15.32:0/348568914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e6804f3e0 0x7f3e68103d70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.744+0000 7f3e75800640 1 -- 172.21.15.32:0/348568914 >> 172.21.15.32:0/348568914 conn(0x7f3e68009fc0 msgr2=0x7f3e68006e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:17.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.744+0000 7f3e75800640 1 -- 172.21.15.32:0/348568914 shutdown_connections 2024-03-19T06:21:17.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.744+0000 7f3e75800640 1 -- 172.21.15.32:0/348568914 wait complete. 2024-03-19T06:21:17.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.756+0000 7f052e800640 1 -- 172.21.15.32:0/386336055 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f05200391e0 con 0x7f0510003fa0 2024-03-19T06:21:17.751 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2024-03-19T06:21:17.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.756+0000 7f0525600640 1 -- 172.21.15.32:0/386336055 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0514056c60 con 0x7f0510003fa0 2024-03-19T06:21:17.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.760+0000 7f051aa00640 1 -- 172.21.15.32:0/386336055 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0508067660 msgr2=0x7f0508069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.760+0000 7f051aa00640 1 --2- 172.21.15.32:0/386336055 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0508067660 0x7f0508069b20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f051c0ad000 tx=0x7f051c004850 comp rx=0 tx=0).stop 2024-03-19T06:21:17.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.760+0000 7f051aa00640 1 -- 172.21.15.32:0/386336055 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0510003fa0 msgr2=0x7f052018b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.760+0000 7f051aa00640 1 --2- 172.21.15.32:0/386336055 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0510003fa0 0x7f052018b8d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0514011a30 tx=0x7f0514011ef0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.760+0000 7f051aa00640 1 -- 172.21.15.32:0/386336055 shutdown_connections 2024-03-19T06:21:17.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.760+0000 7f051aa00640 1 --2- 172.21.15.32:0/386336055 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0508067660 0x7f0508069b20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.760+0000 7f051aa00640 1 --2- 172.21.15.32:0/386336055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05201a72b0 0x7f05201a7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.760+0000 7f051aa00640 1 --2- 172.21.15.32:0/386336055 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05201036f0 0x7f0520103b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.760+0000 7f051aa00640 1 --2- 172.21.15.32:0/386336055 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0510003fa0 0x7f052018b8d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.760+0000 7f051aa00640 1 -- 172.21.15.32:0/386336055 >> 172.21.15.32:0/386336055 conn(0x7f0520009fc0 msgr2=0x7f052004c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:17.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.764+0000 7f051aa00640 1 -- 172.21.15.32:0/386336055 shutdown_connections 2024-03-19T06:21:17.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.764+0000 7f051aa00640 1 -- 172.21.15.32:0/386336055 wait complete. 2024-03-19T06:21:17.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-03-19T06:21:17.773 DEBUG:teuthology.parallel:result is None 2024-03-19T06:21:17.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2024-03-19T06:21:17.786 DEBUG:teuthology.parallel:result is None 2024-03-19T06:21:17.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.800+0000 7f00a5600640 1 -- 172.21.15.32:0/1854058042 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f007c005590 con 0x7f0098052ff0 2024-03-19T06:21:17.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.800+0000 7f0093e00640 1 -- 172.21.15.32:0/1854058042 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f008c055b40 con 0x7f0098052ff0 2024-03-19T06:21:17.795 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2024-03-19T06:21:17.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.808+0000 7f00a5600640 1 -- 172.21.15.32:0/1854058042 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0080067730 msgr2=0x7f0080069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.808+0000 7f00a5600640 1 --2- 172.21.15.32:0/1854058042 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0080067730 0x7f0080069bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0094005890 tx=0x7f0094007e20 comp rx=0 tx=0).stop 2024-03-19T06:21:17.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.808+0000 7f00a5600640 1 -- 172.21.15.32:0/1854058042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0098052ff0 msgr2=0x7f009804a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.808+0000 7f00a5600640 1 --2- 172.21.15.32:0/1854058042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0098052ff0 0x7f009804a7e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f008c00b500 tx=0x7f008c00b9c0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.808+0000 7f00a5600640 1 -- 172.21.15.32:0/1854058042 shutdown_connections 2024-03-19T06:21:17.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.808+0000 7f00a5600640 1 --2- 172.21.15.32:0/1854058042 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0080067730 0x7f0080069bf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.808+0000 7f00a5600640 1 --2- 172.21.15.32:0/1854058042 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0098056210 0x7f009804ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.808+0000 7f00a5600640 1 --2- 172.21.15.32:0/1854058042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0098052ff0 0x7f009804a7e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.808+0000 7f00a5600640 1 --2- 172.21.15.32:0/1854058042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0098039b90 0x7f009800a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.808+0000 7f00a5600640 1 -- 172.21.15.32:0/1854058042 >> 172.21.15.32:0/1854058042 conn(0x7f00980537c0 msgr2=0x7f00980367c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:17.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.808+0000 7f00a5600640 1 -- 172.21.15.32:0/1854058042 shutdown_connections 2024-03-19T06:21:17.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.808+0000 7f00a5600640 1 -- 172.21.15.32:0/1854058042 wait complete. 2024-03-19T06:21:17.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.812+0000 7fd53c400640 1 -- 172.21.15.32:0/2876019176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd5340b0f90 con 0x7fd53415a7c0 2024-03-19T06:21:17.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.816+0000 7fd531600640 1 -- 172.21.15.32:0/2876019176 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd5200f00e0 con 0x7fd53415a7c0 2024-03-19T06:21:17.807 INFO:teuthology.orchestra.run.smithi032.stdout:60129542150 2024-03-19T06:21:17.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.816+0000 7fd53c400640 1 -- 172.21.15.32:0/2876019176 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd514067730 msgr2=0x7fd514069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.816+0000 7fd53c400640 1 --2- 172.21.15.32:0/2876019176 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd514067730 0x7fd514069bf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00c530 tx=0x7fd52c00b040 comp rx=0 tx=0).stop 2024-03-19T06:21:17.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.816+0000 7fd53c400640 1 -- 172.21.15.32:0/2876019176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd53415a7c0 msgr2=0x7fd5340c44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.816+0000 7fd53c400640 1 --2- 172.21.15.32:0/2876019176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd53415a7c0 0x7fd5340c44f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd53415e9e0 tx=0x7fd52001f0d0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.816+0000 7fd53c400640 1 -- 172.21.15.32:0/2876019176 shutdown_connections 2024-03-19T06:21:17.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.816+0000 7fd53c400640 1 --2- 172.21.15.32:0/2876019176 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd514067730 0x7fd514069bf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.816+0000 7fd53c400640 1 --2- 172.21.15.32:0/2876019176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd53415a7c0 0x7fd5340c44f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.816+0000 7fd53c400640 1 --2- 172.21.15.32:0/2876019176 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5340cc680 0x7fd5340c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.816+0000 7fd53c400640 1 --2- 172.21.15.32:0/2876019176 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5340b4c50 0x7fd5340c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.816+0000 7fd53c400640 1 -- 172.21.15.32:0/2876019176 >> 172.21.15.32:0/2876019176 conn(0x7fd5340b1280 msgr2=0x7fd5340b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:17.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.816+0000 7fd53c400640 1 -- 172.21.15.32:0/2876019176 shutdown_connections 2024-03-19T06:21:17.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.816+0000 7fd53c400640 1 -- 172.21.15.32:0/2876019176 wait complete. 2024-03-19T06:21:17.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.816+0000 7fda6a600640 1 -- 172.21.15.32:0/1442733066 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fda6406ae60 con 0x7fda640c9350 2024-03-19T06:21:17.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.820+0000 7fda60c00640 1 -- 172.21.15.32:0/1442733066 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda54056000 con 0x7fda640c9350 2024-03-19T06:21:17.812 INFO:teuthology.orchestra.run.smithi032.stdout:60129542153 2024-03-19T06:21:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.820+0000 7fda6a600640 1 -- 172.21.15.32:0/1442733066 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fda44067760 msgr2=0x7fda44069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.820+0000 7fda6a600640 1 --2- 172.21.15.32:0/1442733066 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fda44067760 0x7fda44069c20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fda500ac000 tx=0x7fda500b0040 comp rx=0 tx=0).stop 2024-03-19T06:21:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.820+0000 7fda6a600640 1 -- 172.21.15.32:0/1442733066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda640c9350 msgr2=0x7fda6415abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.820+0000 7fda6a600640 1 --2- 172.21.15.32:0/1442733066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda640c9350 0x7fda6415abf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fda5400d5f0 tx=0x7fda5400dab0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.820+0000 7fda6a600640 1 -- 172.21.15.32:0/1442733066 shutdown_connections 2024-03-19T06:21:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.820+0000 7fda6a600640 1 --2- 172.21.15.32:0/1442733066 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fda44067760 0x7fda44069c20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.820+0000 7fda6a600640 1 --2- 172.21.15.32:0/1442733066 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda6415b130 0x7fda640cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.820+0000 7fda6a600640 1 --2- 172.21.15.32:0/1442733066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda640c9350 0x7fda6415abf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.820+0000 7fda6a600640 1 --2- 172.21.15.32:0/1442733066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda48004bb0 0x7fda640b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.820+0000 7fda6a600640 1 -- 172.21.15.32:0/1442733066 >> 172.21.15.32:0/1442733066 conn(0x7fda6408b000 msgr2=0x7fda6415cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:17.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.824+0000 7fda6a600640 1 -- 172.21.15.32:0/1442733066 shutdown_connections 2024-03-19T06:21:17.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.824+0000 7fda6a600640 1 -- 172.21.15.32:0/1442733066 wait complete. 2024-03-19T06:21:17.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.828+0000 7f4ee2000640 1 -- 172.21.15.32:0/1531114100 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4edc0cd1e0 con 0x7f4edc162050 2024-03-19T06:21:17.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.828+0000 7f4ed3400640 1 -- 172.21.15.32:0/1531114100 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ed4059e00 con 0x7f4edc162050 2024-03-19T06:21:17.821 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2024-03-19T06:21:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.832+0000 7f4ee2000640 1 -- 172.21.15.32:0/1531114100 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4eb80676b0 msgr2=0x7f4eb8069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.832+0000 7f4ee2000640 1 --2- 172.21.15.32:0/1531114100 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4eb80676b0 0x7f4eb8069b70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0af000 tx=0x7f4ecc0a7000 comp rx=0 tx=0).stop 2024-03-19T06:21:17.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.832+0000 7f4ee2000640 1 -- 172.21.15.32:0/1531114100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4edc162050 msgr2=0x7f4edc1653f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.832+0000 7f4ee2000640 1 --2- 172.21.15.32:0/1531114100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4edc162050 0x7f4edc1653f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400c780 tx=0x7f4ed400cc40 comp rx=0 tx=0).stop 2024-03-19T06:21:17.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.832+0000 7f4ee2000640 1 -- 172.21.15.32:0/1531114100 shutdown_connections 2024-03-19T06:21:17.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.832+0000 7f4ee2000640 1 --2- 172.21.15.32:0/1531114100 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4eb80676b0 0x7f4eb8069b70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.832+0000 7f4ee2000640 1 --2- 172.21.15.32:0/1531114100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4edc162050 0x7f4edc1653f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.832+0000 7f4ee2000640 1 --2- 172.21.15.32:0/1531114100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4edc06d9f0 0x7f4edc153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.832+0000 7f4ee2000640 1 --2- 172.21.15.32:0/1531114100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4edc06d590 0x7f4edc0c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.832+0000 7f4ee2000640 1 -- 172.21.15.32:0/1531114100 >> 172.21.15.32:0/1531114100 conn(0x7f4edc0b1280 msgr2=0x7f4edc15b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:17.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.832+0000 7f4ee2000640 1 -- 172.21.15.32:0/1531114100 shutdown_connections 2024-03-19T06:21:17.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.832+0000 7f4ee2000640 1 -- 172.21.15.32:0/1531114100 wait complete. 2024-03-19T06:21:17.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.836+0000 7ff94cc00640 1 -- 172.21.15.32:0/3168092860 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff92c005590 con 0x7ff950034120 2024-03-19T06:21:17.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.840+0000 7ff94f400640 1 -- 172.21.15.32:0/3168092860 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9500caf50 con 0x7ff950034120 2024-03-19T06:21:17.832 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2024-03-19T06:21:17.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2024-03-19T06:21:17.833 DEBUG:teuthology.parallel:result is None 2024-03-19T06:21:17.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.840+0000 7ff94cc00640 1 -- 172.21.15.32:0/3168092860 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff938067660 msgr2=0x7ff938069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.840+0000 7ff94cc00640 1 --2- 172.21.15.32:0/3168092860 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff938067660 0x7ff938069b20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff9440092c0 tx=0x7ff944009250 comp rx=0 tx=0).stop 2024-03-19T06:21:17.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.840+0000 7ff94cc00640 1 -- 172.21.15.32:0/3168092860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff950034120 msgr2=0x7ff9500496e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.840+0000 7ff94cc00640 1 --2- 172.21.15.32:0/3168092860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff950034120 0x7ff9500496e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff94800b3f0 tx=0x7ff94800b8b0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.840+0000 7ff94cc00640 1 -- 172.21.15.32:0/3168092860 shutdown_connections 2024-03-19T06:21:17.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.840+0000 7ff94cc00640 1 --2- 172.21.15.32:0/3168092860 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff938067660 0x7ff938069b20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.840+0000 7ff94cc00640 1 --2- 172.21.15.32:0/3168092860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9500e0fc0 0x7ff9500d2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.840+0000 7ff94cc00640 1 --2- 172.21.15.32:0/3168092860 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff95003a5c0 0x7ff9500caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.840+0000 7ff94cc00640 1 --2- 172.21.15.32:0/3168092860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff950034120 0x7ff9500496e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.840+0000 7ff94cc00640 1 -- 172.21.15.32:0/3168092860 >> 172.21.15.32:0/3168092860 conn(0x7ff950054ca0 msgr2=0x7ff9500503c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:17.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.840+0000 7ff94cc00640 1 -- 172.21.15.32:0/3168092860 shutdown_connections 2024-03-19T06:21:17.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.844+0000 7ff94cc00640 1 -- 172.21.15.32:0/3168092860 wait complete. 2024-03-19T06:21:17.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-03-19T06:21:17.836 DEBUG:teuthology.parallel:result is None 2024-03-19T06:21:17.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.848+0000 7f047b400640 1 -- 172.21.15.32:0/535120390 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f045c005590 con 0x7f048c06d590 2024-03-19T06:21:17.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.848+0000 7f0482000640 1 -- 172.21.15.32:0/535120390 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f047c055a30 con 0x7f048c06d590 2024-03-19T06:21:17.840 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2024-03-19T06:21:17.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.4 2024-03-19T06:21:17.843 DEBUG:teuthology.parallel:result is None 2024-03-19T06:21:17.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.848+0000 7f047b400640 1 -- 172.21.15.32:0/535120390 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0468067690 msgr2=0x7f0468069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.848+0000 7f047b400640 1 --2- 172.21.15.32:0/535120390 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0468067690 0x7f0468069b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f048c1fea40 tx=0x7f0474009040 comp rx=0 tx=0).stop 2024-03-19T06:21:17.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.848+0000 7f047b400640 1 -- 172.21.15.32:0/535120390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f048c06d590 msgr2=0x7f048c0c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:17.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.848+0000 7f047b400640 1 --2- 172.21.15.32:0/535120390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f048c06d590 0x7f048c0c9900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f047c00e810 tx=0x7f047c00ecd0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.848+0000 7f047b400640 1 -- 172.21.15.32:0/535120390 shutdown_connections 2024-03-19T06:21:17.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.852+0000 7f047b400640 1 --2- 172.21.15.32:0/535120390 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0468067690 0x7f0468069b50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.852+0000 7f047b400640 1 --2- 172.21.15.32:0/535120390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f048c162050 0x7f048c149500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.852+0000 7f047b400640 1 --2- 172.21.15.32:0/535120390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f048c0cc6a0 0x7f048c15a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.852+0000 7f047b400640 1 --2- 172.21.15.32:0/535120390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f048c06d590 0x7f048c0c9900 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:17.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.852+0000 7f047b400640 1 -- 172.21.15.32:0/535120390 >> 172.21.15.32:0/535120390 conn(0x7f048c0b1280 msgr2=0x7f048c06e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:17.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.852+0000 7f047b400640 1 -- 172.21.15.32:0/535120390 shutdown_connections 2024-03-19T06:21:17.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:17.852+0000 7f047b400640 1 -- 172.21.15.32:0/535120390 wait complete. 2024-03-19T06:21:17.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.5 2024-03-19T06:21:17.859 DEBUG:teuthology.parallel:result is None 2024-03-19T06:21:17.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-03-19T06:21:17.865 DEBUG:teuthology.parallel:result is None 2024-03-19T06:21:17.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2024-03-19T06:21:17.866 DEBUG:teuthology.parallel:result is None 2024-03-19T06:21:17.866 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-19T06:21:17.866 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:21:18.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.060+0000 7f6d55200640 1 Processor -- start 2024-03-19T06:21:18.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.060+0000 7f6d55200640 1 -- start start 2024-03-19T06:21:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.060+0000 7f6d55200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6d500b0650 0x7f6d500cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.060+0000 7f6d55200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d5006f440 0x7f6d5006f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.060+0000 7f6d55200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d500cce80 con 0x7f6d5015ef90 2024-03-19T06:21:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.060+0000 7f6d55200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d500cd160 con 0x7f6d500b0650 2024-03-19T06:21:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.060+0000 7f6d55200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500cd440 con 0x7f6d5006f440 2024-03-19T06:21:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.060+0000 7f6d47e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6d500b0650 0x7f6d500cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.060+0000 7f6d47e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6d500b0650 0x7f6d500cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45646/0 (socket says 172.21.15.32:45646) 2024-03-19T06:21:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.060+0000 7f6d47e00640 1 -- 172.21.15.32:0/2199471446 learned_addr learned my addr 172.21.15.32:0/2199471446 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.060+0000 7f6d4fe00640 1 --2- 172.21.15.32:0/2199471446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d5006f440 0x7f6d5006f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.060+0000 7f6d47e00640 1 -- 172.21.15.32:0/2199471446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d5006f440 msgr2=0x7f6d5006f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.060+0000 7f6d47e00640 1 --2- 172.21.15.32:0/2199471446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d5006f440 0x7f6d5006f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.060+0000 7f6d47e00640 1 -- 172.21.15.32:0/2199471446 >> v1:172.21.15.171:6789/0 conn(0x7f6d5015ef90 legacy=0x7f6d500cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:18.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.060+0000 7f6d47e00640 1 -- 172.21.15.32:0/2199471446 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d500d24a0 con 0x7f6d500b0650 2024-03-19T06:21:18.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.064+0000 7f6d47e00640 1 --2- 172.21.15.32:0/2199471446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d500b0650 0x7f6d500cfc20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009870 tx=0x7f6d3801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b2e17c071a342 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:18.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.064+0000 7f6d4ea00640 1 -- 172.21.15.32:0/2199471446 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d380b0070 con 0x7f6d500b0650 2024-03-19T06:21:18.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.064+0000 7f6d4ea00640 1 -- 172.21.15.32:0/2199471446 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d380ab600 con 0x7f6d500b0650 2024-03-19T06:21:18.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.064+0000 7f6d4ea00640 1 -- 172.21.15.32:0/2199471446 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d380ab9d0 con 0x7f6d500b0650 2024-03-19T06:21:18.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.064+0000 7f6d55200640 1 -- 172.21.15.32:0/2199471446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d500b0650 msgr2=0x7f6d500cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:18.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.064+0000 7f6d55200640 1 --2- 172.21.15.32:0/2199471446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d500b0650 0x7f6d500cfc20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009870 tx=0x7f6d3801c490 comp rx=0 tx=0).stop 2024-03-19T06:21:18.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.064+0000 7f6d55200640 1 -- 172.21.15.32:0/2199471446 shutdown_connections 2024-03-19T06:21:18.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.064+0000 7f6d55200640 1 --2- 172.21.15.32:0/2199471446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d5006f440 0x7f6d5006f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.064+0000 7f6d55200640 1 --2- 172.21.15.32:0/2199471446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d500b0650 0x7f6d500cfc20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.064+0000 7f6d55200640 1 -- 172.21.15.32:0/2199471446 >> 172.21.15.32:0/2199471446 conn(0x7f6d500d1610 msgr2=0x7f6d500d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:18.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.064+0000 7f6d55200640 1 -- 172.21.15.32:0/2199471446 shutdown_connections 2024-03-19T06:21:18.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.064+0000 7f6d55200640 1 -- 172.21.15.32:0/2199471446 wait complete. 2024-03-19T06:21:18.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.064+0000 7f6d55200640 1 Processor -- start 2024-03-19T06:21:18.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.064+0000 7f6d55200640 1 -- start start 2024-03-19T06:21:18.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d55200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d5006f440 0x7f6d50156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d55200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d500b0650 0x7f6d500b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d55200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d5015ef90 0x7f6d501516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d55200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50168750 con 0x7f6d5006f440 2024-03-19T06:21:18.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d55200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500d0370 con 0x7f6d500b0650 2024-03-19T06:21:18.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d55200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d501688d0 con 0x7f6d5015ef90 2024-03-19T06:21:18.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d4f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d5006f440 0x7f6d50156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d4f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d5006f440 0x7f6d50156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45656/0 (socket says 172.21.15.32:45656) 2024-03-19T06:21:18.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d4f400640 1 -- 172.21.15.32:0/696575786 learned_addr learned my addr 172.21.15.32:0/696575786 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:18.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d47e00640 1 --2- 172.21.15.32:0/696575786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d500b0650 0x7f6d500b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d4fe00640 1 --2- 172.21.15.32:0/696575786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d5015ef90 0x7f6d501516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d4f400640 1 -- 172.21.15.32:0/696575786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d5015ef90 msgr2=0x7f6d501516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:18.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d4f400640 1 --2- 172.21.15.32:0/696575786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d5015ef90 0x7f6d501516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d4f400640 1 -- 172.21.15.32:0/696575786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d500b0650 msgr2=0x7f6d500b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:18.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d4f400640 1 --2- 172.21.15.32:0/696575786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d500b0650 0x7f6d500b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d4f400640 1 -- 172.21.15.32:0/696575786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d50156fe0 con 0x7f6d5006f440 2024-03-19T06:21:18.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d47e00640 1 --2- 172.21.15.32:0/696575786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d500b0650 0x7f6d500b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:18.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d4f400640 1 --2- 172.21.15.32:0/696575786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d5006f440 0x7f6d50156760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000c480 tx=0x7f6d4000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:18.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d47400640 1 -- 172.21.15.32:0/696575786 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40012830 con 0x7f6d5006f440 2024-03-19T06:21:18.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d47400640 1 -- 172.21.15.32:0/696575786 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d40017070 con 0x7f6d5006f440 2024-03-19T06:21:18.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d55200640 1 -- 172.21.15.32:0/696575786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d501572c0 con 0x7f6d5006f440 2024-03-19T06:21:18.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d47400640 1 -- 172.21.15.32:0/696575786 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40012c30 con 0x7f6d5006f440 2024-03-19T06:21:18.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d55200640 1 -- 172.21.15.32:0/696575786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5006bef0 con 0x7f6d5006f440 2024-03-19T06:21:18.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d55200640 1 -- 172.21.15.32:0/696575786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d50075090 con 0x7f6d5006f440 2024-03-19T06:21:18.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.068+0000 7f6d47400640 1 -- 172.21.15.32:0/696575786 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6d4001c460 con 0x7f6d5006f440 2024-03-19T06:21:18.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.072+0000 7f6d47400640 1 --2- 172.21.15.32:0/696575786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6d2c067690 0x7f6d2c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.072+0000 7f6d47400640 1 -- 172.21.15.32:0/696575786 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d40085700 con 0x7f6d5006f440 2024-03-19T06:21:18.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.072+0000 7f6d47e00640 1 --2- 172.21.15.32:0/696575786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6d2c067690 0x7f6d2c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.072+0000 7f6d47e00640 1 --2- 172.21.15.32:0/696575786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6d2c067690 0x7f6d2c069b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6d380ad000 tx=0x7f6d38008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:18.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.076+0000 7f6d47400640 1 -- 172.21.15.32:0/696575786 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f6d40056370 con 0x7f6d5006f440 2024-03-19T06:21:18.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.232+0000 7f6d55200640 1 -- 172.21.15.32:0/696575786 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d500aec40 con 0x7f6d2c067690 2024-03-19T06:21:18.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.240+0000 7f6d47400640 1 -- 172.21.15.32:0/696575786 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251836 (secure 0 0 0) 0x7f6d500aec40 con 0x7f6d2c067690 2024-03-19T06:21:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:18.238 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:21:18.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.244+0000 7f6d55200640 1 -- 172.21.15.32:0/696575786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6d2c067690 msgr2=0x7f6d2c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:18.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.244+0000 7f6d55200640 1 --2- 172.21.15.32:0/696575786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6d2c067690 0x7f6d2c069b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6d380ad000 tx=0x7f6d38008040 comp rx=0 tx=0).stop 2024-03-19T06:21:18.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.244+0000 7f6d55200640 1 -- 172.21.15.32:0/696575786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d5006f440 msgr2=0x7f6d50156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:18.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.244+0000 7f6d55200640 1 --2- 172.21.15.32:0/696575786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d5006f440 0x7f6d50156760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000c480 tx=0x7f6d4000c940 comp rx=0 tx=0).stop 2024-03-19T06:21:18.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.244+0000 7f6d55200640 1 -- 172.21.15.32:0/696575786 shutdown_connections 2024-03-19T06:21:18.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.244+0000 7f6d55200640 1 --2- 172.21.15.32:0/696575786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6d2c067690 0x7f6d2c069b50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.244+0000 7f6d55200640 1 --2- 172.21.15.32:0/696575786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d5015ef90 0x7f6d501516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.244+0000 7f6d55200640 1 --2- 172.21.15.32:0/696575786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d500b0650 0x7f6d500b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.244+0000 7f6d55200640 1 --2- 172.21.15.32:0/696575786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d5006f440 0x7f6d50156760 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.244+0000 7f6d55200640 1 -- 172.21.15.32:0/696575786 >> 172.21.15.32:0/696575786 conn(0x7f6d500d1610 msgr2=0x7f6d5015b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:18.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.244+0000 7f6d55200640 1 -- 172.21.15.32:0/696575786 shutdown_connections 2024-03-19T06:21:18.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.244+0000 7f6d55200640 1 -- 172.21.15.32:0/696575786 wait complete. 2024-03-19T06:21:18.256 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-03-19T06:21:17.922800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235788,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738932,"statfs":{"total":773094113280,"available":772852666368,"internally_reserved":0,"allocated":3022848,"data_stored":1800420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.506017"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439338+0000","last_change":"2024-03-19T06:21:09.452313+0000","last_active":"2024-03-19T06:21:10.439338+0000","last_peered":"2024-03-19T06:21:10.439338+0000","last_clean":"2024-03-19T06:21:10.439338+0000","last_became_active":"2024-03-19T06:21:09.452026+0000","last_became_peered":"2024-03-19T06:21:09.452026+0000","last_unstale":"2024-03-19T06:21:10.439338+0000","last_undegraded":"2024-03-19T06:21:10.439338+0000","last_fullsized":"2024-03-19T06:21:10.439338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:42.199087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431525+0000","last_change":"2024-03-19T06:21:09.451446+0000","last_active":"2024-03-19T06:21:10.431525+0000","last_peered":"2024-03-19T06:21:10.431525+0000","last_clean":"2024-03-19T06:21:10.431525+0000","last_became_active":"2024-03-19T06:21:09.451150+0000","last_became_peered":"2024-03-19T06:21:09.451150+0000","last_unstale":"2024-03-19T06:21:10.431525+0000","last_undegraded":"2024-03-19T06:21:10.431525+0000","last_fullsized":"2024-03-19T06:21:10.431525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:10:38.991785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367006+0000","last_change":"2024-03-19T06:21:09.456587+0000","last_active":"2024-03-19T06:21:11.367006+0000","last_peered":"2024-03-19T06:21:11.367006+0000","last_clean":"2024-03-19T06:21:11.367006+0000","last_became_active":"2024-03-19T06:21:09.454920+0000","last_became_peered":"2024-03-19T06:21:09.454920+0000","last_unstale":"2024-03-19T06:21:11.367006+0000","last_undegraded":"2024-03-19T06:21:11.367006+0000","last_fullsized":"2024-03-19T06:21:11.367006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:18:50.283686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438703+0000","last_change":"2024-03-19T06:21:09.440118+0000","last_active":"2024-03-19T06:21:10.438703+0000","last_peered":"2024-03-19T06:21:10.438703+0000","last_clean":"2024-03-19T06:21:10.438703+0000","last_became_active":"2024-03-19T06:21:09.434539+0000","last_became_peered":"2024-03-19T06:21:09.434539+0000","last_unstale":"2024-03-19T06:21:10.438703+0000","last_undegraded":"2024-03-19T06:21:10.438703+0000","last_fullsized":"2024-03-19T06:21:10.438703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:05:23.173353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438953+0000","last_change":"2024-03-19T06:21:09.443312+0000","last_active":"2024-03-19T06:21:10.438953+0000","last_peered":"2024-03-19T06:21:10.438953+0000","last_clean":"2024-03-19T06:21:10.438953+0000","last_became_active":"2024-03-19T06:21:09.442978+0000","last_became_peered":"2024-03-19T06:21:09.442978+0000","last_unstale":"2024-03-19T06:21:10.438953+0000","last_undegraded":"2024-03-19T06:21:10.438953+0000","last_fullsized":"2024-03-19T06:21:10.438953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:39:52.224305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437914+0000","last_change":"2024-03-19T06:21:09.450442+0000","last_active":"2024-03-19T06:21:10.437914+0000","last_peered":"2024-03-19T06:21:10.437914+0000","last_clean":"2024-03-19T06:21:10.437914+0000","last_became_active":"2024-03-19T06:21:09.450149+0000","last_became_peered":"2024-03-19T06:21:09.450149+0000","last_unstale":"2024-03-19T06:21:10.437914+0000","last_undegraded":"2024-03-19T06:21:10.437914+0000","last_fullsized":"2024-03-19T06:21:10.437914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:54:53.443608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438253+0000","last_change":"2024-03-19T06:21:09.450859+0000","last_active":"2024-03-19T06:21:10.438253+0000","last_peered":"2024-03-19T06:21:10.438253+0000","last_clean":"2024-03-19T06:21:10.438253+0000","last_became_active":"2024-03-19T06:21:09.450658+0000","last_became_peered":"2024-03-19T06:21:09.450658+0000","last_unstale":"2024-03-19T06:21:10.438253+0000","last_undegraded":"2024-03-19T06:21:10.438253+0000","last_fullsized":"2024-03-19T06:21:10.438253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:05:23.173353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367080+0000","last_change":"2024-03-19T06:21:09.445477+0000","last_active":"2024-03-19T06:21:11.367080+0000","last_peered":"2024-03-19T06:21:11.367080+0000","last_clean":"2024-03-19T06:21:11.367080+0000","last_became_active":"2024-03-19T06:21:09.445221+0000","last_became_peered":"2024-03-19T06:21:09.445221+0000","last_unstale":"2024-03-19T06:21:11.367080+0000","last_undegraded":"2024-03-19T06:21:11.367080+0000","last_fullsized":"2024-03-19T06:21:11.367080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:57:38.557074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439471+0000","last_change":"2024-03-19T06:21:09.450867+0000","last_active":"2024-03-19T06:21:10.439471+0000","last_peered":"2024-03-19T06:21:10.439471+0000","last_clean":"2024-03-19T06:21:10.439471+0000","last_became_active":"2024-03-19T06:21:09.449220+0000","last_became_peered":"2024-03-19T06:21:09.449220+0000","last_unstale":"2024-03-19T06:21:10.439471+0000","last_undegraded":"2024-03-19T06:21:10.439471+0000","last_fullsized":"2024-03-19T06:21:10.439471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:33:35.251645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367849+0000","last_change":"2024-03-19T06:21:09.446487+0000","last_active":"2024-03-19T06:21:11.367849+0000","last_peered":"2024-03-19T06:21:11.367849+0000","last_clean":"2024-03-19T06:21:11.367849+0000","last_became_active":"2024-03-19T06:21:09.445934+0000","last_became_peered":"2024-03-19T06:21:09.445934+0000","last_unstale":"2024-03-19T06:21:11.367849+0000","last_undegraded":"2024-03-19T06:21:11.367849+0000","last_fullsized":"2024-03-19T06:21:11.367849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:06.036992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367714+0000","last_change":"2024-03-19T06:21:09.446685+0000","last_active":"2024-03-19T06:21:11.367714+0000","last_peered":"2024-03-19T06:21:11.367714+0000","last_clean":"2024-03-19T06:21:11.367714+0000","last_became_active":"2024-03-19T06:21:09.446022+0000","last_became_peered":"2024-03-19T06:21:09.446022+0000","last_unstale":"2024-03-19T06:21:11.367714+0000","last_undegraded":"2024-03-19T06:21:11.367714+0000","last_fullsized":"2024-03-19T06:21:11.367714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:24:35.271835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.604348+0000","last_change":"2024-03-19T06:21:09.434969+0000","last_active":"2024-03-19T06:21:10.604348+0000","last_peered":"2024-03-19T06:21:10.604348+0000","last_clean":"2024-03-19T06:21:10.604348+0000","last_became_active":"2024-03-19T06:21:09.434675+0000","last_became_peered":"2024-03-19T06:21:09.434675+0000","last_unstale":"2024-03-19T06:21:10.604348+0000","last_undegraded":"2024-03-19T06:21:10.604348+0000","last_fullsized":"2024-03-19T06:21:10.604348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:10:44.620921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367625+0000","last_change":"2024-03-19T06:21:09.434060+0000","last_active":"2024-03-19T06:21:11.367625+0000","last_peered":"2024-03-19T06:21:11.367625+0000","last_clean":"2024-03-19T06:21:11.367625+0000","last_became_active":"2024-03-19T06:21:09.433679+0000","last_became_peered":"2024-03-19T06:21:09.433679+0000","last_unstale":"2024-03-19T06:21:11.367625+0000","last_undegraded":"2024-03-19T06:21:11.367625+0000","last_fullsized":"2024-03-19T06:21:11.367625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:12.509804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367088+0000","last_change":"2024-03-19T06:21:09.447522+0000","last_active":"2024-03-19T06:21:11.367088+0000","last_peered":"2024-03-19T06:21:11.367088+0000","last_clean":"2024-03-19T06:21:11.367088+0000","last_became_active":"2024-03-19T06:21:09.447175+0000","last_became_peered":"2024-03-19T06:21:09.447175+0000","last_unstale":"2024-03-19T06:21:11.367088+0000","last_undegraded":"2024-03-19T06:21:11.367088+0000","last_fullsized":"2024-03-19T06:21:11.367088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:55.809405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431070+0000","last_change":"2024-03-19T06:21:09.424398+0000","last_active":"2024-03-19T06:21:10.431070+0000","last_peered":"2024-03-19T06:21:10.431070+0000","last_clean":"2024-03-19T06:21:10.431070+0000","last_became_active":"2024-03-19T06:21:09.424002+0000","last_became_peered":"2024-03-19T06:21:09.424002+0000","last_unstale":"2024-03-19T06:21:10.431070+0000","last_undegraded":"2024-03-19T06:21:10.431070+0000","last_fullsized":"2024-03-19T06:21:10.431070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:33:13.994451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437639+0000","last_change":"2024-03-19T06:21:09.451772+0000","last_active":"2024-03-19T06:21:10.437639+0000","last_peered":"2024-03-19T06:21:10.437639+0000","last_clean":"2024-03-19T06:21:10.437639+0000","last_became_active":"2024-03-19T06:21:09.451466+0000","last_became_peered":"2024-03-19T06:21:09.451466+0000","last_unstale":"2024-03-19T06:21:10.437639+0000","last_undegraded":"2024-03-19T06:21:10.437639+0000","last_fullsized":"2024-03-19T06:21:10.437639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:06.036992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439498+0000","last_change":"2024-03-19T06:21:09.447850+0000","last_active":"2024-03-19T06:21:10.439498+0000","last_peered":"2024-03-19T06:21:10.439498+0000","last_clean":"2024-03-19T06:21:10.439498+0000","last_became_active":"2024-03-19T06:21:09.446058+0000","last_became_peered":"2024-03-19T06:21:09.446058+0000","last_unstale":"2024-03-19T06:21:10.439498+0000","last_undegraded":"2024-03-19T06:21:10.439498+0000","last_fullsized":"2024-03-19T06:21:10.439498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:42.199087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366229+0000","last_change":"2024-03-19T06:21:09.435147+0000","last_active":"2024-03-19T06:21:11.366229+0000","last_peered":"2024-03-19T06:21:11.366229+0000","last_clean":"2024-03-19T06:21:11.366229+0000","last_became_active":"2024-03-19T06:21:09.434845+0000","last_became_peered":"2024-03-19T06:21:09.434845+0000","last_unstale":"2024-03-19T06:21:11.366229+0000","last_undegraded":"2024-03-19T06:21:11.366229+0000","last_fullsized":"2024-03-19T06:21:11.366229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:27:52.195605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438335+0000","last_change":"2024-03-19T06:21:09.452917+0000","last_active":"2024-03-19T06:21:10.438335+0000","last_peered":"2024-03-19T06:21:10.438335+0000","last_clean":"2024-03-19T06:21:10.438335+0000","last_became_active":"2024-03-19T06:21:09.452649+0000","last_became_peered":"2024-03-19T06:21:09.452649+0000","last_unstale":"2024-03-19T06:21:10.438335+0000","last_undegraded":"2024-03-19T06:21:10.438335+0000","last_fullsized":"2024-03-19T06:21:10.438335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:21:16.347465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367714+0000","last_change":"2024-03-19T06:21:09.441874+0000","last_active":"2024-03-19T06:21:11.367714+0000","last_peered":"2024-03-19T06:21:11.367714+0000","last_clean":"2024-03-19T06:21:11.367714+0000","last_became_active":"2024-03-19T06:21:09.441614+0000","last_became_peered":"2024-03-19T06:21:09.441614+0000","last_unstale":"2024-03-19T06:21:11.367714+0000","last_undegraded":"2024-03-19T06:21:11.367714+0000","last_fullsized":"2024-03-19T06:21:11.367714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:48:33.849430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366850+0000","last_change":"2024-03-19T06:21:09.442717+0000","last_active":"2024-03-19T06:21:11.366850+0000","last_peered":"2024-03-19T06:21:11.366850+0000","last_clean":"2024-03-19T06:21:11.366850+0000","last_became_active":"2024-03-19T06:21:09.441979+0000","last_became_peered":"2024-03-19T06:21:09.441979+0000","last_unstale":"2024-03-19T06:21:11.366850+0000","last_undegraded":"2024-03-19T06:21:11.366850+0000","last_fullsized":"2024-03-19T06:21:11.366850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:24:35.271835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438065+0000","last_change":"2024-03-19T06:21:09.444519+0000","last_active":"2024-03-19T06:21:10.438065+0000","last_peered":"2024-03-19T06:21:10.438065+0000","last_clean":"2024-03-19T06:21:10.438065+0000","last_became_active":"2024-03-19T06:21:09.444304+0000","last_became_peered":"2024-03-19T06:21:09.444304+0000","last_unstale":"2024-03-19T06:21:10.438065+0000","last_undegraded":"2024-03-19T06:21:10.438065+0000","last_fullsized":"2024-03-19T06:21:10.438065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:29:55.294290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367627+0000","last_change":"2024-03-19T06:21:09.439225+0000","last_active":"2024-03-19T06:21:11.367627+0000","last_peered":"2024-03-19T06:21:11.367627+0000","last_clean":"2024-03-19T06:21:11.367627+0000","last_became_active":"2024-03-19T06:21:09.437400+0000","last_became_peered":"2024-03-19T06:21:09.437400+0000","last_unstale":"2024-03-19T06:21:11.367627+0000","last_undegraded":"2024-03-19T06:21:11.367627+0000","last_fullsized":"2024-03-19T06:21:11.367627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:40:56.782739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437740+0000","last_change":"2024-03-19T06:21:09.438758+0000","last_active":"2024-03-19T06:21:10.437740+0000","last_peered":"2024-03-19T06:21:10.437740+0000","last_clean":"2024-03-19T06:21:10.437740+0000","last_became_active":"2024-03-19T06:21:09.438493+0000","last_became_peered":"2024-03-19T06:21:09.438493+0000","last_unstale":"2024-03-19T06:21:10.437740+0000","last_undegraded":"2024-03-19T06:21:10.437740+0000","last_fullsized":"2024-03-19T06:21:10.437740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:10:38.991785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.368270+0000","last_change":"2024-03-19T06:21:09.442133+0000","last_active":"2024-03-19T06:21:11.368270+0000","last_peered":"2024-03-19T06:21:11.368270+0000","last_clean":"2024-03-19T06:21:11.368270+0000","last_became_active":"2024-03-19T06:21:09.438450+0000","last_became_peered":"2024-03-19T06:21:09.438450+0000","last_unstale":"2024-03-19T06:21:11.368270+0000","last_undegraded":"2024-03-19T06:21:11.368270+0000","last_fullsized":"2024-03-19T06:21:11.368270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:38:39.537525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367913+0000","last_change":"2024-03-19T06:21:09.452119+0000","last_active":"2024-03-19T06:21:11.367913+0000","last_peered":"2024-03-19T06:21:11.367913+0000","last_clean":"2024-03-19T06:21:11.367913+0000","last_became_active":"2024-03-19T06:21:09.446514+0000","last_became_peered":"2024-03-19T06:21:09.446514+0000","last_unstale":"2024-03-19T06:21:11.367913+0000","last_undegraded":"2024-03-19T06:21:11.367913+0000","last_fullsized":"2024-03-19T06:21:11.367913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:10:38.991785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431419+0000","last_change":"2024-03-19T06:21:09.431512+0000","last_active":"2024-03-19T06:21:10.431419+0000","last_peered":"2024-03-19T06:21:10.431419+0000","last_clean":"2024-03-19T06:21:10.431419+0000","last_became_active":"2024-03-19T06:21:09.431222+0000","last_became_peered":"2024-03-19T06:21:09.431222+0000","last_unstale":"2024-03-19T06:21:10.431419+0000","last_undegraded":"2024-03-19T06:21:10.431419+0000","last_fullsized":"2024-03-19T06:21:10.431419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:06.036992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.368156+0000","last_change":"2024-03-19T06:21:09.439110+0000","last_active":"2024-03-19T06:21:11.368156+0000","last_peered":"2024-03-19T06:21:11.368156+0000","last_clean":"2024-03-19T06:21:11.368156+0000","last_became_active":"2024-03-19T06:21:09.437439+0000","last_became_peered":"2024-03-19T06:21:09.437439+0000","last_unstale":"2024-03-19T06:21:11.368156+0000","last_undegraded":"2024-03-19T06:21:11.368156+0000","last_fullsized":"2024-03-19T06:21:11.368156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:54:31.028271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366871+0000","last_change":"2024-03-19T06:21:09.442438+0000","last_active":"2024-03-19T06:21:11.366871+0000","last_peered":"2024-03-19T06:21:11.366871+0000","last_clean":"2024-03-19T06:21:11.366871+0000","last_became_active":"2024-03-19T06:21:09.441595+0000","last_became_peered":"2024-03-19T06:21:09.441595+0000","last_unstale":"2024-03-19T06:21:11.366871+0000","last_undegraded":"2024-03-19T06:21:11.366871+0000","last_fullsized":"2024-03-19T06:21:11.366871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:54:33.924115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438209+0000","last_change":"2024-03-19T06:21:09.445182+0000","last_active":"2024-03-19T06:21:10.438209+0000","last_peered":"2024-03-19T06:21:10.438209+0000","last_clean":"2024-03-19T06:21:10.438209+0000","last_became_active":"2024-03-19T06:21:09.442331+0000","last_became_peered":"2024-03-19T06:21:09.442331+0000","last_unstale":"2024-03-19T06:21:10.438209+0000","last_undegraded":"2024-03-19T06:21:10.438209+0000","last_fullsized":"2024-03-19T06:21:10.438209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:20.797571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366223+0000","last_change":"2024-03-19T06:21:09.432846+0000","last_active":"2024-03-19T06:21:11.366223+0000","last_peered":"2024-03-19T06:21:11.366223+0000","last_clean":"2024-03-19T06:21:11.366223+0000","last_became_active":"2024-03-19T06:21:09.432568+0000","last_became_peered":"2024-03-19T06:21:09.432568+0000","last_unstale":"2024-03-19T06:21:11.366223+0000","last_undegraded":"2024-03-19T06:21:11.366223+0000","last_fullsized":"2024-03-19T06:21:11.366223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:42.809555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367540+0000","last_change":"2024-03-19T06:21:09.455461+0000","last_active":"2024-03-19T06:21:11.367540+0000","last_peered":"2024-03-19T06:21:11.367540+0000","last_clean":"2024-03-19T06:21:11.367540+0000","last_became_active":"2024-03-19T06:21:09.452616+0000","last_became_peered":"2024-03-19T06:21:09.452616+0000","last_unstale":"2024-03-19T06:21:11.367540+0000","last_undegraded":"2024-03-19T06:21:11.367540+0000","last_fullsized":"2024-03-19T06:21:11.367540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:55.809405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.604179+0000","last_change":"2024-03-19T06:21:09.429726+0000","last_active":"2024-03-19T06:21:10.604179+0000","last_peered":"2024-03-19T06:21:10.604179+0000","last_clean":"2024-03-19T06:21:10.604179+0000","last_became_active":"2024-03-19T06:21:09.428690+0000","last_became_peered":"2024-03-19T06:21:09.428690+0000","last_unstale":"2024-03-19T06:21:10.604179+0000","last_undegraded":"2024-03-19T06:21:10.604179+0000","last_fullsized":"2024-03-19T06:21:10.604179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:41:23.004327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367784+0000","last_change":"2024-03-19T06:21:08.435558+0000","last_active":"2024-03-19T06:21:11.367784+0000","last_peered":"2024-03-19T06:21:11.367784+0000","last_clean":"2024-03-19T06:21:11.367784+0000","last_became_active":"2024-03-19T06:21:08.435230+0000","last_became_peered":"2024-03-19T06:21:08.435230+0000","last_unstale":"2024-03-19T06:21:11.367784+0000","last_undegraded":"2024-03-19T06:21:11.367784+0000","last_fullsized":"2024-03-19T06:21:11.367784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:57:49.073834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367078+0000","last_change":"2024-03-19T06:21:09.449204+0000","last_active":"2024-03-19T06:21:11.367078+0000","last_peered":"2024-03-19T06:21:11.367078+0000","last_clean":"2024-03-19T06:21:11.367078+0000","last_became_active":"2024-03-19T06:21:09.448927+0000","last_became_peered":"2024-03-19T06:21:09.448927+0000","last_unstale":"2024-03-19T06:21:11.367078+0000","last_undegraded":"2024-03-19T06:21:11.367078+0000","last_fullsized":"2024-03-19T06:21:11.367078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:33:13.994451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367497+0000","last_change":"2024-03-19T06:21:08.439097+0000","last_active":"2024-03-19T06:21:11.367497+0000","last_peered":"2024-03-19T06:21:11.367497+0000","last_clean":"2024-03-19T06:21:11.367497+0000","last_became_active":"2024-03-19T06:21:08.438783+0000","last_became_peered":"2024-03-19T06:21:08.438783+0000","last_unstale":"2024-03-19T06:21:11.367497+0000","last_undegraded":"2024-03-19T06:21:11.367497+0000","last_fullsized":"2024-03-19T06:21:11.367497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:37.056055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367737+0000","last_change":"2024-03-19T06:21:08.427804+0000","last_active":"2024-03-19T06:21:11.367737+0000","last_peered":"2024-03-19T06:21:11.367737+0000","last_clean":"2024-03-19T06:21:11.367737+0000","last_became_active":"2024-03-19T06:21:08.427129+0000","last_became_peered":"2024-03-19T06:21:08.427129+0000","last_unstale":"2024-03-19T06:21:11.367737+0000","last_undegraded":"2024-03-19T06:21:11.367737+0000","last_fullsized":"2024-03-19T06:21:11.367737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:13:25.373226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367168+0000","last_change":"2024-03-19T06:21:09.449579+0000","last_active":"2024-03-19T06:21:11.367168+0000","last_peered":"2024-03-19T06:21:11.367168+0000","last_clean":"2024-03-19T06:21:11.367168+0000","last_became_active":"2024-03-19T06:21:09.448892+0000","last_became_peered":"2024-03-19T06:21:09.448892+0000","last_unstale":"2024-03-19T06:21:11.367168+0000","last_undegraded":"2024-03-19T06:21:11.367168+0000","last_fullsized":"2024-03-19T06:21:11.367168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:37:25.985856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437736+0000","last_change":"2024-03-19T06:21:08.441838+0000","last_active":"2024-03-19T06:21:10.437736+0000","last_peered":"2024-03-19T06:21:10.437736+0000","last_clean":"2024-03-19T06:21:10.437736+0000","last_became_active":"2024-03-19T06:21:08.441169+0000","last_became_peered":"2024-03-19T06:21:08.441169+0000","last_unstale":"2024-03-19T06:21:10.437736+0000","last_undegraded":"2024-03-19T06:21:10.437736+0000","last_fullsized":"2024-03-19T06:21:10.437736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:32:24.190836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431070+0000","last_change":"2024-03-19T06:21:09.430021+0000","last_active":"2024-03-19T06:21:10.431070+0000","last_peered":"2024-03-19T06:21:10.431070+0000","last_clean":"2024-03-19T06:21:10.431070+0000","last_became_active":"2024-03-19T06:21:09.429679+0000","last_became_peered":"2024-03-19T06:21:09.429679+0000","last_unstale":"2024-03-19T06:21:10.431070+0000","last_undegraded":"2024-03-19T06:21:10.431070+0000","last_fullsized":"2024-03-19T06:21:10.431070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:55.809405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367681+0000","last_change":"2024-03-19T06:21:08.447659+0000","last_active":"2024-03-19T06:21:11.367681+0000","last_peered":"2024-03-19T06:21:11.367681+0000","last_clean":"2024-03-19T06:21:11.367681+0000","last_became_active":"2024-03-19T06:21:08.447310+0000","last_became_peered":"2024-03-19T06:21:08.447310+0000","last_unstale":"2024-03-19T06:21:11.367681+0000","last_undegraded":"2024-03-19T06:21:11.367681+0000","last_fullsized":"2024-03-19T06:21:11.367681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:22.147438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439182+0000","last_change":"2024-03-19T06:21:09.445774+0000","last_active":"2024-03-19T06:21:10.439182+0000","last_peered":"2024-03-19T06:21:10.439182+0000","last_clean":"2024-03-19T06:21:10.439182+0000","last_became_active":"2024-03-19T06:21:09.445517+0000","last_became_peered":"2024-03-19T06:21:09.445517+0000","last_unstale":"2024-03-19T06:21:10.439182+0000","last_undegraded":"2024-03-19T06:21:10.439182+0000","last_fullsized":"2024-03-19T06:21:10.439182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:14:58.974751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439282+0000","last_change":"2024-03-19T06:21:08.447265+0000","last_active":"2024-03-19T06:21:10.439282+0000","last_peered":"2024-03-19T06:21:10.439282+0000","last_clean":"2024-03-19T06:21:10.439282+0000","last_became_active":"2024-03-19T06:21:08.447009+0000","last_became_peered":"2024-03-19T06:21:08.447009+0000","last_unstale":"2024-03-19T06:21:10.439282+0000","last_undegraded":"2024-03-19T06:21:10.439282+0000","last_fullsized":"2024-03-19T06:21:10.439282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:22.147438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367597+0000","last_change":"2024-03-19T06:21:09.453099+0000","last_active":"2024-03-19T06:21:11.367597+0000","last_peered":"2024-03-19T06:21:11.367597+0000","last_clean":"2024-03-19T06:21:11.367597+0000","last_became_active":"2024-03-19T06:21:09.448991+0000","last_became_peered":"2024-03-19T06:21:09.448991+0000","last_unstale":"2024-03-19T06:21:11.367597+0000","last_undegraded":"2024-03-19T06:21:11.367597+0000","last_fullsized":"2024-03-19T06:21:11.367597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:10:38.991785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431373+0000","last_change":"2024-03-19T06:21:08.439829+0000","last_active":"2024-03-19T06:21:10.431373+0000","last_peered":"2024-03-19T06:21:10.431373+0000","last_clean":"2024-03-19T06:21:10.431373+0000","last_became_active":"2024-03-19T06:21:08.439454+0000","last_became_peered":"2024-03-19T06:21:08.439454+0000","last_unstale":"2024-03-19T06:21:10.431373+0000","last_undegraded":"2024-03-19T06:21:10.431373+0000","last_fullsized":"2024-03-19T06:21:10.431373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:41.802412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.604359+0000","last_change":"2024-03-19T06:21:09.449268+0000","last_active":"2024-03-19T06:21:10.604359+0000","last_peered":"2024-03-19T06:21:10.604359+0000","last_clean":"2024-03-19T06:21:10.604359+0000","last_became_active":"2024-03-19T06:21:09.448827+0000","last_became_peered":"2024-03-19T06:21:09.448827+0000","last_unstale":"2024-03-19T06:21:10.604359+0000","last_undegraded":"2024-03-19T06:21:10.604359+0000","last_fullsized":"2024-03-19T06:21:10.604359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:18:03.542251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367525+0000","last_change":"2024-03-19T06:21:08.445760+0000","last_active":"2024-03-19T06:21:11.367525+0000","last_peered":"2024-03-19T06:21:11.367525+0000","last_clean":"2024-03-19T06:21:11.367525+0000","last_became_active":"2024-03-19T06:21:08.445560+0000","last_became_peered":"2024-03-19T06:21:08.445560+0000","last_unstale":"2024-03-19T06:21:11.367525+0000","last_undegraded":"2024-03-19T06:21:11.367525+0000","last_fullsized":"2024-03-19T06:21:11.367525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:32:24.190836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438055+0000","last_change":"2024-03-19T06:21:09.447310+0000","last_active":"2024-03-19T06:21:10.438055+0000","last_peered":"2024-03-19T06:21:10.438055+0000","last_clean":"2024-03-19T06:21:10.438055+0000","last_became_active":"2024-03-19T06:21:09.446811+0000","last_became_peered":"2024-03-19T06:21:09.446811+0000","last_unstale":"2024-03-19T06:21:10.438055+0000","last_undegraded":"2024-03-19T06:21:10.438055+0000","last_fullsized":"2024-03-19T06:21:10.438055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:29:55.294290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367197+0000","last_change":"2024-03-19T06:21:08.437505+0000","last_active":"2024-03-19T06:21:11.367197+0000","last_peered":"2024-03-19T06:21:11.367197+0000","last_clean":"2024-03-19T06:21:11.367197+0000","last_became_active":"2024-03-19T06:21:08.437190+0000","last_became_peered":"2024-03-19T06:21:08.437190+0000","last_unstale":"2024-03-19T06:21:11.367197+0000","last_undegraded":"2024-03-19T06:21:11.367197+0000","last_fullsized":"2024-03-19T06:21:11.367197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:53:34.745415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366717+0000","last_change":"2024-03-19T06:21:09.447509+0000","last_active":"2024-03-19T06:21:11.366717+0000","last_peered":"2024-03-19T06:21:11.366717+0000","last_clean":"2024-03-19T06:21:11.366717+0000","last_became_active":"2024-03-19T06:21:09.447154+0000","last_became_peered":"2024-03-19T06:21:09.447154+0000","last_unstale":"2024-03-19T06:21:11.366717+0000","last_undegraded":"2024-03-19T06:21:11.366717+0000","last_fullsized":"2024-03-19T06:21:11.366717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:15:19.406708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438312+0000","last_change":"2024-03-19T06:21:08.440830+0000","last_active":"2024-03-19T06:21:10.438312+0000","last_peered":"2024-03-19T06:21:10.438312+0000","last_clean":"2024-03-19T06:21:10.438312+0000","last_became_active":"2024-03-19T06:21:08.439995+0000","last_became_peered":"2024-03-19T06:21:08.439995+0000","last_unstale":"2024-03-19T06:21:10.438312+0000","last_undegraded":"2024-03-19T06:21:10.438312+0000","last_fullsized":"2024-03-19T06:21:10.438312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:56.274578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439288+0000","last_change":"2024-03-19T06:21:09.442975+0000","last_active":"2024-03-19T06:21:10.439288+0000","last_peered":"2024-03-19T06:21:10.439288+0000","last_clean":"2024-03-19T06:21:10.439288+0000","last_became_active":"2024-03-19T06:21:09.442638+0000","last_became_peered":"2024-03-19T06:21:09.442638+0000","last_unstale":"2024-03-19T06:21:10.439288+0000","last_undegraded":"2024-03-19T06:21:10.439288+0000","last_fullsized":"2024-03-19T06:21:10.439288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:14:58.974751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367363+0000","last_change":"2024-03-19T06:21:08.439829+0000","last_active":"2024-03-19T06:21:11.367363+0000","last_peered":"2024-03-19T06:21:11.367363+0000","last_clean":"2024-03-19T06:21:11.367363+0000","last_became_active":"2024-03-19T06:21:08.439524+0000","last_became_peered":"2024-03-19T06:21:08.439524+0000","last_unstale":"2024-03-19T06:21:11.367363+0000","last_undegraded":"2024-03-19T06:21:11.367363+0000","last_fullsized":"2024-03-19T06:21:11.367363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:56.274578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367453+0000","last_change":"2024-03-19T06:21:09.454721+0000","last_active":"2024-03-19T06:21:11.367453+0000","last_peered":"2024-03-19T06:21:11.367453+0000","last_clean":"2024-03-19T06:21:11.367453+0000","last_became_active":"2024-03-19T06:21:09.451915+0000","last_became_peered":"2024-03-19T06:21:09.451915+0000","last_unstale":"2024-03-19T06:21:11.367453+0000","last_undegraded":"2024-03-19T06:21:11.367453+0000","last_fullsized":"2024-03-19T06:21:11.367453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:33:13.994451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.365855+0000","last_change":"2024-03-19T06:21:08.434264+0000","last_active":"2024-03-19T06:21:11.365855+0000","last_peered":"2024-03-19T06:21:11.365855+0000","last_clean":"2024-03-19T06:21:11.365855+0000","last_became_active":"2024-03-19T06:21:08.433960+0000","last_became_peered":"2024-03-19T06:21:08.433960+0000","last_unstale":"2024-03-19T06:21:11.365855+0000","last_undegraded":"2024-03-19T06:21:11.365855+0000","last_fullsized":"2024-03-19T06:21:11.365855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:14:50.420085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438491+0000","last_change":"2024-03-19T06:21:09.444684+0000","last_active":"2024-03-19T06:21:10.438491+0000","last_peered":"2024-03-19T06:21:10.438491+0000","last_clean":"2024-03-19T06:21:10.438491+0000","last_became_active":"2024-03-19T06:21:09.444451+0000","last_became_peered":"2024-03-19T06:21:09.444451+0000","last_unstale":"2024-03-19T06:21:10.438491+0000","last_undegraded":"2024-03-19T06:21:10.438491+0000","last_fullsized":"2024-03-19T06:21:10.438491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:42:31.622101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.604178+0000","last_change":"2024-03-19T06:21:08.437032+0000","last_active":"2024-03-19T06:21:10.604178+0000","last_peered":"2024-03-19T06:21:10.604178+0000","last_clean":"2024-03-19T06:21:10.604178+0000","last_became_active":"2024-03-19T06:21:08.436518+0000","last_became_peered":"2024-03-19T06:21:08.436518+0000","last_unstale":"2024-03-19T06:21:10.604178+0000","last_undegraded":"2024-03-19T06:21:10.604178+0000","last_fullsized":"2024-03-19T06:21:10.604178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:37:38.410985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438943+0000","last_change":"2024-03-19T06:21:09.454018+0000","last_active":"2024-03-19T06:21:10.438943+0000","last_peered":"2024-03-19T06:21:10.438943+0000","last_clean":"2024-03-19T06:21:10.438943+0000","last_became_active":"2024-03-19T06:21:09.453715+0000","last_became_peered":"2024-03-19T06:21:09.453715+0000","last_unstale":"2024-03-19T06:21:10.438943+0000","last_undegraded":"2024-03-19T06:21:10.438943+0000","last_fullsized":"2024-03-19T06:21:10.438943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:08:07.201487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366369+0000","last_change":"2024-03-19T06:21:08.426349+0000","last_active":"2024-03-19T06:21:11.366369+0000","last_peered":"2024-03-19T06:21:11.366369+0000","last_clean":"2024-03-19T06:21:11.366369+0000","last_became_active":"2024-03-19T06:21:08.426057+0000","last_became_peered":"2024-03-19T06:21:08.426057+0000","last_unstale":"2024-03-19T06:21:11.366369+0000","last_undegraded":"2024-03-19T06:21:11.366369+0000","last_fullsized":"2024-03-19T06:21:11.366369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:56.274578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439569+0000","last_change":"2024-03-19T06:21:09.453273+0000","last_active":"2024-03-19T06:21:10.439569+0000","last_peered":"2024-03-19T06:21:10.439569+0000","last_clean":"2024-03-19T06:21:10.439569+0000","last_became_active":"2024-03-19T06:21:09.453008+0000","last_became_peered":"2024-03-19T06:21:09.453008+0000","last_unstale":"2024-03-19T06:21:10.439569+0000","last_undegraded":"2024-03-19T06:21:10.439569+0000","last_fullsized":"2024-03-19T06:21:10.439569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:06:46.783271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431445+0000","last_change":"2024-03-19T06:21:08.436955+0000","last_active":"2024-03-19T06:21:10.431445+0000","last_peered":"2024-03-19T06:21:10.431445+0000","last_clean":"2024-03-19T06:21:10.431445+0000","last_became_active":"2024-03-19T06:21:08.436695+0000","last_became_peered":"2024-03-19T06:21:08.436695+0000","last_unstale":"2024-03-19T06:21:10.431445+0000","last_undegraded":"2024-03-19T06:21:10.431445+0000","last_fullsized":"2024-03-19T06:21:10.431445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:27:51.188461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438972+0000","last_change":"2024-03-19T06:21:09.440792+0000","last_active":"2024-03-19T06:21:10.438972+0000","last_peered":"2024-03-19T06:21:10.438972+0000","last_clean":"2024-03-19T06:21:10.438972+0000","last_became_active":"2024-03-19T06:21:09.433674+0000","last_became_peered":"2024-03-19T06:21:09.433674+0000","last_unstale":"2024-03-19T06:21:10.438972+0000","last_undegraded":"2024-03-19T06:21:10.438972+0000","last_fullsized":"2024-03-19T06:21:10.438972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:08:07.201487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366099+0000","last_change":"2024-03-19T06:21:08.437235+0000","last_active":"2024-03-19T06:21:11.366099+0000","last_peered":"2024-03-19T06:21:11.366099+0000","last_clean":"2024-03-19T06:21:11.366099+0000","last_became_active":"2024-03-19T06:21:08.436874+0000","last_became_peered":"2024-03-19T06:21:08.436874+0000","last_unstale":"2024-03-19T06:21:11.366099+0000","last_undegraded":"2024-03-19T06:21:11.366099+0000","last_fullsized":"2024-03-19T06:21:11.366099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:37.056055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438152+0000","last_change":"2024-03-19T06:21:09.452749+0000","last_active":"2024-03-19T06:21:10.438152+0000","last_peered":"2024-03-19T06:21:10.438152+0000","last_clean":"2024-03-19T06:21:10.438152+0000","last_became_active":"2024-03-19T06:21:09.452386+0000","last_became_peered":"2024-03-19T06:21:09.452386+0000","last_unstale":"2024-03-19T06:21:10.438152+0000","last_undegraded":"2024-03-19T06:21:10.438152+0000","last_fullsized":"2024-03-19T06:21:10.438152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:20.797571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438011+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:21:10.438011+0000","last_peered":"2024-03-19T06:21:10.438011+0000","last_clean":"2024-03-19T06:21:10.438011+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:21:10.438011+0000","last_undegraded":"2024-03-19T06:21:10.438011+0000","last_fullsized":"2024-03-19T06:21:10.438011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439152+0000","last_change":"2024-03-19T06:21:08.436525+0000","last_active":"2024-03-19T06:21:10.439152+0000","last_peered":"2024-03-19T06:21:10.439152+0000","last_clean":"2024-03-19T06:21:10.439152+0000","last_became_active":"2024-03-19T06:21:08.434902+0000","last_became_peered":"2024-03-19T06:21:08.434902+0000","last_unstale":"2024-03-19T06:21:10.439152+0000","last_undegraded":"2024-03-19T06:21:10.439152+0000","last_fullsized":"2024-03-19T06:21:10.439152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:12:55.201245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367569+0000","last_change":"2024-03-19T06:21:09.446879+0000","last_active":"2024-03-19T06:21:11.367569+0000","last_peered":"2024-03-19T06:21:11.367569+0000","last_clean":"2024-03-19T06:21:11.367569+0000","last_became_active":"2024-03-19T06:21:09.446625+0000","last_became_peered":"2024-03-19T06:21:09.446625+0000","last_unstale":"2024-03-19T06:21:11.367569+0000","last_undegraded":"2024-03-19T06:21:11.367569+0000","last_fullsized":"2024-03-19T06:21:11.367569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:26:13.910343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437951+0000","last_change":"2024-03-19T06:21:08.441736+0000","last_active":"2024-03-19T06:21:10.437951+0000","last_peered":"2024-03-19T06:21:10.437951+0000","last_clean":"2024-03-19T06:21:10.437951+0000","last_became_active":"2024-03-19T06:21:08.441408+0000","last_became_peered":"2024-03-19T06:21:08.441408+0000","last_unstale":"2024-03-19T06:21:10.437951+0000","last_undegraded":"2024-03-19T06:21:10.437951+0000","last_fullsized":"2024-03-19T06:21:10.437951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:27:51.188461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366478+0000","last_change":"2024-03-19T06:21:09.435944+0000","last_active":"2024-03-19T06:21:11.366478+0000","last_peered":"2024-03-19T06:21:11.366478+0000","last_clean":"2024-03-19T06:21:11.366478+0000","last_became_active":"2024-03-19T06:21:09.435521+0000","last_became_peered":"2024-03-19T06:21:09.435521+0000","last_unstale":"2024-03-19T06:21:11.366478+0000","last_undegraded":"2024-03-19T06:21:11.366478+0000","last_fullsized":"2024-03-19T06:21:11.366478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:30:08.169277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366255+0000","last_change":"2024-03-19T06:21:08.428501+0000","last_active":"2024-03-19T06:21:11.366255+0000","last_peered":"2024-03-19T06:21:11.366255+0000","last_clean":"2024-03-19T06:21:11.366255+0000","last_became_active":"2024-03-19T06:21:08.428240+0000","last_became_peered":"2024-03-19T06:21:08.428240+0000","last_unstale":"2024-03-19T06:21:11.366255+0000","last_undegraded":"2024-03-19T06:21:11.366255+0000","last_fullsized":"2024-03-19T06:21:11.366255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:12:55.201245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431078+0000","last_change":"2024-03-19T06:21:09.437604+0000","last_active":"2024-03-19T06:21:10.431078+0000","last_peered":"2024-03-19T06:21:10.431078+0000","last_clean":"2024-03-19T06:21:10.431078+0000","last_became_active":"2024-03-19T06:21:09.436485+0000","last_became_peered":"2024-03-19T06:21:09.436485+0000","last_unstale":"2024-03-19T06:21:10.431078+0000","last_undegraded":"2024-03-19T06:21:10.431078+0000","last_fullsized":"2024-03-19T06:21:10.431078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:48:33.849430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438404+0000","last_change":"2024-03-19T06:21:08.435260+0000","last_active":"2024-03-19T06:21:10.438404+0000","last_peered":"2024-03-19T06:21:10.438404+0000","last_clean":"2024-03-19T06:21:10.438404+0000","last_became_active":"2024-03-19T06:21:08.434842+0000","last_became_peered":"2024-03-19T06:21:08.434842+0000","last_unstale":"2024-03-19T06:21:10.438404+0000","last_undegraded":"2024-03-19T06:21:10.438404+0000","last_fullsized":"2024-03-19T06:21:10.438404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:37.056055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.604158+0000","last_change":"2024-03-19T06:21:09.449799+0000","last_active":"2024-03-19T06:21:10.604158+0000","last_peered":"2024-03-19T06:21:10.604158+0000","last_clean":"2024-03-19T06:21:10.604158+0000","last_became_active":"2024-03-19T06:21:09.448305+0000","last_became_peered":"2024-03-19T06:21:09.448305+0000","last_unstale":"2024-03-19T06:21:10.604158+0000","last_undegraded":"2024-03-19T06:21:10.604158+0000","last_fullsized":"2024-03-19T06:21:10.604158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:34:32.017603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431407+0000","last_change":"2024-03-19T06:21:08.429361+0000","last_active":"2024-03-19T06:21:10.431407+0000","last_peered":"2024-03-19T06:21:10.431407+0000","last_clean":"2024-03-19T06:21:10.431407+0000","last_became_active":"2024-03-19T06:21:08.429138+0000","last_became_peered":"2024-03-19T06:21:08.429138+0000","last_unstale":"2024-03-19T06:21:10.431407+0000","last_undegraded":"2024-03-19T06:21:10.431407+0000","last_fullsized":"2024-03-19T06:21:10.431407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:32:24.190836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439077+0000","last_change":"2024-03-19T06:21:09.438743+0000","last_active":"2024-03-19T06:21:10.439077+0000","last_peered":"2024-03-19T06:21:10.439077+0000","last_clean":"2024-03-19T06:21:10.439077+0000","last_became_active":"2024-03-19T06:21:09.433760+0000","last_became_peered":"2024-03-19T06:21:09.433760+0000","last_unstale":"2024-03-19T06:21:10.439077+0000","last_undegraded":"2024-03-19T06:21:10.439077+0000","last_fullsized":"2024-03-19T06:21:10.439077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:39:52.224305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438397+0000","last_change":"2024-03-19T06:21:08.443003+0000","last_active":"2024-03-19T06:21:10.438397+0000","last_peered":"2024-03-19T06:21:10.438397+0000","last_clean":"2024-03-19T06:21:10.438397+0000","last_became_active":"2024-03-19T06:21:08.442704+0000","last_became_peered":"2024-03-19T06:21:08.442704+0000","last_unstale":"2024-03-19T06:21:10.438397+0000","last_undegraded":"2024-03-19T06:21:10.438397+0000","last_fullsized":"2024-03-19T06:21:10.438397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:55:30.030272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431303+0000","last_change":"2024-03-19T06:21:09.440061+0000","last_active":"2024-03-19T06:21:10.431303+0000","last_peered":"2024-03-19T06:21:10.431303+0000","last_clean":"2024-03-19T06:21:10.431303+0000","last_became_active":"2024-03-19T06:21:09.439732+0000","last_became_peered":"2024-03-19T06:21:09.439732+0000","last_unstale":"2024-03-19T06:21:10.431303+0000","last_undegraded":"2024-03-19T06:21:10.431303+0000","last_fullsized":"2024-03-19T06:21:10.431303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:24:35.271835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.974593+0000","last_change":"2024-03-19T06:21:08.443381+0000","last_active":"2024-03-19T06:21:10.974593+0000","last_peered":"2024-03-19T06:21:10.974593+0000","last_clean":"2024-03-19T06:21:10.974593+0000","last_became_active":"2024-03-19T06:21:08.443148+0000","last_became_peered":"2024-03-19T06:21:08.443148+0000","last_unstale":"2024-03-19T06:21:10.974593+0000","last_undegraded":"2024-03-19T06:21:10.974593+0000","last_fullsized":"2024-03-19T06:21:10.974593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:22.147438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.368263+0000","last_change":"2024-03-19T06:21:09.444826+0000","last_active":"2024-03-19T06:21:11.368263+0000","last_peered":"2024-03-19T06:21:11.368263+0000","last_clean":"2024-03-19T06:21:11.368263+0000","last_became_active":"2024-03-19T06:21:09.444361+0000","last_became_peered":"2024-03-19T06:21:09.444361+0000","last_unstale":"2024-03-19T06:21:11.368263+0000","last_undegraded":"2024-03-19T06:21:11.368263+0000","last_fullsized":"2024-03-19T06:21:11.368263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:51:27.900040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367795+0000","last_change":"2024-03-19T06:21:08.447890+0000","last_active":"2024-03-19T06:21:11.367795+0000","last_peered":"2024-03-19T06:21:11.367795+0000","last_clean":"2024-03-19T06:21:11.367795+0000","last_became_active":"2024-03-19T06:21:08.447369+0000","last_became_peered":"2024-03-19T06:21:08.447369+0000","last_unstale":"2024-03-19T06:21:11.367795+0000","last_undegraded":"2024-03-19T06:21:11.367795+0000","last_fullsized":"2024-03-19T06:21:11.367795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:41.802412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367114+0000","last_change":"2024-03-19T06:21:09.448599+0000","last_active":"2024-03-19T06:21:11.367114+0000","last_peered":"2024-03-19T06:21:11.367114+0000","last_clean":"2024-03-19T06:21:11.367114+0000","last_became_active":"2024-03-19T06:21:09.448321+0000","last_became_peered":"2024-03-19T06:21:09.448321+0000","last_unstale":"2024-03-19T06:21:11.367114+0000","last_undegraded":"2024-03-19T06:21:11.367114+0000","last_fullsized":"2024-03-19T06:21:11.367114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:48:33.849430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437834+0000","last_change":"2024-03-19T06:21:08.442999+0000","last_active":"2024-03-19T06:21:10.437834+0000","last_peered":"2024-03-19T06:21:10.437834+0000","last_clean":"2024-03-19T06:21:10.437834+0000","last_became_active":"2024-03-19T06:21:08.442712+0000","last_became_peered":"2024-03-19T06:21:08.442712+0000","last_unstale":"2024-03-19T06:21:10.437834+0000","last_undegraded":"2024-03-19T06:21:10.437834+0000","last_fullsized":"2024-03-19T06:21:10.437834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:41.802412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.604246+0000","last_change":"2024-03-19T06:21:09.439036+0000","last_active":"2024-03-19T06:21:10.604246+0000","last_peered":"2024-03-19T06:21:10.604246+0000","last_clean":"2024-03-19T06:21:10.604246+0000","last_became_active":"2024-03-19T06:21:09.437278+0000","last_became_peered":"2024-03-19T06:21:09.437278+0000","last_unstale":"2024-03-19T06:21:10.604246+0000","last_undegraded":"2024-03-19T06:21:10.604246+0000","last_fullsized":"2024-03-19T06:21:10.604246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:04:20.539454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431175+0000","last_change":"2024-03-19T06:21:08.426050+0000","last_active":"2024-03-19T06:21:10.431175+0000","last_peered":"2024-03-19T06:21:10.431175+0000","last_clean":"2024-03-19T06:21:10.431175+0000","last_became_active":"2024-03-19T06:21:08.425685+0000","last_became_peered":"2024-03-19T06:21:08.425685+0000","last_unstale":"2024-03-19T06:21:10.431175+0000","last_undegraded":"2024-03-19T06:21:10.431175+0000","last_fullsized":"2024-03-19T06:21:10.431175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:17:39.175587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367190+0000","last_change":"2024-03-19T06:21:09.429673+0000","last_active":"2024-03-19T06:21:11.367190+0000","last_peered":"2024-03-19T06:21:11.367190+0000","last_clean":"2024-03-19T06:21:11.367190+0000","last_became_active":"2024-03-19T06:21:09.429200+0000","last_became_peered":"2024-03-19T06:21:09.429200+0000","last_unstale":"2024-03-19T06:21:11.367190+0000","last_undegraded":"2024-03-19T06:21:11.367190+0000","last_fullsized":"2024-03-19T06:21:11.367190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:01:28.925601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431295+0000","last_change":"2024-03-19T06:21:08.432937+0000","last_active":"2024-03-19T06:21:10.431295+0000","last_peered":"2024-03-19T06:21:10.431295+0000","last_clean":"2024-03-19T06:21:10.431295+0000","last_became_active":"2024-03-19T06:21:08.432643+0000","last_became_peered":"2024-03-19T06:21:08.432643+0000","last_unstale":"2024-03-19T06:21:10.431295+0000","last_undegraded":"2024-03-19T06:21:10.431295+0000","last_fullsized":"2024-03-19T06:21:10.431295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:37.056055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367866+0000","last_change":"2024-03-19T06:21:09.450656+0000","last_active":"2024-03-19T06:21:11.367866+0000","last_peered":"2024-03-19T06:21:11.367866+0000","last_clean":"2024-03-19T06:21:11.367866+0000","last_became_active":"2024-03-19T06:21:09.450267+0000","last_became_peered":"2024-03-19T06:21:09.450267+0000","last_unstale":"2024-03-19T06:21:11.367866+0000","last_undegraded":"2024-03-19T06:21:11.367866+0000","last_fullsized":"2024-03-19T06:21:11.367866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:53:31.740331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439491+0000","last_change":"2024-03-19T06:21:08.444057+0000","last_active":"2024-03-19T06:21:10.439491+0000","last_peered":"2024-03-19T06:21:10.439491+0000","last_clean":"2024-03-19T06:21:10.439491+0000","last_became_active":"2024-03-19T06:21:08.443651+0000","last_became_peered":"2024-03-19T06:21:08.443651+0000","last_unstale":"2024-03-19T06:21:10.439491+0000","last_undegraded":"2024-03-19T06:21:10.439491+0000","last_fullsized":"2024-03-19T06:21:10.439491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:17:39.175587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367475+0000","last_change":"2024-03-19T06:21:09.434472+0000","last_active":"2024-03-19T06:21:11.367475+0000","last_peered":"2024-03-19T06:21:11.367475+0000","last_clean":"2024-03-19T06:21:11.367475+0000","last_became_active":"2024-03-19T06:21:09.434201+0000","last_became_peered":"2024-03-19T06:21:09.434201+0000","last_unstale":"2024-03-19T06:21:11.367475+0000","last_undegraded":"2024-03-19T06:21:11.367475+0000","last_fullsized":"2024-03-19T06:21:11.367475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:18:50.283686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438926+0000","last_change":"2024-03-19T06:21:09.431782+0000","last_active":"2024-03-19T06:21:10.438926+0000","last_peered":"2024-03-19T06:21:10.438926+0000","last_clean":"2024-03-19T06:21:10.438926+0000","last_became_active":"2024-03-19T06:21:09.431490+0000","last_became_peered":"2024-03-19T06:21:09.431490+0000","last_unstale":"2024-03-19T06:21:10.438926+0000","last_undegraded":"2024-03-19T06:21:10.438926+0000","last_fullsized":"2024-03-19T06:21:10.438926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:42:31.622101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438627+0000","last_change":"2024-03-19T06:21:08.446728+0000","last_active":"2024-03-19T06:21:10.438627+0000","last_peered":"2024-03-19T06:21:10.438627+0000","last_clean":"2024-03-19T06:21:10.438627+0000","last_became_active":"2024-03-19T06:21:08.446423+0000","last_became_peered":"2024-03-19T06:21:08.446423+0000","last_unstale":"2024-03-19T06:21:10.438627+0000","last_undegraded":"2024-03-19T06:21:10.438627+0000","last_fullsized":"2024-03-19T06:21:10.438627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:22.147438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438843+0000","last_change":"2024-03-19T06:21:09.431353+0000","last_active":"2024-03-19T06:21:10.438843+0000","last_peered":"2024-03-19T06:21:10.438843+0000","last_clean":"2024-03-19T06:21:10.438843+0000","last_became_active":"2024-03-19T06:21:09.431060+0000","last_became_peered":"2024-03-19T06:21:09.431060+0000","last_unstale":"2024-03-19T06:21:10.438843+0000","last_undegraded":"2024-03-19T06:21:10.438843+0000","last_fullsized":"2024-03-19T06:21:10.438843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:21:16.347465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438235+0000","last_change":"2024-03-19T06:21:08.447987+0000","last_active":"2024-03-19T06:21:10.438235+0000","last_peered":"2024-03-19T06:21:10.438235+0000","last_clean":"2024-03-19T06:21:10.438235+0000","last_became_active":"2024-03-19T06:21:08.447692+0000","last_became_peered":"2024-03-19T06:21:08.447692+0000","last_unstale":"2024-03-19T06:21:10.438235+0000","last_undegraded":"2024-03-19T06:21:10.438235+0000","last_fullsized":"2024-03-19T06:21:10.438235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:28:34.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367438+0000","last_change":"2024-03-19T06:21:09.453284+0000","last_active":"2024-03-19T06:21:11.367438+0000","last_peered":"2024-03-19T06:21:11.367438+0000","last_clean":"2024-03-19T06:21:11.367438+0000","last_became_active":"2024-03-19T06:21:09.452881+0000","last_became_peered":"2024-03-19T06:21:09.452881+0000","last_unstale":"2024-03-19T06:21:11.367438+0000","last_undegraded":"2024-03-19T06:21:11.367438+0000","last_fullsized":"2024-03-19T06:21:11.367438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:06.036992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.368174+0000","last_change":"2024-03-19T06:21:08.431484+0000","last_active":"2024-03-19T06:21:11.368174+0000","last_peered":"2024-03-19T06:21:11.368174+0000","last_clean":"2024-03-19T06:21:11.368174+0000","last_became_active":"2024-03-19T06:21:08.430999+0000","last_became_peered":"2024-03-19T06:21:08.430999+0000","last_unstale":"2024-03-19T06:21:11.368174+0000","last_undegraded":"2024-03-19T06:21:11.368174+0000","last_fullsized":"2024-03-19T06:21:11.368174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:57:55.273406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.368247+0000","last_change":"2024-03-19T06:21:09.442579+0000","last_active":"2024-03-19T06:21:11.368247+0000","last_peered":"2024-03-19T06:21:11.368247+0000","last_clean":"2024-03-19T06:21:11.368247+0000","last_became_active":"2024-03-19T06:21:09.442277+0000","last_became_peered":"2024-03-19T06:21:09.442277+0000","last_unstale":"2024-03-19T06:21:11.368247+0000","last_undegraded":"2024-03-19T06:21:11.368247+0000","last_fullsized":"2024-03-19T06:21:11.368247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:10.988226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367836+0000","last_change":"2024-03-19T06:21:08.436289+0000","last_active":"2024-03-19T06:21:11.367836+0000","last_peered":"2024-03-19T06:21:11.367836+0000","last_clean":"2024-03-19T06:21:11.367836+0000","last_became_active":"2024-03-19T06:21:08.436007+0000","last_became_peered":"2024-03-19T06:21:08.436007+0000","last_unstale":"2024-03-19T06:21:11.367836+0000","last_undegraded":"2024-03-19T06:21:11.367836+0000","last_fullsized":"2024-03-19T06:21:11.367836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:29:42.390366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":78470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":76948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":76858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":77018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":827392,"data_stored":667864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":76984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":78470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:21:18.261 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:21:18.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.448+0000 7f8879000640 1 Processor -- start 2024-03-19T06:21:18.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.448+0000 7f8879000640 1 -- start start 2024-03-19T06:21:18.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.448+0000 7f8879000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f887415bb20 0x7f887409a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.448+0000 7f8879000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f88740cf460 0x7f88740c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.448+0000 7f8879000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887415bf00 con 0x7f88740c5920 2024-03-19T06:21:18.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.448+0000 7f8879000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88740cc3a0 con 0x7f887415bb20 2024-03-19T06:21:18.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.448+0000 7f8879000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88740cfbb0 con 0x7f88740cf460 2024-03-19T06:21:18.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.448+0000 7f8871e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f887415bb20 0x7f887409a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.448+0000 7f8872800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f88740c5920 0x7f88740cd390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47726/0 (socket says 172.21.15.32:47726) 2024-03-19T06:21:18.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.448+0000 7f8872800640 1 -- 172.21.15.32:0/529708606 learned_addr learned my addr 172.21.15.32:0/529708606 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:18.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.448+0000 7f8869400640 1 --2- 172.21.15.32:0/529708606 >> v2:172.21.15.171:3300/0 conn(0x7f88740cf460 0x7f88740c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.448+0000 7f8871e00640 1 -- 172.21.15.32:0/529708606 >> v2:172.21.15.171:3300/0 conn(0x7f88740cf460 msgr2=0x7f88740c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:18.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.448+0000 7f8871e00640 1 --2- 172.21.15.32:0/529708606 >> v2:172.21.15.171:3300/0 conn(0x7f88740cf460 0x7f88740c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.448+0000 7f8871e00640 1 -- 172.21.15.32:0/529708606 >> v1:172.21.15.32:6789/0 conn(0x7f88740c5920 legacy=0x7f88740cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:18.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.448+0000 7f8871e00640 1 -- 172.21.15.32:0/529708606 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88740cc5d0 con 0x7f887415bb20 2024-03-19T06:21:18.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.448+0000 7f8871400640 1 -- 172.21.15.32:0/529708606 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638564886 0 0) 0x7f887415bf00 con 0x7f88740c5920 2024-03-19T06:21:18.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.452+0000 7f8871e00640 1 --2- 172.21.15.32:0/529708606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887415bb20 0x7f887409a480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f88740685f0 tx=0x7f886401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13e2fcb0e727b45 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:18.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.452+0000 7f8871400640 1 -- 172.21.15.32:0/529708606 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88640ab650 con 0x7f887415bb20 2024-03-19T06:21:18.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.452+0000 7f8871400640 1 -- 172.21.15.32:0/529708606 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88640b0070 con 0x7f887415bb20 2024-03-19T06:21:18.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.452+0000 7f8871400640 1 -- 172.21.15.32:0/529708606 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88640aba10 con 0x7f887415bb20 2024-03-19T06:21:18.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.452+0000 7f8879000640 1 -- 172.21.15.32:0/529708606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887415bb20 msgr2=0x7f887409a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:18.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.452+0000 7f8879000640 1 --2- 172.21.15.32:0/529708606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887415bb20 0x7f887409a480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f88740685f0 tx=0x7f886401c450 comp rx=0 tx=0).stop 2024-03-19T06:21:18.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.452+0000 7f8879000640 1 -- 172.21.15.32:0/529708606 shutdown_connections 2024-03-19T06:21:18.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.452+0000 7f8879000640 1 --2- 172.21.15.32:0/529708606 >> v2:172.21.15.171:3300/0 conn(0x7f88740cf460 0x7f88740c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.452+0000 7f8879000640 1 --2- 172.21.15.32:0/529708606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f887415bb20 0x7f887409a480 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.452+0000 7f8879000640 1 -- 172.21.15.32:0/529708606 >> 172.21.15.32:0/529708606 conn(0x7f88740d1890 msgr2=0x7f88740d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:18.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.452+0000 7f8879000640 1 -- 172.21.15.32:0/529708606 shutdown_connections 2024-03-19T06:21:18.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.452+0000 7f8879000640 1 -- 172.21.15.32:0/529708606 wait complete. 2024-03-19T06:21:18.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8879000640 1 Processor -- start 2024-03-19T06:21:18.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8879000640 1 -- start start 2024-03-19T06:21:18.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8879000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88740c5920 0x7f8874150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8879000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88740cf460 0x7f88740c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8879000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f887415bb20 0x7f88740c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8879000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8874168940 con 0x7f88740cf460 2024-03-19T06:21:18.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8879000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88740cf870 con 0x7f88740c5920 2024-03-19T06:21:18.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8879000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8874168ac0 con 0x7f887415bb20 2024-03-19T06:21:18.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8869400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88740cf460 0x7f88740c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8869400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88740cf460 0x7f88740c4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45684/0 (socket says 172.21.15.32:45684) 2024-03-19T06:21:18.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8869400640 1 -- 172.21.15.32:0/2470694092 learned_addr learned my addr 172.21.15.32:0/2470694092 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:18.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8871e00640 1 --2- 172.21.15.32:0/2470694092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88740c5920 0x7f8874150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8872800640 1 --2- 172.21.15.32:0/2470694092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f887415bb20 0x7f88740c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8869400640 1 -- 172.21.15.32:0/2470694092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f887415bb20 msgr2=0x7f88740c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:18.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8869400640 1 --2- 172.21.15.32:0/2470694092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f887415bb20 0x7f88740c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8869400640 1 -- 172.21.15.32:0/2470694092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88740c5920 msgr2=0x7f8874150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8869400640 1 --2- 172.21.15.32:0/2470694092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88740c5920 0x7f8874150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8869400640 1 -- 172.21.15.32:0/2470694092 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88740c8cd0 con 0x7f88740cf460 2024-03-19T06:21:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8872800640 1 --2- 172.21.15.32:0/2470694092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f887415bb20 0x7f88740c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8869400640 1 --2- 172.21.15.32:0/2470694092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88740cf460 0x7f88740c4f70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f885c00efc0 tx=0x7f885c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f886aa00640 1 -- 172.21.15.32:0/2470694092 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c018020 con 0x7f88740cf460 2024-03-19T06:21:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f886aa00640 1 -- 172.21.15.32:0/2470694092 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c014480 con 0x7f88740cf460 2024-03-19T06:21:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8879000640 1 -- 172.21.15.32:0/2470694092 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88740c9290 con 0x7f88740cf460 2024-03-19T06:21:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f886aa00640 1 -- 172.21.15.32:0/2470694092 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c014850 con 0x7f88740cf460 2024-03-19T06:21:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8879000640 1 -- 172.21.15.32:0/2470694092 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88740c9850 con 0x7f88740cf460 2024-03-19T06:21:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.456+0000 7f8879000640 1 -- 172.21.15.32:0/2470694092 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88740c8a20 con 0x7f88740cf460 2024-03-19T06:21:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.460+0000 7f886aa00640 1 -- 172.21.15.32:0/2470694092 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f885c01b020 con 0x7f88740cf460 2024-03-19T06:21:18.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.460+0000 7f886aa00640 1 --2- 172.21.15.32:0/2470694092 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8850067660 0x7f8850069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.460+0000 7f886aa00640 1 -- 172.21.15.32:0/2470694092 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f885c0865f0 con 0x7f88740cf460 2024-03-19T06:21:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.460+0000 7f8871e00640 1 --2- 172.21.15.32:0/2470694092 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8850067660 0x7f8850069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.460+0000 7f8871e00640 1 --2- 172.21.15.32:0/2470694092 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8850067660 0x7f8850069b20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f88640af000 tx=0x7f88640a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.464+0000 7f886aa00640 1 -- 172.21.15.32:0/2470694092 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f885c022030 con 0x7f88740cf460 2024-03-19T06:21:18.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.628+0000 7f8879000640 1 -- 172.21.15.32:0/2470694092 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88740749e0 con 0x7f8850067660 2024-03-19T06:21:18.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.632+0000 7f886aa00640 1 -- 172.21.15.32:0/2470694092 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251836 (secure 0 0 0) 0x7f88740749e0 con 0x7f8850067660 2024-03-19T06:21:18.629 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:18.630 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:21:18.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.636+0000 7f8879000640 1 -- 172.21.15.32:0/2470694092 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8850067660 msgr2=0x7f8850069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:18.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.636+0000 7f8879000640 1 --2- 172.21.15.32:0/2470694092 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8850067660 0x7f8850069b20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f88640af000 tx=0x7f88640a7000 comp rx=0 tx=0).stop 2024-03-19T06:21:18.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.636+0000 7f8879000640 1 -- 172.21.15.32:0/2470694092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88740cf460 msgr2=0x7f88740c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:18.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.636+0000 7f8879000640 1 --2- 172.21.15.32:0/2470694092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88740cf460 0x7f88740c4f70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f885c00efc0 tx=0x7f885c00c490 comp rx=0 tx=0).stop 2024-03-19T06:21:18.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.636+0000 7f8879000640 1 -- 172.21.15.32:0/2470694092 shutdown_connections 2024-03-19T06:21:18.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.636+0000 7f8879000640 1 --2- 172.21.15.32:0/2470694092 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8850067660 0x7f8850069b20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.636+0000 7f8879000640 1 --2- 172.21.15.32:0/2470694092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f887415bb20 0x7f88740c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.636+0000 7f8879000640 1 --2- 172.21.15.32:0/2470694092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88740cf460 0x7f88740c4f70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.636+0000 7f8879000640 1 --2- 172.21.15.32:0/2470694092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88740c5920 0x7f8874150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.636+0000 7f8879000640 1 -- 172.21.15.32:0/2470694092 >> 172.21.15.32:0/2470694092 conn(0x7f88740d1890 msgr2=0x7f8874155e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:18.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.636+0000 7f8879000640 1 -- 172.21.15.32:0/2470694092 shutdown_connections 2024-03-19T06:21:18.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.636+0000 7f8879000640 1 -- 172.21.15.32:0/2470694092 wait complete. 2024-03-19T06:21:18.650 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-03-19T06:21:17.922800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235788,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738932,"statfs":{"total":773094113280,"available":772852666368,"internally_reserved":0,"allocated":3022848,"data_stored":1800420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.506017"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439338+0000","last_change":"2024-03-19T06:21:09.452313+0000","last_active":"2024-03-19T06:21:10.439338+0000","last_peered":"2024-03-19T06:21:10.439338+0000","last_clean":"2024-03-19T06:21:10.439338+0000","last_became_active":"2024-03-19T06:21:09.452026+0000","last_became_peered":"2024-03-19T06:21:09.452026+0000","last_unstale":"2024-03-19T06:21:10.439338+0000","last_undegraded":"2024-03-19T06:21:10.439338+0000","last_fullsized":"2024-03-19T06:21:10.439338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:42.199087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431525+0000","last_change":"2024-03-19T06:21:09.451446+0000","last_active":"2024-03-19T06:21:10.431525+0000","last_peered":"2024-03-19T06:21:10.431525+0000","last_clean":"2024-03-19T06:21:10.431525+0000","last_became_active":"2024-03-19T06:21:09.451150+0000","last_became_peered":"2024-03-19T06:21:09.451150+0000","last_unstale":"2024-03-19T06:21:10.431525+0000","last_undegraded":"2024-03-19T06:21:10.431525+0000","last_fullsized":"2024-03-19T06:21:10.431525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:10:38.991785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367006+0000","last_change":"2024-03-19T06:21:09.456587+0000","last_active":"2024-03-19T06:21:11.367006+0000","last_peered":"2024-03-19T06:21:11.367006+0000","last_clean":"2024-03-19T06:21:11.367006+0000","last_became_active":"2024-03-19T06:21:09.454920+0000","last_became_peered":"2024-03-19T06:21:09.454920+0000","last_unstale":"2024-03-19T06:21:11.367006+0000","last_undegraded":"2024-03-19T06:21:11.367006+0000","last_fullsized":"2024-03-19T06:21:11.367006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:18:50.283686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438703+0000","last_change":"2024-03-19T06:21:09.440118+0000","last_active":"2024-03-19T06:21:10.438703+0000","last_peered":"2024-03-19T06:21:10.438703+0000","last_clean":"2024-03-19T06:21:10.438703+0000","last_became_active":"2024-03-19T06:21:09.434539+0000","last_became_peered":"2024-03-19T06:21:09.434539+0000","last_unstale":"2024-03-19T06:21:10.438703+0000","last_undegraded":"2024-03-19T06:21:10.438703+0000","last_fullsized":"2024-03-19T06:21:10.438703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:05:23.173353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438953+0000","last_change":"2024-03-19T06:21:09.443312+0000","last_active":"2024-03-19T06:21:10.438953+0000","last_peered":"2024-03-19T06:21:10.438953+0000","last_clean":"2024-03-19T06:21:10.438953+0000","last_became_active":"2024-03-19T06:21:09.442978+0000","last_became_peered":"2024-03-19T06:21:09.442978+0000","last_unstale":"2024-03-19T06:21:10.438953+0000","last_undegraded":"2024-03-19T06:21:10.438953+0000","last_fullsized":"2024-03-19T06:21:10.438953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:39:52.224305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437914+0000","last_change":"2024-03-19T06:21:09.450442+0000","last_active":"2024-03-19T06:21:10.437914+0000","last_peered":"2024-03-19T06:21:10.437914+0000","last_clean":"2024-03-19T06:21:10.437914+0000","last_became_active":"2024-03-19T06:21:09.450149+0000","last_became_peered":"2024-03-19T06:21:09.450149+0000","last_unstale":"2024-03-19T06:21:10.437914+0000","last_undegraded":"2024-03-19T06:21:10.437914+0000","last_fullsized":"2024-03-19T06:21:10.437914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:54:53.443608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438253+0000","last_change":"2024-03-19T06:21:09.450859+0000","last_active":"2024-03-19T06:21:10.438253+0000","last_peered":"2024-03-19T06:21:10.438253+0000","last_clean":"2024-03-19T06:21:10.438253+0000","last_became_active":"2024-03-19T06:21:09.450658+0000","last_became_peered":"2024-03-19T06:21:09.450658+0000","last_unstale":"2024-03-19T06:21:10.438253+0000","last_undegraded":"2024-03-19T06:21:10.438253+0000","last_fullsized":"2024-03-19T06:21:10.438253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:05:23.173353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367080+0000","last_change":"2024-03-19T06:21:09.445477+0000","last_active":"2024-03-19T06:21:11.367080+0000","last_peered":"2024-03-19T06:21:11.367080+0000","last_clean":"2024-03-19T06:21:11.367080+0000","last_became_active":"2024-03-19T06:21:09.445221+0000","last_became_peered":"2024-03-19T06:21:09.445221+0000","last_unstale":"2024-03-19T06:21:11.367080+0000","last_undegraded":"2024-03-19T06:21:11.367080+0000","last_fullsized":"2024-03-19T06:21:11.367080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:57:38.557074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439471+0000","last_change":"2024-03-19T06:21:09.450867+0000","last_active":"2024-03-19T06:21:10.439471+0000","last_peered":"2024-03-19T06:21:10.439471+0000","last_clean":"2024-03-19T06:21:10.439471+0000","last_became_active":"2024-03-19T06:21:09.449220+0000","last_became_peered":"2024-03-19T06:21:09.449220+0000","last_unstale":"2024-03-19T06:21:10.439471+0000","last_undegraded":"2024-03-19T06:21:10.439471+0000","last_fullsized":"2024-03-19T06:21:10.439471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:33:35.251645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367849+0000","last_change":"2024-03-19T06:21:09.446487+0000","last_active":"2024-03-19T06:21:11.367849+0000","last_peered":"2024-03-19T06:21:11.367849+0000","last_clean":"2024-03-19T06:21:11.367849+0000","last_became_active":"2024-03-19T06:21:09.445934+0000","last_became_peered":"2024-03-19T06:21:09.445934+0000","last_unstale":"2024-03-19T06:21:11.367849+0000","last_undegraded":"2024-03-19T06:21:11.367849+0000","last_fullsized":"2024-03-19T06:21:11.367849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:06.036992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367714+0000","last_change":"2024-03-19T06:21:09.446685+0000","last_active":"2024-03-19T06:21:11.367714+0000","last_peered":"2024-03-19T06:21:11.367714+0000","last_clean":"2024-03-19T06:21:11.367714+0000","last_became_active":"2024-03-19T06:21:09.446022+0000","last_became_peered":"2024-03-19T06:21:09.446022+0000","last_unstale":"2024-03-19T06:21:11.367714+0000","last_undegraded":"2024-03-19T06:21:11.367714+0000","last_fullsized":"2024-03-19T06:21:11.367714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:24:35.271835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.604348+0000","last_change":"2024-03-19T06:21:09.434969+0000","last_active":"2024-03-19T06:21:10.604348+0000","last_peered":"2024-03-19T06:21:10.604348+0000","last_clean":"2024-03-19T06:21:10.604348+0000","last_became_active":"2024-03-19T06:21:09.434675+0000","last_became_peered":"2024-03-19T06:21:09.434675+0000","last_unstale":"2024-03-19T06:21:10.604348+0000","last_undegraded":"2024-03-19T06:21:10.604348+0000","last_fullsized":"2024-03-19T06:21:10.604348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:10:44.620921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367625+0000","last_change":"2024-03-19T06:21:09.434060+0000","last_active":"2024-03-19T06:21:11.367625+0000","last_peered":"2024-03-19T06:21:11.367625+0000","last_clean":"2024-03-19T06:21:11.367625+0000","last_became_active":"2024-03-19T06:21:09.433679+0000","last_became_peered":"2024-03-19T06:21:09.433679+0000","last_unstale":"2024-03-19T06:21:11.367625+0000","last_undegraded":"2024-03-19T06:21:11.367625+0000","last_fullsized":"2024-03-19T06:21:11.367625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:12.509804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367088+0000","last_change":"2024-03-19T06:21:09.447522+0000","last_active":"2024-03-19T06:21:11.367088+0000","last_peered":"2024-03-19T06:21:11.367088+0000","last_clean":"2024-03-19T06:21:11.367088+0000","last_became_active":"2024-03-19T06:21:09.447175+0000","last_became_peered":"2024-03-19T06:21:09.447175+0000","last_unstale":"2024-03-19T06:21:11.367088+0000","last_undegraded":"2024-03-19T06:21:11.367088+0000","last_fullsized":"2024-03-19T06:21:11.367088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:55.809405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431070+0000","last_change":"2024-03-19T06:21:09.424398+0000","last_active":"2024-03-19T06:21:10.431070+0000","last_peered":"2024-03-19T06:21:10.431070+0000","last_clean":"2024-03-19T06:21:10.431070+0000","last_became_active":"2024-03-19T06:21:09.424002+0000","last_became_peered":"2024-03-19T06:21:09.424002+0000","last_unstale":"2024-03-19T06:21:10.431070+0000","last_undegraded":"2024-03-19T06:21:10.431070+0000","last_fullsized":"2024-03-19T06:21:10.431070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:33:13.994451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437639+0000","last_change":"2024-03-19T06:21:09.451772+0000","last_active":"2024-03-19T06:21:10.437639+0000","last_peered":"2024-03-19T06:21:10.437639+0000","last_clean":"2024-03-19T06:21:10.437639+0000","last_became_active":"2024-03-19T06:21:09.451466+0000","last_became_peered":"2024-03-19T06:21:09.451466+0000","last_unstale":"2024-03-19T06:21:10.437639+0000","last_undegraded":"2024-03-19T06:21:10.437639+0000","last_fullsized":"2024-03-19T06:21:10.437639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:06.036992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439498+0000","last_change":"2024-03-19T06:21:09.447850+0000","last_active":"2024-03-19T06:21:10.439498+0000","last_peered":"2024-03-19T06:21:10.439498+0000","last_clean":"2024-03-19T06:21:10.439498+0000","last_became_active":"2024-03-19T06:21:09.446058+0000","last_became_peered":"2024-03-19T06:21:09.446058+0000","last_unstale":"2024-03-19T06:21:10.439498+0000","last_undegraded":"2024-03-19T06:21:10.439498+0000","last_fullsized":"2024-03-19T06:21:10.439498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:42.199087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366229+0000","last_change":"2024-03-19T06:21:09.435147+0000","last_active":"2024-03-19T06:21:11.366229+0000","last_peered":"2024-03-19T06:21:11.366229+0000","last_clean":"2024-03-19T06:21:11.366229+0000","last_became_active":"2024-03-19T06:21:09.434845+0000","last_became_peered":"2024-03-19T06:21:09.434845+0000","last_unstale":"2024-03-19T06:21:11.366229+0000","last_undegraded":"2024-03-19T06:21:11.366229+0000","last_fullsized":"2024-03-19T06:21:11.366229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:27:52.195605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438335+0000","last_change":"2024-03-19T06:21:09.452917+0000","last_active":"2024-03-19T06:21:10.438335+0000","last_peered":"2024-03-19T06:21:10.438335+0000","last_clean":"2024-03-19T06:21:10.438335+0000","last_became_active":"2024-03-19T06:21:09.452649+0000","last_became_peered":"2024-03-19T06:21:09.452649+0000","last_unstale":"2024-03-19T06:21:10.438335+0000","last_undegraded":"2024-03-19T06:21:10.438335+0000","last_fullsized":"2024-03-19T06:21:10.438335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:21:16.347465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367714+0000","last_change":"2024-03-19T06:21:09.441874+0000","last_active":"2024-03-19T06:21:11.367714+0000","last_peered":"2024-03-19T06:21:11.367714+0000","last_clean":"2024-03-19T06:21:11.367714+0000","last_became_active":"2024-03-19T06:21:09.441614+0000","last_became_peered":"2024-03-19T06:21:09.441614+0000","last_unstale":"2024-03-19T06:21:11.367714+0000","last_undegraded":"2024-03-19T06:21:11.367714+0000","last_fullsized":"2024-03-19T06:21:11.367714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:48:33.849430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366850+0000","last_change":"2024-03-19T06:21:09.442717+0000","last_active":"2024-03-19T06:21:11.366850+0000","last_peered":"2024-03-19T06:21:11.366850+0000","last_clean":"2024-03-19T06:21:11.366850+0000","last_became_active":"2024-03-19T06:21:09.441979+0000","last_became_peered":"2024-03-19T06:21:09.441979+0000","last_unstale":"2024-03-19T06:21:11.366850+0000","last_undegraded":"2024-03-19T06:21:11.366850+0000","last_fullsized":"2024-03-19T06:21:11.366850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:24:35.271835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438065+0000","last_change":"2024-03-19T06:21:09.444519+0000","last_active":"2024-03-19T06:21:10.438065+0000","last_peered":"2024-03-19T06:21:10.438065+0000","last_clean":"2024-03-19T06:21:10.438065+0000","last_became_active":"2024-03-19T06:21:09.444304+0000","last_became_peered":"2024-03-19T06:21:09.444304+0000","last_unstale":"2024-03-19T06:21:10.438065+0000","last_undegraded":"2024-03-19T06:21:10.438065+0000","last_fullsized":"2024-03-19T06:21:10.438065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:29:55.294290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367627+0000","last_change":"2024-03-19T06:21:09.439225+0000","last_active":"2024-03-19T06:21:11.367627+0000","last_peered":"2024-03-19T06:21:11.367627+0000","last_clean":"2024-03-19T06:21:11.367627+0000","last_became_active":"2024-03-19T06:21:09.437400+0000","last_became_peered":"2024-03-19T06:21:09.437400+0000","last_unstale":"2024-03-19T06:21:11.367627+0000","last_undegraded":"2024-03-19T06:21:11.367627+0000","last_fullsized":"2024-03-19T06:21:11.367627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:40:56.782739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437740+0000","last_change":"2024-03-19T06:21:09.438758+0000","last_active":"2024-03-19T06:21:10.437740+0000","last_peered":"2024-03-19T06:21:10.437740+0000","last_clean":"2024-03-19T06:21:10.437740+0000","last_became_active":"2024-03-19T06:21:09.438493+0000","last_became_peered":"2024-03-19T06:21:09.438493+0000","last_unstale":"2024-03-19T06:21:10.437740+0000","last_undegraded":"2024-03-19T06:21:10.437740+0000","last_fullsized":"2024-03-19T06:21:10.437740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:10:38.991785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.368270+0000","last_change":"2024-03-19T06:21:09.442133+0000","last_active":"2024-03-19T06:21:11.368270+0000","last_peered":"2024-03-19T06:21:11.368270+0000","last_clean":"2024-03-19T06:21:11.368270+0000","last_became_active":"2024-03-19T06:21:09.438450+0000","last_became_peered":"2024-03-19T06:21:09.438450+0000","last_unstale":"2024-03-19T06:21:11.368270+0000","last_undegraded":"2024-03-19T06:21:11.368270+0000","last_fullsized":"2024-03-19T06:21:11.368270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:38:39.537525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367913+0000","last_change":"2024-03-19T06:21:09.452119+0000","last_active":"2024-03-19T06:21:11.367913+0000","last_peered":"2024-03-19T06:21:11.367913+0000","last_clean":"2024-03-19T06:21:11.367913+0000","last_became_active":"2024-03-19T06:21:09.446514+0000","last_became_peered":"2024-03-19T06:21:09.446514+0000","last_unstale":"2024-03-19T06:21:11.367913+0000","last_undegraded":"2024-03-19T06:21:11.367913+0000","last_fullsized":"2024-03-19T06:21:11.367913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:10:38.991785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431419+0000","last_change":"2024-03-19T06:21:09.431512+0000","last_active":"2024-03-19T06:21:10.431419+0000","last_peered":"2024-03-19T06:21:10.431419+0000","last_clean":"2024-03-19T06:21:10.431419+0000","last_became_active":"2024-03-19T06:21:09.431222+0000","last_became_peered":"2024-03-19T06:21:09.431222+0000","last_unstale":"2024-03-19T06:21:10.431419+0000","last_undegraded":"2024-03-19T06:21:10.431419+0000","last_fullsized":"2024-03-19T06:21:10.431419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:06.036992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.368156+0000","last_change":"2024-03-19T06:21:09.439110+0000","last_active":"2024-03-19T06:21:11.368156+0000","last_peered":"2024-03-19T06:21:11.368156+0000","last_clean":"2024-03-19T06:21:11.368156+0000","last_became_active":"2024-03-19T06:21:09.437439+0000","last_became_peered":"2024-03-19T06:21:09.437439+0000","last_unstale":"2024-03-19T06:21:11.368156+0000","last_undegraded":"2024-03-19T06:21:11.368156+0000","last_fullsized":"2024-03-19T06:21:11.368156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:54:31.028271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366871+0000","last_change":"2024-03-19T06:21:09.442438+0000","last_active":"2024-03-19T06:21:11.366871+0000","last_peered":"2024-03-19T06:21:11.366871+0000","last_clean":"2024-03-19T06:21:11.366871+0000","last_became_active":"2024-03-19T06:21:09.441595+0000","last_became_peered":"2024-03-19T06:21:09.441595+0000","last_unstale":"2024-03-19T06:21:11.366871+0000","last_undegraded":"2024-03-19T06:21:11.366871+0000","last_fullsized":"2024-03-19T06:21:11.366871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:54:33.924115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438209+0000","last_change":"2024-03-19T06:21:09.445182+0000","last_active":"2024-03-19T06:21:10.438209+0000","last_peered":"2024-03-19T06:21:10.438209+0000","last_clean":"2024-03-19T06:21:10.438209+0000","last_became_active":"2024-03-19T06:21:09.442331+0000","last_became_peered":"2024-03-19T06:21:09.442331+0000","last_unstale":"2024-03-19T06:21:10.438209+0000","last_undegraded":"2024-03-19T06:21:10.438209+0000","last_fullsized":"2024-03-19T06:21:10.438209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:20.797571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366223+0000","last_change":"2024-03-19T06:21:09.432846+0000","last_active":"2024-03-19T06:21:11.366223+0000","last_peered":"2024-03-19T06:21:11.366223+0000","last_clean":"2024-03-19T06:21:11.366223+0000","last_became_active":"2024-03-19T06:21:09.432568+0000","last_became_peered":"2024-03-19T06:21:09.432568+0000","last_unstale":"2024-03-19T06:21:11.366223+0000","last_undegraded":"2024-03-19T06:21:11.366223+0000","last_fullsized":"2024-03-19T06:21:11.366223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:42.809555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367540+0000","last_change":"2024-03-19T06:21:09.455461+0000","last_active":"2024-03-19T06:21:11.367540+0000","last_peered":"2024-03-19T06:21:11.367540+0000","last_clean":"2024-03-19T06:21:11.367540+0000","last_became_active":"2024-03-19T06:21:09.452616+0000","last_became_peered":"2024-03-19T06:21:09.452616+0000","last_unstale":"2024-03-19T06:21:11.367540+0000","last_undegraded":"2024-03-19T06:21:11.367540+0000","last_fullsized":"2024-03-19T06:21:11.367540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:55.809405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.604179+0000","last_change":"2024-03-19T06:21:09.429726+0000","last_active":"2024-03-19T06:21:10.604179+0000","last_peered":"2024-03-19T06:21:10.604179+0000","last_clean":"2024-03-19T06:21:10.604179+0000","last_became_active":"2024-03-19T06:21:09.428690+0000","last_became_peered":"2024-03-19T06:21:09.428690+0000","last_unstale":"2024-03-19T06:21:10.604179+0000","last_undegraded":"2024-03-19T06:21:10.604179+0000","last_fullsized":"2024-03-19T06:21:10.604179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:41:23.004327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367784+0000","last_change":"2024-03-19T06:21:08.435558+0000","last_active":"2024-03-19T06:21:11.367784+0000","last_peered":"2024-03-19T06:21:11.367784+0000","last_clean":"2024-03-19T06:21:11.367784+0000","last_became_active":"2024-03-19T06:21:08.435230+0000","last_became_peered":"2024-03-19T06:21:08.435230+0000","last_unstale":"2024-03-19T06:21:11.367784+0000","last_undegraded":"2024-03-19T06:21:11.367784+0000","last_fullsized":"2024-03-19T06:21:11.367784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:57:49.073834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367078+0000","last_change":"2024-03-19T06:21:09.449204+0000","last_active":"2024-03-19T06:21:11.367078+0000","last_peered":"2024-03-19T06:21:11.367078+0000","last_clean":"2024-03-19T06:21:11.367078+0000","last_became_active":"2024-03-19T06:21:09.448927+0000","last_became_peered":"2024-03-19T06:21:09.448927+0000","last_unstale":"2024-03-19T06:21:11.367078+0000","last_undegraded":"2024-03-19T06:21:11.367078+0000","last_fullsized":"2024-03-19T06:21:11.367078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:33:13.994451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367497+0000","last_change":"2024-03-19T06:21:08.439097+0000","last_active":"2024-03-19T06:21:11.367497+0000","last_peered":"2024-03-19T06:21:11.367497+0000","last_clean":"2024-03-19T06:21:11.367497+0000","last_became_active":"2024-03-19T06:21:08.438783+0000","last_became_peered":"2024-03-19T06:21:08.438783+0000","last_unstale":"2024-03-19T06:21:11.367497+0000","last_undegraded":"2024-03-19T06:21:11.367497+0000","last_fullsized":"2024-03-19T06:21:11.367497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:37.056055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367737+0000","last_change":"2024-03-19T06:21:08.427804+0000","last_active":"2024-03-19T06:21:11.367737+0000","last_peered":"2024-03-19T06:21:11.367737+0000","last_clean":"2024-03-19T06:21:11.367737+0000","last_became_active":"2024-03-19T06:21:08.427129+0000","last_became_peered":"2024-03-19T06:21:08.427129+0000","last_unstale":"2024-03-19T06:21:11.367737+0000","last_undegraded":"2024-03-19T06:21:11.367737+0000","last_fullsized":"2024-03-19T06:21:11.367737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:13:25.373226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367168+0000","last_change":"2024-03-19T06:21:09.449579+0000","last_active":"2024-03-19T06:21:11.367168+0000","last_peered":"2024-03-19T06:21:11.367168+0000","last_clean":"2024-03-19T06:21:11.367168+0000","last_became_active":"2024-03-19T06:21:09.448892+0000","last_became_peered":"2024-03-19T06:21:09.448892+0000","last_unstale":"2024-03-19T06:21:11.367168+0000","last_undegraded":"2024-03-19T06:21:11.367168+0000","last_fullsized":"2024-03-19T06:21:11.367168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:37:25.985856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437736+0000","last_change":"2024-03-19T06:21:08.441838+0000","last_active":"2024-03-19T06:21:10.437736+0000","last_peered":"2024-03-19T06:21:10.437736+0000","last_clean":"2024-03-19T06:21:10.437736+0000","last_became_active":"2024-03-19T06:21:08.441169+0000","last_became_peered":"2024-03-19T06:21:08.441169+0000","last_unstale":"2024-03-19T06:21:10.437736+0000","last_undegraded":"2024-03-19T06:21:10.437736+0000","last_fullsized":"2024-03-19T06:21:10.437736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:32:24.190836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431070+0000","last_change":"2024-03-19T06:21:09.430021+0000","last_active":"2024-03-19T06:21:10.431070+0000","last_peered":"2024-03-19T06:21:10.431070+0000","last_clean":"2024-03-19T06:21:10.431070+0000","last_became_active":"2024-03-19T06:21:09.429679+0000","last_became_peered":"2024-03-19T06:21:09.429679+0000","last_unstale":"2024-03-19T06:21:10.431070+0000","last_undegraded":"2024-03-19T06:21:10.431070+0000","last_fullsized":"2024-03-19T06:21:10.431070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:55.809405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367681+0000","last_change":"2024-03-19T06:21:08.447659+0000","last_active":"2024-03-19T06:21:11.367681+0000","last_peered":"2024-03-19T06:21:11.367681+0000","last_clean":"2024-03-19T06:21:11.367681+0000","last_became_active":"2024-03-19T06:21:08.447310+0000","last_became_peered":"2024-03-19T06:21:08.447310+0000","last_unstale":"2024-03-19T06:21:11.367681+0000","last_undegraded":"2024-03-19T06:21:11.367681+0000","last_fullsized":"2024-03-19T06:21:11.367681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:22.147438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439182+0000","last_change":"2024-03-19T06:21:09.445774+0000","last_active":"2024-03-19T06:21:10.439182+0000","last_peered":"2024-03-19T06:21:10.439182+0000","last_clean":"2024-03-19T06:21:10.439182+0000","last_became_active":"2024-03-19T06:21:09.445517+0000","last_became_peered":"2024-03-19T06:21:09.445517+0000","last_unstale":"2024-03-19T06:21:10.439182+0000","last_undegraded":"2024-03-19T06:21:10.439182+0000","last_fullsized":"2024-03-19T06:21:10.439182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:14:58.974751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439282+0000","last_change":"2024-03-19T06:21:08.447265+0000","last_active":"2024-03-19T06:21:10.439282+0000","last_peered":"2024-03-19T06:21:10.439282+0000","last_clean":"2024-03-19T06:21:10.439282+0000","last_became_active":"2024-03-19T06:21:08.447009+0000","last_became_peered":"2024-03-19T06:21:08.447009+0000","last_unstale":"2024-03-19T06:21:10.439282+0000","last_undegraded":"2024-03-19T06:21:10.439282+0000","last_fullsized":"2024-03-19T06:21:10.439282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:22.147438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367597+0000","last_change":"2024-03-19T06:21:09.453099+0000","last_active":"2024-03-19T06:21:11.367597+0000","last_peered":"2024-03-19T06:21:11.367597+0000","last_clean":"2024-03-19T06:21:11.367597+0000","last_became_active":"2024-03-19T06:21:09.448991+0000","last_became_peered":"2024-03-19T06:21:09.448991+0000","last_unstale":"2024-03-19T06:21:11.367597+0000","last_undegraded":"2024-03-19T06:21:11.367597+0000","last_fullsized":"2024-03-19T06:21:11.367597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:10:38.991785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431373+0000","last_change":"2024-03-19T06:21:08.439829+0000","last_active":"2024-03-19T06:21:10.431373+0000","last_peered":"2024-03-19T06:21:10.431373+0000","last_clean":"2024-03-19T06:21:10.431373+0000","last_became_active":"2024-03-19T06:21:08.439454+0000","last_became_peered":"2024-03-19T06:21:08.439454+0000","last_unstale":"2024-03-19T06:21:10.431373+0000","last_undegraded":"2024-03-19T06:21:10.431373+0000","last_fullsized":"2024-03-19T06:21:10.431373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:41.802412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.604359+0000","last_change":"2024-03-19T06:21:09.449268+0000","last_active":"2024-03-19T06:21:10.604359+0000","last_peered":"2024-03-19T06:21:10.604359+0000","last_clean":"2024-03-19T06:21:10.604359+0000","last_became_active":"2024-03-19T06:21:09.448827+0000","last_became_peered":"2024-03-19T06:21:09.448827+0000","last_unstale":"2024-03-19T06:21:10.604359+0000","last_undegraded":"2024-03-19T06:21:10.604359+0000","last_fullsized":"2024-03-19T06:21:10.604359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:18:03.542251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367525+0000","last_change":"2024-03-19T06:21:08.445760+0000","last_active":"2024-03-19T06:21:11.367525+0000","last_peered":"2024-03-19T06:21:11.367525+0000","last_clean":"2024-03-19T06:21:11.367525+0000","last_became_active":"2024-03-19T06:21:08.445560+0000","last_became_peered":"2024-03-19T06:21:08.445560+0000","last_unstale":"2024-03-19T06:21:11.367525+0000","last_undegraded":"2024-03-19T06:21:11.367525+0000","last_fullsized":"2024-03-19T06:21:11.367525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:32:24.190836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438055+0000","last_change":"2024-03-19T06:21:09.447310+0000","last_active":"2024-03-19T06:21:10.438055+0000","last_peered":"2024-03-19T06:21:10.438055+0000","last_clean":"2024-03-19T06:21:10.438055+0000","last_became_active":"2024-03-19T06:21:09.446811+0000","last_became_peered":"2024-03-19T06:21:09.446811+0000","last_unstale":"2024-03-19T06:21:10.438055+0000","last_undegraded":"2024-03-19T06:21:10.438055+0000","last_fullsized":"2024-03-19T06:21:10.438055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:29:55.294290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367197+0000","last_change":"2024-03-19T06:21:08.437505+0000","last_active":"2024-03-19T06:21:11.367197+0000","last_peered":"2024-03-19T06:21:11.367197+0000","last_clean":"2024-03-19T06:21:11.367197+0000","last_became_active":"2024-03-19T06:21:08.437190+0000","last_became_peered":"2024-03-19T06:21:08.437190+0000","last_unstale":"2024-03-19T06:21:11.367197+0000","last_undegraded":"2024-03-19T06:21:11.367197+0000","last_fullsized":"2024-03-19T06:21:11.367197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:53:34.745415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366717+0000","last_change":"2024-03-19T06:21:09.447509+0000","last_active":"2024-03-19T06:21:11.366717+0000","last_peered":"2024-03-19T06:21:11.366717+0000","last_clean":"2024-03-19T06:21:11.366717+0000","last_became_active":"2024-03-19T06:21:09.447154+0000","last_became_peered":"2024-03-19T06:21:09.447154+0000","last_unstale":"2024-03-19T06:21:11.366717+0000","last_undegraded":"2024-03-19T06:21:11.366717+0000","last_fullsized":"2024-03-19T06:21:11.366717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:15:19.406708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438312+0000","last_change":"2024-03-19T06:21:08.440830+0000","last_active":"2024-03-19T06:21:10.438312+0000","last_peered":"2024-03-19T06:21:10.438312+0000","last_clean":"2024-03-19T06:21:10.438312+0000","last_became_active":"2024-03-19T06:21:08.439995+0000","last_became_peered":"2024-03-19T06:21:08.439995+0000","last_unstale":"2024-03-19T06:21:10.438312+0000","last_undegraded":"2024-03-19T06:21:10.438312+0000","last_fullsized":"2024-03-19T06:21:10.438312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:56.274578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439288+0000","last_change":"2024-03-19T06:21:09.442975+0000","last_active":"2024-03-19T06:21:10.439288+0000","last_peered":"2024-03-19T06:21:10.439288+0000","last_clean":"2024-03-19T06:21:10.439288+0000","last_became_active":"2024-03-19T06:21:09.442638+0000","last_became_peered":"2024-03-19T06:21:09.442638+0000","last_unstale":"2024-03-19T06:21:10.439288+0000","last_undegraded":"2024-03-19T06:21:10.439288+0000","last_fullsized":"2024-03-19T06:21:10.439288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:14:58.974751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367363+0000","last_change":"2024-03-19T06:21:08.439829+0000","last_active":"2024-03-19T06:21:11.367363+0000","last_peered":"2024-03-19T06:21:11.367363+0000","last_clean":"2024-03-19T06:21:11.367363+0000","last_became_active":"2024-03-19T06:21:08.439524+0000","last_became_peered":"2024-03-19T06:21:08.439524+0000","last_unstale":"2024-03-19T06:21:11.367363+0000","last_undegraded":"2024-03-19T06:21:11.367363+0000","last_fullsized":"2024-03-19T06:21:11.367363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:56.274578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367453+0000","last_change":"2024-03-19T06:21:09.454721+0000","last_active":"2024-03-19T06:21:11.367453+0000","last_peered":"2024-03-19T06:21:11.367453+0000","last_clean":"2024-03-19T06:21:11.367453+0000","last_became_active":"2024-03-19T06:21:09.451915+0000","last_became_peered":"2024-03-19T06:21:09.451915+0000","last_unstale":"2024-03-19T06:21:11.367453+0000","last_undegraded":"2024-03-19T06:21:11.367453+0000","last_fullsized":"2024-03-19T06:21:11.367453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:33:13.994451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.365855+0000","last_change":"2024-03-19T06:21:08.434264+0000","last_active":"2024-03-19T06:21:11.365855+0000","last_peered":"2024-03-19T06:21:11.365855+0000","last_clean":"2024-03-19T06:21:11.365855+0000","last_became_active":"2024-03-19T06:21:08.433960+0000","last_became_peered":"2024-03-19T06:21:08.433960+0000","last_unstale":"2024-03-19T06:21:11.365855+0000","last_undegraded":"2024-03-19T06:21:11.365855+0000","last_fullsized":"2024-03-19T06:21:11.365855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:14:50.420085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438491+0000","last_change":"2024-03-19T06:21:09.444684+0000","last_active":"2024-03-19T06:21:10.438491+0000","last_peered":"2024-03-19T06:21:10.438491+0000","last_clean":"2024-03-19T06:21:10.438491+0000","last_became_active":"2024-03-19T06:21:09.444451+0000","last_became_peered":"2024-03-19T06:21:09.444451+0000","last_unstale":"2024-03-19T06:21:10.438491+0000","last_undegraded":"2024-03-19T06:21:10.438491+0000","last_fullsized":"2024-03-19T06:21:10.438491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:42:31.622101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.604178+0000","last_change":"2024-03-19T06:21:08.437032+0000","last_active":"2024-03-19T06:21:10.604178+0000","last_peered":"2024-03-19T06:21:10.604178+0000","last_clean":"2024-03-19T06:21:10.604178+0000","last_became_active":"2024-03-19T06:21:08.436518+0000","last_became_peered":"2024-03-19T06:21:08.436518+0000","last_unstale":"2024-03-19T06:21:10.604178+0000","last_undegraded":"2024-03-19T06:21:10.604178+0000","last_fullsized":"2024-03-19T06:21:10.604178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:37:38.410985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438943+0000","last_change":"2024-03-19T06:21:09.454018+0000","last_active":"2024-03-19T06:21:10.438943+0000","last_peered":"2024-03-19T06:21:10.438943+0000","last_clean":"2024-03-19T06:21:10.438943+0000","last_became_active":"2024-03-19T06:21:09.453715+0000","last_became_peered":"2024-03-19T06:21:09.453715+0000","last_unstale":"2024-03-19T06:21:10.438943+0000","last_undegraded":"2024-03-19T06:21:10.438943+0000","last_fullsized":"2024-03-19T06:21:10.438943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:08:07.201487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366369+0000","last_change":"2024-03-19T06:21:08.426349+0000","last_active":"2024-03-19T06:21:11.366369+0000","last_peered":"2024-03-19T06:21:11.366369+0000","last_clean":"2024-03-19T06:21:11.366369+0000","last_became_active":"2024-03-19T06:21:08.426057+0000","last_became_peered":"2024-03-19T06:21:08.426057+0000","last_unstale":"2024-03-19T06:21:11.366369+0000","last_undegraded":"2024-03-19T06:21:11.366369+0000","last_fullsized":"2024-03-19T06:21:11.366369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:56.274578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439569+0000","last_change":"2024-03-19T06:21:09.453273+0000","last_active":"2024-03-19T06:21:10.439569+0000","last_peered":"2024-03-19T06:21:10.439569+0000","last_clean":"2024-03-19T06:21:10.439569+0000","last_became_active":"2024-03-19T06:21:09.453008+0000","last_became_peered":"2024-03-19T06:21:09.453008+0000","last_unstale":"2024-03-19T06:21:10.439569+0000","last_undegraded":"2024-03-19T06:21:10.439569+0000","last_fullsized":"2024-03-19T06:21:10.439569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:06:46.783271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431445+0000","last_change":"2024-03-19T06:21:08.436955+0000","last_active":"2024-03-19T06:21:10.431445+0000","last_peered":"2024-03-19T06:21:10.431445+0000","last_clean":"2024-03-19T06:21:10.431445+0000","last_became_active":"2024-03-19T06:21:08.436695+0000","last_became_peered":"2024-03-19T06:21:08.436695+0000","last_unstale":"2024-03-19T06:21:10.431445+0000","last_undegraded":"2024-03-19T06:21:10.431445+0000","last_fullsized":"2024-03-19T06:21:10.431445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:27:51.188461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438972+0000","last_change":"2024-03-19T06:21:09.440792+0000","last_active":"2024-03-19T06:21:10.438972+0000","last_peered":"2024-03-19T06:21:10.438972+0000","last_clean":"2024-03-19T06:21:10.438972+0000","last_became_active":"2024-03-19T06:21:09.433674+0000","last_became_peered":"2024-03-19T06:21:09.433674+0000","last_unstale":"2024-03-19T06:21:10.438972+0000","last_undegraded":"2024-03-19T06:21:10.438972+0000","last_fullsized":"2024-03-19T06:21:10.438972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:08:07.201487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366099+0000","last_change":"2024-03-19T06:21:08.437235+0000","last_active":"2024-03-19T06:21:11.366099+0000","last_peered":"2024-03-19T06:21:11.366099+0000","last_clean":"2024-03-19T06:21:11.366099+0000","last_became_active":"2024-03-19T06:21:08.436874+0000","last_became_peered":"2024-03-19T06:21:08.436874+0000","last_unstale":"2024-03-19T06:21:11.366099+0000","last_undegraded":"2024-03-19T06:21:11.366099+0000","last_fullsized":"2024-03-19T06:21:11.366099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:37.056055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438152+0000","last_change":"2024-03-19T06:21:09.452749+0000","last_active":"2024-03-19T06:21:10.438152+0000","last_peered":"2024-03-19T06:21:10.438152+0000","last_clean":"2024-03-19T06:21:10.438152+0000","last_became_active":"2024-03-19T06:21:09.452386+0000","last_became_peered":"2024-03-19T06:21:09.452386+0000","last_unstale":"2024-03-19T06:21:10.438152+0000","last_undegraded":"2024-03-19T06:21:10.438152+0000","last_fullsized":"2024-03-19T06:21:10.438152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:20.797571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438011+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:21:10.438011+0000","last_peered":"2024-03-19T06:21:10.438011+0000","last_clean":"2024-03-19T06:21:10.438011+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:21:10.438011+0000","last_undegraded":"2024-03-19T06:21:10.438011+0000","last_fullsized":"2024-03-19T06:21:10.438011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439152+0000","last_change":"2024-03-19T06:21:08.436525+0000","last_active":"2024-03-19T06:21:10.439152+0000","last_peered":"2024-03-19T06:21:10.439152+0000","last_clean":"2024-03-19T06:21:10.439152+0000","last_became_active":"2024-03-19T06:21:08.434902+0000","last_became_peered":"2024-03-19T06:21:08.434902+0000","last_unstale":"2024-03-19T06:21:10.439152+0000","last_undegraded":"2024-03-19T06:21:10.439152+0000","last_fullsized":"2024-03-19T06:21:10.439152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:12:55.201245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367569+0000","last_change":"2024-03-19T06:21:09.446879+0000","last_active":"2024-03-19T06:21:11.367569+0000","last_peered":"2024-03-19T06:21:11.367569+0000","last_clean":"2024-03-19T06:21:11.367569+0000","last_became_active":"2024-03-19T06:21:09.446625+0000","last_became_peered":"2024-03-19T06:21:09.446625+0000","last_unstale":"2024-03-19T06:21:11.367569+0000","last_undegraded":"2024-03-19T06:21:11.367569+0000","last_fullsized":"2024-03-19T06:21:11.367569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:26:13.910343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437951+0000","last_change":"2024-03-19T06:21:08.441736+0000","last_active":"2024-03-19T06:21:10.437951+0000","last_peered":"2024-03-19T06:21:10.437951+0000","last_clean":"2024-03-19T06:21:10.437951+0000","last_became_active":"2024-03-19T06:21:08.441408+0000","last_became_peered":"2024-03-19T06:21:08.441408+0000","last_unstale":"2024-03-19T06:21:10.437951+0000","last_undegraded":"2024-03-19T06:21:10.437951+0000","last_fullsized":"2024-03-19T06:21:10.437951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:27:51.188461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366478+0000","last_change":"2024-03-19T06:21:09.435944+0000","last_active":"2024-03-19T06:21:11.366478+0000","last_peered":"2024-03-19T06:21:11.366478+0000","last_clean":"2024-03-19T06:21:11.366478+0000","last_became_active":"2024-03-19T06:21:09.435521+0000","last_became_peered":"2024-03-19T06:21:09.435521+0000","last_unstale":"2024-03-19T06:21:11.366478+0000","last_undegraded":"2024-03-19T06:21:11.366478+0000","last_fullsized":"2024-03-19T06:21:11.366478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:30:08.169277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.366255+0000","last_change":"2024-03-19T06:21:08.428501+0000","last_active":"2024-03-19T06:21:11.366255+0000","last_peered":"2024-03-19T06:21:11.366255+0000","last_clean":"2024-03-19T06:21:11.366255+0000","last_became_active":"2024-03-19T06:21:08.428240+0000","last_became_peered":"2024-03-19T06:21:08.428240+0000","last_unstale":"2024-03-19T06:21:11.366255+0000","last_undegraded":"2024-03-19T06:21:11.366255+0000","last_fullsized":"2024-03-19T06:21:11.366255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:12:55.201245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431078+0000","last_change":"2024-03-19T06:21:09.437604+0000","last_active":"2024-03-19T06:21:10.431078+0000","last_peered":"2024-03-19T06:21:10.431078+0000","last_clean":"2024-03-19T06:21:10.431078+0000","last_became_active":"2024-03-19T06:21:09.436485+0000","last_became_peered":"2024-03-19T06:21:09.436485+0000","last_unstale":"2024-03-19T06:21:10.431078+0000","last_undegraded":"2024-03-19T06:21:10.431078+0000","last_fullsized":"2024-03-19T06:21:10.431078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:48:33.849430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438404+0000","last_change":"2024-03-19T06:21:08.435260+0000","last_active":"2024-03-19T06:21:10.438404+0000","last_peered":"2024-03-19T06:21:10.438404+0000","last_clean":"2024-03-19T06:21:10.438404+0000","last_became_active":"2024-03-19T06:21:08.434842+0000","last_became_peered":"2024-03-19T06:21:08.434842+0000","last_unstale":"2024-03-19T06:21:10.438404+0000","last_undegraded":"2024-03-19T06:21:10.438404+0000","last_fullsized":"2024-03-19T06:21:10.438404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:37.056055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.604158+0000","last_change":"2024-03-19T06:21:09.449799+0000","last_active":"2024-03-19T06:21:10.604158+0000","last_peered":"2024-03-19T06:21:10.604158+0000","last_clean":"2024-03-19T06:21:10.604158+0000","last_became_active":"2024-03-19T06:21:09.448305+0000","last_became_peered":"2024-03-19T06:21:09.448305+0000","last_unstale":"2024-03-19T06:21:10.604158+0000","last_undegraded":"2024-03-19T06:21:10.604158+0000","last_fullsized":"2024-03-19T06:21:10.604158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:34:32.017603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431407+0000","last_change":"2024-03-19T06:21:08.429361+0000","last_active":"2024-03-19T06:21:10.431407+0000","last_peered":"2024-03-19T06:21:10.431407+0000","last_clean":"2024-03-19T06:21:10.431407+0000","last_became_active":"2024-03-19T06:21:08.429138+0000","last_became_peered":"2024-03-19T06:21:08.429138+0000","last_unstale":"2024-03-19T06:21:10.431407+0000","last_undegraded":"2024-03-19T06:21:10.431407+0000","last_fullsized":"2024-03-19T06:21:10.431407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:32:24.190836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439077+0000","last_change":"2024-03-19T06:21:09.438743+0000","last_active":"2024-03-19T06:21:10.439077+0000","last_peered":"2024-03-19T06:21:10.439077+0000","last_clean":"2024-03-19T06:21:10.439077+0000","last_became_active":"2024-03-19T06:21:09.433760+0000","last_became_peered":"2024-03-19T06:21:09.433760+0000","last_unstale":"2024-03-19T06:21:10.439077+0000","last_undegraded":"2024-03-19T06:21:10.439077+0000","last_fullsized":"2024-03-19T06:21:10.439077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:39:52.224305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438397+0000","last_change":"2024-03-19T06:21:08.443003+0000","last_active":"2024-03-19T06:21:10.438397+0000","last_peered":"2024-03-19T06:21:10.438397+0000","last_clean":"2024-03-19T06:21:10.438397+0000","last_became_active":"2024-03-19T06:21:08.442704+0000","last_became_peered":"2024-03-19T06:21:08.442704+0000","last_unstale":"2024-03-19T06:21:10.438397+0000","last_undegraded":"2024-03-19T06:21:10.438397+0000","last_fullsized":"2024-03-19T06:21:10.438397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:55:30.030272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431303+0000","last_change":"2024-03-19T06:21:09.440061+0000","last_active":"2024-03-19T06:21:10.431303+0000","last_peered":"2024-03-19T06:21:10.431303+0000","last_clean":"2024-03-19T06:21:10.431303+0000","last_became_active":"2024-03-19T06:21:09.439732+0000","last_became_peered":"2024-03-19T06:21:09.439732+0000","last_unstale":"2024-03-19T06:21:10.431303+0000","last_undegraded":"2024-03-19T06:21:10.431303+0000","last_fullsized":"2024-03-19T06:21:10.431303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:24:35.271835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.974593+0000","last_change":"2024-03-19T06:21:08.443381+0000","last_active":"2024-03-19T06:21:10.974593+0000","last_peered":"2024-03-19T06:21:10.974593+0000","last_clean":"2024-03-19T06:21:10.974593+0000","last_became_active":"2024-03-19T06:21:08.443148+0000","last_became_peered":"2024-03-19T06:21:08.443148+0000","last_unstale":"2024-03-19T06:21:10.974593+0000","last_undegraded":"2024-03-19T06:21:10.974593+0000","last_fullsized":"2024-03-19T06:21:10.974593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:22.147438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.368263+0000","last_change":"2024-03-19T06:21:09.444826+0000","last_active":"2024-03-19T06:21:11.368263+0000","last_peered":"2024-03-19T06:21:11.368263+0000","last_clean":"2024-03-19T06:21:11.368263+0000","last_became_active":"2024-03-19T06:21:09.444361+0000","last_became_peered":"2024-03-19T06:21:09.444361+0000","last_unstale":"2024-03-19T06:21:11.368263+0000","last_undegraded":"2024-03-19T06:21:11.368263+0000","last_fullsized":"2024-03-19T06:21:11.368263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:51:27.900040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367795+0000","last_change":"2024-03-19T06:21:08.447890+0000","last_active":"2024-03-19T06:21:11.367795+0000","last_peered":"2024-03-19T06:21:11.367795+0000","last_clean":"2024-03-19T06:21:11.367795+0000","last_became_active":"2024-03-19T06:21:08.447369+0000","last_became_peered":"2024-03-19T06:21:08.447369+0000","last_unstale":"2024-03-19T06:21:11.367795+0000","last_undegraded":"2024-03-19T06:21:11.367795+0000","last_fullsized":"2024-03-19T06:21:11.367795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:41.802412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367114+0000","last_change":"2024-03-19T06:21:09.448599+0000","last_active":"2024-03-19T06:21:11.367114+0000","last_peered":"2024-03-19T06:21:11.367114+0000","last_clean":"2024-03-19T06:21:11.367114+0000","last_became_active":"2024-03-19T06:21:09.448321+0000","last_became_peered":"2024-03-19T06:21:09.448321+0000","last_unstale":"2024-03-19T06:21:11.367114+0000","last_undegraded":"2024-03-19T06:21:11.367114+0000","last_fullsized":"2024-03-19T06:21:11.367114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:48:33.849430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.437834+0000","last_change":"2024-03-19T06:21:08.442999+0000","last_active":"2024-03-19T06:21:10.437834+0000","last_peered":"2024-03-19T06:21:10.437834+0000","last_clean":"2024-03-19T06:21:10.437834+0000","last_became_active":"2024-03-19T06:21:08.442712+0000","last_became_peered":"2024-03-19T06:21:08.442712+0000","last_unstale":"2024-03-19T06:21:10.437834+0000","last_undegraded":"2024-03-19T06:21:10.437834+0000","last_fullsized":"2024-03-19T06:21:10.437834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:41.802412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.604246+0000","last_change":"2024-03-19T06:21:09.439036+0000","last_active":"2024-03-19T06:21:10.604246+0000","last_peered":"2024-03-19T06:21:10.604246+0000","last_clean":"2024-03-19T06:21:10.604246+0000","last_became_active":"2024-03-19T06:21:09.437278+0000","last_became_peered":"2024-03-19T06:21:09.437278+0000","last_unstale":"2024-03-19T06:21:10.604246+0000","last_undegraded":"2024-03-19T06:21:10.604246+0000","last_fullsized":"2024-03-19T06:21:10.604246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:04:20.539454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431175+0000","last_change":"2024-03-19T06:21:08.426050+0000","last_active":"2024-03-19T06:21:10.431175+0000","last_peered":"2024-03-19T06:21:10.431175+0000","last_clean":"2024-03-19T06:21:10.431175+0000","last_became_active":"2024-03-19T06:21:08.425685+0000","last_became_peered":"2024-03-19T06:21:08.425685+0000","last_unstale":"2024-03-19T06:21:10.431175+0000","last_undegraded":"2024-03-19T06:21:10.431175+0000","last_fullsized":"2024-03-19T06:21:10.431175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:17:39.175587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367190+0000","last_change":"2024-03-19T06:21:09.429673+0000","last_active":"2024-03-19T06:21:11.367190+0000","last_peered":"2024-03-19T06:21:11.367190+0000","last_clean":"2024-03-19T06:21:11.367190+0000","last_became_active":"2024-03-19T06:21:09.429200+0000","last_became_peered":"2024-03-19T06:21:09.429200+0000","last_unstale":"2024-03-19T06:21:11.367190+0000","last_undegraded":"2024-03-19T06:21:11.367190+0000","last_fullsized":"2024-03-19T06:21:11.367190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:01:28.925601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.431295+0000","last_change":"2024-03-19T06:21:08.432937+0000","last_active":"2024-03-19T06:21:10.431295+0000","last_peered":"2024-03-19T06:21:10.431295+0000","last_clean":"2024-03-19T06:21:10.431295+0000","last_became_active":"2024-03-19T06:21:08.432643+0000","last_became_peered":"2024-03-19T06:21:08.432643+0000","last_unstale":"2024-03-19T06:21:10.431295+0000","last_undegraded":"2024-03-19T06:21:10.431295+0000","last_fullsized":"2024-03-19T06:21:10.431295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:58:37.056055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367866+0000","last_change":"2024-03-19T06:21:09.450656+0000","last_active":"2024-03-19T06:21:11.367866+0000","last_peered":"2024-03-19T06:21:11.367866+0000","last_clean":"2024-03-19T06:21:11.367866+0000","last_became_active":"2024-03-19T06:21:09.450267+0000","last_became_peered":"2024-03-19T06:21:09.450267+0000","last_unstale":"2024-03-19T06:21:11.367866+0000","last_undegraded":"2024-03-19T06:21:11.367866+0000","last_fullsized":"2024-03-19T06:21:11.367866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:53:31.740331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.439491+0000","last_change":"2024-03-19T06:21:08.444057+0000","last_active":"2024-03-19T06:21:10.439491+0000","last_peered":"2024-03-19T06:21:10.439491+0000","last_clean":"2024-03-19T06:21:10.439491+0000","last_became_active":"2024-03-19T06:21:08.443651+0000","last_became_peered":"2024-03-19T06:21:08.443651+0000","last_unstale":"2024-03-19T06:21:10.439491+0000","last_undegraded":"2024-03-19T06:21:10.439491+0000","last_fullsized":"2024-03-19T06:21:10.439491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:17:39.175587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367475+0000","last_change":"2024-03-19T06:21:09.434472+0000","last_active":"2024-03-19T06:21:11.367475+0000","last_peered":"2024-03-19T06:21:11.367475+0000","last_clean":"2024-03-19T06:21:11.367475+0000","last_became_active":"2024-03-19T06:21:09.434201+0000","last_became_peered":"2024-03-19T06:21:09.434201+0000","last_unstale":"2024-03-19T06:21:11.367475+0000","last_undegraded":"2024-03-19T06:21:11.367475+0000","last_fullsized":"2024-03-19T06:21:11.367475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:18:50.283686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438926+0000","last_change":"2024-03-19T06:21:09.431782+0000","last_active":"2024-03-19T06:21:10.438926+0000","last_peered":"2024-03-19T06:21:10.438926+0000","last_clean":"2024-03-19T06:21:10.438926+0000","last_became_active":"2024-03-19T06:21:09.431490+0000","last_became_peered":"2024-03-19T06:21:09.431490+0000","last_unstale":"2024-03-19T06:21:10.438926+0000","last_undegraded":"2024-03-19T06:21:10.438926+0000","last_fullsized":"2024-03-19T06:21:10.438926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:42:31.622101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438627+0000","last_change":"2024-03-19T06:21:08.446728+0000","last_active":"2024-03-19T06:21:10.438627+0000","last_peered":"2024-03-19T06:21:10.438627+0000","last_clean":"2024-03-19T06:21:10.438627+0000","last_became_active":"2024-03-19T06:21:08.446423+0000","last_became_peered":"2024-03-19T06:21:08.446423+0000","last_unstale":"2024-03-19T06:21:10.438627+0000","last_undegraded":"2024-03-19T06:21:10.438627+0000","last_fullsized":"2024-03-19T06:21:10.438627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:47:22.147438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438843+0000","last_change":"2024-03-19T06:21:09.431353+0000","last_active":"2024-03-19T06:21:10.438843+0000","last_peered":"2024-03-19T06:21:10.438843+0000","last_clean":"2024-03-19T06:21:10.438843+0000","last_became_active":"2024-03-19T06:21:09.431060+0000","last_became_peered":"2024-03-19T06:21:09.431060+0000","last_unstale":"2024-03-19T06:21:10.438843+0000","last_undegraded":"2024-03-19T06:21:10.438843+0000","last_fullsized":"2024-03-19T06:21:10.438843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:21:16.347465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:10.438235+0000","last_change":"2024-03-19T06:21:08.447987+0000","last_active":"2024-03-19T06:21:10.438235+0000","last_peered":"2024-03-19T06:21:10.438235+0000","last_clean":"2024-03-19T06:21:10.438235+0000","last_became_active":"2024-03-19T06:21:08.447692+0000","last_became_peered":"2024-03-19T06:21:08.447692+0000","last_unstale":"2024-03-19T06:21:10.438235+0000","last_undegraded":"2024-03-19T06:21:10.438235+0000","last_fullsized":"2024-03-19T06:21:10.438235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:28:34.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367438+0000","last_change":"2024-03-19T06:21:09.453284+0000","last_active":"2024-03-19T06:21:11.367438+0000","last_peered":"2024-03-19T06:21:11.367438+0000","last_clean":"2024-03-19T06:21:11.367438+0000","last_became_active":"2024-03-19T06:21:09.452881+0000","last_became_peered":"2024-03-19T06:21:09.452881+0000","last_unstale":"2024-03-19T06:21:11.367438+0000","last_undegraded":"2024-03-19T06:21:11.367438+0000","last_fullsized":"2024-03-19T06:21:11.367438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:06.036992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.368174+0000","last_change":"2024-03-19T06:21:08.431484+0000","last_active":"2024-03-19T06:21:11.368174+0000","last_peered":"2024-03-19T06:21:11.368174+0000","last_clean":"2024-03-19T06:21:11.368174+0000","last_became_active":"2024-03-19T06:21:08.430999+0000","last_became_peered":"2024-03-19T06:21:08.430999+0000","last_unstale":"2024-03-19T06:21:11.368174+0000","last_undegraded":"2024-03-19T06:21:11.368174+0000","last_fullsized":"2024-03-19T06:21:11.368174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:57:55.273406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.368247+0000","last_change":"2024-03-19T06:21:09.442579+0000","last_active":"2024-03-19T06:21:11.368247+0000","last_peered":"2024-03-19T06:21:11.368247+0000","last_clean":"2024-03-19T06:21:11.368247+0000","last_became_active":"2024-03-19T06:21:09.442277+0000","last_became_peered":"2024-03-19T06:21:09.442277+0000","last_unstale":"2024-03-19T06:21:11.368247+0000","last_undegraded":"2024-03-19T06:21:11.368247+0000","last_fullsized":"2024-03-19T06:21:11.368247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:08.399888+0000","last_clean_scrub_stamp":"2024-03-19T06:21:08.399888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:10.988226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-19T06:21:11.367836+0000","last_change":"2024-03-19T06:21:08.436289+0000","last_active":"2024-03-19T06:21:11.367836+0000","last_peered":"2024-03-19T06:21:11.367836+0000","last_clean":"2024-03-19T06:21:11.367836+0000","last_became_active":"2024-03-19T06:21:08.436007+0000","last_became_peered":"2024-03-19T06:21:08.436007+0000","last_unstale":"2024-03-19T06:21:11.367836+0000","last_undegraded":"2024-03-19T06:21:11.367836+0000","last_fullsized":"2024-03-19T06:21:11.367836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:21:07.392745+0000","last_clean_scrub_stamp":"2024-03-19T06:21:07.392745+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:29:42.390366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":78470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":76948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":76858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":77018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":827392,"data_stored":667864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":76984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":78470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:21:18.654 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-19T06:21:18.654 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-19T06:21:18.654 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-19T06:21:18.654 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-19T06:21:18.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46cbe00640 1 Processor -- start 2024-03-19T06:21:18.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46cbe00640 1 -- start start 2024-03-19T06:21:18.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46cbe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f46c415b810 0x7f46c406ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46cbe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46c40b2d70 0x7f46c406b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46cbe00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c40cf840 con 0x7f46c415bbf0 2024-03-19T06:21:18.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46cbe00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c40cfb20 con 0x7f46c415b810 2024-03-19T06:21:18.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46cbe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40cfe00 con 0x7f46c40b2d70 2024-03-19T06:21:18.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c9e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f46c415bbf0 0x7f46c40ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47730/0 (socket says 172.21.15.32:47730) 2024-03-19T06:21:18.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c9e00640 1 -- 172.21.15.32:0/624459867 learned_addr learned my addr 172.21.15.32:0/624459867 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c8a00640 1 --2- 172.21.15.32:0/624459867 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46c40b2d70 0x7f46c406b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c9400640 1 --2- 172.21.15.32:0/624459867 >> v2:172.21.15.171:3300/0 conn(0x7f46c415b810 0x7f46c406ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c3e00640 1 -- 172.21.15.32:0/624459867 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228046069 0 0) 0x7f46c40cf840 con 0x7f46c415bbf0 2024-03-19T06:21:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c3e00640 1 -- 172.21.15.32:0/624459867 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46ac003530 con 0x7f46c415bbf0 2024-03-19T06:21:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c3e00640 1 -- 172.21.15.32:0/624459867 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1250737879 0 0) 0x7f46ac003530 con 0x7f46c415bbf0 2024-03-19T06:21:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c3e00640 1 -- 172.21.15.32:0/624459867 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46c40b2d70 msgr2=0x7f46c406b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c3e00640 1 --2- 172.21.15.32:0/624459867 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46c40b2d70 0x7f46c406b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c3e00640 1 -- 172.21.15.32:0/624459867 >> v2:172.21.15.171:3300/0 conn(0x7f46c415b810 msgr2=0x7f46c406ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c3e00640 1 --2- 172.21.15.32:0/624459867 >> v2:172.21.15.171:3300/0 conn(0x7f46c415b810 0x7f46c406ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c3e00640 1 -- 172.21.15.32:0/624459867 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c40d00e0 con 0x7f46c415bbf0 2024-03-19T06:21:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c3e00640 1 -- 172.21.15.32:0/624459867 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f46bc001a00 con 0x7f46c415bbf0 2024-03-19T06:21:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c3e00640 1 -- 172.21.15.32:0/624459867 >> v1:172.21.15.32:6789/0 conn(0x7f46c415bbf0 legacy=0x7f46c40ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:18.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c3e00640 1 --2- 172.21.15.32:0/624459867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46ac0039c0 0x7f46ac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c3e00640 1 --2- 172.21.15.32:0/624459867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46ac004810 0x7f46ac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c3e00640 1 --2- 172.21.15.32:0/624459867 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46c40b2d70 0x7f46ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c3e00640 1 -- 172.21.15.32:0/624459867 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40cfb20 con 0x7f46ac004810 2024-03-19T06:21:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c3e00640 1 -- 172.21.15.32:0/624459867 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40cfe00 con 0x7f46ac0039c0 2024-03-19T06:21:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c3e00640 1 -- 172.21.15.32:0/624459867 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac00b9d0 con 0x7f46c40b2d70 2024-03-19T06:21:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c8a00640 1 --2- 172.21.15.32:0/624459867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46ac004810 0x7f46ac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c9400640 1 --2- 172.21.15.32:0/624459867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46ac0039c0 0x7f46ac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c9e00640 1 --2- 172.21.15.32:0/624459867 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46c40b2d70 0x7f46ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c8a00640 1 -- 172.21.15.32:0/624459867 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46c40b2d70 msgr2=0x7f46ac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c8a00640 1 --2- 172.21.15.32:0/624459867 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46c40b2d70 0x7f46ac0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c8a00640 1 -- 172.21.15.32:0/624459867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46ac0039c0 msgr2=0x7f46ac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c8a00640 1 --2- 172.21.15.32:0/624459867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46ac0039c0 0x7f46ac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.840+0000 7f46c8a00640 1 -- 172.21.15.32:0/624459867 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac003530 con 0x7f46ac004810 2024-03-19T06:21:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.844+0000 7f46c8a00640 1 --2- 172.21.15.32:0/624459867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46ac004810 0x7f46ac004c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009ae0 tx=0x7f46b001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf627140526c235c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.844+0000 7f46c3e00640 1 -- 172.21.15.32:0/624459867 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b00096b0 con 0x7f46ac004810 2024-03-19T06:21:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.844+0000 7f46c3e00640 1 -- 172.21.15.32:0/624459867 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b00a9430 con 0x7f46ac004810 2024-03-19T06:21:18.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.844+0000 7f46c3e00640 1 -- 172.21.15.32:0/624459867 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b00a9820 con 0x7f46ac004810 2024-03-19T06:21:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.844+0000 7f46cbe00640 1 -- 172.21.15.32:0/624459867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46ac004810 msgr2=0x7f46ac004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.844+0000 7f46cbe00640 1 --2- 172.21.15.32:0/624459867 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46ac004810 0x7f46ac004c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009ae0 tx=0x7f46b001ca30 comp rx=0 tx=0).stop 2024-03-19T06:21:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.844+0000 7f46c9e00640 1 -- 172.21.15.32:0/624459867 reap_dead start 2024-03-19T06:21:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.844+0000 7f46cbe00640 1 -- 172.21.15.32:0/624459867 shutdown_connections 2024-03-19T06:21:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.844+0000 7f46cbe00640 1 -- 172.21.15.32:0/624459867 >> 172.21.15.32:0/624459867 conn(0x7f46c40b2250 msgr2=0x7f46c40b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.844+0000 7f46cbe00640 1 -- 172.21.15.32:0/624459867 shutdown_connections 2024-03-19T06:21:18.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.844+0000 7f46cbe00640 1 -- 172.21.15.32:0/624459867 wait complete. 2024-03-19T06:21:18.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46cbe00640 1 Processor -- start 2024-03-19T06:21:18.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46cbe00640 1 -- start start 2024-03-19T06:21:18.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46cbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46ac004810 0x7f46c40c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46cbe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46c40c5770 0x7f46c40c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46cbe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46c40b56c0 0x7f46c414a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46cbe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c406b610 con 0x7f46ac004810 2024-03-19T06:21:18.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46cbe00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c406b490 con 0x7f46c40c5770 2024-03-19T06:21:18.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46cbe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c41669a0 con 0x7f46c40b56c0 2024-03-19T06:21:18.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46c9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46ac004810 0x7f46c40c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46c9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46ac004810 0x7f46c40c6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45702/0 (socket says 172.21.15.32:45702) 2024-03-19T06:21:18.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46c9400640 1 -- 172.21.15.32:0/3106011647 learned_addr learned my addr 172.21.15.32:0/3106011647 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:18.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46c8a00640 1 --2- 172.21.15.32:0/3106011647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46c40c5770 0x7f46c40c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46c9e00640 1 --2- 172.21.15.32:0/3106011647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46c40b56c0 0x7f46c414a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46c9400640 1 -- 172.21.15.32:0/3106011647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46c40b56c0 msgr2=0x7f46c414a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:18.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46c9400640 1 --2- 172.21.15.32:0/3106011647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46c40b56c0 0x7f46c414a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46c9400640 1 -- 172.21.15.32:0/3106011647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46c40c5770 msgr2=0x7f46c40c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:18.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46c9400640 1 --2- 172.21.15.32:0/3106011647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46c40c5770 0x7f46c40c4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:18.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46c9400640 1 -- 172.21.15.32:0/3106011647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c40c5ce0 con 0x7f46ac004810 2024-03-19T06:21:18.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46c9400640 1 --2- 172.21.15.32:0/3106011647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46ac004810 0x7f46c40c6d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f46b8011aa0 tx=0x7f46b8011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:18.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46c1600640 1 -- 172.21.15.32:0/3106011647 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b800fb80 con 0x7f46ac004810 2024-03-19T06:21:18.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46c1600640 1 -- 172.21.15.32:0/3106011647 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b800fd20 con 0x7f46ac004810 2024-03-19T06:21:18.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46c1600640 1 -- 172.21.15.32:0/3106011647 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8014680 con 0x7f46ac004810 2024-03-19T06:21:18.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46cbe00640 1 -- 172.21.15.32:0/3106011647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c40c5fc0 con 0x7f46ac004810 2024-03-19T06:21:18.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46cbe00640 1 -- 172.21.15.32:0/3106011647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c40c6580 con 0x7f46ac004810 2024-03-19T06:21:18.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.848+0000 7f46cbe00640 1 -- 172.21.15.32:0/3106011647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c406cde0 con 0x7f46ac004810 2024-03-19T06:21:18.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.852+0000 7f46c1600640 1 -- 172.21.15.32:0/3106011647 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f46b8012040 con 0x7f46ac004810 2024-03-19T06:21:18.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.852+0000 7f46c1600640 1 --2- 172.21.15.32:0/3106011647 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f46a4067660 0x7f46a4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:18.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.852+0000 7f46c1600640 1 -- 172.21.15.32:0/3106011647 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46b8086130 con 0x7f46ac004810 2024-03-19T06:21:18.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.852+0000 7f46c8a00640 1 --2- 172.21.15.32:0/3106011647 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f46a4067660 0x7f46a4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:18.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.852+0000 7f46c8a00640 1 --2- 172.21.15.32:0/3106011647 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f46a4067660 0x7f46a4069b20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f46b00ae000 tx=0x7f46b00046d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:18.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:18.856+0000 7f46c1600640 1 -- 172.21.15.32:0/3106011647 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f46b8019030 con 0x7f46ac004810 2024-03-19T06:21:19.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.052+0000 7f46cbe00640 1 -- 172.21.15.32:0/3106011647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f46c40cdf90 con 0x7f46ac004810 2024-03-19T06:21:19.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.052+0000 7f46c1600640 1 -- 172.21.15.32:0/3106011647 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f46b8056d10 con 0x7f46ac004810 2024-03-19T06:21:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:19.046 INFO:teuthology.orchestra.run.smithi032.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-19T06:21:19.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.056+0000 7f46cbe00640 1 -- 172.21.15.32:0/3106011647 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f46a4067660 msgr2=0x7f46a4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.056+0000 7f46cbe00640 1 --2- 172.21.15.32:0/3106011647 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f46a4067660 0x7f46a4069b20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f46b00ae000 tx=0x7f46b00046d0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.056+0000 7f46cbe00640 1 -- 172.21.15.32:0/3106011647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46ac004810 msgr2=0x7f46c40c6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.056+0000 7f46cbe00640 1 --2- 172.21.15.32:0/3106011647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46ac004810 0x7f46c40c6d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f46b8011aa0 tx=0x7f46b8011f60 comp rx=0 tx=0).stop 2024-03-19T06:21:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.056+0000 7f46cbe00640 1 -- 172.21.15.32:0/3106011647 shutdown_connections 2024-03-19T06:21:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.056+0000 7f46cbe00640 1 --2- 172.21.15.32:0/3106011647 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f46a4067660 0x7f46a4069b20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.056+0000 7f46cbe00640 1 --2- 172.21.15.32:0/3106011647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46c40b56c0 0x7f46c414a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.056+0000 7f46cbe00640 1 --2- 172.21.15.32:0/3106011647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46c40c5770 0x7f46c40c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.056+0000 7f46cbe00640 1 --2- 172.21.15.32:0/3106011647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46ac004810 0x7f46c40c6d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.056+0000 7f46cbe00640 1 -- 172.21.15.32:0/3106011647 >> 172.21.15.32:0/3106011647 conn(0x7f46c40b2250 msgr2=0x7f46c40b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.056+0000 7f46cbe00640 1 -- 172.21.15.32:0/3106011647 shutdown_connections 2024-03-19T06:21:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.056+0000 7f46cbe00640 1 -- 172.21.15.32:0/3106011647 wait complete. 2024-03-19T06:21:19.067 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-19T06:21:19.067 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:19.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.216+0000 7fa251e00640 1 Processor -- start 2024-03-19T06:21:19.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.216+0000 7fa251e00640 1 -- start start 2024-03-19T06:21:19.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.216+0000 7fa251e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa24c0cc680 0x7fa24c15ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.216+0000 7fa251e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa24c0b4c50 0x7fa24c0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.216+0000 7fa251e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24c0cb670 con 0x7fa24c15a7c0 2024-03-19T06:21:19.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.216+0000 7fa251e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24c15e860 con 0x7fa24c0b4c50 2024-03-19T06:21:19.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.216+0000 7fa251e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0cb950 con 0x7fa24c0cc680 2024-03-19T06:21:19.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.216+0000 7fa24b400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa24c0b4c50 0x7fa24c0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.216+0000 7fa24a000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa24c0cc680 0x7fa24c15ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.216+0000 7fa24aa00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fa24c15a7c0 0x7fa24c0cae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:56956/0 (socket says 172.21.15.32:56956) 2024-03-19T06:21:19.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.216+0000 7fa24aa00640 1 -- 172.21.15.32:0/3268546222 learned_addr learned my addr 172.21.15.32:0/3268546222 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:19.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.216+0000 7fa24b400640 1 -- 172.21.15.32:0/3268546222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa24c0cc680 msgr2=0x7fa24c15ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:19.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.216+0000 7fa24b400640 1 --2- 172.21.15.32:0/3268546222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa24c0cc680 0x7fa24c15ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.216+0000 7fa24b400640 1 -- 172.21.15.32:0/3268546222 >> v1:172.21.15.171:6789/0 conn(0x7fa24c15a7c0 legacy=0x7fa24c0cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.216+0000 7fa24b400640 1 -- 172.21.15.32:0/3268546222 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c15e4f0 con 0x7fa24c0b4c50 2024-03-19T06:21:19.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.220+0000 7fa24b400640 1 --2- 172.21.15.32:0/3268546222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa24c0b4c50 0x7fa24c0b50e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa24400bfa0 tx=0x7fa24401eae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e00913bf67be2a26 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:19.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.220+0000 7fa249600640 1 -- 172.21.15.32:0/3268546222 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400b2d0 con 0x7fa24c0b4c50 2024-03-19T06:21:19.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.220+0000 7fa249600640 1 -- 172.21.15.32:0/3268546222 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2440a78c0 con 0x7fa24c0b4c50 2024-03-19T06:21:19.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.220+0000 7fa249600640 1 -- 172.21.15.32:0/3268546222 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2440a7c90 con 0x7fa24c0b4c50 2024-03-19T06:21:19.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.220+0000 7fa251e00640 1 -- 172.21.15.32:0/3268546222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa24c0b4c50 msgr2=0x7fa24c0b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.220+0000 7fa251e00640 1 --2- 172.21.15.32:0/3268546222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa24c0b4c50 0x7fa24c0b50e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa24400bfa0 tx=0x7fa24401eae0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.220+0000 7fa251e00640 1 -- 172.21.15.32:0/3268546222 shutdown_connections 2024-03-19T06:21:19.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.220+0000 7fa251e00640 1 --2- 172.21.15.32:0/3268546222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa24c0b4c50 0x7fa24c0b50e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.220+0000 7fa251e00640 1 --2- 172.21.15.32:0/3268546222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa24c0cc680 0x7fa24c15ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.220+0000 7fa251e00640 1 -- 172.21.15.32:0/3268546222 >> 172.21.15.32:0/3268546222 conn(0x7fa24c0b1280 msgr2=0x7fa24c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:19.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.220+0000 7fa251e00640 1 -- 172.21.15.32:0/3268546222 shutdown_connections 2024-03-19T06:21:19.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.220+0000 7fa251e00640 1 -- 172.21.15.32:0/3268546222 wait complete. 2024-03-19T06:21:19.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa251e00640 1 Processor -- start 2024-03-19T06:21:19.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa251e00640 1 -- start start 2024-03-19T06:21:19.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa251e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa24c0b4c50 0x7fa24c152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa251e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa24c0cc680 0x7fa24c143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa251e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa24c15a7c0 0x7fa24c148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa251e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c071350 con 0x7fa24c0cc680 2024-03-19T06:21:19.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa251e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0cbe40 con 0x7fa24c0b4c50 2024-03-19T06:21:19.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa251e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0714d0 con 0x7fa24c15a7c0 2024-03-19T06:21:19.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa24a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa24c0cc680 0x7fa24c143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa24a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa24c0cc680 0x7fa24c143e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45714/0 (socket says 172.21.15.32:45714) 2024-03-19T06:21:19.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa24a000640 1 -- 172.21.15.32:0/4118559712 learned_addr learned my addr 172.21.15.32:0/4118559712 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:19.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa24aa00640 1 --2- 172.21.15.32:0/4118559712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa24c0b4c50 0x7fa24c152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa24b400640 1 --2- 172.21.15.32:0/4118559712 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa24c15a7c0 0x7fa24c148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa24a000640 1 -- 172.21.15.32:0/4118559712 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa24c15a7c0 msgr2=0x7fa24c148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa24a000640 1 --2- 172.21.15.32:0/4118559712 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa24c15a7c0 0x7fa24c148430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa24a000640 1 -- 172.21.15.32:0/4118559712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa24c0b4c50 msgr2=0x7fa24c152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa24a000640 1 --2- 172.21.15.32:0/4118559712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa24c0b4c50 0x7fa24c152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa24a000640 1 -- 172.21.15.32:0/4118559712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c15c5f0 con 0x7fa24c0cc680 2024-03-19T06:21:19.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa24a000640 1 --2- 172.21.15.32:0/4118559712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa24c0cc680 0x7fa24c143e50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa23800e930 tx=0x7fa23800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:19.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa243400640 1 -- 172.21.15.32:0/4118559712 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238017070 con 0x7fa24c0cc680 2024-03-19T06:21:19.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa243400640 1 -- 172.21.15.32:0/4118559712 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23800ca00 con 0x7fa24c0cc680 2024-03-19T06:21:19.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa243400640 1 -- 172.21.15.32:0/4118559712 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23800cdb0 con 0x7fa24c0cc680 2024-03-19T06:21:19.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa251e00640 1 -- 172.21.15.32:0/4118559712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24c15c8d0 con 0x7fa24c0cc680 2024-03-19T06:21:19.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa251e00640 1 -- 172.21.15.32:0/4118559712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c15ce90 con 0x7fa24c0cc680 2024-03-19T06:21:19.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.224+0000 7fa251e00640 1 -- 172.21.15.32:0/4118559712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24c0749e0 con 0x7fa24c0cc680 2024-03-19T06:21:19.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.228+0000 7fa243400640 1 -- 172.21.15.32:0/4118559712 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa23801a070 con 0x7fa24c0cc680 2024-03-19T06:21:19.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.228+0000 7fa243400640 1 --2- 172.21.15.32:0/4118559712 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa22c067660 0x7fa22c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.228+0000 7fa243400640 1 -- 172.21.15.32:0/4118559712 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa238085c80 con 0x7fa24c0cc680 2024-03-19T06:21:19.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.228+0000 7fa24aa00640 1 --2- 172.21.15.32:0/4118559712 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa22c067660 0x7fa22c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.228+0000 7fa24aa00640 1 --2- 172.21.15.32:0/4118559712 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa22c067660 0x7fa22c069b20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa23c000f70 tx=0x7fa23c007e90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:19.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.232+0000 7fa243400640 1 -- 172.21.15.32:0/4118559712 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fa2380562d0 con 0x7fa24c0cc680 2024-03-19T06:21:19.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.396+0000 7fa251e00640 1 -- 172.21.15.32:0/4118559712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa24c0cc270 con 0x7fa24c0cc680 2024-03-19T06:21:19.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.400+0000 7fa243400640 1 -- 172.21.15.32:0/4118559712 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16617 (secure 0 0 0) 0x7fa23805a370 con 0x7fa24c0cc680 2024-03-19T06:21:19.391 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:19.391 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:10.423479+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:19.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.400+0000 7fa251e00640 1 -- 172.21.15.32:0/4118559712 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa22c067660 msgr2=0x7fa22c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.400+0000 7fa251e00640 1 --2- 172.21.15.32:0/4118559712 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa22c067660 0x7fa22c069b20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa23c000f70 tx=0x7fa23c007e90 comp rx=0 tx=0).stop 2024-03-19T06:21:19.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.400+0000 7fa251e00640 1 -- 172.21.15.32:0/4118559712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa24c0cc680 msgr2=0x7fa24c143e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.400+0000 7fa251e00640 1 --2- 172.21.15.32:0/4118559712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa24c0cc680 0x7fa24c143e50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa23800e930 tx=0x7fa23800edf0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.400+0000 7fa251e00640 1 -- 172.21.15.32:0/4118559712 shutdown_connections 2024-03-19T06:21:19.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.400+0000 7fa251e00640 1 --2- 172.21.15.32:0/4118559712 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa22c067660 0x7fa22c069b20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.400+0000 7fa251e00640 1 --2- 172.21.15.32:0/4118559712 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa24c15a7c0 0x7fa24c148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.400+0000 7fa251e00640 1 --2- 172.21.15.32:0/4118559712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa24c0cc680 0x7fa24c143e50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.400+0000 7fa251e00640 1 --2- 172.21.15.32:0/4118559712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa24c0b4c50 0x7fa24c152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.400+0000 7fa251e00640 1 -- 172.21.15.32:0/4118559712 >> 172.21.15.32:0/4118559712 conn(0x7fa24c0b1280 msgr2=0x7fa24c0cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:19.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.400+0000 7fa251e00640 1 -- 172.21.15.32:0/4118559712 shutdown_connections 2024-03-19T06:21:19.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.400+0000 7fa251e00640 1 -- 172.21.15.32:0/4118559712 wait complete. 2024-03-19T06:21:19.412 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:21:07.089673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:21:07.801319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:19.413 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:19.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.564+0000 7f6a91400640 1 Processor -- start 2024-03-19T06:21:19.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.564+0000 7f6a91400640 1 -- start start 2024-03-19T06:21:19.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.564+0000 7f6a91400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a8c06eed0 0x7f6a8c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.564+0000 7f6a91400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6a8c06e320 0x7f6a8c15bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.564+0000 7f6a91400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8c0cc290 con 0x7f6a8c06ad40 2024-03-19T06:21:19.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.564+0000 7f6a91400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c06dbb0 con 0x7f6a8c06eed0 2024-03-19T06:21:19.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.564+0000 7f6a91400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c0cc570 con 0x7f6a8c06e320 2024-03-19T06:21:19.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.564+0000 7f6a83e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a8c06eed0 0x7f6a8c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.564+0000 7f6a83e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a8c06eed0 0x7f6a8c0ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45728/0 (socket says 172.21.15.32:45728) 2024-03-19T06:21:19.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.564+0000 7f6a83e00640 1 -- 172.21.15.32:0/1004389350 learned_addr learned my addr 172.21.15.32:0/1004389350 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:19.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.568+0000 7f6a8b200640 1 --2- 172.21.15.32:0/1004389350 >> v2:172.21.15.171:3300/0 conn(0x7f6a8c06e320 0x7f6a8c15bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.568+0000 7f6a83e00640 1 -- 172.21.15.32:0/1004389350 >> v2:172.21.15.171:3300/0 conn(0x7f6a8c06e320 msgr2=0x7f6a8c15bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:19.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.568+0000 7f6a83e00640 1 --2- 172.21.15.32:0/1004389350 >> v2:172.21.15.171:3300/0 conn(0x7f6a8c06e320 0x7f6a8c15bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.568+0000 7f6a83e00640 1 -- 172.21.15.32:0/1004389350 >> v1:172.21.15.171:6789/0 conn(0x7f6a8c06ad40 legacy=0x7f6a8c06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:19.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.568+0000 7f6a83e00640 1 -- 172.21.15.32:0/1004389350 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c0cc850 con 0x7f6a8c06eed0 2024-03-19T06:21:19.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.568+0000 7f6a83e00640 1 --2- 172.21.15.32:0/1004389350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a8c06eed0 0x7f6a8c0ccd10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c06f7f0 tx=0x7f6a7401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7242657d037b65 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:19.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.568+0000 7f6a89e00640 1 -- 172.21.15.32:0/1004389350 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a740ab640 con 0x7f6a8c06eed0 2024-03-19T06:21:19.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.568+0000 7f6a89e00640 1 -- 172.21.15.32:0/1004389350 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a740b0070 con 0x7f6a8c06eed0 2024-03-19T06:21:19.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.568+0000 7f6a89e00640 1 -- 172.21.15.32:0/1004389350 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a740aba00 con 0x7f6a8c06eed0 2024-03-19T06:21:19.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.568+0000 7f6a91400640 1 -- 172.21.15.32:0/1004389350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a8c06eed0 msgr2=0x7f6a8c0ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.568+0000 7f6a91400640 1 --2- 172.21.15.32:0/1004389350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a8c06eed0 0x7f6a8c0ccd10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c06f7f0 tx=0x7f6a7401c420 comp rx=0 tx=0).stop 2024-03-19T06:21:19.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.568+0000 7f6a91400640 1 -- 172.21.15.32:0/1004389350 shutdown_connections 2024-03-19T06:21:19.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a91400640 1 --2- 172.21.15.32:0/1004389350 >> v2:172.21.15.171:3300/0 conn(0x7f6a8c06e320 0x7f6a8c15bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a91400640 1 --2- 172.21.15.32:0/1004389350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a8c06eed0 0x7f6a8c0ccd10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a91400640 1 -- 172.21.15.32:0/1004389350 >> 172.21.15.32:0/1004389350 conn(0x7f6a8c0b1590 msgr2=0x7f6a8c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:19.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a91400640 1 -- 172.21.15.32:0/1004389350 shutdown_connections 2024-03-19T06:21:19.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a91400640 1 -- 172.21.15.32:0/1004389350 wait complete. 2024-03-19T06:21:19.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a91400640 1 Processor -- start 2024-03-19T06:21:19.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a91400640 1 -- start start 2024-03-19T06:21:19.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a91400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a8c06ad40 0x7f6a8c154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a91400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a8c06e320 0x7f6a8c141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a91400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a8c06eed0 0x7f6a8c142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a91400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c1688a0 con 0x7f6a8c06e320 2024-03-19T06:21:19.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a91400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c168720 con 0x7f6a8c06ad40 2024-03-19T06:21:19.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a91400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c168a20 con 0x7f6a8c06eed0 2024-03-19T06:21:19.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a83e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a8c06e320 0x7f6a8c141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a83e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a8c06e320 0x7f6a8c141e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45740/0 (socket says 172.21.15.32:45740) 2024-03-19T06:21:19.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a83e00640 1 -- 172.21.15.32:0/1846743125 learned_addr learned my addr 172.21.15.32:0/1846743125 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:19.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a8a800640 1 --2- 172.21.15.32:0/1846743125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a8c06ad40 0x7f6a8c154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a8b200640 1 --2- 172.21.15.32:0/1846743125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a8c06eed0 0x7f6a8c142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a83e00640 1 -- 172.21.15.32:0/1846743125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a8c06eed0 msgr2=0x7f6a8c142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a83e00640 1 --2- 172.21.15.32:0/1846743125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a8c06eed0 0x7f6a8c142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a83e00640 1 -- 172.21.15.32:0/1846743125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a8c06ad40 msgr2=0x7f6a8c154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a83e00640 1 --2- 172.21.15.32:0/1846743125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a8c06ad40 0x7f6a8c154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a83e00640 1 -- 172.21.15.32:0/1846743125 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c0b35f0 con 0x7f6a8c06e320 2024-03-19T06:21:19.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a8b200640 1 --2- 172.21.15.32:0/1846743125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a8c06eed0 0x7f6a8c142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:19.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.572+0000 7f6a83e00640 1 --2- 172.21.15.32:0/1846743125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a8c06e320 0x7f6a8c141e30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6a740ad040 tx=0x7f6a7401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:19.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.576+0000 7f6a82a00640 1 -- 172.21.15.32:0/1846743125 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a740be3f0 con 0x7f6a8c06e320 2024-03-19T06:21:19.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.576+0000 7f6a82a00640 1 -- 172.21.15.32:0/1846743125 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c15c9a0 con 0x7f6a8c06e320 2024-03-19T06:21:19.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.576+0000 7f6a82a00640 1 -- 172.21.15.32:0/1846743125 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a740be7f0 con 0x7f6a8c06e320 2024-03-19T06:21:19.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.576+0000 7f6a91400640 1 -- 172.21.15.32:0/1846743125 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c0b38d0 con 0x7f6a8c06e320 2024-03-19T06:21:19.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.576+0000 7f6a91400640 1 -- 172.21.15.32:0/1846743125 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c0b3e90 con 0x7f6a8c06e320 2024-03-19T06:21:19.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.576+0000 7f6a91400640 1 -- 172.21.15.32:0/1846743125 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c0749e0 con 0x7f6a8c06e320 2024-03-19T06:21:19.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.576+0000 7f6a82a00640 1 -- 172.21.15.32:0/1846743125 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6a740b43f0 con 0x7f6a8c06e320 2024-03-19T06:21:19.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.576+0000 7f6a82a00640 1 --2- 172.21.15.32:0/1846743125 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6a68067660 0x7f6a68069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.576+0000 7f6a82a00640 1 -- 172.21.15.32:0/1846743125 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a7411fd70 con 0x7f6a8c06e320 2024-03-19T06:21:19.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.576+0000 7f6a8a800640 1 --2- 172.21.15.32:0/1846743125 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6a68067660 0x7f6a68069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.576+0000 7f6a8a800640 1 --2- 172.21.15.32:0/1846743125 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6a68067660 0x7f6a68069b20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c007fd0 tx=0x7f6a7c007e40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:19.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.580+0000 7f6a82a00640 1 -- 172.21.15.32:0/1846743125 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f6a740c4060 con 0x7f6a8c06e320 2024-03-19T06:21:19.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.744+0000 7f6a91400640 1 -- 172.21.15.32:0/1846743125 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a8c15bcc0 con 0x7f6a8c06e320 2024-03-19T06:21:19.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.744+0000 7f6a82a00640 1 -- 172.21.15.32:0/1846743125 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a740160d0 con 0x7f6a8c06e320 2024-03-19T06:21:19.736 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:19.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.744+0000 7f6a91400640 1 -- 172.21.15.32:0/1846743125 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6a68067660 msgr2=0x7f6a68069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.744+0000 7f6a91400640 1 --2- 172.21.15.32:0/1846743125 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6a68067660 0x7f6a68069b20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c007fd0 tx=0x7f6a7c007e40 comp rx=0 tx=0).stop 2024-03-19T06:21:19.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.744+0000 7f6a91400640 1 -- 172.21.15.32:0/1846743125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a8c06e320 msgr2=0x7f6a8c141e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.744+0000 7f6a91400640 1 --2- 172.21.15.32:0/1846743125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a8c06e320 0x7f6a8c141e30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6a740ad040 tx=0x7f6a7401ac60 comp rx=0 tx=0).stop 2024-03-19T06:21:19.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.744+0000 7f6a91400640 1 -- 172.21.15.32:0/1846743125 shutdown_connections 2024-03-19T06:21:19.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.744+0000 7f6a91400640 1 --2- 172.21.15.32:0/1846743125 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6a68067660 0x7f6a68069b20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.744+0000 7f6a91400640 1 --2- 172.21.15.32:0/1846743125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a8c06eed0 0x7f6a8c142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.744+0000 7f6a91400640 1 --2- 172.21.15.32:0/1846743125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a8c06e320 0x7f6a8c141e30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.744+0000 7f6a91400640 1 --2- 172.21.15.32:0/1846743125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a8c06ad40 0x7f6a8c154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.744+0000 7f6a91400640 1 -- 172.21.15.32:0/1846743125 >> 172.21.15.32:0/1846743125 conn(0x7f6a8c0b1590 msgr2=0x7f6a8c1556b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:19.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.744+0000 7f6a91400640 1 -- 172.21.15.32:0/1846743125 shutdown_connections 2024-03-19T06:21:19.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.744+0000 7f6a91400640 1 -- 172.21.15.32:0/1846743125 wait complete. 2024-03-19T06:21:19.756 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:21:19.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.908+0000 7f6c1e800640 1 Processor -- start 2024-03-19T06:21:19.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.908+0000 7f6c1e800640 1 -- start start 2024-03-19T06:21:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.908+0000 7f6c1e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6c1815dbb0 0x7f6c1806c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.908+0000 7f6c1e800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6c180b3d30 0x7f6c180cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.908+0000 7f6c1e800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c180cbf00 con 0x7f6c1806c5a0 2024-03-19T06:21:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.908+0000 7f6c1e800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1806cb20 con 0x7f6c1815dbb0 2024-03-19T06:21:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.908+0000 7f6c1e800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1806ce00 con 0x7f6c180b3d30 2024-03-19T06:21:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.908+0000 7f6c17400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6c1815dbb0 0x7f6c1806c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.908+0000 7f6c17400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6c1815dbb0 0x7f6c1806c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45744/0 (socket says 172.21.15.32:45744) 2024-03-19T06:21:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.908+0000 7f6c17400640 1 -- 172.21.15.32:0/3329462132 learned_addr learned my addr 172.21.15.32:0/3329462132 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.908+0000 7f6c17e00640 1 --2- 172.21.15.32:0/3329462132 >> v2:172.21.15.171:3300/0 conn(0x7f6c180b3d30 0x7f6c180cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.908+0000 7f6c17400640 1 -- 172.21.15.32:0/3329462132 >> v2:172.21.15.171:3300/0 conn(0x7f6c180b3d30 msgr2=0x7f6c180cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.908+0000 7f6c17400640 1 --2- 172.21.15.32:0/3329462132 >> v2:172.21.15.171:3300/0 conn(0x7f6c180b3d30 0x7f6c180cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.908+0000 7f6c17400640 1 -- 172.21.15.32:0/3329462132 >> v1:172.21.15.171:6789/0 conn(0x7f6c1806c5a0 legacy=0x7f6c180b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.908+0000 7f6c17400640 1 -- 172.21.15.32:0/3329462132 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1806d0e0 con 0x7f6c1815dbb0 2024-03-19T06:21:19.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.912+0000 7f6c17400640 1 --2- 172.21.15.32:0/3329462132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c1815dbb0 0x7f6c1806c060 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6c180b7940 tx=0x7f6c0801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c4d9eb666c93af server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:19.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.912+0000 7f6c16a00640 1 -- 172.21.15.32:0/3329462132 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c080b5070 con 0x7f6c1815dbb0 2024-03-19T06:21:19.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.912+0000 7f6c16a00640 1 -- 172.21.15.32:0/3329462132 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c080a8a10 con 0x7f6c1815dbb0 2024-03-19T06:21:19.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.912+0000 7f6c16a00640 1 -- 172.21.15.32:0/3329462132 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c080a8de0 con 0x7f6c1815dbb0 2024-03-19T06:21:19.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.912+0000 7f6c1e800640 1 -- 172.21.15.32:0/3329462132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c1815dbb0 msgr2=0x7f6c1806c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.912+0000 7f6c1e800640 1 --2- 172.21.15.32:0/3329462132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c1815dbb0 0x7f6c1806c060 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6c180b7940 tx=0x7f6c0801ed10 comp rx=0 tx=0).stop 2024-03-19T06:21:19.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.912+0000 7f6c1e800640 1 -- 172.21.15.32:0/3329462132 shutdown_connections 2024-03-19T06:21:19.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.912+0000 7f6c1e800640 1 --2- 172.21.15.32:0/3329462132 >> v2:172.21.15.171:3300/0 conn(0x7f6c180b3d30 0x7f6c180cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.912+0000 7f6c1e800640 1 --2- 172.21.15.32:0/3329462132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c1815dbb0 0x7f6c1806c060 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.912+0000 7f6c1e800640 1 -- 172.21.15.32:0/3329462132 >> 172.21.15.32:0/3329462132 conn(0x7f6c18066ca0 msgr2=0x7f6c180670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:19.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.912+0000 7f6c1e800640 1 -- 172.21.15.32:0/3329462132 shutdown_connections 2024-03-19T06:21:19.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.912+0000 7f6c1e800640 1 -- 172.21.15.32:0/3329462132 wait complete. 2024-03-19T06:21:19.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.912+0000 7f6c1e800640 1 Processor -- start 2024-03-19T06:21:19.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.912+0000 7f6c1e800640 1 -- start start 2024-03-19T06:21:19.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c1e800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c1806c5a0 0x7f6c181587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c1e800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c180b3d30 0x7f6c1815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c1e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c1815dbb0 0x7f6c181f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c1e800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1815df90 con 0x7f6c1815dbb0 2024-03-19T06:21:19.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c1e800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1806d910 con 0x7f6c180b3d30 2024-03-19T06:21:19.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c1e800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c180ccc00 con 0x7f6c1806c5a0 2024-03-19T06:21:19.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c17e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c1815dbb0 0x7f6c181f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c17e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c1815dbb0 0x7f6c181f3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45752/0 (socket says 172.21.15.32:45752) 2024-03-19T06:21:19.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c17e00640 1 -- 172.21.15.32:0/2735102788 learned_addr learned my addr 172.21.15.32:0/2735102788 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:19.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c17400640 1 --2- 172.21.15.32:0/2735102788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c1806c5a0 0x7f6c181587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c0ea00640 1 --2- 172.21.15.32:0/2735102788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c180b3d30 0x7f6c1815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c17e00640 1 -- 172.21.15.32:0/2735102788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c1806c5a0 msgr2=0x7f6c181587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c17e00640 1 --2- 172.21.15.32:0/2735102788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c1806c5a0 0x7f6c181587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c17e00640 1 -- 172.21.15.32:0/2735102788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c180b3d30 msgr2=0x7f6c1815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:19.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c17e00640 1 --2- 172.21.15.32:0/2735102788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c180b3d30 0x7f6c1815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:19.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c17e00640 1 -- 172.21.15.32:0/2735102788 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1815b110 con 0x7f6c1815dbb0 2024-03-19T06:21:19.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c0ea00640 1 --2- 172.21.15.32:0/2735102788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c180b3d30 0x7f6c1815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:19.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c17e00640 1 --2- 172.21.15.32:0/2735102788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c1815dbb0 0x7f6c181f3590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000efc0 tx=0x7f6c1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:19.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c0fe00640 1 -- 172.21.15.32:0/2735102788 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10018020 con 0x7f6c1815dbb0 2024-03-19T06:21:19.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c0fe00640 1 -- 172.21.15.32:0/2735102788 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c10014480 con 0x7f6c1815dbb0 2024-03-19T06:21:19.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c0fe00640 1 -- 172.21.15.32:0/2735102788 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10014870 con 0x7f6c1815dbb0 2024-03-19T06:21:19.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c1e800640 1 -- 172.21.15.32:0/2735102788 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1815b3b0 con 0x7f6c1815dbb0 2024-03-19T06:21:19.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c1e800640 1 -- 172.21.15.32:0/2735102788 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c180c9a50 con 0x7f6c1815dbb0 2024-03-19T06:21:19.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.916+0000 7f6c1e800640 1 -- 172.21.15.32:0/2735102788 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c180749e0 con 0x7f6c1815dbb0 2024-03-19T06:21:19.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.920+0000 7f6c0fe00640 1 -- 172.21.15.32:0/2735102788 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6c1001b020 con 0x7f6c1815dbb0 2024-03-19T06:21:19.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.920+0000 7f6c0fe00640 1 --2- 172.21.15.32:0/2735102788 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6bf4067660 0x7f6bf4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:19.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.920+0000 7f6c0fe00640 1 -- 172.21.15.32:0/2735102788 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c10086220 con 0x7f6c1815dbb0 2024-03-19T06:21:19.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.920+0000 7f6c17400640 1 --2- 172.21.15.32:0/2735102788 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6bf4067660 0x7f6bf4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:19.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.920+0000 7f6c17400640 1 --2- 172.21.15.32:0/2735102788 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6bf4067660 0x7f6bf4069b20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6c080b2000 tx=0x7f6c08009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:19.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:19.924+0000 7f6c0fe00640 1 -- 172.21.15.32:0/2735102788 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f6c10022070 con 0x7f6c1815dbb0 2024-03-19T06:21:20.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.088+0000 7f6c1e800640 1 -- 172.21.15.32:0/2735102788 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c1815b8d0 con 0x7f6c1815dbb0 2024-03-19T06:21:20.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.088+0000 7f6c0fe00640 1 -- 172.21.15.32:0/2735102788 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c10010040 con 0x7f6c1815dbb0 2024-03-19T06:21:20.081 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:21:20.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.088+0000 7f6c1e800640 1 -- 172.21.15.32:0/2735102788 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6bf4067660 msgr2=0x7f6bf4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.088+0000 7f6c1e800640 1 --2- 172.21.15.32:0/2735102788 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6bf4067660 0x7f6bf4069b20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6c080b2000 tx=0x7f6c08009040 comp rx=0 tx=0).stop 2024-03-19T06:21:20.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.088+0000 7f6c1e800640 1 -- 172.21.15.32:0/2735102788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c1815dbb0 msgr2=0x7f6c181f3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.088+0000 7f6c1e800640 1 --2- 172.21.15.32:0/2735102788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c1815dbb0 0x7f6c181f3590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000efc0 tx=0x7f6c1000c490 comp rx=0 tx=0).stop 2024-03-19T06:21:20.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.088+0000 7f6c1e800640 1 -- 172.21.15.32:0/2735102788 shutdown_connections 2024-03-19T06:21:20.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.088+0000 7f6c1e800640 1 --2- 172.21.15.32:0/2735102788 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6bf4067660 0x7f6bf4069b20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.088+0000 7f6c1e800640 1 --2- 172.21.15.32:0/2735102788 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c1815dbb0 0x7f6c181f3590 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.088+0000 7f6c1e800640 1 --2- 172.21.15.32:0/2735102788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c180b3d30 0x7f6c1815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.088+0000 7f6c1e800640 1 --2- 172.21.15.32:0/2735102788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c1806c5a0 0x7f6c181587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.088+0000 7f6c1e800640 1 -- 172.21.15.32:0/2735102788 >> 172.21.15.32:0/2735102788 conn(0x7f6c18066ca0 msgr2=0x7f6c180b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:20.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.088+0000 7f6c1e800640 1 -- 172.21.15.32:0/2735102788 shutdown_connections 2024-03-19T06:21:20.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.092+0000 7f6c1e800640 1 -- 172.21.15.32:0/2735102788 wait complete. 2024-03-19T06:21:20.101 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:21:20.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe440200640 1 Processor -- start 2024-03-19T06:21:20.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe440200640 1 -- start start 2024-03-19T06:21:20.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe440200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4380b3a90 0x7fe4380ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe440200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4380cbf00 con 0x7fe43815dbb0 2024-03-19T06:21:20.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe440200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43806cb20 con 0x7fe4380b3620 2024-03-19T06:21:20.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe440200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43806ce00 con 0x7fe4380b3a90 2024-03-19T06:21:20.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe43d800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe43815dbb0 0x7fe43806c060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47738/0 (socket says 172.21.15.32:47738) 2024-03-19T06:21:20.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe43d800640 1 -- 172.21.15.32:0/3157681454 learned_addr learned my addr 172.21.15.32:0/3157681454 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:20.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe43e200640 1 --2- 172.21.15.32:0/3157681454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4380b3a90 0x7fe4380ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 -- 172.21.15.32:0/3157681454 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206184926 0 0) 0x7fe4380cbf00 con 0x7fe43815dbb0 2024-03-19T06:21:20.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 -- 172.21.15.32:0/3157681454 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe420003530 con 0x7fe43815dbb0 2024-03-19T06:21:20.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 -- 172.21.15.32:0/3157681454 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797187813 0 0) 0x7fe43806cb20 con 0x7fe4380b3620 2024-03-19T06:21:20.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 -- 172.21.15.32:0/3157681454 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4380cbf00 con 0x7fe4380b3620 2024-03-19T06:21:20.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 -- 172.21.15.32:0/3157681454 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 241430973 0 0) 0x7fe420003530 con 0x7fe43815dbb0 2024-03-19T06:21:20.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 -- 172.21.15.32:0/3157681454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4380b3a90 msgr2=0x7fe4380ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:20.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 --2- 172.21.15.32:0/3157681454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4380b3a90 0x7fe4380ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 -- 172.21.15.32:0/3157681454 >> v1:172.21.15.171:6789/0 conn(0x7fe4380b3620 legacy=0x7fe4380cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 -- 172.21.15.32:0/3157681454 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43806d0e0 con 0x7fe43815dbb0 2024-03-19T06:21:20.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 -- 172.21.15.32:0/3157681454 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fe42c0016a0 con 0x7fe43815dbb0 2024-03-19T06:21:20.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe43e200640 1 --2- 172.21.15.32:0/3157681454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4380b3a90 0x7fe4380ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:20.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 -- 172.21.15.32:0/3157681454 >> v1:172.21.15.32:6789/0 conn(0x7fe43815dbb0 legacy=0x7fe43806c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 --2- 172.21.15.32:0/3157681454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe420003b80 0x7fe420003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 --2- 172.21.15.32:0/3157681454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4380b3a90 0x7fe420004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 --2- 172.21.15.32:0/3157681454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe420004d50 0x7fe4200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 -- 172.21.15.32:0/3157681454 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43806ce00 con 0x7fe420003b80 2024-03-19T06:21:20.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 -- 172.21.15.32:0/3157681454 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42000ba80 con 0x7fe420004d50 2024-03-19T06:21:20.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe437e00640 1 -- 172.21.15.32:0/3157681454 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42000bc30 con 0x7fe4380b3a90 2024-03-19T06:21:20.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe43d800640 1 --2- 172.21.15.32:0/3157681454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe420003b80 0x7fe420003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe43ce00640 1 --2- 172.21.15.32:0/3157681454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4380b3a90 0x7fe420004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.252+0000 7fe43e200640 1 --2- 172.21.15.32:0/3157681454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe420004d50 0x7fe4200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.256+0000 7fe43d800640 1 -- 172.21.15.32:0/3157681454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4380b3a90 msgr2=0x7fe420004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:20.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.256+0000 7fe43d800640 1 --2- 172.21.15.32:0/3157681454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4380b3a90 0x7fe420004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.256+0000 7fe43d800640 1 -- 172.21.15.32:0/3157681454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe420004d50 msgr2=0x7fe4200051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:20.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.256+0000 7fe43d800640 1 --2- 172.21.15.32:0/3157681454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe420004d50 0x7fe4200051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.256+0000 7fe43d800640 1 -- 172.21.15.32:0/3157681454 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe420003530 con 0x7fe420003b80 2024-03-19T06:21:20.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.256+0000 7fe43d800640 1 --2- 172.21.15.32:0/3157681454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe420003b80 0x7fe420003f80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00c190 tx=0x7fe42c01cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0be5b91001c967 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:20.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.256+0000 7fe437e00640 1 -- 172.21.15.32:0/3157681454 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c007d00 con 0x7fe420003b80 2024-03-19T06:21:20.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.256+0000 7fe437e00640 1 -- 172.21.15.32:0/3157681454 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c0a9020 con 0x7fe420003b80 2024-03-19T06:21:20.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.256+0000 7fe437e00640 1 -- 172.21.15.32:0/3157681454 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0a5b40 con 0x7fe420003b80 2024-03-19T06:21:20.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.256+0000 7fe440200640 1 -- 172.21.15.32:0/3157681454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe420003b80 msgr2=0x7fe420003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.256+0000 7fe440200640 1 --2- 172.21.15.32:0/3157681454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe420003b80 0x7fe420003f80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00c190 tx=0x7fe42c01cba0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.256+0000 7fe43e200640 1 -- 172.21.15.32:0/3157681454 reap_dead start 2024-03-19T06:21:20.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.256+0000 7fe440200640 1 -- 172.21.15.32:0/3157681454 shutdown_connections 2024-03-19T06:21:20.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.256+0000 7fe440200640 1 -- 172.21.15.32:0/3157681454 >> 172.21.15.32:0/3157681454 conn(0x7fe438066ca0 msgr2=0x7fe4380670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:20.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.256+0000 7fe440200640 1 -- 172.21.15.32:0/3157681454 shutdown_connections 2024-03-19T06:21:20.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.256+0000 7fe440200640 1 -- 172.21.15.32:0/3157681454 wait complete. 2024-03-19T06:21:20.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe440200640 1 Processor -- start 2024-03-19T06:21:20.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe440200640 1 -- start start 2024-03-19T06:21:20.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe440200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe420003b80 0x7fe4381f42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe440200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4380b5d50 0x7fe43815b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe440200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4380b61d0 0x7fe4380c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe440200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43806d910 con 0x7fe4380b5d50 2024-03-19T06:21:20.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe440200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380b3ec0 con 0x7fe420003b80 2024-03-19T06:21:20.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe440200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43815df90 con 0x7fe4380b61d0 2024-03-19T06:21:20.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe43ce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4380b5d50 0x7fe43815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe43ce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4380b5d50 0x7fe43815b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45758/0 (socket says 172.21.15.32:45758) 2024-03-19T06:21:20.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe43ce00640 1 -- 172.21.15.32:0/846341390 learned_addr learned my addr 172.21.15.32:0/846341390 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:20.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe43d800640 1 --2- 172.21.15.32:0/846341390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe420003b80 0x7fe4381f42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe43e200640 1 --2- 172.21.15.32:0/846341390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4380b61d0 0x7fe4380c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe43ce00640 1 -- 172.21.15.32:0/846341390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4380b61d0 msgr2=0x7fe4380c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe43ce00640 1 --2- 172.21.15.32:0/846341390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4380b61d0 0x7fe4380c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe43ce00640 1 -- 172.21.15.32:0/846341390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe420003b80 msgr2=0x7fe4381f42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe43ce00640 1 --2- 172.21.15.32:0/846341390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe420003b80 0x7fe4381f42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe43ce00640 1 -- 172.21.15.32:0/846341390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4380b4610 con 0x7fe4380b5d50 2024-03-19T06:21:20.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe43d800640 1 --2- 172.21.15.32:0/846341390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe420003b80 0x7fe4381f42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:20.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe43e200640 1 --2- 172.21.15.32:0/846341390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4380b61d0 0x7fe4380c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:20.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe43ce00640 1 --2- 172.21.15.32:0/846341390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4380b5d50 0x7fe43815b450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe424011f10 tx=0x7fe42400f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:20.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe435600640 1 -- 172.21.15.32:0/846341390 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424010040 con 0x7fe4380b5d50 2024-03-19T06:21:20.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe435600640 1 -- 172.21.15.32:0/846341390 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42401a070 con 0x7fe4380b5d50 2024-03-19T06:21:20.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe440200640 1 -- 172.21.15.32:0/846341390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4380b48f0 con 0x7fe4380b5d50 2024-03-19T06:21:20.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe435600640 1 -- 172.21.15.32:0/846341390 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424015850 con 0x7fe4380b5d50 2024-03-19T06:21:20.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.260+0000 7fe440200640 1 -- 172.21.15.32:0/846341390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4380b4eb0 con 0x7fe4380b5d50 2024-03-19T06:21:20.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.264+0000 7fe440200640 1 -- 172.21.15.32:0/846341390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4380b50b0 con 0x7fe4380b5d50 2024-03-19T06:21:20.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.264+0000 7fe435600640 1 -- 172.21.15.32:0/846341390 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe4240159f0 con 0x7fe4380b5d50 2024-03-19T06:21:20.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.264+0000 7fe435600640 1 --2- 172.21.15.32:0/846341390 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe418067660 0x7fe418069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.264+0000 7fe435600640 1 -- 172.21.15.32:0/846341390 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe424089220 con 0x7fe4380b5d50 2024-03-19T06:21:20.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.264+0000 7fe43d800640 1 --2- 172.21.15.32:0/846341390 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe418067660 0x7fe418069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.264+0000 7fe43d800640 1 --2- 172.21.15.32:0/846341390 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe418067660 0x7fe418069b20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0aa000 tx=0x7fe42c001a60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:20.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.268+0000 7fe435600640 1 -- 172.21.15.32:0/846341390 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fe424059e00 con 0x7fe4380b5d50 2024-03-19T06:21:20.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.432+0000 7fe440200640 1 -- 172.21.15.32:0/846341390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe4380749e0 con 0x7fe4380b5d50 2024-03-19T06:21:20.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.432+0000 7fe435600640 1 -- 172.21.15.32:0/846341390 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe424059700 con 0x7fe4380b5d50 2024-03-19T06:21:20.426 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:21:20.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.436+0000 7fe440200640 1 -- 172.21.15.32:0/846341390 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe418067660 msgr2=0x7fe418069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.436+0000 7fe440200640 1 --2- 172.21.15.32:0/846341390 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe418067660 0x7fe418069b20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0aa000 tx=0x7fe42c001a60 comp rx=0 tx=0).stop 2024-03-19T06:21:20.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.436+0000 7fe440200640 1 -- 172.21.15.32:0/846341390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4380b5d50 msgr2=0x7fe43815b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.436+0000 7fe440200640 1 --2- 172.21.15.32:0/846341390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4380b5d50 0x7fe43815b450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe424011f10 tx=0x7fe42400f540 comp rx=0 tx=0).stop 2024-03-19T06:21:20.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.436+0000 7fe440200640 1 -- 172.21.15.32:0/846341390 shutdown_connections 2024-03-19T06:21:20.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.436+0000 7fe440200640 1 --2- 172.21.15.32:0/846341390 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe418067660 0x7fe418069b20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.436+0000 7fe440200640 1 --2- 172.21.15.32:0/846341390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4380b61d0 0x7fe4380c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.436+0000 7fe440200640 1 --2- 172.21.15.32:0/846341390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4380b5d50 0x7fe43815b450 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.436+0000 7fe440200640 1 --2- 172.21.15.32:0/846341390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe420003b80 0x7fe4381f42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.436+0000 7fe440200640 1 -- 172.21.15.32:0/846341390 >> 172.21.15.32:0/846341390 conn(0x7fe438066ca0 msgr2=0x7fe4380670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:20.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.436+0000 7fe440200640 1 -- 172.21.15.32:0/846341390 shutdown_connections 2024-03-19T06:21:20.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.436+0000 7fe440200640 1 -- 172.21.15.32:0/846341390 wait complete. 2024-03-19T06:21:20.447 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:21:20.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e98200640 1 Processor -- start 2024-03-19T06:21:20.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e98200640 1 -- start start 2024-03-19T06:21:20.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e98200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2e9015a7c0 0x7f2e900cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e98200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e900cc680 0x7f2e9015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e98200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e900cb670 con 0x7f2e900b4c50 2024-03-19T06:21:20.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e98200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9015e860 con 0x7f2e9015a7c0 2024-03-19T06:21:20.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e98200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e900cb950 con 0x7f2e900cc680 2024-03-19T06:21:20.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e95800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2e9015a7c0 0x7f2e900cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e95800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2e9015a7c0 0x7f2e900cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45768/0 (socket says 172.21.15.32:45768) 2024-03-19T06:21:20.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e95800640 1 -- 172.21.15.32:0/3566494726 learned_addr learned my addr 172.21.15.32:0/3566494726 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:20.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e96200640 1 --1- 172.21.15.32:0/3566494726 >> v1:172.21.15.32:6789/0 conn(0x7f2e900b4c50 0x7f2e900cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47748/0 (socket says 172.21.15.32:47748) 2024-03-19T06:21:20.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e94e00640 1 --2- 172.21.15.32:0/3566494726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e900cc680 0x7f2e9015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e95800640 1 -- 172.21.15.32:0/3566494726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e900cc680 msgr2=0x7f2e9015ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:20.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e95800640 1 --2- 172.21.15.32:0/3566494726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e900cc680 0x7f2e9015ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e95800640 1 -- 172.21.15.32:0/3566494726 >> v1:172.21.15.32:6789/0 conn(0x7f2e900b4c50 legacy=0x7f2e900cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e95800640 1 -- 172.21.15.32:0/3566494726 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9015e4f0 con 0x7f2e9015a7c0 2024-03-19T06:21:20.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e8fe00640 1 -- 172.21.15.32:0/3566494726 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903392243 0 0) 0x7f2e900cb670 con 0x7f2e900b4c50 2024-03-19T06:21:20.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.596+0000 7f2e94e00640 1 --2- 172.21.15.32:0/3566494726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e900cc680 0x7f2e9015ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:20.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.600+0000 7f2e95800640 1 --2- 172.21.15.32:0/3566494726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e9015a7c0 0x7f2e900cae20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009870 tx=0x7f2e8401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ee891a151ea1c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:20.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.600+0000 7f2e8fe00640 1 -- 172.21.15.32:0/3566494726 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840aa5f0 con 0x7f2e9015a7c0 2024-03-19T06:21:20.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.600+0000 7f2e8fe00640 1 -- 172.21.15.32:0/3566494726 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e840af070 con 0x7f2e9015a7c0 2024-03-19T06:21:20.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.600+0000 7f2e8fe00640 1 -- 172.21.15.32:0/3566494726 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840aa9b0 con 0x7f2e9015a7c0 2024-03-19T06:21:20.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.600+0000 7f2e98200640 1 -- 172.21.15.32:0/3566494726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e9015a7c0 msgr2=0x7f2e900cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.600+0000 7f2e98200640 1 --2- 172.21.15.32:0/3566494726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e9015a7c0 0x7f2e900cae20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009870 tx=0x7f2e8401c470 comp rx=0 tx=0).stop 2024-03-19T06:21:20.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.600+0000 7f2e98200640 1 -- 172.21.15.32:0/3566494726 shutdown_connections 2024-03-19T06:21:20.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.600+0000 7f2e98200640 1 --2- 172.21.15.32:0/3566494726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e900cc680 0x7f2e9015ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.600+0000 7f2e98200640 1 --2- 172.21.15.32:0/3566494726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e9015a7c0 0x7f2e900cae20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.600+0000 7f2e98200640 1 -- 172.21.15.32:0/3566494726 >> 172.21.15.32:0/3566494726 conn(0x7f2e900b1280 msgr2=0x7f2e900b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:20.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.600+0000 7f2e98200640 1 -- 172.21.15.32:0/3566494726 shutdown_connections 2024-03-19T06:21:20.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.600+0000 7f2e98200640 1 -- 172.21.15.32:0/3566494726 wait complete. 2024-03-19T06:21:20.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e98200640 1 Processor -- start 2024-03-19T06:21:20.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e98200640 1 -- start start 2024-03-19T06:21:20.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e98200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e900b4c50 0x7f2e901f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e98200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e900cc680 0x7f2e9015c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e98200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e9015a7c0 0x7f2e90144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e98200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9015f3b0 con 0x7f2e9015a7c0 2024-03-19T06:21:20.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e98200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9015f230 con 0x7f2e900cc680 2024-03-19T06:21:20.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e98200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e900cbc30 con 0x7f2e900b4c50 2024-03-19T06:21:20.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e96200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e9015a7c0 0x7f2e90144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e96200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e9015a7c0 0x7f2e90144bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45784/0 (socket says 172.21.15.32:45784) 2024-03-19T06:21:20.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e96200640 1 -- 172.21.15.32:0/2759564741 learned_addr learned my addr 172.21.15.32:0/2759564741 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:20.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e95800640 1 --2- 172.21.15.32:0/2759564741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e900b4c50 0x7f2e901f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e94e00640 1 --2- 172.21.15.32:0/2759564741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e900cc680 0x7f2e9015c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e96200640 1 -- 172.21.15.32:0/2759564741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e900b4c50 msgr2=0x7f2e901f4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e96200640 1 --2- 172.21.15.32:0/2759564741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e900b4c50 0x7f2e901f4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e96200640 1 -- 172.21.15.32:0/2759564741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e900cc680 msgr2=0x7f2e9015c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e96200640 1 --2- 172.21.15.32:0/2759564741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e900cc680 0x7f2e9015c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e96200640 1 -- 172.21.15.32:0/2759564741 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e901f5480 con 0x7f2e9015a7c0 2024-03-19T06:21:20.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e96200640 1 --2- 172.21.15.32:0/2759564741 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e9015a7c0 0x7f2e90144bd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800c700 tx=0x7f2e8800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:20.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e8d600640 1 -- 172.21.15.32:0/2759564741 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e88018070 con 0x7f2e9015a7c0 2024-03-19T06:21:20.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e8d600640 1 -- 172.21.15.32:0/2759564741 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8800ce10 con 0x7f2e9015a7c0 2024-03-19T06:21:20.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e8d600640 1 -- 172.21.15.32:0/2759564741 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8800a860 con 0x7f2e9015a7c0 2024-03-19T06:21:20.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e98200640 1 -- 172.21.15.32:0/2759564741 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e901f5760 con 0x7f2e9015a7c0 2024-03-19T06:21:20.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.604+0000 7f2e98200640 1 -- 172.21.15.32:0/2759564741 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e901f5d20 con 0x7f2e9015a7c0 2024-03-19T06:21:20.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.608+0000 7f2e98200640 1 -- 172.21.15.32:0/2759564741 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e900749e0 con 0x7f2e9015a7c0 2024-03-19T06:21:20.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.608+0000 7f2e8d600640 1 -- 172.21.15.32:0/2759564741 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2e8801b070 con 0x7f2e9015a7c0 2024-03-19T06:21:20.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.608+0000 7f2e8d600640 1 --2- 172.21.15.32:0/2759564741 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e70067690 0x7f2e70069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.608+0000 7f2e8d600640 1 -- 172.21.15.32:0/2759564741 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e88084e40 con 0x7f2e9015a7c0 2024-03-19T06:21:20.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.608+0000 7f2e95800640 1 --2- 172.21.15.32:0/2759564741 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e70067690 0x7f2e70069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.608+0000 7f2e95800640 1 --2- 172.21.15.32:0/2759564741 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e70067690 0x7f2e70069b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2e840ae000 tx=0x7f2e840a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:20.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.612+0000 7f2e8d600640 1 -- 172.21.15.32:0/2759564741 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2e88055ab0 con 0x7f2e9015a7c0 2024-03-19T06:21:20.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.808+0000 7f2e98200640 1 -- 172.21.15.32:0/2759564741 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e9015c2f0 con 0x7f2e9015a7c0 2024-03-19T06:21:20.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.808+0000 7f2e8d600640 1 -- 172.21.15.32:0/2759564741 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4935 (secure 0 0 0) 0x7f2e880553b0 con 0x7f2e9015a7c0 2024-03-19T06:21:20.800 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:20.800 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/3555048948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3555048948},{"type":"v1","addr":"172.21.15.32:6834","nonce":3555048948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3484789829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3484789829},{"type":"v1","addr":"172.21.15.171:6836","nonce":3484789829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/851750022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":851750022},{"type":"v1","addr":"172.21.15.171:6837","nonce":851750022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:21:08.817580+0000","modified":"2024-03-19T06:21:11.829499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/1902889035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":1902889035},{"type":"v1","addr":"172.21.15.32:6835","nonce":1902889035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-19T06:21:20.800 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-03-19T06:21:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.808+0000 7f2e98200640 1 -- 172.21.15.32:0/2759564741 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e70067690 msgr2=0x7f2e70069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.808+0000 7f2e98200640 1 --2- 172.21.15.32:0/2759564741 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e70067690 0x7f2e70069b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2e840ae000 tx=0x7f2e840a7000 comp rx=0 tx=0).stop 2024-03-19T06:21:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.808+0000 7f2e98200640 1 -- 172.21.15.32:0/2759564741 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e9015a7c0 msgr2=0x7f2e90144bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.808+0000 7f2e98200640 1 --2- 172.21.15.32:0/2759564741 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e9015a7c0 0x7f2e90144bd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800c700 tx=0x7f2e8800cbc0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.808+0000 7f2e98200640 1 -- 172.21.15.32:0/2759564741 shutdown_connections 2024-03-19T06:21:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.808+0000 7f2e98200640 1 --2- 172.21.15.32:0/2759564741 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e70067690 0x7f2e70069b50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.808+0000 7f2e98200640 1 --2- 172.21.15.32:0/2759564741 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e9015a7c0 0x7f2e90144bd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.808+0000 7f2e98200640 1 --2- 172.21.15.32:0/2759564741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e900cc680 0x7f2e9015c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.808+0000 7f2e98200640 1 --2- 172.21.15.32:0/2759564741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e900b4c50 0x7f2e901f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.808+0000 7f2e98200640 1 -- 172.21.15.32:0/2759564741 >> 172.21.15.32:0/2759564741 conn(0x7f2e900b1280 msgr2=0x7f2e9006e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:20.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.808+0000 7f2e98200640 1 -- 172.21.15.32:0/2759564741 shutdown_connections 2024-03-19T06:21:20.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.808+0000 7f2e98200640 1 -- 172.21.15.32:0/2759564741 wait complete. 2024-03-19T06:21:20.821 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:20.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.968+0000 7f4855200640 1 Processor -- start 2024-03-19T06:21:20.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.968+0000 7f4855200640 1 -- start start 2024-03-19T06:21:20.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.968+0000 7f4855200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48500aecf0 0x7f48500ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.968+0000 7f4855200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f485015c010 0x7f485015f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.968+0000 7f4855200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485015fe20 con 0x7f485006d6c0 2024-03-19T06:21:20.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.968+0000 7f4855200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48501603e0 con 0x7f485015c010 2024-03-19T06:21:20.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.968+0000 7f4855200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4850160100 con 0x7f48500aecf0 2024-03-19T06:21:20.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.968+0000 7f4847e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f485015c010 0x7f485015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.968+0000 7f4847e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f485015c010 0x7f485015f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45790/0 (socket says 172.21.15.32:45790) 2024-03-19T06:21:20.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.968+0000 7f4847e00640 1 -- 172.21.15.32:0/814011443 learned_addr learned my addr 172.21.15.32:0/814011443 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:20.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.968+0000 7f484de00640 1 --2- 172.21.15.32:0/814011443 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48500aecf0 0x7f48500ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.968+0000 7f4847e00640 1 -- 172.21.15.32:0/814011443 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48500aecf0 msgr2=0x7f48500ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:20.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.968+0000 7f4847e00640 1 --2- 172.21.15.32:0/814011443 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48500aecf0 0x7f48500ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.968+0000 7f4847e00640 1 -- 172.21.15.32:0/814011443 >> v1:172.21.15.171:6789/0 conn(0x7f485006d6c0 legacy=0x7f48500cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.968+0000 7f4847e00640 1 -- 172.21.15.32:0/814011443 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48500ca1f0 con 0x7f485015c010 2024-03-19T06:21:20.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.972+0000 7f4847e00640 1 --2- 172.21.15.32:0/814011443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f485015c010 0x7f485015f520 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4838009870 tx=0x7f483801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f97485bebf5dba server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:20.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.972+0000 7f484d400640 1 -- 172.21.15.32:0/814011443 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380b1070 con 0x7f485015c010 2024-03-19T06:21:20.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.972+0000 7f484d400640 1 -- 172.21.15.32:0/814011443 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48380a8050 con 0x7f485015c010 2024-03-19T06:21:20.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.972+0000 7f484d400640 1 -- 172.21.15.32:0/814011443 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380ac860 con 0x7f485015c010 2024-03-19T06:21:20.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.972+0000 7f4855200640 1 -- 172.21.15.32:0/814011443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f485015c010 msgr2=0x7f485015f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.972+0000 7f4855200640 1 --2- 172.21.15.32:0/814011443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f485015c010 0x7f485015f520 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4838009870 tx=0x7f483801c4d0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.972+0000 7f4855200640 1 -- 172.21.15.32:0/814011443 shutdown_connections 2024-03-19T06:21:20.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.972+0000 7f4855200640 1 --2- 172.21.15.32:0/814011443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f485015c010 0x7f485015f520 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.972+0000 7f4855200640 1 --2- 172.21.15.32:0/814011443 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48500aecf0 0x7f48500ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.972+0000 7f4855200640 1 -- 172.21.15.32:0/814011443 >> 172.21.15.32:0/814011443 conn(0x7f48500b1280 msgr2=0x7f48500b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:20.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.972+0000 7f4855200640 1 -- 172.21.15.32:0/814011443 shutdown_connections 2024-03-19T06:21:20.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.972+0000 7f4855200640 1 -- 172.21.15.32:0/814011443 wait complete. 2024-03-19T06:21:20.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4855200640 1 Processor -- start 2024-03-19T06:21:20.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4855200640 1 -- start start 2024-03-19T06:21:20.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4855200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f485006d6c0 0x7f4850159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4855200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48500aecf0 0x7f48500c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4855200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f485015c010 0x7f4850147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4855200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485015fbe0 con 0x7f48500aecf0 2024-03-19T06:21:20.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4855200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485015fa60 con 0x7f485006d6c0 2024-03-19T06:21:20.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4855200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4850168ea0 con 0x7f485015c010 2024-03-19T06:21:20.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4847e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48500aecf0 0x7f48500c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4847e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48500aecf0 0x7f48500c9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45796/0 (socket says 172.21.15.32:45796) 2024-03-19T06:21:20.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4847e00640 1 -- 172.21.15.32:0/4110494845 learned_addr learned my addr 172.21.15.32:0/4110494845 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:20.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f484de00640 1 --2- 172.21.15.32:0/4110494845 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f485006d6c0 0x7f4850159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f484e800640 1 --2- 172.21.15.32:0/4110494845 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f485015c010 0x7f4850147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4847e00640 1 -- 172.21.15.32:0/4110494845 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f485015c010 msgr2=0x7f4850147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4847e00640 1 --2- 172.21.15.32:0/4110494845 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f485015c010 0x7f4850147530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4847e00640 1 -- 172.21.15.32:0/4110494845 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f485006d6c0 msgr2=0x7f4850159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:20.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4847e00640 1 --2- 172.21.15.32:0/4110494845 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f485006d6c0 0x7f4850159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:20.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4847e00640 1 -- 172.21.15.32:0/4110494845 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4850144540 con 0x7f48500aecf0 2024-03-19T06:21:20.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f484e800640 1 --2- 172.21.15.32:0/4110494845 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f485015c010 0x7f4850147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:20.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4847e00640 1 --2- 172.21.15.32:0/4110494845 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48500aecf0 0x7f48500c9510 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f483801ab80 tx=0x7f4838019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:20.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4846000640 1 -- 172.21.15.32:0/4110494845 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380bc070 con 0x7f48500aecf0 2024-03-19T06:21:20.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4846000640 1 -- 172.21.15.32:0/4110494845 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48380acdd0 con 0x7f48500aecf0 2024-03-19T06:21:20.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4855200640 1 -- 172.21.15.32:0/4110494845 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4850144820 con 0x7f48500aecf0 2024-03-19T06:21:20.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4846000640 1 -- 172.21.15.32:0/4110494845 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380b1040 con 0x7f48500aecf0 2024-03-19T06:21:20.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.976+0000 7f4855200640 1 -- 172.21.15.32:0/4110494845 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4850144de0 con 0x7f48500aecf0 2024-03-19T06:21:20.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.980+0000 7f4855200640 1 -- 172.21.15.32:0/4110494845 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48501661b0 con 0x7f48500aecf0 2024-03-19T06:21:20.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.980+0000 7f4846000640 1 -- 172.21.15.32:0/4110494845 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f48380bf070 con 0x7f48500aecf0 2024-03-19T06:21:20.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.980+0000 7f4846000640 1 --2- 172.21.15.32:0/4110494845 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f482c067660 0x7f482c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:20.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.980+0000 7f4846000640 1 -- 172.21.15.32:0/4110494845 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f483811f000 con 0x7f48500aecf0 2024-03-19T06:21:20.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.980+0000 7f484de00640 1 --2- 172.21.15.32:0/4110494845 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f482c067660 0x7f482c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:20.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.980+0000 7f484de00640 1 --2- 172.21.15.32:0/4110494845 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f482c067660 0x7f482c069b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4840009af0 tx=0x7f4840008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:20.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:20.984+0000 7f4846000640 1 -- 172.21.15.32:0/4110494845 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f4838016150 con 0x7f48500aecf0 2024-03-19T06:21:21.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.148+0000 7f4855200640 1 -- 172.21.15.32:0/4110494845 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4850165ed0 con 0x7f48500aecf0 2024-03-19T06:21:21.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.148+0000 7f4846000640 1 -- 172.21.15.32:0/4110494845 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f48380efd00 con 0x7f48500aecf0 2024-03-19T06:21:21.141 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:21.141 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:10.423479+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:21.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.148+0000 7f4855200640 1 -- 172.21.15.32:0/4110494845 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f482c067660 msgr2=0x7f482c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:21.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.148+0000 7f4855200640 1 --2- 172.21.15.32:0/4110494845 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f482c067660 0x7f482c069b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4840009af0 tx=0x7f4840008040 comp rx=0 tx=0).stop 2024-03-19T06:21:21.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.148+0000 7f4855200640 1 -- 172.21.15.32:0/4110494845 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48500aecf0 msgr2=0x7f48500c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:21.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.148+0000 7f4855200640 1 --2- 172.21.15.32:0/4110494845 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48500aecf0 0x7f48500c9510 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f483801ab80 tx=0x7f4838019270 comp rx=0 tx=0).stop 2024-03-19T06:21:21.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.148+0000 7f4855200640 1 -- 172.21.15.32:0/4110494845 shutdown_connections 2024-03-19T06:21:21.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.148+0000 7f4855200640 1 --2- 172.21.15.32:0/4110494845 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f482c067660 0x7f482c069b20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.148+0000 7f4855200640 1 --2- 172.21.15.32:0/4110494845 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f485015c010 0x7f4850147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.148+0000 7f4855200640 1 --2- 172.21.15.32:0/4110494845 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48500aecf0 0x7f48500c9510 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.148+0000 7f4855200640 1 --2- 172.21.15.32:0/4110494845 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f485006d6c0 0x7f4850159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.148+0000 7f4855200640 1 -- 172.21.15.32:0/4110494845 >> 172.21.15.32:0/4110494845 conn(0x7f48500b1280 msgr2=0x7f48500b46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:21.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.148+0000 7f4855200640 1 -- 172.21.15.32:0/4110494845 shutdown_connections 2024-03-19T06:21:21.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.148+0000 7f4855200640 1 -- 172.21.15.32:0/4110494845 wait complete. 2024-03-19T06:21:21.161 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:21:07.089673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:21:07.801319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:21.162 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:21.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.312+0000 7f9746a00640 1 Processor -- start 2024-03-19T06:21:21.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.312+0000 7f9746a00640 1 -- start start 2024-03-19T06:21:21.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.312+0000 7f9746a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f974006eed0 0x7f97400ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:21.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.312+0000 7f9746a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f974006e320 0x7f974015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:21.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.312+0000 7f9746a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97400cc290 con 0x7f974006ad40 2024-03-19T06:21:21.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.312+0000 7f9746a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974006dbb0 con 0x7f974006e320 2024-03-19T06:21:21.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.312+0000 7f9746a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97400cc570 con 0x7f974006eed0 2024-03-19T06:21:21.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.316+0000 7f973fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f974006ad40 0x7f974006b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47764/0 (socket says 172.21.15.32:47764) 2024-03-19T06:21:21.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.316+0000 7f973fe00640 1 -- 172.21.15.32:0/1817358576 learned_addr learned my addr 172.21.15.32:0/1817358576 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:21.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.316+0000 7f9744a00640 1 --2- 172.21.15.32:0/1817358576 >> v2:172.21.15.32:3300/0 conn(0x7f974006e320 0x7f974015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:21.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.316+0000 7f9737400640 1 --2- 172.21.15.32:0/1817358576 >> v2:172.21.15.171:3300/0 conn(0x7f974006eed0 0x7f97400ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:21.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.316+0000 7f9744a00640 1 -- 172.21.15.32:0/1817358576 >> v2:172.21.15.171:3300/0 conn(0x7f974006eed0 msgr2=0x7f97400ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:21.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.316+0000 7f9744a00640 1 --2- 172.21.15.32:0/1817358576 >> v2:172.21.15.171:3300/0 conn(0x7f974006eed0 0x7f97400ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.316+0000 7f9744a00640 1 -- 172.21.15.32:0/1817358576 >> v1:172.21.15.32:6789/0 conn(0x7f974006ad40 legacy=0x7f974006b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:21.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.316+0000 7f9744a00640 1 -- 172.21.15.32:0/1817358576 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97400cc850 con 0x7f974006e320 2024-03-19T06:21:21.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.316+0000 7f973f400640 1 -- 172.21.15.32:0/1817358576 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63245412 0 0) 0x7f97400cc290 con 0x7f974006ad40 2024-03-19T06:21:21.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.316+0000 7f9737400640 1 --2- 172.21.15.32:0/1817358576 >> v2:172.21.15.171:3300/0 conn(0x7f974006eed0 0x7f97400ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.316+0000 7f9744a00640 1 --2- 172.21.15.32:0/1817358576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f974006e320 0x7f974015bc50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f974006bab0 tx=0x7f973801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7097a384a483cd89 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.316+0000 7f973f400640 1 -- 172.21.15.32:0/1817358576 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97380b2070 con 0x7f974006e320 2024-03-19T06:21:21.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.316+0000 7f973f400640 1 -- 172.21.15.32:0/1817358576 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974015c9a0 con 0x7f974006e320 2024-03-19T06:21:21.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.316+0000 7f973f400640 1 -- 172.21.15.32:0/1817358576 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97380a5b70 con 0x7f974006e320 2024-03-19T06:21:21.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9746a00640 1 -- 172.21.15.32:0/1817358576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f974006e320 msgr2=0x7f974015bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:21.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9746a00640 1 --2- 172.21.15.32:0/1817358576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f974006e320 0x7f974015bc50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f974006bab0 tx=0x7f973801c870 comp rx=0 tx=0).stop 2024-03-19T06:21:21.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9746a00640 1 -- 172.21.15.32:0/1817358576 shutdown_connections 2024-03-19T06:21:21.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9746a00640 1 --2- 172.21.15.32:0/1817358576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f974006e320 0x7f974015bc50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9746a00640 1 --2- 172.21.15.32:0/1817358576 >> v2:172.21.15.171:3300/0 conn(0x7f974006eed0 0x7f97400ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9746a00640 1 -- 172.21.15.32:0/1817358576 >> 172.21.15.32:0/1817358576 conn(0x7f97400b1590 msgr2=0x7f97400b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:21.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9746a00640 1 -- 172.21.15.32:0/1817358576 shutdown_connections 2024-03-19T06:21:21.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9746a00640 1 -- 172.21.15.32:0/1817358576 wait complete. 2024-03-19T06:21:21.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9746a00640 1 Processor -- start 2024-03-19T06:21:21.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9746a00640 1 -- start start 2024-03-19T06:21:21.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9746a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f974006ad40 0x7f9740153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:21.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9746a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f974006e320 0x7f974014f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:21.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9746a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f974006eed0 0x7f97400b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:21.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9746a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97401688a0 con 0x7f974006ad40 2024-03-19T06:21:21.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9746a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9740168720 con 0x7f974006e320 2024-03-19T06:21:21.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9746a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9740168a20 con 0x7f974006eed0 2024-03-19T06:21:21.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f973fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f974006ad40 0x7f9740153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:21.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f973fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f974006ad40 0x7f9740153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45816/0 (socket says 172.21.15.32:45816) 2024-03-19T06:21:21.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f973fe00640 1 -- 172.21.15.32:0/2256421714 learned_addr learned my addr 172.21.15.32:0/2256421714 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:21.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9737400640 1 --2- 172.21.15.32:0/2256421714 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f974006e320 0x7f974014f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:21.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f9744a00640 1 --2- 172.21.15.32:0/2256421714 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f974006eed0 0x7f97400b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:21.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f973fe00640 1 -- 172.21.15.32:0/2256421714 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f974006eed0 msgr2=0x7f97400b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:21.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f973fe00640 1 --2- 172.21.15.32:0/2256421714 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f974006eed0 0x7f97400b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f973fe00640 1 -- 172.21.15.32:0/2256421714 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f974006e320 msgr2=0x7f974014f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:21.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f973fe00640 1 --2- 172.21.15.32:0/2256421714 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f974006e320 0x7f974014f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.320+0000 7f973fe00640 1 -- 172.21.15.32:0/2256421714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97400b2a30 con 0x7f974006ad40 2024-03-19T06:21:21.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.324+0000 7f973fe00640 1 --2- 172.21.15.32:0/2256421714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f974006ad40 0x7f9740153390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f97300011f0 tx=0x7f973000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:21.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.324+0000 7f973cc00640 1 -- 172.21.15.32:0/2256421714 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730018070 con 0x7f974006ad40 2024-03-19T06:21:21.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.324+0000 7f973cc00640 1 -- 172.21.15.32:0/2256421714 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97300074e0 con 0x7f974006ad40 2024-03-19T06:21:21.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.324+0000 7f9746a00640 1 -- 172.21.15.32:0/2256421714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97400b2cd0 con 0x7f974006ad40 2024-03-19T06:21:21.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.324+0000 7f973cc00640 1 -- 172.21.15.32:0/2256421714 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730004a10 con 0x7f974006ad40 2024-03-19T06:21:21.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.324+0000 7f9746a00640 1 -- 172.21.15.32:0/2256421714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97400b3570 con 0x7f974006ad40 2024-03-19T06:21:21.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.324+0000 7f9746a00640 1 -- 172.21.15.32:0/2256421714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97400749e0 con 0x7f974006ad40 2024-03-19T06:21:21.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.324+0000 7f973cc00640 1 -- 172.21.15.32:0/2256421714 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f973001b070 con 0x7f974006ad40 2024-03-19T06:21:21.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.324+0000 7f973cc00640 1 --2- 172.21.15.32:0/2256421714 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f971c067660 0x7f971c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:21.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.324+0000 7f973cc00640 1 -- 172.21.15.32:0/2256421714 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9730084b30 con 0x7f974006ad40 2024-03-19T06:21:21.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.324+0000 7f9737400640 1 --2- 172.21.15.32:0/2256421714 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f971c067660 0x7f971c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:21.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.328+0000 7f9737400640 1 --2- 172.21.15.32:0/2256421714 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f971c067660 0x7f971c069b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9728006fd0 tx=0x7f9728008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:21.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.328+0000 7f973cc00640 1 -- 172.21.15.32:0/2256421714 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f97300557a0 con 0x7f974006ad40 2024-03-19T06:21:21.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.492+0000 7f9746a00640 1 -- 172.21.15.32:0/2256421714 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97400b2ea0 con 0x7f974006ad40 2024-03-19T06:21:21.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.496+0000 7f973cc00640 1 -- 172.21.15.32:0/2256421714 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97300550a0 con 0x7f974006ad40 2024-03-19T06:21:21.487 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:21.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.496+0000 7f9746a00640 1 -- 172.21.15.32:0/2256421714 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f971c067660 msgr2=0x7f971c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:21.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.496+0000 7f9746a00640 1 --2- 172.21.15.32:0/2256421714 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f971c067660 0x7f971c069b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9728006fd0 tx=0x7f9728008040 comp rx=0 tx=0).stop 2024-03-19T06:21:21.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.496+0000 7f9746a00640 1 -- 172.21.15.32:0/2256421714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f974006ad40 msgr2=0x7f9740153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:21.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.496+0000 7f9746a00640 1 --2- 172.21.15.32:0/2256421714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f974006ad40 0x7f9740153390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f97300011f0 tx=0x7f973000c9b0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.496+0000 7f9746a00640 1 -- 172.21.15.32:0/2256421714 shutdown_connections 2024-03-19T06:21:21.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.496+0000 7f9746a00640 1 --2- 172.21.15.32:0/2256421714 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f971c067660 0x7f971c069b20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.496+0000 7f9746a00640 1 --2- 172.21.15.32:0/2256421714 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f974006eed0 0x7f97400b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.496+0000 7f9746a00640 1 --2- 172.21.15.32:0/2256421714 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f974006e320 0x7f974014f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.496+0000 7f9746a00640 1 --2- 172.21.15.32:0/2256421714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f974006ad40 0x7f9740153390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.496+0000 7f9746a00640 1 -- 172.21.15.32:0/2256421714 >> 172.21.15.32:0/2256421714 conn(0x7f97400b1590 msgr2=0x7f974015a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:21.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.496+0000 7f9746a00640 1 -- 172.21.15.32:0/2256421714 shutdown_connections 2024-03-19T06:21:21.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.496+0000 7f9746a00640 1 -- 172.21.15.32:0/2256421714 wait complete. 2024-03-19T06:21:21.509 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:21:21.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.656+0000 7f449ba00640 1 Processor -- start 2024-03-19T06:21:21.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.656+0000 7f449ba00640 1 -- start start 2024-03-19T06:21:21.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f449ba00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f449415dbb0 0x7f449406c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:21.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f449ba00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44940cbf00 con 0x7f449406c5a0 2024-03-19T06:21:21.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f449ba00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449406cb20 con 0x7f44940b3d30 2024-03-19T06:21:21.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f449ba00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449406ce00 con 0x7f449415dbb0 2024-03-19T06:21:21.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f448be00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f449406c5a0 0x7f44940b3620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47780/0 (socket says 172.21.15.32:47780) 2024-03-19T06:21:21.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f448be00640 1 -- 172.21.15.32:0/3878666029 learned_addr learned my addr 172.21.15.32:0/3878666029 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:21.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4499000640 1 --2- 172.21.15.32:0/3878666029 >> v2:172.21.15.171:3300/0 conn(0x7f449415dbb0 0x7f449406c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:21.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 -- 172.21.15.32:0/3878666029 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575407169 0 0) 0x7f44940cbf00 con 0x7f449406c5a0 2024-03-19T06:21:21.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 -- 172.21.15.32:0/3878666029 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4478003530 con 0x7f449406c5a0 2024-03-19T06:21:21.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 -- 172.21.15.32:0/3878666029 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095417420 0 0) 0x7f449406cb20 con 0x7f44940b3d30 2024-03-19T06:21:21.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 -- 172.21.15.32:0/3878666029 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44940cbf00 con 0x7f44940b3d30 2024-03-19T06:21:21.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 -- 172.21.15.32:0/3878666029 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1107359221 0 0) 0x7f4478003530 con 0x7f449406c5a0 2024-03-19T06:21:21.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 -- 172.21.15.32:0/3878666029 >> v2:172.21.15.171:3300/0 conn(0x7f449415dbb0 msgr2=0x7f449406c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:21.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 --2- 172.21.15.32:0/3878666029 >> v2:172.21.15.171:3300/0 conn(0x7f449415dbb0 0x7f449406c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 -- 172.21.15.32:0/3878666029 >> v1:172.21.15.171:6789/0 conn(0x7f44940b3d30 legacy=0x7f44940cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:21.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 -- 172.21.15.32:0/3878666029 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449406d0e0 con 0x7f449406c5a0 2024-03-19T06:21:21.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 -- 172.21.15.32:0/3878666029 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f447c0016a0 con 0x7f449406c5a0 2024-03-19T06:21:21.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 -- 172.21.15.32:0/3878666029 >> v1:172.21.15.32:6789/0 conn(0x7f449406c5a0 legacy=0x7f44940b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:21.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 --2- 172.21.15.32:0/3878666029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4478003b50 0x7f4478003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:21.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 --2- 172.21.15.32:0/3878666029 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4478004810 0x7f4478004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:21.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 --2- 172.21.15.32:0/3878666029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44780051d0 0x7f447800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:21.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 -- 172.21.15.32:0/3878666029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449406ce00 con 0x7f4478003b50 2024-03-19T06:21:21.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 -- 172.21.15.32:0/3878666029 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447800bfc0 con 0x7f44780051d0 2024-03-19T06:21:21.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4493e00640 1 -- 172.21.15.32:0/3878666029 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447800c1c0 con 0x7f4478004810 2024-03-19T06:21:21.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4499000640 1 --2- 172.21.15.32:0/3878666029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4478003b50 0x7f4478003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:21.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f448be00640 1 --2- 172.21.15.32:0/3878666029 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4478004810 0x7f4478004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:21.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4499a00640 1 --2- 172.21.15.32:0/3878666029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44780051d0 0x7f447800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:21.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4499000640 1 -- 172.21.15.32:0/3878666029 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4478004810 msgr2=0x7f4478004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:21.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4499000640 1 --2- 172.21.15.32:0/3878666029 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4478004810 0x7f4478004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4499000640 1 -- 172.21.15.32:0/3878666029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44780051d0 msgr2=0x7f447800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:21.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4499000640 1 --2- 172.21.15.32:0/3878666029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44780051d0 0x7f447800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4499000640 1 -- 172.21.15.32:0/3878666029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4478003530 con 0x7f4478003b50 2024-03-19T06:21:21.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4499a00640 1 --2- 172.21.15.32:0/3878666029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44780051d0 0x7f447800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:21.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f448be00640 1 --2- 172.21.15.32:0/3878666029 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4478004810 0x7f4478004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:21.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.660+0000 7f4499a00640 1 -- 172.21.15.32:0/3878666029 reap_dead start 2024-03-19T06:21:21.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.664+0000 7f4499000640 1 --2- 172.21.15.32:0/3878666029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4478003b50 0x7f4478003f50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4484009ab0 tx=0x7f448401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35e03ce55233ee7 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:21.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.664+0000 7f4493e00640 1 -- 172.21.15.32:0/3878666029 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840b2070 con 0x7f4478003b50 2024-03-19T06:21:21.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.664+0000 7f4493e00640 1 -- 172.21.15.32:0/3878666029 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44840a5640 con 0x7f4478003b50 2024-03-19T06:21:21.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.664+0000 7f4493e00640 1 -- 172.21.15.32:0/3878666029 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840096b0 con 0x7f4478003b50 2024-03-19T06:21:21.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.664+0000 7f449ba00640 1 -- 172.21.15.32:0/3878666029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4478003b50 msgr2=0x7f4478003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:21.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.664+0000 7f449ba00640 1 --2- 172.21.15.32:0/3878666029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4478003b50 0x7f4478003f50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4484009ab0 tx=0x7f448401ca50 comp rx=0 tx=0).stop 2024-03-19T06:21:21.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.664+0000 7f449ba00640 1 -- 172.21.15.32:0/3878666029 shutdown_connections 2024-03-19T06:21:21.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.664+0000 7f449ba00640 1 --2- 172.21.15.32:0/3878666029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4478003b50 0x7f4478003f50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.664+0000 7f449ba00640 1 -- 172.21.15.32:0/3878666029 >> 172.21.15.32:0/3878666029 conn(0x7f4494066ca0 msgr2=0x7f44940670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:21.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.664+0000 7f449ba00640 1 -- 172.21.15.32:0/3878666029 shutdown_connections 2024-03-19T06:21:21.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.664+0000 7f449ba00640 1 -- 172.21.15.32:0/3878666029 wait complete. 2024-03-19T06:21:21.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f449ba00640 1 Processor -- start 2024-03-19T06:21:21.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f449ba00640 1 -- start start 2024-03-19T06:21:21.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f449ba00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4478003b50 0x7f44940b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:21.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f449ba00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44940b6310 0x7f44941f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:21.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f449ba00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44941f3c10 0x7f44941f4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:21.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f449ba00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449415df90 con 0x7f44941f3c10 2024-03-19T06:21:21.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f449ba00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449406d910 con 0x7f44940b6310 2024-03-19T06:21:21.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f449ba00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449406c060 con 0x7f4478003b50 2024-03-19T06:21:21.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f4499a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44941f3c10 0x7f44941f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:21.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f4499a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44941f3c10 0x7f44941f4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45836/0 (socket says 172.21.15.32:45836) 2024-03-19T06:21:21.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f4499a00640 1 -- 172.21.15.32:0/944441702 learned_addr learned my addr 172.21.15.32:0/944441702 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:21.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f448be00640 1 --2- 172.21.15.32:0/944441702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44940b6310 0x7f44941f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:21.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f4499000640 1 --2- 172.21.15.32:0/944441702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4478003b50 0x7f44940b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:21.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f4499a00640 1 -- 172.21.15.32:0/944441702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4478003b50 msgr2=0x7f44940b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:21.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f4499a00640 1 --2- 172.21.15.32:0/944441702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4478003b50 0x7f44940b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f4499a00640 1 -- 172.21.15.32:0/944441702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44940b6310 msgr2=0x7f44941f36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:21.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f4499a00640 1 --2- 172.21.15.32:0/944441702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44940b6310 0x7f44941f36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f4499a00640 1 -- 172.21.15.32:0/944441702 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44941f10d0 con 0x7f44941f3c10 2024-03-19T06:21:21.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f448be00640 1 --2- 172.21.15.32:0/944441702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44940b6310 0x7f44941f36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:21.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f4499a00640 1 --2- 172.21.15.32:0/944441702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44941f3c10 0x7f44941f4090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f448c0059b0 tx=0x7f448c00f170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:21.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f4491600640 1 -- 172.21.15.32:0/944441702 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c010040 con 0x7f44941f3c10 2024-03-19T06:21:21.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f4491600640 1 -- 172.21.15.32:0/944441702 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c01a070 con 0x7f44941f3c10 2024-03-19T06:21:21.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f449ba00640 1 -- 172.21.15.32:0/944441702 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44940b4d70 con 0x7f44941f3c10 2024-03-19T06:21:21.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f4491600640 1 -- 172.21.15.32:0/944441702 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c015410 con 0x7f44941f3c10 2024-03-19T06:21:21.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f449ba00640 1 -- 172.21.15.32:0/944441702 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44940b5330 con 0x7f44941f3c10 2024-03-19T06:21:21.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.668+0000 7f449ba00640 1 -- 172.21.15.32:0/944441702 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44940749e0 con 0x7f44941f3c10 2024-03-19T06:21:21.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.672+0000 7f4491600640 1 -- 172.21.15.32:0/944441702 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f448c0155b0 con 0x7f44941f3c10 2024-03-19T06:21:21.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.672+0000 7f4491600640 1 --2- 172.21.15.32:0/944441702 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4470067660 0x7f4470069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:21.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.672+0000 7f4491600640 1 -- 172.21.15.32:0/944441702 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f448c088c40 con 0x7f44941f3c10 2024-03-19T06:21:21.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.672+0000 7f4499000640 1 --2- 172.21.15.32:0/944441702 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4470067660 0x7f4470069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:21.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.672+0000 7f4499000640 1 --2- 172.21.15.32:0/944441702 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4470067660 0x7f4470069b20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4484009ab0 tx=0x7f44840a7040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:21.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.676+0000 7f4491600640 1 -- 172.21.15.32:0/944441702 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f448c0598c0 con 0x7f44941f3c10 2024-03-19T06:21:21.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.836+0000 7f449ba00640 1 -- 172.21.15.32:0/944441702 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44940cdbb0 con 0x7f44941f3c10 2024-03-19T06:21:21.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.836+0000 7f4491600640 1 -- 172.21.15.32:0/944441702 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f448c0591c0 con 0x7f44941f3c10 2024-03-19T06:21:21.831 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:21:21.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.840+0000 7f449ba00640 1 -- 172.21.15.32:0/944441702 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4470067660 msgr2=0x7f4470069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:21.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.840+0000 7f449ba00640 1 --2- 172.21.15.32:0/944441702 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4470067660 0x7f4470069b20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4484009ab0 tx=0x7f44840a7040 comp rx=0 tx=0).stop 2024-03-19T06:21:21.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.840+0000 7f449ba00640 1 -- 172.21.15.32:0/944441702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44941f3c10 msgr2=0x7f44941f4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:21.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.840+0000 7f449ba00640 1 --2- 172.21.15.32:0/944441702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44941f3c10 0x7f44941f4090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f448c0059b0 tx=0x7f448c00f170 comp rx=0 tx=0).stop 2024-03-19T06:21:21.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.840+0000 7f449ba00640 1 -- 172.21.15.32:0/944441702 shutdown_connections 2024-03-19T06:21:21.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.840+0000 7f449ba00640 1 --2- 172.21.15.32:0/944441702 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4470067660 0x7f4470069b20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.840+0000 7f449ba00640 1 --2- 172.21.15.32:0/944441702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44941f3c10 0x7f44941f4090 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.840+0000 7f449ba00640 1 --2- 172.21.15.32:0/944441702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44940b6310 0x7f44941f36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.840+0000 7f449ba00640 1 --2- 172.21.15.32:0/944441702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4478003b50 0x7f44940b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:21.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.840+0000 7f449ba00640 1 -- 172.21.15.32:0/944441702 >> 172.21.15.32:0/944441702 conn(0x7f4494066ca0 msgr2=0x7f449406f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:21.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.840+0000 7f449ba00640 1 -- 172.21.15.32:0/944441702 shutdown_connections 2024-03-19T06:21:21.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:21.840+0000 7f449ba00640 1 -- 172.21.15.32:0/944441702 wait complete. 2024-03-19T06:21:21.852 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:21:21.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe581a00640 1 Processor -- start 2024-03-19T06:21:21.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe581a00640 1 -- start start 2024-03-19T06:21:21.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe581a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe57c06eed0 0x7fe57c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:21.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe581a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57c0cc290 con 0x7fe57c06ad40 2024-03-19T06:21:21.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe581a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57c0cc570 con 0x7fe57c06e320 2024-03-19T06:21:21.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe581a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c06dbb0 con 0x7fe57c06eed0 2024-03-19T06:21:21.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57aa00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe57c06ad40 0x7fe57c06b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47786/0 (socket says 172.21.15.32:47786) 2024-03-19T06:21:21.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57aa00640 1 -- 172.21.15.32:0/1976888118 learned_addr learned my addr 172.21.15.32:0/1976888118 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:21.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe572000640 1 --2- 172.21.15.32:0/1976888118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe57c06eed0 0x7fe57c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57a000640 1 -- 172.21.15.32:0/1976888118 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478048375 0 0) 0x7fe57c0cc290 con 0x7fe57c06ad40 2024-03-19T06:21:22.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57a000640 1 -- 172.21.15.32:0/1976888118 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe560003530 con 0x7fe57c06ad40 2024-03-19T06:21:22.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57a000640 1 -- 172.21.15.32:0/1976888118 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1475100302 0 0) 0x7fe560003530 con 0x7fe57c06ad40 2024-03-19T06:21:22.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57a000640 1 -- 172.21.15.32:0/1976888118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe57c06eed0 msgr2=0x7fe57c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:22.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57a000640 1 --2- 172.21.15.32:0/1976888118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe57c06eed0 0x7fe57c0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57a000640 1 -- 172.21.15.32:0/1976888118 >> v1:172.21.15.171:6789/0 conn(0x7fe57c06e320 legacy=0x7fe57c15bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57a000640 1 -- 172.21.15.32:0/1976888118 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c0cc850 con 0x7fe57c06ad40 2024-03-19T06:21:22.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57a000640 1 -- 172.21.15.32:0/1976888118 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fe56c001680 con 0x7fe57c06ad40 2024-03-19T06:21:22.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57a000640 1 -- 172.21.15.32:0/1976888118 >> v1:172.21.15.32:6789/0 conn(0x7fe57c06ad40 legacy=0x7fe57c06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57a000640 1 --2- 172.21.15.32:0/1976888118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe57c06eed0 0x7fe5600039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57a000640 1 --2- 172.21.15.32:0/1976888118 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe560003f70 0x7fe560004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57a000640 1 --2- 172.21.15.32:0/1976888118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe560004d50 0x7fe5600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57a000640 1 -- 172.21.15.32:0/1976888118 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c06dbb0 con 0x7fe560004d50 2024-03-19T06:21:22.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57a000640 1 -- 172.21.15.32:0/1976888118 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56000bb60 con 0x7fe560003f70 2024-03-19T06:21:22.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57a000640 1 -- 172.21.15.32:0/1976888118 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56000bd60 con 0x7fe57c06eed0 2024-03-19T06:21:22.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57b400640 1 --2- 172.21.15.32:0/1976888118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe560004d50 0x7fe5600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe57aa00640 1 --2- 172.21.15.32:0/1976888118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe57c06eed0 0x7fe5600039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.004+0000 7fe572000640 1 --2- 172.21.15.32:0/1976888118 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe560003f70 0x7fe560004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.008+0000 7fe57b400640 1 -- 172.21.15.32:0/1976888118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe57c06eed0 msgr2=0x7fe5600039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:22.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.008+0000 7fe57b400640 1 --2- 172.21.15.32:0/1976888118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe57c06eed0 0x7fe5600039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.008+0000 7fe57b400640 1 -- 172.21.15.32:0/1976888118 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe560003f70 msgr2=0x7fe560004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:22.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.008+0000 7fe57b400640 1 --2- 172.21.15.32:0/1976888118 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe560003f70 0x7fe560004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.008+0000 7fe57b400640 1 -- 172.21.15.32:0/1976888118 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe560003530 con 0x7fe560004d50 2024-03-19T06:21:22.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.008+0000 7fe57b400640 1 --2- 172.21.15.32:0/1976888118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe560004d50 0x7fe5600051d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe574001e70 tx=0x7fe57401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234d022b1c5f48f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:22.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.008+0000 7fe57a000640 1 -- 172.21.15.32:0/1976888118 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574001a90 con 0x7fe560004d50 2024-03-19T06:21:22.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.008+0000 7fe57a000640 1 -- 172.21.15.32:0/1976888118 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe574003b80 con 0x7fe560004d50 2024-03-19T06:21:22.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.008+0000 7fe57a000640 1 -- 172.21.15.32:0/1976888118 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740050d0 con 0x7fe560004d50 2024-03-19T06:21:22.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.008+0000 7fe581a00640 1 -- 172.21.15.32:0/1976888118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe560004d50 msgr2=0x7fe5600051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.008+0000 7fe581a00640 1 --2- 172.21.15.32:0/1976888118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe560004d50 0x7fe5600051d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe574001e70 tx=0x7fe57401c780 comp rx=0 tx=0).stop 2024-03-19T06:21:22.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.008+0000 7fe57b400640 1 -- 172.21.15.32:0/1976888118 reap_dead start 2024-03-19T06:21:22.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.008+0000 7fe581a00640 1 -- 172.21.15.32:0/1976888118 shutdown_connections 2024-03-19T06:21:22.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.008+0000 7fe581a00640 1 -- 172.21.15.32:0/1976888118 >> 172.21.15.32:0/1976888118 conn(0x7fe57c0b1590 msgr2=0x7fe57c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:22.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.008+0000 7fe581a00640 1 -- 172.21.15.32:0/1976888118 shutdown_connections 2024-03-19T06:21:22.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.008+0000 7fe581a00640 1 -- 172.21.15.32:0/1976888118 wait complete. 2024-03-19T06:21:22.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe581a00640 1 Processor -- start 2024-03-19T06:21:22.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe581a00640 1 -- start start 2024-03-19T06:21:22.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe581a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe560004d50 0x7fe57c158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe581a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe57c0cf840 0x7fe57c0cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe581a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe57c1f3710 0x7fe57c1f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe581a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c06e950 con 0x7fe57c1f3710 2024-03-19T06:21:22.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe581a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c06e7d0 con 0x7fe560004d50 2024-03-19T06:21:22.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe581a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c15c360 con 0x7fe57c0cf840 2024-03-19T06:21:22.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe57b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe57c1f3710 0x7fe57c1f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe57b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe57c1f3710 0x7fe57c1f3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45858/0 (socket says 172.21.15.32:45858) 2024-03-19T06:21:22.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe57b400640 1 -- 172.21.15.32:0/3841568322 learned_addr learned my addr 172.21.15.32:0/3841568322 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:22.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe572000640 1 --2- 172.21.15.32:0/3841568322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe57c0cf840 0x7fe57c0cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe57aa00640 1 --2- 172.21.15.32:0/3841568322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe560004d50 0x7fe57c158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe57b400640 1 -- 172.21.15.32:0/3841568322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe57c0cf840 msgr2=0x7fe57c0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe57b400640 1 --2- 172.21.15.32:0/3841568322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe57c0cf840 0x7fe57c0cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe57b400640 1 -- 172.21.15.32:0/3841568322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe560004d50 msgr2=0x7fe57c158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe57b400640 1 --2- 172.21.15.32:0/3841568322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe560004d50 0x7fe57c158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe57b400640 1 -- 172.21.15.32:0/3841568322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c1f4600 con 0x7fe57c1f3710 2024-03-19T06:21:22.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe57aa00640 1 --2- 172.21.15.32:0/3841568322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe560004d50 0x7fe57c158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:22.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe57b400640 1 --2- 172.21.15.32:0/3841568322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe57c1f3710 0x7fe57c1f3b90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe57401cc60 tx=0x7fe560005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:22.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe573400640 1 -- 172.21.15.32:0/3841568322 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574007dc0 con 0x7fe57c1f3710 2024-03-19T06:21:22.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.012+0000 7fe573400640 1 -- 172.21.15.32:0/3841568322 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe574003980 con 0x7fe57c1f3710 2024-03-19T06:21:22.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.016+0000 7fe581a00640 1 -- 172.21.15.32:0/3841568322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57c0adc90 con 0x7fe57c1f3710 2024-03-19T06:21:22.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.016+0000 7fe573400640 1 -- 172.21.15.32:0/3841568322 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574006d80 con 0x7fe57c1f3710 2024-03-19T06:21:22.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.016+0000 7fe581a00640 1 -- 172.21.15.32:0/3841568322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57c1f4910 con 0x7fe57c1f3710 2024-03-19T06:21:22.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.016+0000 7fe581a00640 1 -- 172.21.15.32:0/3841568322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57c0749e0 con 0x7fe57c1f3710 2024-03-19T06:21:22.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.016+0000 7fe573400640 1 -- 172.21.15.32:0/3841568322 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe5740050d0 con 0x7fe57c1f3710 2024-03-19T06:21:22.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.016+0000 7fe573400640 1 --2- 172.21.15.32:0/3841568322 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5580676e0 0x7fe558069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.016+0000 7fe573400640 1 -- 172.21.15.32:0/3841568322 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe57411f1b0 con 0x7fe57c1f3710 2024-03-19T06:21:22.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.016+0000 7fe57aa00640 1 --2- 172.21.15.32:0/3841568322 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5580676e0 0x7fe558069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.016+0000 7fe57aa00640 1 --2- 172.21.15.32:0/3841568322 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5580676e0 0x7fe558069ba0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe56c005180 tx=0x7fe56c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:22.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.020+0000 7fe573400640 1 -- 172.21.15.32:0/3841568322 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fe5740ac020 con 0x7fe57c1f3710 2024-03-19T06:21:22.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.184+0000 7fe581a00640 1 -- 172.21.15.32:0/3841568322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe57c0b3800 con 0x7fe57c1f3710 2024-03-19T06:21:22.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.184+0000 7fe573400640 1 -- 172.21.15.32:0/3841568322 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe574016490 con 0x7fe57c1f3710 2024-03-19T06:21:22.178 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:21:22.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.188+0000 7fe581a00640 1 -- 172.21.15.32:0/3841568322 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5580676e0 msgr2=0x7fe558069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.188+0000 7fe581a00640 1 --2- 172.21.15.32:0/3841568322 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5580676e0 0x7fe558069ba0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe56c005180 tx=0x7fe56c009040 comp rx=0 tx=0).stop 2024-03-19T06:21:22.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.188+0000 7fe581a00640 1 -- 172.21.15.32:0/3841568322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe57c1f3710 msgr2=0x7fe57c1f3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.188+0000 7fe581a00640 1 --2- 172.21.15.32:0/3841568322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe57c1f3710 0x7fe57c1f3b90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe57401cc60 tx=0x7fe560005840 comp rx=0 tx=0).stop 2024-03-19T06:21:22.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.188+0000 7fe581a00640 1 -- 172.21.15.32:0/3841568322 shutdown_connections 2024-03-19T06:21:22.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.188+0000 7fe581a00640 1 --2- 172.21.15.32:0/3841568322 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5580676e0 0x7fe558069ba0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.188+0000 7fe581a00640 1 --2- 172.21.15.32:0/3841568322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe57c1f3710 0x7fe57c1f3b90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.188+0000 7fe581a00640 1 --2- 172.21.15.32:0/3841568322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe57c0cf840 0x7fe57c0cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.188+0000 7fe581a00640 1 --2- 172.21.15.32:0/3841568322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe560004d50 0x7fe57c158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.188+0000 7fe581a00640 1 -- 172.21.15.32:0/3841568322 >> 172.21.15.32:0/3841568322 conn(0x7fe57c0b1590 msgr2=0x7fe57c0b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:22.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.188+0000 7fe581a00640 1 -- 172.21.15.32:0/3841568322 shutdown_connections 2024-03-19T06:21:22.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.188+0000 7fe581a00640 1 -- 172.21.15.32:0/3841568322 wait complete. 2024-03-19T06:21:22.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:21:22.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.348+0000 7f69b0e00640 1 Processor -- start 2024-03-19T06:21:22.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.348+0000 7f69b0e00640 1 -- start start 2024-03-19T06:21:22.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.348+0000 7f69b0e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f69ac15bb20 0x7f69ac09a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.348+0000 7f69b0e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f69ac0cd390 0x7f69ac0cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.348+0000 7f69b0e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ac15bf00 con 0x7f69ac0cf460 2024-03-19T06:21:22.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.348+0000 7f69b0e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ac0cc3a0 con 0x7f69ac15bb20 2024-03-19T06:21:22.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.348+0000 7f69b0e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ac0cfbb0 con 0x7f69ac0cd390 2024-03-19T06:21:22.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.348+0000 7f69a9e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f69ac15bb20 0x7f69ac09a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.348+0000 7f69a9e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f69ac15bb20 0x7f69ac09a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45864/0 (socket says 172.21.15.32:45864) 2024-03-19T06:21:22.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.348+0000 7f69a9e00640 1 -- 172.21.15.32:0/3702139763 learned_addr learned my addr 172.21.15.32:0/3702139763 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:22.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.348+0000 7f69aa800640 1 --2- 172.21.15.32:0/3702139763 >> v2:172.21.15.171:3300/0 conn(0x7f69ac0cd390 0x7f69ac0cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.348+0000 7f69a9e00640 1 -- 172.21.15.32:0/3702139763 >> v2:172.21.15.171:3300/0 conn(0x7f69ac0cd390 msgr2=0x7f69ac0cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:22.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.348+0000 7f69a9e00640 1 --2- 172.21.15.32:0/3702139763 >> v2:172.21.15.171:3300/0 conn(0x7f69ac0cd390 0x7f69ac0cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.348+0000 7f69a9e00640 1 -- 172.21.15.32:0/3702139763 >> v1:172.21.15.171:6789/0 conn(0x7f69ac0cf460 legacy=0x7f69ac0c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:22.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.348+0000 7f69a9e00640 1 -- 172.21.15.32:0/3702139763 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac0cc5d0 con 0x7f69ac15bb20 2024-03-19T06:21:22.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.348+0000 7f69aa800640 1 --2- 172.21.15.32:0/3702139763 >> v2:172.21.15.171:3300/0 conn(0x7f69ac0cd390 0x7f69ac0cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:22.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.352+0000 7f69a9e00640 1 --2- 172.21.15.32:0/3702139763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69ac15bb20 0x7f69ac09a480 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f69ac06e960 tx=0x7f699c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb1daee2e726810 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:22.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.352+0000 7f69a9400640 1 -- 172.21.15.32:0/3702139763 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c0b1070 con 0x7f69ac15bb20 2024-03-19T06:21:22.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.352+0000 7f69a9400640 1 -- 172.21.15.32:0/3702139763 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699c0ac630 con 0x7f69ac15bb20 2024-03-19T06:21:22.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.352+0000 7f69a9400640 1 -- 172.21.15.32:0/3702139763 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c0a8050 con 0x7f69ac15bb20 2024-03-19T06:21:22.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.352+0000 7f69b0e00640 1 -- 172.21.15.32:0/3702139763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69ac15bb20 msgr2=0x7f69ac09a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.352+0000 7f69b0e00640 1 --2- 172.21.15.32:0/3702139763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69ac15bb20 0x7f69ac09a480 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f69ac06e960 tx=0x7f699c01c4e0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.352+0000 7f69b0e00640 1 -- 172.21.15.32:0/3702139763 shutdown_connections 2024-03-19T06:21:22.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.352+0000 7f69b0e00640 1 --2- 172.21.15.32:0/3702139763 >> v2:172.21.15.171:3300/0 conn(0x7f69ac0cd390 0x7f69ac0cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.352+0000 7f69b0e00640 1 --2- 172.21.15.32:0/3702139763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69ac15bb20 0x7f69ac09a480 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.352+0000 7f69b0e00640 1 -- 172.21.15.32:0/3702139763 >> 172.21.15.32:0/3702139763 conn(0x7f69ac0d1890 msgr2=0x7f69ac0d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:22.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.352+0000 7f69b0e00640 1 -- 172.21.15.32:0/3702139763 shutdown_connections 2024-03-19T06:21:22.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.352+0000 7f69b0e00640 1 -- 172.21.15.32:0/3702139763 wait complete. 2024-03-19T06:21:22.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69b0e00640 1 Processor -- start 2024-03-19T06:21:22.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69b0e00640 1 -- start start 2024-03-19T06:21:22.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69b0e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69ac0cd390 0x7f69ac145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69b0e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69ac0cf460 0x7f69ac15c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69b0e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69ac15bb20 0x7f69ac156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69b0e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac0c5af0 con 0x7f69ac0cf460 2024-03-19T06:21:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69b0e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac0cf8d0 con 0x7f69ac0cd390 2024-03-19T06:21:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69b0e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac168940 con 0x7f69ac15bb20 2024-03-19T06:21:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69a3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69ac0cf460 0x7f69ac15c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69a3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69ac0cf460 0x7f69ac15c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45876/0 (socket says 172.21.15.32:45876) 2024-03-19T06:21:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69a3e00640 1 -- 172.21.15.32:0/2932163624 learned_addr learned my addr 172.21.15.32:0/2932163624 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69a9e00640 1 --2- 172.21.15.32:0/2932163624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69ac0cd390 0x7f69ac145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69aa800640 1 --2- 172.21.15.32:0/2932163624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69ac15bb20 0x7f69ac156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69a3e00640 1 -- 172.21.15.32:0/2932163624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69ac15bb20 msgr2=0x7f69ac156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69a3e00640 1 --2- 172.21.15.32:0/2932163624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69ac15bb20 0x7f69ac156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69a3e00640 1 -- 172.21.15.32:0/2932163624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69ac0cd390 msgr2=0x7f69ac145bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69a3e00640 1 --2- 172.21.15.32:0/2932163624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69ac0cd390 0x7f69ac145bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69a3e00640 1 -- 172.21.15.32:0/2932163624 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac153a90 con 0x7f69ac0cf460 2024-03-19T06:21:22.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69a3e00640 1 --2- 172.21.15.32:0/2932163624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69ac0cf460 0x7f69ac15c0d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f699400c450 tx=0x7f699400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:22.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69a2000640 1 -- 172.21.15.32:0/2932163624 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6994012830 con 0x7f69ac0cf460 2024-03-19T06:21:22.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69a2000640 1 -- 172.21.15.32:0/2932163624 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6994017070 con 0x7f69ac0cf460 2024-03-19T06:21:22.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69a2000640 1 -- 172.21.15.32:0/2932163624 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6994012c30 con 0x7f69ac0cf460 2024-03-19T06:21:22.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69b0e00640 1 -- 172.21.15.32:0/2932163624 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ac153d70 con 0x7f69ac0cf460 2024-03-19T06:21:22.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69b0e00640 1 -- 172.21.15.32:0/2932163624 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ac154330 con 0x7f69ac0cf460 2024-03-19T06:21:22.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.356+0000 7f69b0e00640 1 -- 172.21.15.32:0/2932163624 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ac154530 con 0x7f69ac0cf460 2024-03-19T06:21:22.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.360+0000 7f69a2000640 1 -- 172.21.15.32:0/2932163624 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f699401c460 con 0x7f69ac0cf460 2024-03-19T06:21:22.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.360+0000 7f69a2000640 1 --2- 172.21.15.32:0/2932163624 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6988067690 0x7f6988069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.360+0000 7f69a2000640 1 -- 172.21.15.32:0/2932163624 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6994085660 con 0x7f69ac0cf460 2024-03-19T06:21:22.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.360+0000 7f69a9e00640 1 --2- 172.21.15.32:0/2932163624 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6988067690 0x7f6988069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.360+0000 7f69a9e00640 1 --2- 172.21.15.32:0/2932163624 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6988067690 0x7f6988069b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f699c0ae000 tx=0x7f699c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:22.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.364+0000 7f69a2000640 1 -- 172.21.15.32:0/2932163624 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f69ac154530 con 0x7f69ac0cf460 2024-03-19T06:21:22.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.560+0000 7f69b0e00640 1 -- 172.21.15.32:0/2932163624 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69ac0749e0 con 0x7f69ac0cf460 2024-03-19T06:21:22.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.564+0000 7f69a2000640 1 -- 172.21.15.32:0/2932163624 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4935 (secure 0 0 0) 0x7f69940562d0 con 0x7f69ac0cf460 2024-03-19T06:21:22.555 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:22.555 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/3555048948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3555048948},{"type":"v1","addr":"172.21.15.32:6834","nonce":3555048948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3484789829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3484789829},{"type":"v1","addr":"172.21.15.171:6836","nonce":3484789829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/851750022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":851750022},{"type":"v1","addr":"172.21.15.171:6837","nonce":851750022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:21:08.817580+0000","modified":"2024-03-19T06:21:11.829499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/1902889035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":1902889035},{"type":"v1","addr":"172.21.15.32:6835","nonce":1902889035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-19T06:21:22.556 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-03-19T06:21:22.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.564+0000 7f69b0e00640 1 -- 172.21.15.32:0/2932163624 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6988067690 msgr2=0x7f6988069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.564+0000 7f69b0e00640 1 --2- 172.21.15.32:0/2932163624 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6988067690 0x7f6988069b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f699c0ae000 tx=0x7f699c008040 comp rx=0 tx=0).stop 2024-03-19T06:21:22.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.564+0000 7f69b0e00640 1 -- 172.21.15.32:0/2932163624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69ac0cf460 msgr2=0x7f69ac15c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.564+0000 7f69b0e00640 1 --2- 172.21.15.32:0/2932163624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69ac0cf460 0x7f69ac15c0d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f699400c450 tx=0x7f699400c910 comp rx=0 tx=0).stop 2024-03-19T06:21:22.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.564+0000 7f69b0e00640 1 -- 172.21.15.32:0/2932163624 shutdown_connections 2024-03-19T06:21:22.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.564+0000 7f69b0e00640 1 --2- 172.21.15.32:0/2932163624 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6988067690 0x7f6988069b50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.564+0000 7f69b0e00640 1 --2- 172.21.15.32:0/2932163624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69ac15bb20 0x7f69ac156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.564+0000 7f69b0e00640 1 --2- 172.21.15.32:0/2932163624 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69ac0cf460 0x7f69ac15c0d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.564+0000 7f69b0e00640 1 --2- 172.21.15.32:0/2932163624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69ac0cd390 0x7f69ac145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.564+0000 7f69b0e00640 1 -- 172.21.15.32:0/2932163624 >> 172.21.15.32:0/2932163624 conn(0x7f69ac0d1890 msgr2=0x7f69ac0c5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:22.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.564+0000 7f69b0e00640 1 -- 172.21.15.32:0/2932163624 shutdown_connections 2024-03-19T06:21:22.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.564+0000 7f69b0e00640 1 -- 172.21.15.32:0/2932163624 wait complete. 2024-03-19T06:21:22.575 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:22.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.724+0000 7fa7c0c00640 1 Processor -- start 2024-03-19T06:21:22.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.724+0000 7fa7c0c00640 1 -- start start 2024-03-19T06:21:22.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.724+0000 7fa7c0c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa7bc06d6c0 0x7fa7bc06daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.724+0000 7fa7c0c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc15fe20 con 0x7fa7bc0aecf0 2024-03-19T06:21:22.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.724+0000 7fa7c0c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc160100 con 0x7fa7bc15c010 2024-03-19T06:21:22.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.724+0000 7fa7c0c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7bc1603e0 con 0x7fa7bc06d6c0 2024-03-19T06:21:22.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.724+0000 7fa7b9e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa7bc0aecf0 0x7fa7bc0ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47790/0 (socket says 172.21.15.32:47790) 2024-03-19T06:21:22.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.724+0000 7fa7b9e00640 1 -- 172.21.15.32:0/2465053763 learned_addr learned my addr 172.21.15.32:0/2465053763 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:22.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.724+0000 7fa7ba800640 1 --2- 172.21.15.32:0/2465053763 >> v2:172.21.15.32:3300/0 conn(0x7fa7bc06d6c0 0x7fa7bc06daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.724+0000 7fa7b9400640 1 -- 172.21.15.32:0/2465053763 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979983211 0 0) 0x7fa7bc15fe20 con 0x7fa7bc0aecf0 2024-03-19T06:21:22.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.724+0000 7fa7ba800640 1 -- 172.21.15.32:0/2465053763 >> v1:172.21.15.171:6789/0 conn(0x7fa7bc15c010 legacy=0x7fa7bc15f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.724+0000 7fa7ba800640 1 -- 172.21.15.32:0/2465053763 >> v1:172.21.15.32:6789/0 conn(0x7fa7bc0aecf0 legacy=0x7fa7bc0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.724+0000 7fa7ba800640 1 -- 172.21.15.32:0/2465053763 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc0ca1f0 con 0x7fa7bc06d6c0 2024-03-19T06:21:22.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.728+0000 7fa7ba800640 1 --2- 172.21.15.32:0/2465053763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7bc06d6c0 0x7fa7bc06daf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009d90 tx=0x7fa7b401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bcf1a3d0472671 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:22.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.728+0000 7fa7b9400640 1 -- 172.21.15.32:0/2465053763 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b40b2070 con 0x7fa7bc06d6c0 2024-03-19T06:21:22.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.728+0000 7fa7b9400640 1 -- 172.21.15.32:0/2465053763 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b40a58b0 con 0x7fa7bc06d6c0 2024-03-19T06:21:22.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.728+0000 7fa7b9400640 1 -- 172.21.15.32:0/2465053763 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b40a5c80 con 0x7fa7bc06d6c0 2024-03-19T06:21:22.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.728+0000 7fa7c0c00640 1 -- 172.21.15.32:0/2465053763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7bc06d6c0 msgr2=0x7fa7bc06daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.728+0000 7fa7c0c00640 1 --2- 172.21.15.32:0/2465053763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7bc06d6c0 0x7fa7bc06daf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009d90 tx=0x7fa7b401c8e0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.728+0000 7fa7c0c00640 1 -- 172.21.15.32:0/2465053763 shutdown_connections 2024-03-19T06:21:22.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.728+0000 7fa7c0c00640 1 --2- 172.21.15.32:0/2465053763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7bc06d6c0 0x7fa7bc06daf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.728+0000 7fa7c0c00640 1 -- 172.21.15.32:0/2465053763 >> 172.21.15.32:0/2465053763 conn(0x7fa7bc0b1280 msgr2=0x7fa7bc0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:22.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.728+0000 7fa7c0c00640 1 -- 172.21.15.32:0/2465053763 shutdown_connections 2024-03-19T06:21:22.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.728+0000 7fa7c0c00640 1 -- 172.21.15.32:0/2465053763 wait complete. 2024-03-19T06:21:22.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7c0c00640 1 Processor -- start 2024-03-19T06:21:22.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7c0c00640 1 -- start start 2024-03-19T06:21:22.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7c0c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7bc06d6c0 0x7fa7bc158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7c0c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7bc0aecf0 0x7fa7bc0c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7c0c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7bc15c010 0x7fa7bc0c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7c0c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc06e030 con 0x7fa7bc15c010 2024-03-19T06:21:22.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7c0c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0cbe70 con 0x7fa7bc06d6c0 2024-03-19T06:21:22.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7c0c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc1696a0 con 0x7fa7bc0aecf0 2024-03-19T06:21:22.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7ba800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7bc15c010 0x7fa7bc0c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7ba800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7bc15c010 0x7fa7bc0c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45902/0 (socket says 172.21.15.32:45902) 2024-03-19T06:21:22.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7ba800640 1 -- 172.21.15.32:0/1042848660 learned_addr learned my addr 172.21.15.32:0/1042848660 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7b9e00640 1 --2- 172.21.15.32:0/1042848660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7bc06d6c0 0x7fa7bc158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7b3e00640 1 --2- 172.21.15.32:0/1042848660 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7bc0aecf0 0x7fa7bc0c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7ba800640 1 -- 172.21.15.32:0/1042848660 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7bc0aecf0 msgr2=0x7fa7bc0c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7ba800640 1 --2- 172.21.15.32:0/1042848660 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7bc0aecf0 0x7fa7bc0c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7ba800640 1 -- 172.21.15.32:0/1042848660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7bc06d6c0 msgr2=0x7fa7bc158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7ba800640 1 --2- 172.21.15.32:0/1042848660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7bc06d6c0 0x7fa7bc158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7ba800640 1 -- 172.21.15.32:0/1042848660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc0b3dc0 con 0x7fa7bc15c010 2024-03-19T06:21:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7b3e00640 1 --2- 172.21.15.32:0/1042848660 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7bc0aecf0 0x7fa7bc0c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7ba800640 1 --2- 172.21.15.32:0/1042848660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7bc15c010 0x7fa7bc0c8e40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40b0040 tx=0x7fa7b4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7b2000640 1 -- 172.21.15.32:0/1042848660 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b40b2050 con 0x7fa7bc15c010 2024-03-19T06:21:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7b2000640 1 -- 172.21.15.32:0/1042848660 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b40be070 con 0x7fa7bc15c010 2024-03-19T06:21:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7b2000640 1 -- 172.21.15.32:0/1042848660 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b40ade20 con 0x7fa7bc15c010 2024-03-19T06:21:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7c0c00640 1 -- 172.21.15.32:0/1042848660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7bc159510 con 0x7fa7bc15c010 2024-03-19T06:21:22.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7c0c00640 1 -- 172.21.15.32:0/1042848660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7bc0b4340 con 0x7fa7bc15c010 2024-03-19T06:21:22.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.732+0000 7fa7c0c00640 1 -- 172.21.15.32:0/1042848660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7bc0749e0 con 0x7fa7bc15c010 2024-03-19T06:21:22.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.736+0000 7fa7b2000640 1 -- 172.21.15.32:0/1042848660 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa7b40c3460 con 0x7fa7bc15c010 2024-03-19T06:21:22.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.736+0000 7fa7b2000640 1 --2- 172.21.15.32:0/1042848660 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa798067660 0x7fa798069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:22.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.736+0000 7fa7b2000640 1 -- 172.21.15.32:0/1042848660 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7b4120c40 con 0x7fa7bc15c010 2024-03-19T06:21:22.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.736+0000 7fa7b9e00640 1 --2- 172.21.15.32:0/1042848660 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa798067660 0x7fa798069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:22.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.736+0000 7fa7b9e00640 1 --2- 172.21.15.32:0/1042848660 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa798067660 0x7fa798069b20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac007a90 tx=0x7fa7ac0079e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:22.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.740+0000 7fa7b2000640 1 -- 172.21.15.32:0/1042848660 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fa7b4016560 con 0x7fa7bc15c010 2024-03-19T06:21:22.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.904+0000 7fa7c0c00640 1 -- 172.21.15.32:0/1042848660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7bc06c310 con 0x7fa7bc15c010 2024-03-19T06:21:22.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.904+0000 7fa7b2000640 1 -- 172.21.15.32:0/1042848660 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16617 (secure 0 0 0) 0x7fa7b40f18e0 con 0x7fa7bc15c010 2024-03-19T06:21:22.897 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:22.897 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:10.423479+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:22.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.908+0000 7fa7c0c00640 1 -- 172.21.15.32:0/1042848660 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa798067660 msgr2=0x7fa798069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.908+0000 7fa7c0c00640 1 --2- 172.21.15.32:0/1042848660 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa798067660 0x7fa798069b20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac007a90 tx=0x7fa7ac0079e0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.908+0000 7fa7c0c00640 1 -- 172.21.15.32:0/1042848660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7bc15c010 msgr2=0x7fa7bc0c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:22.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.908+0000 7fa7c0c00640 1 --2- 172.21.15.32:0/1042848660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7bc15c010 0x7fa7bc0c8e40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40b0040 tx=0x7fa7b4019680 comp rx=0 tx=0).stop 2024-03-19T06:21:22.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.908+0000 7fa7c0c00640 1 -- 172.21.15.32:0/1042848660 shutdown_connections 2024-03-19T06:21:22.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.908+0000 7fa7c0c00640 1 --2- 172.21.15.32:0/1042848660 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa798067660 0x7fa798069b20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.908+0000 7fa7c0c00640 1 --2- 172.21.15.32:0/1042848660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7bc15c010 0x7fa7bc0c8e40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.908+0000 7fa7c0c00640 1 --2- 172.21.15.32:0/1042848660 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7bc0aecf0 0x7fa7bc0c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.908+0000 7fa7c0c00640 1 --2- 172.21.15.32:0/1042848660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7bc06d6c0 0x7fa7bc158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:22.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.908+0000 7fa7c0c00640 1 -- 172.21.15.32:0/1042848660 >> 172.21.15.32:0/1042848660 conn(0x7fa7bc0b1280 msgr2=0x7fa7bc0ca9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:22.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.908+0000 7fa7c0c00640 1 -- 172.21.15.32:0/1042848660 shutdown_connections 2024-03-19T06:21:22.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:22.908+0000 7fa7c0c00640 1 -- 172.21.15.32:0/1042848660 wait complete. 2024-03-19T06:21:22.919 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:21:23.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.068+0000 7fc561000640 1 Processor -- start 2024-03-19T06:21:23.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.068+0000 7fc561000640 1 -- start start 2024-03-19T06:21:23.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.068+0000 7fc561000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc55c0cc680 0x7fc55c15ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.068+0000 7fc561000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55c0cb670 con 0x7fc55c0b4c50 2024-03-19T06:21:23.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.068+0000 7fc561000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55c0cb950 con 0x7fc55c15a7c0 2024-03-19T06:21:23.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.068+0000 7fc561000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c15e860 con 0x7fc55c0cc680 2024-03-19T06:21:23.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.068+0000 7fc55a800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc55c0b4c50 0x7fc55c0cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47796/0 (socket says 172.21.15.32:47796) 2024-03-19T06:21:23.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.068+0000 7fc55a800640 1 -- 172.21.15.32:0/832330554 learned_addr learned my addr 172.21.15.32:0/832330554 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:23.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.068+0000 7fc553e00640 1 --2- 172.21.15.32:0/832330554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc55c0cc680 0x7fc55c15ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.072+0000 7fc559400640 1 -- 172.21.15.32:0/832330554 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404056089 0 0) 0x7fc55c0cb670 con 0x7fc55c0b4c50 2024-03-19T06:21:23.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.072+0000 7fc559400640 1 -- 172.21.15.32:0/832330554 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc540003530 con 0x7fc55c0b4c50 2024-03-19T06:21:23.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.072+0000 7fc559400640 1 -- 172.21.15.32:0/832330554 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92037366 0 0) 0x7fc55c0cb950 con 0x7fc55c15a7c0 2024-03-19T06:21:23.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.072+0000 7fc559400640 1 -- 172.21.15.32:0/832330554 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc55c0cb670 con 0x7fc55c15a7c0 2024-03-19T06:21:23.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.072+0000 7fc553e00640 1 -- 172.21.15.32:0/832330554 >> v1:172.21.15.171:6789/0 conn(0x7fc55c15a7c0 legacy=0x7fc55c0cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.072+0000 7fc553e00640 1 -- 172.21.15.32:0/832330554 >> v1:172.21.15.32:6789/0 conn(0x7fc55c0b4c50 legacy=0x7fc55c0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.072+0000 7fc553e00640 1 -- 172.21.15.32:0/832330554 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c15e4f0 con 0x7fc55c0cc680 2024-03-19T06:21:23.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.072+0000 7fc553e00640 1 --2- 172.21.15.32:0/832330554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc55c0cc680 0x7fc55c15ecf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc5440097f0 tx=0x7fc54401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f00038af80dcd server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:23.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.072+0000 7fc559400640 1 -- 172.21.15.32:0/832330554 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440b0070 con 0x7fc55c0cc680 2024-03-19T06:21:23.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.072+0000 7fc559400640 1 -- 172.21.15.32:0/832330554 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5440ab600 con 0x7fc55c0cc680 2024-03-19T06:21:23.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.072+0000 7fc559400640 1 -- 172.21.15.32:0/832330554 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440ab9d0 con 0x7fc55c0cc680 2024-03-19T06:21:23.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc561000640 1 -- 172.21.15.32:0/832330554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc55c0cc680 msgr2=0x7fc55c15ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc561000640 1 --2- 172.21.15.32:0/832330554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc55c0cc680 0x7fc55c15ecf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc5440097f0 tx=0x7fc54401c450 comp rx=0 tx=0).stop 2024-03-19T06:21:23.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc561000640 1 -- 172.21.15.32:0/832330554 shutdown_connections 2024-03-19T06:21:23.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc561000640 1 --2- 172.21.15.32:0/832330554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc55c0cc680 0x7fc55c15ecf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc561000640 1 -- 172.21.15.32:0/832330554 >> 172.21.15.32:0/832330554 conn(0x7fc55c0b1280 msgr2=0x7fc55c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:23.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc561000640 1 -- 172.21.15.32:0/832330554 shutdown_connections 2024-03-19T06:21:23.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc561000640 1 -- 172.21.15.32:0/832330554 wait complete. 2024-03-19T06:21:23.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc561000640 1 Processor -- start 2024-03-19T06:21:23.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc561000640 1 -- start start 2024-03-19T06:21:23.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc561000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc55c0b4c50 0x7fc55c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc561000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc55c0cc680 0x7fc55c0c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc561000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc55c15a7c0 0x7fc55c0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc561000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0cbdb0 con 0x7fc55c0b4c50 2024-03-19T06:21:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc561000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0cbc30 con 0x7fc55c15a7c0 2024-03-19T06:21:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc561000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c071b60 con 0x7fc55c0cc680 2024-03-19T06:21:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc559e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc55c0b4c50 0x7fc55c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc559e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc55c0b4c50 0x7fc55c15d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45908/0 (socket says 172.21.15.32:45908) 2024-03-19T06:21:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc559e00640 1 -- 172.21.15.32:0/1395679458 learned_addr learned my addr 172.21.15.32:0/1395679458 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc55a800640 1 --2- 172.21.15.32:0/1395679458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc55c15a7c0 0x7fc55c0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.076+0000 7fc553e00640 1 --2- 172.21.15.32:0/1395679458 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc55c0cc680 0x7fc55c0c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc559e00640 1 -- 172.21.15.32:0/1395679458 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc55c0cc680 msgr2=0x7fc55c0c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc559e00640 1 --2- 172.21.15.32:0/1395679458 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc55c0cc680 0x7fc55c0c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc559e00640 1 -- 172.21.15.32:0/1395679458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc55c15a7c0 msgr2=0x7fc55c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc559e00640 1 --2- 172.21.15.32:0/1395679458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc55c15a7c0 0x7fc55c0b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc559e00640 1 -- 172.21.15.32:0/1395679458 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c14fd70 con 0x7fc55c0b4c50 2024-03-19T06:21:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc553e00640 1 --2- 172.21.15.32:0/1395679458 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc55c0cc680 0x7fc55c0c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc55a800640 1 --2- 172.21.15.32:0/1395679458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc55c15a7c0 0x7fc55c0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc559e00640 1 --2- 172.21.15.32:0/1395679458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc55c0b4c50 0x7fc55c15d9a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00c430 tx=0x7fc54c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc552000640 1 -- 172.21.15.32:0/1395679458 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c017070 con 0x7fc55c0b4c50 2024-03-19T06:21:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc552000640 1 -- 172.21.15.32:0/1395679458 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c0052f0 con 0x7fc55c0b4c50 2024-03-19T06:21:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc561000640 1 -- 172.21.15.32:0/1395679458 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55c150030 con 0x7fc55c0b4c50 2024-03-19T06:21:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc552000640 1 -- 172.21.15.32:0/1395679458 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c003840 con 0x7fc55c0b4c50 2024-03-19T06:21:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc561000640 1 -- 172.21.15.32:0/1395679458 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55c1505f0 con 0x7fc55c0b4c50 2024-03-19T06:21:23.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc561000640 1 -- 172.21.15.32:0/1395679458 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55c0cd0e0 con 0x7fc55c0b4c50 2024-03-19T06:21:23.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc552000640 1 -- 172.21.15.32:0/1395679458 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc54c01a070 con 0x7fc55c0b4c50 2024-03-19T06:21:23.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc552000640 1 --2- 172.21.15.32:0/1395679458 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc538067660 0x7fc538069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.080+0000 7fc552000640 1 -- 172.21.15.32:0/1395679458 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc54c084cf0 con 0x7fc55c0b4c50 2024-03-19T06:21:23.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.084+0000 7fc553e00640 1 --2- 172.21.15.32:0/1395679458 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc538067660 0x7fc538069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.084+0000 7fc553e00640 1 --2- 172.21.15.32:0/1395679458 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc538067660 0x7fc538069b20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc5440ad000 tx=0x7fc5440a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:23.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.088+0000 7fc552000640 1 -- 172.21.15.32:0/1395679458 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fc54c0558d0 con 0x7fc55c0b4c50 2024-03-19T06:21:23.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.284+0000 7fc561000640 1 -- 172.21.15.32:0/1395679458 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc55c0749e0 con 0x7fc55c0b4c50 2024-03-19T06:21:23.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.284+0000 7fc552000640 1 -- 172.21.15.32:0/1395679458 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4935 (secure 0 0 0) 0x7fc54c0551d0 con 0x7fc55c0b4c50 2024-03-19T06:21:23.276 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:23.276 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/3555048948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3555048948},{"type":"v1","addr":"172.21.15.32:6834","nonce":3555048948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3484789829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3484789829},{"type":"v1","addr":"172.21.15.171:6836","nonce":3484789829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/851750022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":851750022},{"type":"v1","addr":"172.21.15.171:6837","nonce":851750022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:21:08.817580+0000","modified":"2024-03-19T06:21:11.829499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/1902889035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":1902889035},{"type":"v1","addr":"172.21.15.32:6835","nonce":1902889035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-19T06:21:23.276 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-03-19T06:21:23.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.284+0000 7fc561000640 1 -- 172.21.15.32:0/1395679458 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc538067660 msgr2=0x7fc538069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.284+0000 7fc561000640 1 --2- 172.21.15.32:0/1395679458 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc538067660 0x7fc538069b20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc5440ad000 tx=0x7fc5440a6000 comp rx=0 tx=0).stop 2024-03-19T06:21:23.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.284+0000 7fc561000640 1 -- 172.21.15.32:0/1395679458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc55c0b4c50 msgr2=0x7fc55c15d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.284+0000 7fc561000640 1 --2- 172.21.15.32:0/1395679458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc55c0b4c50 0x7fc55c15d9a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00c430 tx=0x7fc54c00c8f0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.284+0000 7fc561000640 1 -- 172.21.15.32:0/1395679458 shutdown_connections 2024-03-19T06:21:23.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.284+0000 7fc561000640 1 --2- 172.21.15.32:0/1395679458 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc538067660 0x7fc538069b20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.284+0000 7fc561000640 1 --2- 172.21.15.32:0/1395679458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc55c15a7c0 0x7fc55c0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.284+0000 7fc561000640 1 --2- 172.21.15.32:0/1395679458 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc55c0cc680 0x7fc55c0c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.284+0000 7fc561000640 1 --2- 172.21.15.32:0/1395679458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc55c0b4c50 0x7fc55c15d9a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.284+0000 7fc561000640 1 -- 172.21.15.32:0/1395679458 >> 172.21.15.32:0/1395679458 conn(0x7fc55c0b1280 msgr2=0x7fc55c152450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:23.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.284+0000 7fc561000640 1 -- 172.21.15.32:0/1395679458 shutdown_connections 2024-03-19T06:21:23.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.284+0000 7fc561000640 1 -- 172.21.15.32:0/1395679458 wait complete. 2024-03-19T06:21:23.699 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-19T06:21:08.817580+0000', 'modified': '2024-03-19T06:21:11.829499+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.32:6835/1902889035', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6832', 'nonce': 1902889035}, {'type': 'v1', 'addr': '172.21.15.32:6835', 'nonce': 1902889035}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-19T06:21:23.700 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-19T06:21:23.700 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-19T06:21:23.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c35600640 1 Processor -- start 2024-03-19T06:21:23.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c35600640 1 -- start start 2024-03-19T06:21:23.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c35600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c300cc680 0x7f3c3015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c35600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c300cb670 con 0x7f3c3015a7c0 2024-03-19T06:21:23.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c35600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c300cb950 con 0x7f3c300b4c50 2024-03-19T06:21:23.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c35600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3015e860 con 0x7f3c300cc680 2024-03-19T06:21:23.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2ea00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3c3015a7c0 0x7f3c300cae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38470/0 (socket says 172.21.15.32:38470) 2024-03-19T06:21:23.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2ea00640 1 -- 172.21.15.32:0/2482740844 learned_addr learned my addr 172.21.15.32:0/2482740844 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:23.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c27e00640 1 --2- 172.21.15.32:0/2482740844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c300cc680 0x7f3c3015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 -- 172.21.15.32:0/2482740844 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222197232 0 0) 0x7f3c300cb670 con 0x7f3c3015a7c0 2024-03-19T06:21:23.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 -- 172.21.15.32:0/2482740844 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c14003530 con 0x7f3c3015a7c0 2024-03-19T06:21:23.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 -- 172.21.15.32:0/2482740844 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768653743 0 0) 0x7f3c300cb950 con 0x7f3c300b4c50 2024-03-19T06:21:23.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 -- 172.21.15.32:0/2482740844 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c300cb670 con 0x7f3c300b4c50 2024-03-19T06:21:23.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 -- 172.21.15.32:0/2482740844 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2780546691 0 0) 0x7f3c14003530 con 0x7f3c3015a7c0 2024-03-19T06:21:23.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 -- 172.21.15.32:0/2482740844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c300cc680 msgr2=0x7f3c3015ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:23.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 --2- 172.21.15.32:0/2482740844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c300cc680 0x7f3c3015ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 -- 172.21.15.32:0/2482740844 >> v1:172.21.15.171:6789/0 conn(0x7f3c300b4c50 legacy=0x7f3c300cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 -- 172.21.15.32:0/2482740844 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3015e4f0 con 0x7f3c3015a7c0 2024-03-19T06:21:23.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 -- 172.21.15.32:0/2482740844 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f3c20001680 con 0x7f3c3015a7c0 2024-03-19T06:21:23.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 -- 172.21.15.32:0/2482740844 >> v1:172.21.15.32:6789/0 conn(0x7f3c3015a7c0 legacy=0x7f3c300cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 --2- 172.21.15.32:0/2482740844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c300cc680 0x7f3c14003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 --2- 172.21.15.32:0/2482740844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c140040e0 0x7f3c14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 --2- 172.21.15.32:0/2482740844 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c14004d50 0x7f3c140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 -- 172.21.15.32:0/2482740844 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3015e860 con 0x7f3c14004d50 2024-03-19T06:21:23.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 -- 172.21.15.32:0/2482740844 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1400bb60 con 0x7f3c140040e0 2024-03-19T06:21:23.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2e000640 1 -- 172.21.15.32:0/2482740844 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1400bd30 con 0x7f3c300cc680 2024-03-19T06:21:23.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2f400640 1 --2- 172.21.15.32:0/2482740844 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c14004d50 0x7f3c140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c2ea00640 1 --2- 172.21.15.32:0/2482740844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c300cc680 0x7f3c14003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.852+0000 7f3c27e00640 1 --2- 172.21.15.32:0/2482740844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c140040e0 0x7f3c14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.856+0000 7f3c2f400640 1 -- 172.21.15.32:0/2482740844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c300cc680 msgr2=0x7f3c14003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:23.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.856+0000 7f3c2f400640 1 --2- 172.21.15.32:0/2482740844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c300cc680 0x7f3c14003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.856+0000 7f3c2f400640 1 -- 172.21.15.32:0/2482740844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c140040e0 msgr2=0x7f3c14004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:23.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.856+0000 7f3c2f400640 1 --2- 172.21.15.32:0/2482740844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c140040e0 0x7f3c14004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.856+0000 7f3c2f400640 1 -- 172.21.15.32:0/2482740844 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c14003530 con 0x7f3c14004d50 2024-03-19T06:21:23.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.856+0000 7f3c2f400640 1 --2- 172.21.15.32:0/2482740844 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c14004d50 0x7f3c140051d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3c28002060 tx=0x7f3c28021730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9233cdbcc5439125 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:23.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.856+0000 7f3c2e000640 1 -- 172.21.15.32:0/2482740844 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c280b5070 con 0x7f3c14004d50 2024-03-19T06:21:23.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.856+0000 7f3c2e000640 1 -- 172.21.15.32:0/2482740844 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c28003ba0 con 0x7f3c14004d50 2024-03-19T06:21:23.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.856+0000 7f3c2e000640 1 -- 172.21.15.32:0/2482740844 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28001cb0 con 0x7f3c14004d50 2024-03-19T06:21:23.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.856+0000 7f3c35600640 1 -- 172.21.15.32:0/2482740844 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c14004d50 msgr2=0x7f3c140051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.856+0000 7f3c35600640 1 --2- 172.21.15.32:0/2482740844 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c14004d50 0x7f3c140051d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3c28002060 tx=0x7f3c28021730 comp rx=0 tx=0).stop 2024-03-19T06:21:23.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.856+0000 7f3c2f400640 1 -- 172.21.15.32:0/2482740844 reap_dead start 2024-03-19T06:21:23.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.856+0000 7f3c35600640 1 -- 172.21.15.32:0/2482740844 shutdown_connections 2024-03-19T06:21:23.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.856+0000 7f3c35600640 1 -- 172.21.15.32:0/2482740844 >> 172.21.15.32:0/2482740844 conn(0x7f3c300b1280 msgr2=0x7f3c300b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:23.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.856+0000 7f3c35600640 1 -- 172.21.15.32:0/2482740844 shutdown_connections 2024-03-19T06:21:23.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.856+0000 7f3c35600640 1 -- 172.21.15.32:0/2482740844 wait complete. 2024-03-19T06:21:23.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c35600640 1 Processor -- start 2024-03-19T06:21:23.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c35600640 1 -- start start 2024-03-19T06:21:23.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c35600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c14004d50 0x7f3c3015c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c35600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c30152800 0x7f3c30152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c35600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c300c44f0 0x7f3c300c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c35600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300cbdb0 con 0x7f3c14004d50 2024-03-19T06:21:23.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c35600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300cbc30 con 0x7f3c30152800 2024-03-19T06:21:23.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c35600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300cd890 con 0x7f3c300c44f0 2024-03-19T06:21:23.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c2ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c14004d50 0x7f3c3015c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c2ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c14004d50 0x7f3c3015c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36432/0 (socket says 172.21.15.32:36432) 2024-03-19T06:21:23.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c2ea00640 1 -- 172.21.15.32:0/1453264087 learned_addr learned my addr 172.21.15.32:0/1453264087 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:23.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c2ea00640 1 -- 172.21.15.32:0/1453264087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c300c44f0 msgr2=0x7f3c300c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c2ea00640 1 --2- 172.21.15.32:0/1453264087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c300c44f0 0x7f3c300c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c2ea00640 1 -- 172.21.15.32:0/1453264087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c30152800 msgr2=0x7f3c30152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c27e00640 1 --2- 172.21.15.32:0/1453264087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c30152800 0x7f3c30152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c2ea00640 1 --2- 172.21.15.32:0/1453264087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c30152800 0x7f3c30152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c2ea00640 1 -- 172.21.15.32:0/1453264087 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c300c5200 con 0x7f3c14004d50 2024-03-19T06:21:23.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c27e00640 1 --2- 172.21.15.32:0/1453264087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c30152800 0x7f3c30152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:23.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c2ea00640 1 --2- 172.21.15.32:0/1453264087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c14004d50 0x7f3c3015c7f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3c200072c0 tx=0x7f3c20007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:23.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c26a00640 1 -- 172.21.15.32:0/1453264087 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20001660 con 0x7f3c14004d50 2024-03-19T06:21:23.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c26a00640 1 -- 172.21.15.32:0/1453264087 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c20018070 con 0x7f3c14004d50 2024-03-19T06:21:23.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c26a00640 1 -- 172.21.15.32:0/1453264087 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2000fbe0 con 0x7f3c14004d50 2024-03-19T06:21:23.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c35600640 1 -- 172.21.15.32:0/1453264087 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c300c54e0 con 0x7f3c14004d50 2024-03-19T06:21:23.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.860+0000 7f3c35600640 1 -- 172.21.15.32:0/1453264087 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c300c5aa0 con 0x7f3c14004d50 2024-03-19T06:21:23.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.864+0000 7f3c26a00640 1 -- 172.21.15.32:0/1453264087 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3c2001d460 con 0x7f3c14004d50 2024-03-19T06:21:23.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.864+0000 7f3c26a00640 1 --2- 172.21.15.32:0/1453264087 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c0c067690 0x7f3c0c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.864+0000 7f3c26a00640 1 -- 172.21.15.32:0/1453264087 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c20085a60 con 0x7f3c14004d50 2024-03-19T06:21:23.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.864+0000 7f3c38b9e000 1 Processor -- start 2024-03-19T06:21:23.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.864+0000 7f3c27e00640 1 --2- 172.21.15.32:0/1453264087 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c0c067690 0x7f3c0c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.864+0000 7f3c38b9e000 1 -- start start 2024-03-19T06:21:23.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c27e00640 1 --2- 172.21.15.32:0/1453264087 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c0c067690 0x7f3c0c069b50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3c30159dd0 tx=0x7f3c18008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:23.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556955256d60 0x556955257140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556955257680 0x55695520ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55695520cf90 0x55695520d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569550f4420 con 0x556955257680 2024-03-19T06:21:23.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55695505bfa0 con 0x55695520cf90 2024-03-19T06:21:23.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x556954fe3e00 con 0x556955256d60 2024-03-19T06:21:23.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c27e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556955257680 0x55695520ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c27e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556955257680 0x55695520ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36444/0 (socket says 172.21.15.32:36444) 2024-03-19T06:21:23.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c27e00640 1 -- 172.21.15.32:0/3568934224 learned_addr learned my addr 172.21.15.32:0/3568934224 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:23.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c2ea00640 1 --2- 172.21.15.32:0/3568934224 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556955256d60 0x556955257140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c2f400640 1 --2- 172.21.15.32:0/3568934224 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55695520cf90 0x55695520d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c27e00640 1 -- 172.21.15.32:0/3568934224 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556955256d60 msgr2=0x556955257140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:23.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c27e00640 1 --2- 172.21.15.32:0/3568934224 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556955256d60 0x556955257140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c27e00640 1 -- 172.21.15.32:0/3568934224 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55695520cf90 msgr2=0x55695520d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:23.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c27e00640 1 --2- 172.21.15.32:0/3568934224 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55695520cf90 0x55695520d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c27e00640 1 -- 172.21.15.32:0/3568934224 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556954fe7cc0 con 0x556955257680 2024-03-19T06:21:23.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c27e00640 1 --2- 172.21.15.32:0/3568934224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556955257680 0x55695520ca50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3c18013e00 tx=0x7f3c18016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5defdfd3e6e1963c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:23.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c1f400640 1 -- 172.21.15.32:0/3568934224 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18016df0 con 0x556955257680 2024-03-19T06:21:23.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c1f400640 1 -- 172.21.15.32:0/3568934224 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c18028070 con 0x556955257680 2024-03-19T06:21:23.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c1f400640 1 -- 172.21.15.32:0/3568934224 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18023640 con 0x556955257680 2024-03-19T06:21:23.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 -- 172.21.15.32:0/3568934224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556955257680 msgr2=0x55695520ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/3568934224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556955257680 0x55695520ca50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3c18013e00 tx=0x7f3c18016000 comp rx=0 tx=0).stop 2024-03-19T06:21:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 -- 172.21.15.32:0/3568934224 shutdown_connections 2024-03-19T06:21:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/3568934224 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55695520cf90 0x55695520d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/3568934224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556955257680 0x55695520ca50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/3568934224 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556955256d60 0x556955257140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 -- 172.21.15.32:0/3568934224 >> 172.21.15.32:0/3568934224 conn(0x556955204310 msgr2=0x55695520b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 -- 172.21.15.32:0/3568934224 shutdown_connections 2024-03-19T06:21:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 -- 172.21.15.32:0/3568934224 wait complete. 2024-03-19T06:21:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 -- start start 2024-03-19T06:21:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.868+0000 7f3c38b9e000 1 Processor -- start 2024-03-19T06:21:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55695520cf90 0x556955218110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556955256d60 0x556955218650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556955257680 0x556955218b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x556955016b00 con 0x55695520cf90 2024-03-19T06:21:23.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556955058040 con 0x556955257680 2024-03-19T06:21:23.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569550605d0 con 0x556955256d60 2024-03-19T06:21:23.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 10 client.0 _ll_register_callbacks cb 0x556954ffded0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:21:23.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c2ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55695520cf90 0x556955218110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c2ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55695520cf90 0x556955218110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36452/0 (socket says 172.21.15.32:36452) 2024-03-19T06:21:23.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c2ea00640 1 -- 172.21.15.32:0/4094698013 learned_addr learned my addr 172.21.15.32:0/4094698013 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:23.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c2ea00640 1 -- 172.21.15.32:0/4094698013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556955256d60 msgr2=0x556955218650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:23.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c2ea00640 1 --2- 172.21.15.32:0/4094698013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556955256d60 0x556955218650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c2ea00640 1 -- 172.21.15.32:0/4094698013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556955257680 msgr2=0x556955218b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:23.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c2ea00640 1 --2- 172.21.15.32:0/4094698013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556955257680 0x556955218b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c2ea00640 1 -- 172.21.15.32:0/4094698013 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556955020380 con 0x55695520cf90 2024-03-19T06:21:23.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c2ea00640 1 --2- 172.21.15.32:0/4094698013 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55695520cf90 0x556955218110 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3c20007290 tx=0x7f3c2005e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728d6bb9fb030f83 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:23.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c13e00640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-03-19T06:21:23.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c13e00640 1 -- 172.21.15.32:0/4094698013 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20082060 con 0x55695520cf90 2024-03-19T06:21:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c13e00640 1 -- 172.21.15.32:0/4094698013 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c2005c270 con 0x55695520cf90 2024-03-19T06:21:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 -- 172.21.15.32:0/4094698013 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3c18028070 con 0x55695520cf90 2024-03-19T06:21:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c13e00640 1 -- 172.21.15.32:0/4094698013 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c20055440 con 0x55695520cf90 2024-03-19T06:21:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 10 client.4644 fetch_fsmap learned FSMap version 8 2024-03-19T06:21:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 -- 172.21.15.32:0/4094698013 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55695502f830 con 0x55695520cf90 2024-03-19T06:21:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c13e00640 1 -- 172.21.15.32:0/4094698013 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c18028070 con 0x55695520cf90 2024-03-19T06:21:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c13e00640 1 -- 172.21.15.32:0/4094698013 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3c200742d0 con 0x55695520cf90 2024-03-19T06:21:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 10 client.4644 fetch_fsmap finished waiting for FSMap version 8 2024-03-19T06:21:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 10 client.4644 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-19T06:21:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 20 client.4644 populate_metadata read hostname 'smithi032' 2024-03-19T06:21:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/4094698013 >> [v2:172.21.15.32:6832/1902889035,v1:172.21.15.32:6835/1902889035] conn(0x556955219460 0x5569552684e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 4 client.4644 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-19T06:21:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 -- 172.21.15.32:0/4094698013 --> [v2:172.21.15.32:6832/1902889035,v1:172.21.15.32:6835/1902889035] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556954ff7b60 con 0x556955219460 2024-03-19T06:21:23.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c27e00640 1 --2- 172.21.15.32:0/4094698013 >> [v2:172.21.15.32:6832/1902889035,v1:172.21.15.32:6835/1902889035] conn(0x556955219460 0x5569552684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c27e00640 1 --2- 172.21.15.32:0/4094698013 >> [v2:172.21.15.32:6832/1902889035,v1:172.21.15.32:6835/1902889035] conn(0x556955219460 0x5569552684e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53ad380fd3c3c10e server_cookie=9ca7cb8ba5abe6b4 in_seq=0 out_seq=0 2024-03-19T06:21:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c13e00640 10 client.4644 ms_handle_connect on v2:172.21.15.32:6832/1902889035 2024-03-19T06:21:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c13e00640 1 -- 172.21.15.32:0/4094698013 <== mds.0 v2:172.21.15.32:6832/1902889035 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556954ff7b60 con 0x556955219460 2024-03-19T06:21:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c13e00640 10 client.4644 handle_command_reply: tid=0 2024-03-19T06:21:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 client.4644 shutdown 2024-03-19T06:21:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 -- 172.21.15.32:0/4094698013 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55695520cf90 msgr2=0x556955218110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/4094698013 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55695520cf90 0x556955218110 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3c20007290 tx=0x7f3c2005e650 comp rx=0 tx=0).stop 2024-03-19T06:21:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 -- 172.21.15.32:0/4094698013 shutdown_connections 2024-03-19T06:21:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/4094698013 >> [v2:172.21.15.32:6832/1902889035,v1:172.21.15.32:6835/1902889035] conn(0x556955219460 0x5569552684e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/4094698013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556955257680 0x556955218b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/4094698013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556955256d60 0x556955218650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c13e00640 0 client.4644 ms_handle_reset on v2:172.21.15.32:6832/1902889035 2024-03-19T06:21:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/4094698013 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55695520cf90 0x556955218110 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 -- 172.21.15.32:0/4094698013 >> 172.21.15.32:0/4094698013 conn(0x556955204310 msgr2=0x55695520ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 -- 172.21.15.32:0/4094698013 shutdown_connections 2024-03-19T06:21:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 1 -- 172.21.15.32:0/4094698013 wait complete. 2024-03-19T06:21:23.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.872+0000 7f3c38b9e000 20 client.4644 trim_cache size 0 max 16384 2024-03-19T06:21:23.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.888+0000 7f3c38b9e000 1 Processor -- start 2024-03-19T06:21:23.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.888+0000 7f3c38b9e000 1 -- start start 2024-03-19T06:21:23.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55695520cf90 0x5569552b3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556955256d60 0x5569552b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556955257680 0x5569552b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c30200270 con 0x556955256d60 2024-03-19T06:21:23.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c301ff4a0 con 0x556955257680 2024-03-19T06:21:23.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300c7f90 con 0x55695520cf90 2024-03-19T06:21:23.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c27e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556955256d60 0x5569552b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c27e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556955256d60 0x5569552b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36460/0 (socket says 172.21.15.32:36460) 2024-03-19T06:21:23.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c27e00640 1 -- 172.21.15.32:0/723623593 learned_addr learned my addr 172.21.15.32:0/723623593 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:23.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c2ea00640 1 --2- 172.21.15.32:0/723623593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55695520cf90 0x5569552b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c2f400640 1 --2- 172.21.15.32:0/723623593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556955257680 0x5569552b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c27e00640 1 -- 172.21.15.32:0/723623593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55695520cf90 msgr2=0x5569552b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:23.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c27e00640 1 --2- 172.21.15.32:0/723623593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55695520cf90 0x5569552b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c27e00640 1 -- 172.21.15.32:0/723623593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556955257680 msgr2=0x5569552b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:23.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c27e00640 1 --2- 172.21.15.32:0/723623593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556955257680 0x5569552b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c27e00640 1 -- 172.21.15.32:0/723623593 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556955029fb0 con 0x556955256d60 2024-03-19T06:21:23.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c27e00640 1 --2- 172.21.15.32:0/723623593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556955256d60 0x5569552b38b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3c18018040 tx=0x7f3c1801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd18176ffd0120e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:23.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c1ea00640 1 -- 172.21.15.32:0/723623593 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1803b070 con 0x556955256d60 2024-03-19T06:21:23.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c1ea00640 1 -- 172.21.15.32:0/723623593 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c18028040 con 0x556955256d60 2024-03-19T06:21:23.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c1ea00640 1 -- 172.21.15.32:0/723623593 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18035de0 con 0x556955256d60 2024-03-19T06:21:23.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 -- 172.21.15.32:0/723623593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556955256d60 msgr2=0x5569552b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/723623593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556955256d60 0x5569552b38b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3c18018040 tx=0x7f3c1801a000 comp rx=0 tx=0).stop 2024-03-19T06:21:23.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 -- 172.21.15.32:0/723623593 shutdown_connections 2024-03-19T06:21:23.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/723623593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556955257680 0x5569552b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/723623593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556955256d60 0x5569552b38b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/723623593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55695520cf90 0x5569552b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 -- 172.21.15.32:0/723623593 >> 172.21.15.32:0/723623593 conn(0x556955204310 msgr2=0x556955212370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:23.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 -- 172.21.15.32:0/723623593 shutdown_connections 2024-03-19T06:21:23.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 -- 172.21.15.32:0/723623593 wait complete. 2024-03-19T06:21:23.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 -- start start 2024-03-19T06:21:23.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 Processor -- start 2024-03-19T06:21:23.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55695520cf90 0x5569552b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556955256d60 0x5569552b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556955257680 0x556955271f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569552164e0 con 0x55695520cf90 2024-03-19T06:21:23.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300c8590 con 0x556955257680 2024-03-19T06:21:23.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x556955117b80 con 0x556955256d60 2024-03-19T06:21:23.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.892+0000 7f3c38b9e000 10 client.0 _ll_register_callbacks cb 0x7f3c180097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:21:23.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c2ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55695520cf90 0x5569552b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c2ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55695520cf90 0x5569552b73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36470/0 (socket says 172.21.15.32:36470) 2024-03-19T06:21:23.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c2ea00640 1 -- 172.21.15.32:0/3346247847 learned_addr learned my addr 172.21.15.32:0/3346247847 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:23.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c27e00640 1 --2- 172.21.15.32:0/3346247847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556955256d60 0x5569552b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c2f400640 1 --2- 172.21.15.32:0/3346247847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556955257680 0x556955271f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c2ea00640 1 -- 172.21.15.32:0/3346247847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556955256d60 msgr2=0x5569552b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:23.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c2ea00640 1 --2- 172.21.15.32:0/3346247847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556955256d60 0x5569552b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c2ea00640 1 -- 172.21.15.32:0/3346247847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556955257680 msgr2=0x556955271f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:23.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c2ea00640 1 --2- 172.21.15.32:0/3346247847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556955257680 0x556955271f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c2ea00640 1 -- 172.21.15.32:0/3346247847 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5569550dd2e0 con 0x55695520cf90 2024-03-19T06:21:23.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c2f400640 1 --2- 172.21.15.32:0/3346247847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556955257680 0x556955271f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:23.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c2ea00640 1 --2- 172.21.15.32:0/3346247847 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55695520cf90 0x5569552b73b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3c20001900 tx=0x7f3c2006d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bac23b216417f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:23.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c13e00640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-03-19T06:21:23.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c13e00640 1 -- 172.21.15.32:0/3346247847 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20078070 con 0x55695520cf90 2024-03-19T06:21:23.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c13e00640 1 -- 172.21.15.32:0/3346247847 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c2005c270 con 0x55695520cf90 2024-03-19T06:21:23.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 1 -- 172.21.15.32:0/3346247847 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3c18028040 con 0x55695520cf90 2024-03-19T06:21:23.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c13e00640 1 -- 172.21.15.32:0/3346247847 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c20082020 con 0x55695520cf90 2024-03-19T06:21:23.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 10 client.4650 fetch_fsmap learned FSMap version 8 2024-03-19T06:21:23.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 1 -- 172.21.15.32:0/3346247847 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5569550030a0 con 0x55695520cf90 2024-03-19T06:21:23.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c13e00640 1 -- 172.21.15.32:0/3346247847 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c18028040 con 0x55695520cf90 2024-03-19T06:21:23.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c13e00640 1 -- 172.21.15.32:0/3346247847 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3c2007c070 con 0x55695520cf90 2024-03-19T06:21:23.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 10 client.4650 fetch_fsmap finished waiting for FSMap version 8 2024-03-19T06:21:23.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 10 client.4650 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-19T06:21:23.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 20 client.4650 populate_metadata read hostname 'smithi032' 2024-03-19T06:21:23.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/3346247847 >> [v2:172.21.15.32:6832/1902889035,v1:172.21.15.32:6835/1902889035] conn(0x5569552728f0 0x556955272cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:23.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 4 client.4650 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-19T06:21:23.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 1 -- 172.21.15.32:0/3346247847 --> [v2:172.21.15.32:6832/1902889035,v1:172.21.15.32:6835/1902889035] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5569550694e0 con 0x5569552728f0 2024-03-19T06:21:23.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c27e00640 1 --2- 172.21.15.32:0/3346247847 >> [v2:172.21.15.32:6832/1902889035,v1:172.21.15.32:6835/1902889035] conn(0x5569552728f0 0x556955272cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:23.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c27e00640 1 --2- 172.21.15.32:0/3346247847 >> [v2:172.21.15.32:6832/1902889035,v1:172.21.15.32:6835/1902889035] conn(0x5569552728f0 0x556955272cd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9d65e1baa22f808 server_cookie=27a67055a198e52f in_seq=0 out_seq=0 2024-03-19T06:21:23.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c13e00640 10 client.4650 ms_handle_connect on v2:172.21.15.32:6832/1902889035 2024-03-19T06:21:23.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c13e00640 1 -- 172.21.15.32:0/3346247847 <== mds.0 v2:172.21.15.32:6832/1902889035 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5569550694e0 con 0x5569552728f0 2024-03-19T06:21:23.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c13e00640 10 client.4650 handle_command_reply: tid=0 2024-03-19T06:21:23.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 1 client.4650 shutdown 2024-03-19T06:21:23.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 1 -- 172.21.15.32:0/3346247847 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55695520cf90 msgr2=0x5569552b73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/3346247847 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55695520cf90 0x5569552b73b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3c20001900 tx=0x7f3c2006d000 comp rx=0 tx=0).stop 2024-03-19T06:21:23.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 1 -- 172.21.15.32:0/3346247847 shutdown_connections 2024-03-19T06:21:23.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/3346247847 >> [v2:172.21.15.32:6832/1902889035,v1:172.21.15.32:6835/1902889035] conn(0x5569552728f0 0x556955272cd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/3346247847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556955257680 0x556955271f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c13e00640 0 client.4650 ms_handle_reset on v2:172.21.15.32:6832/1902889035 2024-03-19T06:21:23.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/3346247847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x556955256d60 0x5569552b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 1 --2- 172.21.15.32:0/3346247847 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55695520cf90 0x5569552b73b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 1 -- 172.21.15.32:0/3346247847 >> 172.21.15.32:0/3346247847 conn(0x556955204310 msgr2=0x556955212a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:23.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 1 -- 172.21.15.32:0/3346247847 shutdown_connections 2024-03-19T06:21:23.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 1 -- 172.21.15.32:0/3346247847 wait complete. 2024-03-19T06:21:23.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c38b9e000 20 client.4650 trim_cache size 0 max 16384 2024-03-19T06:21:23.894 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:21:23.894 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "5b96820f-940f-489f-8b00-afd5c905fd95", 2024-03-19T06:21:23.894 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2024-03-19T06:21:23.894 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4294, 2024-03-19T06:21:23.894 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2024-03-19T06:21:23.894 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2024-03-19T06:21:23.894 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2024-03-19T06:21:23.894 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 14.488877248, 2024-03-19T06:21:23.894 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 8, 2024-03-19T06:21:23.894 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 22, 2024-03-19T06:21:23.895 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 22, 2024-03-19T06:21:23.895 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 21.573134800999998 2024-03-19T06:21:23.895 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:21:23.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c35600640 1 -- 172.21.15.32:0/1453264087 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c0c067690 msgr2=0x7f3c0c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c35600640 1 --2- 172.21.15.32:0/1453264087 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c0c067690 0x7f3c0c069b50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3c30159dd0 tx=0x7f3c18008040 comp rx=0 tx=0).stop 2024-03-19T06:21:23.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c35600640 1 -- 172.21.15.32:0/1453264087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c14004d50 msgr2=0x7f3c3015c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:23.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c35600640 1 --2- 172.21.15.32:0/1453264087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c14004d50 0x7f3c3015c7f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3c200072c0 tx=0x7f3c20007780 comp rx=0 tx=0).stop 2024-03-19T06:21:23.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c35600640 1 -- 172.21.15.32:0/1453264087 shutdown_connections 2024-03-19T06:21:23.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c35600640 1 --2- 172.21.15.32:0/1453264087 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c0c067690 0x7f3c0c069b50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c35600640 1 --2- 172.21.15.32:0/1453264087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3c300c44f0 0x7f3c300c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c35600640 1 --2- 172.21.15.32:0/1453264087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3c30152800 0x7f3c30152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c35600640 1 --2- 172.21.15.32:0/1453264087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c14004d50 0x7f3c3015c7f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:23.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c35600640 1 -- 172.21.15.32:0/1453264087 >> 172.21.15.32:0/1453264087 conn(0x7f3c300b1280 msgr2=0x7f3c3006e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:23.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c35600640 1 -- 172.21.15.32:0/1453264087 shutdown_connections 2024-03-19T06:21:23.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:23.896+0000 7f3c35600640 1 -- 172.21.15.32:0/1453264087 wait complete. 2024-03-19T06:21:23.910 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-03-19T06:21:23.934 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-03-19T06:21:23.934 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-19T06:21:23.934 INFO:tasks.ceph_fuse:client.0 config is {} 2024-03-19T06:21:23.935 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-19T06:21:23.935 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-19T06:21:23.935 INFO:tasks.ceph_fuse:client.2 config is {} 2024-03-19T06:21:23.935 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-19T06:21:23.935 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-19T06:21:23.935 INFO:tasks.ceph_fuse:client.1 config is {} 2024-03-19T06:21:23.935 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-19T06:21:23.935 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-19T06:21:23.935 INFO:tasks.ceph_fuse:client.3 config is {} 2024-03-19T06:21:23.935 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-19T06:21:23.935 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-19T06:21:23.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:23.936 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-03-19T06:21:23.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:23.946 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link delete ceph-brx 2024-03-19T06:21:24.012 INFO:teuthology.orchestra.run.smithi171.stderr:Cannot find device "ceph-brx" 2024-03-19T06:21:24.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:21:24.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:24.015 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-03-19T06:21:24.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:24.024 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2024-03-19T06:21:24.089 INFO:teuthology.orchestra.run.smithi032.stderr:Cannot find device "ceph-brx" 2024-03-19T06:21:24.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:21:24.091 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-03-19T06:21:24.091 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-19T06:21:24.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a34e00640 1 Processor -- start 2024-03-19T06:21:24.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a34e00640 1 -- start start 2024-03-19T06:21:24.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a34e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a30159e00 0x7f5a300cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:24.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a34e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a300cd3b0 con 0x7f5a3006ad40 2024-03-19T06:21:24.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a34e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3006d6d0 con 0x7f5a3006b180 2024-03-19T06:21:24.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a34e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3015a1e0 con 0x7f5a30159e00 2024-03-19T06:21:24.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a26a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5a3006ad40 0x7f5a300b3e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38484/0 (socket says 172.21.15.32:38484) 2024-03-19T06:21:24.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a26a00640 1 -- 172.21.15.32:0/3123283483 learned_addr learned my addr 172.21.15.32:0/3123283483 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:24.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a2f400640 1 --2- 172.21.15.32:0/3123283483 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a30159e00 0x7f5a300cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:24.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a2ea00640 1 -- 172.21.15.32:0/3123283483 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812543301 0 0) 0x7f5a300cd3b0 con 0x7f5a3006ad40 2024-03-19T06:21:24.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a2ea00640 1 -- 172.21.15.32:0/3123283483 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a14003530 con 0x7f5a3006ad40 2024-03-19T06:21:24.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a2ea00640 1 -- 172.21.15.32:0/3123283483 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632040577 0 0) 0x7f5a3006d6d0 con 0x7f5a3006b180 2024-03-19T06:21:24.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a2ea00640 1 -- 172.21.15.32:0/3123283483 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a300cd3b0 con 0x7f5a3006b180 2024-03-19T06:21:24.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a2ea00640 1 -- 172.21.15.32:0/3123283483 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3508940555 0 0) 0x7f5a14003530 con 0x7f5a3006ad40 2024-03-19T06:21:24.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a2f400640 1 -- 172.21.15.32:0/3123283483 >> v1:172.21.15.171:6789/0 conn(0x7f5a3006b180 legacy=0x7f5a30071540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:24.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a2f400640 1 -- 172.21.15.32:0/3123283483 >> v1:172.21.15.32:6789/0 conn(0x7f5a3006ad40 legacy=0x7f5a300b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:24.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.284+0000 7f5a2f400640 1 -- 172.21.15.32:0/3123283483 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3006d9b0 con 0x7f5a30159e00 2024-03-19T06:21:24.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.288+0000 7f5a2f400640 1 --2- 172.21.15.32:0/3123283483 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a30159e00 0x7f5a300cce70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5a200097f0 tx=0x7f5a2001c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ba324a998ed0c26 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:24.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.288+0000 7f5a2ea00640 1 -- 172.21.15.32:0/3123283483 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a200b0070 con 0x7f5a30159e00 2024-03-19T06:21:24.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.288+0000 7f5a2ea00640 1 -- 172.21.15.32:0/3123283483 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a200ab400 con 0x7f5a30159e00 2024-03-19T06:21:24.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.288+0000 7f5a2ea00640 1 -- 172.21.15.32:0/3123283483 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18001680 con 0x7f5a30159e00 2024-03-19T06:21:24.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.288+0000 7f5a34e00640 1 -- 172.21.15.32:0/3123283483 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a30159e00 msgr2=0x7f5a300cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:24.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.288+0000 7f5a34e00640 1 --2- 172.21.15.32:0/3123283483 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a30159e00 0x7f5a300cce70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5a200097f0 tx=0x7f5a2001c370 comp rx=0 tx=0).stop 2024-03-19T06:21:24.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.288+0000 7f5a34e00640 1 -- 172.21.15.32:0/3123283483 shutdown_connections 2024-03-19T06:21:24.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.288+0000 7f5a34e00640 1 --2- 172.21.15.32:0/3123283483 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a30159e00 0x7f5a300cce70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:24.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.288+0000 7f5a34e00640 1 -- 172.21.15.32:0/3123283483 >> 172.21.15.32:0/3123283483 conn(0x7f5a300b1590 msgr2=0x7f5a300b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:24.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.288+0000 7f5a34e00640 1 -- 172.21.15.32:0/3123283483 shutdown_connections 2024-03-19T06:21:24.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.288+0000 7f5a34e00640 1 -- 172.21.15.32:0/3123283483 wait complete. 2024-03-19T06:21:24.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a34e00640 1 Processor -- start 2024-03-19T06:21:24.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a34e00640 1 -- start start 2024-03-19T06:21:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a34e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a3006ad40 0x7f5a300ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a34e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a3006b180 0x7f5a3014d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a34e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a30159e00 0x7f5a301f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a34e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300b3090 con 0x7f5a3006ad40 2024-03-19T06:21:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a34e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300b2f10 con 0x7f5a30159e00 2024-03-19T06:21:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a34e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a30071c50 con 0x7f5a3006b180 2024-03-19T06:21:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a2f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a3006ad40 0x7f5a300ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a2f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a3006ad40 0x7f5a300ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36478/0 (socket says 172.21.15.32:36478) 2024-03-19T06:21:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a2f400640 1 -- 172.21.15.32:0/2457925501 learned_addr learned my addr 172.21.15.32:0/2457925501 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a26a00640 1 --2- 172.21.15.32:0/2457925501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a3006b180 0x7f5a3014d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a2f400640 1 -- 172.21.15.32:0/2457925501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a3006b180 msgr2=0x7f5a3014d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a2f400640 1 --2- 172.21.15.32:0/2457925501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a3006b180 0x7f5a3014d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a2f400640 1 -- 172.21.15.32:0/2457925501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a30159e00 msgr2=0x7f5a301f6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:24.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a2fe00640 1 --2- 172.21.15.32:0/2457925501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a30159e00 0x7f5a301f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:24.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a2f400640 1 --2- 172.21.15.32:0/2457925501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a30159e00 0x7f5a301f6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:24.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a2f400640 1 -- 172.21.15.32:0/2457925501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a301f72b0 con 0x7f5a3006ad40 2024-03-19T06:21:24.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a26a00640 1 --2- 172.21.15.32:0/2457925501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a3006b180 0x7f5a3014d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:24.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a2fe00640 1 --2- 172.21.15.32:0/2457925501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a30159e00 0x7f5a301f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:24.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a2f400640 1 --2- 172.21.15.32:0/2457925501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a3006ad40 0x7f5a300ac8e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5a200097f0 tx=0x7f5a20019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:24.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a27e00640 1 -- 172.21.15.32:0/2457925501 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a200bb070 con 0x7f5a3006ad40 2024-03-19T06:21:24.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a27e00640 1 -- 172.21.15.32:0/2457925501 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a20004020 con 0x7f5a3006ad40 2024-03-19T06:21:24.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a34e00640 1 -- 172.21.15.32:0/2457925501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a300b1270 con 0x7f5a3006ad40 2024-03-19T06:21:24.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a27e00640 1 -- 172.21.15.32:0/2457925501 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a200b0040 con 0x7f5a3006ad40 2024-03-19T06:21:24.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a34e00640 1 -- 172.21.15.32:0/2457925501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3015b3a0 con 0x7f5a3006ad40 2024-03-19T06:21:24.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.292+0000 7f5a34e00640 1 -- 172.21.15.32:0/2457925501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a30075090 con 0x7f5a3006ad40 2024-03-19T06:21:24.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.296+0000 7f5a27e00640 1 -- 172.21.15.32:0/2457925501 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5a200b3040 con 0x7f5a3006ad40 2024-03-19T06:21:24.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.296+0000 7f5a27e00640 1 --2- 172.21.15.32:0/2457925501 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5a0c067660 0x7f5a0c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:24.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.296+0000 7f5a27e00640 1 -- 172.21.15.32:0/2457925501 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a2011f880 con 0x7f5a3006ad40 2024-03-19T06:21:24.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.296+0000 7f5a26a00640 1 --2- 172.21.15.32:0/2457925501 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5a0c067660 0x7f5a0c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:24.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.296+0000 7f5a26a00640 1 --2- 172.21.15.32:0/2457925501 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5a0c067660 0x7f5a0c069b20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5a18000fc0 tx=0x7f5a18009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:24.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.300+0000 7f5a27e00640 1 -- 172.21.15.32:0/2457925501 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f5a301f72b0 con 0x7f5a3006ad40 2024-03-19T06:21:24.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.500+0000 7f5a34e00640 1 -- 172.21.15.32:0/2457925501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5a300af500 con 0x7f5a3006ad40 2024-03-19T06:21:24.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.500+0000 7f5a27e00640 1 -- 172.21.15.32:0/2457925501 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5a20015ff0 con 0x7f5a3006ad40 2024-03-19T06:21:24.494 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-19T06:21:24.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.504+0000 7f5a34e00640 1 -- 172.21.15.32:0/2457925501 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5a0c067660 msgr2=0x7f5a0c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:24.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.504+0000 7f5a34e00640 1 --2- 172.21.15.32:0/2457925501 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5a0c067660 0x7f5a0c069b20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5a18000fc0 tx=0x7f5a18009040 comp rx=0 tx=0).stop 2024-03-19T06:21:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.504+0000 7f5a34e00640 1 -- 172.21.15.32:0/2457925501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a3006ad40 msgr2=0x7f5a300ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.504+0000 7f5a34e00640 1 --2- 172.21.15.32:0/2457925501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a3006ad40 0x7f5a300ac8e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5a200097f0 tx=0x7f5a20019110 comp rx=0 tx=0).stop 2024-03-19T06:21:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.504+0000 7f5a34e00640 1 -- 172.21.15.32:0/2457925501 shutdown_connections 2024-03-19T06:21:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.504+0000 7f5a34e00640 1 --2- 172.21.15.32:0/2457925501 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5a0c067660 0x7f5a0c069b20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.504+0000 7f5a34e00640 1 --2- 172.21.15.32:0/2457925501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a30159e00 0x7f5a301f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.504+0000 7f5a34e00640 1 --2- 172.21.15.32:0/2457925501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a3006b180 0x7f5a3014d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.504+0000 7f5a34e00640 1 --2- 172.21.15.32:0/2457925501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5a3006ad40 0x7f5a300ac8e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.504+0000 7f5a34e00640 1 -- 172.21.15.32:0/2457925501 >> 172.21.15.32:0/2457925501 conn(0x7f5a300b1590 msgr2=0x7f5a300cba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.504+0000 7f5a34e00640 1 -- 172.21.15.32:0/2457925501 shutdown_connections 2024-03-19T06:21:24.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:24.504+0000 7f5a34e00640 1 -- 172.21.15.32:0/2457925501 wait complete. 2024-03-19T06:21:24.514 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-19T06:21:24.514 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-19T06:21:24.515 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-03-19T06:21:24.515 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-19T06:21:24.515 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-19T06:21:24.515 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-19T06:21:24.515 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-19T06:21:24.515 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-19T06:21:24.515 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:21:24.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:24.515 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-03-19T06:21:24.525 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:21:24.525 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:21:24.525 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:21:24.525 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:24.525 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-03-19T06:21:24.525 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:24.525 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:21:24.525 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:24.525 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-03-19T06:21:24.525 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:21:24.526 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:24.526 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-03-19T06:21:24.526 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-19T06:21:24.526 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:24.526 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-03-19T06:21:24.526 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-03-19T06:21:24.526 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42413sec preferred_lft 42413sec 2024-03-19T06:21:24.526 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-03-19T06:21:24.526 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:24.526 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:21:24.526 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:24.526 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-03-19T06:21:24.526 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-19T06:21:24.526 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:f5:94:d0:dd brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:24.527 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-19T06:21:24.527 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:24.527 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-19T06:21:24.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:24.527 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-03-19T06:21:24.527 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-03-19T06:21:24.527 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add name ceph-brx type bridge 2024-03-19T06:21:24.527 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr flush dev ceph-brx 2024-03-19T06:21:24.527 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set ceph-brx up 2024-03-19T06:21:24.528 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-19T06:21:24.528 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-03-19T06:21:24.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:24.638 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-19T06:21:24.656 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-03-19T06:21:24.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:24.659 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-03-19T06:21:24.759 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-03-19T06:21:24.759 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-19T06:21:24.759 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-03-19T06:21:24.759 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-19T06:21:24.759 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-03-19T06:21:24.760 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-19T06:21:24.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:24.760 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-03-19T06:21:24.760 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-03-19T06:21:24.760 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-19T06:21:24.760 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-19T06:21:24.760 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-19T06:21:24.761 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-03-19T06:21:24.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:24.810 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-03-19T06:21:24.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:24.820 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list-id 2024-03-19T06:21:24.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:24.872 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-03-19T06:21:24.872 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-03-19T06:21:24.872 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:21:24.872 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-19T06:21:24.872 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-03-19T06:21:24.954 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-19T06:21:24.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:24.954 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-03-19T06:21:24.954 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-03-19T06:21:24.954 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-19T06:21:24.954 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-19T06:21:24.955 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-19T06:21:24.955 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-19T06:21:24.955 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-19T06:21:24.955 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-03-19T06:21:25.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:25.124 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-03-19T06:21:25.124 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-03-19T06:21:25.124 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-03-19T06:21:25.124 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set dev brx.0 master ceph-brx 2024-03-19T06:21:25.124 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-03-19T06:21:25.163 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-19T06:21:25.163 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:21:25.163 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-19T06:21:25.215 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:21:25.215 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:21:25.215 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:21:25.266 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:21:25.327 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:21:25.380 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:21:25.380 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:21:25.380 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:21:25.380 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:21:25.380 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:21:25.380 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:21:25.380 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:21:25.380 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:21:25.380 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:21:25.381 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:21:25.381 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:21:25.381 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:21:25.381 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:21:25.381 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:21:25.381 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:21:25.381 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:21:25.381 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:21:25.381 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:21:25.381 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:21:25.381 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:21:25.381 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:21:25.381 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:21:25.381 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:21:25.381 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:21:25.382 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:21:25.382 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:21:25.382 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:21:25.382 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:21:25.382 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:21:25.382 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:21:25.382 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:21:25.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:25.383 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:21:25.435 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-19T06:21:25.435 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-19T06:21:25.481 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:21:25.502 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:21:25.556 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:21:25.556 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:21:25.556 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:21:25.556 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:21:25.556 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:21:25.556 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:21:25.556 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:21:25.556 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:21:25.557 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:21:25.557 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:21:25.557 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:21:25.557 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:21:25.557 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:21:25.557 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:21:25.557 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:21:25.557 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:21:25.557 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:21:25.557 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:21:25.557 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:21:25.557 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:21:25.557 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:21:25.557 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:21:25.557 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:21:25.557 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:21:25.558 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:21:25.558 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:21:25.558 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:21:25.558 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:21:25.558 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:21:25.558 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:21:25.558 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:21:25.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:25.559 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:21:25.593 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:2024-03-19T06:21:25.600+0000 7ff26464e580 -1 init, newargv = 0x55b30f121340 newargc=15 2024-03-19T06:21:25.593 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[33247]: starting ceph client 2024-03-19T06:21:25.602 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[33247]: starting fuse 2024-03-19T06:21:26.703 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:21:26.727 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:21:26.781 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:21:26.781 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:21:26.781 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:21:26.781 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:21:26.781 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:21:26.781 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:21:26.781 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:21:26.781 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:21:26.781 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:21:26.781 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:21:26.781 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:21:26.781 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:21:26.782 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:21:26.782 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:21:26.782 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:21:26.782 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:21:26.782 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:21:26.782 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:21:26.782 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:21:26.782 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:21:26.782 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:21:26.782 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:21:26.782 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:21:26.782 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:21:26.782 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:21:26.782 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:21:26.782 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:21:26.783 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:21:26.783 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:21:26.783 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:21:26.783 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:21:26.783 INFO:teuthology.orchestra.run.smithi032.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-19T06:21:26.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:26.784 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:21:26.835 INFO:teuthology.orchestra.run.smithi032.stdout:43 2024-03-19T06:21:26.835 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-03-19T06:21:26.836 DEBUG:teuthology.orchestra.run.smithi032:> sudo stdin-killer -- python3 -c ' 2024-03-19T06:21:26.836 DEBUG:teuthology.orchestra.run.smithi032:> import glob 2024-03-19T06:21:26.836 DEBUG:teuthology.orchestra.run.smithi032:> import re 2024-03-19T06:21:26.836 DEBUG:teuthology.orchestra.run.smithi032:> import os 2024-03-19T06:21:26.836 DEBUG:teuthology.orchestra.run.smithi032:> import subprocess 2024-03-19T06:21:26.836 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:21:26.836 DEBUG:teuthology.orchestra.run.smithi032:> def _find_admin_socket(client_name): 2024-03-19T06:21:26.836 DEBUG:teuthology.orchestra.run.smithi032:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-19T06:21:26.836 DEBUG:teuthology.orchestra.run.smithi032:> files = glob.glob(asok_path) 2024-03-19T06:21:26.836 DEBUG:teuthology.orchestra.run.smithi032:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-19T06:21:26.836 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:21:26.836 DEBUG:teuthology.orchestra.run.smithi032:> # Given a non-glob path, it better be there 2024-03-19T06:21:26.836 DEBUG:teuthology.orchestra.run.smithi032:> if "*" not in asok_path: 2024-03-19T06:21:26.836 DEBUG:teuthology.orchestra.run.smithi032:> assert(len(files) == 1) 2024-03-19T06:21:26.836 DEBUG:teuthology.orchestra.run.smithi032:> return files[0] 2024-03-19T06:21:26.836 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:21:26.837 DEBUG:teuthology.orchestra.run.smithi032:> for f in files: 2024-03-19T06:21:26.837 DEBUG:teuthology.orchestra.run.smithi032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-19T06:21:26.837 DEBUG:teuthology.orchestra.run.smithi032:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-19T06:21:26.837 DEBUG:teuthology.orchestra.run.smithi032:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-19T06:21:26.837 DEBUG:teuthology.orchestra.run.smithi032:> contents = proc_f.read() 2024-03-19T06:21:26.837 DEBUG:teuthology.orchestra.run.smithi032:> if mountpoint in contents: 2024-03-19T06:21:26.837 DEBUG:teuthology.orchestra.run.smithi032:> return f 2024-03-19T06:21:26.837 DEBUG:teuthology.orchestra.run.smithi032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-19T06:21:26.837 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:21:26.837 DEBUG:teuthology.orchestra.run.smithi032:> print(_find_admin_socket("client.0")) 2024-03-19T06:21:26.837 DEBUG:teuthology.orchestra.run.smithi032:> ' 2024-03-19T06:21:26.970 INFO:teuthology.orchestra.run.smithi032.stdout:/var/run/ceph/ceph-client.0.33247.asok 2024-03-19T06:21:26.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-19T06:21:26.982 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33247.asok 2024-03-19T06:21:26.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:26.983 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33247.asok status 2024-03-19T06:21:27.161 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:21:27.161 INFO:teuthology.orchestra.run.smithi032.stdout: "metadata": { 2024-03-19T06:21:27.161 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_sha1": "b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", 2024-03-19T06:21:27.161 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_version": "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)", 2024-03-19T06:21:27.162 INFO:teuthology.orchestra.run.smithi032.stdout: "entity_id": "0", 2024-03-19T06:21:27.162 INFO:teuthology.orchestra.run.smithi032.stdout: "hostname": "smithi032", 2024-03-19T06:21:27.162 INFO:teuthology.orchestra.run.smithi032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-19T06:21:27.162 INFO:teuthology.orchestra.run.smithi032.stdout: "pid": "33247", 2024-03-19T06:21:27.162 INFO:teuthology.orchestra.run.smithi032.stdout: "root": "/" 2024-03-19T06:21:27.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:21:27.162 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_count": 0, 2024-03-19T06:21:27.162 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_pinned_count": 0, 2024-03-19T06:21:27.162 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4665, 2024-03-19T06:21:27.162 INFO:teuthology.orchestra.run.smithi032.stdout: "inst": { 2024-03-19T06:21:27.162 INFO:teuthology.orchestra.run.smithi032.stdout: "name": { 2024-03-19T06:21:27.162 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "client", 2024-03-19T06:21:27.162 INFO:teuthology.orchestra.run.smithi032.stdout: "num": 4665 2024-03-19T06:21:27.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:21:27.163 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-03-19T06:21:27.163 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-03-19T06:21:27.163 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:21:27.163 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1819909352 2024-03-19T06:21:27.163 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:21:27.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:21:27.163 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-03-19T06:21:27.163 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-03-19T06:21:27.163 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:21:27.163 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1819909352 2024-03-19T06:21:27.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:21:27.163 INFO:teuthology.orchestra.run.smithi032.stdout: "inst_str": "client.4665 192.168.0.1:0/1819909352", 2024-03-19T06:21:27.163 INFO:teuthology.orchestra.run.smithi032.stdout: "addr_str": "192.168.0.1:0/1819909352", 2024-03-19T06:21:27.163 INFO:teuthology.orchestra.run.smithi032.stdout: "inode_count": 1, 2024-03-19T06:21:27.163 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_epoch": 8, 2024-03-19T06:21:27.163 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch": 22, 2024-03-19T06:21:27.164 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch_barrier": 0, 2024-03-19T06:21:27.164 INFO:teuthology.orchestra.run.smithi032.stdout: "blocklisted": false, 2024-03-19T06:21:27.164 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs" 2024-03-19T06:21:27.164 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:21:27.176 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-19T06:21:27.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.324+0000 7f839aa00640 1 Processor -- start 2024-03-19T06:21:27.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.324+0000 7f839aa00640 1 -- start start 2024-03-19T06:21:27.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f839aa00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8394161270 0x7f83940ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:27.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f839aa00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83940cfa70 0x7f83940cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:27.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f839aa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f83940cb2d0 0x7f83940cb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:27.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f839aa00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839406ad40 con 0x7f83940cb2d0 2024-03-19T06:21:27.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f839aa00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839406b020 con 0x7f8394161270 2024-03-19T06:21:27.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f839aa00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839406b300 con 0x7f83940cfa70 2024-03-19T06:21:27.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f8398a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f83940cb2d0 0x7f83940cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:27.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f8398a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f83940cb2d0 0x7f83940cb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36492/0 (socket says 172.21.15.32:36492) 2024-03-19T06:21:27.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f8398a00640 1 -- 172.21.15.32:0/3714344546 learned_addr learned my addr 172.21.15.32:0/3714344546 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:27.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f8393e00640 1 --2- 172.21.15.32:0/3714344546 >> v2:172.21.15.171:3300/0 conn(0x7f8394161270 0x7f83940ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:27.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f838b400640 1 --2- 172.21.15.32:0/3714344546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83940cfa70 0x7f83940cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:27.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f8398a00640 1 -- 172.21.15.32:0/3714344546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83940cfa70 msgr2=0x7f83940cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:27.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f8398a00640 1 --2- 172.21.15.32:0/3714344546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83940cfa70 0x7f83940cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:27.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f8398a00640 1 -- 172.21.15.32:0/3714344546 >> v2:172.21.15.171:3300/0 conn(0x7f8394161270 msgr2=0x7f83940ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:27.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f8398a00640 1 --2- 172.21.15.32:0/3714344546 >> v2:172.21.15.171:3300/0 conn(0x7f8394161270 0x7f83940ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:27.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f8398a00640 1 -- 172.21.15.32:0/3714344546 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839406b5e0 con 0x7f83940cb2d0 2024-03-19T06:21:27.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f8393e00640 1 --2- 172.21.15.32:0/3714344546 >> v2:172.21.15.171:3300/0 conn(0x7f8394161270 0x7f83940ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:27.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.328+0000 7f8398a00640 1 --2- 172.21.15.32:0/3714344546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83940cb2d0 0x7f83940cb760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8394068730 tx=0x7f838c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6a2e39565a2f8a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:27.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f8393400640 1 -- 172.21.15.32:0/3714344546 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c0a5780 con 0x7f83940cb2d0 2024-03-19T06:21:27.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f8393400640 1 -- 172.21.15.32:0/3714344546 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c0a5920 con 0x7f83940cb2d0 2024-03-19T06:21:27.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f8393400640 1 -- 172.21.15.32:0/3714344546 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c0a5cf0 con 0x7f83940cb2d0 2024-03-19T06:21:27.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 -- 172.21.15.32:0/3714344546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83940cb2d0 msgr2=0x7f83940cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:27.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 --2- 172.21.15.32:0/3714344546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83940cb2d0 0x7f83940cb760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8394068730 tx=0x7f838c01c9f0 comp rx=0 tx=0).stop 2024-03-19T06:21:27.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 -- 172.21.15.32:0/3714344546 shutdown_connections 2024-03-19T06:21:27.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 --2- 172.21.15.32:0/3714344546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83940cb2d0 0x7f83940cb760 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:27.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 --2- 172.21.15.32:0/3714344546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83940cfa70 0x7f83940cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:27.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 --2- 172.21.15.32:0/3714344546 >> v2:172.21.15.171:3300/0 conn(0x7f8394161270 0x7f83940ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:27.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 -- 172.21.15.32:0/3714344546 >> 172.21.15.32:0/3714344546 conn(0x7f83940b2250 msgr2=0x7f83940b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:27.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 -- 172.21.15.32:0/3714344546 shutdown_connections 2024-03-19T06:21:27.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 -- 172.21.15.32:0/3714344546 wait complete. 2024-03-19T06:21:27.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 Processor -- start 2024-03-19T06:21:27.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 -- start start 2024-03-19T06:21:27.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83940cb2d0 0x7f83940c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:27.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83940cfa70 0x7f8394153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:27.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8394161270 0x7f83940b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:27.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83940ccad0 con 0x7f8394161270 2024-03-19T06:21:27.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83940cc950 con 0x7f83940cb2d0 2024-03-19T06:21:27.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f839aa00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83940ccc50 con 0x7f83940cfa70 2024-03-19T06:21:27.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f8398a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8394161270 0x7f83940b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:27.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f8398a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8394161270 0x7f83940b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36504/0 (socket says 172.21.15.32:36504) 2024-03-19T06:21:27.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f8398a00640 1 -- 172.21.15.32:0/4058878289 learned_addr learned my addr 172.21.15.32:0/4058878289 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:27.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f838b400640 1 --2- 172.21.15.32:0/4058878289 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83940cfa70 0x7f8394153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:27.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.332+0000 7f8393e00640 1 --2- 172.21.15.32:0/4058878289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83940cb2d0 0x7f83940c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:27.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.336+0000 7f8398a00640 1 -- 172.21.15.32:0/4058878289 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83940cfa70 msgr2=0x7f8394153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:27.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.336+0000 7f8398a00640 1 --2- 172.21.15.32:0/4058878289 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83940cfa70 0x7f8394153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:27.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.336+0000 7f8398a00640 1 -- 172.21.15.32:0/4058878289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83940cb2d0 msgr2=0x7f83940c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:27.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.336+0000 7f8398a00640 1 --2- 172.21.15.32:0/4058878289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83940cb2d0 0x7f83940c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:27.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.336+0000 7f8398a00640 1 -- 172.21.15.32:0/4058878289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839415d2a0 con 0x7f8394161270 2024-03-19T06:21:27.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.336+0000 7f8398a00640 1 --2- 172.21.15.32:0/4058878289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8394161270 0x7f83940b3340 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f838c01b0a0 tx=0x7f838c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:27.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.336+0000 7f8390c00640 1 -- 172.21.15.32:0/4058878289 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c0b8470 con 0x7f8394161270 2024-03-19T06:21:27.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.336+0000 7f8390c00640 1 -- 172.21.15.32:0/4058878289 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c0be070 con 0x7f8394161270 2024-03-19T06:21:27.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.336+0000 7f8390c00640 1 -- 172.21.15.32:0/4058878289 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c0b8830 con 0x7f8394161270 2024-03-19T06:21:27.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.336+0000 7f839aa00640 1 -- 172.21.15.32:0/4058878289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839415d580 con 0x7f8394161270 2024-03-19T06:21:27.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.336+0000 7f839aa00640 1 -- 172.21.15.32:0/4058878289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839415db40 con 0x7f8394161270 2024-03-19T06:21:27.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.336+0000 7f839aa00640 1 -- 172.21.15.32:0/4058878289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83940749e0 con 0x7f8394161270 2024-03-19T06:21:27.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.336+0000 7f8390c00640 1 -- 172.21.15.32:0/4058878289 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f838c0b89d0 con 0x7f8394161270 2024-03-19T06:21:27.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.336+0000 7f8390c00640 1 --2- 172.21.15.32:0/4058878289 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8370067690 0x7f8370069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:27.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.336+0000 7f8390c00640 1 -- 172.21.15.32:0/4058878289 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f838c120250 con 0x7f8394161270 2024-03-19T06:21:27.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.336+0000 7f8393e00640 1 --2- 172.21.15.32:0/4058878289 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8370067690 0x7f8370069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:27.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.340+0000 7f8393e00640 1 --2- 172.21.15.32:0/4058878289 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8370067690 0x7f8370069b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f839415ee50 tx=0x7f8384008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:27.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.340+0000 7f8390c00640 1 -- 172.21.15.32:0/4058878289 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f838c0c7020 con 0x7f8394161270 2024-03-19T06:21:27.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.544+0000 7f839aa00640 1 -- 172.21.15.32:0/4058878289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f83940b1700 con 0x7f8394161270 2024-03-19T06:21:27.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.544+0000 7f8390c00640 1 -- 172.21.15.32:0/4058878289 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f838c0165e0 con 0x7f8394161270 2024-03-19T06:21:27.539 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-19T06:21:27.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.548+0000 7f839aa00640 1 -- 172.21.15.32:0/4058878289 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8370067690 msgr2=0x7f8370069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:27.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.548+0000 7f839aa00640 1 --2- 172.21.15.32:0/4058878289 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8370067690 0x7f8370069b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f839415ee50 tx=0x7f8384008040 comp rx=0 tx=0).stop 2024-03-19T06:21:27.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.548+0000 7f839aa00640 1 -- 172.21.15.32:0/4058878289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8394161270 msgr2=0x7f83940b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:27.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.548+0000 7f839aa00640 1 --2- 172.21.15.32:0/4058878289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8394161270 0x7f83940b3340 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f838c01b0a0 tx=0x7f838c019790 comp rx=0 tx=0).stop 2024-03-19T06:21:27.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.548+0000 7f839aa00640 1 -- 172.21.15.32:0/4058878289 shutdown_connections 2024-03-19T06:21:27.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.548+0000 7f839aa00640 1 --2- 172.21.15.32:0/4058878289 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8370067690 0x7f8370069b50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:27.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.548+0000 7f839aa00640 1 --2- 172.21.15.32:0/4058878289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8394161270 0x7f83940b3340 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:27.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.548+0000 7f839aa00640 1 --2- 172.21.15.32:0/4058878289 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83940cfa70 0x7f8394153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:27.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.548+0000 7f839aa00640 1 --2- 172.21.15.32:0/4058878289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83940cb2d0 0x7f83940c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:27.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.548+0000 7f839aa00640 1 -- 172.21.15.32:0/4058878289 >> 172.21.15.32:0/4058878289 conn(0x7f83940b2250 msgr2=0x7f839406fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:27.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.548+0000 7f839aa00640 1 -- 172.21.15.32:0/4058878289 shutdown_connections 2024-03-19T06:21:27.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:27.548+0000 7f839aa00640 1 -- 172.21.15.32:0/4058878289 wait complete. 2024-03-19T06:21:27.559 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-19T06:21:27.559 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-19T06:21:27.559 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-03-19T06:21:27.559 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-19T06:21:27.559 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-19T06:21:27.559 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-19T06:21:27.560 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-19T06:21:27.560 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-19T06:21:27.560 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-19T06:21:27.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:27.560 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-03-19T06:21:27.569 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:21:27.569 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:21:27.569 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:21:27.570 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:27.570 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-03-19T06:21:27.570 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:27.570 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:21:27.570 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:27.570 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-03-19T06:21:27.570 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:21:27.570 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:27.570 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-03-19T06:21:27.570 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-19T06:21:27.570 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:27.570 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-03-19T06:21:27.570 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-03-19T06:21:27.570 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42410sec preferred_lft 42410sec 2024-03-19T06:21:27.570 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-03-19T06:21:27.571 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:27.571 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:21:27.571 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:27.571 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-03-19T06:21:27.571 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-19T06:21:27.571 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:f5:94:d0:dd brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:27.571 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-19T06:21:27.571 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:27.571 INFO:teuthology.orchestra.run.smithi032.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-19T06:21:27.571 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:27.571 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-19T06:21:27.571 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:27.571 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-03-19T06:21:27.571 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:27.571 INFO:teuthology.orchestra.run.smithi032.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-19T06:21:27.572 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:21:27.572 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-03-19T06:21:27.572 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:27.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:27.572 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-19T06:21:27.628 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-03-19T06:21:27.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:27.630 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-03-19T06:21:27.684 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-03-19T06:21:27.684 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-19T06:21:27.684 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-03-19T06:21:27.684 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-19T06:21:27.684 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-03-19T06:21:27.684 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-19T06:21:27.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:27.684 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-03-19T06:21:27.684 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-03-19T06:21:27.684 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-19T06:21:27.685 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-19T06:21:27.685 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-19T06:21:27.685 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-03-19T06:21:27.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:27.776 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-03-19T06:21:27.785 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-19T06:21:27.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:27.785 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list-id 2024-03-19T06:21:27.835 INFO:teuthology.orchestra.run.smithi032.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-19T06:21:27.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:27.835 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-03-19T06:21:27.835 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-03-19T06:21:27.835 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:21:27.835 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-19T06:21:27.835 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-03-19T06:21:27.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:27.917 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-19T06:21:27.982 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:21:27.982 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:21:27.982 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:21:27.983 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:27.983 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-03-19T06:21:27.983 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:27.983 INFO:teuthology.orchestra.run.smithi032.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-19T06:21:27.983 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:74:d5:10:85:47 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-19T06:21:27.983 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-19T06:21:27.983 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:27.983 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::74:d5ff:fe10:8547/64 scope link 2024-03-19T06:21:27.983 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:27.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:27.985 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-19T06:21:28.050 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:21:28.050 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:21:28.050 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:21:28.050 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:28.051 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-03-19T06:21:28.051 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:28.051 INFO:teuthology.orchestra.run.smithi032.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-19T06:21:28.051 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:74:d5:10:85:47 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-19T06:21:28.051 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-19T06:21:28.051 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:28.051 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::74:d5ff:fe10:8547/64 scope link 2024-03-19T06:21:28.051 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:28.052 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-19T06:21:28.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:28.053 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-03-19T06:21:28.053 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-03-19T06:21:28.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-19T06:21:28.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-19T06:21:28.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-19T06:21:28.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-19T06:21:28.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-19T06:21:28.053 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-03-19T06:21:28.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:28.193 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-03-19T06:21:28.193 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-03-19T06:21:28.193 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.1 up 2024-03-19T06:21:28.194 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set dev brx.1 master ceph-brx 2024-03-19T06:21:28.194 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-03-19T06:21:28.232 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-03-19T06:21:28.232 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:21:28.232 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-19T06:21:28.287 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-19T06:21:28.287 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:21:28.287 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-19T06:21:28.338 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:21:28.399 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:21:28.452 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:21:28.452 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:21:28.452 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:21:28.452 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:21:28.452 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:21:28.452 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:21:28.452 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:21:28.452 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:21:28.452 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:21:28.452 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:21:28.453 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:21:28.453 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:21:28.453 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:21:28.453 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:21:28.453 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:21:28.453 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:21:28.453 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:21:28.453 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:21:28.453 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:21:28.453 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:21:28.453 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:21:28.453 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:21:28.453 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:21:28.453 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:21:28.453 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:21:28.454 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:21:28.454 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:21:28.454 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:21:28.454 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:21:28.454 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:21:28.454 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:21:28.454 INFO:teuthology.orchestra.run.smithi032.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-19T06:21:28.454 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:21:28.454 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:21:28.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:28.455 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:21:28.506 INFO:teuthology.orchestra.run.smithi032.stdout:43 2024-03-19T06:21:28.507 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-03-19T06:21:28.507 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-03-19T06:21:28.553 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:21:28.574 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:21:28.624 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:21:28.624 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:21:28.624 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:21:28.624 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:21:28.624 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:21:28.624 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:21:28.624 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:21:28.624 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:21:28.624 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:21:28.625 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:21:28.625 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:21:28.625 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:21:28.625 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:21:28.625 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:21:28.625 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:21:28.625 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:21:28.625 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:21:28.625 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:21:28.625 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:21:28.625 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:21:28.625 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:21:28.625 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:21:28.625 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:21:28.625 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:21:28.626 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:21:28.626 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:21:28.626 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:21:28.626 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:21:28.626 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:21:28.626 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:21:28.626 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:21:28.626 INFO:teuthology.orchestra.run.smithi032.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-19T06:21:28.626 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:21:28.626 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:21:28.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:28.627 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:21:28.650 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi032.stderr:2024-03-19T06:21:28.656+0000 7f7e12279580 -1 init, newargv = 0x56387c1a6b00 newargc=15 2024-03-19T06:21:28.650 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi032.stderr:ceph-fuse[33385]: starting ceph client 2024-03-19T06:21:28.657 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi032.stderr:ceph-fuse[33385]: starting fuse 2024-03-19T06:21:28.659 INFO:teuthology.orchestra.run.smithi032.stdout:43 2024-03-19T06:21:28.659 INFO:teuthology.orchestra.run.smithi032.stdout:44 2024-03-19T06:21:28.660 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-03-19T06:21:28.660 DEBUG:teuthology.orchestra.run.smithi032:> sudo stdin-killer -- python3 -c ' 2024-03-19T06:21:28.660 DEBUG:teuthology.orchestra.run.smithi032:> import glob 2024-03-19T06:21:28.660 DEBUG:teuthology.orchestra.run.smithi032:> import re 2024-03-19T06:21:28.660 DEBUG:teuthology.orchestra.run.smithi032:> import os 2024-03-19T06:21:28.660 DEBUG:teuthology.orchestra.run.smithi032:> import subprocess 2024-03-19T06:21:28.660 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:21:28.660 DEBUG:teuthology.orchestra.run.smithi032:> def _find_admin_socket(client_name): 2024-03-19T06:21:28.660 DEBUG:teuthology.orchestra.run.smithi032:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-03-19T06:21:28.660 DEBUG:teuthology.orchestra.run.smithi032:> files = glob.glob(asok_path) 2024-03-19T06:21:28.660 DEBUG:teuthology.orchestra.run.smithi032:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-03-19T06:21:28.660 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:21:28.660 DEBUG:teuthology.orchestra.run.smithi032:> # Given a non-glob path, it better be there 2024-03-19T06:21:28.660 DEBUG:teuthology.orchestra.run.smithi032:> if "*" not in asok_path: 2024-03-19T06:21:28.660 DEBUG:teuthology.orchestra.run.smithi032:> assert(len(files) == 1) 2024-03-19T06:21:28.661 DEBUG:teuthology.orchestra.run.smithi032:> return files[0] 2024-03-19T06:21:28.661 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:21:28.661 DEBUG:teuthology.orchestra.run.smithi032:> for f in files: 2024-03-19T06:21:28.661 DEBUG:teuthology.orchestra.run.smithi032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-19T06:21:28.661 DEBUG:teuthology.orchestra.run.smithi032:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-19T06:21:28.661 DEBUG:teuthology.orchestra.run.smithi032:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-19T06:21:28.661 DEBUG:teuthology.orchestra.run.smithi032:> contents = proc_f.read() 2024-03-19T06:21:28.661 DEBUG:teuthology.orchestra.run.smithi032:> if mountpoint in contents: 2024-03-19T06:21:28.661 DEBUG:teuthology.orchestra.run.smithi032:> return f 2024-03-19T06:21:28.661 DEBUG:teuthology.orchestra.run.smithi032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-19T06:21:28.661 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:21:28.661 DEBUG:teuthology.orchestra.run.smithi032:> print(_find_admin_socket("client.2")) 2024-03-19T06:21:28.661 DEBUG:teuthology.orchestra.run.smithi032:> ' 2024-03-19T06:21:28.784 INFO:teuthology.orchestra.run.smithi032.stdout:/var/run/ceph/ceph-client.2.33385.asok 2024-03-19T06:21:28.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-19T06:21:28.796 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.33385.asok 2024-03-19T06:21:28.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:28.796 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.33385.asok status 2024-03-19T06:21:28.969 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:21:28.970 INFO:teuthology.orchestra.run.smithi032.stdout: "metadata": { 2024-03-19T06:21:28.970 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_sha1": "b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", 2024-03-19T06:21:28.970 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_version": "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)", 2024-03-19T06:21:28.970 INFO:teuthology.orchestra.run.smithi032.stdout: "entity_id": "2", 2024-03-19T06:21:28.970 INFO:teuthology.orchestra.run.smithi032.stdout: "hostname": "smithi032", 2024-03-19T06:21:28.970 INFO:teuthology.orchestra.run.smithi032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-03-19T06:21:28.970 INFO:teuthology.orchestra.run.smithi032.stdout: "pid": "33385", 2024-03-19T06:21:28.970 INFO:teuthology.orchestra.run.smithi032.stdout: "root": "/" 2024-03-19T06:21:28.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:21:28.970 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_count": 0, 2024-03-19T06:21:28.970 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_pinned_count": 0, 2024-03-19T06:21:28.970 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4677, 2024-03-19T06:21:28.971 INFO:teuthology.orchestra.run.smithi032.stdout: "inst": { 2024-03-19T06:21:28.971 INFO:teuthology.orchestra.run.smithi032.stdout: "name": { 2024-03-19T06:21:28.971 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "client", 2024-03-19T06:21:28.971 INFO:teuthology.orchestra.run.smithi032.stdout: "num": 4677 2024-03-19T06:21:28.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:21:28.971 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-03-19T06:21:28.971 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-03-19T06:21:28.971 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.2:0", 2024-03-19T06:21:28.971 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3405247102 2024-03-19T06:21:28.971 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:21:28.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:21:28.971 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-03-19T06:21:28.971 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-03-19T06:21:28.971 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.2:0", 2024-03-19T06:21:28.972 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3405247102 2024-03-19T06:21:28.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:21:28.972 INFO:teuthology.orchestra.run.smithi032.stdout: "inst_str": "client.4677 192.168.0.2:0/3405247102", 2024-03-19T06:21:28.972 INFO:teuthology.orchestra.run.smithi032.stdout: "addr_str": "192.168.0.2:0/3405247102", 2024-03-19T06:21:28.972 INFO:teuthology.orchestra.run.smithi032.stdout: "inode_count": 1, 2024-03-19T06:21:28.972 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_epoch": 8, 2024-03-19T06:21:28.972 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch": 22, 2024-03-19T06:21:28.972 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch_barrier": 0, 2024-03-19T06:21:28.972 INFO:teuthology.orchestra.run.smithi032.stdout: "blocklisted": false, 2024-03-19T06:21:28.972 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs" 2024-03-19T06:21:28.972 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:21:28.985 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-19T06:21:29.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.132+0000 7fc845400640 1 Processor -- start 2024-03-19T06:21:29.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.132+0000 7fc845400640 1 -- start start 2024-03-19T06:21:29.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.132+0000 7fc845400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8400aecf0 0x7fc8400ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:29.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.132+0000 7fc845400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc84015c010 0x7fc84015f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:29.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.132+0000 7fc845400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc84006d6c0 0x7fc84006db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:29.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.132+0000 7fc845400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84006e070 con 0x7fc84015c010 2024-03-19T06:21:29.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.132+0000 7fc845400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8401603e0 con 0x7fc84006d6c0 2024-03-19T06:21:29.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.132+0000 7fc845400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84015fe20 con 0x7fc8400aecf0 2024-03-19T06:21:29.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.132+0000 7fc837e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc84015c010 0x7fc84015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:29.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.132+0000 7fc837e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc84015c010 0x7fc84015f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36512/0 (socket says 172.21.15.32:36512) 2024-03-19T06:21:29.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.132+0000 7fc837e00640 1 -- 172.21.15.32:0/3595759196 learned_addr learned my addr 172.21.15.32:0/3595759196 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:29.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.136+0000 7fc83f200640 1 --2- 172.21.15.32:0/3595759196 >> v2:172.21.15.171:3300/0 conn(0x7fc84006d6c0 0x7fc84006db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:29.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.136+0000 7fc837e00640 1 -- 172.21.15.32:0/3595759196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8400aecf0 msgr2=0x7fc8400ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:29.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.136+0000 7fc837e00640 1 --2- 172.21.15.32:0/3595759196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8400aecf0 0x7fc8400ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:29.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.136+0000 7fc837e00640 1 -- 172.21.15.32:0/3595759196 >> v2:172.21.15.171:3300/0 conn(0x7fc84006d6c0 msgr2=0x7fc84006db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:29.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.136+0000 7fc837e00640 1 --2- 172.21.15.32:0/3595759196 >> v2:172.21.15.171:3300/0 conn(0x7fc84006d6c0 0x7fc84006db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:29.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.136+0000 7fc837e00640 1 -- 172.21.15.32:0/3595759196 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc840160100 con 0x7fc84015c010 2024-03-19T06:21:29.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.136+0000 7fc83f200640 1 --2- 172.21.15.32:0/3595759196 >> v2:172.21.15.171:3300/0 conn(0x7fc84006d6c0 0x7fc84006db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:29.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.136+0000 7fc837e00640 1 --2- 172.21.15.32:0/3595759196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc84015c010 0x7fc84015f520 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc8400c9e60 tx=0x7fc82801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d0215d433e92bc server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:29.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.136+0000 7fc83de00640 1 -- 172.21.15.32:0/3595759196 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280b2070 con 0x7fc84015c010 2024-03-19T06:21:29.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.136+0000 7fc83de00640 1 -- 172.21.15.32:0/3595759196 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8280a9070 con 0x7fc84015c010 2024-03-19T06:21:29.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.136+0000 7fc83de00640 1 -- 172.21.15.32:0/3595759196 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280ad880 con 0x7fc84015c010 2024-03-19T06:21:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.136+0000 7fc845400640 1 -- 172.21.15.32:0/3595759196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc84015c010 msgr2=0x7fc84015f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.136+0000 7fc845400640 1 --2- 172.21.15.32:0/3595759196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc84015c010 0x7fc84015f520 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc8400c9e60 tx=0x7fc82801c490 comp rx=0 tx=0).stop 2024-03-19T06:21:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc845400640 1 -- 172.21.15.32:0/3595759196 shutdown_connections 2024-03-19T06:21:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc845400640 1 --2- 172.21.15.32:0/3595759196 >> v2:172.21.15.171:3300/0 conn(0x7fc84006d6c0 0x7fc84006db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc845400640 1 --2- 172.21.15.32:0/3595759196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc84015c010 0x7fc84015f520 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc845400640 1 --2- 172.21.15.32:0/3595759196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8400aecf0 0x7fc8400ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc845400640 1 -- 172.21.15.32:0/3595759196 >> 172.21.15.32:0/3595759196 conn(0x7fc8400b1280 msgr2=0x7fc8400b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc845400640 1 -- 172.21.15.32:0/3595759196 shutdown_connections 2024-03-19T06:21:29.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc845400640 1 -- 172.21.15.32:0/3595759196 wait complete. 2024-03-19T06:21:29.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc845400640 1 Processor -- start 2024-03-19T06:21:29.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc845400640 1 -- start start 2024-03-19T06:21:29.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc845400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc84006d6c0 0x7fc840144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:29.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc845400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8400aecf0 0x7fc840157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:29.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc845400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc84015c010 0x7fc8400b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:29.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc845400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84015fbe0 con 0x7fc84015c010 2024-03-19T06:21:29.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc845400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84015fa60 con 0x7fc84006d6c0 2024-03-19T06:21:29.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc845400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400cbc60 con 0x7fc8400aecf0 2024-03-19T06:21:29.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc83f200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc84015c010 0x7fc8400b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:29.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc83e800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc84006d6c0 0x7fc840144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:29.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc83f200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc84015c010 0x7fc8400b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36520/0 (socket says 172.21.15.32:36520) 2024-03-19T06:21:29.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc83f200640 1 -- 172.21.15.32:0/3355481150 learned_addr learned my addr 172.21.15.32:0/3355481150 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:29.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc837e00640 1 --2- 172.21.15.32:0/3355481150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8400aecf0 0x7fc840157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:29.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc83f200640 1 -- 172.21.15.32:0/3355481150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8400aecf0 msgr2=0x7fc840157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:29.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc83f200640 1 --2- 172.21.15.32:0/3355481150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8400aecf0 0x7fc840157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:29.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc83f200640 1 -- 172.21.15.32:0/3355481150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc84006d6c0 msgr2=0x7fc840144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:29.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc83f200640 1 --2- 172.21.15.32:0/3355481150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc84006d6c0 0x7fc840144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:29.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc83f200640 1 -- 172.21.15.32:0/3355481150 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8401565a0 con 0x7fc84015c010 2024-03-19T06:21:29.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.140+0000 7fc83f200640 1 --2- 172.21.15.32:0/3355481150 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc84015c010 0x7fc8400b2950 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc83800cef0 tx=0x7fc83800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:29.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.144+0000 7fc836a00640 1 -- 172.21.15.32:0/3355481150 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83801a070 con 0x7fc84015c010 2024-03-19T06:21:29.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.144+0000 7fc836a00640 1 -- 172.21.15.32:0/3355481150 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83800d860 con 0x7fc84015c010 2024-03-19T06:21:29.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.144+0000 7fc836a00640 1 -- 172.21.15.32:0/3355481150 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800dc50 con 0x7fc84015c010 2024-03-19T06:21:29.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.144+0000 7fc845400640 1 -- 172.21.15.32:0/3355481150 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc840156880 con 0x7fc84015c010 2024-03-19T06:21:29.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.144+0000 7fc845400640 1 -- 172.21.15.32:0/3355481150 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc840156e40 con 0x7fc84015c010 2024-03-19T06:21:29.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.144+0000 7fc845400640 1 -- 172.21.15.32:0/3355481150 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8400749e0 con 0x7fc84015c010 2024-03-19T06:21:29.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.144+0000 7fc836a00640 1 -- 172.21.15.32:0/3355481150 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc83801d070 con 0x7fc84015c010 2024-03-19T06:21:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.144+0000 7fc836a00640 1 --2- 172.21.15.32:0/3355481150 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc81c067660 0x7fc81c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.144+0000 7fc836a00640 1 -- 172.21.15.32:0/3355481150 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc838086150 con 0x7fc84015c010 2024-03-19T06:21:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.144+0000 7fc83e800640 1 --2- 172.21.15.32:0/3355481150 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc81c067660 0x7fc81c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.148+0000 7fc83e800640 1 --2- 172.21.15.32:0/3355481150 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc81c067660 0x7fc81c069b20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc830009990 tx=0x7fc830009110 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:29.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.148+0000 7fc836a00640 1 -- 172.21.15.32:0/3355481150 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fc8380567a0 con 0x7fc84015c010 2024-03-19T06:21:29.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.348+0000 7fc845400640 1 -- 172.21.15.32:0/3355481150 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc8400b47f0 con 0x7fc84015c010 2024-03-19T06:21:29.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.348+0000 7fc836a00640 1 -- 172.21.15.32:0/3355481150 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc83805a840 con 0x7fc84015c010 2024-03-19T06:21:29.341 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-19T06:21:29.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.352+0000 7fc845400640 1 -- 172.21.15.32:0/3355481150 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc81c067660 msgr2=0x7fc81c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:29.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.352+0000 7fc845400640 1 --2- 172.21.15.32:0/3355481150 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc81c067660 0x7fc81c069b20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc830009990 tx=0x7fc830009110 comp rx=0 tx=0).stop 2024-03-19T06:21:29.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.352+0000 7fc845400640 1 -- 172.21.15.32:0/3355481150 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc84015c010 msgr2=0x7fc8400b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:29.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.352+0000 7fc845400640 1 --2- 172.21.15.32:0/3355481150 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc84015c010 0x7fc8400b2950 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc83800cef0 tx=0x7fc83800a710 comp rx=0 tx=0).stop 2024-03-19T06:21:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.352+0000 7fc845400640 1 -- 172.21.15.32:0/3355481150 shutdown_connections 2024-03-19T06:21:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.352+0000 7fc845400640 1 --2- 172.21.15.32:0/3355481150 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc81c067660 0x7fc81c069b20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.352+0000 7fc845400640 1 --2- 172.21.15.32:0/3355481150 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc84015c010 0x7fc8400b2950 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.352+0000 7fc845400640 1 --2- 172.21.15.32:0/3355481150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8400aecf0 0x7fc840157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.352+0000 7fc845400640 1 --2- 172.21.15.32:0/3355481150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc84006d6c0 0x7fc840144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.352+0000 7fc845400640 1 -- 172.21.15.32:0/3355481150 >> 172.21.15.32:0/3355481150 conn(0x7fc8400b1280 msgr2=0x7fc8400cc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.352+0000 7fc845400640 1 -- 172.21.15.32:0/3355481150 shutdown_connections 2024-03-19T06:21:29.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:29.352+0000 7fc845400640 1 -- 172.21.15.32:0/3355481150 wait complete. 2024-03-19T06:21:29.362 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-19T06:21:29.362 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-19T06:21:29.362 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-03-19T06:21:29.362 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-19T06:21:29.363 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-19T06:21:29.363 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-19T06:21:29.363 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-19T06:21:29.363 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-19T06:21:29.363 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-19T06:21:29.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:29.363 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-03-19T06:21:29.373 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:21:29.373 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:21:29.373 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:21:29.373 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:29.373 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-03-19T06:21:29.373 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:29.373 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:21:29.373 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:29.373 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-03-19T06:21:29.373 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:21:29.373 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:29.373 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-03-19T06:21:29.374 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:21:29.374 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:29.374 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-19T06:21:29.374 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:29.374 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-19T06:21:29.374 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42417sec preferred_lft 42417sec 2024-03-19T06:21:29.374 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-03-19T06:21:29.374 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:29.374 INFO:teuthology.orchestra.run.smithi171.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-19T06:21:29.374 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 02:42:9f:c8:0c:00 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:29.374 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-19T06:21:29.374 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:29.375 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-19T06:21:29.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:29.376 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-03-19T06:21:29.376 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-03-19T06:21:29.376 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link add name ceph-brx type bridge 2024-03-19T06:21:29.376 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip addr flush dev ceph-brx 2024-03-19T06:21:29.376 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set ceph-brx up 2024-03-19T06:21:29.376 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-19T06:21:29.376 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-03-19T06:21:29.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:29.488 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-19T06:21:29.507 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-03-19T06:21:29.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:29.509 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-03-19T06:21:29.587 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-03-19T06:21:29.588 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-19T06:21:29.588 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-19T06:21:29.588 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-19T06:21:29.588 INFO:teuthology.orchestra.run.smithi171.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-03-19T06:21:29.588 INFO:teuthology.orchestra.run.smithi171.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-19T06:21:29.588 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-19T06:21:29.588 INFO:teuthology.orchestra.run.smithi171.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-19T06:21:29.588 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-19T06:21:29.588 INFO:teuthology.orchestra.run.smithi171.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-19T06:21:29.588 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-19T06:21:29.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:29.589 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-03-19T06:21:29.589 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-03-19T06:21:29.589 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-19T06:21:29.589 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-19T06:21:29.589 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-19T06:21:29.589 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-03-19T06:21:29.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:29.677 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-03-19T06:21:29.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:29.686 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list-id 2024-03-19T06:21:29.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:29.736 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-03-19T06:21:29.736 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-03-19T06:21:29.736 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:21:29.736 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-19T06:21:29.736 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-03-19T06:21:29.818 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-19T06:21:29.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:29.819 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-03-19T06:21:29.819 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-03-19T06:21:29.819 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-19T06:21:29.819 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-19T06:21:29.819 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-19T06:21:29.819 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-19T06:21:29.819 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-19T06:21:29.819 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-03-19T06:21:29.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:29.979 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-03-19T06:21:29.979 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-03-19T06:21:29.979 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-03-19T06:21:29.980 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set dev brx.0 master ceph-brx 2024-03-19T06:21:29.980 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-03-19T06:21:30.018 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-19T06:21:30.018 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:21:30.018 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-19T06:21:30.072 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-19T06:21:30.088 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:21:30.088 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-19T06:21:30.126 DEBUG:teuthology.orchestra.run.smithi171:> sudo modprobe fuse 2024-03-19T06:21:30.188 DEBUG:teuthology.orchestra.run.smithi171:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:21:30.241 INFO:teuthology.orchestra.run.smithi171.stdout:/sys 2024-03-19T06:21:30.241 INFO:teuthology.orchestra.run.smithi171.stdout:/proc 2024-03-19T06:21:30.241 INFO:teuthology.orchestra.run.smithi171.stdout:/dev 2024-03-19T06:21:30.241 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/pts 2024-03-19T06:21:30.241 INFO:teuthology.orchestra.run.smithi171.stdout:/run 2024-03-19T06:21:30.241 INFO:teuthology.orchestra.run.smithi171.stdout:/ 2024-03-19T06:21:30.241 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/security 2024-03-19T06:21:30.242 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/shm 2024-03-19T06:21:30.242 INFO:teuthology.orchestra.run.smithi171.stdout:/run/lock 2024-03-19T06:21:30.242 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/cgroup 2024-03-19T06:21:30.242 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/pstore 2024-03-19T06:21:30.242 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/bpf 2024-03-19T06:21:30.242 INFO:teuthology.orchestra.run.smithi171.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:21:30.242 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/hugepages 2024-03-19T06:21:30.242 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/mqueue 2024-03-19T06:21:30.242 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/debug 2024-03-19T06:21:30.242 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/tracing 2024-03-19T06:21:30.242 INFO:teuthology.orchestra.run.smithi171.stdout:/proc/fs/nfsd 2024-03-19T06:21:30.242 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/fuse/connections 2024-03-19T06:21:30.242 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/config 2024-03-19T06:21:30.243 INFO:teuthology.orchestra.run.smithi171.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:21:30.243 INFO:teuthology.orchestra.run.smithi171.stdout:/run/rpc_pipefs 2024-03-19T06:21:30.243 INFO:teuthology.orchestra.run.smithi171.stdout:/run/user/1000 2024-03-19T06:21:30.243 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph 2024-03-19T06:21:30.243 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-4 2024-03-19T06:21:30.243 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-5 2024-03-19T06:21:30.243 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-6 2024-03-19T06:21:30.243 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-7 2024-03-19T06:21:30.243 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns 2024-03-19T06:21:30.243 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:21:30.243 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:21:30.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:30.244 DEBUG:teuthology.orchestra.run.smithi171:> ls /sys/fs/fuse/connections 2024-03-19T06:21:30.299 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-19T06:21:30.300 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-03-19T06:21:30.342 DEBUG:teuthology.orchestra.run.smithi171:> sudo modprobe fuse 2024-03-19T06:21:30.362 DEBUG:teuthology.orchestra.run.smithi171:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:21:30.413 INFO:teuthology.orchestra.run.smithi171.stdout:/sys 2024-03-19T06:21:30.413 INFO:teuthology.orchestra.run.smithi171.stdout:/proc 2024-03-19T06:21:30.413 INFO:teuthology.orchestra.run.smithi171.stdout:/dev 2024-03-19T06:21:30.413 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/pts 2024-03-19T06:21:30.413 INFO:teuthology.orchestra.run.smithi171.stdout:/run 2024-03-19T06:21:30.413 INFO:teuthology.orchestra.run.smithi171.stdout:/ 2024-03-19T06:21:30.413 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/security 2024-03-19T06:21:30.413 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/shm 2024-03-19T06:21:30.413 INFO:teuthology.orchestra.run.smithi171.stdout:/run/lock 2024-03-19T06:21:30.414 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/cgroup 2024-03-19T06:21:30.414 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/pstore 2024-03-19T06:21:30.414 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/bpf 2024-03-19T06:21:30.414 INFO:teuthology.orchestra.run.smithi171.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:21:30.414 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/hugepages 2024-03-19T06:21:30.414 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/mqueue 2024-03-19T06:21:30.414 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/debug 2024-03-19T06:21:30.414 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/tracing 2024-03-19T06:21:30.414 INFO:teuthology.orchestra.run.smithi171.stdout:/proc/fs/nfsd 2024-03-19T06:21:30.414 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/fuse/connections 2024-03-19T06:21:30.414 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/config 2024-03-19T06:21:30.414 INFO:teuthology.orchestra.run.smithi171.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:21:30.414 INFO:teuthology.orchestra.run.smithi171.stdout:/run/rpc_pipefs 2024-03-19T06:21:30.415 INFO:teuthology.orchestra.run.smithi171.stdout:/run/user/1000 2024-03-19T06:21:30.415 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph 2024-03-19T06:21:30.415 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-4 2024-03-19T06:21:30.415 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-5 2024-03-19T06:21:30.415 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-6 2024-03-19T06:21:30.415 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-7 2024-03-19T06:21:30.415 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns 2024-03-19T06:21:30.415 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:21:30.415 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:21:30.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:30.416 DEBUG:teuthology.orchestra.run.smithi171:> ls /sys/fs/fuse/connections 2024-03-19T06:21:30.450 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi171.stderr:2024-03-19T06:21:30.460+0000 7fca14dc9580 -1 init, newargv = 0x56120da1f010 newargc=15 2024-03-19T06:21:30.450 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi171.stderr:ceph-fuse[33127]: starting ceph client 2024-03-19T06:21:30.458 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi171.stderr:ceph-fuse[33127]: starting fuse 2024-03-19T06:21:31.559 DEBUG:teuthology.orchestra.run.smithi171:> sudo modprobe fuse 2024-03-19T06:21:31.581 DEBUG:teuthology.orchestra.run.smithi171:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:21:31.637 INFO:teuthology.orchestra.run.smithi171.stdout:/sys 2024-03-19T06:21:31.637 INFO:teuthology.orchestra.run.smithi171.stdout:/proc 2024-03-19T06:21:31.637 INFO:teuthology.orchestra.run.smithi171.stdout:/dev 2024-03-19T06:21:31.637 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/pts 2024-03-19T06:21:31.638 INFO:teuthology.orchestra.run.smithi171.stdout:/run 2024-03-19T06:21:31.638 INFO:teuthology.orchestra.run.smithi171.stdout:/ 2024-03-19T06:21:31.638 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/security 2024-03-19T06:21:31.638 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/shm 2024-03-19T06:21:31.638 INFO:teuthology.orchestra.run.smithi171.stdout:/run/lock 2024-03-19T06:21:31.638 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/cgroup 2024-03-19T06:21:31.638 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/pstore 2024-03-19T06:21:31.638 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/bpf 2024-03-19T06:21:31.638 INFO:teuthology.orchestra.run.smithi171.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:21:31.638 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/hugepages 2024-03-19T06:21:31.638 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/mqueue 2024-03-19T06:21:31.638 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/debug 2024-03-19T06:21:31.638 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/tracing 2024-03-19T06:21:31.638 INFO:teuthology.orchestra.run.smithi171.stdout:/proc/fs/nfsd 2024-03-19T06:21:31.639 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/fuse/connections 2024-03-19T06:21:31.639 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/config 2024-03-19T06:21:31.639 INFO:teuthology.orchestra.run.smithi171.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:21:31.639 INFO:teuthology.orchestra.run.smithi171.stdout:/run/rpc_pipefs 2024-03-19T06:21:31.639 INFO:teuthology.orchestra.run.smithi171.stdout:/run/user/1000 2024-03-19T06:21:31.639 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph 2024-03-19T06:21:31.639 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-4 2024-03-19T06:21:31.639 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-5 2024-03-19T06:21:31.639 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-6 2024-03-19T06:21:31.639 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-7 2024-03-19T06:21:31.639 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns 2024-03-19T06:21:31.639 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:21:31.639 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:21:31.639 INFO:teuthology.orchestra.run.smithi171.stdout:/home/ubuntu/cephtest/mnt.1 2024-03-19T06:21:31.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:31.640 DEBUG:teuthology.orchestra.run.smithi171:> ls /sys/fs/fuse/connections 2024-03-19T06:21:31.692 INFO:teuthology.orchestra.run.smithi171.stdout:43 2024-03-19T06:21:31.692 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-03-19T06:21:31.692 DEBUG:teuthology.orchestra.run.smithi171:> sudo stdin-killer -- python3 -c ' 2024-03-19T06:21:31.692 DEBUG:teuthology.orchestra.run.smithi171:> import glob 2024-03-19T06:21:31.692 DEBUG:teuthology.orchestra.run.smithi171:> import re 2024-03-19T06:21:31.692 DEBUG:teuthology.orchestra.run.smithi171:> import os 2024-03-19T06:21:31.692 DEBUG:teuthology.orchestra.run.smithi171:> import subprocess 2024-03-19T06:21:31.692 DEBUG:teuthology.orchestra.run.smithi171:> 2024-03-19T06:21:31.693 DEBUG:teuthology.orchestra.run.smithi171:> def _find_admin_socket(client_name): 2024-03-19T06:21:31.693 DEBUG:teuthology.orchestra.run.smithi171:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-19T06:21:31.693 DEBUG:teuthology.orchestra.run.smithi171:> files = glob.glob(asok_path) 2024-03-19T06:21:31.693 DEBUG:teuthology.orchestra.run.smithi171:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-19T06:21:31.693 DEBUG:teuthology.orchestra.run.smithi171:> 2024-03-19T06:21:31.693 DEBUG:teuthology.orchestra.run.smithi171:> # Given a non-glob path, it better be there 2024-03-19T06:21:31.693 DEBUG:teuthology.orchestra.run.smithi171:> if "*" not in asok_path: 2024-03-19T06:21:31.693 DEBUG:teuthology.orchestra.run.smithi171:> assert(len(files) == 1) 2024-03-19T06:21:31.693 DEBUG:teuthology.orchestra.run.smithi171:> return files[0] 2024-03-19T06:21:31.693 DEBUG:teuthology.orchestra.run.smithi171:> 2024-03-19T06:21:31.693 DEBUG:teuthology.orchestra.run.smithi171:> for f in files: 2024-03-19T06:21:31.693 DEBUG:teuthology.orchestra.run.smithi171:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-19T06:21:31.693 DEBUG:teuthology.orchestra.run.smithi171:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-19T06:21:31.693 DEBUG:teuthology.orchestra.run.smithi171:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-19T06:21:31.693 DEBUG:teuthology.orchestra.run.smithi171:> contents = proc_f.read() 2024-03-19T06:21:31.693 DEBUG:teuthology.orchestra.run.smithi171:> if mountpoint in contents: 2024-03-19T06:21:31.694 DEBUG:teuthology.orchestra.run.smithi171:> return f 2024-03-19T06:21:31.694 DEBUG:teuthology.orchestra.run.smithi171:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-19T06:21:31.694 DEBUG:teuthology.orchestra.run.smithi171:> 2024-03-19T06:21:31.694 DEBUG:teuthology.orchestra.run.smithi171:> print(_find_admin_socket("client.1")) 2024-03-19T06:21:31.694 DEBUG:teuthology.orchestra.run.smithi171:> ' 2024-03-19T06:21:31.814 INFO:teuthology.orchestra.run.smithi171.stdout:/var/run/ceph/ceph-client.1.33127.asok 2024-03-19T06:21:31.818 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:21:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-19T06:21:31.825 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33127.asok 2024-03-19T06:21:31.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:31.826 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33127.asok status 2024-03-19T06:21:31.995 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-03-19T06:21:31.996 INFO:teuthology.orchestra.run.smithi171.stdout: "metadata": { 2024-03-19T06:21:31.996 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_sha1": "b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", 2024-03-19T06:21:31.996 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_version": "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)", 2024-03-19T06:21:31.996 INFO:teuthology.orchestra.run.smithi171.stdout: "entity_id": "1", 2024-03-19T06:21:31.996 INFO:teuthology.orchestra.run.smithi171.stdout: "hostname": "smithi171", 2024-03-19T06:21:31.996 INFO:teuthology.orchestra.run.smithi171.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-19T06:21:31.996 INFO:teuthology.orchestra.run.smithi171.stdout: "pid": "33127", 2024-03-19T06:21:31.996 INFO:teuthology.orchestra.run.smithi171.stdout: "root": "/" 2024-03-19T06:21:31.996 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-03-19T06:21:31.996 INFO:teuthology.orchestra.run.smithi171.stdout: "dentry_count": 0, 2024-03-19T06:21:31.996 INFO:teuthology.orchestra.run.smithi171.stdout: "dentry_pinned_count": 0, 2024-03-19T06:21:31.996 INFO:teuthology.orchestra.run.smithi171.stdout: "id": 4687, 2024-03-19T06:21:31.996 INFO:teuthology.orchestra.run.smithi171.stdout: "inst": { 2024-03-19T06:21:31.997 INFO:teuthology.orchestra.run.smithi171.stdout: "name": { 2024-03-19T06:21:31.997 INFO:teuthology.orchestra.run.smithi171.stdout: "type": "client", 2024-03-19T06:21:31.997 INFO:teuthology.orchestra.run.smithi171.stdout: "num": 4687 2024-03-19T06:21:31.997 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-03-19T06:21:31.997 INFO:teuthology.orchestra.run.smithi171.stdout: "addr": { 2024-03-19T06:21:31.997 INFO:teuthology.orchestra.run.smithi171.stdout: "type": "v1", 2024-03-19T06:21:31.997 INFO:teuthology.orchestra.run.smithi171.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:21:31.997 INFO:teuthology.orchestra.run.smithi171.stdout: "nonce": 3154229756 2024-03-19T06:21:31.997 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-03-19T06:21:31.997 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-03-19T06:21:31.997 INFO:teuthology.orchestra.run.smithi171.stdout: "addr": { 2024-03-19T06:21:31.997 INFO:teuthology.orchestra.run.smithi171.stdout: "type": "v1", 2024-03-19T06:21:31.997 INFO:teuthology.orchestra.run.smithi171.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:21:31.997 INFO:teuthology.orchestra.run.smithi171.stdout: "nonce": 3154229756 2024-03-19T06:21:31.997 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-03-19T06:21:31.997 INFO:teuthology.orchestra.run.smithi171.stdout: "inst_str": "client.4687 192.168.0.1:0/3154229756", 2024-03-19T06:21:31.998 INFO:teuthology.orchestra.run.smithi171.stdout: "addr_str": "192.168.0.1:0/3154229756", 2024-03-19T06:21:31.998 INFO:teuthology.orchestra.run.smithi171.stdout: "inode_count": 1, 2024-03-19T06:21:31.998 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_epoch": 8, 2024-03-19T06:21:31.998 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_epoch": 22, 2024-03-19T06:21:31.998 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_epoch_barrier": 0, 2024-03-19T06:21:31.998 INFO:teuthology.orchestra.run.smithi171.stdout: "blocklisted": false, 2024-03-19T06:21:31.998 INFO:teuthology.orchestra.run.smithi171.stdout: "fs_name": "cephfs" 2024-03-19T06:21:31.998 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-03-19T06:21:32.011 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-19T06:21:32.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.172+0000 7f1cede00640 1 Processor -- start 2024-03-19T06:21:32.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.172+0000 7f1cede00640 1 -- start start 2024-03-19T06:21:32.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1cede00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce8159ed0 0x7f1ce80cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:32.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1cede00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1ce815a2b0 0x7f1ce80caf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:32.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1cede00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1ce80cdb40 0x7f1ce8071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:32.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1cede00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce80ce3e0 con 0x7f1ce80cdb40 2024-03-19T06:21:32.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1cede00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce80ca1d0 con 0x7f1ce815a2b0 2024-03-19T06:21:32.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1cede00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80ca4b0 con 0x7f1ce8159ed0 2024-03-19T06:21:32.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1ce7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1ce80cdb40 0x7f1ce8071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1ce7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1ce80cdb40 0x7f1ce8071350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36532/0 (socket says 172.21.15.32:36532) 2024-03-19T06:21:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1ce7400640 1 -- 172.21.15.32:0/2560708311 learned_addr learned my addr 172.21.15.32:0/2560708311 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1ce6a00640 1 --2- 172.21.15.32:0/2560708311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce8159ed0 0x7f1ce80cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1cdfe00640 1 --2- 172.21.15.32:0/2560708311 >> v2:172.21.15.171:3300/0 conn(0x7f1ce815a2b0 0x7f1ce80caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1ce7400640 1 -- 172.21.15.32:0/2560708311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce8159ed0 msgr2=0x7f1ce80cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1ce7400640 1 --2- 172.21.15.32:0/2560708311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce8159ed0 0x7f1ce80cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1ce7400640 1 -- 172.21.15.32:0/2560708311 >> v2:172.21.15.171:3300/0 conn(0x7f1ce815a2b0 msgr2=0x7f1ce80caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1ce7400640 1 --2- 172.21.15.32:0/2560708311 >> v2:172.21.15.171:3300/0 conn(0x7f1ce815a2b0 0x7f1ce80caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1ce7400640 1 -- 172.21.15.32:0/2560708311 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce80ca790 con 0x7f1ce80cdb40 2024-03-19T06:21:32.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.176+0000 7f1ce7400640 1 --2- 172.21.15.32:0/2560708311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce80cdb40 0x7f1ce8071350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8068910 tx=0x7f1ce001eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5328233993a1f704 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:32.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1ce6000640 1 -- 172.21.15.32:0/2560708311 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00ad070 con 0x7f1ce80cdb40 2024-03-19T06:21:32.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1ce6000640 1 -- 172.21.15.32:0/2560708311 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce00a7a50 con 0x7f1ce80cdb40 2024-03-19T06:21:32.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1ce6000640 1 -- 172.21.15.32:0/2560708311 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00a7e20 con 0x7f1ce80cdb40 2024-03-19T06:21:32.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 -- 172.21.15.32:0/2560708311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce80cdb40 msgr2=0x7f1ce8071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:32.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 --2- 172.21.15.32:0/2560708311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce80cdb40 0x7f1ce8071350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8068910 tx=0x7f1ce001eb30 comp rx=0 tx=0).stop 2024-03-19T06:21:32.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 -- 172.21.15.32:0/2560708311 shutdown_connections 2024-03-19T06:21:32.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 --2- 172.21.15.32:0/2560708311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce80cdb40 0x7f1ce8071350 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:32.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 --2- 172.21.15.32:0/2560708311 >> v2:172.21.15.171:3300/0 conn(0x7f1ce815a2b0 0x7f1ce80caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:32.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 --2- 172.21.15.32:0/2560708311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce8159ed0 0x7f1ce80cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:32.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 -- 172.21.15.32:0/2560708311 >> 172.21.15.32:0/2560708311 conn(0x7f1ce80b1280 msgr2=0x7f1ce80b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:32.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 -- 172.21.15.32:0/2560708311 shutdown_connections 2024-03-19T06:21:32.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 -- 172.21.15.32:0/2560708311 wait complete. 2024-03-19T06:21:32.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 Processor -- start 2024-03-19T06:21:32.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 -- start start 2024-03-19T06:21:32.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce80cdb40 0x7f1ce80a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:32.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce8159ed0 0x7f1ce80a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce815a2b0 0x7f1ce80b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce806de30 con 0x7f1ce815a2b0 2024-03-19T06:21:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80ce180 con 0x7f1ce8159ed0 2024-03-19T06:21:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cede00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce806dfb0 con 0x7f1ce80cdb40 2024-03-19T06:21:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1ce7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce815a2b0 0x7f1ce80b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1ce7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce815a2b0 0x7f1ce80b20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36538/0 (socket says 172.21.15.32:36538) 2024-03-19T06:21:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1ce7400640 1 -- 172.21.15.32:0/2247501666 learned_addr learned my addr 172.21.15.32:0/2247501666 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1cdfe00640 1 --2- 172.21.15.32:0/2247501666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce8159ed0 0x7f1ce80a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.180+0000 7f1ce6a00640 1 --2- 172.21.15.32:0/2247501666 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce80cdb40 0x7f1ce80a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.184+0000 7f1ce7400640 1 -- 172.21.15.32:0/2247501666 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce80cdb40 msgr2=0x7f1ce80a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.184+0000 7f1ce7400640 1 --2- 172.21.15.32:0/2247501666 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce80cdb40 0x7f1ce80a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.184+0000 7f1ce7400640 1 -- 172.21.15.32:0/2247501666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce8159ed0 msgr2=0x7f1ce80a8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:32.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.184+0000 7f1ce7400640 1 --2- 172.21.15.32:0/2247501666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce8159ed0 0x7f1ce80a8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:32.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.184+0000 7f1ce7400640 1 -- 172.21.15.32:0/2247501666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce8146c20 con 0x7f1ce815a2b0 2024-03-19T06:21:32.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.184+0000 7f1ce7400640 1 --2- 172.21.15.32:0/2247501666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce815a2b0 0x7f1ce80b20d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00b3040 tx=0x7f1ce001b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:32.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.184+0000 7f1cdf400640 1 -- 172.21.15.32:0/2247501666 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00c0070 con 0x7f1ce815a2b0 2024-03-19T06:21:32.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.184+0000 7f1cdf400640 1 -- 172.21.15.32:0/2247501666 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce00a7850 con 0x7f1ce815a2b0 2024-03-19T06:21:32.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.184+0000 7f1cdf400640 1 -- 172.21.15.32:0/2247501666 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00ad040 con 0x7f1ce815a2b0 2024-03-19T06:21:32.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.184+0000 7f1cede00640 1 -- 172.21.15.32:0/2247501666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce8146280 con 0x7f1ce815a2b0 2024-03-19T06:21:32.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.184+0000 7f1cede00640 1 -- 172.21.15.32:0/2247501666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce80b3620 con 0x7f1ce815a2b0 2024-03-19T06:21:32.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.184+0000 7f1cede00640 1 -- 172.21.15.32:0/2247501666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce80749e0 con 0x7f1ce815a2b0 2024-03-19T06:21:32.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.184+0000 7f1cdf400640 1 -- 172.21.15.32:0/2247501666 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1ce000b150 con 0x7f1ce815a2b0 2024-03-19T06:21:32.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.184+0000 7f1cdf400640 1 --2- 172.21.15.32:0/2247501666 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1cc4067660 0x7f1cc4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:32.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.184+0000 7f1cdf400640 1 -- 172.21.15.32:0/2247501666 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ce011f960 con 0x7f1ce815a2b0 2024-03-19T06:21:32.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.188+0000 7f1ce6a00640 1 --2- 172.21.15.32:0/2247501666 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1cc4067660 0x7f1cc4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:32.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.188+0000 7f1ce6a00640 1 --2- 172.21.15.32:0/2247501666 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1cc4067660 0x7f1cc4069b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009b60 tx=0x7f1cd8009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:32.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.192+0000 7f1cdf400640 1 -- 172.21.15.32:0/2247501666 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f1ce00187e0 con 0x7f1ce815a2b0 2024-03-19T06:21:32.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.388+0000 7f1cede00640 1 -- 172.21.15.32:0/2247501666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1ce8072600 con 0x7f1ce815a2b0 2024-03-19T06:21:32.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.392+0000 7f1cdf400640 1 -- 172.21.15.32:0/2247501666 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1ce00a7a20 con 0x7f1ce815a2b0 2024-03-19T06:21:32.383 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-19T06:21:32.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.392+0000 7f1cede00640 1 -- 172.21.15.32:0/2247501666 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1cc4067660 msgr2=0x7f1cc4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:32.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.392+0000 7f1cede00640 1 --2- 172.21.15.32:0/2247501666 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1cc4067660 0x7f1cc4069b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009b60 tx=0x7f1cd8009190 comp rx=0 tx=0).stop 2024-03-19T06:21:32.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.392+0000 7f1cede00640 1 -- 172.21.15.32:0/2247501666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce815a2b0 msgr2=0x7f1ce80b20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:32.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.392+0000 7f1cede00640 1 --2- 172.21.15.32:0/2247501666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce815a2b0 0x7f1ce80b20d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00b3040 tx=0x7f1ce001b8d0 comp rx=0 tx=0).stop 2024-03-19T06:21:32.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.392+0000 7f1cede00640 1 -- 172.21.15.32:0/2247501666 shutdown_connections 2024-03-19T06:21:32.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.392+0000 7f1cede00640 1 --2- 172.21.15.32:0/2247501666 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1cc4067660 0x7f1cc4069b20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:32.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.392+0000 7f1cede00640 1 --2- 172.21.15.32:0/2247501666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ce815a2b0 0x7f1ce80b20d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:32.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.392+0000 7f1cede00640 1 --2- 172.21.15.32:0/2247501666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce8159ed0 0x7f1ce80a8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:32.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.392+0000 7f1cede00640 1 --2- 172.21.15.32:0/2247501666 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ce80cdb40 0x7f1ce80a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:32.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.392+0000 7f1cede00640 1 -- 172.21.15.32:0/2247501666 >> 172.21.15.32:0/2247501666 conn(0x7f1ce80b1280 msgr2=0x7f1ce815c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:32.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.392+0000 7f1cede00640 1 -- 172.21.15.32:0/2247501666 shutdown_connections 2024-03-19T06:21:32.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:32.392+0000 7f1cede00640 1 -- 172.21.15.32:0/2247501666 wait complete. 2024-03-19T06:21:32.404 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-19T06:21:32.404 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-19T06:21:32.404 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-03-19T06:21:32.404 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-19T06:21:32.405 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-19T06:21:32.405 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-19T06:21:32.405 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-19T06:21:32.405 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-19T06:21:32.405 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-19T06:21:32.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:32.405 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-03-19T06:21:32.415 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:21:32.415 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:21:32.415 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:21:32.415 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:32.415 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-03-19T06:21:32.415 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:32.415 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:21:32.415 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:32.415 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-03-19T06:21:32.415 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:21:32.415 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:32.415 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-03-19T06:21:32.416 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:21:32.416 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:32.416 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-19T06:21:32.416 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:32.416 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-19T06:21:32.416 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42414sec preferred_lft 42414sec 2024-03-19T06:21:32.416 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-03-19T06:21:32.416 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:32.416 INFO:teuthology.orchestra.run.smithi171.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-19T06:21:32.416 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 02:42:9f:c8:0c:00 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:32.416 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-19T06:21:32.416 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:32.416 INFO:teuthology.orchestra.run.smithi171.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-19T06:21:32.416 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-03-19T06:21:32.417 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-19T06:21:32.417 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:32.417 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-03-19T06:21:32.417 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:32.417 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-19T06:21:32.417 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:21:32.417 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-03-19T06:21:32.417 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:32.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:32.417 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-19T06:21:32.477 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-03-19T06:21:32.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:32.479 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-03-19T06:21:32.531 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-03-19T06:21:32.532 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-19T06:21:32.532 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-19T06:21:32.532 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-19T06:21:32.532 INFO:teuthology.orchestra.run.smithi171.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-03-19T06:21:32.532 INFO:teuthology.orchestra.run.smithi171.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-19T06:21:32.532 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-19T06:21:32.532 INFO:teuthology.orchestra.run.smithi171.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-19T06:21:32.532 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-19T06:21:32.532 INFO:teuthology.orchestra.run.smithi171.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-19T06:21:32.532 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-19T06:21:32.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:32.533 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-03-19T06:21:32.533 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-03-19T06:21:32.533 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-19T06:21:32.533 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-19T06:21:32.533 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-19T06:21:32.533 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-03-19T06:21:32.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:32.620 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-03-19T06:21:32.629 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-19T06:21:32.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:32.630 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list-id 2024-03-19T06:21:32.679 INFO:teuthology.orchestra.run.smithi171.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-19T06:21:32.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:32.680 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-03-19T06:21:32.680 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-03-19T06:21:32.680 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-19T06:21:32.680 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-19T06:21:32.680 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-03-19T06:21:32.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:32.761 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-19T06:21:32.823 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:21:32.823 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:21:32.823 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:21:32.823 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:32.823 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-03-19T06:21:32.823 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:32.823 INFO:teuthology.orchestra.run.smithi171.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-19T06:21:32.823 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether ca:45:43:33:36:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-19T06:21:32.824 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-19T06:21:32.824 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:32.824 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::c845:43ff:fe33:3639/64 scope link 2024-03-19T06:21:32.824 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:32.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:32.825 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-19T06:21:32.887 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:21:32.887 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:21:32.887 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:21:32.887 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:32.887 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-03-19T06:21:32.887 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:32.887 INFO:teuthology.orchestra.run.smithi171.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-19T06:21:32.887 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether ca:45:43:33:36:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-19T06:21:32.888 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-19T06:21:32.888 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:32.888 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::c845:43ff:fe33:3639/64 scope link 2024-03-19T06:21:32.888 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:21:32.889 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-19T06:21:32.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:32.889 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-03-19T06:21:32.890 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-03-19T06:21:32.890 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-19T06:21:32.890 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-19T06:21:32.890 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-19T06:21:32.890 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-19T06:21:32.890 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-19T06:21:32.890 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-03-19T06:21:33.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:33.028 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-03-19T06:21:33.028 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-03-19T06:21:33.028 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.1 up 2024-03-19T06:21:33.028 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set dev brx.1 master ceph-brx 2024-03-19T06:21:33.028 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-03-19T06:21:33.065 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-03-19T06:21:33.065 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:21:33.065 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-19T06:21:33.115 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-19T06:21:33.116 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:21:33.116 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-19T06:21:33.167 DEBUG:teuthology.orchestra.run.smithi171:> sudo modprobe fuse 2024-03-19T06:21:33.227 DEBUG:teuthology.orchestra.run.smithi171:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:21:33.281 INFO:teuthology.orchestra.run.smithi171.stdout:/sys 2024-03-19T06:21:33.281 INFO:teuthology.orchestra.run.smithi171.stdout:/proc 2024-03-19T06:21:33.281 INFO:teuthology.orchestra.run.smithi171.stdout:/dev 2024-03-19T06:21:33.281 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/pts 2024-03-19T06:21:33.281 INFO:teuthology.orchestra.run.smithi171.stdout:/run 2024-03-19T06:21:33.281 INFO:teuthology.orchestra.run.smithi171.stdout:/ 2024-03-19T06:21:33.281 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/security 2024-03-19T06:21:33.281 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/shm 2024-03-19T06:21:33.281 INFO:teuthology.orchestra.run.smithi171.stdout:/run/lock 2024-03-19T06:21:33.281 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/cgroup 2024-03-19T06:21:33.282 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/pstore 2024-03-19T06:21:33.282 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/bpf 2024-03-19T06:21:33.282 INFO:teuthology.orchestra.run.smithi171.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:21:33.282 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/hugepages 2024-03-19T06:21:33.282 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/mqueue 2024-03-19T06:21:33.282 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/debug 2024-03-19T06:21:33.282 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/tracing 2024-03-19T06:21:33.282 INFO:teuthology.orchestra.run.smithi171.stdout:/proc/fs/nfsd 2024-03-19T06:21:33.282 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/fuse/connections 2024-03-19T06:21:33.282 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/config 2024-03-19T06:21:33.282 INFO:teuthology.orchestra.run.smithi171.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:21:33.282 INFO:teuthology.orchestra.run.smithi171.stdout:/run/rpc_pipefs 2024-03-19T06:21:33.282 INFO:teuthology.orchestra.run.smithi171.stdout:/run/user/1000 2024-03-19T06:21:33.283 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph 2024-03-19T06:21:33.283 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-4 2024-03-19T06:21:33.283 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-5 2024-03-19T06:21:33.283 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-6 2024-03-19T06:21:33.283 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-7 2024-03-19T06:21:33.283 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns 2024-03-19T06:21:33.283 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:21:33.283 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:21:33.283 INFO:teuthology.orchestra.run.smithi171.stdout:/home/ubuntu/cephtest/mnt.1 2024-03-19T06:21:33.283 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-19T06:21:33.283 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-19T06:21:33.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:33.284 DEBUG:teuthology.orchestra.run.smithi171:> ls /sys/fs/fuse/connections 2024-03-19T06:21:33.335 INFO:teuthology.orchestra.run.smithi171.stdout:43 2024-03-19T06:21:33.335 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-03-19T06:21:33.335 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-03-19T06:21:33.378 DEBUG:teuthology.orchestra.run.smithi171:> sudo modprobe fuse 2024-03-19T06:21:33.399 DEBUG:teuthology.orchestra.run.smithi171:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:21:33.449 INFO:teuthology.orchestra.run.smithi171.stdout:/sys 2024-03-19T06:21:33.449 INFO:teuthology.orchestra.run.smithi171.stdout:/proc 2024-03-19T06:21:33.449 INFO:teuthology.orchestra.run.smithi171.stdout:/dev 2024-03-19T06:21:33.449 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/pts 2024-03-19T06:21:33.449 INFO:teuthology.orchestra.run.smithi171.stdout:/run 2024-03-19T06:21:33.449 INFO:teuthology.orchestra.run.smithi171.stdout:/ 2024-03-19T06:21:33.449 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/security 2024-03-19T06:21:33.449 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/shm 2024-03-19T06:21:33.449 INFO:teuthology.orchestra.run.smithi171.stdout:/run/lock 2024-03-19T06:21:33.449 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/cgroup 2024-03-19T06:21:33.449 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/pstore 2024-03-19T06:21:33.450 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/bpf 2024-03-19T06:21:33.450 INFO:teuthology.orchestra.run.smithi171.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:21:33.450 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/hugepages 2024-03-19T06:21:33.450 INFO:teuthology.orchestra.run.smithi171.stdout:/dev/mqueue 2024-03-19T06:21:33.450 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/debug 2024-03-19T06:21:33.450 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/tracing 2024-03-19T06:21:33.450 INFO:teuthology.orchestra.run.smithi171.stdout:/proc/fs/nfsd 2024-03-19T06:21:33.450 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/fs/fuse/connections 2024-03-19T06:21:33.450 INFO:teuthology.orchestra.run.smithi171.stdout:/sys/kernel/config 2024-03-19T06:21:33.450 INFO:teuthology.orchestra.run.smithi171.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:21:33.450 INFO:teuthology.orchestra.run.smithi171.stdout:/run/rpc_pipefs 2024-03-19T06:21:33.450 INFO:teuthology.orchestra.run.smithi171.stdout:/run/user/1000 2024-03-19T06:21:33.450 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph 2024-03-19T06:21:33.450 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-4 2024-03-19T06:21:33.450 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-5 2024-03-19T06:21:33.451 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-6 2024-03-19T06:21:33.451 INFO:teuthology.orchestra.run.smithi171.stdout:/var/lib/ceph/osd/ceph-7 2024-03-19T06:21:33.451 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns 2024-03-19T06:21:33.451 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:21:33.451 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:21:33.451 INFO:teuthology.orchestra.run.smithi171.stdout:/home/ubuntu/cephtest/mnt.1 2024-03-19T06:21:33.451 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-19T06:21:33.451 INFO:teuthology.orchestra.run.smithi171.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-19T06:21:33.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:33.452 DEBUG:teuthology.orchestra.run.smithi171:> ls /sys/fs/fuse/connections 2024-03-19T06:21:33.476 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi171.stderr:2024-03-19T06:21:33.488+0000 7efef820d580 -1 init, newargv = 0x562519c69040 newargc=15 2024-03-19T06:21:33.477 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi171.stderr:ceph-fuse[33240]: starting ceph client 2024-03-19T06:21:33.484 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi171.stderr:ceph-fuse[33240]: starting fuse 2024-03-19T06:21:33.485 INFO:teuthology.orchestra.run.smithi171.stdout:43 2024-03-19T06:21:33.485 INFO:teuthology.orchestra.run.smithi171.stdout:44 2024-03-19T06:21:33.485 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-03-19T06:21:33.485 DEBUG:teuthology.orchestra.run.smithi171:> sudo stdin-killer -- python3 -c ' 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> import glob 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> import re 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> import os 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> import subprocess 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> def _find_admin_socket(client_name): 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> files = glob.glob(asok_path) 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> # Given a non-glob path, it better be there 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> if "*" not in asok_path: 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> assert(len(files) == 1) 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> return files[0] 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> for f in files: 2024-03-19T06:21:33.486 DEBUG:teuthology.orchestra.run.smithi171:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-19T06:21:33.487 DEBUG:teuthology.orchestra.run.smithi171:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-19T06:21:33.487 DEBUG:teuthology.orchestra.run.smithi171:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-19T06:21:33.487 DEBUG:teuthology.orchestra.run.smithi171:> contents = proc_f.read() 2024-03-19T06:21:33.487 DEBUG:teuthology.orchestra.run.smithi171:> if mountpoint in contents: 2024-03-19T06:21:33.487 DEBUG:teuthology.orchestra.run.smithi171:> return f 2024-03-19T06:21:33.487 DEBUG:teuthology.orchestra.run.smithi171:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-19T06:21:33.487 DEBUG:teuthology.orchestra.run.smithi171:> 2024-03-19T06:21:33.487 DEBUG:teuthology.orchestra.run.smithi171:> print(_find_admin_socket("client.3")) 2024-03-19T06:21:33.487 DEBUG:teuthology.orchestra.run.smithi171:> ' 2024-03-19T06:21:33.611 INFO:teuthology.orchestra.run.smithi171.stdout:/var/run/ceph/ceph-client.3.33240.asok 2024-03-19T06:21:33.614 INFO:teuthology.orchestra.run.smithi171.stderr:2024-03-19T06:21:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-19T06:21:33.622 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.33240.asok 2024-03-19T06:21:33.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:33.622 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.33240.asok status 2024-03-19T06:21:33.791 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-03-19T06:21:33.791 INFO:teuthology.orchestra.run.smithi171.stdout: "metadata": { 2024-03-19T06:21:33.791 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_sha1": "b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", 2024-03-19T06:21:33.791 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_version": "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)", 2024-03-19T06:21:33.791 INFO:teuthology.orchestra.run.smithi171.stdout: "entity_id": "3", 2024-03-19T06:21:33.791 INFO:teuthology.orchestra.run.smithi171.stdout: "hostname": "smithi171", 2024-03-19T06:21:33.791 INFO:teuthology.orchestra.run.smithi171.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-03-19T06:21:33.791 INFO:teuthology.orchestra.run.smithi171.stdout: "pid": "33240", 2024-03-19T06:21:33.791 INFO:teuthology.orchestra.run.smithi171.stdout: "root": "/" 2024-03-19T06:21:33.791 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-03-19T06:21:33.791 INFO:teuthology.orchestra.run.smithi171.stdout: "dentry_count": 0, 2024-03-19T06:21:33.791 INFO:teuthology.orchestra.run.smithi171.stdout: "dentry_pinned_count": 0, 2024-03-19T06:21:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: "id": 4532, 2024-03-19T06:21:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: "inst": { 2024-03-19T06:21:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: "name": { 2024-03-19T06:21:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: "type": "client", 2024-03-19T06:21:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: "num": 4532 2024-03-19T06:21:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-03-19T06:21:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: "addr": { 2024-03-19T06:21:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: "type": "v1", 2024-03-19T06:21:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: "addr": "192.168.0.2:0", 2024-03-19T06:21:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: "nonce": 4156041839 2024-03-19T06:21:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-03-19T06:21:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-03-19T06:21:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: "addr": { 2024-03-19T06:21:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: "type": "v1", 2024-03-19T06:21:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: "addr": "192.168.0.2:0", 2024-03-19T06:21:33.792 INFO:teuthology.orchestra.run.smithi171.stdout: "nonce": 4156041839 2024-03-19T06:21:33.793 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-03-19T06:21:33.793 INFO:teuthology.orchestra.run.smithi171.stdout: "inst_str": "client.4532 192.168.0.2:0/4156041839", 2024-03-19T06:21:33.793 INFO:teuthology.orchestra.run.smithi171.stdout: "addr_str": "192.168.0.2:0/4156041839", 2024-03-19T06:21:33.793 INFO:teuthology.orchestra.run.smithi171.stdout: "inode_count": 1, 2024-03-19T06:21:33.793 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_epoch": 8, 2024-03-19T06:21:33.793 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_epoch": 22, 2024-03-19T06:21:33.793 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_epoch_barrier": 0, 2024-03-19T06:21:33.793 INFO:teuthology.orchestra.run.smithi171.stdout: "blocklisted": false, 2024-03-19T06:21:33.793 INFO:teuthology.orchestra.run.smithi171.stdout: "fs_name": "cephfs" 2024-03-19T06:21:33.793 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-03-19T06:21:33.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:33.806 DEBUG:teuthology.orchestra.run.smithi032:> stat --file-system '--printf=%T 2024-03-19T06:21:33.806 DEBUG:teuthology.orchestra.run.smithi032:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-19T06:21:33.817 INFO:teuthology.orchestra.run.smithi032.stdout:fuseblk 2024-03-19T06:21:33.817 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-19T06:21:33.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:33.817 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:21:33.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:33.882 DEBUG:teuthology.orchestra.run.smithi032:> stat --file-system '--printf=%T 2024-03-19T06:21:33.883 DEBUG:teuthology.orchestra.run.smithi032:> ' -- /home/ubuntu/cephtest/mnt.2 2024-03-19T06:21:33.936 INFO:teuthology.orchestra.run.smithi032.stdout:fuseblk 2024-03-19T06:21:33.936 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-03-19T06:21:33.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:33.936 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-19T06:21:34.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:34.004 DEBUG:teuthology.orchestra.run.smithi171:> stat --file-system '--printf=%T 2024-03-19T06:21:34.004 DEBUG:teuthology.orchestra.run.smithi171:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-19T06:21:34.013 INFO:teuthology.orchestra.run.smithi171.stdout:fuseblk 2024-03-19T06:21:34.014 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-19T06:21:34.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:34.014 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-19T06:21:34.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:34.075 DEBUG:teuthology.orchestra.run.smithi171:> stat --file-system '--printf=%T 2024-03-19T06:21:34.075 DEBUG:teuthology.orchestra.run.smithi171:> ' -- /home/ubuntu/cephtest/mnt.3 2024-03-19T06:21:34.128 INFO:teuthology.orchestra.run.smithi171.stdout:fuseblk 2024-03-19T06:21:34.128 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-03-19T06:21:34.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:34.128 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-19T06:21:34.195 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-19T06:21:34.210 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:34.231 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:21:34.263 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:21:34.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.372+0000 7f43c6000640 1 Processor -- start 2024-03-19T06:21:34.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.372+0000 7f43c6000640 1 -- start start 2024-03-19T06:21:34.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.372+0000 7f43c6000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f43c00aecf0 0x7f43c00ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:34.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.372+0000 7f43c6000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c015fe20 con 0x7f43c015c010 2024-03-19T06:21:34.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.372+0000 7f43c6000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c0160100 con 0x7f43c006d6c0 2024-03-19T06:21:34.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.372+0000 7f43c6000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c01603e0 con 0x7f43c00aecf0 2024-03-19T06:21:34.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.372+0000 7f43b7e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f43c015c010 0x7f43c015f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48198/0 (socket says 172.21.15.32:48198) 2024-03-19T06:21:34.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.372+0000 7f43b7e00640 1 -- 172.21.15.32:0/878474842 learned_addr learned my addr 172.21.15.32:0/878474842 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:34.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.372+0000 7f43bf400640 1 --2- 172.21.15.32:0/878474842 >> v2:172.21.15.171:3300/0 conn(0x7f43c00aecf0 0x7f43c00ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:34.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.376+0000 7f43bea00640 1 -- 172.21.15.32:0/878474842 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195523759 0 0) 0x7f43c015fe20 con 0x7f43c015c010 2024-03-19T06:21:34.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.376+0000 7f43bea00640 1 -- 172.21.15.32:0/878474842 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a4003530 con 0x7f43c015c010 2024-03-19T06:21:34.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.376+0000 7f43bf400640 1 -- 172.21.15.32:0/878474842 >> v1:172.21.15.171:6789/0 conn(0x7f43c006d6c0 legacy=0x7f43c00cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:34.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.376+0000 7f43bf400640 1 -- 172.21.15.32:0/878474842 >> v1:172.21.15.32:6789/0 conn(0x7f43c015c010 legacy=0x7f43c015f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:34.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.376+0000 7f43bf400640 1 -- 172.21.15.32:0/878474842 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c00ca1f0 con 0x7f43c00aecf0 2024-03-19T06:21:34.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.376+0000 7f43bf400640 1 --2- 172.21.15.32:0/878474842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c00aecf0 0x7f43c00ca9f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43b00097c0 tx=0x7f43b001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=692443aaf31dc486 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:34.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.376+0000 7f43bea00640 1 -- 172.21.15.32:0/878474842 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b00b0070 con 0x7f43c00aecf0 2024-03-19T06:21:34.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.376+0000 7f43bea00640 1 -- 172.21.15.32:0/878474842 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b00ab600 con 0x7f43c00aecf0 2024-03-19T06:21:34.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.376+0000 7f43bea00640 1 -- 172.21.15.32:0/878474842 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b00ab9d0 con 0x7f43c00aecf0 2024-03-19T06:21:34.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.376+0000 7f43c6000640 1 -- 172.21.15.32:0/878474842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c00aecf0 msgr2=0x7f43c00ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:34.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.376+0000 7f43c6000640 1 --2- 172.21.15.32:0/878474842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c00aecf0 0x7f43c00ca9f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43b00097c0 tx=0x7f43b001c410 comp rx=0 tx=0).stop 2024-03-19T06:21:34.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43c6000640 1 -- 172.21.15.32:0/878474842 shutdown_connections 2024-03-19T06:21:34.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43c6000640 1 --2- 172.21.15.32:0/878474842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c00aecf0 0x7f43c00ca9f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:34.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43c6000640 1 -- 172.21.15.32:0/878474842 >> 172.21.15.32:0/878474842 conn(0x7f43c00b1280 msgr2=0x7f43c00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:34.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43c6000640 1 -- 172.21.15.32:0/878474842 shutdown_connections 2024-03-19T06:21:34.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43c6000640 1 -- 172.21.15.32:0/878474842 wait complete. 2024-03-19T06:21:34.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43c6000640 1 Processor -- start 2024-03-19T06:21:34.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43c6000640 1 -- start start 2024-03-19T06:21:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43c6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c006d6c0 0x7f43c01528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43c6000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c00aecf0 0x7f43c01570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43c6000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c015c010 0x7f43c0158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43c6000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c016a030 con 0x7f43c006d6c0 2024-03-19T06:21:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43c6000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c0169eb0 con 0x7f43c00aecf0 2024-03-19T06:21:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43c6000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c016a1b0 con 0x7f43c015c010 2024-03-19T06:21:34.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43bf400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c006d6c0 0x7f43c01528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43bf400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c006d6c0 0x7f43c01528b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60524/0 (socket says 172.21.15.32:60524) 2024-03-19T06:21:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43bf400640 1 -- 172.21.15.32:0/3164505468 learned_addr learned my addr 172.21.15.32:0/3164505468 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43b7e00640 1 --2- 172.21.15.32:0/3164505468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c00aecf0 0x7f43c01570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43bfe00640 1 --2- 172.21.15.32:0/3164505468 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c015c010 0x7f43c0158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43bf400640 1 -- 172.21.15.32:0/3164505468 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c015c010 msgr2=0x7f43c0158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43bf400640 1 --2- 172.21.15.32:0/3164505468 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c015c010 0x7f43c0158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43bf400640 1 -- 172.21.15.32:0/3164505468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c00aecf0 msgr2=0x7f43c01570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43bf400640 1 --2- 172.21.15.32:0/3164505468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c00aecf0 0x7f43c01570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43bf400640 1 -- 172.21.15.32:0/3164505468 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0157930 con 0x7f43c006d6c0 2024-03-19T06:21:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.380+0000 7f43bf400640 1 --2- 172.21.15.32:0/3164505468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c006d6c0 0x7f43c01528b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f43b001a040 tx=0x7f43b00191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.384+0000 7f43b7400640 1 -- 172.21.15.32:0/3164505468 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b00b8020 con 0x7f43c006d6c0 2024-03-19T06:21:34.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.384+0000 7f43b7400640 1 -- 172.21.15.32:0/3164505468 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b00b4410 con 0x7f43c006d6c0 2024-03-19T06:21:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.384+0000 7f43b7400640 1 -- 172.21.15.32:0/3164505468 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b00b0040 con 0x7f43c006d6c0 2024-03-19T06:21:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.384+0000 7f43c6000640 1 -- 172.21.15.32:0/3164505468 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c00cd4a0 con 0x7f43c006d6c0 2024-03-19T06:21:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.384+0000 7f43c6000640 1 -- 172.21.15.32:0/3164505468 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c00cda60 con 0x7f43c006d6c0 2024-03-19T06:21:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.384+0000 7f43c6000640 1 -- 172.21.15.32:0/3164505468 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c00749e0 con 0x7f43c006d6c0 2024-03-19T06:21:34.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.384+0000 7f43b7400640 1 -- 172.21.15.32:0/3164505468 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f43b00bb020 con 0x7f43c006d6c0 2024-03-19T06:21:34.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.384+0000 7f43b7400640 1 --2- 172.21.15.32:0/3164505468 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f439c067660 0x7f439c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:34.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.384+0000 7f43b7400640 1 -- 172.21.15.32:0/3164505468 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43b011f290 con 0x7f43c006d6c0 2024-03-19T06:21:34.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.384+0000 7f43b7e00640 1 --2- 172.21.15.32:0/3164505468 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f439c067660 0x7f439c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:34.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.388+0000 7f43b7e00640 1 --2- 172.21.15.32:0/3164505468 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f439c067660 0x7f439c069b20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f43c01598d0 tx=0x7f43a8007d40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:34.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.392+0000 7f43b7400640 1 -- 172.21.15.32:0/3164505468 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f43b00c2030 con 0x7f43c006d6c0 2024-03-19T06:21:34.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.560+0000 7f43c6000640 1 -- 172.21.15.32:0/3164505468 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43c0166b50 con 0x7f43c006d6c0 2024-03-19T06:21:34.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.560+0000 7f43b7400640 1 -- 172.21.15.32:0/3164505468 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f43b0016090 con 0x7f43c006d6c0 2024-03-19T06:21:34.554 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:34.554 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:10.423479+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.564+0000 7f43c6000640 1 -- 172.21.15.32:0/3164505468 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f439c067660 msgr2=0x7f439c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.564+0000 7f43c6000640 1 --2- 172.21.15.32:0/3164505468 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f439c067660 0x7f439c069b20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f43c01598d0 tx=0x7f43a8007d40 comp rx=0 tx=0).stop 2024-03-19T06:21:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.564+0000 7f43c6000640 1 -- 172.21.15.32:0/3164505468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c006d6c0 msgr2=0x7f43c01528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.564+0000 7f43c6000640 1 --2- 172.21.15.32:0/3164505468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c006d6c0 0x7f43c01528b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f43b001a040 tx=0x7f43b00191b0 comp rx=0 tx=0).stop 2024-03-19T06:21:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.564+0000 7f43c6000640 1 -- 172.21.15.32:0/3164505468 shutdown_connections 2024-03-19T06:21:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.564+0000 7f43c6000640 1 --2- 172.21.15.32:0/3164505468 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f439c067660 0x7f439c069b20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.564+0000 7f43c6000640 1 --2- 172.21.15.32:0/3164505468 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c015c010 0x7f43c0158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.564+0000 7f43c6000640 1 --2- 172.21.15.32:0/3164505468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c00aecf0 0x7f43c01570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.564+0000 7f43c6000640 1 --2- 172.21.15.32:0/3164505468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c006d6c0 0x7f43c01528b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:34.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.564+0000 7f43c6000640 1 -- 172.21.15.32:0/3164505468 >> 172.21.15.32:0/3164505468 conn(0x7f43c00b1280 msgr2=0x7f43c015d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:34.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.564+0000 7f43c6000640 1 -- 172.21.15.32:0/3164505468 shutdown_connections 2024-03-19T06:21:34.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.564+0000 7f43c6000640 1 -- 172.21.15.32:0/3164505468 wait complete. 2024-03-19T06:21:34.576 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:21:07.089673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:21:07.801319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:34.577 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:34.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.728+0000 7f0fe5200640 1 Processor -- start 2024-03-19T06:21:34.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.728+0000 7f0fe5200640 1 -- start start 2024-03-19T06:21:34.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.728+0000 7f0fe5200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe015dbb0 0x7f0fe006c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:34.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.728+0000 7f0fe5200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe00cbf00 con 0x7f0fe00b3d30 2024-03-19T06:21:34.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.728+0000 7f0fe5200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe006cb20 con 0x7f0fe006c5a0 2024-03-19T06:21:34.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.728+0000 7f0fe5200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe006ce00 con 0x7f0fe015dbb0 2024-03-19T06:21:34.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.728+0000 7f0fde800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0fe00b3d30 0x7f0fe00cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48210/0 (socket says 172.21.15.32:48210) 2024-03-19T06:21:34.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.728+0000 7f0fde800640 1 -- 172.21.15.32:0/1392046352 learned_addr learned my addr 172.21.15.32:0/1392046352 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:34.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.728+0000 7f0fdde00640 1 --2- 172.21.15.32:0/1392046352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe015dbb0 0x7f0fe006c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:34.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.728+0000 7f0fdd400640 1 -- 172.21.15.32:0/1392046352 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847746900 0 0) 0x7f0fe00cbf00 con 0x7f0fe00b3d30 2024-03-19T06:21:34.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.728+0000 7f0fdd400640 1 -- 172.21.15.32:0/1392046352 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc4003530 con 0x7f0fe00b3d30 2024-03-19T06:21:34.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.728+0000 7f0fdd400640 1 -- 172.21.15.32:0/1392046352 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255546680 0 0) 0x7f0fe006cb20 con 0x7f0fe006c5a0 2024-03-19T06:21:34.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.728+0000 7f0fdd400640 1 -- 172.21.15.32:0/1392046352 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fe00cbf00 con 0x7f0fe006c5a0 2024-03-19T06:21:34.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.728+0000 7f0fdde00640 1 -- 172.21.15.32:0/1392046352 >> v1:172.21.15.171:6789/0 conn(0x7f0fe006c5a0 legacy=0x7f0fe00b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:34.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.728+0000 7f0fdde00640 1 -- 172.21.15.32:0/1392046352 >> v1:172.21.15.32:6789/0 conn(0x7f0fe00b3d30 legacy=0x7f0fe00cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:34.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.728+0000 7f0fdde00640 1 -- 172.21.15.32:0/1392046352 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe006d0e0 con 0x7f0fe015dbb0 2024-03-19T06:21:34.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.732+0000 7f0fdde00640 1 --2- 172.21.15.32:0/1392046352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe015dbb0 0x7f0fe006c060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00097f0 tx=0x7f0fd001ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e1a5196eb5c9da6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:34.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.732+0000 7f0fdd400640 1 -- 172.21.15.32:0/1392046352 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd00b5070 con 0x7f0fe015dbb0 2024-03-19T06:21:34.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.732+0000 7f0fdd400640 1 -- 172.21.15.32:0/1392046352 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd00a89d0 con 0x7f0fe015dbb0 2024-03-19T06:21:34.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.732+0000 7f0fdd400640 1 -- 172.21.15.32:0/1392046352 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd00a8d80 con 0x7f0fe015dbb0 2024-03-19T06:21:34.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.732+0000 7f0fe5200640 1 -- 172.21.15.32:0/1392046352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe015dbb0 msgr2=0x7f0fe006c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.732+0000 7f0fe5200640 1 --2- 172.21.15.32:0/1392046352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe015dbb0 0x7f0fe006c060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00097f0 tx=0x7f0fd001ecd0 comp rx=0 tx=0).stop 2024-03-19T06:21:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.732+0000 7f0fe5200640 1 -- 172.21.15.32:0/1392046352 shutdown_connections 2024-03-19T06:21:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.732+0000 7f0fe5200640 1 --2- 172.21.15.32:0/1392046352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe015dbb0 0x7f0fe006c060 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.732+0000 7f0fe5200640 1 -- 172.21.15.32:0/1392046352 >> 172.21.15.32:0/1392046352 conn(0x7f0fe0066ca0 msgr2=0x7f0fe00670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.732+0000 7f0fe5200640 1 -- 172.21.15.32:0/1392046352 shutdown_connections 2024-03-19T06:21:34.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.732+0000 7f0fe5200640 1 -- 172.21.15.32:0/1392046352 wait complete. 2024-03-19T06:21:34.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fe5200640 1 Processor -- start 2024-03-19T06:21:34.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fe5200640 1 -- start start 2024-03-19T06:21:34.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fe5200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe006c5a0 0x7f0fe01601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:34.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fe5200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe00b3d30 0x7f0fe015f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:34.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fe5200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fe015dbb0 0x7f0fe00c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:34.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fe5200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe015df90 con 0x7f0fe015dbb0 2024-03-19T06:21:34.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fe5200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe006d910 con 0x7f0fe006c5a0 2024-03-19T06:21:34.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fe5200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe00ccdd0 con 0x7f0fe00b3d30 2024-03-19T06:21:34.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fde800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fe015dbb0 0x7f0fe00c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:34.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fdde00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe006c5a0 0x7f0fe01601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:34.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fde800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fe015dbb0 0x7f0fe00c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60526/0 (socket says 172.21.15.32:60526) 2024-03-19T06:21:34.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fd7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe00b3d30 0x7f0fe015f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:34.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fde800640 1 -- 172.21.15.32:0/1857841124 learned_addr learned my addr 172.21.15.32:0/1857841124 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:34.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fde800640 1 -- 172.21.15.32:0/1857841124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe00b3d30 msgr2=0x7f0fe015f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:34.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fde800640 1 --2- 172.21.15.32:0/1857841124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe00b3d30 0x7f0fe015f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:34.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fde800640 1 -- 172.21.15.32:0/1857841124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe006c5a0 msgr2=0x7f0fe01601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:34.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fde800640 1 --2- 172.21.15.32:0/1857841124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe006c5a0 0x7f0fe01601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:34.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fde800640 1 -- 172.21.15.32:0/1857841124 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe015fd50 con 0x7f0fe015dbb0 2024-03-19T06:21:34.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fde800640 1 --2- 172.21.15.32:0/1857841124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fe015dbb0 0x7f0fe00c7500 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800cbe0 tx=0x7f0fd800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:34.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fd6000640 1 -- 172.21.15.32:0/1857841124 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8017070 con 0x7f0fe015dbb0 2024-03-19T06:21:34.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fd6000640 1 -- 172.21.15.32:0/1857841124 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd800aca0 con 0x7f0fe015dbb0 2024-03-19T06:21:34.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fd6000640 1 -- 172.21.15.32:0/1857841124 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8012620 con 0x7f0fe015dbb0 2024-03-19T06:21:34.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fe5200640 1 -- 172.21.15.32:0/1857841124 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe01f3b90 con 0x7f0fe015dbb0 2024-03-19T06:21:34.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fe5200640 1 -- 172.21.15.32:0/1857841124 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe01f4150 con 0x7f0fe015dbb0 2024-03-19T06:21:34.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.736+0000 7f0fe5200640 1 -- 172.21.15.32:0/1857841124 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe00749e0 con 0x7f0fe015dbb0 2024-03-19T06:21:34.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.740+0000 7f0fd6000640 1 -- 172.21.15.32:0/1857841124 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0fd801a070 con 0x7f0fe015dbb0 2024-03-19T06:21:34.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.740+0000 7f0fd6000640 1 --2- 172.21.15.32:0/1857841124 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0fbc067660 0x7f0fbc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:34.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.740+0000 7f0fd6000640 1 -- 172.21.15.32:0/1857841124 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fd8085580 con 0x7f0fe015dbb0 2024-03-19T06:21:34.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.740+0000 7f0fdde00640 1 --2- 172.21.15.32:0/1857841124 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0fbc067660 0x7f0fbc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.740+0000 7f0fdde00640 1 --2- 172.21.15.32:0/1857841124 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0fbc067660 0x7f0fbc069b20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00b2000 tx=0x7f0fd00aa070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.744+0000 7f0fd6000640 1 -- 172.21.15.32:0/1857841124 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f0fd8055ba0 con 0x7f0fe015dbb0 2024-03-19T06:21:34.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.904+0000 7f0fe5200640 1 -- 172.21.15.32:0/1857841124 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0fe00cd9c0 con 0x7f0fe015dbb0 2024-03-19T06:21:34.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.904+0000 7f0fd6000640 1 -- 172.21.15.32:0/1857841124 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0fd8059c40 con 0x7f0fe015dbb0 2024-03-19T06:21:34.898 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:34.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.908+0000 7f0fe5200640 1 -- 172.21.15.32:0/1857841124 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0fbc067660 msgr2=0x7f0fbc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:34.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.908+0000 7f0fe5200640 1 --2- 172.21.15.32:0/1857841124 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0fbc067660 0x7f0fbc069b20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00b2000 tx=0x7f0fd00aa070 comp rx=0 tx=0).stop 2024-03-19T06:21:34.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.908+0000 7f0fe5200640 1 -- 172.21.15.32:0/1857841124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fe015dbb0 msgr2=0x7f0fe00c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:34.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.908+0000 7f0fe5200640 1 --2- 172.21.15.32:0/1857841124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fe015dbb0 0x7f0fe00c7500 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800cbe0 tx=0x7f0fd800a060 comp rx=0 tx=0).stop 2024-03-19T06:21:34.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.908+0000 7f0fe5200640 1 -- 172.21.15.32:0/1857841124 shutdown_connections 2024-03-19T06:21:34.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.908+0000 7f0fe5200640 1 --2- 172.21.15.32:0/1857841124 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0fbc067660 0x7f0fbc069b20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:34.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.908+0000 7f0fe5200640 1 --2- 172.21.15.32:0/1857841124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0fe015dbb0 0x7f0fe00c7500 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:34.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.908+0000 7f0fe5200640 1 --2- 172.21.15.32:0/1857841124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0fe00b3d30 0x7f0fe015f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:34.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.908+0000 7f0fe5200640 1 --2- 172.21.15.32:0/1857841124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe006c5a0 0x7f0fe01601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:34.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.908+0000 7f0fe5200640 1 -- 172.21.15.32:0/1857841124 >> 172.21.15.32:0/1857841124 conn(0x7f0fe0066ca0 msgr2=0x7f0fe015cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:34.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.908+0000 7f0fe5200640 1 -- 172.21.15.32:0/1857841124 shutdown_connections 2024-03-19T06:21:34.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:34.908+0000 7f0fe5200640 1 -- 172.21.15.32:0/1857841124 wait complete. 2024-03-19T06:21:34.919 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:21:35.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2df1600640 1 Processor -- start 2024-03-19T06:21:35.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2df1600640 1 -- start start 2024-03-19T06:21:35.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2df1600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2dec15bad0 0x7f2dec0b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2df1600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dec06b450 0x7f2dec0cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2df1600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dec0ae510 con 0x7f2dec0b0f40 2024-03-19T06:21:35.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2df1600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dec0ae7f0 con 0x7f2dec15bad0 2024-03-19T06:21:35.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2df1600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec0aead0 con 0x7f2dec06b450 2024-03-19T06:21:35.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2deb400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2dec0b0f40 0x7f2dec06ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48226/0 (socket says 172.21.15.32:48226) 2024-03-19T06:21:35.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2deb400640 1 -- 172.21.15.32:0/2600377865 learned_addr learned my addr 172.21.15.32:0/2600377865 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:35.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2df0c00640 1 --2- 172.21.15.32:0/2600377865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dec06b450 0x7f2dec0cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2debe00640 1 --2- 172.21.15.32:0/2600377865 >> v2:172.21.15.171:3300/0 conn(0x7f2dec15bad0 0x7f2dec0b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2deaa00640 1 -- 172.21.15.32:0/2600377865 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183516794 0 0) 0x7f2dec0ae510 con 0x7f2dec0b0f40 2024-03-19T06:21:35.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2deaa00640 1 -- 172.21.15.32:0/2600377865 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd0003530 con 0x7f2dec0b0f40 2024-03-19T06:21:35.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2df0c00640 1 -- 172.21.15.32:0/2600377865 >> v2:172.21.15.171:3300/0 conn(0x7f2dec15bad0 msgr2=0x7f2dec0b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:35.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2df0c00640 1 --2- 172.21.15.32:0/2600377865 >> v2:172.21.15.171:3300/0 conn(0x7f2dec15bad0 0x7f2dec0b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2deaa00640 1 -- 172.21.15.32:0/2600377865 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2254150583 0 0) 0x7f2dd0003530 con 0x7f2dec0b0f40 2024-03-19T06:21:35.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2df0c00640 1 -- 172.21.15.32:0/2600377865 >> v1:172.21.15.32:6789/0 conn(0x7f2dec0b0f40 legacy=0x7f2dec06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.072+0000 7f2df0c00640 1 -- 172.21.15.32:0/2600377865 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec0aedb0 con 0x7f2dec06b450 2024-03-19T06:21:35.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.076+0000 7f2df0c00640 1 --2- 172.21.15.32:0/2600377865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dec06b450 0x7f2dec0cea80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009d90 tx=0x7f2de401c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1d86596a48c249e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:35.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.076+0000 7f2deaa00640 1 -- 172.21.15.32:0/2600377865 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40b2070 con 0x7f2dec06b450 2024-03-19T06:21:35.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.076+0000 7f2deaa00640 1 -- 172.21.15.32:0/2600377865 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de40a5600 con 0x7f2dec06b450 2024-03-19T06:21:35.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.076+0000 7f2deaa00640 1 -- 172.21.15.32:0/2600377865 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8001680 con 0x7f2dec06b450 2024-03-19T06:21:35.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.076+0000 7f2df1600640 1 -- 172.21.15.32:0/2600377865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dec06b450 msgr2=0x7f2dec0cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.076+0000 7f2df1600640 1 --2- 172.21.15.32:0/2600377865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dec06b450 0x7f2dec0cea80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009d90 tx=0x7f2de401c860 comp rx=0 tx=0).stop 2024-03-19T06:21:35.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.076+0000 7f2df1600640 1 -- 172.21.15.32:0/2600377865 shutdown_connections 2024-03-19T06:21:35.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.076+0000 7f2df1600640 1 --2- 172.21.15.32:0/2600377865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dec06b450 0x7f2dec0cea80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.076+0000 7f2df1600640 1 --2- 172.21.15.32:0/2600377865 >> v2:172.21.15.171:3300/0 conn(0x7f2dec15bad0 0x7f2dec0b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.076+0000 7f2df1600640 1 -- 172.21.15.32:0/2600377865 >> 172.21.15.32:0/2600377865 conn(0x7f2dec0b58e0 msgr2=0x7f2dec0b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:35.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.076+0000 7f2df1600640 1 -- 172.21.15.32:0/2600377865 shutdown_connections 2024-03-19T06:21:35.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.076+0000 7f2df1600640 1 -- 172.21.15.32:0/2600377865 wait complete. 2024-03-19T06:21:35.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.076+0000 7f2df1600640 1 Processor -- start 2024-03-19T06:21:35.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.076+0000 7f2df1600640 1 -- start start 2024-03-19T06:21:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df1600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dec06b450 0x7f2dec0b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df1600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dec0b0f40 0x7f2dec14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df1600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dec15bad0 0x7f2dec154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df1600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec0cf7d0 con 0x7f2dec15bad0 2024-03-19T06:21:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df1600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec15c0c0 con 0x7f2dec0b0f40 2024-03-19T06:21:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df1600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec0cf950 con 0x7f2dec06b450 2024-03-19T06:21:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df0c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dec15bad0 0x7f2dec154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df0c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dec15bad0 0x7f2dec154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60542/0 (socket says 172.21.15.32:60542) 2024-03-19T06:21:35.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df0c00640 1 -- 172.21.15.32:0/526867191 learned_addr learned my addr 172.21.15.32:0/526867191 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2debe00640 1 --2- 172.21.15.32:0/526867191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dec06b450 0x7f2dec0b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2deb400640 1 --2- 172.21.15.32:0/526867191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dec0b0f40 0x7f2dec14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df0c00640 1 -- 172.21.15.32:0/526867191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dec06b450 msgr2=0x7f2dec0b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df0c00640 1 --2- 172.21.15.32:0/526867191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dec06b450 0x7f2dec0b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df0c00640 1 -- 172.21.15.32:0/526867191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dec0b0f40 msgr2=0x7f2dec14fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df0c00640 1 --2- 172.21.15.32:0/526867191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dec0b0f40 0x7f2dec14fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df0c00640 1 -- 172.21.15.32:0/526867191 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec0b3090 con 0x7f2dec15bad0 2024-03-19T06:21:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df0c00640 1 --2- 172.21.15.32:0/526867191 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dec15bad0 0x7f2dec154b70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2de40b0040 tx=0x7f2de4019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2de3e00640 1 -- 172.21.15.32:0/526867191 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40b2050 con 0x7f2dec15bad0 2024-03-19T06:21:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2de3e00640 1 -- 172.21.15.32:0/526867191 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de40be070 con 0x7f2dec15bad0 2024-03-19T06:21:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df1600640 1 -- 172.21.15.32:0/526867191 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dec0b3370 con 0x7f2dec15bad0 2024-03-19T06:21:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2de3e00640 1 -- 172.21.15.32:0/526867191 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de4009450 con 0x7f2dec15bad0 2024-03-19T06:21:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df1600640 1 -- 172.21.15.32:0/526867191 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dec0b3930 con 0x7f2dec15bad0 2024-03-19T06:21:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.080+0000 7f2df1600640 1 -- 172.21.15.32:0/526867191 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dec075090 con 0x7f2dec15bad0 2024-03-19T06:21:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.084+0000 7f2de3e00640 1 -- 172.21.15.32:0/526867191 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2de40ada50 con 0x7f2dec15bad0 2024-03-19T06:21:35.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.084+0000 7f2de3e00640 1 --2- 172.21.15.32:0/526867191 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2dcc067660 0x7f2dcc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.084+0000 7f2de3e00640 1 -- 172.21.15.32:0/526867191 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2de41208e0 con 0x7f2dec15bad0 2024-03-19T06:21:35.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.084+0000 7f2debe00640 1 --2- 172.21.15.32:0/526867191 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2dcc067660 0x7f2dcc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.084+0000 7f2debe00640 1 --2- 172.21.15.32:0/526867191 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2dcc067660 0x7f2dcc069b20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0b4fe0 tx=0x7f2ddc009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:35.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.088+0000 7f2de3e00640 1 -- 172.21.15.32:0/526867191 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2de4016480 con 0x7f2dec15bad0 2024-03-19T06:21:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.252+0000 7f2df1600640 1 -- 172.21.15.32:0/526867191 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2dec0cec50 con 0x7f2dec15bad0 2024-03-19T06:21:35.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.252+0000 7f2de3e00640 1 -- 172.21.15.32:0/526867191 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2de40f1020 con 0x7f2dec15bad0 2024-03-19T06:21:35.244 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:21:35.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.252+0000 7f2df1600640 1 -- 172.21.15.32:0/526867191 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2dcc067660 msgr2=0x7f2dcc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.252+0000 7f2df1600640 1 --2- 172.21.15.32:0/526867191 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2dcc067660 0x7f2dcc069b20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0b4fe0 tx=0x7f2ddc009190 comp rx=0 tx=0).stop 2024-03-19T06:21:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.252+0000 7f2df1600640 1 -- 172.21.15.32:0/526867191 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dec15bad0 msgr2=0x7f2dec154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.252+0000 7f2df1600640 1 --2- 172.21.15.32:0/526867191 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dec15bad0 0x7f2dec154b70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2de40b0040 tx=0x7f2de4019600 comp rx=0 tx=0).stop 2024-03-19T06:21:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.252+0000 7f2df1600640 1 -- 172.21.15.32:0/526867191 shutdown_connections 2024-03-19T06:21:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.252+0000 7f2df1600640 1 --2- 172.21.15.32:0/526867191 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2dcc067660 0x7f2dcc069b20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.252+0000 7f2df1600640 1 --2- 172.21.15.32:0/526867191 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2dec15bad0 0x7f2dec154b70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.252+0000 7f2df1600640 1 --2- 172.21.15.32:0/526867191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2dec0b0f40 0x7f2dec14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.252+0000 7f2df1600640 1 --2- 172.21.15.32:0/526867191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2dec06b450 0x7f2dec0b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.252+0000 7f2df1600640 1 -- 172.21.15.32:0/526867191 >> 172.21.15.32:0/526867191 conn(0x7f2dec0b58e0 msgr2=0x7f2dec0ad360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.252+0000 7f2df1600640 1 -- 172.21.15.32:0/526867191 shutdown_connections 2024-03-19T06:21:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.252+0000 7f2df1600640 1 -- 172.21.15.32:0/526867191 wait complete. 2024-03-19T06:21:35.266 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:21:35.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.416+0000 7f4a4fa00640 1 Processor -- start 2024-03-19T06:21:35.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.416+0000 7f4a4fa00640 1 -- start start 2024-03-19T06:21:35.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.416+0000 7f4a4fa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4a4815dbb0 0x7f4a4806c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.416+0000 7f4a4fa00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4a480b3d30 0x7f4a480cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.416+0000 7f4a4fa00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a480cbf00 con 0x7f4a4806c5a0 2024-03-19T06:21:35.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.420+0000 7f4a4fa00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4806cb20 con 0x7f4a4815dbb0 2024-03-19T06:21:35.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.420+0000 7f4a4fa00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4806ce00 con 0x7f4a480b3d30 2024-03-19T06:21:35.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.420+0000 7f4a4d000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4a4815dbb0 0x7f4a4806c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.420+0000 7f4a47e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4a4806c5a0 0x7f4a480b3620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48238/0 (socket says 172.21.15.32:48238) 2024-03-19T06:21:35.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.420+0000 7f4a47e00640 1 -- 172.21.15.32:0/1429311420 learned_addr learned my addr 172.21.15.32:0/1429311420 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:35.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.420+0000 7f4a4da00640 1 --2- 172.21.15.32:0/1429311420 >> v2:172.21.15.171:3300/0 conn(0x7f4a480b3d30 0x7f4a480cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.420+0000 7f4a47400640 1 -- 172.21.15.32:0/1429311420 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722221053 0 0) 0x7f4a480cbf00 con 0x7f4a4806c5a0 2024-03-19T06:21:35.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.420+0000 7f4a47400640 1 -- 172.21.15.32:0/1429311420 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a30003530 con 0x7f4a4806c5a0 2024-03-19T06:21:35.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.420+0000 7f4a4d000640 1 -- 172.21.15.32:0/1429311420 >> v2:172.21.15.171:3300/0 conn(0x7f4a480b3d30 msgr2=0x7f4a480cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:35.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.420+0000 7f4a4d000640 1 --2- 172.21.15.32:0/1429311420 >> v2:172.21.15.171:3300/0 conn(0x7f4a480b3d30 0x7f4a480cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.420+0000 7f4a4d000640 1 -- 172.21.15.32:0/1429311420 >> v1:172.21.15.32:6789/0 conn(0x7f4a4806c5a0 legacy=0x7f4a480b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.420+0000 7f4a4d000640 1 -- 172.21.15.32:0/1429311420 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4806d0e0 con 0x7f4a4815dbb0 2024-03-19T06:21:35.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.420+0000 7f4a4d000640 1 --2- 172.21.15.32:0/1429311420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a4815dbb0 0x7f4a4806c060 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4a480b7940 tx=0x7f4a3c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b6f9dec6c2b90f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:35.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.420+0000 7f4a47400640 1 -- 172.21.15.32:0/1429311420 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c0b5070 con 0x7f4a4815dbb0 2024-03-19T06:21:35.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a47400640 1 -- 172.21.15.32:0/1429311420 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3c0a8970 con 0x7f4a4815dbb0 2024-03-19T06:21:35.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a47400640 1 -- 172.21.15.32:0/1429311420 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c0a8d40 con 0x7f4a4815dbb0 2024-03-19T06:21:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4fa00640 1 -- 172.21.15.32:0/1429311420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a4815dbb0 msgr2=0x7f4a4806c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4fa00640 1 --2- 172.21.15.32:0/1429311420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a4815dbb0 0x7f4a4806c060 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4a480b7940 tx=0x7f4a3c01ec70 comp rx=0 tx=0).stop 2024-03-19T06:21:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4fa00640 1 -- 172.21.15.32:0/1429311420 shutdown_connections 2024-03-19T06:21:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4fa00640 1 --2- 172.21.15.32:0/1429311420 >> v2:172.21.15.171:3300/0 conn(0x7f4a480b3d30 0x7f4a480cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4fa00640 1 --2- 172.21.15.32:0/1429311420 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a4815dbb0 0x7f4a4806c060 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4fa00640 1 -- 172.21.15.32:0/1429311420 >> 172.21.15.32:0/1429311420 conn(0x7f4a48066ca0 msgr2=0x7f4a480670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4fa00640 1 -- 172.21.15.32:0/1429311420 shutdown_connections 2024-03-19T06:21:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4fa00640 1 -- 172.21.15.32:0/1429311420 wait complete. 2024-03-19T06:21:35.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4fa00640 1 Processor -- start 2024-03-19T06:21:35.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4fa00640 1 -- start start 2024-03-19T06:21:35.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4fa00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a4806c5a0 0x7f4a4814c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4fa00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a480b3d30 0x7f4a480c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4fa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a4815dbb0 0x7f4a4815f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4fa00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4815df90 con 0x7f4a4815dbb0 2024-03-19T06:21:35.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4fa00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4806d910 con 0x7f4a480b3d30 2024-03-19T06:21:35.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4fa00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a480ccc00 con 0x7f4a4806c5a0 2024-03-19T06:21:35.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4da00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a4815dbb0 0x7f4a4815f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4da00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a4815dbb0 0x7f4a4815f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60572/0 (socket says 172.21.15.32:60572) 2024-03-19T06:21:35.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4da00640 1 -- 172.21.15.32:0/3205137654 learned_addr learned my addr 172.21.15.32:0/3205137654 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:35.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a4d000640 1 --2- 172.21.15.32:0/3205137654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a4806c5a0 0x7f4a4814c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.424+0000 7f4a47e00640 1 --2- 172.21.15.32:0/3205137654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a480b3d30 0x7f4a480c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.428+0000 7f4a4da00640 1 -- 172.21.15.32:0/3205137654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a4806c5a0 msgr2=0x7f4a4814c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.428+0000 7f4a4da00640 1 --2- 172.21.15.32:0/3205137654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a4806c5a0 0x7f4a4814c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.428+0000 7f4a4da00640 1 -- 172.21.15.32:0/3205137654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a480b3d30 msgr2=0x7f4a480c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.428+0000 7f4a4da00640 1 --2- 172.21.15.32:0/3205137654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a480b3d30 0x7f4a480c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.428+0000 7f4a4da00640 1 -- 172.21.15.32:0/3205137654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a480b5360 con 0x7f4a4815dbb0 2024-03-19T06:21:35.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.428+0000 7f4a4da00640 1 --2- 172.21.15.32:0/3205137654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a4815dbb0 0x7f4a4815f6d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4a40009dd0 tx=0x7f4a4000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:35.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.428+0000 7f4a44c00640 1 -- 172.21.15.32:0/3205137654 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40018020 con 0x7f4a4815dbb0 2024-03-19T06:21:35.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.428+0000 7f4a44c00640 1 -- 172.21.15.32:0/3205137654 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a40014480 con 0x7f4a4815dbb0 2024-03-19T06:21:35.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.428+0000 7f4a44c00640 1 -- 172.21.15.32:0/3205137654 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40014870 con 0x7f4a4815dbb0 2024-03-19T06:21:35.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.428+0000 7f4a4fa00640 1 -- 172.21.15.32:0/3205137654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a480b5d80 con 0x7f4a4815dbb0 2024-03-19T06:21:35.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.428+0000 7f4a4fa00640 1 -- 172.21.15.32:0/3205137654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a480b6340 con 0x7f4a4815dbb0 2024-03-19T06:21:35.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.428+0000 7f4a4fa00640 1 -- 172.21.15.32:0/3205137654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a480749e0 con 0x7f4a4815dbb0 2024-03-19T06:21:35.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.428+0000 7f4a44c00640 1 -- 172.21.15.32:0/3205137654 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f4a4001b020 con 0x7f4a4815dbb0 2024-03-19T06:21:35.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.428+0000 7f4a44c00640 1 --2- 172.21.15.32:0/3205137654 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4a28067660 0x7f4a28069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.428+0000 7f4a44c00640 1 -- 172.21.15.32:0/3205137654 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a400865d0 con 0x7f4a4815dbb0 2024-03-19T06:21:35.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.428+0000 7f4a4d000640 1 --2- 172.21.15.32:0/3205137654 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4a28067660 0x7f4a28069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.432+0000 7f4a4d000640 1 --2- 172.21.15.32:0/3205137654 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4a28067660 0x7f4a28069b20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0b2000 tx=0x7f4a3c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:35.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.432+0000 7f4a44c00640 1 -- 172.21.15.32:0/3205137654 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f4a40022030 con 0x7f4a4815dbb0 2024-03-19T06:21:35.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.596+0000 7f4a4fa00640 1 -- 172.21.15.32:0/3205137654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a480cee70 con 0x7f4a4815dbb0 2024-03-19T06:21:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.600+0000 7f4a44c00640 1 -- 172.21.15.32:0/3205137654 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a40010040 con 0x7f4a4815dbb0 2024-03-19T06:21:35.591 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:21:35.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.600+0000 7f4a4fa00640 1 -- 172.21.15.32:0/3205137654 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4a28067660 msgr2=0x7f4a28069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.600+0000 7f4a4fa00640 1 --2- 172.21.15.32:0/3205137654 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4a28067660 0x7f4a28069b20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0b2000 tx=0x7f4a3c008040 comp rx=0 tx=0).stop 2024-03-19T06:21:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.600+0000 7f4a4fa00640 1 -- 172.21.15.32:0/3205137654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a4815dbb0 msgr2=0x7f4a4815f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.600+0000 7f4a4fa00640 1 --2- 172.21.15.32:0/3205137654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a4815dbb0 0x7f4a4815f6d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4a40009dd0 tx=0x7f4a4000c490 comp rx=0 tx=0).stop 2024-03-19T06:21:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.600+0000 7f4a4fa00640 1 -- 172.21.15.32:0/3205137654 shutdown_connections 2024-03-19T06:21:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.600+0000 7f4a4fa00640 1 --2- 172.21.15.32:0/3205137654 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4a28067660 0x7f4a28069b20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.600+0000 7f4a4fa00640 1 --2- 172.21.15.32:0/3205137654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a4815dbb0 0x7f4a4815f6d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.600+0000 7f4a4fa00640 1 --2- 172.21.15.32:0/3205137654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a480b3d30 0x7f4a480c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.600+0000 7f4a4fa00640 1 --2- 172.21.15.32:0/3205137654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a4806c5a0 0x7f4a4814c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.600+0000 7f4a4fa00640 1 -- 172.21.15.32:0/3205137654 >> 172.21.15.32:0/3205137654 conn(0x7f4a48066ca0 msgr2=0x7f4a48067080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.600+0000 7f4a4fa00640 1 -- 172.21.15.32:0/3205137654 shutdown_connections 2024-03-19T06:21:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.600+0000 7f4a4fa00640 1 -- 172.21.15.32:0/3205137654 wait complete. 2024-03-19T06:21:35.613 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:35.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.760+0000 7f60f8800640 1 Processor -- start 2024-03-19T06:21:35.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.760+0000 7f60f8800640 1 -- start start 2024-03-19T06:21:35.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.760+0000 7f60f8800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f60f0099a70 0x7f60f0099e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.760+0000 7f60f8800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f00cfe20 con 0x7f60f00b0bc0 2024-03-19T06:21:35.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.760+0000 7f60f8800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f00cc5c0 con 0x7f60f006f620 2024-03-19T06:21:35.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.760+0000 7f60f8800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f009a390 con 0x7f60f0099a70 2024-03-19T06:21:35.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.760+0000 7f60f6800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f60f00b0bc0 0x7f60f00cd340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48252/0 (socket says 172.21.15.32:48252) 2024-03-19T06:21:35.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.760+0000 7f60f6800640 1 -- 172.21.15.32:0/1611303245 learned_addr learned my addr 172.21.15.32:0/1611303245 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:35.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.760+0000 7f60f5e00640 1 --2- 172.21.15.32:0/1611303245 >> v2:172.21.15.171:3300/0 conn(0x7f60f0099a70 0x7f60f0099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.764+0000 7f60f4a00640 1 -- 172.21.15.32:0/1611303245 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929903073 0 0) 0x7f60f00cfe20 con 0x7f60f00b0bc0 2024-03-19T06:21:35.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.764+0000 7f60f4a00640 1 -- 172.21.15.32:0/1611303245 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60d8003530 con 0x7f60f00b0bc0 2024-03-19T06:21:35.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.764+0000 7f60f4a00640 1 -- 172.21.15.32:0/1611303245 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232452060 0 0) 0x7f60f00cc5c0 con 0x7f60f006f620 2024-03-19T06:21:35.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.764+0000 7f60f4a00640 1 -- 172.21.15.32:0/1611303245 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f00cfe20 con 0x7f60f006f620 2024-03-19T06:21:35.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.764+0000 7f60f5e00640 1 -- 172.21.15.32:0/1611303245 >> v1:172.21.15.171:6789/0 conn(0x7f60f006f620 legacy=0x7f60f00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.764+0000 7f60f5e00640 1 -- 172.21.15.32:0/1611303245 >> v1:172.21.15.32:6789/0 conn(0x7f60f00b0bc0 legacy=0x7f60f00cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.764+0000 7f60f5e00640 1 -- 172.21.15.32:0/1611303245 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f00cc860 con 0x7f60f0099a70 2024-03-19T06:21:35.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.764+0000 7f60f5e00640 1 --2- 172.21.15.32:0/1611303245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60f0099a70 0x7f60f0099e50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f60e40097c0 tx=0x7f60e401c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dde6737891b7c015 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:35.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.764+0000 7f60f4a00640 1 -- 172.21.15.32:0/1611303245 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e40b0070 con 0x7f60f0099a70 2024-03-19T06:21:35.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.764+0000 7f60f4a00640 1 -- 172.21.15.32:0/1611303245 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e40ab600 con 0x7f60f0099a70 2024-03-19T06:21:35.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.764+0000 7f60f4a00640 1 -- 172.21.15.32:0/1611303245 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e40ab9d0 con 0x7f60f0099a70 2024-03-19T06:21:35.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f8800640 1 -- 172.21.15.32:0/1611303245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60f0099a70 msgr2=0x7f60f0099e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f8800640 1 --2- 172.21.15.32:0/1611303245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60f0099a70 0x7f60f0099e50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f60e40097c0 tx=0x7f60e401c380 comp rx=0 tx=0).stop 2024-03-19T06:21:35.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f8800640 1 -- 172.21.15.32:0/1611303245 shutdown_connections 2024-03-19T06:21:35.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f8800640 1 --2- 172.21.15.32:0/1611303245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60f0099a70 0x7f60f0099e50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f8800640 1 -- 172.21.15.32:0/1611303245 >> 172.21.15.32:0/1611303245 conn(0x7f60f00b3300 msgr2=0x7f60f00b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:35.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f8800640 1 -- 172.21.15.32:0/1611303245 shutdown_connections 2024-03-19T06:21:35.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f8800640 1 -- 172.21.15.32:0/1611303245 wait complete. 2024-03-19T06:21:35.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f8800640 1 Processor -- start 2024-03-19T06:21:35.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f8800640 1 -- start start 2024-03-19T06:21:35.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f8800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60f006f620 0x7f60f014f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f8800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60f0099a70 0x7f60f00caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f8800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60f00b0bc0 0x7f60f01f8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f8800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f0070a10 con 0x7f60f00b0bc0 2024-03-19T06:21:35.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f8800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f0070890 con 0x7f60f006f620 2024-03-19T06:21:35.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f8800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f016a660 con 0x7f60f0099a70 2024-03-19T06:21:35.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f6800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60f00b0bc0 0x7f60f01f8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f6800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60f00b0bc0 0x7f60f01f8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60574/0 (socket says 172.21.15.32:60574) 2024-03-19T06:21:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f6800640 1 -- 172.21.15.32:0/125618407 learned_addr learned my addr 172.21.15.32:0/125618407 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f5e00640 1 --2- 172.21.15.32:0/125618407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60f006f620 0x7f60f014f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f5400640 1 --2- 172.21.15.32:0/125618407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60f0099a70 0x7f60f00caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f6800640 1 -- 172.21.15.32:0/125618407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60f0099a70 msgr2=0x7f60f00caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f6800640 1 --2- 172.21.15.32:0/125618407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60f0099a70 0x7f60f00caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f6800640 1 -- 172.21.15.32:0/125618407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60f006f620 msgr2=0x7f60f014f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f6800640 1 --2- 172.21.15.32:0/125618407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60f006f620 0x7f60f014f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f6800640 1 -- 172.21.15.32:0/125618407 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f00cb0e0 con 0x7f60f00b0bc0 2024-03-19T06:21:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.768+0000 7f60f5400640 1 --2- 172.21.15.32:0/125618407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60f0099a70 0x7f60f00caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.772+0000 7f60f6800640 1 --2- 172.21.15.32:0/125618407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60f00b0bc0 0x7f60f01f8290 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00cbf0 tx=0x7f60ec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.772+0000 7f60ea000640 1 -- 172.21.15.32:0/125618407 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec017070 con 0x7f60f00b0bc0 2024-03-19T06:21:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.772+0000 7f60ea000640 1 -- 172.21.15.32:0/125618407 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec00acf0 con 0x7f60f00b0bc0 2024-03-19T06:21:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.772+0000 7f60f8800640 1 -- 172.21.15.32:0/125618407 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f0154960 con 0x7f60f00b0bc0 2024-03-19T06:21:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.772+0000 7f60ea000640 1 -- 172.21.15.32:0/125618407 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec012600 con 0x7f60f00b0bc0 2024-03-19T06:21:35.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.772+0000 7f60f8800640 1 -- 172.21.15.32:0/125618407 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f0154f20 con 0x7f60f00b0bc0 2024-03-19T06:21:35.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.772+0000 7f60f8800640 1 -- 172.21.15.32:0/125618407 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f00749e0 con 0x7f60f00b0bc0 2024-03-19T06:21:35.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.772+0000 7f60ea000640 1 -- 172.21.15.32:0/125618407 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f60ec01a070 con 0x7f60f00b0bc0 2024-03-19T06:21:35.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.772+0000 7f60ea000640 1 --2- 172.21.15.32:0/125618407 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f60d4067660 0x7f60d4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:35.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.772+0000 7f60ea000640 1 -- 172.21.15.32:0/125618407 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60ec085680 con 0x7f60f00b0bc0 2024-03-19T06:21:35.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.772+0000 7f60f5e00640 1 --2- 172.21.15.32:0/125618407 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f60d4067660 0x7f60d4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:35.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.776+0000 7f60f5e00640 1 --2- 172.21.15.32:0/125618407 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f60d4067660 0x7f60d4069b20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f60e40ad000 tx=0x7f60e4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:35.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.776+0000 7f60ea000640 1 -- 172.21.15.32:0/125618407 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f60ec055c10 con 0x7f60f00b0bc0 2024-03-19T06:21:35.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.940+0000 7f60f8800640 1 -- 172.21.15.32:0/125618407 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60f00c8170 con 0x7f60f00b0bc0 2024-03-19T06:21:35.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.940+0000 7f60ea000640 1 -- 172.21.15.32:0/125618407 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f60ec059cb0 con 0x7f60f00b0bc0 2024-03-19T06:21:35.934 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:35.934 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:10.423479+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:35.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.944+0000 7f60f8800640 1 -- 172.21.15.32:0/125618407 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f60d4067660 msgr2=0x7f60d4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.944+0000 7f60f8800640 1 --2- 172.21.15.32:0/125618407 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f60d4067660 0x7f60d4069b20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f60e40ad000 tx=0x7f60e4008040 comp rx=0 tx=0).stop 2024-03-19T06:21:35.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.944+0000 7f60f8800640 1 -- 172.21.15.32:0/125618407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60f00b0bc0 msgr2=0x7f60f01f8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:35.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.944+0000 7f60f8800640 1 --2- 172.21.15.32:0/125618407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60f00b0bc0 0x7f60f01f8290 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00cbf0 tx=0x7f60ec00a430 comp rx=0 tx=0).stop 2024-03-19T06:21:35.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.944+0000 7f60f8800640 1 -- 172.21.15.32:0/125618407 shutdown_connections 2024-03-19T06:21:35.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.944+0000 7f60f8800640 1 --2- 172.21.15.32:0/125618407 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f60d4067660 0x7f60d4069b20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.944+0000 7f60f8800640 1 --2- 172.21.15.32:0/125618407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60f00b0bc0 0x7f60f01f8290 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.944+0000 7f60f8800640 1 --2- 172.21.15.32:0/125618407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60f0099a70 0x7f60f00caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.944+0000 7f60f8800640 1 --2- 172.21.15.32:0/125618407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60f006f620 0x7f60f014f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:35.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.944+0000 7f60f8800640 1 -- 172.21.15.32:0/125618407 >> 172.21.15.32:0/125618407 conn(0x7f60f00b3300 msgr2=0x7f60f015b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:35.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.944+0000 7f60f8800640 1 -- 172.21.15.32:0/125618407 shutdown_connections 2024-03-19T06:21:35.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:35.944+0000 7f60f8800640 1 -- 172.21.15.32:0/125618407 wait complete. 2024-03-19T06:21:35.955 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:21:07.089673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:21:07.801319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:35.955 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:36.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.108+0000 7f4d5c200640 1 Processor -- start 2024-03-19T06:21:36.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.108+0000 7f4d5c200640 1 -- start start 2024-03-19T06:21:36.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.108+0000 7f4d5c200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4d5406eed0 0x7f4d540ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.108+0000 7f4d5c200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4d5406e320 0x7f4d5415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.108+0000 7f4d5c200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d540cc290 con 0x7f4d5406ad40 2024-03-19T06:21:36.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.108+0000 7f4d5c200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5406dbb0 con 0x7f4d5406e320 2024-03-19T06:21:36.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.108+0000 7f4d5c200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d540cc570 con 0x7f4d5406eed0 2024-03-19T06:21:36.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.108+0000 7f4d5a200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4d5406e320 0x7f4d5415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.108+0000 7f4d5a200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4d5406e320 0x7f4d5415bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60582/0 (socket says 172.21.15.32:60582) 2024-03-19T06:21:36.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.108+0000 7f4d5a200640 1 -- 172.21.15.32:0/2446127246 learned_addr learned my addr 172.21.15.32:0/2446127246 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:36.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.108+0000 7f4d58e00640 1 --2- 172.21.15.32:0/2446127246 >> v2:172.21.15.171:3300/0 conn(0x7f4d5406eed0 0x7f4d540ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.108+0000 7f4d5a200640 1 -- 172.21.15.32:0/2446127246 >> v2:172.21.15.171:3300/0 conn(0x7f4d5406eed0 msgr2=0x7f4d540ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:36.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.108+0000 7f4d5a200640 1 --2- 172.21.15.32:0/2446127246 >> v2:172.21.15.171:3300/0 conn(0x7f4d5406eed0 0x7f4d540ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.108+0000 7f4d5a200640 1 -- 172.21.15.32:0/2446127246 >> v1:172.21.15.171:6789/0 conn(0x7f4d5406ad40 legacy=0x7f4d5406b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.108+0000 7f4d5a200640 1 -- 172.21.15.32:0/2446127246 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540cc850 con 0x7f4d5406e320 2024-03-19T06:21:36.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.112+0000 7f4d5a200640 1 --2- 172.21.15.32:0/2446127246 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d5406e320 0x7f4d5415bc50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4d5406bab0 tx=0x7f4d4c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bc57a8754ee2e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:36.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.112+0000 7f4d53e00640 1 -- 172.21.15.32:0/2446127246 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c0a57d0 con 0x7f4d5406e320 2024-03-19T06:21:36.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.112+0000 7f4d53e00640 1 -- 172.21.15.32:0/2446127246 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5415c9a0 con 0x7f4d5406e320 2024-03-19T06:21:36.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.112+0000 7f4d53e00640 1 -- 172.21.15.32:0/2446127246 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c0a5b90 con 0x7f4d5406e320 2024-03-19T06:21:36.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.112+0000 7f4d5c200640 1 -- 172.21.15.32:0/2446127246 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d5406e320 msgr2=0x7f4d5415bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.112+0000 7f4d5c200640 1 --2- 172.21.15.32:0/2446127246 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d5406e320 0x7f4d5415bc50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4d5406bab0 tx=0x7f4d4c01c8f0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.112+0000 7f4d5c200640 1 -- 172.21.15.32:0/2446127246 shutdown_connections 2024-03-19T06:21:36.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.112+0000 7f4d5c200640 1 --2- 172.21.15.32:0/2446127246 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d5406e320 0x7f4d5415bc50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.112+0000 7f4d5c200640 1 --2- 172.21.15.32:0/2446127246 >> v2:172.21.15.171:3300/0 conn(0x7f4d5406eed0 0x7f4d540ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.112+0000 7f4d5c200640 1 -- 172.21.15.32:0/2446127246 >> 172.21.15.32:0/2446127246 conn(0x7f4d540b1590 msgr2=0x7f4d540b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:36.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.112+0000 7f4d5c200640 1 -- 172.21.15.32:0/2446127246 shutdown_connections 2024-03-19T06:21:36.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.112+0000 7f4d5c200640 1 -- 172.21.15.32:0/2446127246 wait complete. 2024-03-19T06:21:36.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d5c200640 1 Processor -- start 2024-03-19T06:21:36.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d5c200640 1 -- start start 2024-03-19T06:21:36.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d5c200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d5406ad40 0x7f4d54149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d5c200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d5406e320 0x7f4d54148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d5c200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5406eed0 0x7f4d540b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d5c200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d541688a0 con 0x7f4d5406e320 2024-03-19T06:21:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d5c200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d54168720 con 0x7f4d5406ad40 2024-03-19T06:21:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d5c200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d54168a20 con 0x7f4d5406eed0 2024-03-19T06:21:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d58e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d5406e320 0x7f4d54148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d58e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d5406e320 0x7f4d54148c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60588/0 (socket says 172.21.15.32:60588) 2024-03-19T06:21:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d58e00640 1 -- 172.21.15.32:0/3179751127 learned_addr learned my addr 172.21.15.32:0/3179751127 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d59800640 1 --2- 172.21.15.32:0/3179751127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d5406ad40 0x7f4d54149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d5a200640 1 --2- 172.21.15.32:0/3179751127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5406eed0 0x7f4d540b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d58e00640 1 -- 172.21.15.32:0/3179751127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5406eed0 msgr2=0x7f4d540b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d58e00640 1 --2- 172.21.15.32:0/3179751127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5406eed0 0x7f4d540b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d58e00640 1 -- 172.21.15.32:0/3179751127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d5406ad40 msgr2=0x7f4d54149820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d58e00640 1 --2- 172.21.15.32:0/3179751127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d5406ad40 0x7f4d54149820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d58e00640 1 -- 172.21.15.32:0/3179751127 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d54150b00 con 0x7f4d5406e320 2024-03-19T06:21:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d5a200640 1 --2- 172.21.15.32:0/3179751127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5406eed0 0x7f4d540b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:36.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d58e00640 1 --2- 172.21.15.32:0/3179751127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d5406e320 0x7f4d54148c00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000d5f0 tx=0x7f4d4000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:36.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d51600640 1 -- 172.21.15.32:0/3179751127 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d400125f0 con 0x7f4d5406e320 2024-03-19T06:21:36.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d51600640 1 -- 172.21.15.32:0/3179751127 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d40019070 con 0x7f4d5406e320 2024-03-19T06:21:36.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d51600640 1 -- 172.21.15.32:0/3179751127 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d400129d0 con 0x7f4d5406e320 2024-03-19T06:21:36.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d5c200640 1 -- 172.21.15.32:0/3179751127 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d54150de0 con 0x7f4d5406e320 2024-03-19T06:21:36.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d5c200640 1 -- 172.21.15.32:0/3179751127 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d541513a0 con 0x7f4d5406e320 2024-03-19T06:21:36.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.116+0000 7f4d5c200640 1 -- 172.21.15.32:0/3179751127 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d54156230 con 0x7f4d5406e320 2024-03-19T06:21:36.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.120+0000 7f4d51600640 1 -- 172.21.15.32:0/3179751127 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f4d40012b70 con 0x7f4d5406e320 2024-03-19T06:21:36.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.120+0000 7f4d51600640 1 --2- 172.21.15.32:0/3179751127 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4d34067660 0x7f4d34069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.120+0000 7f4d51600640 1 -- 172.21.15.32:0/3179751127 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d40085bf0 con 0x7f4d5406e320 2024-03-19T06:21:36.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.120+0000 7f4d59800640 1 --2- 172.21.15.32:0/3179751127 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4d34067660 0x7f4d34069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.120+0000 7f4d59800640 1 --2- 172.21.15.32:0/3179751127 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4d34067660 0x7f4d34069b20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4d540d0640 tx=0x7f4d48007e40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:36.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.124+0000 7f4d51600640 1 -- 172.21.15.32:0/3179751127 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f4d40056900 con 0x7f4d5406e320 2024-03-19T06:21:36.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.292+0000 7f4d5c200640 1 -- 172.21.15.32:0/3179751127 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d5406c510 con 0x7f4d5406e320 2024-03-19T06:21:36.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.292+0000 7f4d51600640 1 -- 172.21.15.32:0/3179751127 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d40056200 con 0x7f4d5406e320 2024-03-19T06:21:36.284 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:36.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.292+0000 7f4d5c200640 1 -- 172.21.15.32:0/3179751127 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4d34067660 msgr2=0x7f4d34069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.292+0000 7f4d5c200640 1 --2- 172.21.15.32:0/3179751127 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4d34067660 0x7f4d34069b20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4d540d0640 tx=0x7f4d48007e40 comp rx=0 tx=0).stop 2024-03-19T06:21:36.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.292+0000 7f4d5c200640 1 -- 172.21.15.32:0/3179751127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d5406e320 msgr2=0x7f4d54148c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.292+0000 7f4d5c200640 1 --2- 172.21.15.32:0/3179751127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d5406e320 0x7f4d54148c00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000d5f0 tx=0x7f4d4000dab0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.292+0000 7f4d5c200640 1 -- 172.21.15.32:0/3179751127 shutdown_connections 2024-03-19T06:21:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.292+0000 7f4d5c200640 1 --2- 172.21.15.32:0/3179751127 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4d34067660 0x7f4d34069b20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.292+0000 7f4d5c200640 1 --2- 172.21.15.32:0/3179751127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5406eed0 0x7f4d540b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.292+0000 7f4d5c200640 1 --2- 172.21.15.32:0/3179751127 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d5406e320 0x7f4d54148c00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.292+0000 7f4d5c200640 1 --2- 172.21.15.32:0/3179751127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d5406ad40 0x7f4d54149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.292+0000 7f4d5c200640 1 -- 172.21.15.32:0/3179751127 >> 172.21.15.32:0/3179751127 conn(0x7f4d540b1590 msgr2=0x7f4d54156550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.292+0000 7f4d5c200640 1 -- 172.21.15.32:0/3179751127 shutdown_connections 2024-03-19T06:21:36.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.292+0000 7f4d5c200640 1 -- 172.21.15.32:0/3179751127 wait complete. 2024-03-19T06:21:36.303 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:21:36.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.452+0000 7f1b71a00640 1 Processor -- start 2024-03-19T06:21:36.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.452+0000 7f1b71a00640 1 -- start start 2024-03-19T06:21:36.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.456+0000 7f1b71a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b6c06e320 0x7f1b6c15bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.456+0000 7f1b71a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6c0cc290 con 0x7f1b6c06ad40 2024-03-19T06:21:36.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.456+0000 7f1b71a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6c0cc570 con 0x7f1b6c06eed0 2024-03-19T06:21:36.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.456+0000 7f1b71a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c0cd420 con 0x7f1b6c06e320 2024-03-19T06:21:36.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.456+0000 7f1b6aa00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1b6c06ad40 0x7f1b6c06b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48260/0 (socket says 172.21.15.32:48260) 2024-03-19T06:21:36.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.456+0000 7f1b6aa00640 1 -- 172.21.15.32:0/602326364 learned_addr learned my addr 172.21.15.32:0/602326364 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:36.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.456+0000 7f1b6b400640 1 --2- 172.21.15.32:0/602326364 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b6c06e320 0x7f1b6c15bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.456+0000 7f1b6a000640 1 -- 172.21.15.32:0/602326364 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219978210 0 0) 0x7f1b6c0cc290 con 0x7f1b6c06ad40 2024-03-19T06:21:36.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.456+0000 7f1b6a000640 1 -- 172.21.15.32:0/602326364 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b50003530 con 0x7f1b6c06ad40 2024-03-19T06:21:36.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.456+0000 7f1b6a000640 1 -- 172.21.15.32:0/602326364 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367308844 0 0) 0x7f1b6c0cc570 con 0x7f1b6c06eed0 2024-03-19T06:21:36.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.456+0000 7f1b6a000640 1 -- 172.21.15.32:0/602326364 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b6c0cc290 con 0x7f1b6c06eed0 2024-03-19T06:21:36.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.456+0000 7f1b6b400640 1 -- 172.21.15.32:0/602326364 >> v1:172.21.15.171:6789/0 conn(0x7f1b6c06eed0 legacy=0x7f1b6c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.456+0000 7f1b6b400640 1 -- 172.21.15.32:0/602326364 >> v1:172.21.15.32:6789/0 conn(0x7f1b6c06ad40 legacy=0x7f1b6c06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.456+0000 7f1b6b400640 1 -- 172.21.15.32:0/602326364 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c0cc850 con 0x7f1b6c06e320 2024-03-19T06:21:36.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.460+0000 7f1b6b400640 1 --2- 172.21.15.32:0/602326364 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b6c06e320 0x7f1b6c15bc50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009dc0 tx=0x7f1b6401c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1f01ad2ad242ba5 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:36.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.460+0000 7f1b6a000640 1 -- 172.21.15.32:0/602326364 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b640b2070 con 0x7f1b6c06e320 2024-03-19T06:21:36.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.460+0000 7f1b6a000640 1 -- 172.21.15.32:0/602326364 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c15c9a0 con 0x7f1b6c06e320 2024-03-19T06:21:36.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.460+0000 7f1b6a000640 1 -- 172.21.15.32:0/602326364 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b640a5af0 con 0x7f1b6c06e320 2024-03-19T06:21:36.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.460+0000 7f1b71a00640 1 -- 172.21.15.32:0/602326364 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b6c06e320 msgr2=0x7f1b6c15bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.460+0000 7f1b71a00640 1 --2- 172.21.15.32:0/602326364 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b6c06e320 0x7f1b6c15bc50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009dc0 tx=0x7f1b6401c900 comp rx=0 tx=0).stop 2024-03-19T06:21:36.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.460+0000 7f1b71a00640 1 -- 172.21.15.32:0/602326364 shutdown_connections 2024-03-19T06:21:36.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.460+0000 7f1b71a00640 1 --2- 172.21.15.32:0/602326364 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b6c06e320 0x7f1b6c15bc50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.460+0000 7f1b71a00640 1 -- 172.21.15.32:0/602326364 >> 172.21.15.32:0/602326364 conn(0x7f1b6c0b1590 msgr2=0x7f1b6c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:36.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.460+0000 7f1b71a00640 1 -- 172.21.15.32:0/602326364 shutdown_connections 2024-03-19T06:21:36.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.460+0000 7f1b71a00640 1 -- 172.21.15.32:0/602326364 wait complete. 2024-03-19T06:21:36.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.460+0000 7f1b71a00640 1 Processor -- start 2024-03-19T06:21:36.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.460+0000 7f1b71a00640 1 -- start start 2024-03-19T06:21:36.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b71a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b6c06ad40 0x7f1b6c0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b71a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b6c06e320 0x7f1b6c0ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b71a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b6c06eed0 0x7f1b6c0ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b71a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c1698b0 con 0x7f1b6c06ad40 2024-03-19T06:21:36.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b71a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c169730 con 0x7f1b6c06e320 2024-03-19T06:21:36.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b71a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c169a30 con 0x7f1b6c06eed0 2024-03-19T06:21:36.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b6aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b6c06ad40 0x7f1b6c0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b6aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b6c06ad40 0x7f1b6c0b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60598/0 (socket says 172.21.15.32:60598) 2024-03-19T06:21:36.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b6aa00640 1 -- 172.21.15.32:0/1248069269 learned_addr learned my addr 172.21.15.32:0/1248069269 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:36.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b62000640 1 --2- 172.21.15.32:0/1248069269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b6c06e320 0x7f1b6c0ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b6b400640 1 --2- 172.21.15.32:0/1248069269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b6c06eed0 0x7f1b6c0ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b6aa00640 1 -- 172.21.15.32:0/1248069269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b6c06eed0 msgr2=0x7f1b6c0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b6aa00640 1 --2- 172.21.15.32:0/1248069269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b6c06eed0 0x7f1b6c0ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b6aa00640 1 -- 172.21.15.32:0/1248069269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b6c06e320 msgr2=0x7f1b6c0ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b6aa00640 1 --2- 172.21.15.32:0/1248069269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b6c06e320 0x7f1b6c0ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b6aa00640 1 -- 172.21.15.32:0/1248069269 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c0ac8e0 con 0x7f1b6c06ad40 2024-03-19T06:21:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b62000640 1 --2- 172.21.15.32:0/1248069269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b6c06e320 0x7f1b6c0ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b6aa00640 1 --2- 172.21.15.32:0/1248069269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b6c06ad40 0x7f1b6c0b3dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00c420 tx=0x7f1b5c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b63400640 1 -- 172.21.15.32:0/1248069269 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c017070 con 0x7f1b6c06ad40 2024-03-19T06:21:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b63400640 1 -- 172.21.15.32:0/1248069269 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c005cf0 con 0x7f1b6c06ad40 2024-03-19T06:21:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b71a00640 1 -- 172.21.15.32:0/1248069269 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6c0acb80 con 0x7f1b6c06ad40 2024-03-19T06:21:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b63400640 1 -- 172.21.15.32:0/1248069269 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c007310 con 0x7f1b6c06ad40 2024-03-19T06:21:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b71a00640 1 -- 172.21.15.32:0/1248069269 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6c0b35d0 con 0x7f1b6c06ad40 2024-03-19T06:21:36.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b71a00640 1 -- 172.21.15.32:0/1248069269 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6c1517a0 con 0x7f1b6c06ad40 2024-03-19T06:21:36.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.464+0000 7f1b63400640 1 -- 172.21.15.32:0/1248069269 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1b5c01a070 con 0x7f1b6c06ad40 2024-03-19T06:21:36.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.468+0000 7f1b63400640 1 --2- 172.21.15.32:0/1248069269 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1b48067690 0x7f1b48069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.468+0000 7f1b63400640 1 -- 172.21.15.32:0/1248069269 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b5c084c60 con 0x7f1b6c06ad40 2024-03-19T06:21:36.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.468+0000 7f1b62000640 1 --2- 172.21.15.32:0/1248069269 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1b48067690 0x7f1b48069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.468+0000 7f1b62000640 1 --2- 172.21.15.32:0/1248069269 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1b48067690 0x7f1b48069b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c071d10 tx=0x7f1b54009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:36.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.472+0000 7f1b63400640 1 -- 172.21.15.32:0/1248069269 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f1b5c0558d0 con 0x7f1b6c06ad40 2024-03-19T06:21:36.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.632+0000 7f1b71a00640 1 -- 172.21.15.32:0/1248069269 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b6c0b3380 con 0x7f1b6c06ad40 2024-03-19T06:21:36.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.632+0000 7f1b63400640 1 -- 172.21.15.32:0/1248069269 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b5c0551d0 con 0x7f1b6c06ad40 2024-03-19T06:21:36.625 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:21:36.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.636+0000 7f1b71a00640 1 -- 172.21.15.32:0/1248069269 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1b48067690 msgr2=0x7f1b48069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.636+0000 7f1b71a00640 1 --2- 172.21.15.32:0/1248069269 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1b48067690 0x7f1b48069b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c071d10 tx=0x7f1b54009040 comp rx=0 tx=0).stop 2024-03-19T06:21:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.636+0000 7f1b71a00640 1 -- 172.21.15.32:0/1248069269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b6c06ad40 msgr2=0x7f1b6c0b3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.636+0000 7f1b71a00640 1 --2- 172.21.15.32:0/1248069269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b6c06ad40 0x7f1b6c0b3dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00c420 tx=0x7f1b5c00c8e0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.636+0000 7f1b71a00640 1 -- 172.21.15.32:0/1248069269 shutdown_connections 2024-03-19T06:21:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.636+0000 7f1b71a00640 1 --2- 172.21.15.32:0/1248069269 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1b48067690 0x7f1b48069b50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.636+0000 7f1b71a00640 1 --2- 172.21.15.32:0/1248069269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b6c06eed0 0x7f1b6c0ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.636+0000 7f1b71a00640 1 --2- 172.21.15.32:0/1248069269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b6c06e320 0x7f1b6c0ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.636+0000 7f1b71a00640 1 --2- 172.21.15.32:0/1248069269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b6c06ad40 0x7f1b6c0b3dd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.636+0000 7f1b71a00640 1 -- 172.21.15.32:0/1248069269 >> 172.21.15.32:0/1248069269 conn(0x7f1b6c0b1590 msgr2=0x7f1b6c0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.636+0000 7f1b71a00640 1 -- 172.21.15.32:0/1248069269 shutdown_connections 2024-03-19T06:21:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.636+0000 7f1b71a00640 1 -- 172.21.15.32:0/1248069269 wait complete. 2024-03-19T06:21:36.647 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:21:36.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.796+0000 7f45b5c00640 1 Processor -- start 2024-03-19T06:21:36.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.796+0000 7f45b5c00640 1 -- start start 2024-03-19T06:21:36.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.800+0000 7f45b5c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45b015b7d0 0x7f45b00ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.800+0000 7f45b5c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f45b015ca30 0x7f45b006ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.800+0000 7f45b5c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b015bbb0 con 0x7f45b006b280 2024-03-19T06:21:36.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.800+0000 7f45b5c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b00cac50 con 0x7f45b015ca30 2024-03-19T06:21:36.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.800+0000 7f45b5c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b00caf30 con 0x7f45b015b7d0 2024-03-19T06:21:36.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.800+0000 7f45a7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f45b015ca30 0x7f45b006ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.800+0000 7f45b5200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f45b006b280 0x7f45b006e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48276/0 (socket says 172.21.15.32:48276) 2024-03-19T06:21:36.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.800+0000 7f45b5200640 1 -- 172.21.15.32:0/2927346658 learned_addr learned my addr 172.21.15.32:0/2927346658 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:36.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.800+0000 7f45afe00640 1 --2- 172.21.15.32:0/2927346658 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45b015b7d0 0x7f45b00ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.800+0000 7f45a7e00640 1 -- 172.21.15.32:0/2927346658 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45b015b7d0 msgr2=0x7f45b00ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:36.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.800+0000 7f45a7e00640 1 --2- 172.21.15.32:0/2927346658 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45b015b7d0 0x7f45b00ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.800+0000 7f45a7e00640 1 -- 172.21.15.32:0/2927346658 >> v1:172.21.15.32:6789/0 conn(0x7f45b006b280 legacy=0x7f45b006e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.800+0000 7f45a7e00640 1 -- 172.21.15.32:0/2927346658 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b006da80 con 0x7f45b015ca30 2024-03-19T06:21:36.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.800+0000 7f45af400640 1 -- 172.21.15.32:0/2927346658 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083642230 0 0) 0x7f45b015bbb0 con 0x7f45b006b280 2024-03-19T06:21:36.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.804+0000 7f45a7e00640 1 --2- 172.21.15.32:0/2927346658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45b015ca30 0x7f45b006ad40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f45980097c0 tx=0x7f459801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2683adde040986fa server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:36.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.804+0000 7f45af400640 1 -- 172.21.15.32:0/2927346658 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45980a7070 con 0x7f45b015ca30 2024-03-19T06:21:36.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.804+0000 7f45af400640 1 -- 172.21.15.32:0/2927346658 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45980b0070 con 0x7f45b015ca30 2024-03-19T06:21:36.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.804+0000 7f45af400640 1 -- 172.21.15.32:0/2927346658 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45980ab890 con 0x7f45b015ca30 2024-03-19T06:21:36.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.804+0000 7f45b5c00640 1 -- 172.21.15.32:0/2927346658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45b015ca30 msgr2=0x7f45b006ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.804+0000 7f45b5c00640 1 --2- 172.21.15.32:0/2927346658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45b015ca30 0x7f45b006ad40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f45980097c0 tx=0x7f459801c470 comp rx=0 tx=0).stop 2024-03-19T06:21:36.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.804+0000 7f45b5c00640 1 -- 172.21.15.32:0/2927346658 shutdown_connections 2024-03-19T06:21:36.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.804+0000 7f45b5c00640 1 --2- 172.21.15.32:0/2927346658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45b015ca30 0x7f45b006ad40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.804+0000 7f45b5c00640 1 --2- 172.21.15.32:0/2927346658 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45b015b7d0 0x7f45b00ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.804+0000 7f45b5c00640 1 -- 172.21.15.32:0/2927346658 >> 172.21.15.32:0/2927346658 conn(0x7f45b00b17c0 msgr2=0x7f45b00b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:36.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.804+0000 7f45b5c00640 1 -- 172.21.15.32:0/2927346658 shutdown_connections 2024-03-19T06:21:36.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.804+0000 7f45b5c00640 1 -- 172.21.15.32:0/2927346658 wait complete. 2024-03-19T06:21:36.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.804+0000 7f45b5c00640 1 Processor -- start 2024-03-19T06:21:36.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.804+0000 7f45b5c00640 1 -- start start 2024-03-19T06:21:36.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45b5c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45b006b280 0x7f45b00c2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45b5c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45b015b7d0 0x7f45b01658d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45b5c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45b015ca30 0x7f45b0165e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45b5c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b006edf0 con 0x7f45b015b7d0 2024-03-19T06:21:36.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45b5c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b006ec70 con 0x7f45b006b280 2024-03-19T06:21:36.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45b5c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b0168700 con 0x7f45b015ca30 2024-03-19T06:21:36.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45a7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45b015b7d0 0x7f45b01658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45a7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45b015b7d0 0x7f45b01658d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60622/0 (socket says 172.21.15.32:60622) 2024-03-19T06:21:36.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45a7e00640 1 -- 172.21.15.32:0/1716563548 learned_addr learned my addr 172.21.15.32:0/1716563548 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:36.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45afe00640 1 --2- 172.21.15.32:0/1716563548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45b006b280 0x7f45b00c2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45b5200640 1 --2- 172.21.15.32:0/1716563548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45b015ca30 0x7f45b0165e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45a7e00640 1 -- 172.21.15.32:0/1716563548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45b015ca30 msgr2=0x7f45b0165e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45a7e00640 1 --2- 172.21.15.32:0/1716563548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45b015ca30 0x7f45b0165e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45a7e00640 1 -- 172.21.15.32:0/1716563548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45b006b280 msgr2=0x7f45b00c2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45a7e00640 1 --2- 172.21.15.32:0/1716563548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45b006b280 0x7f45b00c2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45a7e00640 1 -- 172.21.15.32:0/1716563548 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b015db60 con 0x7f45b015b7d0 2024-03-19T06:21:36.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45afe00640 1 --2- 172.21.15.32:0/1716563548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45b006b280 0x7f45b00c2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:36.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45a7e00640 1 --2- 172.21.15.32:0/1716563548 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45b015b7d0 0x7f45b01658d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f45980ad040 tx=0x7f459801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:36.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45acc00640 1 -- 172.21.15.32:0/1716563548 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45980bf610 con 0x7f45b015b7d0 2024-03-19T06:21:36.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45acc00640 1 -- 172.21.15.32:0/1716563548 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45980bf7f0 con 0x7f45b015b7d0 2024-03-19T06:21:36.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45acc00640 1 -- 172.21.15.32:0/1716563548 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45980bfbe0 con 0x7f45b015b7d0 2024-03-19T06:21:36.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45b5c00640 1 -- 172.21.15.32:0/1716563548 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b015de40 con 0x7f45b015b7d0 2024-03-19T06:21:36.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45b5c00640 1 -- 172.21.15.32:0/1716563548 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b015e400 con 0x7f45b015b7d0 2024-03-19T06:21:36.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45b5c00640 1 -- 172.21.15.32:0/1716563548 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b0075090 con 0x7f45b015b7d0 2024-03-19T06:21:36.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.808+0000 7f45acc00640 1 -- 172.21.15.32:0/1716563548 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f45980bd020 con 0x7f45b015b7d0 2024-03-19T06:21:36.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.812+0000 7f45acc00640 1 --2- 172.21.15.32:0/1716563548 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f458c067660 0x7f458c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:36.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.812+0000 7f45acc00640 1 -- 172.21.15.32:0/1716563548 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f459811fc20 con 0x7f45b015b7d0 2024-03-19T06:21:36.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.812+0000 7f45afe00640 1 --2- 172.21.15.32:0/1716563548 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f458c067660 0x7f458c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:36.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.812+0000 7f45afe00640 1 --2- 172.21.15.32:0/1716563548 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f458c067660 0x7f458c069b20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f45b00c6770 tx=0x7f45a0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:36.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.816+0000 7f45acc00640 1 -- 172.21.15.32:0/1716563548 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f45980c6030 con 0x7f45b015b7d0 2024-03-19T06:21:36.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.976+0000 7f45b5c00640 1 -- 172.21.15.32:0/1716563548 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45b0150900 con 0x7f45b015b7d0 2024-03-19T06:21:36.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.976+0000 7f45acc00640 1 -- 172.21.15.32:0/1716563548 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4598016090 con 0x7f45b015b7d0 2024-03-19T06:21:36.969 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:21:36.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.980+0000 7f45b5c00640 1 -- 172.21.15.32:0/1716563548 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f458c067660 msgr2=0x7f458c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.980+0000 7f45b5c00640 1 --2- 172.21.15.32:0/1716563548 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f458c067660 0x7f458c069b20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f45b00c6770 tx=0x7f45a0008040 comp rx=0 tx=0).stop 2024-03-19T06:21:36.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.980+0000 7f45b5c00640 1 -- 172.21.15.32:0/1716563548 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45b015b7d0 msgr2=0x7f45b01658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:36.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.980+0000 7f45b5c00640 1 --2- 172.21.15.32:0/1716563548 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45b015b7d0 0x7f45b01658d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f45980ad040 tx=0x7f459801acb0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.980+0000 7f45b5c00640 1 -- 172.21.15.32:0/1716563548 shutdown_connections 2024-03-19T06:21:36.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.980+0000 7f45b5c00640 1 --2- 172.21.15.32:0/1716563548 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f458c067660 0x7f458c069b20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.980+0000 7f45b5c00640 1 --2- 172.21.15.32:0/1716563548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45b015ca30 0x7f45b0165e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.980+0000 7f45b5c00640 1 --2- 172.21.15.32:0/1716563548 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45b015b7d0 0x7f45b01658d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.980+0000 7f45b5c00640 1 --2- 172.21.15.32:0/1716563548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45b006b280 0x7f45b00c2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:36.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.980+0000 7f45b5c00640 1 -- 172.21.15.32:0/1716563548 >> 172.21.15.32:0/1716563548 conn(0x7f45b00b17c0 msgr2=0x7f45b00cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:36.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.980+0000 7f45b5c00640 1 -- 172.21.15.32:0/1716563548 shutdown_connections 2024-03-19T06:21:36.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:36.980+0000 7f45b5c00640 1 -- 172.21.15.32:0/1716563548 wait complete. 2024-03-19T06:21:36.991 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:37.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.140+0000 7ff435c00640 1 Processor -- start 2024-03-19T06:21:37.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.140+0000 7ff435c00640 1 -- start start 2024-03-19T06:21:37.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.140+0000 7ff435c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff4300cdaa0 0x7ff4300cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.140+0000 7ff435c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43015bf00 con 0x7ff43009a480 2024-03-19T06:21:37.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.140+0000 7ff435c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4300cc5d0 con 0x7ff43015bb20 2024-03-19T06:21:37.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.140+0000 7ff435c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4300cc3a0 con 0x7ff4300cdaa0 2024-03-19T06:21:37.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.140+0000 7ff42f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff4300cdaa0 0x7ff4300cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.140+0000 7ff427e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff43009a480 0x7ff4300cd390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48290/0 (socket says 172.21.15.32:48290) 2024-03-19T06:21:37.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.140+0000 7ff427e00640 1 -- 172.21.15.32:0/2599726455 learned_addr learned my addr 172.21.15.32:0/2599726455 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:37.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.140+0000 7ff42e000640 1 -- 172.21.15.32:0/2599726455 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894318632 0 0) 0x7ff43015bf00 con 0x7ff43009a480 2024-03-19T06:21:37.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.140+0000 7ff42f400640 1 -- 172.21.15.32:0/2599726455 >> v1:172.21.15.171:6789/0 conn(0x7ff43015bb20 legacy=0x7ff4300c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.140+0000 7ff42f400640 1 -- 172.21.15.32:0/2599726455 >> v1:172.21.15.32:6789/0 conn(0x7ff43009a480 legacy=0x7ff4300cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.140+0000 7ff42f400640 1 -- 172.21.15.32:0/2599726455 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4300cc8b0 con 0x7ff4300cdaa0 2024-03-19T06:21:37.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.144+0000 7ff42f400640 1 --2- 172.21.15.32:0/2599726455 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4300cdaa0 0x7ff4300cf460 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff428009d90 tx=0x7ff42801c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d92f890c1b07a17 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:37.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.144+0000 7ff42e000640 1 -- 172.21.15.32:0/2599726455 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280a6670 con 0x7ff4300cdaa0 2024-03-19T06:21:37.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.144+0000 7ff42e000640 1 -- 172.21.15.32:0/2599726455 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4280a6810 con 0x7ff4300cdaa0 2024-03-19T06:21:37.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.144+0000 7ff42e000640 1 -- 172.21.15.32:0/2599726455 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280a6be0 con 0x7ff4300cdaa0 2024-03-19T06:21:37.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.144+0000 7ff435c00640 1 -- 172.21.15.32:0/2599726455 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4300cdaa0 msgr2=0x7ff4300cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.144+0000 7ff435c00640 1 --2- 172.21.15.32:0/2599726455 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4300cdaa0 0x7ff4300cf460 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff428009d90 tx=0x7ff42801c820 comp rx=0 tx=0).stop 2024-03-19T06:21:37.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.144+0000 7ff435c00640 1 -- 172.21.15.32:0/2599726455 shutdown_connections 2024-03-19T06:21:37.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.144+0000 7ff435c00640 1 --2- 172.21.15.32:0/2599726455 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4300cdaa0 0x7ff4300cf460 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.144+0000 7ff435c00640 1 -- 172.21.15.32:0/2599726455 >> 172.21.15.32:0/2599726455 conn(0x7ff4300d1890 msgr2=0x7ff4300d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:37.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.144+0000 7ff435c00640 1 -- 172.21.15.32:0/2599726455 shutdown_connections 2024-03-19T06:21:37.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.144+0000 7ff435c00640 1 -- 172.21.15.32:0/2599726455 wait complete. 2024-03-19T06:21:37.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff435c00640 1 Processor -- start 2024-03-19T06:21:37.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff435c00640 1 -- start start 2024-03-19T06:21:37.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff435c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43009a480 0x7ff4300cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff435c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4300cdaa0 0x7ff4300b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff435c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff43015bb20 0x7ff430157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff435c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff430169950 con 0x7ff4300cdaa0 2024-03-19T06:21:37.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff435c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4300cfbb0 con 0x7ff43015bb20 2024-03-19T06:21:37.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff435c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff430169ad0 con 0x7ff43009a480 2024-03-19T06:21:37.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff427e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4300cdaa0 0x7ff4300b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff427e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4300cdaa0 0x7ff4300b6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60642/0 (socket says 172.21.15.32:60642) 2024-03-19T06:21:37.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff427e00640 1 -- 172.21.15.32:0/724921775 learned_addr learned my addr 172.21.15.32:0/724921775 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:37.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff42ea00640 1 --2- 172.21.15.32:0/724921775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43009a480 0x7ff4300cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff42f400640 1 --2- 172.21.15.32:0/724921775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff43015bb20 0x7ff430157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff427e00640 1 -- 172.21.15.32:0/724921775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43009a480 msgr2=0x7ff4300cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff427e00640 1 --2- 172.21.15.32:0/724921775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43009a480 0x7ff4300cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff427e00640 1 -- 172.21.15.32:0/724921775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff43015bb20 msgr2=0x7ff430157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff427e00640 1 --2- 172.21.15.32:0/724921775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff43015bb20 0x7ff430157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff427e00640 1 -- 172.21.15.32:0/724921775 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4300b6950 con 0x7ff4300cdaa0 2024-03-19T06:21:37.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff427e00640 1 --2- 172.21.15.32:0/724921775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4300cdaa0 0x7ff4300b6100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff41800c410 tx=0x7ff41800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:37.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff426a00640 1 -- 172.21.15.32:0/724921775 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4180074e0 con 0x7ff4300cdaa0 2024-03-19T06:21:37.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff426a00640 1 -- 172.21.15.32:0/724921775 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4180047f0 con 0x7ff4300cdaa0 2024-03-19T06:21:37.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff426a00640 1 -- 172.21.15.32:0/724921775 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418007680 con 0x7ff4300cdaa0 2024-03-19T06:21:37.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff435c00640 1 -- 172.21.15.32:0/724921775 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff430163ad0 con 0x7ff4300cdaa0 2024-03-19T06:21:37.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff435c00640 1 -- 172.21.15.32:0/724921775 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4300b6640 con 0x7ff4300cdaa0 2024-03-19T06:21:37.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.148+0000 7ff435c00640 1 -- 172.21.15.32:0/724921775 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4300749e0 con 0x7ff4300cdaa0 2024-03-19T06:21:37.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.152+0000 7ff426a00640 1 -- 172.21.15.32:0/724921775 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff418011070 con 0x7ff4300cdaa0 2024-03-19T06:21:37.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.152+0000 7ff426a00640 1 --2- 172.21.15.32:0/724921775 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff40c067660 0x7ff40c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.152+0000 7ff426a00640 1 -- 172.21.15.32:0/724921775 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff418085340 con 0x7ff4300cdaa0 2024-03-19T06:21:37.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.152+0000 7ff42ea00640 1 --2- 172.21.15.32:0/724921775 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff40c067660 0x7ff40c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.152+0000 7ff42ea00640 1 --2- 172.21.15.32:0/724921775 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff40c067660 0x7ff40c069b20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff420007fd0 tx=0x7ff420009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:37.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.156+0000 7ff426a00640 1 -- 172.21.15.32:0/724921775 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7ff4180559e0 con 0x7ff4300cdaa0 2024-03-19T06:21:37.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.320+0000 7ff435c00640 1 -- 172.21.15.32:0/724921775 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4300b7810 con 0x7ff4300cdaa0 2024-03-19T06:21:37.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.320+0000 7ff426a00640 1 -- 172.21.15.32:0/724921775 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16617 (secure 0 0 0) 0x7ff418059a80 con 0x7ff4300cdaa0 2024-03-19T06:21:37.312 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:37.312 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:10.423479+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:37.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.320+0000 7ff435c00640 1 -- 172.21.15.32:0/724921775 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff40c067660 msgr2=0x7ff40c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.320+0000 7ff435c00640 1 --2- 172.21.15.32:0/724921775 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff40c067660 0x7ff40c069b20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff420007fd0 tx=0x7ff420009040 comp rx=0 tx=0).stop 2024-03-19T06:21:37.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.320+0000 7ff435c00640 1 -- 172.21.15.32:0/724921775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4300cdaa0 msgr2=0x7ff4300b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.320+0000 7ff435c00640 1 --2- 172.21.15.32:0/724921775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4300cdaa0 0x7ff4300b6100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff41800c410 tx=0x7ff41800c8d0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.320+0000 7ff435c00640 1 -- 172.21.15.32:0/724921775 shutdown_connections 2024-03-19T06:21:37.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.320+0000 7ff435c00640 1 --2- 172.21.15.32:0/724921775 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff40c067660 0x7ff40c069b20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.320+0000 7ff435c00640 1 --2- 172.21.15.32:0/724921775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff43015bb20 0x7ff430157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.320+0000 7ff435c00640 1 --2- 172.21.15.32:0/724921775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4300cdaa0 0x7ff4300b6100 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.320+0000 7ff435c00640 1 --2- 172.21.15.32:0/724921775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43009a480 0x7ff4300cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.320+0000 7ff435c00640 1 -- 172.21.15.32:0/724921775 >> 172.21.15.32:0/724921775 conn(0x7ff4300d1890 msgr2=0x7ff43015a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:37.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.320+0000 7ff435c00640 1 -- 172.21.15.32:0/724921775 shutdown_connections 2024-03-19T06:21:37.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.320+0000 7ff435c00640 1 -- 172.21.15.32:0/724921775 wait complete. 2024-03-19T06:21:37.334 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:21:07.089673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:21:07.801319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:37.335 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:37.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0ea200640 1 Processor -- start 2024-03-19T06:21:37.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0ea200640 1 -- start start 2024-03-19T06:21:37.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0ea200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc0e406b450 0x7fc0e406f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0ea200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e40af2d0 con 0x7fc0e415a840 2024-03-19T06:21:37.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0ea200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e415eea0 con 0x7fc0e40aea70 2024-03-19T06:21:37.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0ea200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e40cdc20 con 0x7fc0e406b450 2024-03-19T06:21:37.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e3400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc0e415a840 0x7fc0e406ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48300/0 (socket says 172.21.15.32:48300) 2024-03-19T06:21:37.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e3400640 1 -- 172.21.15.32:0/1152776716 learned_addr learned my addr 172.21.15.32:0/1152776716 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:37.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0dbe00640 1 --2- 172.21.15.32:0/1152776716 >> v2:172.21.15.171:3300/0 conn(0x7fc0e406b450 0x7fc0e406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e2a00640 1 -- 172.21.15.32:0/1152776716 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130501298 0 0) 0x7fc0e40af2d0 con 0x7fc0e415a840 2024-03-19T06:21:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e2a00640 1 -- 172.21.15.32:0/1152776716 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0c8005740 con 0x7fc0e415a840 2024-03-19T06:21:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e2a00640 1 -- 172.21.15.32:0/1152776716 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 843618448 0 0) 0x7fc0c8005740 con 0x7fc0e415a840 2024-03-19T06:21:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e2a00640 1 -- 172.21.15.32:0/1152776716 >> v2:172.21.15.171:3300/0 conn(0x7fc0e406b450 msgr2=0x7fc0e406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e2a00640 1 --2- 172.21.15.32:0/1152776716 >> v2:172.21.15.171:3300/0 conn(0x7fc0e406b450 0x7fc0e406f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e2a00640 1 -- 172.21.15.32:0/1152776716 >> v1:172.21.15.171:6789/0 conn(0x7fc0e40aea70 legacy=0x7fc0e40ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e2a00640 1 -- 172.21.15.32:0/1152776716 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e415f180 con 0x7fc0e415a840 2024-03-19T06:21:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e2a00640 1 -- 172.21.15.32:0/1152776716 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fc0d4001680 con 0x7fc0e415a840 2024-03-19T06:21:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0dbe00640 1 --2- 172.21.15.32:0/1152776716 >> v2:172.21.15.171:3300/0 conn(0x7fc0e406b450 0x7fc0e406f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e2a00640 1 -- 172.21.15.32:0/1152776716 >> v1:172.21.15.32:6789/0 conn(0x7fc0e415a840 legacy=0x7fc0e406ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e2a00640 1 --2- 172.21.15.32:0/1152776716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0c8005bd0 0x7fc0c8005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e2a00640 1 --2- 172.21.15.32:0/1152776716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0c80065d0 0x7fc0c8006aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e2a00640 1 --2- 172.21.15.32:0/1152776716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c8007340 0x7fc0c800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e2a00640 1 -- 172.21.15.32:0/1152776716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e40cdc20 con 0x7fc0c8007340 2024-03-19T06:21:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e2a00640 1 -- 172.21.15.32:0/1152776716 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c800e280 con 0x7fc0c80065d0 2024-03-19T06:21:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e2a00640 1 -- 172.21.15.32:0/1152776716 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c800e480 con 0x7fc0c8005bd0 2024-03-19T06:21:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e3e00640 1 --2- 172.21.15.32:0/1152776716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c8007340 0x7fc0c800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e3400640 1 --2- 172.21.15.32:0/1152776716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0c8005bd0 0x7fc0c8005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0dbe00640 1 --2- 172.21.15.32:0/1152776716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0c80065d0 0x7fc0c8006aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e3e00640 1 -- 172.21.15.32:0/1152776716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0c8005bd0 msgr2=0x7fc0c8005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e3e00640 1 --2- 172.21.15.32:0/1152776716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0c8005bd0 0x7fc0c8005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e3e00640 1 -- 172.21.15.32:0/1152776716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0c80065d0 msgr2=0x7fc0c8006aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e3e00640 1 --2- 172.21.15.32:0/1152776716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0c80065d0 0x7fc0c8006aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.488+0000 7fc0e3e00640 1 -- 172.21.15.32:0/1152776716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c8005740 con 0x7fc0c8007340 2024-03-19T06:21:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.492+0000 7fc0e3e00640 1 -- 172.21.15.32:0/1152776716 reap_dead start 2024-03-19T06:21:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.492+0000 7fc0e3e00640 1 --2- 172.21.15.32:0/1152776716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c8007340 0x7fc0c800dbe0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc001f60 tx=0x7fc0dc01c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14bdf23831db44c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.492+0000 7fc0e2a00640 1 -- 172.21.15.32:0/1152776716 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc001b60 con 0x7fc0c8007340 2024-03-19T06:21:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.492+0000 7fc0e2a00640 1 -- 172.21.15.32:0/1152776716 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0dc003b80 con 0x7fc0c8007340 2024-03-19T06:21:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.492+0000 7fc0e2a00640 1 -- 172.21.15.32:0/1152776716 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc0050d0 con 0x7fc0c8007340 2024-03-19T06:21:37.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.492+0000 7fc0ea200640 1 -- 172.21.15.32:0/1152776716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c8007340 msgr2=0x7fc0c800dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.492+0000 7fc0ea200640 1 --2- 172.21.15.32:0/1152776716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c8007340 0x7fc0c800dbe0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc001f60 tx=0x7fc0dc01c840 comp rx=0 tx=0).stop 2024-03-19T06:21:37.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.492+0000 7fc0ea200640 1 -- 172.21.15.32:0/1152776716 shutdown_connections 2024-03-19T06:21:37.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.492+0000 7fc0ea200640 1 --2- 172.21.15.32:0/1152776716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c8007340 0x7fc0c800dbe0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.492+0000 7fc0ea200640 1 -- 172.21.15.32:0/1152776716 >> 172.21.15.32:0/1152776716 conn(0x7fc0e40b1590 msgr2=0x7fc0e40b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:37.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.492+0000 7fc0ea200640 1 -- 172.21.15.32:0/1152776716 shutdown_connections 2024-03-19T06:21:37.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.492+0000 7fc0ea200640 1 -- 172.21.15.32:0/1152776716 wait complete. 2024-03-19T06:21:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0ea200640 1 Processor -- start 2024-03-19T06:21:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0ea200640 1 -- start start 2024-03-19T06:21:37.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0ea200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0c8007340 0x7fc0e414ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0ea200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0e414a100 0x7fc0e4147070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0ea200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0e41432d0 0x7fc0e415ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0ea200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e406f040 con 0x7fc0e414a100 2024-03-19T06:21:37.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0ea200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e406f1c0 con 0x7fc0c8007340 2024-03-19T06:21:37.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0ea200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e406f340 con 0x7fc0e41432d0 2024-03-19T06:21:37.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0dbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0e414a100 0x7fc0e4147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0dbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0e414a100 0x7fc0e4147070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60656/0 (socket says 172.21.15.32:60656) 2024-03-19T06:21:37.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0dbe00640 1 -- 172.21.15.32:0/2863965379 learned_addr learned my addr 172.21.15.32:0/2863965379 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:37.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0e3400640 1 --2- 172.21.15.32:0/2863965379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0c8007340 0x7fc0e414ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0e3e00640 1 --2- 172.21.15.32:0/2863965379 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0e41432d0 0x7fc0e415ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0dbe00640 1 -- 172.21.15.32:0/2863965379 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0e41432d0 msgr2=0x7fc0e415ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0dbe00640 1 --2- 172.21.15.32:0/2863965379 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0e41432d0 0x7fc0e415ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0dbe00640 1 -- 172.21.15.32:0/2863965379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0c8007340 msgr2=0x7fc0e414ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0dbe00640 1 --2- 172.21.15.32:0/2863965379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0c8007340 0x7fc0e414ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0dbe00640 1 -- 172.21.15.32:0/2863965379 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e415e420 con 0x7fc0e414a100 2024-03-19T06:21:37.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0dbe00640 1 --2- 172.21.15.32:0/2863965379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0e414a100 0x7fc0e4147070 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc011a30 tx=0x7fc0cc011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:37.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0db400640 1 -- 172.21.15.32:0/2863965379 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc00fc70 con 0x7fc0e414a100 2024-03-19T06:21:37.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0db400640 1 -- 172.21.15.32:0/2863965379 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc00fe10 con 0x7fc0e414a100 2024-03-19T06:21:37.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0db400640 1 -- 172.21.15.32:0/2863965379 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc004260 con 0x7fc0e414a100 2024-03-19T06:21:37.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0ea200640 1 -- 172.21.15.32:0/2863965379 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e415e700 con 0x7fc0e414a100 2024-03-19T06:21:37.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.496+0000 7fc0ea200640 1 -- 172.21.15.32:0/2863965379 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e4149900 con 0x7fc0e414a100 2024-03-19T06:21:37.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.500+0000 7fc0ea200640 1 -- 172.21.15.32:0/2863965379 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e40749e0 con 0x7fc0e414a100 2024-03-19T06:21:37.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.500+0000 7fc0db400640 1 -- 172.21.15.32:0/2863965379 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc0cc012040 con 0x7fc0e414a100 2024-03-19T06:21:37.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.500+0000 7fc0db400640 1 --2- 172.21.15.32:0/2863965379 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc0c0067660 0x7fc0c0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.500+0000 7fc0db400640 1 -- 172.21.15.32:0/2863965379 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0cc085c30 con 0x7fc0e414a100 2024-03-19T06:21:37.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.500+0000 7fc0e3400640 1 --2- 172.21.15.32:0/2863965379 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc0c0067660 0x7fc0c0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.500+0000 7fc0e3400640 1 --2- 172.21.15.32:0/2863965379 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc0c0067660 0x7fc0c0069b20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4000c10 tx=0x7fc0d4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:37.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.504+0000 7fc0db400640 1 -- 172.21.15.32:0/2863965379 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fc0cc019030 con 0x7fc0e414a100 2024-03-19T06:21:37.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.668+0000 7fc0ea200640 1 -- 172.21.15.32:0/2863965379 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc0e406e6c0 con 0x7fc0e414a100 2024-03-19T06:21:37.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.668+0000 7fc0db400640 1 -- 172.21.15.32:0/2863965379 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc0cc056940 con 0x7fc0e414a100 2024-03-19T06:21:37.660 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:37.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.668+0000 7fc0ea200640 1 -- 172.21.15.32:0/2863965379 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc0c0067660 msgr2=0x7fc0c0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.668+0000 7fc0ea200640 1 --2- 172.21.15.32:0/2863965379 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc0c0067660 0x7fc0c0069b20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4000c10 tx=0x7fc0d4009040 comp rx=0 tx=0).stop 2024-03-19T06:21:37.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.668+0000 7fc0ea200640 1 -- 172.21.15.32:0/2863965379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0e414a100 msgr2=0x7fc0e4147070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.668+0000 7fc0ea200640 1 --2- 172.21.15.32:0/2863965379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0e414a100 0x7fc0e4147070 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc011a30 tx=0x7fc0cc011ef0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.668+0000 7fc0ea200640 1 -- 172.21.15.32:0/2863965379 shutdown_connections 2024-03-19T06:21:37.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.668+0000 7fc0ea200640 1 --2- 172.21.15.32:0/2863965379 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc0c0067660 0x7fc0c0069b20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.668+0000 7fc0ea200640 1 --2- 172.21.15.32:0/2863965379 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0e41432d0 0x7fc0e415ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.668+0000 7fc0ea200640 1 --2- 172.21.15.32:0/2863965379 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0e414a100 0x7fc0e4147070 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.668+0000 7fc0ea200640 1 --2- 172.21.15.32:0/2863965379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0c8007340 0x7fc0e414ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.668+0000 7fc0ea200640 1 -- 172.21.15.32:0/2863965379 >> 172.21.15.32:0/2863965379 conn(0x7fc0e40b1590 msgr2=0x7fc0e414e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:37.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.668+0000 7fc0ea200640 1 -- 172.21.15.32:0/2863965379 shutdown_connections 2024-03-19T06:21:37.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.668+0000 7fc0ea200640 1 -- 172.21.15.32:0/2863965379 wait complete. 2024-03-19T06:21:37.681 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:21:37.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.832+0000 7f607b600640 1 Processor -- start 2024-03-19T06:21:37.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.832+0000 7f607b600640 1 -- start start 2024-03-19T06:21:37.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.832+0000 7f607b600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f607406ad40 0x7f607406b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.832+0000 7f607b600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607406b660 con 0x7f607406eed0 2024-03-19T06:21:37.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.832+0000 7f607b600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60740cc290 con 0x7f607406e320 2024-03-19T06:21:37.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.832+0000 7f607b600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60740cd420 con 0x7f607406ad40 2024-03-19T06:21:37.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.832+0000 7f6078c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f607406ad40 0x7f607406b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.832+0000 7f606be00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f607406eed0 0x7f60740ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48308/0 (socket says 172.21.15.32:48308) 2024-03-19T06:21:37.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.832+0000 7f606be00640 1 -- 172.21.15.32:0/2261251378 learned_addr learned my addr 172.21.15.32:0/2261251378 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:37.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.836+0000 7f6078c00640 1 -- 172.21.15.32:0/2261251378 >> v1:172.21.15.171:6789/0 conn(0x7f607406e320 legacy=0x7f607415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:37.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.836+0000 7f6078c00640 1 -- 172.21.15.32:0/2261251378 >> v1:172.21.15.32:6789/0 conn(0x7f607406eed0 legacy=0x7f60740ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.836+0000 7f6078c00640 1 -- 172.21.15.32:0/2261251378 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60740cc570 con 0x7f607406ad40 2024-03-19T06:21:37.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.836+0000 7f6078c00640 1 --2- 172.21.15.32:0/2261251378 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f607406ad40 0x7f607406b120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f60640097c0 tx=0x7f606401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1142ae941c9c8623 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:37.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.836+0000 7f6073e00640 1 -- 172.21.15.32:0/2261251378 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60640b0070 con 0x7f607406ad40 2024-03-19T06:21:37.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.836+0000 7f6073e00640 1 -- 172.21.15.32:0/2261251378 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60640ab600 con 0x7f607406ad40 2024-03-19T06:21:37.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.836+0000 7f6073e00640 1 -- 172.21.15.32:0/2261251378 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60640ab9d0 con 0x7f607406ad40 2024-03-19T06:21:37.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.836+0000 7f607b600640 1 -- 172.21.15.32:0/2261251378 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f607406ad40 msgr2=0x7f607406b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.836+0000 7f607b600640 1 --2- 172.21.15.32:0/2261251378 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f607406ad40 0x7f607406b120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f60640097c0 tx=0x7f606401c260 comp rx=0 tx=0).stop 2024-03-19T06:21:37.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.836+0000 7f607b600640 1 -- 172.21.15.32:0/2261251378 shutdown_connections 2024-03-19T06:21:37.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.836+0000 7f607b600640 1 --2- 172.21.15.32:0/2261251378 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f607406ad40 0x7f607406b120 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.836+0000 7f607b600640 1 -- 172.21.15.32:0/2261251378 >> 172.21.15.32:0/2261251378 conn(0x7f60740b1590 msgr2=0x7f60740b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:37.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.836+0000 7f607b600640 1 -- 172.21.15.32:0/2261251378 shutdown_connections 2024-03-19T06:21:37.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f607b600640 1 -- 172.21.15.32:0/2261251378 wait complete. 2024-03-19T06:21:37.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f607b600640 1 Processor -- start 2024-03-19T06:21:37.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f607b600640 1 -- start start 2024-03-19T06:21:37.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f607b600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f607406ad40 0x7f607413abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f607b600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f607406e320 0x7f6074155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f607b600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f607406eed0 0x7f6074156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f607b600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6074169d30 con 0x7f607406ad40 2024-03-19T06:21:37.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f607b600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607415c980 con 0x7f607406e320 2024-03-19T06:21:37.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f607b600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6074169eb0 con 0x7f607406eed0 2024-03-19T06:21:37.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f6078c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f607406ad40 0x7f607413abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f6078c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f607406ad40 0x7f607413abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60672/0 (socket says 172.21.15.32:60672) 2024-03-19T06:21:37.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f6078c00640 1 -- 172.21.15.32:0/3802843294 learned_addr learned my addr 172.21.15.32:0/3802843294 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:37.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f606be00640 1 --2- 172.21.15.32:0/3802843294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f607406e320 0x7f6074155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f6079600640 1 --2- 172.21.15.32:0/3802843294 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f607406eed0 0x7f6074156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f6078c00640 1 -- 172.21.15.32:0/3802843294 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f607406eed0 msgr2=0x7f6074156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f6078c00640 1 --2- 172.21.15.32:0/3802843294 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f607406eed0 0x7f6074156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f6078c00640 1 -- 172.21.15.32:0/3802843294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f607406e320 msgr2=0x7f6074155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:37.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f6078c00640 1 --2- 172.21.15.32:0/3802843294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f607406e320 0x7f6074155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:37.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f6078c00640 1 -- 172.21.15.32:0/3802843294 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6074156320 con 0x7f607406ad40 2024-03-19T06:21:37.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f6079600640 1 --2- 172.21.15.32:0/3802843294 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f607406eed0 0x7f6074156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:37.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f6078c00640 1 --2- 172.21.15.32:0/3802843294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f607406ad40 0x7f607413abd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6064019e90 tx=0x7f606401aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:37.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f6071600640 1 -- 172.21.15.32:0/3802843294 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60640b0050 con 0x7f607406ad40 2024-03-19T06:21:37.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f6071600640 1 -- 172.21.15.32:0/3802843294 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60640bc070 con 0x7f607406ad40 2024-03-19T06:21:37.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f607b600640 1 -- 172.21.15.32:0/3802843294 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607413d4d0 con 0x7f607406ad40 2024-03-19T06:21:37.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.840+0000 7f6071600640 1 -- 172.21.15.32:0/3802843294 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60640b5a30 con 0x7f607406ad40 2024-03-19T06:21:37.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.844+0000 7f607b600640 1 -- 172.21.15.32:0/3802843294 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607413da90 con 0x7f607406ad40 2024-03-19T06:21:37.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.844+0000 7f607b600640 1 -- 172.21.15.32:0/3802843294 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60740749e0 con 0x7f607406ad40 2024-03-19T06:21:37.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.844+0000 7f6071600640 1 -- 172.21.15.32:0/3802843294 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f60640ab4c0 con 0x7f607406ad40 2024-03-19T06:21:37.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.844+0000 7f6071600640 1 --2- 172.21.15.32:0/3802843294 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6050067660 0x7f6050069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:37.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.844+0000 7f6071600640 1 -- 172.21.15.32:0/3802843294 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6064120220 con 0x7f607406ad40 2024-03-19T06:21:37.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.844+0000 7f606be00640 1 --2- 172.21.15.32:0/3802843294 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6050067660 0x7f6050069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:37.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.844+0000 7f606be00640 1 --2- 172.21.15.32:0/3802843294 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6050067660 0x7f6050069b20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f60740b4910 tx=0x7f605c007c70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:37.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:37.848+0000 7f6071600640 1 -- 172.21.15.32:0/3802843294 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f6064015fb0 con 0x7f607406ad40 2024-03-19T06:21:38.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.012+0000 7f607b600640 1 -- 172.21.15.32:0/3802843294 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f607406d950 con 0x7f607406ad40 2024-03-19T06:21:38.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.012+0000 7f6071600640 1 -- 172.21.15.32:0/3802843294 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f60640f0f20 con 0x7f607406ad40 2024-03-19T06:21:38.004 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:21:38.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.012+0000 7f607b600640 1 -- 172.21.15.32:0/3802843294 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6050067660 msgr2=0x7f6050069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.012+0000 7f607b600640 1 --2- 172.21.15.32:0/3802843294 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6050067660 0x7f6050069b20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f60740b4910 tx=0x7f605c007c70 comp rx=0 tx=0).stop 2024-03-19T06:21:38.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.012+0000 7f607b600640 1 -- 172.21.15.32:0/3802843294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f607406ad40 msgr2=0x7f607413abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.012+0000 7f607b600640 1 --2- 172.21.15.32:0/3802843294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f607406ad40 0x7f607413abd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6064019e90 tx=0x7f606401aaa0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.012+0000 7f607b600640 1 -- 172.21.15.32:0/3802843294 shutdown_connections 2024-03-19T06:21:38.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.012+0000 7f607b600640 1 --2- 172.21.15.32:0/3802843294 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6050067660 0x7f6050069b20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.012+0000 7f607b600640 1 --2- 172.21.15.32:0/3802843294 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f607406eed0 0x7f6074156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.012+0000 7f607b600640 1 --2- 172.21.15.32:0/3802843294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f607406e320 0x7f6074155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.012+0000 7f607b600640 1 --2- 172.21.15.32:0/3802843294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f607406ad40 0x7f607413abd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.012+0000 7f607b600640 1 -- 172.21.15.32:0/3802843294 >> 172.21.15.32:0/3802843294 conn(0x7f60740b1590 msgr2=0x7f6074150010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:38.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.012+0000 7f607b600640 1 -- 172.21.15.32:0/3802843294 shutdown_connections 2024-03-19T06:21:38.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.012+0000 7f607b600640 1 -- 172.21.15.32:0/3802843294 wait complete. 2024-03-19T06:21:38.024 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:21:38.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.176+0000 7f201c400640 1 Processor -- start 2024-03-19T06:21:38.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.176+0000 7f201c400640 1 -- start start 2024-03-19T06:21:38.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.176+0000 7f201c400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f201415dbb0 0x7f201406c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.176+0000 7f201c400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20140cbf00 con 0x7f201406c5a0 2024-03-19T06:21:38.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.176+0000 7f201c400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201406cb20 con 0x7f20140b3d30 2024-03-19T06:21:38.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.176+0000 7f201c400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201406ce00 con 0x7f201415dbb0 2024-03-19T06:21:38.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.176+0000 7f2019000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f201406c5a0 0x7f20140b3620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48314/0 (socket says 172.21.15.32:48314) 2024-03-19T06:21:38.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.176+0000 7f2019000640 1 -- 172.21.15.32:0/1456915879 learned_addr learned my addr 172.21.15.32:0/1456915879 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:38.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.176+0000 7f2019a00640 1 --2- 172.21.15.32:0/1456915879 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f201415dbb0 0x7f201406c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.176+0000 7f2013e00640 1 -- 172.21.15.32:0/1456915879 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202874888 0 0) 0x7f20140cbf00 con 0x7f201406c5a0 2024-03-19T06:21:38.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.176+0000 7f2013e00640 1 -- 172.21.15.32:0/1456915879 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ffc003530 con 0x7f201406c5a0 2024-03-19T06:21:38.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.176+0000 7f2013e00640 1 -- 172.21.15.32:0/1456915879 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106556117 0 0) 0x7f201406cb20 con 0x7f20140b3d30 2024-03-19T06:21:38.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.176+0000 7f2013e00640 1 -- 172.21.15.32:0/1456915879 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20140cbf00 con 0x7f20140b3d30 2024-03-19T06:21:38.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.176+0000 7f2019a00640 1 -- 172.21.15.32:0/1456915879 >> v1:172.21.15.171:6789/0 conn(0x7f20140b3d30 legacy=0x7f20140cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.176+0000 7f2019a00640 1 -- 172.21.15.32:0/1456915879 >> v1:172.21.15.32:6789/0 conn(0x7f201406c5a0 legacy=0x7f20140b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.176+0000 7f2019a00640 1 -- 172.21.15.32:0/1456915879 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201406d0e0 con 0x7f201415dbb0 2024-03-19T06:21:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.180+0000 7f2019a00640 1 --2- 172.21.15.32:0/1456915879 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f201415dbb0 0x7f201406c060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f20080097f0 tx=0x7f200801ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13f899fb7ca88b56 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.180+0000 7f2013e00640 1 -- 172.21.15.32:0/1456915879 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20080b5070 con 0x7f201415dbb0 2024-03-19T06:21:38.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.180+0000 7f2013e00640 1 -- 172.21.15.32:0/1456915879 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20080a89d0 con 0x7f201415dbb0 2024-03-19T06:21:38.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.180+0000 7f2013e00640 1 -- 172.21.15.32:0/1456915879 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20080a8da0 con 0x7f201415dbb0 2024-03-19T06:21:38.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.180+0000 7f201c400640 1 -- 172.21.15.32:0/1456915879 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f201415dbb0 msgr2=0x7f201406c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.180+0000 7f201c400640 1 --2- 172.21.15.32:0/1456915879 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f201415dbb0 0x7f201406c060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f20080097f0 tx=0x7f200801ecd0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.180+0000 7f201c400640 1 -- 172.21.15.32:0/1456915879 shutdown_connections 2024-03-19T06:21:38.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.180+0000 7f201c400640 1 --2- 172.21.15.32:0/1456915879 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f201415dbb0 0x7f201406c060 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.180+0000 7f201c400640 1 -- 172.21.15.32:0/1456915879 >> 172.21.15.32:0/1456915879 conn(0x7f2014066ca0 msgr2=0x7f20140670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:38.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.180+0000 7f201c400640 1 -- 172.21.15.32:0/1456915879 shutdown_connections 2024-03-19T06:21:38.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.180+0000 7f201c400640 1 -- 172.21.15.32:0/1456915879 wait complete. 2024-03-19T06:21:38.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201c400640 1 Processor -- start 2024-03-19T06:21:38.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201c400640 1 -- start start 2024-03-19T06:21:38.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201c400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f201406c5a0 0x7f20140b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201c400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20140b3d30 0x7f20140c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201c400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f201415dbb0 0x7f20140b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201c400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201415df90 con 0x7f201415dbb0 2024-03-19T06:21:38.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201c400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201406d910 con 0x7f20140b3d30 2024-03-19T06:21:38.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201c400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20140ccdd0 con 0x7f201406c5a0 2024-03-19T06:21:38.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201a400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f201415dbb0 0x7f20140b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201a400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f201415dbb0 0x7f20140b4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60674/0 (socket says 172.21.15.32:60674) 2024-03-19T06:21:38.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201a400640 1 -- 172.21.15.32:0/4147258498 learned_addr learned my addr 172.21.15.32:0/4147258498 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:38.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f2019a00640 1 --2- 172.21.15.32:0/4147258498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f201406c5a0 0x7f20140b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f2019000640 1 --2- 172.21.15.32:0/4147258498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20140b3d30 0x7f20140c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201a400640 1 -- 172.21.15.32:0/4147258498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f201406c5a0 msgr2=0x7f20140b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201a400640 1 --2- 172.21.15.32:0/4147258498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f201406c5a0 0x7f20140b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201a400640 1 -- 172.21.15.32:0/4147258498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20140b3d30 msgr2=0x7f20140c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201a400640 1 --2- 172.21.15.32:0/4147258498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20140b3d30 0x7f20140c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201a400640 1 -- 172.21.15.32:0/4147258498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20140c6e20 con 0x7f201415dbb0 2024-03-19T06:21:38.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f2019a00640 1 --2- 172.21.15.32:0/4147258498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f201406c5a0 0x7f20140b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:38.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f2019000640 1 --2- 172.21.15.32:0/4147258498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20140b3d30 0x7f20140c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:38.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201a400640 1 --2- 172.21.15.32:0/4147258498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f201415dbb0 0x7f20140b4400 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f200c00c7a0 tx=0x7f200c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:38.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f2011600640 1 -- 172.21.15.32:0/4147258498 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c003b80 con 0x7f201415dbb0 2024-03-19T06:21:38.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f2011600640 1 -- 172.21.15.32:0/4147258498 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c003d20 con 0x7f201415dbb0 2024-03-19T06:21:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201c400640 1 -- 172.21.15.32:0/4147258498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20140c7100 con 0x7f201415dbb0 2024-03-19T06:21:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f2011600640 1 -- 172.21.15.32:0/4147258498 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00aa90 con 0x7f201415dbb0 2024-03-19T06:21:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.184+0000 7f201c400640 1 -- 172.21.15.32:0/4147258498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20140c76c0 con 0x7f201415dbb0 2024-03-19T06:21:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.188+0000 7f201c400640 1 -- 172.21.15.32:0/4147258498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20140749e0 con 0x7f201415dbb0 2024-03-19T06:21:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.188+0000 7f2011600640 1 -- 172.21.15.32:0/4147258498 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f200c00ac30 con 0x7f201415dbb0 2024-03-19T06:21:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.188+0000 7f2011600640 1 --2- 172.21.15.32:0/4147258498 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1ff4067660 0x7f1ff4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.188+0000 7f2011600640 1 -- 172.21.15.32:0/4147258498 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f200c085880 con 0x7f201415dbb0 2024-03-19T06:21:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.188+0000 7f2019a00640 1 --2- 172.21.15.32:0/4147258498 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1ff4067660 0x7f1ff4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.188+0000 7f2019a00640 1 --2- 172.21.15.32:0/4147258498 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1ff4067660 0x7f1ff4069b20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f20080b2000 tx=0x7f20080aa070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:38.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.192+0000 7f2011600640 1 -- 172.21.15.32:0/4147258498 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f200c0564f0 con 0x7f201415dbb0 2024-03-19T06:21:38.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.356+0000 7f201c400640 1 -- 172.21.15.32:0/4147258498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f201415cda0 con 0x7f201415dbb0 2024-03-19T06:21:38.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.356+0000 7f2011600640 1 -- 172.21.15.32:0/4147258498 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f200c055df0 con 0x7f201415dbb0 2024-03-19T06:21:38.347 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:21:38.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.356+0000 7f201c400640 1 -- 172.21.15.32:0/4147258498 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1ff4067660 msgr2=0x7f1ff4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.356+0000 7f201c400640 1 --2- 172.21.15.32:0/4147258498 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1ff4067660 0x7f1ff4069b20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f20080b2000 tx=0x7f20080aa070 comp rx=0 tx=0).stop 2024-03-19T06:21:38.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.356+0000 7f201c400640 1 -- 172.21.15.32:0/4147258498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f201415dbb0 msgr2=0x7f20140b4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.356+0000 7f201c400640 1 --2- 172.21.15.32:0/4147258498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f201415dbb0 0x7f20140b4400 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f200c00c7a0 tx=0x7f200c00cc60 comp rx=0 tx=0).stop 2024-03-19T06:21:38.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.356+0000 7f201c400640 1 -- 172.21.15.32:0/4147258498 shutdown_connections 2024-03-19T06:21:38.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.356+0000 7f201c400640 1 --2- 172.21.15.32:0/4147258498 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1ff4067660 0x7f1ff4069b20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.356+0000 7f201c400640 1 --2- 172.21.15.32:0/4147258498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f201415dbb0 0x7f20140b4400 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.356+0000 7f201c400640 1 --2- 172.21.15.32:0/4147258498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20140b3d30 0x7f20140c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.356+0000 7f201c400640 1 --2- 172.21.15.32:0/4147258498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f201406c5a0 0x7f20140b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.356+0000 7f201c400640 1 -- 172.21.15.32:0/4147258498 >> 172.21.15.32:0/4147258498 conn(0x7f2014066ca0 msgr2=0x7f20140ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:38.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.356+0000 7f201c400640 1 -- 172.21.15.32:0/4147258498 shutdown_connections 2024-03-19T06:21:38.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.356+0000 7f201c400640 1 -- 172.21.15.32:0/4147258498 wait complete. 2024-03-19T06:21:38.369 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:38.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.516+0000 7f4c6a600640 1 Processor -- start 2024-03-19T06:21:38.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.516+0000 7f4c6a600640 1 -- start start 2024-03-19T06:21:38.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.520+0000 7f4c6a600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c640aecf0 0x7f4c640ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.520+0000 7f4c6a600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4c6415c010 0x7f4c6415f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.520+0000 7f4c6a600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c6415fe20 con 0x7f4c6406d6c0 2024-03-19T06:21:38.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.520+0000 7f4c6a600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c641603e0 con 0x7f4c6415c010 2024-03-19T06:21:38.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.520+0000 7f4c6a600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c64160100 con 0x7f4c640aecf0 2024-03-19T06:21:38.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.520+0000 7f4c63e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4c6406d6c0 0x7f4c640cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48330/0 (socket says 172.21.15.32:48330) 2024-03-19T06:21:38.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.520+0000 7f4c63e00640 1 -- 172.21.15.32:0/3752357685 learned_addr learned my addr 172.21.15.32:0/3752357685 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:38.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.520+0000 7f4c62a00640 1 --2- 172.21.15.32:0/3752357685 >> v2:172.21.15.171:3300/0 conn(0x7f4c6415c010 0x7f4c6415f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.520+0000 7f4c63400640 1 --2- 172.21.15.32:0/3752357685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c640aecf0 0x7f4c640ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.520+0000 7f4c62000640 1 -- 172.21.15.32:0/3752357685 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107212690 0 0) 0x7f4c6415fe20 con 0x7f4c6406d6c0 2024-03-19T06:21:38.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.520+0000 7f4c62000640 1 -- 172.21.15.32:0/3752357685 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c48003530 con 0x7f4c6406d6c0 2024-03-19T06:21:38.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.520+0000 7f4c63400640 1 -- 172.21.15.32:0/3752357685 >> v2:172.21.15.171:3300/0 conn(0x7f4c6415c010 msgr2=0x7f4c6415f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:38.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.520+0000 7f4c63400640 1 --2- 172.21.15.32:0/3752357685 >> v2:172.21.15.171:3300/0 conn(0x7f4c6415c010 0x7f4c6415f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.520+0000 7f4c63400640 1 -- 172.21.15.32:0/3752357685 >> v1:172.21.15.32:6789/0 conn(0x7f4c6406d6c0 legacy=0x7f4c640cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.520+0000 7f4c63400640 1 -- 172.21.15.32:0/3752357685 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c640ca1f0 con 0x7f4c640aecf0 2024-03-19T06:21:38.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.524+0000 7f4c63400640 1 --2- 172.21.15.32:0/3752357685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c640aecf0 0x7f4c640ca9f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c540097c0 tx=0x7f4c5401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92133f0c92d6007e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:38.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.524+0000 7f4c62000640 1 -- 172.21.15.32:0/3752357685 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c540b0070 con 0x7f4c640aecf0 2024-03-19T06:21:38.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.524+0000 7f4c62000640 1 -- 172.21.15.32:0/3752357685 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c540ab600 con 0x7f4c640aecf0 2024-03-19T06:21:38.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.524+0000 7f4c62000640 1 -- 172.21.15.32:0/3752357685 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c540ab9d0 con 0x7f4c640aecf0 2024-03-19T06:21:38.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.524+0000 7f4c6a600640 1 -- 172.21.15.32:0/3752357685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c640aecf0 msgr2=0x7f4c640ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.524+0000 7f4c6a600640 1 --2- 172.21.15.32:0/3752357685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c640aecf0 0x7f4c640ca9f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c540097c0 tx=0x7f4c5401c410 comp rx=0 tx=0).stop 2024-03-19T06:21:38.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.524+0000 7f4c6a600640 1 -- 172.21.15.32:0/3752357685 shutdown_connections 2024-03-19T06:21:38.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.524+0000 7f4c6a600640 1 --2- 172.21.15.32:0/3752357685 >> v2:172.21.15.171:3300/0 conn(0x7f4c6415c010 0x7f4c6415f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.524+0000 7f4c6a600640 1 --2- 172.21.15.32:0/3752357685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c640aecf0 0x7f4c640ca9f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.524+0000 7f4c6a600640 1 -- 172.21.15.32:0/3752357685 >> 172.21.15.32:0/3752357685 conn(0x7f4c640b1280 msgr2=0x7f4c640b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:38.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.524+0000 7f4c6a600640 1 -- 172.21.15.32:0/3752357685 shutdown_connections 2024-03-19T06:21:38.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.524+0000 7f4c6a600640 1 -- 172.21.15.32:0/3752357685 wait complete. 2024-03-19T06:21:38.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c6a600640 1 Processor -- start 2024-03-19T06:21:38.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c6a600640 1 -- start start 2024-03-19T06:21:38.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c6a600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c6406d6c0 0x7f4c64155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c6a600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c640aecf0 0x7f4c64156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c6a600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c6415c010 0x7f4c64157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c6a600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6415fbe0 con 0x7f4c640aecf0 2024-03-19T06:21:38.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c6a600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6415fa60 con 0x7f4c6415c010 2024-03-19T06:21:38.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c6a600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c64168ea0 con 0x7f4c6406d6c0 2024-03-19T06:21:38.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c62a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c640aecf0 0x7f4c64156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c62a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c640aecf0 0x7f4c64156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60678/0 (socket says 172.21.15.32:60678) 2024-03-19T06:21:38.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c62a00640 1 -- 172.21.15.32:0/1021662876 learned_addr learned my addr 172.21.15.32:0/1021662876 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:38.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c63e00640 1 --2- 172.21.15.32:0/1021662876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c6415c010 0x7f4c64157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c63400640 1 --2- 172.21.15.32:0/1021662876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c6406d6c0 0x7f4c64155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c62a00640 1 -- 172.21.15.32:0/1021662876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c6406d6c0 msgr2=0x7f4c64155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c62a00640 1 --2- 172.21.15.32:0/1021662876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c6406d6c0 0x7f4c64155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c62a00640 1 -- 172.21.15.32:0/1021662876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c6415c010 msgr2=0x7f4c64157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c62a00640 1 --2- 172.21.15.32:0/1021662876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c6415c010 0x7f4c64157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c62a00640 1 -- 172.21.15.32:0/1021662876 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6415ba00 con 0x7f4c640aecf0 2024-03-19T06:21:38.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c62a00640 1 --2- 172.21.15.32:0/1021662876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c640aecf0 0x7f4c64156c40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000e930 tx=0x7f4c5000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:38.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c5b400640 1 -- 172.21.15.32:0/1021662876 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50017070 con 0x7f4c640aecf0 2024-03-19T06:21:38.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c5b400640 1 -- 172.21.15.32:0/1021662876 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5000ca00 con 0x7f4c640aecf0 2024-03-19T06:21:38.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c5b400640 1 -- 172.21.15.32:0/1021662876 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5000cdd0 con 0x7f4c640aecf0 2024-03-19T06:21:38.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c6a600640 1 -- 172.21.15.32:0/1021662876 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c641606d0 con 0x7f4c640aecf0 2024-03-19T06:21:38.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c6a600640 1 -- 172.21.15.32:0/1021662876 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c64155710 con 0x7f4c640aecf0 2024-03-19T06:21:38.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.528+0000 7f4c6a600640 1 -- 172.21.15.32:0/1021662876 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c640749e0 con 0x7f4c640aecf0 2024-03-19T06:21:38.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.532+0000 7f4c5b400640 1 -- 172.21.15.32:0/1021662876 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f4c5001a070 con 0x7f4c640aecf0 2024-03-19T06:21:38.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.532+0000 7f4c5b400640 1 --2- 172.21.15.32:0/1021662876 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4c44067660 0x7f4c44069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.532+0000 7f4c5b400640 1 -- 172.21.15.32:0/1021662876 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c50085c60 con 0x7f4c640aecf0 2024-03-19T06:21:38.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.532+0000 7f4c63400640 1 --2- 172.21.15.32:0/1021662876 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4c44067660 0x7f4c44069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.532+0000 7f4c63400640 1 --2- 172.21.15.32:0/1021662876 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4c44067660 0x7f4c44069b20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4c540ad000 tx=0x7f4c54008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:38.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.536+0000 7f4c5b400640 1 -- 172.21.15.32:0/1021662876 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f4c500562b0 con 0x7f4c640aecf0 2024-03-19T06:21:38.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.696+0000 7f4c6a600640 1 -- 172.21.15.32:0/1021662876 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c6415d200 con 0x7f4c640aecf0 2024-03-19T06:21:38.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.700+0000 7f4c5b400640 1 -- 172.21.15.32:0/1021662876 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f4c5005a350 con 0x7f4c640aecf0 2024-03-19T06:21:38.691 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:38.691 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:10.423479+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.700+0000 7f4c6a600640 1 -- 172.21.15.32:0/1021662876 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4c44067660 msgr2=0x7f4c44069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.700+0000 7f4c6a600640 1 --2- 172.21.15.32:0/1021662876 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4c44067660 0x7f4c44069b20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4c540ad000 tx=0x7f4c54008040 comp rx=0 tx=0).stop 2024-03-19T06:21:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.700+0000 7f4c6a600640 1 -- 172.21.15.32:0/1021662876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c640aecf0 msgr2=0x7f4c64156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.700+0000 7f4c6a600640 1 --2- 172.21.15.32:0/1021662876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c640aecf0 0x7f4c64156c40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000e930 tx=0x7f4c5000edf0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.700+0000 7f4c6a600640 1 -- 172.21.15.32:0/1021662876 shutdown_connections 2024-03-19T06:21:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.700+0000 7f4c6a600640 1 --2- 172.21.15.32:0/1021662876 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4c44067660 0x7f4c44069b20 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4c540ad000 tx=0x7f4c54008040 comp rx=0 tx=0).stop 2024-03-19T06:21:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.700+0000 7f4c6a600640 1 --2- 172.21.15.32:0/1021662876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c6415c010 0x7f4c64157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.700+0000 7f4c6a600640 1 --2- 172.21.15.32:0/1021662876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c640aecf0 0x7f4c64156c40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.700+0000 7f4c6a600640 1 --2- 172.21.15.32:0/1021662876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c6406d6c0 0x7f4c64155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.700+0000 7f4c6a600640 1 -- 172.21.15.32:0/1021662876 >> 172.21.15.32:0/1021662876 conn(0x7f4c640b1280 msgr2=0x7f4c6415da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.700+0000 7f4c6a600640 1 -- 172.21.15.32:0/1021662876 shutdown_connections 2024-03-19T06:21:38.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.700+0000 7f4c6a600640 1 -- 172.21.15.32:0/1021662876 wait complete. 2024-03-19T06:21:38.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:21:07.089673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:21:07.801319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:38.712 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:38.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.864+0000 7f2ccf200640 1 Processor -- start 2024-03-19T06:21:38.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.864+0000 7f2ccf200640 1 -- start start 2024-03-19T06:21:38.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.864+0000 7f2ccf200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2cc80ad6d0 0x7f2cc80af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.864+0000 7f2ccf200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2cc80cc850 0x7f2cc806b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.864+0000 7f2ccf200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc8160030 con 0x7f2cc815ba20 2024-03-19T06:21:38.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.864+0000 7f2ccf200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc806b390 con 0x7f2cc80ad6d0 2024-03-19T06:21:38.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.864+0000 7f2ccf200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc81602f0 con 0x7f2cc80cc850 2024-03-19T06:21:38.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.864+0000 7f2cbf400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2cc80ad6d0 0x7f2cc80af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.864+0000 7f2cbf400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2cc80ad6d0 0x7f2cc80af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60680/0 (socket says 172.21.15.32:60680) 2024-03-19T06:21:38.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.864+0000 7f2cbf400640 1 -- 172.21.15.32:0/1134417198 learned_addr learned my addr 172.21.15.32:0/1134417198 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:38.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.864+0000 7f2ccd200640 1 --2- 172.21.15.32:0/1134417198 >> v2:172.21.15.171:3300/0 conn(0x7f2cc80cc850 0x7f2cc806b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.864+0000 7f2cbf400640 1 -- 172.21.15.32:0/1134417198 >> v2:172.21.15.171:3300/0 conn(0x7f2cc80cc850 msgr2=0x7f2cc806b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:38.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.864+0000 7f2cbf400640 1 --2- 172.21.15.32:0/1134417198 >> v2:172.21.15.171:3300/0 conn(0x7f2cc80cc850 0x7f2cc806b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.864+0000 7f2cbf400640 1 -- 172.21.15.32:0/1134417198 >> v1:172.21.15.171:6789/0 conn(0x7f2cc815ba20 legacy=0x7f2cc80acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:38.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.864+0000 7f2cbf400640 1 -- 172.21.15.32:0/1134417198 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc806ad40 con 0x7f2cc80ad6d0 2024-03-19T06:21:38.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.868+0000 7f2cbf400640 1 --2- 172.21.15.32:0/1134417198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc80ad6d0 0x7f2cc80af1f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2cc806b510 tx=0x7f2cb001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fced1f6073b3da1 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:38.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.868+0000 7f2cc7400640 1 -- 172.21.15.32:0/1134417198 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb00aa660 con 0x7f2cc80ad6d0 2024-03-19T06:21:38.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.868+0000 7f2cc7400640 1 -- 172.21.15.32:0/1134417198 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb00af070 con 0x7f2cc80ad6d0 2024-03-19T06:21:38.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.868+0000 7f2cc7400640 1 -- 172.21.15.32:0/1134417198 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb00aaa20 con 0x7f2cc80ad6d0 2024-03-19T06:21:38.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.868+0000 7f2ccf200640 1 -- 172.21.15.32:0/1134417198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc80ad6d0 msgr2=0x7f2cc80af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.868+0000 7f2ccf200640 1 --2- 172.21.15.32:0/1134417198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc80ad6d0 0x7f2cc80af1f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2cc806b510 tx=0x7f2cb001c4e0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.868+0000 7f2ccf200640 1 -- 172.21.15.32:0/1134417198 shutdown_connections 2024-03-19T06:21:38.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.868+0000 7f2ccf200640 1 --2- 172.21.15.32:0/1134417198 >> v2:172.21.15.171:3300/0 conn(0x7f2cc80cc850 0x7f2cc806b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.868+0000 7f2ccf200640 1 --2- 172.21.15.32:0/1134417198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc80ad6d0 0x7f2cc80af1f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.868+0000 7f2ccf200640 1 -- 172.21.15.32:0/1134417198 >> 172.21.15.32:0/1134417198 conn(0x7f2cc80b2480 msgr2=0x7f2cc80cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:38.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.868+0000 7f2ccf200640 1 -- 172.21.15.32:0/1134417198 shutdown_connections 2024-03-19T06:21:38.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.868+0000 7f2ccf200640 1 -- 172.21.15.32:0/1134417198 wait complete. 2024-03-19T06:21:38.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2ccf200640 1 Processor -- start 2024-03-19T06:21:38.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2ccf200640 1 -- start start 2024-03-19T06:21:38.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2ccf200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc80ad6d0 0x7f2cc815a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2ccf200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cc80cc850 0x7f2cc814a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2ccf200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cc815ba20 0x7f2cc8153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2ccf200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc8168bd0 con 0x7f2cc80ad6d0 2024-03-19T06:21:38.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2ccf200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc8168a50 con 0x7f2cc80cc850 2024-03-19T06:21:38.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2ccf200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc8168d50 con 0x7f2cc815ba20 2024-03-19T06:21:38.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2cc7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc80ad6d0 0x7f2cc815a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2cc7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc80ad6d0 0x7f2cc815a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60696/0 (socket says 172.21.15.32:60696) 2024-03-19T06:21:38.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2cc7e00640 1 -- 172.21.15.32:0/1905174832 learned_addr learned my addr 172.21.15.32:0/1905174832 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:38.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2cbf400640 1 --2- 172.21.15.32:0/1905174832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cc80cc850 0x7f2cc814a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2ccd200640 1 --2- 172.21.15.32:0/1905174832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cc815ba20 0x7f2cc8153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2cc7e00640 1 -- 172.21.15.32:0/1905174832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cc815ba20 msgr2=0x7f2cc8153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2cc7e00640 1 --2- 172.21.15.32:0/1905174832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cc815ba20 0x7f2cc8153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2cc7e00640 1 -- 172.21.15.32:0/1905174832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cc80cc850 msgr2=0x7f2cc814a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:38.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2cc7e00640 1 --2- 172.21.15.32:0/1905174832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cc80cc850 0x7f2cc814a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:38.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2cc7e00640 1 -- 172.21.15.32:0/1905174832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc81543b0 con 0x7f2cc80ad6d0 2024-03-19T06:21:38.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2cc7e00640 1 --2- 172.21.15.32:0/1905174832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc80ad6d0 0x7f2cc815a3b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800ba50 tx=0x7f2cb800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:38.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2cc4c00640 1 -- 172.21.15.32:0/1905174832 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8019070 con 0x7f2cc80ad6d0 2024-03-19T06:21:38.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2cc4c00640 1 -- 172.21.15.32:0/1905174832 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb800cc20 con 0x7f2cc80ad6d0 2024-03-19T06:21:38.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2cc4c00640 1 -- 172.21.15.32:0/1905174832 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8014440 con 0x7f2cc80ad6d0 2024-03-19T06:21:38.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2ccf200640 1 -- 172.21.15.32:0/1905174832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc8152d80 con 0x7f2cc80ad6d0 2024-03-19T06:21:38.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2ccf200640 1 -- 172.21.15.32:0/1905174832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc81595f0 con 0x7f2cc80ad6d0 2024-03-19T06:21:38.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.872+0000 7f2ccf200640 1 -- 172.21.15.32:0/1905174832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc80749e0 con 0x7f2cc80ad6d0 2024-03-19T06:21:38.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.876+0000 7f2cc4c00640 1 -- 172.21.15.32:0/1905174832 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2cb801c070 con 0x7f2cc80ad6d0 2024-03-19T06:21:38.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.876+0000 7f2cc4c00640 1 --2- 172.21.15.32:0/1905174832 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2ca4067660 0x7f2ca4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:38.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.876+0000 7f2cc4c00640 1 -- 172.21.15.32:0/1905174832 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cb8085570 con 0x7f2cc80ad6d0 2024-03-19T06:21:38.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.876+0000 7f2cbf400640 1 --2- 172.21.15.32:0/1905174832 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2ca4067660 0x7f2ca4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:38.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.876+0000 7f2cbf400640 1 --2- 172.21.15.32:0/1905174832 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2ca4067660 0x7f2ca4069b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00ae000 tx=0x7f2cb00a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:38.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:38.880+0000 7f2cc4c00640 1 -- 172.21.15.32:0/1905174832 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2cb8055b90 con 0x7f2cc80ad6d0 2024-03-19T06:21:39.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.044+0000 7f2ccf200640 1 -- 172.21.15.32:0/1905174832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2cc80d0bc0 con 0x7f2cc80ad6d0 2024-03-19T06:21:39.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.044+0000 7f2cc4c00640 1 -- 172.21.15.32:0/1905174832 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2cb8083e20 con 0x7f2cc80ad6d0 2024-03-19T06:21:39.036 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.044+0000 7f2ccf200640 1 -- 172.21.15.32:0/1905174832 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2ca4067660 msgr2=0x7f2ca4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.044+0000 7f2ccf200640 1 --2- 172.21.15.32:0/1905174832 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2ca4067660 0x7f2ca4069b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00ae000 tx=0x7f2cb00a7000 comp rx=0 tx=0).stop 2024-03-19T06:21:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.044+0000 7f2ccf200640 1 -- 172.21.15.32:0/1905174832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc80ad6d0 msgr2=0x7f2cc815a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.044+0000 7f2ccf200640 1 --2- 172.21.15.32:0/1905174832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc80ad6d0 0x7f2cc815a3b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800ba50 tx=0x7f2cb800bf10 comp rx=0 tx=0).stop 2024-03-19T06:21:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.044+0000 7f2ccf200640 1 -- 172.21.15.32:0/1905174832 shutdown_connections 2024-03-19T06:21:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.044+0000 7f2ccf200640 1 --2- 172.21.15.32:0/1905174832 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2ca4067660 0x7f2ca4069b20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.044+0000 7f2ccf200640 1 --2- 172.21.15.32:0/1905174832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cc815ba20 0x7f2cc8153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.044+0000 7f2ccf200640 1 --2- 172.21.15.32:0/1905174832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cc80cc850 0x7f2cc814a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.044+0000 7f2ccf200640 1 --2- 172.21.15.32:0/1905174832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc80ad6d0 0x7f2cc815a3b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.044+0000 7f2ccf200640 1 -- 172.21.15.32:0/1905174832 >> 172.21.15.32:0/1905174832 conn(0x7f2cc80b2480 msgr2=0x7f2cc80ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.044+0000 7f2ccf200640 1 -- 172.21.15.32:0/1905174832 shutdown_connections 2024-03-19T06:21:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.044+0000 7f2ccf200640 1 -- 172.21.15.32:0/1905174832 wait complete. 2024-03-19T06:21:39.058 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:21:39.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.208+0000 7f4483e00640 1 Processor -- start 2024-03-19T06:21:39.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.208+0000 7f4483e00640 1 -- start start 2024-03-19T06:21:39.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.212+0000 7f4483e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f44840d1620 0x7f44840d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.212+0000 7f4483e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f44840c51e0 0x7f44840cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.212+0000 7f4483e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44840d1f40 con 0x7f44840cc920 2024-03-19T06:21:39.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.212+0000 7f4483e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44840cd050 con 0x7f44840d1620 2024-03-19T06:21:39.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.212+0000 7f4483e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44840cd330 con 0x7f44840c51e0 2024-03-19T06:21:39.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.212+0000 7f4482a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f44840d1620 0x7f44840d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:39.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.212+0000 7f4483400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f44840cc920 0x7f448415f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48332/0 (socket says 172.21.15.32:48332) 2024-03-19T06:21:39.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.212+0000 7f4483400640 1 -- 172.21.15.32:0/1828225976 learned_addr learned my addr 172.21.15.32:0/1828225976 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:39.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.212+0000 7f447be00640 1 --2- 172.21.15.32:0/1828225976 >> v2:172.21.15.171:3300/0 conn(0x7f44840c51e0 0x7f44840cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:39.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.212+0000 7f4482a00640 1 -- 172.21.15.32:0/1828225976 >> v2:172.21.15.171:3300/0 conn(0x7f44840c51e0 msgr2=0x7f44840cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:39.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.212+0000 7f4482a00640 1 --2- 172.21.15.32:0/1828225976 >> v2:172.21.15.171:3300/0 conn(0x7f44840c51e0 0x7f44840cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.212+0000 7f4482a00640 1 -- 172.21.15.32:0/1828225976 >> v1:172.21.15.32:6789/0 conn(0x7f44840cc920 legacy=0x7f448415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.212+0000 7f4482a00640 1 -- 172.21.15.32:0/1828225976 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44840cd610 con 0x7f44840d1620 2024-03-19T06:21:39.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.212+0000 7f447be00640 1 --2- 172.21.15.32:0/1828225976 >> v2:172.21.15.171:3300/0 conn(0x7f44840c51e0 0x7f44840cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:39.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4482a00640 1 --2- 172.21.15.32:0/1828225976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44840d1620 0x7f44840d1a00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4484068940 tx=0x7f447401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c104012b57c4ade7 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:39.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4482000640 1 -- 172.21.15.32:0/1828225976 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44740b0070 con 0x7f44840d1620 2024-03-19T06:21:39.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4482000640 1 -- 172.21.15.32:0/1828225976 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44740ab600 con 0x7f44840d1620 2024-03-19T06:21:39.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4482000640 1 -- 172.21.15.32:0/1828225976 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44740ab9d0 con 0x7f44840d1620 2024-03-19T06:21:39.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483e00640 1 -- 172.21.15.32:0/1828225976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44840d1620 msgr2=0x7f44840d1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483e00640 1 --2- 172.21.15.32:0/1828225976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44840d1620 0x7f44840d1a00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4484068940 tx=0x7f447401c3c0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483e00640 1 -- 172.21.15.32:0/1828225976 shutdown_connections 2024-03-19T06:21:39.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483e00640 1 --2- 172.21.15.32:0/1828225976 >> v2:172.21.15.171:3300/0 conn(0x7f44840c51e0 0x7f44840cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483e00640 1 --2- 172.21.15.32:0/1828225976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44840d1620 0x7f44840d1a00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483e00640 1 -- 172.21.15.32:0/1828225976 >> 172.21.15.32:0/1828225976 conn(0x7f448408b000 msgr2=0x7f448408b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:39.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483e00640 1 -- 172.21.15.32:0/1828225976 shutdown_connections 2024-03-19T06:21:39.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483e00640 1 -- 172.21.15.32:0/1828225976 wait complete. 2024-03-19T06:21:39.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483e00640 1 Processor -- start 2024-03-19T06:21:39.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483e00640 1 -- start start 2024-03-19T06:21:39.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44840c51e0 0x7f4484147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44840cc920 0x7f44840c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44840d1620 0x7f44840cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448415bcc0 con 0x7f44840d1620 2024-03-19T06:21:39.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44840ccd30 con 0x7f44840c51e0 2024-03-19T06:21:39.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448415be40 con 0x7f44840cc920 2024-03-19T06:21:39.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.216+0000 7f4483400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44840d1620 0x7f44840cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:39.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f4483400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44840d1620 0x7f44840cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60706/0 (socket says 172.21.15.32:60706) 2024-03-19T06:21:39.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f4483400640 1 -- 172.21.15.32:0/2281346134 learned_addr learned my addr 172.21.15.32:0/2281346134 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:39.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f4482a00640 1 --2- 172.21.15.32:0/2281346134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44840c51e0 0x7f4484147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:39.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f447be00640 1 --2- 172.21.15.32:0/2281346134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44840cc920 0x7f44840c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:39.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f4483400640 1 -- 172.21.15.32:0/2281346134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44840cc920 msgr2=0x7f44840c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f4483400640 1 --2- 172.21.15.32:0/2281346134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44840cc920 0x7f44840c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f4483400640 1 -- 172.21.15.32:0/2281346134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44840c51e0 msgr2=0x7f4484147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f4483400640 1 --2- 172.21.15.32:0/2281346134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44840c51e0 0x7f4484147ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f4483400640 1 -- 172.21.15.32:0/2281346134 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44840c4710 con 0x7f44840d1620 2024-03-19T06:21:39.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f4483400640 1 --2- 172.21.15.32:0/2281346134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44840d1620 0x7f44840cafe0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f447c00cbc0 tx=0x7f447c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:39.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f447b400640 1 -- 172.21.15.32:0/2281346134 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c017070 con 0x7f44840d1620 2024-03-19T06:21:39.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f447b400640 1 -- 172.21.15.32:0/2281346134 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c00ad40 con 0x7f44840d1620 2024-03-19T06:21:39.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f447b400640 1 -- 172.21.15.32:0/2281346134 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c012600 con 0x7f44840d1620 2024-03-19T06:21:39.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f4483e00640 1 -- 172.21.15.32:0/2281346134 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44840c89b0 con 0x7f44840d1620 2024-03-19T06:21:39.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f4483e00640 1 -- 172.21.15.32:0/2281346134 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44840c8f70 con 0x7f44840d1620 2024-03-19T06:21:39.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f4483e00640 1 -- 172.21.15.32:0/2281346134 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4484075090 con 0x7f44840d1620 2024-03-19T06:21:39.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f447b400640 1 -- 172.21.15.32:0/2281346134 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f447c01a070 con 0x7f44840d1620 2024-03-19T06:21:39.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f447b400640 1 --2- 172.21.15.32:0/2281346134 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4460067660 0x7f4460069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.220+0000 7f447b400640 1 -- 172.21.15.32:0/2281346134 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f447c085560 con 0x7f44840d1620 2024-03-19T06:21:39.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.224+0000 7f4482a00640 1 --2- 172.21.15.32:0/2281346134 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4460067660 0x7f4460069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:39.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.224+0000 7f4482a00640 1 --2- 172.21.15.32:0/2281346134 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4460067660 0x7f4460069b20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f44740ad000 tx=0x7f4474008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:39.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.228+0000 7f447b400640 1 -- 172.21.15.32:0/2281346134 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f447c055af0 con 0x7f44840d1620 2024-03-19T06:21:39.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.388+0000 7f4483e00640 1 -- 172.21.15.32:0/2281346134 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f448408bc80 con 0x7f44840d1620 2024-03-19T06:21:39.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.388+0000 7f447b400640 1 -- 172.21.15.32:0/2281346134 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f447c059b90 con 0x7f44840d1620 2024-03-19T06:21:39.382 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:21:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.392+0000 7f4483e00640 1 -- 172.21.15.32:0/2281346134 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4460067660 msgr2=0x7f4460069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.392+0000 7f4483e00640 1 --2- 172.21.15.32:0/2281346134 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4460067660 0x7f4460069b20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f44740ad000 tx=0x7f4474008040 comp rx=0 tx=0).stop 2024-03-19T06:21:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.392+0000 7f4483e00640 1 -- 172.21.15.32:0/2281346134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44840d1620 msgr2=0x7f44840cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.392+0000 7f4483e00640 1 --2- 172.21.15.32:0/2281346134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44840d1620 0x7f44840cafe0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f447c00cbc0 tx=0x7f447c00a430 comp rx=0 tx=0).stop 2024-03-19T06:21:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.392+0000 7f4483e00640 1 -- 172.21.15.32:0/2281346134 shutdown_connections 2024-03-19T06:21:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.392+0000 7f4483e00640 1 --2- 172.21.15.32:0/2281346134 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4460067660 0x7f4460069b20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.392+0000 7f4483e00640 1 --2- 172.21.15.32:0/2281346134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44840d1620 0x7f44840cafe0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.392+0000 7f4483e00640 1 --2- 172.21.15.32:0/2281346134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44840cc920 0x7f44840c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.392+0000 7f4483e00640 1 --2- 172.21.15.32:0/2281346134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44840c51e0 0x7f4484147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.392+0000 7f4483e00640 1 -- 172.21.15.32:0/2281346134 >> 172.21.15.32:0/2281346134 conn(0x7f448408b000 msgr2=0x7f4484070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:39.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.392+0000 7f4483e00640 1 -- 172.21.15.32:0/2281346134 shutdown_connections 2024-03-19T06:21:39.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.392+0000 7f4483e00640 1 -- 172.21.15.32:0/2281346134 wait complete. 2024-03-19T06:21:39.403 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:21:39.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.552+0000 7f2c2fa00640 1 Processor -- start 2024-03-19T06:21:39.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.552+0000 7f2c2fa00640 1 -- start start 2024-03-19T06:21:39.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.556+0000 7f2c2fa00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c2815dc30 0x7f2c28071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.556+0000 7f2c2fa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2c280acda0 0x7f2c28071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.556+0000 7f2c2fa00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2806d910 con 0x7f2c280b3460 2024-03-19T06:21:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.556+0000 7f2c2fa00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2806dbf0 con 0x7f2c280acda0 2024-03-19T06:21:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.556+0000 7f2c2fa00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2806ded0 con 0x7f2c2815dc30 2024-03-19T06:21:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.556+0000 7f2c27e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2c280acda0 0x7f2c28071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.556+0000 7f2c2da00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2c280b3460 0x7f2c280b38f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48342/0 (socket says 172.21.15.32:48342) 2024-03-19T06:21:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.556+0000 7f2c2da00640 1 -- 172.21.15.32:0/3891381090 learned_addr learned my addr 172.21.15.32:0/3891381090 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.556+0000 7f2c27e00640 1 -- 172.21.15.32:0/3891381090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c2815dc30 msgr2=0x7f2c28071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.556+0000 7f2c27e00640 1 --2- 172.21.15.32:0/3891381090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c2815dc30 0x7f2c28071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.556+0000 7f2c27e00640 1 -- 172.21.15.32:0/3891381090 >> v1:172.21.15.32:6789/0 conn(0x7f2c280b3460 legacy=0x7f2c280b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.556+0000 7f2c27e00640 1 -- 172.21.15.32:0/3891381090 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2806e1b0 con 0x7f2c280acda0 2024-03-19T06:21:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c27e00640 1 --2- 172.21.15.32:0/3891381090 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c280acda0 0x7f2c28071cc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2c140097c0 tx=0x7f2c1401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9948c4cb8bbf6e19 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c27400640 1 -- 172.21.15.32:0/3891381090 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140b0070 con 0x7f2c280acda0 2024-03-19T06:21:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c27400640 1 -- 172.21.15.32:0/3891381090 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c140ab600 con 0x7f2c280acda0 2024-03-19T06:21:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c27400640 1 -- 172.21.15.32:0/3891381090 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140ab9d0 con 0x7f2c280acda0 2024-03-19T06:21:39.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c2fa00640 1 -- 172.21.15.32:0/3891381090 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c280acda0 msgr2=0x7f2c28071cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c2fa00640 1 --2- 172.21.15.32:0/3891381090 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c280acda0 0x7f2c28071cc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2c140097c0 tx=0x7f2c1401c410 comp rx=0 tx=0).stop 2024-03-19T06:21:39.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c2fa00640 1 -- 172.21.15.32:0/3891381090 shutdown_connections 2024-03-19T06:21:39.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c2fa00640 1 --2- 172.21.15.32:0/3891381090 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c280acda0 0x7f2c28071cc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c2fa00640 1 --2- 172.21.15.32:0/3891381090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c2815dc30 0x7f2c28071780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c2fa00640 1 -- 172.21.15.32:0/3891381090 >> 172.21.15.32:0/3891381090 conn(0x7f2c280cfaa0 msgr2=0x7f2c280cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:39.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c2fa00640 1 -- 172.21.15.32:0/3891381090 shutdown_connections 2024-03-19T06:21:39.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c2fa00640 1 -- 172.21.15.32:0/3891381090 wait complete. 2024-03-19T06:21:39.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c2fa00640 1 Processor -- start 2024-03-19T06:21:39.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c2fa00640 1 -- start start 2024-03-19T06:21:39.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c2fa00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c280acda0 0x7f2c28148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c2fa00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c280b3460 0x7f2c281f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c2fa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c2815dc30 0x7f2c281fa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c2fa00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2806f270 con 0x7f2c2815dc30 2024-03-19T06:21:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c2fa00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2806f0f0 con 0x7f2c280b3460 2024-03-19T06:21:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.560+0000 7f2c2fa00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2806f3f0 con 0x7f2c280acda0 2024-03-19T06:21:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c2da00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c2815dc30 0x7f2c281fa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c2da00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c2815dc30 0x7f2c281fa2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60724/0 (socket says 172.21.15.32:60724) 2024-03-19T06:21:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c2da00640 1 -- 172.21.15.32:0/3826598854 learned_addr learned my addr 172.21.15.32:0/3826598854 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c27e00640 1 --2- 172.21.15.32:0/3826598854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c280b3460 0x7f2c281f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c2d000640 1 --2- 172.21.15.32:0/3826598854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c280acda0 0x7f2c28148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c2da00640 1 -- 172.21.15.32:0/3826598854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c280acda0 msgr2=0x7f2c28148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c2da00640 1 --2- 172.21.15.32:0/3826598854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c280acda0 0x7f2c28148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c2da00640 1 -- 172.21.15.32:0/3826598854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c280b3460 msgr2=0x7f2c281f9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c2da00640 1 --2- 172.21.15.32:0/3826598854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c280b3460 0x7f2c281f9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c2da00640 1 -- 172.21.15.32:0/3826598854 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c28149b50 con 0x7f2c2815dc30 2024-03-19T06:21:39.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c2da00640 1 --2- 172.21.15.32:0/3826598854 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c2815dc30 0x7f2c281fa2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000cab0 tx=0x7f2c2000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:39.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c24c00640 1 -- 172.21.15.32:0/3826598854 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20017070 con 0x7f2c2815dc30 2024-03-19T06:21:39.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c24c00640 1 -- 172.21.15.32:0/3826598854 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2000ac30 con 0x7f2c2815dc30 2024-03-19T06:21:39.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c24c00640 1 -- 172.21.15.32:0/3826598854 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20012400 con 0x7f2c2815dc30 2024-03-19T06:21:39.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c2fa00640 1 -- 172.21.15.32:0/3826598854 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c28149e30 con 0x7f2c2815dc30 2024-03-19T06:21:39.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c2fa00640 1 -- 172.21.15.32:0/3826598854 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c281485b0 con 0x7f2c2815dc30 2024-03-19T06:21:39.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c2fa00640 1 -- 172.21.15.32:0/3826598854 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c280749e0 con 0x7f2c2815dc30 2024-03-19T06:21:39.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c24c00640 1 -- 172.21.15.32:0/3826598854 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2c2001a070 con 0x7f2c2815dc30 2024-03-19T06:21:39.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.564+0000 7f2c24c00640 1 --2- 172.21.15.32:0/3826598854 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2c08067660 0x7f2c08069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.568+0000 7f2c24c00640 1 -- 172.21.15.32:0/3826598854 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c20085440 con 0x7f2c2815dc30 2024-03-19T06:21:39.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.568+0000 7f2c2d000640 1 --2- 172.21.15.32:0/3826598854 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2c08067660 0x7f2c08069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:39.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.568+0000 7f2c2d000640 1 --2- 172.21.15.32:0/3826598854 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2c08067660 0x7f2c08069b20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009990 tx=0x7f2c1c009110 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:39.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.572+0000 7f2c24c00640 1 -- 172.21.15.32:0/3826598854 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2c20055b00 con 0x7f2c2815dc30 2024-03-19T06:21:39.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.732+0000 7f2c2fa00640 1 -- 172.21.15.32:0/3826598854 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2c280d0730 con 0x7f2c2815dc30 2024-03-19T06:21:39.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.732+0000 7f2c24c00640 1 -- 172.21.15.32:0/3826598854 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2c20059ba0 con 0x7f2c2815dc30 2024-03-19T06:21:39.725 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:21:39.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.736+0000 7f2c2fa00640 1 -- 172.21.15.32:0/3826598854 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2c08067660 msgr2=0x7f2c08069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.736+0000 7f2c2fa00640 1 --2- 172.21.15.32:0/3826598854 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2c08067660 0x7f2c08069b20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009990 tx=0x7f2c1c009110 comp rx=0 tx=0).stop 2024-03-19T06:21:39.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.736+0000 7f2c2fa00640 1 -- 172.21.15.32:0/3826598854 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c2815dc30 msgr2=0x7f2c281fa2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.736+0000 7f2c2fa00640 1 --2- 172.21.15.32:0/3826598854 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c2815dc30 0x7f2c281fa2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000cab0 tx=0x7f2c2000cf70 comp rx=0 tx=0).stop 2024-03-19T06:21:39.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.736+0000 7f2c2fa00640 1 -- 172.21.15.32:0/3826598854 shutdown_connections 2024-03-19T06:21:39.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.736+0000 7f2c2fa00640 1 --2- 172.21.15.32:0/3826598854 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2c08067660 0x7f2c08069b20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.736+0000 7f2c2fa00640 1 --2- 172.21.15.32:0/3826598854 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c2815dc30 0x7f2c281fa2f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.736+0000 7f2c2fa00640 1 --2- 172.21.15.32:0/3826598854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c280b3460 0x7f2c281f9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.736+0000 7f2c2fa00640 1 --2- 172.21.15.32:0/3826598854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c280acda0 0x7f2c28148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.736+0000 7f2c2fa00640 1 -- 172.21.15.32:0/3826598854 >> 172.21.15.32:0/3826598854 conn(0x7f2c280cfaa0 msgr2=0x7f2c2814a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:39.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.736+0000 7f2c2fa00640 1 -- 172.21.15.32:0/3826598854 shutdown_connections 2024-03-19T06:21:39.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.736+0000 7f2c2fa00640 1 -- 172.21.15.32:0/3826598854 wait complete. 2024-03-19T06:21:39.771 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) That a client who does not have the capability for setting 2024-03-19T06:21:39.771 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-03-19T06:21:39.772 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:39.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.920+0000 7f23d6c00640 1 Processor -- start 2024-03-19T06:21:39.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.920+0000 7f23d6c00640 1 -- start start 2024-03-19T06:21:39.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.920+0000 7f23d6c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d015bb20 0x7f23d009a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.920+0000 7f23d6c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d015bf00 con 0x7f23d00cf460 2024-03-19T06:21:39.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.920+0000 7f23d6c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d00cc5d0 con 0x7f23d00cd390 2024-03-19T06:21:39.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.920+0000 7f23d6c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d00cc3a0 con 0x7f23d015bb20 2024-03-19T06:21:39.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.920+0000 7f23c7400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f23d00cf460 0x7f23d00c53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48348/0 (socket says 172.21.15.32:48348) 2024-03-19T06:21:39.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.920+0000 7f23c7400640 1 -- 172.21.15.32:0/825246236 learned_addr learned my addr 172.21.15.32:0/825246236 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:39.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.920+0000 7f23cfe00640 1 --2- 172.21.15.32:0/825246236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d015bb20 0x7f23d009a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:39.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.920+0000 7f23cfe00640 1 -- 172.21.15.32:0/825246236 >> v1:172.21.15.171:6789/0 conn(0x7f23d00cd390 legacy=0x7f23d00cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.920+0000 7f23cfe00640 1 -- 172.21.15.32:0/825246236 >> v1:172.21.15.32:6789/0 conn(0x7f23d00cf460 legacy=0x7f23d00c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.920+0000 7f23cf400640 1 -- 172.21.15.32:0/825246236 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539679137 0 0) 0x7f23d00cc5d0 con 0x7f23d00cd390 2024-03-19T06:21:39.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.920+0000 7f23cfe00640 1 -- 172.21.15.32:0/825246236 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d00cc8b0 con 0x7f23d015bb20 2024-03-19T06:21:39.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.924+0000 7f23cfe00640 1 --2- 172.21.15.32:0/825246236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d015bb20 0x7f23d009a480 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f23c00097f0 tx=0x7f23c001c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caa084ba3654ec19 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:39.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.924+0000 7f23cf400640 1 -- 172.21.15.32:0/825246236 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c00b1070 con 0x7f23d015bb20 2024-03-19T06:21:39.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.924+0000 7f23cf400640 1 -- 172.21.15.32:0/825246236 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c00ac640 con 0x7f23d015bb20 2024-03-19T06:21:39.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.924+0000 7f23cf400640 1 -- 172.21.15.32:0/825246236 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c00aca10 con 0x7f23d015bb20 2024-03-19T06:21:39.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.924+0000 7f23d6c00640 1 -- 172.21.15.32:0/825246236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d015bb20 msgr2=0x7f23d009a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.924+0000 7f23d6c00640 1 --2- 172.21.15.32:0/825246236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d015bb20 0x7f23d009a480 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f23c00097f0 tx=0x7f23c001c370 comp rx=0 tx=0).stop 2024-03-19T06:21:39.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.924+0000 7f23d6c00640 1 -- 172.21.15.32:0/825246236 shutdown_connections 2024-03-19T06:21:39.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.924+0000 7f23d6c00640 1 --2- 172.21.15.32:0/825246236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d015bb20 0x7f23d009a480 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.924+0000 7f23d6c00640 1 -- 172.21.15.32:0/825246236 >> 172.21.15.32:0/825246236 conn(0x7f23d00d1890 msgr2=0x7f23d00d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:39.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.924+0000 7f23d6c00640 1 -- 172.21.15.32:0/825246236 shutdown_connections 2024-03-19T06:21:39.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.924+0000 7f23d6c00640 1 -- 172.21.15.32:0/825246236 wait complete. 2024-03-19T06:21:39.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d6c00640 1 Processor -- start 2024-03-19T06:21:39.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d6c00640 1 -- start start 2024-03-19T06:21:39.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d6c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d00cd390 0x7f23d01500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d6c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d00cf460 0x7f23d015c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d6c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23d015bb20 0x7f23d015c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d6c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d00cce70 con 0x7f23d015bb20 2024-03-19T06:21:39.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d6c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d00cfbb0 con 0x7f23d00cd390 2024-03-19T06:21:39.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d6c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d00c5af0 con 0x7f23d00cf460 2024-03-19T06:21:39.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d4c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23d015bb20 0x7f23d015c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:39.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23cfe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d00cd390 0x7f23d01500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:39.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23cfe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d00cd390 0x7f23d01500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:53736/0 (socket says 172.21.15.32:53736) 2024-03-19T06:21:39.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23cfe00640 1 -- 172.21.15.32:0/472766903 learned_addr learned my addr 172.21.15.32:0/472766903 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:39.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d4c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23d015bb20 0x7f23d015c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60728/0 (socket says 172.21.15.32:60728) 2024-03-19T06:21:39.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23c7400640 1 --2- 172.21.15.32:0/472766903 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d00cf460 0x7f23d015c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:39.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d4c00640 1 -- 172.21.15.32:0/472766903 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d00cf460 msgr2=0x7f23d015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d4c00640 1 --2- 172.21.15.32:0/472766903 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d00cf460 0x7f23d015c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d4c00640 1 -- 172.21.15.32:0/472766903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d00cd390 msgr2=0x7f23d01500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:39.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d4c00640 1 --2- 172.21.15.32:0/472766903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d00cd390 0x7f23d01500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:39.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d4c00640 1 -- 172.21.15.32:0/472766903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d01505f0 con 0x7f23d015bb20 2024-03-19T06:21:39.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23cfe00640 1 --2- 172.21.15.32:0/472766903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d00cd390 0x7f23d01500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:39.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d4c00640 1 --2- 172.21.15.32:0/472766903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23d015bb20 0x7f23d015c640 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f23c800c750 tx=0x7f23c800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:39.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23ccc00640 1 -- 172.21.15.32:0/472766903 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c8003b80 con 0x7f23d015bb20 2024-03-19T06:21:39.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23ccc00640 1 -- 172.21.15.32:0/472766903 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c8003d20 con 0x7f23d015bb20 2024-03-19T06:21:39.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d6c00640 1 -- 172.21.15.32:0/472766903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d015cc70 con 0x7f23d015bb20 2024-03-19T06:21:39.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23ccc00640 1 -- 172.21.15.32:0/472766903 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c80052b0 con 0x7f23d015bb20 2024-03-19T06:21:39.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.928+0000 7f23d6c00640 1 -- 172.21.15.32:0/472766903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d00b4930 con 0x7f23d015bb20 2024-03-19T06:21:39.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.932+0000 7f23d6c00640 1 -- 172.21.15.32:0/472766903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d00b7810 con 0x7f23d015bb20 2024-03-19T06:21:39.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.932+0000 7f23ccc00640 1 -- 172.21.15.32:0/472766903 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f23c8005450 con 0x7f23d015bb20 2024-03-19T06:21:39.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.932+0000 7f23ccc00640 1 --2- 172.21.15.32:0/472766903 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f23ac067660 0x7f23ac069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:39.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.932+0000 7f23ccc00640 1 -- 172.21.15.32:0/472766903 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23c8085520 con 0x7f23d015bb20 2024-03-19T06:21:39.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.932+0000 7f23cfe00640 1 --2- 172.21.15.32:0/472766903 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f23ac067660 0x7f23ac069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:39.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.932+0000 7f23cfe00640 1 --2- 172.21.15.32:0/472766903 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f23ac067660 0x7f23ac069b20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f23c001aa20 tx=0x7f23c00a6070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:39.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:39.936+0000 7f23ccc00640 1 -- 172.21.15.32:0/472766903 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f23d01505f0 con 0x7f23d015bb20 2024-03-19T06:21:40.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.100+0000 7f23d6c00640 1 -- 172.21.15.32:0/472766903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23d0159140 con 0x7f23d015bb20 2024-03-19T06:21:40.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.104+0000 7f23ccc00640 1 -- 172.21.15.32:0/472766903 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f23c8055b40 con 0x7f23d015bb20 2024-03-19T06:21:40.095 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:40.095 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:10.423479+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.104+0000 7f23d6c00640 1 -- 172.21.15.32:0/472766903 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f23ac067660 msgr2=0x7f23ac069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.104+0000 7f23d6c00640 1 --2- 172.21.15.32:0/472766903 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f23ac067660 0x7f23ac069b20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f23c001aa20 tx=0x7f23c00a6070 comp rx=0 tx=0).stop 2024-03-19T06:21:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.104+0000 7f23d6c00640 1 -- 172.21.15.32:0/472766903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23d015bb20 msgr2=0x7f23d015c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.104+0000 7f23d6c00640 1 --2- 172.21.15.32:0/472766903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23d015bb20 0x7f23d015c640 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f23c800c750 tx=0x7f23c800cc10 comp rx=0 tx=0).stop 2024-03-19T06:21:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.104+0000 7f23d6c00640 1 -- 172.21.15.32:0/472766903 shutdown_connections 2024-03-19T06:21:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.104+0000 7f23d6c00640 1 --2- 172.21.15.32:0/472766903 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f23ac067660 0x7f23ac069b20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.104+0000 7f23d6c00640 1 --2- 172.21.15.32:0/472766903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23d015bb20 0x7f23d015c640 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.104+0000 7f23d6c00640 1 --2- 172.21.15.32:0/472766903 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23d00cf460 0x7f23d015c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.104+0000 7f23d6c00640 1 --2- 172.21.15.32:0/472766903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23d00cd390 0x7f23d01500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.104+0000 7f23d6c00640 1 -- 172.21.15.32:0/472766903 >> 172.21.15.32:0/472766903 conn(0x7f23d00d1890 msgr2=0x7f23d0074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.104+0000 7f23d6c00640 1 -- 172.21.15.32:0/472766903 shutdown_connections 2024-03-19T06:21:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.104+0000 7f23d6c00640 1 -- 172.21.15.32:0/472766903 wait complete. 2024-03-19T06:21:40.117 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:21:07.089673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:21:07.801319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:40.118 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:40.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.268+0000 7f47ada00640 1 Processor -- start 2024-03-19T06:21:40.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.268+0000 7f47ada00640 1 -- start start 2024-03-19T06:21:40.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.268+0000 7f47ada00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f47a815dbb0 0x7f47a806c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.268+0000 7f47ada00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47a80b3d30 0x7f47a80cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.268+0000 7f47ada00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a80cbf00 con 0x7f47a806c5a0 2024-03-19T06:21:40.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.268+0000 7f47ada00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a806cb20 con 0x7f47a815dbb0 2024-03-19T06:21:40.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.268+0000 7f47ada00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a806ce00 con 0x7f47a80b3d30 2024-03-19T06:21:40.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.268+0000 7f479fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f47a806c5a0 0x7f47a80b3620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48364/0 (socket says 172.21.15.32:48364) 2024-03-19T06:21:40.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.268+0000 7f479fe00640 1 -- 172.21.15.32:0/409128412 learned_addr learned my addr 172.21.15.32:0/409128412 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:40.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.268+0000 7f47a7400640 1 --2- 172.21.15.32:0/409128412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47a80b3d30 0x7f47a80cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.268+0000 7f47a6a00640 1 --2- 172.21.15.32:0/409128412 >> v2:172.21.15.171:3300/0 conn(0x7f47a815dbb0 0x7f47a806c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.272+0000 7f47a6000640 1 -- 172.21.15.32:0/409128412 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257394349 0 0) 0x7f47a80cbf00 con 0x7f47a806c5a0 2024-03-19T06:21:40.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.272+0000 7f47a6000640 1 -- 172.21.15.32:0/409128412 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f478c003530 con 0x7f47a806c5a0 2024-03-19T06:21:40.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.272+0000 7f47a7400640 1 -- 172.21.15.32:0/409128412 >> v2:172.21.15.171:3300/0 conn(0x7f47a815dbb0 msgr2=0x7f47a806c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:40.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.272+0000 7f47a7400640 1 --2- 172.21.15.32:0/409128412 >> v2:172.21.15.171:3300/0 conn(0x7f47a815dbb0 0x7f47a806c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.272+0000 7f47a7400640 1 -- 172.21.15.32:0/409128412 >> v1:172.21.15.32:6789/0 conn(0x7f47a806c5a0 legacy=0x7f47a80b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.272+0000 7f47a7400640 1 -- 172.21.15.32:0/409128412 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a806d0e0 con 0x7f47a80b3d30 2024-03-19T06:21:40.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.272+0000 7f47a6a00640 1 --2- 172.21.15.32:0/409128412 >> v2:172.21.15.171:3300/0 conn(0x7f47a815dbb0 0x7f47a806c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:40.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.272+0000 7f47a7400640 1 --2- 172.21.15.32:0/409128412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47a80b3d30 0x7f47a80cc6c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009d90 tx=0x7f47a001f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43296e761d819b99 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:40.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.272+0000 7f47a6000640 1 -- 172.21.15.32:0/409128412 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a00b4070 con 0x7f47a80b3d30 2024-03-19T06:21:40.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.272+0000 7f47a6000640 1 -- 172.21.15.32:0/409128412 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a00af600 con 0x7f47a80b3d30 2024-03-19T06:21:40.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.272+0000 7f47a6000640 1 -- 172.21.15.32:0/409128412 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a00af9d0 con 0x7f47a80b3d30 2024-03-19T06:21:40.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47ada00640 1 -- 172.21.15.32:0/409128412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47a80b3d30 msgr2=0x7f47a80cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47ada00640 1 --2- 172.21.15.32:0/409128412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47a80b3d30 0x7f47a80cc6c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009d90 tx=0x7f47a001f150 comp rx=0 tx=0).stop 2024-03-19T06:21:40.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47ada00640 1 -- 172.21.15.32:0/409128412 shutdown_connections 2024-03-19T06:21:40.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47ada00640 1 --2- 172.21.15.32:0/409128412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47a80b3d30 0x7f47a80cc6c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47ada00640 1 --2- 172.21.15.32:0/409128412 >> v2:172.21.15.171:3300/0 conn(0x7f47a815dbb0 0x7f47a806c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47ada00640 1 -- 172.21.15.32:0/409128412 >> 172.21.15.32:0/409128412 conn(0x7f47a8066ca0 msgr2=0x7f47a80670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:40.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47ada00640 1 -- 172.21.15.32:0/409128412 shutdown_connections 2024-03-19T06:21:40.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47ada00640 1 -- 172.21.15.32:0/409128412 wait complete. 2024-03-19T06:21:40.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47ada00640 1 Processor -- start 2024-03-19T06:21:40.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47ada00640 1 -- start start 2024-03-19T06:21:40.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47ada00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47a806c5a0 0x7f47a80b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47ada00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47a80b3d30 0x7f47a81597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47ada00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47a815dbb0 0x7f47a8156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47ada00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a815df90 con 0x7f47a80b3d30 2024-03-19T06:21:40.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47ada00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a806d910 con 0x7f47a815dbb0 2024-03-19T06:21:40.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47ada00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80ccc00 con 0x7f47a806c5a0 2024-03-19T06:21:40.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f479fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47a80b3d30 0x7f47a81597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f479fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47a80b3d30 0x7f47a81597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60740/0 (socket says 172.21.15.32:60740) 2024-03-19T06:21:40.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f479fe00640 1 -- 172.21.15.32:0/1313109717 learned_addr learned my addr 172.21.15.32:0/1313109717 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:40.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47a6a00640 1 --2- 172.21.15.32:0/1313109717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47a806c5a0 0x7f47a80b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f47a7400640 1 --2- 172.21.15.32:0/1313109717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47a815dbb0 0x7f47a8156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f479fe00640 1 -- 172.21.15.32:0/1313109717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47a806c5a0 msgr2=0x7f47a80b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f479fe00640 1 --2- 172.21.15.32:0/1313109717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47a806c5a0 0x7f47a80b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f479fe00640 1 -- 172.21.15.32:0/1313109717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47a815dbb0 msgr2=0x7f47a8156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f479fe00640 1 --2- 172.21.15.32:0/1313109717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47a815dbb0 0x7f47a8156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f479fe00640 1 -- 172.21.15.32:0/1313109717 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a8159d00 con 0x7f47a80b3d30 2024-03-19T06:21:40.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f479fe00640 1 --2- 172.21.15.32:0/1313109717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47a80b3d30 0x7f47a81597c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f479000c460 tx=0x7f479000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:40.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.276+0000 7f479ea00640 1 -- 172.21.15.32:0/1313109717 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790017070 con 0x7f47a80b3d30 2024-03-19T06:21:40.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.280+0000 7f479ea00640 1 -- 172.21.15.32:0/1313109717 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4790005d10 con 0x7f47a80b3d30 2024-03-19T06:21:40.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.280+0000 7f479ea00640 1 -- 172.21.15.32:0/1313109717 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47900072b0 con 0x7f47a80b3d30 2024-03-19T06:21:40.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.280+0000 7f47ada00640 1 -- 172.21.15.32:0/1313109717 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a8159fa0 con 0x7f47a80b3d30 2024-03-19T06:21:40.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.280+0000 7f47ada00640 1 -- 172.21.15.32:0/1313109717 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a81579d0 con 0x7f47a80b3d30 2024-03-19T06:21:40.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.280+0000 7f47ada00640 1 -- 172.21.15.32:0/1313109717 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a80749e0 con 0x7f47a80b3d30 2024-03-19T06:21:40.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.280+0000 7f479ea00640 1 -- 172.21.15.32:0/1313109717 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f479001a070 con 0x7f47a80b3d30 2024-03-19T06:21:40.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.280+0000 7f479ea00640 1 --2- 172.21.15.32:0/1313109717 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4784067660 0x7f4784069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.280+0000 7f479ea00640 1 -- 172.21.15.32:0/1313109717 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4790084b70 con 0x7f47a80b3d30 2024-03-19T06:21:40.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.280+0000 7f47a6a00640 1 --2- 172.21.15.32:0/1313109717 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4784067660 0x7f4784069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.284+0000 7f47a6a00640 1 --2- 172.21.15.32:0/1313109717 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4784067660 0x7f4784069b20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4798009580 tx=0x7f4798009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:40.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.284+0000 7f479ea00640 1 -- 172.21.15.32:0/1313109717 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f4790055190 con 0x7f47a80b3d30 2024-03-19T06:21:40.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.448+0000 7f47ada00640 1 -- 172.21.15.32:0/1313109717 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47a80d23a0 con 0x7f47a80b3d30 2024-03-19T06:21:40.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.448+0000 7f479ea00640 1 -- 172.21.15.32:0/1313109717 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4790059230 con 0x7f47a80b3d30 2024-03-19T06:21:40.442 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:40.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.452+0000 7f47ada00640 1 -- 172.21.15.32:0/1313109717 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4784067660 msgr2=0x7f4784069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.452+0000 7f47ada00640 1 --2- 172.21.15.32:0/1313109717 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4784067660 0x7f4784069b20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4798009580 tx=0x7f4798009190 comp rx=0 tx=0).stop 2024-03-19T06:21:40.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.452+0000 7f47ada00640 1 -- 172.21.15.32:0/1313109717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47a80b3d30 msgr2=0x7f47a81597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.452+0000 7f47ada00640 1 --2- 172.21.15.32:0/1313109717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47a80b3d30 0x7f47a81597c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f479000c460 tx=0x7f479000c920 comp rx=0 tx=0).stop 2024-03-19T06:21:40.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.452+0000 7f47ada00640 1 -- 172.21.15.32:0/1313109717 shutdown_connections 2024-03-19T06:21:40.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.452+0000 7f47ada00640 1 --2- 172.21.15.32:0/1313109717 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4784067660 0x7f4784069b20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.452+0000 7f47ada00640 1 --2- 172.21.15.32:0/1313109717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47a815dbb0 0x7f47a8156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.452+0000 7f47ada00640 1 --2- 172.21.15.32:0/1313109717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47a80b3d30 0x7f47a81597c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.452+0000 7f47ada00640 1 --2- 172.21.15.32:0/1313109717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47a806c5a0 0x7f47a80b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.452+0000 7f47ada00640 1 -- 172.21.15.32:0/1313109717 >> 172.21.15.32:0/1313109717 conn(0x7f47a8066ca0 msgr2=0x7f47a80b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:40.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.452+0000 7f47ada00640 1 -- 172.21.15.32:0/1313109717 shutdown_connections 2024-03-19T06:21:40.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.452+0000 7f47ada00640 1 -- 172.21.15.32:0/1313109717 wait complete. 2024-03-19T06:21:40.463 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:21:40.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.612+0000 7f7421600640 1 Processor -- start 2024-03-19T06:21:40.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.616+0000 7f7421600640 1 -- start start 2024-03-19T06:21:40.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.616+0000 7f7421600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f741c15dbb0 0x7f741c06c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.616+0000 7f7421600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f741c0b3d30 0x7f741c0cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.616+0000 7f7421600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c0cbf00 con 0x7f741c06c5a0 2024-03-19T06:21:40.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.616+0000 7f7421600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741c06cb20 con 0x7f741c0b3d30 2024-03-19T06:21:40.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.616+0000 7f7421600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c06ce00 con 0x7f741c15dbb0 2024-03-19T06:21:40.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.616+0000 7f7412000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f741c06c5a0 0x7f741c0b3620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48370/0 (socket says 172.21.15.32:48370) 2024-03-19T06:21:40.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.616+0000 7f7412000640 1 -- 172.21.15.32:0/1997675326 learned_addr learned my addr 172.21.15.32:0/1997675326 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:40.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.616+0000 7f741b400640 1 --2- 172.21.15.32:0/1997675326 >> v2:172.21.15.32:3300/0 conn(0x7f741c0b3d30 0x7f741c0cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.616+0000 7f741aa00640 1 --2- 172.21.15.32:0/1997675326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f741c15dbb0 0x7f741c06c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.616+0000 7f741b400640 1 -- 172.21.15.32:0/1997675326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f741c15dbb0 msgr2=0x7f741c06c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:40.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.616+0000 7f741b400640 1 --2- 172.21.15.32:0/1997675326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f741c15dbb0 0x7f741c06c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.616+0000 7f741b400640 1 -- 172.21.15.32:0/1997675326 >> v1:172.21.15.32:6789/0 conn(0x7f741c06c5a0 legacy=0x7f741c0b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.616+0000 7f741b400640 1 -- 172.21.15.32:0/1997675326 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c06d0e0 con 0x7f741c0b3d30 2024-03-19T06:21:40.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.616+0000 7f741a000640 1 -- 172.21.15.32:0/1997675326 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488929452 0 0) 0x7f741c0cbf00 con 0x7f741c06c5a0 2024-03-19T06:21:40.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.620+0000 7f741b400640 1 --2- 172.21.15.32:0/1997675326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c0b3d30 0x7f741c0cc6c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f74140097c0 tx=0x7f741401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd7cd207a5b584b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:40.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.620+0000 7f741a000640 1 -- 172.21.15.32:0/1997675326 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74140b5070 con 0x7f741c0b3d30 2024-03-19T06:21:40.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.620+0000 7f741a000640 1 -- 172.21.15.32:0/1997675326 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74140a8990 con 0x7f741c0b3d30 2024-03-19T06:21:40.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.620+0000 7f741a000640 1 -- 172.21.15.32:0/1997675326 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74140a8d60 con 0x7f741c0b3d30 2024-03-19T06:21:40.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.620+0000 7f7421600640 1 -- 172.21.15.32:0/1997675326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c0b3d30 msgr2=0x7f741c0cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.620+0000 7f7421600640 1 --2- 172.21.15.32:0/1997675326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c0b3d30 0x7f741c0cc6c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f74140097c0 tx=0x7f741401ec90 comp rx=0 tx=0).stop 2024-03-19T06:21:40.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.620+0000 7f7421600640 1 -- 172.21.15.32:0/1997675326 shutdown_connections 2024-03-19T06:21:40.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.620+0000 7f7421600640 1 --2- 172.21.15.32:0/1997675326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c0b3d30 0x7f741c0cc6c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.620+0000 7f7421600640 1 --2- 172.21.15.32:0/1997675326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f741c15dbb0 0x7f741c06c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.620+0000 7f7421600640 1 -- 172.21.15.32:0/1997675326 >> 172.21.15.32:0/1997675326 conn(0x7f741c066ca0 msgr2=0x7f741c0670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:40.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.620+0000 7f7421600640 1 -- 172.21.15.32:0/1997675326 shutdown_connections 2024-03-19T06:21:40.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.620+0000 7f7421600640 1 -- 172.21.15.32:0/1997675326 wait complete. 2024-03-19T06:21:40.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.620+0000 7f7421600640 1 Processor -- start 2024-03-19T06:21:40.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.620+0000 7f7421600640 1 -- start start 2024-03-19T06:21:40.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f7421600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f741c06c5a0 0x7f741c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f7421600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f741c0b3d30 0x7f741c0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f7421600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c15dbb0 0x7f741c0c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f7421600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c15df90 con 0x7f741c15dbb0 2024-03-19T06:21:40.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f7421600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c06d910 con 0x7f741c0b3d30 2024-03-19T06:21:40.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f7421600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0ccc00 con 0x7f741c06c5a0 2024-03-19T06:21:40.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f741b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c15dbb0 0x7f741c0c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f741b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c15dbb0 0x7f741c0c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60760/0 (socket says 172.21.15.32:60760) 2024-03-19T06:21:40.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f741b400640 1 -- 172.21.15.32:0/3934377733 learned_addr learned my addr 172.21.15.32:0/3934377733 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:40.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f741aa00640 1 --2- 172.21.15.32:0/3934377733 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f741c06c5a0 0x7f741c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f7412000640 1 --2- 172.21.15.32:0/3934377733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f741c0b3d30 0x7f741c0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f741b400640 1 -- 172.21.15.32:0/3934377733 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f741c06c5a0 msgr2=0x7f741c0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f741b400640 1 --2- 172.21.15.32:0/3934377733 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f741c06c5a0 0x7f741c0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f741b400640 1 -- 172.21.15.32:0/3934377733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f741c0b3d30 msgr2=0x7f741c0c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f741b400640 1 --2- 172.21.15.32:0/3934377733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f741c0b3d30 0x7f741c0c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f741b400640 1 -- 172.21.15.32:0/3934377733 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c0ca170 con 0x7f741c15dbb0 2024-03-19T06:21:40.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f741b400640 1 --2- 172.21.15.32:0/3934377733 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c15dbb0 0x7f741c0c5590 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f74140097c0 tx=0x7f741401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:40.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f7413400640 1 -- 172.21.15.32:0/3934377733 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74140bf070 con 0x7f741c15dbb0 2024-03-19T06:21:40.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f7413400640 1 -- 172.21.15.32:0/3934377733 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74140b06c0 con 0x7f741c15dbb0 2024-03-19T06:21:40.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f7421600640 1 -- 172.21.15.32:0/3934377733 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c0ca450 con 0x7f741c15dbb0 2024-03-19T06:21:40.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f7413400640 1 -- 172.21.15.32:0/3934377733 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74140b5040 con 0x7f741c15dbb0 2024-03-19T06:21:40.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f7421600640 1 -- 172.21.15.32:0/3934377733 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c0caa10 con 0x7f741c15dbb0 2024-03-19T06:21:40.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f7421600640 1 -- 172.21.15.32:0/3934377733 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c0749e0 con 0x7f741c15dbb0 2024-03-19T06:21:40.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.624+0000 7f7413400640 1 -- 172.21.15.32:0/3934377733 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f74140c2070 con 0x7f741c15dbb0 2024-03-19T06:21:40.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.628+0000 7f7413400640 1 --2- 172.21.15.32:0/3934377733 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f73f8067660 0x7f73f8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.628+0000 7f7413400640 1 -- 172.21.15.32:0/3934377733 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74141220d0 con 0x7f741c15dbb0 2024-03-19T06:21:40.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.628+0000 7f741aa00640 1 --2- 172.21.15.32:0/3934377733 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f73f8067660 0x7f73f8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.628+0000 7f741aa00640 1 --2- 172.21.15.32:0/3934377733 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f73f8067660 0x7f73f8069b20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f740c003ab0 tx=0x7f740c009830 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:40.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.632+0000 7f7413400640 1 -- 172.21.15.32:0/3934377733 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f74140187f0 con 0x7f741c15dbb0 2024-03-19T06:21:40.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.792+0000 7f7421600640 1 -- 172.21.15.32:0/3934377733 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f741c06d670 con 0x7f741c15dbb0 2024-03-19T06:21:40.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.792+0000 7f7413400640 1 -- 172.21.15.32:0/3934377733 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74140f2670 con 0x7f741c15dbb0 2024-03-19T06:21:40.786 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:21:40.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.796+0000 7f7421600640 1 -- 172.21.15.32:0/3934377733 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f73f8067660 msgr2=0x7f73f8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.796+0000 7f7421600640 1 --2- 172.21.15.32:0/3934377733 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f73f8067660 0x7f73f8069b20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f740c003ab0 tx=0x7f740c009830 comp rx=0 tx=0).stop 2024-03-19T06:21:40.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.796+0000 7f7421600640 1 -- 172.21.15.32:0/3934377733 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c15dbb0 msgr2=0x7f741c0c5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.796+0000 7f7421600640 1 --2- 172.21.15.32:0/3934377733 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c15dbb0 0x7f741c0c5590 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f74140097c0 tx=0x7f741401ba30 comp rx=0 tx=0).stop 2024-03-19T06:21:40.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.796+0000 7f7421600640 1 -- 172.21.15.32:0/3934377733 shutdown_connections 2024-03-19T06:21:40.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.796+0000 7f7421600640 1 --2- 172.21.15.32:0/3934377733 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f73f8067660 0x7f73f8069b20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.796+0000 7f7421600640 1 --2- 172.21.15.32:0/3934377733 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c15dbb0 0x7f741c0c5590 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.796+0000 7f7421600640 1 --2- 172.21.15.32:0/3934377733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f741c0b3d30 0x7f741c0c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.796+0000 7f7421600640 1 --2- 172.21.15.32:0/3934377733 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f741c06c5a0 0x7f741c0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.796+0000 7f7421600640 1 -- 172.21.15.32:0/3934377733 >> 172.21.15.32:0/3934377733 conn(0x7f741c066ca0 msgr2=0x7f741c0b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:40.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.796+0000 7f7421600640 1 -- 172.21.15.32:0/3934377733 shutdown_connections 2024-03-19T06:21:40.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.796+0000 7f7421600640 1 -- 172.21.15.32:0/3934377733 wait complete. 2024-03-19T06:21:40.808 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:21:40.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.960+0000 7fc8ae000640 1 Processor -- start 2024-03-19T06:21:40.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.960+0000 7fc8ae000640 1 -- start start 2024-03-19T06:21:40.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.960+0000 7fc8ae000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc8a815ba00 0x7fc8a80b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.960+0000 7fc8ae000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc8a80b7530 0x7fc8a80b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.960+0000 7fc8ae000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a80b4010 con 0x7fc8a80b3c10 2024-03-19T06:21:40.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.960+0000 7fc8ae000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a80d20c0 con 0x7fc8a80b7530 2024-03-19T06:21:40.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.960+0000 7fc8ae000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a80d08f0 con 0x7fc8a815ba00 2024-03-19T06:21:40.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.960+0000 7fc89ea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc8a80b7530 0x7fc8a80b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.960+0000 7fc89ea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc8a80b7530 0x7fc8a80b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60772/0 (socket says 172.21.15.32:60772) 2024-03-19T06:21:40.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.960+0000 7fc89ea00640 1 -- 172.21.15.32:0/3764634614 learned_addr learned my addr 172.21.15.32:0/3764634614 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:40.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.960+0000 7fc8a7400640 1 --2- 172.21.15.32:0/3764634614 >> v2:172.21.15.171:3300/0 conn(0x7fc8a815ba00 0x7fc8a80b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.960+0000 7fc89ea00640 1 -- 172.21.15.32:0/3764634614 >> v2:172.21.15.171:3300/0 conn(0x7fc8a815ba00 msgr2=0x7fc8a80b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:40.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.960+0000 7fc89ea00640 1 --2- 172.21.15.32:0/3764634614 >> v2:172.21.15.171:3300/0 conn(0x7fc8a815ba00 0x7fc8a80b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.960+0000 7fc89ea00640 1 -- 172.21.15.32:0/3764634614 >> v1:172.21.15.171:6789/0 conn(0x7fc8a80b3c10 legacy=0x7fc8a815f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.960+0000 7fc89ea00640 1 -- 172.21.15.32:0/3764634614 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a80d14b0 con 0x7fc8a80b7530 2024-03-19T06:21:40.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.964+0000 7fc89ea00640 1 --2- 172.21.15.32:0/3764634614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8a80b7530 0x7fc8a80b36d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80b43e0 tx=0x7fc89001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c66a1b7fa9840b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:40.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.964+0000 7fc8a6a00640 1 -- 172.21.15.32:0/3764634614 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8900b5070 con 0x7fc8a80b7530 2024-03-19T06:21:40.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.964+0000 7fc8a6a00640 1 -- 172.21.15.32:0/3764634614 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8900a8a10 con 0x7fc8a80b7530 2024-03-19T06:21:40.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.964+0000 7fc8a6a00640 1 -- 172.21.15.32:0/3764634614 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8900a8de0 con 0x7fc8a80b7530 2024-03-19T06:21:40.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.964+0000 7fc8ae000640 1 -- 172.21.15.32:0/3764634614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8a80b7530 msgr2=0x7fc8a80b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.964+0000 7fc8ae000640 1 --2- 172.21.15.32:0/3764634614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8a80b7530 0x7fc8a80b36d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80b43e0 tx=0x7fc89001ed10 comp rx=0 tx=0).stop 2024-03-19T06:21:40.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.964+0000 7fc8ae000640 1 -- 172.21.15.32:0/3764634614 shutdown_connections 2024-03-19T06:21:40.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.964+0000 7fc8ae000640 1 --2- 172.21.15.32:0/3764634614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8a80b7530 0x7fc8a80b36d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.964+0000 7fc8ae000640 1 --2- 172.21.15.32:0/3764634614 >> v2:172.21.15.171:3300/0 conn(0x7fc8a815ba00 0x7fc8a80b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.964+0000 7fc8ae000640 1 -- 172.21.15.32:0/3764634614 >> 172.21.15.32:0/3764634614 conn(0x7fc8a8066ca0 msgr2=0x7fc8a80670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:40.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.964+0000 7fc8ae000640 1 -- 172.21.15.32:0/3764634614 shutdown_connections 2024-03-19T06:21:40.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.964+0000 7fc8ae000640 1 -- 172.21.15.32:0/3764634614 wait complete. 2024-03-19T06:21:40.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8ae000640 1 Processor -- start 2024-03-19T06:21:40.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8ae000640 1 -- start start 2024-03-19T06:21:40.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8ae000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8a80b3c10 0x7fc8a80c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8ae000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8a80b7530 0x7fc8a81538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8ae000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8a815ba00 0x7fc8a8150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8ae000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80d1d50 con 0x7fc8a815ba00 2024-03-19T06:21:40.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8ae000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80d1a70 con 0x7fc8a80b7530 2024-03-19T06:21:40.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8ae000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a815bde0 con 0x7fc8a80b3c10 2024-03-19T06:21:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8a7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8a815ba00 0x7fc8a8150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8a7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8a815ba00 0x7fc8a8150600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60778/0 (socket says 172.21.15.32:60778) 2024-03-19T06:21:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8a7e00640 1 -- 172.21.15.32:0/2509994558 learned_addr learned my addr 172.21.15.32:0/2509994558 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8a7400640 1 --2- 172.21.15.32:0/2509994558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8a80b3c10 0x7fc8a80c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc89ea00640 1 --2- 172.21.15.32:0/2509994558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8a80b7530 0x7fc8a81538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8a7e00640 1 -- 172.21.15.32:0/2509994558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8a80b3c10 msgr2=0x7fc8a80c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8a7e00640 1 --2- 172.21.15.32:0/2509994558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8a80b3c10 0x7fc8a80c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8a7e00640 1 -- 172.21.15.32:0/2509994558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8a80b7530 msgr2=0x7fc8a81538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8a7e00640 1 --2- 172.21.15.32:0/2509994558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8a80b7530 0x7fc8a81538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8a7e00640 1 -- 172.21.15.32:0/2509994558 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a80c57b0 con 0x7fc8a815ba00 2024-03-19T06:21:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8a7e00640 1 --2- 172.21.15.32:0/2509994558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8a815ba00 0x7fc8a8150600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000c460 tx=0x7fc8a000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc89fe00640 1 -- 172.21.15.32:0/2509994558 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0016020 con 0x7fc8a815ba00 2024-03-19T06:21:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc89fe00640 1 -- 172.21.15.32:0/2509994558 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a0005220 con 0x7fc8a815ba00 2024-03-19T06:21:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8ae000640 1 -- 172.21.15.32:0/2509994558 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a80c5a90 con 0x7fc8a815ba00 2024-03-19T06:21:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc89fe00640 1 -- 172.21.15.32:0/2509994558 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0007030 con 0x7fc8a815ba00 2024-03-19T06:21:40.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.968+0000 7fc8ae000640 1 -- 172.21.15.32:0/2509994558 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a80c6050 con 0x7fc8a815ba00 2024-03-19T06:21:40.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.972+0000 7fc8ae000640 1 -- 172.21.15.32:0/2509994558 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a80749e0 con 0x7fc8a815ba00 2024-03-19T06:21:40.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.972+0000 7fc89fe00640 1 -- 172.21.15.32:0/2509994558 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc8a00071d0 con 0x7fc8a815ba00 2024-03-19T06:21:40.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.972+0000 7fc89fe00640 1 --2- 172.21.15.32:0/2509994558 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc884067660 0x7fc884069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:40.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.972+0000 7fc89fe00640 1 -- 172.21.15.32:0/2509994558 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8a0085120 con 0x7fc8a815ba00 2024-03-19T06:21:40.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.972+0000 7fc8a7400640 1 --2- 172.21.15.32:0/2509994558 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc884067660 0x7fc884069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:40.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.972+0000 7fc8a7400640 1 --2- 172.21.15.32:0/2509994558 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc884067660 0x7fc884069b20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc898003ab0 tx=0x7fc898009830 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:40.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:40.976+0000 7fc89fe00640 1 -- 172.21.15.32:0/2509994558 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fc8a0020020 con 0x7fc8a815ba00 2024-03-19T06:21:41.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.140+0000 7fc8ae000640 1 -- 172.21.15.32:0/2509994558 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc8a815f350 con 0x7fc8a815ba00 2024-03-19T06:21:41.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.144+0000 7fc89fe00640 1 -- 172.21.15.32:0/2509994558 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc8a00074c0 con 0x7fc8a815ba00 2024-03-19T06:21:41.135 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:21:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.144+0000 7fc8ae000640 1 -- 172.21.15.32:0/2509994558 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc884067660 msgr2=0x7fc884069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.144+0000 7fc8ae000640 1 --2- 172.21.15.32:0/2509994558 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc884067660 0x7fc884069b20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc898003ab0 tx=0x7fc898009830 comp rx=0 tx=0).stop 2024-03-19T06:21:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.144+0000 7fc8ae000640 1 -- 172.21.15.32:0/2509994558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8a815ba00 msgr2=0x7fc8a8150600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.144+0000 7fc8ae000640 1 --2- 172.21.15.32:0/2509994558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8a815ba00 0x7fc8a8150600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000c460 tx=0x7fc8a000c920 comp rx=0 tx=0).stop 2024-03-19T06:21:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.144+0000 7fc8ae000640 1 -- 172.21.15.32:0/2509994558 shutdown_connections 2024-03-19T06:21:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.144+0000 7fc8ae000640 1 --2- 172.21.15.32:0/2509994558 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc884067660 0x7fc884069b20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.144+0000 7fc8ae000640 1 --2- 172.21.15.32:0/2509994558 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8a815ba00 0x7fc8a8150600 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:41.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.144+0000 7fc8ae000640 1 --2- 172.21.15.32:0/2509994558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8a80b7530 0x7fc8a81538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:41.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.144+0000 7fc8ae000640 1 --2- 172.21.15.32:0/2509994558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8a80b3c10 0x7fc8a80c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:41.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.144+0000 7fc8ae000640 1 -- 172.21.15.32:0/2509994558 >> 172.21.15.32:0/2509994558 conn(0x7fc8a8066ca0 msgr2=0x7fc8a80b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:41.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.144+0000 7fc8ae000640 1 -- 172.21.15.32:0/2509994558 shutdown_connections 2024-03-19T06:21:41.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.144+0000 7fc8ae000640 1 -- 172.21.15.32:0/2509994558 wait complete. 2024-03-19T06:21:41.157 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2024-03-19T06:21:41.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.304+0000 7f9ce9000640 1 Processor -- start 2024-03-19T06:21:41.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.304+0000 7f9ce9000640 1 -- start start 2024-03-19T06:21:41.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.304+0000 7f9ce9000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9ce40b4c50 0x7f9ce40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:41.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.304+0000 7f9ce9000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce40cb670 con 0x7f9ce415a7c0 2024-03-19T06:21:41.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.304+0000 7f9ce9000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce40cb950 con 0x7f9ce40cc680 2024-03-19T06:21:41.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.304+0000 7f9ce9000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce415f400 con 0x7f9ce40b4c50 2024-03-19T06:21:41.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.308+0000 7f9ce1e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9ce415a7c0 0x7f9ce40cae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48384/0 (socket says 172.21.15.32:48384) 2024-03-19T06:21:41.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.308+0000 7f9ce1e00640 1 -- 172.21.15.32:0/1525757976 learned_addr learned my addr 172.21.15.32:0/1525757976 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:41.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.308+0000 7f9ce2800640 1 --2- 172.21.15.32:0/1525757976 >> v2:172.21.15.32:3300/0 conn(0x7f9ce40b4c50 0x7f9ce40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:41.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.308+0000 7f9ce2800640 1 -- 172.21.15.32:0/1525757976 >> v1:172.21.15.171:6789/0 conn(0x7f9ce40cc680 legacy=0x7f9ce415ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:41.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.308+0000 7f9ce2800640 1 -- 172.21.15.32:0/1525757976 >> v1:172.21.15.32:6789/0 conn(0x7f9ce415a7c0 legacy=0x7f9ce40cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:41.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.308+0000 7f9ce1400640 1 -- 172.21.15.32:0/1525757976 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929822640 0 0) 0x7f9ce40cb670 con 0x7f9ce415a7c0 2024-03-19T06:21:41.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.308+0000 7f9ce2800640 1 -- 172.21.15.32:0/1525757976 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce415e4f0 con 0x7f9ce40b4c50 2024-03-19T06:21:41.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.308+0000 7f9ce2800640 1 --2- 172.21.15.32:0/1525757976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ce40b4c50 0x7f9ce40b5080 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009d90 tx=0x7f9cdc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22b82f7049ba878 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:41.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.308+0000 7f9ce1400640 1 -- 172.21.15.32:0/1525757976 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc0b2070 con 0x7f9ce40b4c50 2024-03-19T06:21:41.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.308+0000 7f9ce1400640 1 -- 172.21.15.32:0/1525757976 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc0a5900 con 0x7f9ce40b4c50 2024-03-19T06:21:41.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.308+0000 7f9ce1400640 1 -- 172.21.15.32:0/1525757976 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc0a5cd0 con 0x7f9ce40b4c50 2024-03-19T06:21:41.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce9000640 1 -- 172.21.15.32:0/1525757976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ce40b4c50 msgr2=0x7f9ce40b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:41.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce9000640 1 --2- 172.21.15.32:0/1525757976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ce40b4c50 0x7f9ce40b5080 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009d90 tx=0x7f9cdc01c930 comp rx=0 tx=0).stop 2024-03-19T06:21:41.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce9000640 1 -- 172.21.15.32:0/1525757976 shutdown_connections 2024-03-19T06:21:41.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce9000640 1 --2- 172.21.15.32:0/1525757976 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ce40b4c50 0x7f9ce40b5080 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:41.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce9000640 1 -- 172.21.15.32:0/1525757976 >> 172.21.15.32:0/1525757976 conn(0x7f9ce40b1280 msgr2=0x7f9ce40b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:41.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce9000640 1 -- 172.21.15.32:0/1525757976 shutdown_connections 2024-03-19T06:21:41.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce9000640 1 -- 172.21.15.32:0/1525757976 wait complete. 2024-03-19T06:21:41.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce9000640 1 Processor -- start 2024-03-19T06:21:41.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce9000640 1 -- start start 2024-03-19T06:21:41.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce9000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ce40b4c50 0x7f9ce4150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:41.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce9000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ce40cc680 0x7f9ce414d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:41.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce9000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ce415a7c0 0x7f9ce414e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:41.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce9000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40b55c0 con 0x7f9ce40b4c50 2024-03-19T06:21:41.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce9000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40cbe40 con 0x7f9ce40cc680 2024-03-19T06:21:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce9000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce4168a10 con 0x7f9ce415a7c0 2024-03-19T06:21:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce1e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ce40b4c50 0x7f9ce4150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce1e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ce40b4c50 0x7f9ce4150850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60792/0 (socket says 172.21.15.32:60792) 2024-03-19T06:21:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce1e00640 1 -- 172.21.15.32:0/1648340402 learned_addr learned my addr 172.21.15.32:0/1648340402 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce2800640 1 --2- 172.21.15.32:0/1648340402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ce415a7c0 0x7f9ce414e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9cdbe00640 1 --2- 172.21.15.32:0/1648340402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ce40cc680 0x7f9ce414d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce1e00640 1 -- 172.21.15.32:0/1648340402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ce415a7c0 msgr2=0x7f9ce414e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce1e00640 1 --2- 172.21.15.32:0/1648340402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ce415a7c0 0x7f9ce414e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce1e00640 1 -- 172.21.15.32:0/1648340402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ce40cc680 msgr2=0x7f9ce414d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce1e00640 1 --2- 172.21.15.32:0/1648340402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ce40cc680 0x7f9ce414d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.312+0000 7f9ce1e00640 1 -- 172.21.15.32:0/1648340402 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce414d990 con 0x7f9ce40b4c50 2024-03-19T06:21:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.316+0000 7f9ce1e00640 1 --2- 172.21.15.32:0/1648340402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ce40b4c50 0x7f9ce4150850 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400c520 tx=0x7f9cd400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.316+0000 7f9cda000640 1 -- 172.21.15.32:0/1648340402 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4018070 con 0x7f9ce40b4c50 2024-03-19T06:21:41.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.316+0000 7f9cda000640 1 -- 172.21.15.32:0/1648340402 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd40074e0 con 0x7f9ce40b4c50 2024-03-19T06:21:41.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.316+0000 7f9cda000640 1 -- 172.21.15.32:0/1648340402 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd40049f0 con 0x7f9ce40b4c50 2024-03-19T06:21:41.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.316+0000 7f9ce9000640 1 -- 172.21.15.32:0/1648340402 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce40c6740 con 0x7f9ce40b4c50 2024-03-19T06:21:41.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.316+0000 7f9ce9000640 1 -- 172.21.15.32:0/1648340402 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce40c6d00 con 0x7f9ce40b4c50 2024-03-19T06:21:41.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.316+0000 7f9ce9000640 1 -- 172.21.15.32:0/1648340402 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce40749e0 con 0x7f9ce40b4c50 2024-03-19T06:21:41.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.316+0000 7f9cda000640 1 -- 172.21.15.32:0/1648340402 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9cd4004b90 con 0x7f9ce40b4c50 2024-03-19T06:21:41.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.316+0000 7f9cda000640 1 --2- 172.21.15.32:0/1648340402 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9cc0067660 0x7f9cc0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:41.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.316+0000 7f9cda000640 1 -- 172.21.15.32:0/1648340402 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cd4084aa0 con 0x7f9ce40b4c50 2024-03-19T06:21:41.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.316+0000 7f9cdbe00640 1 --2- 172.21.15.32:0/1648340402 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9cc0067660 0x7f9cc0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:41.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.320+0000 7f9cdbe00640 1 --2- 172.21.15.32:0/1648340402 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9cc0067660 0x7f9cc0069b20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4151890 tx=0x7f9ccc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:41.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.320+0000 7f9cda000640 1 -- 172.21.15.32:0/1648340402 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f9cd40550d0 con 0x7f9ce40b4c50 2024-03-19T06:21:41.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:41.544+0000 7f9ce9000640 1 -- 172.21.15.32:0/1648340402 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7f9ce40cc270 con 0x7f9ce40b4c50 2024-03-19T06:21:42.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.536+0000 7f9cda000640 1 -- 172.21.15.32:0/1648340402 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v53) v1 ==== 150+0+0 (secure 0 0 0) 0x7f9cd4059170 con 0x7f9ce40b4c50 2024-03-19T06:21:42.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.540+0000 7f9ce9000640 1 -- 172.21.15.32:0/1648340402 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9cc0067660 msgr2=0x7f9cc0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:42.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.540+0000 7f9ce9000640 1 --2- 172.21.15.32:0/1648340402 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9cc0067660 0x7f9cc0069b20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4151890 tx=0x7f9ccc009040 comp rx=0 tx=0).stop 2024-03-19T06:21:42.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.540+0000 7f9ce9000640 1 -- 172.21.15.32:0/1648340402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ce40b4c50 msgr2=0x7f9ce4150850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:42.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.540+0000 7f9ce9000640 1 --2- 172.21.15.32:0/1648340402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ce40b4c50 0x7f9ce4150850 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400c520 tx=0x7f9cd400c9e0 comp rx=0 tx=0).stop 2024-03-19T06:21:42.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.540+0000 7f9ce9000640 1 -- 172.21.15.32:0/1648340402 shutdown_connections 2024-03-19T06:21:42.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.540+0000 7f9ce9000640 1 --2- 172.21.15.32:0/1648340402 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9cc0067660 0x7f9cc0069b20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:42.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.540+0000 7f9ce9000640 1 --2- 172.21.15.32:0/1648340402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ce415a7c0 0x7f9ce414e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:42.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.540+0000 7f9ce9000640 1 --2- 172.21.15.32:0/1648340402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ce40cc680 0x7f9ce414d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:42.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.540+0000 7f9ce9000640 1 --2- 172.21.15.32:0/1648340402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ce40b4c50 0x7f9ce4150850 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:42.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.540+0000 7f9ce9000640 1 -- 172.21.15.32:0/1648340402 >> 172.21.15.32:0/1648340402 conn(0x7f9ce40b1280 msgr2=0x7f9ce406e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:42.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.540+0000 7f9ce9000640 1 -- 172.21.15.32:0/1648340402 shutdown_connections 2024-03-19T06:21:42.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.540+0000 7f9ce9000640 1 -- 172.21.15.32:0/1648340402 wait complete. 2024-03-19T06:21:42.553 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-19T06:21:42.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.704+0000 7f22f5200640 1 Processor -- start 2024-03-19T06:21:42.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.708+0000 7f22f5200640 1 -- start start 2024-03-19T06:21:42.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.708+0000 7f22f5200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f22f015a840 0x7f22f006f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:42.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.708+0000 7f22f5200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f22f00aea70 0x7f22f006ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:42.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.708+0000 7f22f5200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f00af2d0 con 0x7f22f006b280 2024-03-19T06:21:42.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.708+0000 7f22f5200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f006b6d0 con 0x7f22f00aea70 2024-03-19T06:21:42.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.708+0000 7f22f5200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f00cdc20 con 0x7f22f015a840 2024-03-19T06:21:42.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.708+0000 7f22e5400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f22f00aea70 0x7f22f006ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:42.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.708+0000 7f22ee800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f22f006b280 0x7f22f006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48388/0 (socket says 172.21.15.32:48388) 2024-03-19T06:21:42.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.708+0000 7f22ee800640 1 -- 172.21.15.32:0/659233774 learned_addr learned my addr 172.21.15.32:0/659233774 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:42.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.708+0000 7f22ede00640 1 --2- 172.21.15.32:0/659233774 >> v2:172.21.15.171:3300/0 conn(0x7f22f015a840 0x7f22f006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:42.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.708+0000 7f22e5400640 1 -- 172.21.15.32:0/659233774 >> v2:172.21.15.171:3300/0 conn(0x7f22f015a840 msgr2=0x7f22f006f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:42.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.708+0000 7f22e5400640 1 --2- 172.21.15.32:0/659233774 >> v2:172.21.15.171:3300/0 conn(0x7f22f015a840 0x7f22f006f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:42.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.708+0000 7f22e5400640 1 -- 172.21.15.32:0/659233774 >> v1:172.21.15.32:6789/0 conn(0x7f22f006b280 legacy=0x7f22f006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:42.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.708+0000 7f22e5400640 1 -- 172.21.15.32:0/659233774 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f015eea0 con 0x7f22f00aea70 2024-03-19T06:21:42.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.708+0000 7f22ed400640 1 -- 172.21.15.32:0/659233774 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872510271 0 0) 0x7f22f00af2d0 con 0x7f22f006b280 2024-03-19T06:21:42.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.712+0000 7f22e5400640 1 --2- 172.21.15.32:0/659233774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f00aea70 0x7f22f006ad40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f22f006f6f0 tx=0x7f22d801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45b4798d808c36b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:42.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.712+0000 7f22ed400640 1 -- 172.21.15.32:0/659233774 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d80b1070 con 0x7f22f00aea70 2024-03-19T06:21:42.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.712+0000 7f22ed400640 1 -- 172.21.15.32:0/659233774 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d80ac640 con 0x7f22f00aea70 2024-03-19T06:21:42.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.712+0000 7f22ed400640 1 -- 172.21.15.32:0/659233774 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d80aca10 con 0x7f22f00aea70 2024-03-19T06:21:42.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.712+0000 7f22f5200640 1 -- 172.21.15.32:0/659233774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f00aea70 msgr2=0x7f22f006ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.712+0000 7f22f5200640 1 --2- 172.21.15.32:0/659233774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f00aea70 0x7f22f006ad40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f22f006f6f0 tx=0x7f22d801c330 comp rx=0 tx=0).stop 2024-03-19T06:21:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.712+0000 7f22f5200640 1 -- 172.21.15.32:0/659233774 shutdown_connections 2024-03-19T06:21:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.712+0000 7f22f5200640 1 --2- 172.21.15.32:0/659233774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f00aea70 0x7f22f006ad40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.712+0000 7f22f5200640 1 --2- 172.21.15.32:0/659233774 >> v2:172.21.15.171:3300/0 conn(0x7f22f015a840 0x7f22f006f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.712+0000 7f22f5200640 1 -- 172.21.15.32:0/659233774 >> 172.21.15.32:0/659233774 conn(0x7f22f00b1590 msgr2=0x7f22f00b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.712+0000 7f22f5200640 1 -- 172.21.15.32:0/659233774 shutdown_connections 2024-03-19T06:21:42.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.712+0000 7f22f5200640 1 -- 172.21.15.32:0/659233774 wait complete. 2024-03-19T06:21:42.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.712+0000 7f22f5200640 1 Processor -- start 2024-03-19T06:21:42.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.712+0000 7f22f5200640 1 -- start start 2024-03-19T06:21:42.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22f5200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f006b280 0x7f22f01482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:42.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22f5200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22f00aea70 0x7f22f0164f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:42.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22f5200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22f015a840 0x7f22f015f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:42.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22f5200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f00af0b0 con 0x7f22f006b280 2024-03-19T06:21:42.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22f5200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f00aef30 con 0x7f22f00aea70 2024-03-19T06:21:42.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22f5200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f0071550 con 0x7f22f015a840 2024-03-19T06:21:42.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22ede00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f006b280 0x7f22f01482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:42.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22ede00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f006b280 0x7f22f01482e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60814/0 (socket says 172.21.15.32:60814) 2024-03-19T06:21:42.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22ede00640 1 -- 172.21.15.32:0/3589488406 learned_addr learned my addr 172.21.15.32:0/3589488406 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:42.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22ee800640 1 --2- 172.21.15.32:0/3589488406 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22f015a840 0x7f22f015f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:42.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22e5400640 1 --2- 172.21.15.32:0/3589488406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22f00aea70 0x7f22f0164f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:42.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22ede00640 1 -- 172.21.15.32:0/3589488406 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22f015a840 msgr2=0x7f22f015f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:42.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22ede00640 1 --2- 172.21.15.32:0/3589488406 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22f015a840 0x7f22f015f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:42.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22ede00640 1 -- 172.21.15.32:0/3589488406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22f00aea70 msgr2=0x7f22f0164f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:42.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22ede00640 1 --2- 172.21.15.32:0/3589488406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22f00aea70 0x7f22f0164f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:42.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22ede00640 1 -- 172.21.15.32:0/3589488406 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f0148820 con 0x7f22f006b280 2024-03-19T06:21:42.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22e5400640 1 --2- 172.21.15.32:0/3589488406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22f00aea70 0x7f22f0164f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:42.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22ee800640 1 --2- 172.21.15.32:0/3589488406 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22f015a840 0x7f22f015f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:42.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22ede00640 1 --2- 172.21.15.32:0/3589488406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f006b280 0x7f22f01482e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009d10 tx=0x7f22e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:42.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22e6a00640 1 -- 172.21.15.32:0/3589488406 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e0018020 con 0x7f22f006b280 2024-03-19T06:21:42.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22e6a00640 1 -- 172.21.15.32:0/3589488406 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e0014480 con 0x7f22f006b280 2024-03-19T06:21:42.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22e6a00640 1 -- 172.21.15.32:0/3589488406 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e0014830 con 0x7f22f006b280 2024-03-19T06:21:42.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22f5200640 1 -- 172.21.15.32:0/3589488406 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f014a150 con 0x7f22f006b280 2024-03-19T06:21:42.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22f5200640 1 -- 172.21.15.32:0/3589488406 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f014a710 con 0x7f22f006b280 2024-03-19T06:21:42.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.716+0000 7f22f5200640 1 -- 172.21.15.32:0/3589488406 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f00749e0 con 0x7f22f006b280 2024-03-19T06:21:42.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.720+0000 7f22e6a00640 1 -- 172.21.15.32:0/3589488406 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f22e001b020 con 0x7f22f006b280 2024-03-19T06:21:42.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.720+0000 7f22e6a00640 1 --2- 172.21.15.32:0/3589488406 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f22cc067660 0x7f22cc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:42.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.720+0000 7f22e6a00640 1 -- 172.21.15.32:0/3589488406 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22e0086300 con 0x7f22f006b280 2024-03-19T06:21:42.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.720+0000 7f22e5400640 1 --2- 172.21.15.32:0/3589488406 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f22cc067660 0x7f22cc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:42.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.720+0000 7f22e5400640 1 --2- 172.21.15.32:0/3589488406 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f22cc067660 0x7f22cc069b20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f22d80ae000 tx=0x7f22d8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:42.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.724+0000 7f22e6a00640 1 -- 172.21.15.32:0/3589488406 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f22e0022070 con 0x7f22f006b280 2024-03-19T06:21:42.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.884+0000 7f22f5200640 1 -- 172.21.15.32:0/3589488406 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f22f00b48b0 con 0x7f22f006b280 2024-03-19T06:21:42.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.888+0000 7f22e6a00640 1 -- 172.21.15.32:0/3589488406 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f22e0010040 con 0x7f22f006b280 2024-03-19T06:21:42.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.888+0000 7f22f5200640 1 -- 172.21.15.32:0/3589488406 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f22cc067660 msgr2=0x7f22cc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:42.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.888+0000 7f22f5200640 1 --2- 172.21.15.32:0/3589488406 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f22cc067660 0x7f22cc069b20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f22d80ae000 tx=0x7f22d8008040 comp rx=0 tx=0).stop 2024-03-19T06:21:42.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.888+0000 7f22f5200640 1 -- 172.21.15.32:0/3589488406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f006b280 msgr2=0x7f22f01482e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:42.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.888+0000 7f22f5200640 1 --2- 172.21.15.32:0/3589488406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f006b280 0x7f22f01482e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009d10 tx=0x7f22e000c490 comp rx=0 tx=0).stop 2024-03-19T06:21:42.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.888+0000 7f22f5200640 1 -- 172.21.15.32:0/3589488406 shutdown_connections 2024-03-19T06:21:42.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.888+0000 7f22f5200640 1 --2- 172.21.15.32:0/3589488406 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f22cc067660 0x7f22cc069b20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:42.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.888+0000 7f22f5200640 1 --2- 172.21.15.32:0/3589488406 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22f015a840 0x7f22f015f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:42.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.888+0000 7f22f5200640 1 --2- 172.21.15.32:0/3589488406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22f00aea70 0x7f22f0164f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:42.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.888+0000 7f22f5200640 1 --2- 172.21.15.32:0/3589488406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22f006b280 0x7f22f01482e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:42.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.888+0000 7f22f5200640 1 -- 172.21.15.32:0/3589488406 >> 172.21.15.32:0/3589488406 conn(0x7f22f00b1590 msgr2=0x7f22f00b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:42.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.888+0000 7f22f5200640 1 -- 172.21.15.32:0/3589488406 shutdown_connections 2024-03-19T06:21:42.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:42.888+0000 7f22f5200640 1 -- 172.21.15.32:0/3589488406 wait complete. 2024-03-19T06:21:42.901 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-19T06:21:42.901 DEBUG:teuthology.orchestra.run.smithi032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-19T06:21:42.949 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-19T06:21:43.047 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-19T06:21:43.047 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:21:43.047 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:21:43.056 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:21:43.056 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:21:43.107 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:43.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.296+0000 7f1c8e200640 1 Processor -- start 2024-03-19T06:21:43.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.296+0000 7f1c8e200640 1 -- start start 2024-03-19T06:21:43.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.300+0000 7f1c8e200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1c8815a7c0 0x7f1c880cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.300+0000 7f1c8e200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1c880b4c50 0x7f1c880b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.300+0000 7f1c8e200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c880cb670 con 0x7f1c880cc680 2024-03-19T06:21:43.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.300+0000 7f1c8e200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8815f400 con 0x7f1c8815a7c0 2024-03-19T06:21:43.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.300+0000 7f1c8e200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8815e860 con 0x7f1c880b4c50 2024-03-19T06:21:43.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.300+0000 7f1c87400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1c8815a7c0 0x7f1c880cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.300+0000 7f1c87400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1c8815a7c0 0x7f1c880cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60828/0 (socket says 172.21.15.32:60828) 2024-03-19T06:21:43.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.300+0000 7f1c87400640 1 -- 172.21.15.32:0/1367452366 learned_addr learned my addr 172.21.15.32:0/1367452366 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:43.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.300+0000 7f1c87400640 1 -- 172.21.15.32:0/1367452366 >> v2:172.21.15.171:3300/0 conn(0x7f1c880b4c50 msgr2=0x7f1c880b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:43.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.300+0000 7f1c87400640 1 --2- 172.21.15.32:0/1367452366 >> v2:172.21.15.171:3300/0 conn(0x7f1c880b4c50 0x7f1c880b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.300+0000 7f1c87400640 1 -- 172.21.15.32:0/1367452366 >> v1:172.21.15.171:6789/0 conn(0x7f1c880cc680 legacy=0x7f1c8815ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:43.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.300+0000 7f1c87400640 1 -- 172.21.15.32:0/1367452366 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c880cb950 con 0x7f1c8815a7c0 2024-03-19T06:21:43.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.304+0000 7f1c87400640 1 --2- 172.21.15.32:0/1367452366 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c8815a7c0 0x7f1c880cae20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1c880c9b90 tx=0x7f1c7801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd38fd097c33a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:43.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.304+0000 7f1c86a00640 1 -- 172.21.15.32:0/1367452366 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c780b2070 con 0x7f1c8815a7c0 2024-03-19T06:21:43.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.304+0000 7f1c86a00640 1 -- 172.21.15.32:0/1367452366 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c780ad640 con 0x7f1c8815a7c0 2024-03-19T06:21:43.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.304+0000 7f1c86a00640 1 -- 172.21.15.32:0/1367452366 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c780ada10 con 0x7f1c8815a7c0 2024-03-19T06:21:43.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.304+0000 7f1c8e200640 1 -- 172.21.15.32:0/1367452366 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c8815a7c0 msgr2=0x7f1c880cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:43.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.304+0000 7f1c8e200640 1 --2- 172.21.15.32:0/1367452366 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c8815a7c0 0x7f1c880cae20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1c880c9b90 tx=0x7f1c7801c4e0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.304+0000 7f1c8e200640 1 -- 172.21.15.32:0/1367452366 shutdown_connections 2024-03-19T06:21:43.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.304+0000 7f1c8e200640 1 --2- 172.21.15.32:0/1367452366 >> v2:172.21.15.171:3300/0 conn(0x7f1c880b4c50 0x7f1c880b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.304+0000 7f1c8e200640 1 --2- 172.21.15.32:0/1367452366 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c8815a7c0 0x7f1c880cae20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.304+0000 7f1c8e200640 1 -- 172.21.15.32:0/1367452366 >> 172.21.15.32:0/1367452366 conn(0x7f1c880b1280 msgr2=0x7f1c880b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:43.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.304+0000 7f1c8e200640 1 -- 172.21.15.32:0/1367452366 shutdown_connections 2024-03-19T06:21:43.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.304+0000 7f1c8e200640 1 -- 172.21.15.32:0/1367452366 wait complete. 2024-03-19T06:21:43.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.304+0000 7f1c8e200640 1 Processor -- start 2024-03-19T06:21:43.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.304+0000 7f1c8e200640 1 -- start start 2024-03-19T06:21:43.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.304+0000 7f1c8e200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c880b4c50 0x7f1c8814d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c8e200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c880cc680 0x7f1c8815af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c8e200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c8815a7c0 0x7f1c88149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c8e200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880cbdb0 con 0x7f1c8815a7c0 2024-03-19T06:21:43.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c8e200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880cbc30 con 0x7f1c880b4c50 2024-03-19T06:21:43.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c8e200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c881677f0 con 0x7f1c880cc680 2024-03-19T06:21:43.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c87e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c8815a7c0 0x7f1c88149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c87e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c8815a7c0 0x7f1c88149fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60832/0 (socket says 172.21.15.32:60832) 2024-03-19T06:21:43.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c87e00640 1 -- 172.21.15.32:0/2858246053 learned_addr learned my addr 172.21.15.32:0/2858246053 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:43.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c7fe00640 1 --2- 172.21.15.32:0/2858246053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c880cc680 0x7f1c8815af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c87400640 1 --2- 172.21.15.32:0/2858246053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c880b4c50 0x7f1c8814d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c87e00640 1 -- 172.21.15.32:0/2858246053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c880cc680 msgr2=0x7f1c8815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:43.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c87e00640 1 --2- 172.21.15.32:0/2858246053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c880cc680 0x7f1c8815af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c87e00640 1 -- 172.21.15.32:0/2858246053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c880b4c50 msgr2=0x7f1c8814d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:43.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c87e00640 1 --2- 172.21.15.32:0/2858246053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c880b4c50 0x7f1c8814d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c87e00640 1 -- 172.21.15.32:0/2858246053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8814d690 con 0x7f1c8815a7c0 2024-03-19T06:21:43.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c7fe00640 1 --2- 172.21.15.32:0/2858246053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c880cc680 0x7f1c8815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:43.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c87400640 1 --2- 172.21.15.32:0/2858246053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c880b4c50 0x7f1c8814d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:43.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c87e00640 1 --2- 172.21.15.32:0/2858246053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c8815a7c0 0x7f1c88149fe0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000b970 tx=0x7f1c8000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:43.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c7f400640 1 -- 172.21.15.32:0/2858246053 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c80019070 con 0x7f1c8815a7c0 2024-03-19T06:21:43.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c7f400640 1 -- 172.21.15.32:0/2858246053 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8000cb60 con 0x7f1c8815a7c0 2024-03-19T06:21:43.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c7f400640 1 -- 172.21.15.32:0/2858246053 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c80014440 con 0x7f1c8815a7c0 2024-03-19T06:21:43.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c8e200640 1 -- 172.21.15.32:0/2858246053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8814d970 con 0x7f1c8815a7c0 2024-03-19T06:21:43.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c8e200640 1 -- 172.21.15.32:0/2858246053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c881fa8b0 con 0x7f1c8815a7c0 2024-03-19T06:21:43.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c8e200640 1 -- 172.21.15.32:0/2858246053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c881faab0 con 0x7f1c8815a7c0 2024-03-19T06:21:43.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.308+0000 7f1c7f400640 1 -- 172.21.15.32:0/2858246053 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1c8001c070 con 0x7f1c8815a7c0 2024-03-19T06:21:43.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.312+0000 7f1c7f400640 1 --2- 172.21.15.32:0/2858246053 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1c64067690 0x7f1c64069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.312+0000 7f1c7f400640 1 -- 172.21.15.32:0/2858246053 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c80085540 con 0x7f1c8815a7c0 2024-03-19T06:21:43.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.312+0000 7f1c87400640 1 --2- 172.21.15.32:0/2858246053 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1c64067690 0x7f1c64069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.312+0000 7f1c87400640 1 --2- 172.21.15.32:0/2858246053 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1c64067690 0x7f1c64069b50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1c780af000 tx=0x7f1c78008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:43.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.316+0000 7f1c7f400640 1 -- 172.21.15.32:0/2858246053 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f1c881faab0 con 0x7f1c8815a7c0 2024-03-19T06:21:43.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.480+0000 7f1c8e200640 1 -- 172.21.15.32:0/2858246053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c880749e0 con 0x7f1c8815a7c0 2024-03-19T06:21:43.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.480+0000 7f1c7f400640 1 -- 172.21.15.32:0/2858246053 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f1c80056250 con 0x7f1c8815a7c0 2024-03-19T06:21:43.472 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:43.472 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:10.423479+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:43.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.480+0000 7f1c8e200640 1 -- 172.21.15.32:0/2858246053 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1c64067690 msgr2=0x7f1c64069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:43.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.480+0000 7f1c8e200640 1 --2- 172.21.15.32:0/2858246053 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1c64067690 0x7f1c64069b50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1c780af000 tx=0x7f1c78008040 comp rx=0 tx=0).stop 2024-03-19T06:21:43.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.480+0000 7f1c8e200640 1 -- 172.21.15.32:0/2858246053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c8815a7c0 msgr2=0x7f1c88149fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:43.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.480+0000 7f1c8e200640 1 --2- 172.21.15.32:0/2858246053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c8815a7c0 0x7f1c88149fe0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000b970 tx=0x7f1c8000be30 comp rx=0 tx=0).stop 2024-03-19T06:21:43.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.480+0000 7f1c8e200640 1 -- 172.21.15.32:0/2858246053 shutdown_connections 2024-03-19T06:21:43.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.480+0000 7f1c8e200640 1 --2- 172.21.15.32:0/2858246053 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1c64067690 0x7f1c64069b50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.480+0000 7f1c8e200640 1 --2- 172.21.15.32:0/2858246053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c8815a7c0 0x7f1c88149fe0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.480+0000 7f1c8e200640 1 --2- 172.21.15.32:0/2858246053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c880cc680 0x7f1c8815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.480+0000 7f1c8e200640 1 --2- 172.21.15.32:0/2858246053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c880b4c50 0x7f1c8814d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.480+0000 7f1c8e200640 1 -- 172.21.15.32:0/2858246053 >> 172.21.15.32:0/2858246053 conn(0x7f1c880b1280 msgr2=0x7f1c88150770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:43.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.480+0000 7f1c8e200640 1 -- 172.21.15.32:0/2858246053 shutdown_connections 2024-03-19T06:21:43.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.480+0000 7f1c8e200640 1 -- 172.21.15.32:0/2858246053 wait complete. 2024-03-19T06:21:43.494 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:21:07.089673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:21:07.801319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:43.494 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:43.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.644+0000 7fe22b200640 1 Processor -- start 2024-03-19T06:21:43.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.648+0000 7fe22b200640 1 -- start start 2024-03-19T06:21:43.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.648+0000 7fe22b200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe22406ad40 0x7fe22406b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.648+0000 7fe22b200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe22406eed0 0x7fe2240ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.648+0000 7fe22b200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22406b660 con 0x7fe22406e320 2024-03-19T06:21:43.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.648+0000 7fe22b200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22406dbb0 con 0x7fe22406eed0 2024-03-19T06:21:43.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.648+0000 7fe22b200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2240cc290 con 0x7fe22406ad40 2024-03-19T06:21:43.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.648+0000 7fe229200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe22406e320 0x7fe22415bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33040/0 (socket says 172.21.15.32:33040) 2024-03-19T06:21:43.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.648+0000 7fe229200640 1 -- 172.21.15.32:0/3344153061 learned_addr learned my addr 172.21.15.32:0/3344153061 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:43.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.648+0000 7fe223400640 1 --2- 172.21.15.32:0/3344153061 >> v2:172.21.15.171:3300/0 conn(0x7fe22406eed0 0x7fe2240ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.648+0000 7fe223e00640 1 --2- 172.21.15.32:0/3344153061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe22406ad40 0x7fe22406b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.648+0000 7fe222a00640 1 -- 172.21.15.32:0/3344153061 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814484174 0 0) 0x7fe22406b660 con 0x7fe22406e320 2024-03-19T06:21:43.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.648+0000 7fe222a00640 1 -- 172.21.15.32:0/3344153061 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe208003530 con 0x7fe22406e320 2024-03-19T06:21:43.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.648+0000 7fe223400640 1 -- 172.21.15.32:0/3344153061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe22406ad40 msgr2=0x7fe22406b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:43.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.648+0000 7fe223400640 1 --2- 172.21.15.32:0/3344153061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe22406ad40 0x7fe22406b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.648+0000 7fe223400640 1 -- 172.21.15.32:0/3344153061 >> v1:172.21.15.32:6789/0 conn(0x7fe22406e320 legacy=0x7fe22415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:43.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.648+0000 7fe223400640 1 -- 172.21.15.32:0/3344153061 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2240cc570 con 0x7fe22406eed0 2024-03-19T06:21:43.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.652+0000 7fe223400640 1 --2- 172.21.15.32:0/3344153061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe22406eed0 0x7fe2240ccd10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe2100097c0 tx=0x7fe21001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a472d71d4d48bb41 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:43.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.652+0000 7fe222a00640 1 -- 172.21.15.32:0/3344153061 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2100b1070 con 0x7fe22406eed0 2024-03-19T06:21:43.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.652+0000 7fe222a00640 1 -- 172.21.15.32:0/3344153061 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2100a8050 con 0x7fe22406eed0 2024-03-19T06:21:43.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.652+0000 7fe222a00640 1 -- 172.21.15.32:0/3344153061 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2100ac860 con 0x7fe22406eed0 2024-03-19T06:21:43.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.652+0000 7fe22b200640 1 -- 172.21.15.32:0/3344153061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe22406eed0 msgr2=0x7fe2240ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:43.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.652+0000 7fe22b200640 1 --2- 172.21.15.32:0/3344153061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe22406eed0 0x7fe2240ccd10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe2100097c0 tx=0x7fe21001c3e0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.652+0000 7fe22b200640 1 -- 172.21.15.32:0/3344153061 shutdown_connections 2024-03-19T06:21:43.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.652+0000 7fe22b200640 1 --2- 172.21.15.32:0/3344153061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe22406eed0 0x7fe2240ccd10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.652+0000 7fe22b200640 1 --2- 172.21.15.32:0/3344153061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe22406ad40 0x7fe22406b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.652+0000 7fe22b200640 1 -- 172.21.15.32:0/3344153061 >> 172.21.15.32:0/3344153061 conn(0x7fe2240b1590 msgr2=0x7fe2240b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:43.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.652+0000 7fe22b200640 1 -- 172.21.15.32:0/3344153061 shutdown_connections 2024-03-19T06:21:43.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.652+0000 7fe22b200640 1 -- 172.21.15.32:0/3344153061 wait complete. 2024-03-19T06:21:43.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.652+0000 7fe22b200640 1 Processor -- start 2024-03-19T06:21:43.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe22b200640 1 -- start start 2024-03-19T06:21:43.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe22b200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe22406ad40 0x7fe2241558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe22b200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe22406e320 0x7fe2241521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe22b200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe22406eed0 0x7fe224144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe22b200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22415c8f0 con 0x7fe22406e320 2024-03-19T06:21:43.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe22b200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22415c770 con 0x7fe22406ad40 2024-03-19T06:21:43.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe22b200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe224168d20 con 0x7fe22406eed0 2024-03-19T06:21:43.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe223400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe22406e320 0x7fe2241521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe223400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe22406e320 0x7fe2241521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57520/0 (socket says 172.21.15.32:57520) 2024-03-19T06:21:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe223400640 1 -- 172.21.15.32:0/1719942973 learned_addr learned my addr 172.21.15.32:0/1719942973 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe229200640 1 --2- 172.21.15.32:0/1719942973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe22406eed0 0x7fe224144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe223e00640 1 --2- 172.21.15.32:0/1719942973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe22406ad40 0x7fe2241558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe223400640 1 -- 172.21.15.32:0/1719942973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe22406eed0 msgr2=0x7fe224144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe223400640 1 --2- 172.21.15.32:0/1719942973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe22406eed0 0x7fe224144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe223400640 1 -- 172.21.15.32:0/1719942973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe22406ad40 msgr2=0x7fe2241558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe223400640 1 --2- 172.21.15.32:0/1719942973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe22406ad40 0x7fe2241558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe223400640 1 -- 172.21.15.32:0/1719942973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe224154b50 con 0x7fe22406e320 2024-03-19T06:21:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe223e00640 1 --2- 172.21.15.32:0/1719942973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe22406ad40 0x7fe2241558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe223400640 1 --2- 172.21.15.32:0/1719942973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe22406e320 0x7fe2241521d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe21001a010 tx=0x7fe210019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe21be00640 1 -- 172.21.15.32:0/1719942973 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2100bb070 con 0x7fe22406e320 2024-03-19T06:21:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe21be00640 1 -- 172.21.15.32:0/1719942973 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2100acd60 con 0x7fe22406e320 2024-03-19T06:21:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe22b200640 1 -- 172.21.15.32:0/1719942973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe224152850 con 0x7fe22406e320 2024-03-19T06:21:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe21be00640 1 -- 172.21.15.32:0/1719942973 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2100b1040 con 0x7fe22406e320 2024-03-19T06:21:43.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe22b200640 1 -- 172.21.15.32:0/1719942973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2241550b0 con 0x7fe22406e320 2024-03-19T06:21:43.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.656+0000 7fe22b200640 1 -- 172.21.15.32:0/1719942973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2240749e0 con 0x7fe22406e320 2024-03-19T06:21:43.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.660+0000 7fe21be00640 1 -- 172.21.15.32:0/1719942973 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe2100be070 con 0x7fe22406e320 2024-03-19T06:21:43.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.660+0000 7fe21be00640 1 --2- 172.21.15.32:0/1719942973 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe204067660 0x7fe204069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.660+0000 7fe21be00640 1 -- 172.21.15.32:0/1719942973 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe21011fcf0 con 0x7fe22406e320 2024-03-19T06:21:43.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.660+0000 7fe223e00640 1 --2- 172.21.15.32:0/1719942973 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe204067660 0x7fe204069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.660+0000 7fe223e00640 1 --2- 172.21.15.32:0/1719942973 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe204067660 0x7fe204069b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe214009ae0 tx=0x7fe214008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.664+0000 7fe21be00640 1 -- 172.21.15.32:0/1719942973 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fe224154b50 con 0x7fe22406e320 2024-03-19T06:21:43.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.828+0000 7fe22b200640 1 -- 172.21.15.32:0/1719942973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2241488a0 con 0x7fe22406e320 2024-03-19T06:21:43.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.828+0000 7fe21be00640 1 -- 172.21.15.32:0/1719942973 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe210016090 con 0x7fe22406e320 2024-03-19T06:21:43.819 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:43.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.828+0000 7fe22b200640 1 -- 172.21.15.32:0/1719942973 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe204067660 msgr2=0x7fe204069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:43.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.828+0000 7fe22b200640 1 --2- 172.21.15.32:0/1719942973 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe204067660 0x7fe204069b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe214009ae0 tx=0x7fe214008040 comp rx=0 tx=0).stop 2024-03-19T06:21:43.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.828+0000 7fe22b200640 1 -- 172.21.15.32:0/1719942973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe22406e320 msgr2=0x7fe2241521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:43.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.828+0000 7fe22b200640 1 --2- 172.21.15.32:0/1719942973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe22406e320 0x7fe2241521d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe21001a010 tx=0x7fe210019180 comp rx=0 tx=0).stop 2024-03-19T06:21:43.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.828+0000 7fe22b200640 1 -- 172.21.15.32:0/1719942973 shutdown_connections 2024-03-19T06:21:43.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.828+0000 7fe22b200640 1 --2- 172.21.15.32:0/1719942973 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe204067660 0x7fe204069b20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.828+0000 7fe22b200640 1 --2- 172.21.15.32:0/1719942973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe22406eed0 0x7fe224144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.828+0000 7fe22b200640 1 --2- 172.21.15.32:0/1719942973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe22406e320 0x7fe2241521d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.828+0000 7fe22b200640 1 --2- 172.21.15.32:0/1719942973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe22406ad40 0x7fe2241558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.828+0000 7fe22b200640 1 -- 172.21.15.32:0/1719942973 >> 172.21.15.32:0/1719942973 conn(0x7fe2240b1590 msgr2=0x7fe2240ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:43.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.828+0000 7fe22b200640 1 -- 172.21.15.32:0/1719942973 shutdown_connections 2024-03-19T06:21:43.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.828+0000 7fe22b200640 1 -- 172.21.15.32:0/1719942973 wait complete. 2024-03-19T06:21:43.841 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:21:43.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55f3400640 1 Processor -- start 2024-03-19T06:21:43.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55f3400640 1 -- start start 2024-03-19T06:21:43.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55f3400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55ec15dba0 0x7f55ec06ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55f3400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f55ec070240 0x7f55ec0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55f3400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ec0d16d0 con 0x7f55ec06b280 2024-03-19T06:21:43.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55f3400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ec06b6e0 con 0x7f55ec070240 2024-03-19T06:21:43.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55f3400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec0ccea0 con 0x7f55ec15dba0 2024-03-19T06:21:43.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55e3e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f55ec06b280 0x7f55ec06fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33044/0 (socket says 172.21.15.32:33044) 2024-03-19T06:21:43.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55e3e00640 1 -- 172.21.15.32:0/2015105365 learned_addr learned my addr 172.21.15.32:0/2015105365 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:43.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55f0a00640 1 --2- 172.21.15.32:0/2015105365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55ec15dba0 0x7f55ec06ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55f1400640 1 --2- 172.21.15.32:0/2015105365 >> v2:172.21.15.171:3300/0 conn(0x7f55ec070240 0x7f55ec0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55ebe00640 1 -- 172.21.15.32:0/2015105365 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057080637 0 0) 0x7f55ec0d16d0 con 0x7f55ec06b280 2024-03-19T06:21:43.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55ebe00640 1 -- 172.21.15.32:0/2015105365 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55d0003530 con 0x7f55ec06b280 2024-03-19T06:21:43.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55f0a00640 1 -- 172.21.15.32:0/2015105365 >> v2:172.21.15.171:3300/0 conn(0x7f55ec070240 msgr2=0x7f55ec0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:43.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55f0a00640 1 --2- 172.21.15.32:0/2015105365 >> v2:172.21.15.171:3300/0 conn(0x7f55ec070240 0x7f55ec0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55f0a00640 1 -- 172.21.15.32:0/2015105365 >> v1:172.21.15.32:6789/0 conn(0x7f55ec06b280 legacy=0x7f55ec06fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:43.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.992+0000 7f55f0a00640 1 -- 172.21.15.32:0/2015105365 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec070710 con 0x7f55ec15dba0 2024-03-19T06:21:43.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.996+0000 7f55f0a00640 1 --2- 172.21.15.32:0/2015105365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55ec15dba0 0x7f55ec06ad40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0097c0 tx=0x7f55dc01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d303f277043a6456 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:43.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.996+0000 7f55ebe00640 1 -- 172.21.15.32:0/2015105365 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc0b0070 con 0x7f55ec15dba0 2024-03-19T06:21:43.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.996+0000 7f55ebe00640 1 -- 172.21.15.32:0/2015105365 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55dc0ab600 con 0x7f55ec15dba0 2024-03-19T06:21:43.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.996+0000 7f55ebe00640 1 -- 172.21.15.32:0/2015105365 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc0ab9b0 con 0x7f55ec15dba0 2024-03-19T06:21:43.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.996+0000 7f55f3400640 1 -- 172.21.15.32:0/2015105365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55ec15dba0 msgr2=0x7f55ec06ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:43.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.996+0000 7f55f3400640 1 --2- 172.21.15.32:0/2015105365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55ec15dba0 0x7f55ec06ad40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0097c0 tx=0x7f55dc01c410 comp rx=0 tx=0).stop 2024-03-19T06:21:43.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.996+0000 7f55f3400640 1 -- 172.21.15.32:0/2015105365 shutdown_connections 2024-03-19T06:21:43.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.996+0000 7f55f3400640 1 --2- 172.21.15.32:0/2015105365 >> v2:172.21.15.171:3300/0 conn(0x7f55ec070240 0x7f55ec0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.996+0000 7f55f3400640 1 --2- 172.21.15.32:0/2015105365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55ec15dba0 0x7f55ec06ad40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.996+0000 7f55f3400640 1 -- 172.21.15.32:0/2015105365 >> 172.21.15.32:0/2015105365 conn(0x7f55ec099a70 msgr2=0x7f55ec099e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:43.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.996+0000 7f55f3400640 1 -- 172.21.15.32:0/2015105365 shutdown_connections 2024-03-19T06:21:43.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:43.996+0000 7f55f3400640 1 -- 172.21.15.32:0/2015105365 wait complete. 2024-03-19T06:21:43.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55f3400640 1 Processor -- start 2024-03-19T06:21:43.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55f3400640 1 -- start start 2024-03-19T06:21:43.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55f3400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55ec06b280 0x7f55ec155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55f3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55ec070240 0x7f55ec09d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55f3400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55ec15dba0 0x7f55ec09aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55f3400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec15e100 con 0x7f55ec070240 2024-03-19T06:21:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55f3400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec15df80 con 0x7f55ec06b280 2024-03-19T06:21:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55f3400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec0cde10 con 0x7f55ec15dba0 2024-03-19T06:21:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55ec070240 0x7f55ec09d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55ec070240 0x7f55ec09d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57526/0 (socket says 172.21.15.32:57526) 2024-03-19T06:21:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55e3e00640 1 -- 172.21.15.32:0/2815241689 learned_addr learned my addr 172.21.15.32:0/2815241689 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55f0a00640 1 --2- 172.21.15.32:0/2815241689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55ec06b280 0x7f55ec155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55f1400640 1 --2- 172.21.15.32:0/2815241689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55ec15dba0 0x7f55ec09aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55e3e00640 1 -- 172.21.15.32:0/2815241689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55ec15dba0 msgr2=0x7f55ec09aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55e3e00640 1 --2- 172.21.15.32:0/2815241689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55ec15dba0 0x7f55ec09aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55e3e00640 1 -- 172.21.15.32:0/2815241689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55ec06b280 msgr2=0x7f55ec155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55e3e00640 1 --2- 172.21.15.32:0/2815241689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55ec06b280 0x7f55ec155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55e3e00640 1 -- 172.21.15.32:0/2815241689 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec09df20 con 0x7f55ec070240 2024-03-19T06:21:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55f0a00640 1 --2- 172.21.15.32:0/2815241689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55ec06b280 0x7f55ec155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55e3e00640 1 --2- 172.21.15.32:0/2815241689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55ec070240 0x7f55ec09d840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f55d400c450 tx=0x7f55d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55e9600640 1 -- 172.21.15.32:0/2815241689 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4017070 con 0x7f55ec070240 2024-03-19T06:21:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55e9600640 1 -- 172.21.15.32:0/2815241689 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d4005cf0 con 0x7f55ec070240 2024-03-19T06:21:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55f3400640 1 -- 172.21.15.32:0/2815241689 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ec09e200 con 0x7f55ec070240 2024-03-19T06:21:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55e9600640 1 -- 172.21.15.32:0/2815241689 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4007290 con 0x7f55ec070240 2024-03-19T06:21:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.000+0000 7f55f3400640 1 -- 172.21.15.32:0/2815241689 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ec0b1070 con 0x7f55ec070240 2024-03-19T06:21:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.004+0000 7f55f3400640 1 -- 172.21.15.32:0/2815241689 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ec0b0e90 con 0x7f55ec070240 2024-03-19T06:21:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.004+0000 7f55e9600640 1 -- 172.21.15.32:0/2815241689 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f55d401a070 con 0x7f55ec070240 2024-03-19T06:21:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.004+0000 7f55e9600640 1 --2- 172.21.15.32:0/2815241689 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55c8067660 0x7f55c8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.004+0000 7f55e9600640 1 -- 172.21.15.32:0/2815241689 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55d4084c20 con 0x7f55ec070240 2024-03-19T06:21:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.004+0000 7f55f0a00640 1 --2- 172.21.15.32:0/2815241689 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55c8067660 0x7f55c8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:43.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.004+0000 7f55f0a00640 1 --2- 172.21.15.32:0/2815241689 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55c8067660 0x7f55c8069b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0ad000 tx=0x7f55dc0a4f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.008+0000 7f55e9600640 1 -- 172.21.15.32:0/2815241689 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f55ec0b0e90 con 0x7f55ec070240 2024-03-19T06:21:44.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.172+0000 7f55f3400640 1 -- 172.21.15.32:0/2815241689 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55ec0b1270 con 0x7f55ec070240 2024-03-19T06:21:44.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.172+0000 7f55e9600640 1 -- 172.21.15.32:0/2815241689 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55ec0b1270 con 0x7f55ec070240 2024-03-19T06:21:44.166 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:21:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.176+0000 7f55f3400640 1 -- 172.21.15.32:0/2815241689 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55c8067660 msgr2=0x7f55c8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.176+0000 7f55f3400640 1 --2- 172.21.15.32:0/2815241689 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55c8067660 0x7f55c8069b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0ad000 tx=0x7f55dc0a4f90 comp rx=0 tx=0).stop 2024-03-19T06:21:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.176+0000 7f55f3400640 1 -- 172.21.15.32:0/2815241689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55ec070240 msgr2=0x7f55ec09d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.176+0000 7f55f3400640 1 --2- 172.21.15.32:0/2815241689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55ec070240 0x7f55ec09d840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f55d400c450 tx=0x7f55d400c910 comp rx=0 tx=0).stop 2024-03-19T06:21:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.176+0000 7f55f3400640 1 -- 172.21.15.32:0/2815241689 shutdown_connections 2024-03-19T06:21:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.176+0000 7f55f3400640 1 --2- 172.21.15.32:0/2815241689 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55c8067660 0x7f55c8069b20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.176+0000 7f55f3400640 1 --2- 172.21.15.32:0/2815241689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55ec15dba0 0x7f55ec09aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.176+0000 7f55f3400640 1 --2- 172.21.15.32:0/2815241689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55ec070240 0x7f55ec09d840 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.176+0000 7f55f3400640 1 --2- 172.21.15.32:0/2815241689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55ec06b280 0x7f55ec155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.176+0000 7f55f3400640 1 -- 172.21.15.32:0/2815241689 >> 172.21.15.32:0/2815241689 conn(0x7f55ec099a70 msgr2=0x7f55ec15fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:44.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.176+0000 7f55f3400640 1 -- 172.21.15.32:0/2815241689 shutdown_connections 2024-03-19T06:21:44.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.176+0000 7f55f3400640 1 -- 172.21.15.32:0/2815241689 wait complete. 2024-03-19T06:21:44.187 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:21:44.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.340+0000 7f8e78200640 1 Processor -- start 2024-03-19T06:21:44.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.340+0000 7f8e78200640 1 -- start start 2024-03-19T06:21:44.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.340+0000 7f8e78200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8e7015dbb0 0x7f8e7006c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:44.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.340+0000 7f8e78200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e7006c5a0 0x7f8e700b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:44.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.340+0000 7f8e78200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e700cbf00 con 0x7f8e700b3b60 2024-03-19T06:21:44.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.340+0000 7f8e78200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e700b3fb0 con 0x7f8e7015dbb0 2024-03-19T06:21:44.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.340+0000 7f8e78200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7006cb20 con 0x7f8e7006c5a0 2024-03-19T06:21:44.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.340+0000 7f8e75800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8e7015dbb0 0x7f8e7006c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:44.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.340+0000 7f8e76200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8e700b3b60 0x7f8e700d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33050/0 (socket says 172.21.15.32:33050) 2024-03-19T06:21:44.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.340+0000 7f8e76200640 1 -- 172.21.15.32:0/2289340301 learned_addr learned my addr 172.21.15.32:0/2289340301 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:44.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.340+0000 7f8e74e00640 1 --2- 172.21.15.32:0/2289340301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e7006c5a0 0x7f8e700b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:44.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.340+0000 7f8e75800640 1 -- 172.21.15.32:0/2289340301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e7006c5a0 msgr2=0x7f8e700b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:44.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.340+0000 7f8e75800640 1 --2- 172.21.15.32:0/2289340301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e7006c5a0 0x7f8e700b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.340+0000 7f8e75800640 1 -- 172.21.15.32:0/2289340301 >> v1:172.21.15.32:6789/0 conn(0x7f8e700b3b60 legacy=0x7f8e700d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:44.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.340+0000 7f8e75800640 1 -- 172.21.15.32:0/2289340301 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7006ce00 con 0x7f8e7015dbb0 2024-03-19T06:21:44.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.340+0000 7f8e6fe00640 1 -- 172.21.15.32:0/2289340301 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055948816 0 0) 0x7f8e700cbf00 con 0x7f8e700b3b60 2024-03-19T06:21:44.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.344+0000 7f8e75800640 1 --2- 172.21.15.32:0/2289340301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e7015dbb0 0x7f8e7006c060 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8e640097c0 tx=0x7f8e6401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1970ea7022ef4c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:44.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.344+0000 7f8e6fe00640 1 -- 172.21.15.32:0/2289340301 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e640b5070 con 0x7f8e7015dbb0 2024-03-19T06:21:44.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.344+0000 7f8e6fe00640 1 -- 172.21.15.32:0/2289340301 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e640a8990 con 0x7f8e7015dbb0 2024-03-19T06:21:44.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.344+0000 7f8e6fe00640 1 -- 172.21.15.32:0/2289340301 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e640a8d60 con 0x7f8e7015dbb0 2024-03-19T06:21:44.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.344+0000 7f8e78200640 1 -- 172.21.15.32:0/2289340301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e7015dbb0 msgr2=0x7f8e7006c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:44.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.344+0000 7f8e78200640 1 --2- 172.21.15.32:0/2289340301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e7015dbb0 0x7f8e7006c060 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8e640097c0 tx=0x7f8e6401ec90 comp rx=0 tx=0).stop 2024-03-19T06:21:44.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.344+0000 7f8e78200640 1 -- 172.21.15.32:0/2289340301 shutdown_connections 2024-03-19T06:21:44.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.344+0000 7f8e78200640 1 --2- 172.21.15.32:0/2289340301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e7006c5a0 0x7f8e700b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.344+0000 7f8e78200640 1 --2- 172.21.15.32:0/2289340301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e7015dbb0 0x7f8e7006c060 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.344+0000 7f8e78200640 1 -- 172.21.15.32:0/2289340301 >> 172.21.15.32:0/2289340301 conn(0x7f8e70066ca0 msgr2=0x7f8e700670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:44.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.344+0000 7f8e78200640 1 -- 172.21.15.32:0/2289340301 shutdown_connections 2024-03-19T06:21:44.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.344+0000 7f8e78200640 1 -- 172.21.15.32:0/2289340301 wait complete. 2024-03-19T06:21:44.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.344+0000 7f8e78200640 1 Processor -- start 2024-03-19T06:21:44.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.344+0000 7f8e78200640 1 -- start start 2024-03-19T06:21:44.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e78200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e7006c5a0 0x7f8e701f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:44.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e78200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e700b3b60 0x7f8e7014ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:44.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e78200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e7015dbb0 0x7f8e700cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:44.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e78200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7006d910 con 0x7f8e7006c5a0 2024-03-19T06:21:44.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e78200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e700cc1a0 con 0x7f8e7015dbb0 2024-03-19T06:21:44.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e78200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7015df90 con 0x7f8e700b3b60 2024-03-19T06:21:44.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e75800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e7006c5a0 0x7f8e701f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:44.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e75800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e7006c5a0 0x7f8e701f3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57556/0 (socket says 172.21.15.32:57556) 2024-03-19T06:21:44.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e75800640 1 -- 172.21.15.32:0/2566513824 learned_addr learned my addr 172.21.15.32:0/2566513824 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:44.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e75800640 1 -- 172.21.15.32:0/2566513824 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e700b3b60 msgr2=0x7f8e7014ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:44.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e75800640 1 --2- 172.21.15.32:0/2566513824 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e700b3b60 0x7f8e7014ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e75800640 1 -- 172.21.15.32:0/2566513824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e7015dbb0 msgr2=0x7f8e700cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:44.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e75800640 1 --2- 172.21.15.32:0/2566513824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e7015dbb0 0x7f8e700cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e75800640 1 -- 172.21.15.32:0/2566513824 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e700b24a0 con 0x7f8e7006c5a0 2024-03-19T06:21:44.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e75800640 1 --2- 172.21.15.32:0/2566513824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e7006c5a0 0x7f8e701f3f90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8e640b3040 tx=0x7f8e6401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:44.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e6d600640 1 -- 172.21.15.32:0/2566513824 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e640bf070 con 0x7f8e7006c5a0 2024-03-19T06:21:44.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e6d600640 1 -- 172.21.15.32:0/2566513824 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e640b0820 con 0x7f8e7006c5a0 2024-03-19T06:21:44.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e6d600640 1 -- 172.21.15.32:0/2566513824 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e640b5040 con 0x7f8e7006c5a0 2024-03-19T06:21:44.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e78200640 1 -- 172.21.15.32:0/2566513824 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e701f44d0 con 0x7f8e7006c5a0 2024-03-19T06:21:44.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e78200640 1 -- 172.21.15.32:0/2566513824 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e700c7060 con 0x7f8e7006c5a0 2024-03-19T06:21:44.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.348+0000 7f8e78200640 1 -- 172.21.15.32:0/2566513824 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e700749e0 con 0x7f8e7006c5a0 2024-03-19T06:21:44.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.352+0000 7f8e6d600640 1 -- 172.21.15.32:0/2566513824 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8e640b0c10 con 0x7f8e7006c5a0 2024-03-19T06:21:44.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.352+0000 7f8e6d600640 1 --2- 172.21.15.32:0/2566513824 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e50067660 0x7f8e50069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:44.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.352+0000 7f8e6d600640 1 -- 172.21.15.32:0/2566513824 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e641222b0 con 0x7f8e7006c5a0 2024-03-19T06:21:44.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.352+0000 7f8e74e00640 1 --2- 172.21.15.32:0/2566513824 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e50067660 0x7f8e50069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:44.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.352+0000 7f8e74e00640 1 --2- 172.21.15.32:0/2566513824 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e50067660 0x7f8e50069b20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8e7015c180 tx=0x7f8e5c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:44.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.356+0000 7f8e6d600640 1 -- 172.21.15.32:0/2566513824 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f8e701f44d0 con 0x7f8e7006c5a0 2024-03-19T06:21:44.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.516+0000 7f8e78200640 1 -- 172.21.15.32:0/2566513824 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e7014f110 con 0x7f8e7006c5a0 2024-03-19T06:21:44.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.516+0000 7f8e6d600640 1 -- 172.21.15.32:0/2566513824 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e640187f0 con 0x7f8e7006c5a0 2024-03-19T06:21:44.510 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:21:44.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.520+0000 7f8e78200640 1 -- 172.21.15.32:0/2566513824 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e50067660 msgr2=0x7f8e50069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:44.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.520+0000 7f8e78200640 1 --2- 172.21.15.32:0/2566513824 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e50067660 0x7f8e50069b20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8e7015c180 tx=0x7f8e5c008040 comp rx=0 tx=0).stop 2024-03-19T06:21:44.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.520+0000 7f8e78200640 1 -- 172.21.15.32:0/2566513824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e7006c5a0 msgr2=0x7f8e701f3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:44.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.520+0000 7f8e78200640 1 --2- 172.21.15.32:0/2566513824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e7006c5a0 0x7f8e701f3f90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8e640b3040 tx=0x7f8e6401ba30 comp rx=0 tx=0).stop 2024-03-19T06:21:44.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.520+0000 7f8e78200640 1 -- 172.21.15.32:0/2566513824 shutdown_connections 2024-03-19T06:21:44.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.520+0000 7f8e78200640 1 --2- 172.21.15.32:0/2566513824 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e50067660 0x7f8e50069b20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.520+0000 7f8e78200640 1 --2- 172.21.15.32:0/2566513824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e7015dbb0 0x7f8e700cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.520+0000 7f8e78200640 1 --2- 172.21.15.32:0/2566513824 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e700b3b60 0x7f8e7014ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.520+0000 7f8e78200640 1 --2- 172.21.15.32:0/2566513824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e7006c5a0 0x7f8e701f3f90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.520+0000 7f8e78200640 1 -- 172.21.15.32:0/2566513824 >> 172.21.15.32:0/2566513824 conn(0x7f8e70066ca0 msgr2=0x7f8e7015ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.520+0000 7f8e78200640 1 -- 172.21.15.32:0/2566513824 shutdown_connections 2024-03-19T06:21:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.520+0000 7f8e78200640 1 -- 172.21.15.32:0/2566513824 wait complete. 2024-03-19T06:21:44.531 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:21:44.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.680+0000 7f8eaa200640 1 Processor -- start 2024-03-19T06:21:44.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.680+0000 7f8eaa200640 1 -- start start 2024-03-19T06:21:44.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.680+0000 7f8eaa200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8ea40cc680 0x7f8ea415ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.680+0000 7f8eaa200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8ea40b4c50 0x7f8ea40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.680+0000 7f8eaa200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea40cb670 con 0x7f8ea415a7c0 2024-03-19T06:21:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.680+0000 7f8eaa200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea415e860 con 0x7f8ea40b4c50 2024-03-19T06:21:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.680+0000 7f8eaa200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea40b55c0 con 0x7f8ea40cc680 2024-03-19T06:21:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.684+0000 7f8ea3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8ea40b4c50 0x7f8ea40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.684+0000 7f8ea3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8ea40b4c50 0x7f8ea40b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57566/0 (socket says 172.21.15.32:57566) 2024-03-19T06:21:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.684+0000 7f8ea3e00640 1 -- 172.21.15.32:0/3426077997 learned_addr learned my addr 172.21.15.32:0/3426077997 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.684+0000 7f8e9aa00640 1 --2- 172.21.15.32:0/3426077997 >> v2:172.21.15.171:3300/0 conn(0x7f8ea40cc680 0x7f8ea415ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:44.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.684+0000 7f8ea3e00640 1 -- 172.21.15.32:0/3426077997 >> v2:172.21.15.171:3300/0 conn(0x7f8ea40cc680 msgr2=0x7f8ea415ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:44.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.684+0000 7f8ea3e00640 1 --2- 172.21.15.32:0/3426077997 >> v2:172.21.15.171:3300/0 conn(0x7f8ea40cc680 0x7f8ea415ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.684+0000 7f8ea3e00640 1 -- 172.21.15.32:0/3426077997 >> v1:172.21.15.171:6789/0 conn(0x7f8ea415a7c0 legacy=0x7f8ea40cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:44.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.684+0000 7f8ea3e00640 1 -- 172.21.15.32:0/3426077997 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40cb950 con 0x7f8ea40b4c50 2024-03-19T06:21:44.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.684+0000 7f8ea3e00640 1 --2- 172.21.15.32:0/3426077997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40b4c50 0x7f8ea40b5080 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40ccfa0 tx=0x7f8e9c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51558feccb633b89 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:44.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.684+0000 7f8ea2a00640 1 -- 172.21.15.32:0/3426077997 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0a58a0 con 0x7f8ea40b4c50 2024-03-19T06:21:44.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.684+0000 7f8ea2a00640 1 -- 172.21.15.32:0/3426077997 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c0a5a40 con 0x7f8ea40b4c50 2024-03-19T06:21:44.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.684+0000 7f8ea2a00640 1 -- 172.21.15.32:0/3426077997 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0a5e10 con 0x7f8ea40b4c50 2024-03-19T06:21:44.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8eaa200640 1 -- 172.21.15.32:0/3426077997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40b4c50 msgr2=0x7f8ea40b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:44.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8eaa200640 1 --2- 172.21.15.32:0/3426077997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40b4c50 0x7f8ea40b5080 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40ccfa0 tx=0x7f8e9c01c9c0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8eaa200640 1 -- 172.21.15.32:0/3426077997 shutdown_connections 2024-03-19T06:21:44.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8eaa200640 1 --2- 172.21.15.32:0/3426077997 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40b4c50 0x7f8ea40b5080 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8eaa200640 1 --2- 172.21.15.32:0/3426077997 >> v2:172.21.15.171:3300/0 conn(0x7f8ea40cc680 0x7f8ea415ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8eaa200640 1 -- 172.21.15.32:0/3426077997 >> 172.21.15.32:0/3426077997 conn(0x7f8ea40b1280 msgr2=0x7f8ea40b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:44.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8eaa200640 1 -- 172.21.15.32:0/3426077997 shutdown_connections 2024-03-19T06:21:44.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8eaa200640 1 -- 172.21.15.32:0/3426077997 wait complete. 2024-03-19T06:21:44.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8eaa200640 1 Processor -- start 2024-03-19T06:21:44.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8eaa200640 1 -- start start 2024-03-19T06:21:44.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8eaa200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ea40b4c50 0x7f8ea413c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:44.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8eaa200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40cc680 0x7f8ea40b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:44.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8eaa200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea415a7c0 0x7f8ea40c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8eaa200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40cbdb0 con 0x7f8ea40cc680 2024-03-19T06:21:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8eaa200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40cbc30 con 0x7f8ea40b4c50 2024-03-19T06:21:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8eaa200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea41677f0 con 0x7f8ea415a7c0 2024-03-19T06:21:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8e9aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40cc680 0x7f8ea40b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8e9aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40cc680 0x7f8ea40b3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57582/0 (socket says 172.21.15.32:57582) 2024-03-19T06:21:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8e9aa00640 1 -- 172.21.15.32:0/2694806688 learned_addr learned my addr 172.21.15.32:0/2694806688 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8ea3400640 1 --2- 172.21.15.32:0/2694806688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ea40b4c50 0x7f8ea413c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8ea3e00640 1 --2- 172.21.15.32:0/2694806688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea415a7c0 0x7f8ea40c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8e9aa00640 1 -- 172.21.15.32:0/2694806688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea415a7c0 msgr2=0x7f8ea40c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8e9aa00640 1 --2- 172.21.15.32:0/2694806688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea415a7c0 0x7f8ea40c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8e9aa00640 1 -- 172.21.15.32:0/2694806688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ea40b4c50 msgr2=0x7f8ea413c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8e9aa00640 1 --2- 172.21.15.32:0/2694806688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ea40b4c50 0x7f8ea413c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8e9aa00640 1 -- 172.21.15.32:0/2694806688 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40b4350 con 0x7f8ea40cc680 2024-03-19T06:21:44.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.688+0000 7f8e9aa00640 1 --2- 172.21.15.32:0/2694806688 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40cc680 0x7f8ea40b3e10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c00d620 tx=0x7f8e8c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:44.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.692+0000 7f8e9be00640 1 -- 172.21.15.32:0/2694806688 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c00b620 con 0x7f8ea40cc680 2024-03-19T06:21:44.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.692+0000 7f8e9be00640 1 -- 172.21.15.32:0/2694806688 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c019070 con 0x7f8ea40cc680 2024-03-19T06:21:44.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.692+0000 7f8e9be00640 1 -- 172.21.15.32:0/2694806688 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c00ba20 con 0x7f8ea40cc680 2024-03-19T06:21:44.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.692+0000 7f8eaa200640 1 -- 172.21.15.32:0/2694806688 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea415b470 con 0x7f8ea40cc680 2024-03-19T06:21:44.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.692+0000 7f8eaa200640 1 -- 172.21.15.32:0/2694806688 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea415db40 con 0x7f8ea40cc680 2024-03-19T06:21:44.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.692+0000 7f8eaa200640 1 -- 172.21.15.32:0/2694806688 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea40749e0 con 0x7f8ea40cc680 2024-03-19T06:21:44.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.692+0000 7f8e9be00640 1 -- 172.21.15.32:0/2694806688 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8e8c00bbc0 con 0x7f8ea40cc680 2024-03-19T06:21:44.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.692+0000 7f8e9be00640 1 --2- 172.21.15.32:0/2694806688 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e80067660 0x7f8e80069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:44.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.692+0000 7f8e9be00640 1 -- 172.21.15.32:0/2694806688 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e8c085c40 con 0x7f8ea40cc680 2024-03-19T06:21:44.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.692+0000 7f8ea3400640 1 --2- 172.21.15.32:0/2694806688 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e80067660 0x7f8e80069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:44.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.696+0000 7f8ea3400640 1 --2- 172.21.15.32:0/2694806688 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e80067660 0x7f8e80069b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8e94007fd0 tx=0x7f8e94009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:44.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.696+0000 7f8e9be00640 1 -- 172.21.15.32:0/2694806688 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f8e8c0561d0 con 0x7f8ea40cc680 2024-03-19T06:21:44.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.872+0000 7f8eaa200640 1 -- 172.21.15.32:0/2694806688 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8ea40cc270 con 0x7f8ea40cc680 2024-03-19T06:21:44.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.872+0000 7f8e9be00640 1 -- 172.21.15.32:0/2694806688 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8e8c05a270 con 0x7f8ea40cc680 2024-03-19T06:21:44.866 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:21:44.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.876+0000 7f8eaa200640 1 -- 172.21.15.32:0/2694806688 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e80067660 msgr2=0x7f8e80069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:44.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.876+0000 7f8eaa200640 1 --2- 172.21.15.32:0/2694806688 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e80067660 0x7f8e80069b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8e94007fd0 tx=0x7f8e94009040 comp rx=0 tx=0).stop 2024-03-19T06:21:44.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.876+0000 7f8eaa200640 1 -- 172.21.15.32:0/2694806688 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40cc680 msgr2=0x7f8ea40b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:44.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.876+0000 7f8eaa200640 1 --2- 172.21.15.32:0/2694806688 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40cc680 0x7f8ea40b3e10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c00d620 tx=0x7f8e8c00dae0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.876+0000 7f8eaa200640 1 -- 172.21.15.32:0/2694806688 shutdown_connections 2024-03-19T06:21:44.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.876+0000 7f8eaa200640 1 --2- 172.21.15.32:0/2694806688 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e80067660 0x7f8e80069b20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.876+0000 7f8eaa200640 1 --2- 172.21.15.32:0/2694806688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea415a7c0 0x7f8ea40c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.876+0000 7f8eaa200640 1 --2- 172.21.15.32:0/2694806688 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40cc680 0x7f8ea40b3e10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.876+0000 7f8eaa200640 1 --2- 172.21.15.32:0/2694806688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ea40b4c50 0x7f8ea413c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:44.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.876+0000 7f8eaa200640 1 -- 172.21.15.32:0/2694806688 >> 172.21.15.32:0/2694806688 conn(0x7f8ea40b1280 msgr2=0x7f8ea4151c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:44.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.876+0000 7f8eaa200640 1 -- 172.21.15.32:0/2694806688 shutdown_connections 2024-03-19T06:21:44.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:44.876+0000 7f8eaa200640 1 -- 172.21.15.32:0/2694806688 wait complete. 2024-03-19T06:21:44.887 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:21:44.887 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:21:44.896 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:45.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.088+0000 7f8a2de00640 1 Processor -- start 2024-03-19T06:21:45.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.088+0000 7f8a2de00640 1 -- start start 2024-03-19T06:21:45.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.092+0000 7f8a2de00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8a28099a70 0x7f8a28099e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.092+0000 7f8a2de00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a2806c060 0x7f8a2815e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.092+0000 7f8a2de00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2806fbe0 con 0x7f8a28161860 2024-03-19T06:21:45.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.092+0000 7f8a2de00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2809a390 con 0x7f8a28099a70 2024-03-19T06:21:45.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.092+0000 7f8a2de00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2815e940 con 0x7f8a2806c060 2024-03-19T06:21:45.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.092+0000 7f8a27400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8a28161860 0x7f8a28161cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33058/0 (socket says 172.21.15.32:33058) 2024-03-19T06:21:45.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.092+0000 7f8a27400640 1 -- 172.21.15.32:0/4185909164 learned_addr learned my addr 172.21.15.32:0/4185909164 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:45.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.092+0000 7f8a26a00640 1 --2- 172.21.15.32:0/4185909164 >> v2:172.21.15.171:3300/0 conn(0x7f8a28099a70 0x7f8a28099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.092+0000 7f8a1fe00640 1 --2- 172.21.15.32:0/4185909164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a2806c060 0x7f8a2815e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.092+0000 7f8a26000640 1 -- 172.21.15.32:0/4185909164 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650760209 0 0) 0x7f8a200014a0 con 0x7f8a28161860 2024-03-19T06:21:45.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.092+0000 7f8a26000640 1 -- 172.21.15.32:0/4185909164 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a0c003530 con 0x7f8a28161860 2024-03-19T06:21:45.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.092+0000 7f8a26a00640 1 -- 172.21.15.32:0/4185909164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a2806c060 msgr2=0x7f8a2815e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:45.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.092+0000 7f8a26a00640 1 --2- 172.21.15.32:0/4185909164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a2806c060 0x7f8a2815e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.092+0000 7f8a26a00640 1 -- 172.21.15.32:0/4185909164 >> v1:172.21.15.32:6789/0 conn(0x7f8a28161860 legacy=0x7f8a28161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.092+0000 7f8a26a00640 1 -- 172.21.15.32:0/4185909164 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2815ec20 con 0x7f8a28099a70 2024-03-19T06:21:45.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a26a00640 1 --2- 172.21.15.32:0/4185909164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a28099a70 0x7f8a28099e50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8a180097c0 tx=0x7f8a1801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bfd8397d19f304d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:45.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a26000640 1 -- 172.21.15.32:0/4185909164 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a180b2070 con 0x7f8a28099a70 2024-03-19T06:21:45.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a26000640 1 -- 172.21.15.32:0/4185909164 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a180ad640 con 0x7f8a28099a70 2024-03-19T06:21:45.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a26000640 1 -- 172.21.15.32:0/4185909164 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a180ada10 con 0x7f8a28099a70 2024-03-19T06:21:45.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a2de00640 1 -- 172.21.15.32:0/4185909164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a28099a70 msgr2=0x7f8a28099e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a2de00640 1 --2- 172.21.15.32:0/4185909164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a28099a70 0x7f8a28099e50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8a180097c0 tx=0x7f8a1801c4a0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a2de00640 1 -- 172.21.15.32:0/4185909164 shutdown_connections 2024-03-19T06:21:45.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a2de00640 1 --2- 172.21.15.32:0/4185909164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a2806c060 0x7f8a2815e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a2de00640 1 --2- 172.21.15.32:0/4185909164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a28099a70 0x7f8a28099e50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a2de00640 1 -- 172.21.15.32:0/4185909164 >> 172.21.15.32:0/4185909164 conn(0x7f8a280b3300 msgr2=0x7f8a280b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:45.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a2de00640 1 -- 172.21.15.32:0/4185909164 shutdown_connections 2024-03-19T06:21:45.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a2de00640 1 -- 172.21.15.32:0/4185909164 wait complete. 2024-03-19T06:21:45.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a2de00640 1 Processor -- start 2024-03-19T06:21:45.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a2de00640 1 -- start start 2024-03-19T06:21:45.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a2de00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a2806c060 0x7f8a2815b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a2de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a28099a70 0x7f8a28155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a2de00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a28161860 0x7f8a28159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a2de00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2815e6d0 con 0x7f8a28099a70 2024-03-19T06:21:45.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a2de00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2815e550 con 0x7f8a28161860 2024-03-19T06:21:45.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.096+0000 7f8a2de00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2816b410 con 0x7f8a2806c060 2024-03-19T06:21:45.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a1fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a28099a70 0x7f8a28155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a1fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a28099a70 0x7f8a28155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57586/0 (socket says 172.21.15.32:57586) 2024-03-19T06:21:45.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a1fe00640 1 -- 172.21.15.32:0/1078301312 learned_addr learned my addr 172.21.15.32:0/1078301312 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:45.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a26a00640 1 --2- 172.21.15.32:0/1078301312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a2806c060 0x7f8a2815b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a27400640 1 --2- 172.21.15.32:0/1078301312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a28161860 0x7f8a28159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a1fe00640 1 -- 172.21.15.32:0/1078301312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a2806c060 msgr2=0x7f8a2815b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a1fe00640 1 --2- 172.21.15.32:0/1078301312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a2806c060 0x7f8a2815b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a1fe00640 1 -- 172.21.15.32:0/1078301312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a28161860 msgr2=0x7f8a28159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a1fe00640 1 --2- 172.21.15.32:0/1078301312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a28161860 0x7f8a28159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a1fe00640 1 -- 172.21.15.32:0/1078301312 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a281564f0 con 0x7f8a28099a70 2024-03-19T06:21:45.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a1fe00640 1 --2- 172.21.15.32:0/1078301312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a28099a70 0x7f8a28155fb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000e870 tx=0x7f8a1000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:45.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a1f400640 1 -- 172.21.15.32:0/1078301312 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10017070 con 0x7f8a28099a70 2024-03-19T06:21:45.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a1f400640 1 -- 172.21.15.32:0/1078301312 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1000c940 con 0x7f8a28099a70 2024-03-19T06:21:45.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a2de00640 1 -- 172.21.15.32:0/1078301312 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a28156790 con 0x7f8a28099a70 2024-03-19T06:21:45.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a1f400640 1 -- 172.21.15.32:0/1078301312 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1000ccf0 con 0x7f8a28099a70 2024-03-19T06:21:45.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a2de00640 1 -- 172.21.15.32:0/1078301312 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a28156d50 con 0x7f8a28099a70 2024-03-19T06:21:45.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a2de00640 1 -- 172.21.15.32:0/1078301312 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a280749e0 con 0x7f8a28099a70 2024-03-19T06:21:45.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.100+0000 7f8a1f400640 1 -- 172.21.15.32:0/1078301312 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8a1001a070 con 0x7f8a28099a70 2024-03-19T06:21:45.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.104+0000 7f8a1f400640 1 --2- 172.21.15.32:0/1078301312 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a04067660 0x7f8a04069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.104+0000 7f8a1f400640 1 -- 172.21.15.32:0/1078301312 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a100857e0 con 0x7f8a28099a70 2024-03-19T06:21:45.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.104+0000 7f8a26a00640 1 --2- 172.21.15.32:0/1078301312 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a04067660 0x7f8a04069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.104+0000 7f8a26a00640 1 --2- 172.21.15.32:0/1078301312 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a04067660 0x7f8a04069b20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8a180af000 tx=0x7f8a18008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:45.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.108+0000 7f8a1f400640 1 -- 172.21.15.32:0/1078301312 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f8a100563c0 con 0x7f8a28099a70 2024-03-19T06:21:45.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.268+0000 7f8a2de00640 1 -- 172.21.15.32:0/1078301312 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a280c8350 con 0x7f8a28099a70 2024-03-19T06:21:45.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.268+0000 7f8a1f400640 1 -- 172.21.15.32:0/1078301312 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f8a1005c0c0 con 0x7f8a28099a70 2024-03-19T06:21:45.262 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:45.262 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:10.423479+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.272+0000 7f8a2de00640 1 -- 172.21.15.32:0/1078301312 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a04067660 msgr2=0x7f8a04069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.272+0000 7f8a2de00640 1 --2- 172.21.15.32:0/1078301312 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a04067660 0x7f8a04069b20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8a180af000 tx=0x7f8a18008040 comp rx=0 tx=0).stop 2024-03-19T06:21:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.272+0000 7f8a2de00640 1 -- 172.21.15.32:0/1078301312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a28099a70 msgr2=0x7f8a28155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.272+0000 7f8a2de00640 1 --2- 172.21.15.32:0/1078301312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a28099a70 0x7f8a28155fb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000e870 tx=0x7f8a1000ec70 comp rx=0 tx=0).stop 2024-03-19T06:21:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.272+0000 7f8a2de00640 1 -- 172.21.15.32:0/1078301312 shutdown_connections 2024-03-19T06:21:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.272+0000 7f8a2de00640 1 --2- 172.21.15.32:0/1078301312 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a04067660 0x7f8a04069b20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.272+0000 7f8a2de00640 1 --2- 172.21.15.32:0/1078301312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a28161860 0x7f8a28159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.272+0000 7f8a2de00640 1 --2- 172.21.15.32:0/1078301312 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a28099a70 0x7f8a28155fb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.272+0000 7f8a2de00640 1 --2- 172.21.15.32:0/1078301312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a2806c060 0x7f8a2815b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.272+0000 7f8a2de00640 1 -- 172.21.15.32:0/1078301312 >> 172.21.15.32:0/1078301312 conn(0x7f8a280b3300 msgr2=0x7f8a280b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.272+0000 7f8a2de00640 1 -- 172.21.15.32:0/1078301312 shutdown_connections 2024-03-19T06:21:45.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.272+0000 7f8a2de00640 1 -- 172.21.15.32:0/1078301312 wait complete. 2024-03-19T06:21:45.285 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:21:07.089673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:21:07.801319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:45.285 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:45.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.436+0000 7f31eea00640 1 Processor -- start 2024-03-19T06:21:45.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.436+0000 7f31eea00640 1 -- start start 2024-03-19T06:21:45.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.436+0000 7f31eea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31e806b450 0x7f31e806f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.436+0000 7f31eea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f31e80aea70 0x7f31e80ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.436+0000 7f31eea00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e80af2d0 con 0x7f31e815a840 2024-03-19T06:21:45.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.436+0000 7f31eea00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e80cdc20 con 0x7f31e80aea70 2024-03-19T06:21:45.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.436+0000 7f31eea00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e815eea0 con 0x7f31e806b450 2024-03-19T06:21:45.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.436+0000 7f31eca00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f31e80aea70 0x7f31e80ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.436+0000 7f31eca00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f31e80aea70 0x7f31e80ce0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57590/0 (socket says 172.21.15.32:57590) 2024-03-19T06:21:45.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.436+0000 7f31eca00640 1 -- 172.21.15.32:0/709124416 learned_addr learned my addr 172.21.15.32:0/709124416 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:45.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.436+0000 7f31dfe00640 1 --2- 172.21.15.32:0/709124416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31e806b450 0x7f31e806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.436+0000 7f31eca00640 1 -- 172.21.15.32:0/709124416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31e806b450 msgr2=0x7f31e806f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:45.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.436+0000 7f31eca00640 1 --2- 172.21.15.32:0/709124416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31e806b450 0x7f31e806f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.436+0000 7f31eca00640 1 -- 172.21.15.32:0/709124416 >> v1:172.21.15.171:6789/0 conn(0x7f31e815a840 legacy=0x7f31e806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.436+0000 7f31eca00640 1 -- 172.21.15.32:0/709124416 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e815f180 con 0x7f31e80aea70 2024-03-19T06:21:45.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.440+0000 7f31eca00640 1 --2- 172.21.15.32:0/709124416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e80aea70 0x7f31e80ce0b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009e50 tx=0x7f31e001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971439a18558b3b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:45.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.440+0000 7f31e7400640 1 -- 172.21.15.32:0/709124416 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e00a57f0 con 0x7f31e80aea70 2024-03-19T06:21:45.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.440+0000 7f31e7400640 1 -- 172.21.15.32:0/709124416 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e00a5990 con 0x7f31e80aea70 2024-03-19T06:21:45.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.440+0000 7f31e7400640 1 -- 172.21.15.32:0/709124416 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e00a5d60 con 0x7f31e80aea70 2024-03-19T06:21:45.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.440+0000 7f31eea00640 1 -- 172.21.15.32:0/709124416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e80aea70 msgr2=0x7f31e80ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.440+0000 7f31eea00640 1 --2- 172.21.15.32:0/709124416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e80aea70 0x7f31e80ce0b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009e50 tx=0x7f31e001c8d0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.440+0000 7f31eea00640 1 -- 172.21.15.32:0/709124416 shutdown_connections 2024-03-19T06:21:45.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.440+0000 7f31eea00640 1 --2- 172.21.15.32:0/709124416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e80aea70 0x7f31e80ce0b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.440+0000 7f31eea00640 1 --2- 172.21.15.32:0/709124416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31e806b450 0x7f31e806f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.440+0000 7f31eea00640 1 -- 172.21.15.32:0/709124416 >> 172.21.15.32:0/709124416 conn(0x7f31e80b1590 msgr2=0x7f31e80b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:45.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.440+0000 7f31eea00640 1 -- 172.21.15.32:0/709124416 shutdown_connections 2024-03-19T06:21:45.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.440+0000 7f31eea00640 1 -- 172.21.15.32:0/709124416 wait complete. 2024-03-19T06:21:45.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31eea00640 1 Processor -- start 2024-03-19T06:21:45.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31eea00640 1 -- start start 2024-03-19T06:21:45.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31eea00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31e806b450 0x7f31e8149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31eea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e80aea70 0x7f31e8155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31eea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31e815a840 0x7f31e81558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31eea00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80cef80 con 0x7f31e80aea70 2024-03-19T06:21:45.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31eea00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80cee00 con 0x7f31e806b450 2024-03-19T06:21:45.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31eea00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80cf100 con 0x7f31e815a840 2024-03-19T06:21:45.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31dfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e80aea70 0x7f31e8155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31dfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e80aea70 0x7f31e8155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57594/0 (socket says 172.21.15.32:57594) 2024-03-19T06:21:45.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31e7e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31e806b450 0x7f31e8149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31dfe00640 1 -- 172.21.15.32:0/2206747496 learned_addr learned my addr 172.21.15.32:0/2206747496 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:45.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31eca00640 1 --2- 172.21.15.32:0/2206747496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31e815a840 0x7f31e81558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31dfe00640 1 -- 172.21.15.32:0/2206747496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31e815a840 msgr2=0x7f31e81558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31dfe00640 1 --2- 172.21.15.32:0/2206747496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31e815a840 0x7f31e81558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31dfe00640 1 -- 172.21.15.32:0/2206747496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31e806b450 msgr2=0x7f31e8149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31dfe00640 1 --2- 172.21.15.32:0/2206747496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31e806b450 0x7f31e8149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31dfe00640 1 -- 172.21.15.32:0/2206747496 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e8157460 con 0x7f31e80aea70 2024-03-19T06:21:45.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31dfe00640 1 --2- 172.21.15.32:0/2206747496 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e80aea70 0x7f31e8155380 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f31d000d5f0 tx=0x7f31d000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:45.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31e4c00640 1 -- 172.21.15.32:0/2206747496 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d00125f0 con 0x7f31e80aea70 2024-03-19T06:21:45.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31e4c00640 1 -- 172.21.15.32:0/2206747496 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d0019070 con 0x7f31e80aea70 2024-03-19T06:21:45.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31eea00640 1 -- 172.21.15.32:0/2206747496 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e8157740 con 0x7f31e80aea70 2024-03-19T06:21:45.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31e4c00640 1 -- 172.21.15.32:0/2206747496 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d00129d0 con 0x7f31e80aea70 2024-03-19T06:21:45.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.444+0000 7f31eea00640 1 -- 172.21.15.32:0/2206747496 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e8157d00 con 0x7f31e80aea70 2024-03-19T06:21:45.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.448+0000 7f31eea00640 1 -- 172.21.15.32:0/2206747496 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e80749e0 con 0x7f31e80aea70 2024-03-19T06:21:45.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.448+0000 7f31e4c00640 1 -- 172.21.15.32:0/2206747496 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f31d0012b70 con 0x7f31e80aea70 2024-03-19T06:21:45.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.448+0000 7f31e4c00640 1 --2- 172.21.15.32:0/2206747496 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f31c4067690 0x7f31c4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.448+0000 7f31e4c00640 1 -- 172.21.15.32:0/2206747496 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31d0085c30 con 0x7f31e80aea70 2024-03-19T06:21:45.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.448+0000 7f31e7e00640 1 --2- 172.21.15.32:0/2206747496 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f31c4067690 0x7f31c4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.448+0000 7f31e7e00640 1 --2- 172.21.15.32:0/2206747496 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f31c4067690 0x7f31c4069b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f31d8001810 tx=0x7f31d8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:45.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.452+0000 7f31e4c00640 1 -- 172.21.15.32:0/2206747496 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f31d00561c0 con 0x7f31e80aea70 2024-03-19T06:21:45.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.616+0000 7f31eea00640 1 -- 172.21.15.32:0/2206747496 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f31e806e6c0 con 0x7f31e80aea70 2024-03-19T06:21:45.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.616+0000 7f31e4c00640 1 -- 172.21.15.32:0/2206747496 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f31d005a260 con 0x7f31e80aea70 2024-03-19T06:21:45.610 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:45.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.620+0000 7f31eea00640 1 -- 172.21.15.32:0/2206747496 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f31c4067690 msgr2=0x7f31c4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.620+0000 7f31eea00640 1 --2- 172.21.15.32:0/2206747496 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f31c4067690 0x7f31c4069b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f31d8001810 tx=0x7f31d8009040 comp rx=0 tx=0).stop 2024-03-19T06:21:45.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.620+0000 7f31eea00640 1 -- 172.21.15.32:0/2206747496 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e80aea70 msgr2=0x7f31e8155380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.620+0000 7f31eea00640 1 --2- 172.21.15.32:0/2206747496 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e80aea70 0x7f31e8155380 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f31d000d5f0 tx=0x7f31d000dab0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.620+0000 7f31eea00640 1 -- 172.21.15.32:0/2206747496 shutdown_connections 2024-03-19T06:21:45.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.620+0000 7f31eea00640 1 --2- 172.21.15.32:0/2206747496 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f31c4067690 0x7f31c4069b50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.620+0000 7f31eea00640 1 --2- 172.21.15.32:0/2206747496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31e815a840 0x7f31e81558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.620+0000 7f31eea00640 1 --2- 172.21.15.32:0/2206747496 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e80aea70 0x7f31e8155380 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.620+0000 7f31eea00640 1 --2- 172.21.15.32:0/2206747496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31e806b450 0x7f31e8149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.620+0000 7f31eea00640 1 -- 172.21.15.32:0/2206747496 >> 172.21.15.32:0/2206747496 conn(0x7f31e80b1590 msgr2=0x7f31e8159430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:45.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.620+0000 7f31eea00640 1 -- 172.21.15.32:0/2206747496 shutdown_connections 2024-03-19T06:21:45.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.620+0000 7f31eea00640 1 -- 172.21.15.32:0/2206747496 wait complete. 2024-03-19T06:21:45.632 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:21:45.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.780+0000 7f12e5c00640 1 Processor -- start 2024-03-19T06:21:45.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.780+0000 7f12e5c00640 1 -- start start 2024-03-19T06:21:45.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.784+0000 7f12e5c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e015a840 0x7f12e006f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.784+0000 7f12e5c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f12e00aea70 0x7f12e006ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.784+0000 7f12e5c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e00af2d0 con 0x7f12e006b280 2024-03-19T06:21:45.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.784+0000 7f12e5c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e00cdc20 con 0x7f12e00aea70 2024-03-19T06:21:45.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.784+0000 7f12e5c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e015eea0 con 0x7f12e015a840 2024-03-19T06:21:45.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.784+0000 7f12d6000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f12e00aea70 0x7f12e006ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.784+0000 7f12df400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f12e006b280 0x7f12e006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33060/0 (socket says 172.21.15.32:33060) 2024-03-19T06:21:45.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.784+0000 7f12df400640 1 -- 172.21.15.32:0/3362299098 learned_addr learned my addr 172.21.15.32:0/3362299098 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:45.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.784+0000 7f12dea00640 1 --2- 172.21.15.32:0/3362299098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e015a840 0x7f12e006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.784+0000 7f12d6000640 1 -- 172.21.15.32:0/3362299098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e015a840 msgr2=0x7f12e006f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:45.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.784+0000 7f12d6000640 1 --2- 172.21.15.32:0/3362299098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e015a840 0x7f12e006f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.784+0000 7f12d6000640 1 -- 172.21.15.32:0/3362299098 >> v1:172.21.15.32:6789/0 conn(0x7f12e006b280 legacy=0x7f12e006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.784+0000 7f12d6000640 1 -- 172.21.15.32:0/3362299098 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e015f180 con 0x7f12e00aea70 2024-03-19T06:21:45.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.784+0000 7f12de000640 1 -- 172.21.15.32:0/3362299098 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401348549 0 0) 0x7f12e00af2d0 con 0x7f12e006b280 2024-03-19T06:21:45.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.784+0000 7f12dea00640 1 --2- 172.21.15.32:0/3362299098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e015a840 0x7f12e006f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:45.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.788+0000 7f12d6000640 1 --2- 172.21.15.32:0/3362299098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12e00aea70 0x7f12e006ad40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f12c800ba60 tx=0x7f12c801ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ae9a6e31819693 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:45.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.788+0000 7f12de000640 1 -- 172.21.15.32:0/3362299098 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c80b4070 con 0x7f12e00aea70 2024-03-19T06:21:45.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.788+0000 7f12de000640 1 -- 172.21.15.32:0/3362299098 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c80a7a30 con 0x7f12e00aea70 2024-03-19T06:21:45.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.788+0000 7f12de000640 1 -- 172.21.15.32:0/3362299098 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c80a7e00 con 0x7f12e00aea70 2024-03-19T06:21:45.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.788+0000 7f12e5c00640 1 -- 172.21.15.32:0/3362299098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12e00aea70 msgr2=0x7f12e006ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.788+0000 7f12e5c00640 1 --2- 172.21.15.32:0/3362299098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12e00aea70 0x7f12e006ad40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f12c800ba60 tx=0x7f12c801ea50 comp rx=0 tx=0).stop 2024-03-19T06:21:45.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.788+0000 7f12e5c00640 1 -- 172.21.15.32:0/3362299098 shutdown_connections 2024-03-19T06:21:45.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.788+0000 7f12e5c00640 1 --2- 172.21.15.32:0/3362299098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12e00aea70 0x7f12e006ad40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.788+0000 7f12e5c00640 1 --2- 172.21.15.32:0/3362299098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e015a840 0x7f12e006f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.788+0000 7f12e5c00640 1 -- 172.21.15.32:0/3362299098 >> 172.21.15.32:0/3362299098 conn(0x7f12e00b1590 msgr2=0x7f12e00b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:45.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.788+0000 7f12e5c00640 1 -- 172.21.15.32:0/3362299098 shutdown_connections 2024-03-19T06:21:45.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.788+0000 7f12e5c00640 1 -- 172.21.15.32:0/3362299098 wait complete. 2024-03-19T06:21:45.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.788+0000 7f12e5c00640 1 Processor -- start 2024-03-19T06:21:45.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.788+0000 7f12e5c00640 1 -- start start 2024-03-19T06:21:45.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12e5c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12e006b280 0x7f12e01533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12e5c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12e00aea70 0x7f12e015ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12e5c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e015a840 0x7f12e015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12e5c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00716d0 con 0x7f12e00aea70 2024-03-19T06:21:45.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12e5c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e0071550 con 0x7f12e006b280 2024-03-19T06:21:45.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12e5c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e0071850 con 0x7f12e015a840 2024-03-19T06:21:45.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12d6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12e00aea70 0x7f12e015ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12d6000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12e00aea70 0x7f12e015ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57614/0 (socket says 172.21.15.32:57614) 2024-03-19T06:21:45.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12d6000640 1 -- 172.21.15.32:0/510968641 learned_addr learned my addr 172.21.15.32:0/510968641 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:45.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12dea00640 1 --2- 172.21.15.32:0/510968641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12e006b280 0x7f12e01533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12df400640 1 --2- 172.21.15.32:0/510968641 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e015a840 0x7f12e015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12d6000640 1 -- 172.21.15.32:0/510968641 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e015a840 msgr2=0x7f12e015d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12d6000640 1 --2- 172.21.15.32:0/510968641 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e015a840 0x7f12e015d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12d6000640 1 -- 172.21.15.32:0/510968641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12e006b280 msgr2=0x7f12e01533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12d6000640 1 --2- 172.21.15.32:0/510968641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12e006b280 0x7f12e01533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12d6000640 1 -- 172.21.15.32:0/510968641 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e015bad0 con 0x7f12e00aea70 2024-03-19T06:21:45.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12df400640 1 --2- 172.21.15.32:0/510968641 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e015a840 0x7f12e015d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:45.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12dea00640 1 --2- 172.21.15.32:0/510968641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12e006b280 0x7f12e01533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:45.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12d6000640 1 --2- 172.21.15.32:0/510968641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12e00aea70 0x7f12e015ce70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f12c800ba60 tx=0x7f12c801b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:45.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12d7400640 1 -- 172.21.15.32:0/510968641 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c80bf070 con 0x7f12e00aea70 2024-03-19T06:21:45.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12d7400640 1 -- 172.21.15.32:0/510968641 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c8004230 con 0x7f12e00aea70 2024-03-19T06:21:45.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12d7400640 1 -- 172.21.15.32:0/510968641 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c80b4040 con 0x7f12e00aea70 2024-03-19T06:21:45.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12e5c00640 1 -- 172.21.15.32:0/510968641 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e015bdb0 con 0x7f12e00aea70 2024-03-19T06:21:45.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12e5c00640 1 -- 172.21.15.32:0/510968641 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e0157170 con 0x7f12e00aea70 2024-03-19T06:21:45.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12e5c00640 1 -- 172.21.15.32:0/510968641 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e00749e0 con 0x7f12e00aea70 2024-03-19T06:21:45.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.792+0000 7f12d7400640 1 -- 172.21.15.32:0/510968641 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f12c80af680 con 0x7f12e00aea70 2024-03-19T06:21:45.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.796+0000 7f12d7400640 1 --2- 172.21.15.32:0/510968641 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f12bc067660 0x7f12bc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:45.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.796+0000 7f12d7400640 1 -- 172.21.15.32:0/510968641 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12c811fbf0 con 0x7f12e00aea70 2024-03-19T06:21:45.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.796+0000 7f12dea00640 1 --2- 172.21.15.32:0/510968641 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f12bc067660 0x7f12bc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:45.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.796+0000 7f12dea00640 1 --2- 172.21.15.32:0/510968641 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f12bc067660 0x7f12bc069b20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f12e0158dc0 tx=0x7f12d0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:45.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.800+0000 7f12d7400640 1 -- 172.21.15.32:0/510968641 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f12c8018760 con 0x7f12e00aea70 2024-03-19T06:21:45.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.960+0000 7f12e5c00640 1 -- 172.21.15.32:0/510968641 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12e006e6c0 con 0x7f12e00aea70 2024-03-19T06:21:45.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.960+0000 7f12d7400640 1 -- 172.21.15.32:0/510968641 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12c80f07d0 con 0x7f12e00aea70 2024-03-19T06:21:45.953 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:21:45.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.960+0000 7f12e5c00640 1 -- 172.21.15.32:0/510968641 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f12bc067660 msgr2=0x7f12bc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.960+0000 7f12e5c00640 1 --2- 172.21.15.32:0/510968641 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f12bc067660 0x7f12bc069b20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f12e0158dc0 tx=0x7f12d0008040 comp rx=0 tx=0).stop 2024-03-19T06:21:45.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.960+0000 7f12e5c00640 1 -- 172.21.15.32:0/510968641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12e00aea70 msgr2=0x7f12e015ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:45.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.960+0000 7f12e5c00640 1 --2- 172.21.15.32:0/510968641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12e00aea70 0x7f12e015ce70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f12c800ba60 tx=0x7f12c801b7f0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.960+0000 7f12e5c00640 1 -- 172.21.15.32:0/510968641 shutdown_connections 2024-03-19T06:21:45.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.960+0000 7f12e5c00640 1 --2- 172.21.15.32:0/510968641 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f12bc067660 0x7f12bc069b20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.960+0000 7f12e5c00640 1 --2- 172.21.15.32:0/510968641 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e015a840 0x7f12e015d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.960+0000 7f12e5c00640 1 --2- 172.21.15.32:0/510968641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12e00aea70 0x7f12e015ce70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.960+0000 7f12e5c00640 1 --2- 172.21.15.32:0/510968641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12e006b280 0x7f12e01533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:45.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.960+0000 7f12e5c00640 1 -- 172.21.15.32:0/510968641 >> 172.21.15.32:0/510968641 conn(0x7f12e00b1590 msgr2=0x7f12e015e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:45.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.960+0000 7f12e5c00640 1 -- 172.21.15.32:0/510968641 shutdown_connections 2024-03-19T06:21:45.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:45.960+0000 7f12e5c00640 1 -- 172.21.15.32:0/510968641 wait complete. 2024-03-19T06:21:45.975 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:21:46.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.128+0000 7f680f800640 1 Processor -- start 2024-03-19T06:21:46.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.128+0000 7f680f800640 1 -- start start 2024-03-19T06:21:46.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.128+0000 7f680f800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f680815dbb0 0x7f680806c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.128+0000 7f680f800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f68080b3d30 0x7f68080cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.128+0000 7f680f800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68080cbf00 con 0x7f680806c5a0 2024-03-19T06:21:46.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.128+0000 7f680f800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680806cb20 con 0x7f68080b3d30 2024-03-19T06:21:46.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.128+0000 7f680f800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680806ce00 con 0x7f680815dbb0 2024-03-19T06:21:46.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.128+0000 7f680d800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f68080b3d30 0x7f68080cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.128+0000 7f680d800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f68080b3d30 0x7f68080cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57624/0 (socket says 172.21.15.32:57624) 2024-03-19T06:21:46.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.128+0000 7f680d800640 1 -- 172.21.15.32:0/3898339618 learned_addr learned my addr 172.21.15.32:0/3898339618 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:46.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.128+0000 7f680ce00640 1 --2- 172.21.15.32:0/3898339618 >> v2:172.21.15.171:3300/0 conn(0x7f680815dbb0 0x7f680806c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.128+0000 7f680d800640 1 -- 172.21.15.32:0/3898339618 >> v2:172.21.15.171:3300/0 conn(0x7f680815dbb0 msgr2=0x7f680806c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:46.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.128+0000 7f680d800640 1 --2- 172.21.15.32:0/3898339618 >> v2:172.21.15.171:3300/0 conn(0x7f680815dbb0 0x7f680806c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.128+0000 7f680d800640 1 -- 172.21.15.32:0/3898339618 >> v1:172.21.15.171:6789/0 conn(0x7f680806c5a0 legacy=0x7f68080b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.128+0000 7f680d800640 1 -- 172.21.15.32:0/3898339618 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680806d0e0 con 0x7f68080b3d30 2024-03-19T06:21:46.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.132+0000 7f680d800640 1 --2- 172.21.15.32:0/3898339618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68080b3d30 0x7f68080cc6c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6808072f00 tx=0x7f680001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b13a622c1c63cc server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:46.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.132+0000 7f6807e00640 1 -- 172.21.15.32:0/3898339618 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000b4070 con 0x7f68080b3d30 2024-03-19T06:21:46.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.132+0000 7f6807e00640 1 -- 172.21.15.32:0/3898339618 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68000af400 con 0x7f68080b3d30 2024-03-19T06:21:46.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.132+0000 7f6807e00640 1 -- 172.21.15.32:0/3898339618 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000af7d0 con 0x7f68080b3d30 2024-03-19T06:21:46.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.132+0000 7f680f800640 1 -- 172.21.15.32:0/3898339618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68080b3d30 msgr2=0x7f68080cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.132+0000 7f680f800640 1 --2- 172.21.15.32:0/3898339618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68080b3d30 0x7f68080cc6c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6808072f00 tx=0x7f680001f1e0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.132+0000 7f680f800640 1 -- 172.21.15.32:0/3898339618 shutdown_connections 2024-03-19T06:21:46.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.132+0000 7f680f800640 1 --2- 172.21.15.32:0/3898339618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68080b3d30 0x7f68080cc6c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.132+0000 7f680f800640 1 --2- 172.21.15.32:0/3898339618 >> v2:172.21.15.171:3300/0 conn(0x7f680815dbb0 0x7f680806c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.132+0000 7f680f800640 1 -- 172.21.15.32:0/3898339618 >> 172.21.15.32:0/3898339618 conn(0x7f6808066ca0 msgr2=0x7f68080670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:46.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.132+0000 7f680f800640 1 -- 172.21.15.32:0/3898339618 shutdown_connections 2024-03-19T06:21:46.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.132+0000 7f680f800640 1 -- 172.21.15.32:0/3898339618 wait complete. 2024-03-19T06:21:46.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680f800640 1 Processor -- start 2024-03-19T06:21:46.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680f800640 1 -- start start 2024-03-19T06:21:46.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680f800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f680806c5a0 0x7f68081f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680f800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68080b3d30 0x7f680814fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680f800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f680815dbb0 0x7f68081f3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680f800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680815df90 con 0x7f680815dbb0 2024-03-19T06:21:46.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680f800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680806d910 con 0x7f680806c5a0 2024-03-19T06:21:46.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680f800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68080ccc00 con 0x7f68080b3d30 2024-03-19T06:21:46.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f680815dbb0 0x7f68081f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f680815dbb0 0x7f68081f3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57632/0 (socket says 172.21.15.32:57632) 2024-03-19T06:21:46.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680d800640 1 -- 172.21.15.32:0/3903560025 learned_addr learned my addr 172.21.15.32:0/3903560025 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:46.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680ce00640 1 --2- 172.21.15.32:0/3903560025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f680806c5a0 0x7f68081f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f67ffe00640 1 --2- 172.21.15.32:0/3903560025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68080b3d30 0x7f680814fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680d800640 1 -- 172.21.15.32:0/3903560025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68080b3d30 msgr2=0x7f680814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680d800640 1 --2- 172.21.15.32:0/3903560025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68080b3d30 0x7f680814fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680d800640 1 -- 172.21.15.32:0/3903560025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f680806c5a0 msgr2=0x7f68081f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680d800640 1 --2- 172.21.15.32:0/3903560025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f680806c5a0 0x7f68081f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680d800640 1 -- 172.21.15.32:0/3903560025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68080c86e0 con 0x7f680815dbb0 2024-03-19T06:21:46.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680d800640 1 --2- 172.21.15.32:0/3903560025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f680815dbb0 0x7f68081f3500 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f680001ce10 tx=0x7f680001bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:46.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f6805600640 1 -- 172.21.15.32:0/3903560025 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000c0070 con 0x7f680815dbb0 2024-03-19T06:21:46.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f6805600640 1 -- 172.21.15.32:0/3903560025 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68000090d0 con 0x7f680815dbb0 2024-03-19T06:21:46.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f6805600640 1 -- 172.21.15.32:0/3903560025 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000b4040 con 0x7f680815dbb0 2024-03-19T06:21:46.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680f800640 1 -- 172.21.15.32:0/3903560025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68081501b0 con 0x7f680815dbb0 2024-03-19T06:21:46.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680f800640 1 -- 172.21.15.32:0/3903560025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68081f4030 con 0x7f680815dbb0 2024-03-19T06:21:46.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.136+0000 7f680f800640 1 -- 172.21.15.32:0/3903560025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68080749e0 con 0x7f680815dbb0 2024-03-19T06:21:46.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.140+0000 7f6805600640 1 -- 172.21.15.32:0/3903560025 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f68000c3070 con 0x7f680815dbb0 2024-03-19T06:21:46.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.140+0000 7f6805600640 1 --2- 172.21.15.32:0/3903560025 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f67e4067660 0x7f67e4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.140+0000 7f6805600640 1 -- 172.21.15.32:0/3903560025 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6800122ff0 con 0x7f680815dbb0 2024-03-19T06:21:46.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.140+0000 7f680ce00640 1 --2- 172.21.15.32:0/3903560025 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f67e4067660 0x7f67e4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.140+0000 7f680ce00640 1 --2- 172.21.15.32:0/3903560025 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f67e4067660 0x7f67e4069b20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f68080ce290 tx=0x7f67f8009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:46.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.144+0000 7f6805600640 1 -- 172.21.15.32:0/3903560025 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f6800018d40 con 0x7f680815dbb0 2024-03-19T06:21:46.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.308+0000 7f680f800640 1 -- 172.21.15.32:0/3903560025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f68080b4fa0 con 0x7f680815dbb0 2024-03-19T06:21:46.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.308+0000 7f6805600640 1 -- 172.21.15.32:0/3903560025 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f68000f3640 con 0x7f680815dbb0 2024-03-19T06:21:46.300 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:21:46.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.308+0000 7f680f800640 1 -- 172.21.15.32:0/3903560025 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f67e4067660 msgr2=0x7f67e4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.308+0000 7f680f800640 1 --2- 172.21.15.32:0/3903560025 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f67e4067660 0x7f67e4069b20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f68080ce290 tx=0x7f67f8009190 comp rx=0 tx=0).stop 2024-03-19T06:21:46.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.308+0000 7f680f800640 1 -- 172.21.15.32:0/3903560025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f680815dbb0 msgr2=0x7f68081f3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.308+0000 7f680f800640 1 --2- 172.21.15.32:0/3903560025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f680815dbb0 0x7f68081f3500 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f680001ce10 tx=0x7f680001bf80 comp rx=0 tx=0).stop 2024-03-19T06:21:46.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.308+0000 7f680f800640 1 -- 172.21.15.32:0/3903560025 shutdown_connections 2024-03-19T06:21:46.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.308+0000 7f680f800640 1 --2- 172.21.15.32:0/3903560025 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f67e4067660 0x7f67e4069b20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.308+0000 7f680f800640 1 --2- 172.21.15.32:0/3903560025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f680815dbb0 0x7f68081f3500 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.308+0000 7f680f800640 1 --2- 172.21.15.32:0/3903560025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68080b3d30 0x7f680814fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.308+0000 7f680f800640 1 --2- 172.21.15.32:0/3903560025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f680806c5a0 0x7f68081f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.308+0000 7f680f800640 1 -- 172.21.15.32:0/3903560025 >> 172.21.15.32:0/3903560025 conn(0x7f6808066ca0 msgr2=0x7f68080d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:46.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.308+0000 7f680f800640 1 -- 172.21.15.32:0/3903560025 shutdown_connections 2024-03-19T06:21:46.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.308+0000 7f680f800640 1 -- 172.21.15.32:0/3903560025 wait complete. 2024-03-19T06:21:46.321 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:21:46.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.468+0000 7f7696c00640 1 Processor -- start 2024-03-19T06:21:46.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.468+0000 7f7696c00640 1 -- start start 2024-03-19T06:21:46.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.472+0000 7f7696c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769006c060 0x7f769015e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.472+0000 7f7696c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f76900700a0 0x7f7690070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.472+0000 7f7696c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769006fbe0 con 0x7f7690099a70 2024-03-19T06:21:46.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.472+0000 7f7696c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769015e940 con 0x7f76900700a0 2024-03-19T06:21:46.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.472+0000 7f7696c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769015ec20 con 0x7f769006c060 2024-03-19T06:21:46.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.472+0000 7f7687e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769006c060 0x7f769015e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.472+0000 7f7694c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f76900700a0 0x7f7690070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.472+0000 7f7687e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769006c060 0x7f769015e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:32808/0 (socket says 172.21.15.32:32808) 2024-03-19T06:21:46.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.472+0000 7f7687e00640 1 -- 172.21.15.32:0/3577580881 learned_addr learned my addr 172.21.15.32:0/3577580881 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:46.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.472+0000 7f7687e00640 1 -- 172.21.15.32:0/3577580881 >> v2:172.21.15.171:3300/0 conn(0x7f76900700a0 msgr2=0x7f7690070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:46.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.472+0000 7f7687e00640 1 --2- 172.21.15.32:0/3577580881 >> v2:172.21.15.171:3300/0 conn(0x7f76900700a0 0x7f7690070530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.472+0000 7f7687e00640 1 -- 172.21.15.32:0/3577580881 >> v1:172.21.15.171:6789/0 conn(0x7f7690099a70 legacy=0x7f7690099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.472+0000 7f7687e00640 1 -- 172.21.15.32:0/3577580881 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769015ef00 con 0x7f769006c060 2024-03-19T06:21:46.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.472+0000 7f7694c00640 1 --2- 172.21.15.32:0/3577580881 >> v2:172.21.15.171:3300/0 conn(0x7f76900700a0 0x7f7690070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:46.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.476+0000 7f7687e00640 1 --2- 172.21.15.32:0/3577580881 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769006c060 0x7f769015e010 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7678009870 tx=0x7f767801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fac3f9f2c5912b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:46.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.476+0000 7f768f400640 1 -- 172.21.15.32:0/3577580881 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76780a7070 con 0x7f769006c060 2024-03-19T06:21:46.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.476+0000 7f768f400640 1 -- 172.21.15.32:0/3577580881 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76780b0070 con 0x7f769006c060 2024-03-19T06:21:46.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.476+0000 7f768f400640 1 -- 172.21.15.32:0/3577580881 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76780ab890 con 0x7f769006c060 2024-03-19T06:21:46.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.476+0000 7f7696c00640 1 -- 172.21.15.32:0/3577580881 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769006c060 msgr2=0x7f769015e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.476+0000 7f7696c00640 1 --2- 172.21.15.32:0/3577580881 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769006c060 0x7f769015e010 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7678009870 tx=0x7f767801c560 comp rx=0 tx=0).stop 2024-03-19T06:21:46.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.476+0000 7f7696c00640 1 -- 172.21.15.32:0/3577580881 shutdown_connections 2024-03-19T06:21:46.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.476+0000 7f7696c00640 1 --2- 172.21.15.32:0/3577580881 >> v2:172.21.15.171:3300/0 conn(0x7f76900700a0 0x7f7690070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.476+0000 7f7696c00640 1 --2- 172.21.15.32:0/3577580881 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769006c060 0x7f769015e010 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.476+0000 7f7696c00640 1 -- 172.21.15.32:0/3577580881 >> 172.21.15.32:0/3577580881 conn(0x7f76900b3300 msgr2=0x7f76900b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:46.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.476+0000 7f7696c00640 1 -- 172.21.15.32:0/3577580881 shutdown_connections 2024-03-19T06:21:46.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.476+0000 7f7696c00640 1 -- 172.21.15.32:0/3577580881 wait complete. 2024-03-19T06:21:46.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.476+0000 7f7696c00640 1 Processor -- start 2024-03-19T06:21:46.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.476+0000 7f7696c00640 1 -- start start 2024-03-19T06:21:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7696c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769006c060 0x7f76900cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7696c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76900700a0 0x7f7690151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7696c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7690099a70 0x7f76900b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7696c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769016ad80 con 0x7f76900700a0 2024-03-19T06:21:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7696c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769016ac00 con 0x7f7690099a70 2024-03-19T06:21:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7696c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769016af00 con 0x7f769006c060 2024-03-19T06:21:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7687e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76900700a0 0x7f7690151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7687e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76900700a0 0x7f7690151270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57648/0 (socket says 172.21.15.32:57648) 2024-03-19T06:21:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7687e00640 1 -- 172.21.15.32:0/524790326 learned_addr learned my addr 172.21.15.32:0/524790326 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f768fe00640 1 --2- 172.21.15.32:0/524790326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769006c060 0x7f76900cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7694c00640 1 --2- 172.21.15.32:0/524790326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7690099a70 0x7f76900b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7687e00640 1 -- 172.21.15.32:0/524790326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769006c060 msgr2=0x7f76900cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7687e00640 1 --2- 172.21.15.32:0/524790326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769006c060 0x7f76900cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7687e00640 1 -- 172.21.15.32:0/524790326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7690099a70 msgr2=0x7f76900b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7687e00640 1 --2- 172.21.15.32:0/524790326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7690099a70 0x7f76900b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7687e00640 1 -- 172.21.15.32:0/524790326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76901517b0 con 0x7f76900700a0 2024-03-19T06:21:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7687e00640 1 --2- 172.21.15.32:0/524790326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76900700a0 0x7f7690151270 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f767801a190 tx=0x7f767801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f768cc00640 1 -- 172.21.15.32:0/524790326 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76780be5f0 con 0x7f76900700a0 2024-03-19T06:21:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f768cc00640 1 -- 172.21.15.32:0/524790326 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76780be7b0 con 0x7f76900700a0 2024-03-19T06:21:46.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7696c00640 1 -- 172.21.15.32:0/524790326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76900af9e0 con 0x7f76900700a0 2024-03-19T06:21:46.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f768cc00640 1 -- 172.21.15.32:0/524790326 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76780beba0 con 0x7f76900700a0 2024-03-19T06:21:46.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7696c00640 1 -- 172.21.15.32:0/524790326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76900ca990 con 0x7f76900700a0 2024-03-19T06:21:46.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f7696c00640 1 -- 172.21.15.32:0/524790326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76900749e0 con 0x7f76900700a0 2024-03-19T06:21:46.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.480+0000 7f768cc00640 1 -- 172.21.15.32:0/524790326 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7690071280 con 0x7f76900700a0 2024-03-19T06:21:46.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.484+0000 7f768cc00640 1 --2- 172.21.15.32:0/524790326 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f766c067660 0x7f766c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.484+0000 7f768cc00640 1 -- 172.21.15.32:0/524790326 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f767811fe60 con 0x7f76900700a0 2024-03-19T06:21:46.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.484+0000 7f768fe00640 1 --2- 172.21.15.32:0/524790326 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f766c067660 0x7f766c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.484+0000 7f768fe00640 1 --2- 172.21.15.32:0/524790326 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f766c067660 0x7f766c069b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76900c9c70 tx=0x7f7680009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:46.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.488+0000 7f768cc00640 1 -- 172.21.15.32:0/524790326 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f7678016150 con 0x7f76900700a0 2024-03-19T06:21:46.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.664+0000 7f7696c00640 1 -- 172.21.15.32:0/524790326 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f76901689d0 con 0x7f76900700a0 2024-03-19T06:21:46.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.664+0000 7f768cc00640 1 -- 172.21.15.32:0/524790326 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f76780f0370 con 0x7f76900700a0 2024-03-19T06:21:46.658 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:21:46.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.668+0000 7f7696c00640 1 -- 172.21.15.32:0/524790326 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f766c067660 msgr2=0x7f766c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.668+0000 7f7696c00640 1 --2- 172.21.15.32:0/524790326 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f766c067660 0x7f766c069b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76900c9c70 tx=0x7f7680009040 comp rx=0 tx=0).stop 2024-03-19T06:21:46.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.668+0000 7f7696c00640 1 -- 172.21.15.32:0/524790326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76900700a0 msgr2=0x7f7690151270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.668+0000 7f7696c00640 1 --2- 172.21.15.32:0/524790326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76900700a0 0x7f7690151270 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f767801a190 tx=0x7f767801ada0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.668+0000 7f7696c00640 1 -- 172.21.15.32:0/524790326 shutdown_connections 2024-03-19T06:21:46.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.668+0000 7f7696c00640 1 --2- 172.21.15.32:0/524790326 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f766c067660 0x7f766c069b20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.668+0000 7f7696c00640 1 --2- 172.21.15.32:0/524790326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7690099a70 0x7f76900b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.668+0000 7f7696c00640 1 --2- 172.21.15.32:0/524790326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76900700a0 0x7f7690151270 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.668+0000 7f7696c00640 1 --2- 172.21.15.32:0/524790326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769006c060 0x7f76900cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.668+0000 7f7696c00640 1 -- 172.21.15.32:0/524790326 >> 172.21.15.32:0/524790326 conn(0x7f76900b3300 msgr2=0x7f76900cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:46.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.668+0000 7f7696c00640 1 -- 172.21.15.32:0/524790326 shutdown_connections 2024-03-19T06:21:46.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.668+0000 7f7696c00640 1 -- 172.21.15.32:0/524790326 wait complete. 2024-03-19T06:21:46.678 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi032.front.sepia.ceph.com... 2024-03-19T06:21:46.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:46.678 DEBUG:teuthology.orchestra.run.smithi032:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-19T06:21:46.716 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:21:46.716 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:21:46.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:46.716 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-19T06:21:46.769 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:21:46.769 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:21:46.779 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:21:46.779 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:21:46.830 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:46.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.976+0000 7fdcd9e00640 1 Processor -- start 2024-03-19T06:21:46.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.980+0000 7fdcd9e00640 1 -- start start 2024-03-19T06:21:46.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.980+0000 7fdcd9e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcd40ce400 0x7fdcd4071c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.980+0000 7fdcd9e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd415af20 con 0x7fdcd415a680 2024-03-19T06:21:46.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.980+0000 7fdcd9e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd415b200 con 0x7fdcd415aa60 2024-03-19T06:21:46.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.980+0000 7fdcd9e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd415bce0 con 0x7fdcd40ce400 2024-03-19T06:21:46.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.980+0000 7fdcd8a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdcd415a680 0x7fdcd40cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33072/0 (socket says 172.21.15.32:33072) 2024-03-19T06:21:46.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.980+0000 7fdcd8a00640 1 -- 172.21.15.32:0/1043577922 learned_addr learned my addr 172.21.15.32:0/1043577922 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:46.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.980+0000 7fdcd3e00640 1 --2- 172.21.15.32:0/1043577922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcd40ce400 0x7fdcd4071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.980+0000 7fdcd3400640 1 -- 172.21.15.32:0/1043577922 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167539038 0 0) 0x7fdcd415af20 con 0x7fdcd415a680 2024-03-19T06:21:46.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.980+0000 7fdcd3400640 1 -- 172.21.15.32:0/1043577922 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcbc003530 con 0x7fdcd415a680 2024-03-19T06:21:46.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.980+0000 7fdcd3400640 1 -- 172.21.15.32:0/1043577922 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207819090 0 0) 0x7fdcd415b200 con 0x7fdcd415aa60 2024-03-19T06:21:46.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.980+0000 7fdcd3400640 1 -- 172.21.15.32:0/1043577922 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcd415af20 con 0x7fdcd415aa60 2024-03-19T06:21:46.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.980+0000 7fdcd3400640 1 -- 172.21.15.32:0/1043577922 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2253127327 0 0) 0x7fdcbc003530 con 0x7fdcd415a680 2024-03-19T06:21:46.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.980+0000 7fdcd3e00640 1 -- 172.21.15.32:0/1043577922 >> v1:172.21.15.171:6789/0 conn(0x7fdcd415aa60 legacy=0x7fdcd415e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.980+0000 7fdcd3e00640 1 -- 172.21.15.32:0/1043577922 >> v1:172.21.15.32:6789/0 conn(0x7fdcd415a680 legacy=0x7fdcd40cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.980+0000 7fdcd3e00640 1 -- 172.21.15.32:0/1043577922 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd415b4e0 con 0x7fdcd40ce400 2024-03-19T06:21:46.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.984+0000 7fdcd3e00640 1 --2- 172.21.15.32:0/1043577922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcd40ce400 0x7fdcd4071c10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00097f0 tx=0x7fdcc001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9bdd18cd31c8579 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:46.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.984+0000 7fdcd3400640 1 -- 172.21.15.32:0/1043577922 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00b0070 con 0x7fdcd40ce400 2024-03-19T06:21:46.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.984+0000 7fdcd3400640 1 -- 172.21.15.32:0/1043577922 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc00ab400 con 0x7fdcd40ce400 2024-03-19T06:21:46.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.984+0000 7fdcd3400640 1 -- 172.21.15.32:0/1043577922 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8001680 con 0x7fdcd40ce400 2024-03-19T06:21:46.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.984+0000 7fdcd9e00640 1 -- 172.21.15.32:0/1043577922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcd40ce400 msgr2=0x7fdcd4071c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.984+0000 7fdcd9e00640 1 --2- 172.21.15.32:0/1043577922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcd40ce400 0x7fdcd4071c10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00097f0 tx=0x7fdcc001c400 comp rx=0 tx=0).stop 2024-03-19T06:21:46.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.984+0000 7fdcd9e00640 1 -- 172.21.15.32:0/1043577922 shutdown_connections 2024-03-19T06:21:46.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.984+0000 7fdcd9e00640 1 --2- 172.21.15.32:0/1043577922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcd40ce400 0x7fdcd4071c10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.984+0000 7fdcd9e00640 1 -- 172.21.15.32:0/1043577922 >> 172.21.15.32:0/1043577922 conn(0x7fdcd406ad40 msgr2=0x7fdcd406b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:46.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.984+0000 7fdcd9e00640 1 -- 172.21.15.32:0/1043577922 shutdown_connections 2024-03-19T06:21:46.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.984+0000 7fdcd9e00640 1 -- 172.21.15.32:0/1043577922 wait complete. 2024-03-19T06:21:46.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.984+0000 7fdcd9e00640 1 Processor -- start 2024-03-19T06:21:46.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.984+0000 7fdcd9e00640 1 -- start start 2024-03-19T06:21:46.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd40ce400 0x7fdcd414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd9e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcd415a680 0x7fdcd4148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd9e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcd415aa60 0x7fdcd4149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd9e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40cf7b0 con 0x7fdcd40ce400 2024-03-19T06:21:46.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd9e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40cf630 con 0x7fdcd415a680 2024-03-19T06:21:46.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd9e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40cf930 con 0x7fdcd415aa60 2024-03-19T06:21:46.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd8a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd40ce400 0x7fdcd414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd8a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd40ce400 0x7fdcd414aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57652/0 (socket says 172.21.15.32:57652) 2024-03-19T06:21:46.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd8a00640 1 -- 172.21.15.32:0/874024549 learned_addr learned my addr 172.21.15.32:0/874024549 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:46.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd9400640 1 --2- 172.21.15.32:0/874024549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcd415aa60 0x7fdcd4149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd3e00640 1 --2- 172.21.15.32:0/874024549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcd415a680 0x7fdcd4148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd8a00640 1 -- 172.21.15.32:0/874024549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcd415aa60 msgr2=0x7fdcd4149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd8a00640 1 --2- 172.21.15.32:0/874024549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcd415aa60 0x7fdcd4149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd8a00640 1 -- 172.21.15.32:0/874024549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcd415a680 msgr2=0x7fdcd4148ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:46.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd8a00640 1 --2- 172.21.15.32:0/874024549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcd415a680 0x7fdcd4148ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:46.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd8a00640 1 -- 172.21.15.32:0/874024549 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd40ad6c0 con 0x7fdcd40ce400 2024-03-19T06:21:46.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd8a00640 1 --2- 172.21.15.32:0/874024549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd40ce400 0x7fdcd414aa50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdcc800c7b0 tx=0x7fdcc800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:46.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd0c00640 1 -- 172.21.15.32:0/874024549 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8017070 con 0x7fdcd40ce400 2024-03-19T06:21:46.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd0c00640 1 -- 172.21.15.32:0/874024549 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc8005b00 con 0x7fdcd40ce400 2024-03-19T06:21:46.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd0c00640 1 -- 172.21.15.32:0/874024549 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8007070 con 0x7fdcd40ce400 2024-03-19T06:21:46.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd9e00640 1 -- 172.21.15.32:0/874024549 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd40ad9a0 con 0x7fdcd40ce400 2024-03-19T06:21:46.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd9e00640 1 -- 172.21.15.32:0/874024549 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd40adf60 con 0x7fdcd40ce400 2024-03-19T06:21:46.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.988+0000 7fdcd9e00640 1 -- 172.21.15.32:0/874024549 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd4075090 con 0x7fdcd40ce400 2024-03-19T06:21:46.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.992+0000 7fdcd0c00640 1 -- 172.21.15.32:0/874024549 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fdcc801a070 con 0x7fdcd40ce400 2024-03-19T06:21:46.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.992+0000 7fdcd0c00640 1 --2- 172.21.15.32:0/874024549 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdcb4067660 0x7fdcb4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:46.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.992+0000 7fdcd0c00640 1 -- 172.21.15.32:0/874024549 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcc8084ec0 con 0x7fdcd40ce400 2024-03-19T06:21:46.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.992+0000 7fdcd3e00640 1 --2- 172.21.15.32:0/874024549 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdcb4067660 0x7fdcb4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:46.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.992+0000 7fdcd3e00640 1 --2- 172.21.15.32:0/874024549 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdcb4067660 0x7fdcb4069b20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00ad000 tx=0x7fdcc00a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:46.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:46.996+0000 7fdcd0c00640 1 -- 172.21.15.32:0/874024549 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fdcc8055b40 con 0x7fdcd40ce400 2024-03-19T06:21:47.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.156+0000 7fdcd9e00640 1 -- 172.21.15.32:0/874024549 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcd4156380 con 0x7fdcd40ce400 2024-03-19T06:21:47.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.160+0000 7fdcd0c00640 1 -- 172.21.15.32:0/874024549 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16617 (secure 0 0 0) 0x7fdcc8055440 con 0x7fdcd40ce400 2024-03-19T06:21:47.152 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:47.152 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:10.423479+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:47.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.160+0000 7fdcd9e00640 1 -- 172.21.15.32:0/874024549 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdcb4067660 msgr2=0x7fdcb4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:47.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.160+0000 7fdcd9e00640 1 --2- 172.21.15.32:0/874024549 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdcb4067660 0x7fdcb4069b20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00ad000 tx=0x7fdcc00a6000 comp rx=0 tx=0).stop 2024-03-19T06:21:47.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.160+0000 7fdcd9e00640 1 -- 172.21.15.32:0/874024549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd40ce400 msgr2=0x7fdcd414aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:47.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.160+0000 7fdcd9e00640 1 --2- 172.21.15.32:0/874024549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd40ce400 0x7fdcd414aa50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdcc800c7b0 tx=0x7fdcc800cc70 comp rx=0 tx=0).stop 2024-03-19T06:21:47.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.160+0000 7fdcd9e00640 1 -- 172.21.15.32:0/874024549 shutdown_connections 2024-03-19T06:21:47.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.160+0000 7fdcd9e00640 1 --2- 172.21.15.32:0/874024549 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdcb4067660 0x7fdcb4069b20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.160+0000 7fdcd9e00640 1 --2- 172.21.15.32:0/874024549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcd415aa60 0x7fdcd4149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.160+0000 7fdcd9e00640 1 --2- 172.21.15.32:0/874024549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcd415a680 0x7fdcd4148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.160+0000 7fdcd9e00640 1 --2- 172.21.15.32:0/874024549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcd40ce400 0x7fdcd414aa50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.160+0000 7fdcd9e00640 1 -- 172.21.15.32:0/874024549 >> 172.21.15.32:0/874024549 conn(0x7fdcd406ad40 msgr2=0x7fdcd40b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:47.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.160+0000 7fdcd9e00640 1 -- 172.21.15.32:0/874024549 shutdown_connections 2024-03-19T06:21:47.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.160+0000 7fdcd9e00640 1 -- 172.21.15.32:0/874024549 wait complete. 2024-03-19T06:21:47.174 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:21:07.089673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:21:07.801319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:47.174 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:47.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.324+0000 7f4133a00640 1 Processor -- start 2024-03-19T06:21:47.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.324+0000 7f4133a00640 1 -- start start 2024-03-19T06:21:47.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.328+0000 7f4133a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f412c06eed0 0x7f412c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:47.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.328+0000 7f4133a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f412c06e320 0x7f412c15bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:47.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.328+0000 7f4133a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412c0cc290 con 0x7f412c06ad40 2024-03-19T06:21:47.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.328+0000 7f4133a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412c06dbb0 con 0x7f412c06e320 2024-03-19T06:21:47.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.328+0000 7f4133a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412c0cc570 con 0x7f412c06eed0 2024-03-19T06:21:47.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.328+0000 7f4131a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f412c06e320 0x7f412c15bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:47.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.328+0000 7f4131a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f412c06e320 0x7f412c15bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57654/0 (socket says 172.21.15.32:57654) 2024-03-19T06:21:47.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.328+0000 7f4123e00640 1 --2- 172.21.15.32:0/253657611 >> v2:172.21.15.171:3300/0 conn(0x7f412c06eed0 0x7f412c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:47.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.328+0000 7f4131a00640 1 -- 172.21.15.32:0/253657611 learned_addr learned my addr 172.21.15.32:0/253657611 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:47.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.328+0000 7f4123e00640 1 -- 172.21.15.32:0/253657611 >> v2:172.21.15.32:3300/0 conn(0x7f412c06e320 msgr2=0x7f412c15bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:47.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.328+0000 7f4123e00640 1 --2- 172.21.15.32:0/253657611 >> v2:172.21.15.32:3300/0 conn(0x7f412c06e320 0x7f412c15bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.328+0000 7f4123e00640 1 -- 172.21.15.32:0/253657611 >> v1:172.21.15.171:6789/0 conn(0x7f412c06ad40 legacy=0x7f412c06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:47.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.328+0000 7f4123e00640 1 -- 172.21.15.32:0/253657611 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c0cc850 con 0x7f412c06eed0 2024-03-19T06:21:47.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.328+0000 7f4131a00640 1 --2- 172.21.15.32:0/253657611 >> v2:172.21.15.32:3300/0 conn(0x7f412c06e320 0x7f412c15bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:47.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.332+0000 7f4123e00640 1 --2- 172.21.15.32:0/253657611 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f412c06eed0 0x7f412c0ccd10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f412c06bab0 tx=0x7f411401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40f3db170f9b62df server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:47.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.332+0000 7f412be00640 1 -- 172.21.15.32:0/253657611 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41140b1070 con 0x7f412c06eed0 2024-03-19T06:21:47.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.332+0000 7f412be00640 1 -- 172.21.15.32:0/253657611 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41140a8050 con 0x7f412c06eed0 2024-03-19T06:21:47.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.332+0000 7f412be00640 1 -- 172.21.15.32:0/253657611 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41140ac860 con 0x7f412c06eed0 2024-03-19T06:21:47.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.332+0000 7f4133a00640 1 -- 172.21.15.32:0/253657611 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f412c06eed0 msgr2=0x7f412c0ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:47.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.332+0000 7f4133a00640 1 --2- 172.21.15.32:0/253657611 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f412c06eed0 0x7f412c0ccd10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f412c06bab0 tx=0x7f411401c3c0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.332+0000 7f4133a00640 1 -- 172.21.15.32:0/253657611 shutdown_connections 2024-03-19T06:21:47.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.332+0000 7f4133a00640 1 --2- 172.21.15.32:0/253657611 >> v2:172.21.15.32:3300/0 conn(0x7f412c06e320 0x7f412c15bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.332+0000 7f4133a00640 1 --2- 172.21.15.32:0/253657611 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f412c06eed0 0x7f412c0ccd10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.332+0000 7f4133a00640 1 -- 172.21.15.32:0/253657611 >> 172.21.15.32:0/253657611 conn(0x7f412c0b1590 msgr2=0x7f412c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:47.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.332+0000 7f4133a00640 1 -- 172.21.15.32:0/253657611 shutdown_connections 2024-03-19T06:21:47.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.332+0000 7f4133a00640 1 -- 172.21.15.32:0/253657611 wait complete. 2024-03-19T06:21:47.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4133a00640 1 Processor -- start 2024-03-19T06:21:47.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4133a00640 1 -- start start 2024-03-19T06:21:47.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4133a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f412c06ad40 0x7f412c1fa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:47.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4133a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f412c06e320 0x7f412c1fa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:47.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4133a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f412c06eed0 0x7f412c13d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:47.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4133a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c1688a0 con 0x7f412c06e320 2024-03-19T06:21:47.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4133a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c168720 con 0x7f412c06eed0 2024-03-19T06:21:47.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4133a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412c168a20 con 0x7f412c06ad40 2024-03-19T06:21:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4123e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f412c06e320 0x7f412c1fa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4123e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f412c06e320 0x7f412c1fa7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57658/0 (socket says 172.21.15.32:57658) 2024-03-19T06:21:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4123e00640 1 -- 172.21.15.32:0/2429388304 learned_addr learned my addr 172.21.15.32:0/2429388304 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4131000640 1 --2- 172.21.15.32:0/2429388304 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f412c06ad40 0x7f412c1fa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4131a00640 1 --2- 172.21.15.32:0/2429388304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f412c06eed0 0x7f412c13d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4123e00640 1 -- 172.21.15.32:0/2429388304 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f412c06ad40 msgr2=0x7f412c1fa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4123e00640 1 --2- 172.21.15.32:0/2429388304 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f412c06ad40 0x7f412c1fa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4123e00640 1 -- 172.21.15.32:0/2429388304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f412c06eed0 msgr2=0x7f412c13d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4123e00640 1 --2- 172.21.15.32:0/2429388304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f412c06eed0 0x7f412c13d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4123e00640 1 -- 172.21.15.32:0/2429388304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c13e510 con 0x7f412c06e320 2024-03-19T06:21:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4131a00640 1 --2- 172.21.15.32:0/2429388304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f412c06eed0 0x7f412c13d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4123e00640 1 --2- 172.21.15.32:0/2429388304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f412c06e320 0x7f412c1fa7e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4114019ff0 tx=0x7f411401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4129600640 1 -- 172.21.15.32:0/2429388304 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41140bc070 con 0x7f412c06e320 2024-03-19T06:21:47.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4129600640 1 -- 172.21.15.32:0/2429388304 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c15c9a0 con 0x7f412c06e320 2024-03-19T06:21:47.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4133a00640 1 -- 172.21.15.32:0/2429388304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412c13e7f0 con 0x7f412c06e320 2024-03-19T06:21:47.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4129600640 1 -- 172.21.15.32:0/2429388304 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41140b1040 con 0x7f412c06e320 2024-03-19T06:21:47.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4133a00640 1 -- 172.21.15.32:0/2429388304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f412c13edb0 con 0x7f412c06e320 2024-03-19T06:21:47.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.336+0000 7f4133a00640 1 -- 172.21.15.32:0/2429388304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f412c0749e0 con 0x7f412c06e320 2024-03-19T06:21:47.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.340+0000 7f4129600640 1 -- 172.21.15.32:0/2429388304 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f41140bf070 con 0x7f412c06e320 2024-03-19T06:21:47.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.340+0000 7f4129600640 1 --2- 172.21.15.32:0/2429388304 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4108067660 0x7f4108069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:47.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.340+0000 7f4129600640 1 -- 172.21.15.32:0/2429388304 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f411411f140 con 0x7f412c06e320 2024-03-19T06:21:47.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.340+0000 7f4131000640 1 --2- 172.21.15.32:0/2429388304 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4108067660 0x7f4108069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.340+0000 7f4131000640 1 --2- 172.21.15.32:0/2429388304 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4108067660 0x7f4108069b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f412c0cfa70 tx=0x7f411c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:47.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.344+0000 7f4129600640 1 -- 172.21.15.32:0/2429388304 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f4114016070 con 0x7f412c06e320 2024-03-19T06:21:47.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.504+0000 7f4133a00640 1 -- 172.21.15.32:0/2429388304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f412c0b3f50 con 0x7f412c06e320 2024-03-19T06:21:47.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.508+0000 7f4129600640 1 -- 172.21.15.32:0/2429388304 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41140ef7e0 con 0x7f412c06e320 2024-03-19T06:21:47.499 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:47.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.508+0000 7f4133a00640 1 -- 172.21.15.32:0/2429388304 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4108067660 msgr2=0x7f4108069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:47.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.508+0000 7f4133a00640 1 --2- 172.21.15.32:0/2429388304 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4108067660 0x7f4108069b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f412c0cfa70 tx=0x7f411c009040 comp rx=0 tx=0).stop 2024-03-19T06:21:47.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.508+0000 7f4133a00640 1 -- 172.21.15.32:0/2429388304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f412c06e320 msgr2=0x7f412c1fa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:47.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.508+0000 7f4133a00640 1 --2- 172.21.15.32:0/2429388304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f412c06e320 0x7f412c1fa7e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4114019ff0 tx=0x7f411401ac00 comp rx=0 tx=0).stop 2024-03-19T06:21:47.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.508+0000 7f4133a00640 1 -- 172.21.15.32:0/2429388304 shutdown_connections 2024-03-19T06:21:47.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.508+0000 7f4133a00640 1 --2- 172.21.15.32:0/2429388304 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4108067660 0x7f4108069b20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.508+0000 7f4133a00640 1 --2- 172.21.15.32:0/2429388304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f412c06eed0 0x7f412c13d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.508+0000 7f4133a00640 1 --2- 172.21.15.32:0/2429388304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f412c06e320 0x7f412c1fa7e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.508+0000 7f4133a00640 1 --2- 172.21.15.32:0/2429388304 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f412c06ad40 0x7f412c1fa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.508+0000 7f4133a00640 1 -- 172.21.15.32:0/2429388304 >> 172.21.15.32:0/2429388304 conn(0x7f412c0b1590 msgr2=0x7f412c0b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.508+0000 7f4133a00640 1 -- 172.21.15.32:0/2429388304 shutdown_connections 2024-03-19T06:21:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.508+0000 7f4133a00640 1 -- 172.21.15.32:0/2429388304 wait complete. 2024-03-19T06:21:47.519 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:21:47.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.672+0000 7fc94d200640 1 Processor -- start 2024-03-19T06:21:47.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.672+0000 7fc94d200640 1 -- start start 2024-03-19T06:21:47.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.672+0000 7fc94d200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc94806ad40 0x7fc94806b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:47.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.672+0000 7fc94d200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc94806e320 0x7fc94815bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:47.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.672+0000 7fc94d200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94806b660 con 0x7fc94806eed0 2024-03-19T06:21:47.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.672+0000 7fc94d200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9480cd420 con 0x7fc94806e320 2024-03-19T06:21:47.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.672+0000 7fc94d200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94806dbb0 con 0x7fc94806ad40 2024-03-19T06:21:47.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.672+0000 7fc946800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc94806e320 0x7fc94815bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:47.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.672+0000 7fc946800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc94806e320 0x7fc94815bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57662/0 (socket says 172.21.15.32:57662) 2024-03-19T06:21:47.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.672+0000 7fc946800640 1 -- 172.21.15.32:0/994309750 learned_addr learned my addr 172.21.15.32:0/994309750 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:47.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.672+0000 7fc945e00640 1 --2- 172.21.15.32:0/994309750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc94806ad40 0x7fc94806b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:47.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.672+0000 7fc946800640 1 -- 172.21.15.32:0/994309750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc94806ad40 msgr2=0x7fc94806b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:47.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.672+0000 7fc946800640 1 --2- 172.21.15.32:0/994309750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc94806ad40 0x7fc94806b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.672+0000 7fc946800640 1 -- 172.21.15.32:0/994309750 >> v1:172.21.15.171:6789/0 conn(0x7fc94806eed0 legacy=0x7fc9480ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:47.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.672+0000 7fc946800640 1 -- 172.21.15.32:0/994309750 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480cc290 con 0x7fc94806e320 2024-03-19T06:21:47.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.672+0000 7fc945e00640 1 --2- 172.21.15.32:0/994309750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc94806ad40 0x7fc94806b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:47.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.676+0000 7fc946800640 1 --2- 172.21.15.32:0/994309750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94806e320 0x7fc94815bc50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc940009e50 tx=0x7fc94001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f0c43e7a06c3b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:47.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.676+0000 7fc945400640 1 -- 172.21.15.32:0/994309750 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400a57b0 con 0x7fc94806e320 2024-03-19T06:21:47.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.676+0000 7fc945400640 1 -- 172.21.15.32:0/994309750 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94815c9a0 con 0x7fc94806e320 2024-03-19T06:21:47.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.676+0000 7fc945400640 1 -- 172.21.15.32:0/994309750 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400a5b70 con 0x7fc94806e320 2024-03-19T06:21:47.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.676+0000 7fc94d200640 1 -- 172.21.15.32:0/994309750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94806e320 msgr2=0x7fc94815bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:47.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.676+0000 7fc94d200640 1 --2- 172.21.15.32:0/994309750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94806e320 0x7fc94815bc50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc940009e50 tx=0x7fc94001c930 comp rx=0 tx=0).stop 2024-03-19T06:21:47.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.676+0000 7fc94d200640 1 -- 172.21.15.32:0/994309750 shutdown_connections 2024-03-19T06:21:47.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.676+0000 7fc94d200640 1 --2- 172.21.15.32:0/994309750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94806e320 0x7fc94815bc50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.676+0000 7fc94d200640 1 --2- 172.21.15.32:0/994309750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc94806ad40 0x7fc94806b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.676+0000 7fc94d200640 1 -- 172.21.15.32:0/994309750 >> 172.21.15.32:0/994309750 conn(0x7fc9480b1590 msgr2=0x7fc9480b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:47.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.676+0000 7fc94d200640 1 -- 172.21.15.32:0/994309750 shutdown_connections 2024-03-19T06:21:47.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.676+0000 7fc94d200640 1 -- 172.21.15.32:0/994309750 wait complete. 2024-03-19T06:21:47.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc94d200640 1 Processor -- start 2024-03-19T06:21:47.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc94d200640 1 -- start start 2024-03-19T06:21:47.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc94d200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc94806ad40 0x7fc948158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:47.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc94d200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc94806e320 0x7fc9481f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:47.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc94d200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94806eed0 0x7fc94815df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:47.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc94d200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc948168690 con 0x7fc94806eed0 2024-03-19T06:21:47.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc94d200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc948168510 con 0x7fc94806ad40 2024-03-19T06:21:47.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc94d200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc948168810 con 0x7fc94806e320 2024-03-19T06:21:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc946800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94806eed0 0x7fc94815df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc946800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94806eed0 0x7fc94815df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57668/0 (socket says 172.21.15.32:57668) 2024-03-19T06:21:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc946800640 1 -- 172.21.15.32:0/3380032215 learned_addr learned my addr 172.21.15.32:0/3380032215 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc945e00640 1 --2- 172.21.15.32:0/3380032215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc94806ad40 0x7fc948158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc93fe00640 1 --2- 172.21.15.32:0/3380032215 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc94806e320 0x7fc9481f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc946800640 1 -- 172.21.15.32:0/3380032215 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc94806e320 msgr2=0x7fc9481f5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc946800640 1 --2- 172.21.15.32:0/3380032215 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc94806e320 0x7fc9481f5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc946800640 1 -- 172.21.15.32:0/3380032215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc94806ad40 msgr2=0x7fc948158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc946800640 1 --2- 172.21.15.32:0/3380032215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc94806ad40 0x7fc948158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc946800640 1 -- 172.21.15.32:0/3380032215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9481faa50 con 0x7fc94806eed0 2024-03-19T06:21:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc945e00640 1 --2- 172.21.15.32:0/3380032215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc94806ad40 0x7fc948158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc946800640 1 --2- 172.21.15.32:0/3380032215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94806eed0 0x7fc94815df10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc94001afe0 tx=0x7fc9400196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc93e000640 1 -- 172.21.15.32:0/3380032215 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400bc020 con 0x7fc94806eed0 2024-03-19T06:21:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc93e000640 1 -- 172.21.15.32:0/3380032215 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9400b8670 con 0x7fc94806eed0 2024-03-19T06:21:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc93e000640 1 -- 172.21.15.32:0/3380032215 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400b8a60 con 0x7fc94806eed0 2024-03-19T06:21:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc94d200640 1 -- 172.21.15.32:0/3380032215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9480afc40 con 0x7fc94806eed0 2024-03-19T06:21:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc94d200640 1 -- 172.21.15.32:0/3380032215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9480afee0 con 0x7fc94806eed0 2024-03-19T06:21:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.680+0000 7fc94d200640 1 -- 172.21.15.32:0/3380032215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9481fa500 con 0x7fc94806eed0 2024-03-19T06:21:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.684+0000 7fc93e000640 1 -- 172.21.15.32:0/3380032215 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc9400bf020 con 0x7fc94806eed0 2024-03-19T06:21:47.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.684+0000 7fc93e000640 1 --2- 172.21.15.32:0/3380032215 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc924067690 0x7fc924069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:47.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.684+0000 7fc93e000640 1 -- 172.21.15.32:0/3380032215 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc940120c70 con 0x7fc94806eed0 2024-03-19T06:21:47.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.684+0000 7fc945e00640 1 --2- 172.21.15.32:0/3380032215 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc924067690 0x7fc924069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:47.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.684+0000 7fc945e00640 1 --2- 172.21.15.32:0/3380032215 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc924067690 0x7fc924069b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc938006fd0 tx=0x7fc938008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:47.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.688+0000 7fc93e000640 1 -- 172.21.15.32:0/3380032215 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fc9400c6030 con 0x7fc94806eed0 2024-03-19T06:21:47.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.848+0000 7fc94d200640 1 -- 172.21.15.32:0/3380032215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9480749e0 con 0x7fc94806eed0 2024-03-19T06:21:47.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.852+0000 7fc93e000640 1 -- 172.21.15.32:0/3380032215 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc9400165e0 con 0x7fc94806eed0 2024-03-19T06:21:47.843 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:21:47.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.852+0000 7fc94d200640 1 -- 172.21.15.32:0/3380032215 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc924067690 msgr2=0x7fc924069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:47.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.852+0000 7fc94d200640 1 --2- 172.21.15.32:0/3380032215 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc924067690 0x7fc924069b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc938006fd0 tx=0x7fc938008040 comp rx=0 tx=0).stop 2024-03-19T06:21:47.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.852+0000 7fc94d200640 1 -- 172.21.15.32:0/3380032215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94806eed0 msgr2=0x7fc94815df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:47.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.852+0000 7fc94d200640 1 --2- 172.21.15.32:0/3380032215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94806eed0 0x7fc94815df10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc94001afe0 tx=0x7fc9400196d0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.852+0000 7fc94d200640 1 -- 172.21.15.32:0/3380032215 shutdown_connections 2024-03-19T06:21:47.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.852+0000 7fc94d200640 1 --2- 172.21.15.32:0/3380032215 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc924067690 0x7fc924069b50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.852+0000 7fc94d200640 1 --2- 172.21.15.32:0/3380032215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94806eed0 0x7fc94815df10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.852+0000 7fc94d200640 1 --2- 172.21.15.32:0/3380032215 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc94806e320 0x7fc9481f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.852+0000 7fc94d200640 1 --2- 172.21.15.32:0/3380032215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc94806ad40 0x7fc948158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:47.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.852+0000 7fc94d200640 1 -- 172.21.15.32:0/3380032215 >> 172.21.15.32:0/3380032215 conn(0x7fc9480b1590 msgr2=0x7fc948155450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:47.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.852+0000 7fc94d200640 1 -- 172.21.15.32:0/3380032215 shutdown_connections 2024-03-19T06:21:47.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:47.852+0000 7fc94d200640 1 -- 172.21.15.32:0/3380032215 wait complete. 2024-03-19T06:21:47.864 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:21:48.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.016+0000 7fea9b200640 1 Processor -- start 2024-03-19T06:21:48.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.016+0000 7fea9b200640 1 -- start start 2024-03-19T06:21:48.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.016+0000 7fea9b200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fea9415bad0 0x7fea940b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.016+0000 7fea9b200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea9406b450 0x7fea940cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.016+0000 7fea9b200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea940ae510 con 0x7fea940b0f40 2024-03-19T06:21:48.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.016+0000 7fea9b200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea940ae7f0 con 0x7fea9415bad0 2024-03-19T06:21:48.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.016+0000 7fea9b200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea940aead0 con 0x7fea9406b450 2024-03-19T06:21:48.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.016+0000 7fea99e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fea9415bad0 0x7fea940b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.016+0000 7fea99400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fea940b0f40 0x7fea9406ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33080/0 (socket says 172.21.15.32:33080) 2024-03-19T06:21:48.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.016+0000 7fea99400640 1 -- 172.21.15.32:0/4017958216 learned_addr learned my addr 172.21.15.32:0/4017958216 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:48.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.016+0000 7fea9a800640 1 --2- 172.21.15.32:0/4017958216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea9406b450 0x7fea940cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.020+0000 7fea99e00640 1 -- 172.21.15.32:0/4017958216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea9406b450 msgr2=0x7fea940cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:48.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.020+0000 7fea99e00640 1 --2- 172.21.15.32:0/4017958216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea9406b450 0x7fea940cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.020+0000 7fea99e00640 1 -- 172.21.15.32:0/4017958216 >> v1:172.21.15.32:6789/0 conn(0x7fea940b0f40 legacy=0x7fea9406ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.020+0000 7fea99e00640 1 -- 172.21.15.32:0/4017958216 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea940aedb0 con 0x7fea9415bad0 2024-03-19T06:21:48.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.020+0000 7fea99e00640 1 --2- 172.21.15.32:0/4017958216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea9415bad0 0x7fea940b0a00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fea880097c0 tx=0x7fea8801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8560632ee0d41ba server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:48.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.020+0000 7fea98a00640 1 -- 172.21.15.32:0/4017958216 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea880ab610 con 0x7fea9415bad0 2024-03-19T06:21:48.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.020+0000 7fea98a00640 1 -- 172.21.15.32:0/4017958216 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea880b0070 con 0x7fea9415bad0 2024-03-19T06:21:48.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.020+0000 7fea98a00640 1 -- 172.21.15.32:0/4017958216 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea880ab9d0 con 0x7fea9415bad0 2024-03-19T06:21:48.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.020+0000 7fea9b200640 1 -- 172.21.15.32:0/4017958216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea9415bad0 msgr2=0x7fea940b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.020+0000 7fea9b200640 1 --2- 172.21.15.32:0/4017958216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea9415bad0 0x7fea940b0a00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fea880097c0 tx=0x7fea8801c470 comp rx=0 tx=0).stop 2024-03-19T06:21:48.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.020+0000 7fea9b200640 1 -- 172.21.15.32:0/4017958216 shutdown_connections 2024-03-19T06:21:48.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.020+0000 7fea9b200640 1 --2- 172.21.15.32:0/4017958216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea9406b450 0x7fea940cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.020+0000 7fea9b200640 1 --2- 172.21.15.32:0/4017958216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea9415bad0 0x7fea940b0a00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.020+0000 7fea9b200640 1 -- 172.21.15.32:0/4017958216 >> 172.21.15.32:0/4017958216 conn(0x7fea940b58e0 msgr2=0x7fea940b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:48.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.020+0000 7fea9b200640 1 -- 172.21.15.32:0/4017958216 shutdown_connections 2024-03-19T06:21:48.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.020+0000 7fea9b200640 1 -- 172.21.15.32:0/4017958216 wait complete. 2024-03-19T06:21:48.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea9b200640 1 Processor -- start 2024-03-19T06:21:48.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea9b200640 1 -- start start 2024-03-19T06:21:48.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea9b200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea9406b450 0x7fea941f5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea9b200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea940b0f40 0x7fea9414d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea9b200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea9415bad0 0x7fea9414d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea9b200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea940cf7d0 con 0x7fea9406b450 2024-03-19T06:21:48.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea9b200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9415c0c0 con 0x7fea940b0f40 2024-03-19T06:21:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea9b200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea940cf950 con 0x7fea9415bad0 2024-03-19T06:21:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea99e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea9406b450 0x7fea941f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea99e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea9406b450 0x7fea941f5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57688/0 (socket says 172.21.15.32:57688) 2024-03-19T06:21:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea99e00640 1 -- 172.21.15.32:0/2828464833 learned_addr learned my addr 172.21.15.32:0/2828464833 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea99400640 1 --2- 172.21.15.32:0/2828464833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea940b0f40 0x7fea9414d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea9a800640 1 --2- 172.21.15.32:0/2828464833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea9415bad0 0x7fea9414d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea99e00640 1 -- 172.21.15.32:0/2828464833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea9415bad0 msgr2=0x7fea9414d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea99e00640 1 --2- 172.21.15.32:0/2828464833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea9415bad0 0x7fea9414d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea99e00640 1 -- 172.21.15.32:0/2828464833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea940b0f40 msgr2=0x7fea9414d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea99e00640 1 --2- 172.21.15.32:0/2828464833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea940b0f40 0x7fea9414d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea99e00640 1 -- 172.21.15.32:0/2828464833 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9414c240 con 0x7fea9406b450 2024-03-19T06:21:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea99e00640 1 --2- 172.21.15.32:0/2828464833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea9406b450 0x7fea941f5380 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fea880ad040 tx=0x7fea8801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:48.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea8e000640 1 -- 172.21.15.32:0/2828464833 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea880bf610 con 0x7fea9406b450 2024-03-19T06:21:48.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea8e000640 1 -- 172.21.15.32:0/2828464833 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea880bf7f0 con 0x7fea9406b450 2024-03-19T06:21:48.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea9b200640 1 -- 172.21.15.32:0/2828464833 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9414c520 con 0x7fea9406b450 2024-03-19T06:21:48.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea8e000640 1 -- 172.21.15.32:0/2828464833 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea880bfbe0 con 0x7fea9406b450 2024-03-19T06:21:48.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.024+0000 7fea9b200640 1 -- 172.21.15.32:0/2828464833 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9414cae0 con 0x7fea9406b450 2024-03-19T06:21:48.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.028+0000 7fea9b200640 1 -- 172.21.15.32:0/2828464833 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea94075090 con 0x7fea9406b450 2024-03-19T06:21:48.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.028+0000 7fea8e000640 1 -- 172.21.15.32:0/2828464833 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fea880bd020 con 0x7fea9406b450 2024-03-19T06:21:48.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.028+0000 7fea8e000640 1 --2- 172.21.15.32:0/2828464833 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fea78067660 0x7fea78069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.028+0000 7fea8e000640 1 -- 172.21.15.32:0/2828464833 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea881200a0 con 0x7fea9406b450 2024-03-19T06:21:48.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.028+0000 7fea99400640 1 --2- 172.21.15.32:0/2828464833 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fea78067660 0x7fea78069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.028+0000 7fea99400640 1 --2- 172.21.15.32:0/2828464833 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fea78067660 0x7fea78069b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fea9414f690 tx=0x7fea84009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:48.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.032+0000 7fea8e000640 1 -- 172.21.15.32:0/2828464833 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fea880a8050 con 0x7fea9406b450 2024-03-19T06:21:48.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.200+0000 7fea9b200640 1 -- 172.21.15.32:0/2828464833 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea940b0d20 con 0x7fea9406b450 2024-03-19T06:21:48.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.200+0000 7fea8e000640 1 -- 172.21.15.32:0/2828464833 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea88016090 con 0x7fea9406b450 2024-03-19T06:21:48.192 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:21:48.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.200+0000 7fea9b200640 1 -- 172.21.15.32:0/2828464833 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fea78067660 msgr2=0x7fea78069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.200+0000 7fea9b200640 1 --2- 172.21.15.32:0/2828464833 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fea78067660 0x7fea78069b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fea9414f690 tx=0x7fea84009040 comp rx=0 tx=0).stop 2024-03-19T06:21:48.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.200+0000 7fea9b200640 1 -- 172.21.15.32:0/2828464833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea9406b450 msgr2=0x7fea941f5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.200+0000 7fea9b200640 1 --2- 172.21.15.32:0/2828464833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea9406b450 0x7fea941f5380 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fea880ad040 tx=0x7fea8801acb0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.200+0000 7fea9b200640 1 -- 172.21.15.32:0/2828464833 shutdown_connections 2024-03-19T06:21:48.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.200+0000 7fea9b200640 1 --2- 172.21.15.32:0/2828464833 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fea78067660 0x7fea78069b20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.200+0000 7fea9b200640 1 --2- 172.21.15.32:0/2828464833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea9415bad0 0x7fea9414d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.200+0000 7fea9b200640 1 --2- 172.21.15.32:0/2828464833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea940b0f40 0x7fea9414d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.200+0000 7fea9b200640 1 --2- 172.21.15.32:0/2828464833 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea9406b450 0x7fea941f5380 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.200+0000 7fea9b200640 1 -- 172.21.15.32:0/2828464833 >> 172.21.15.32:0/2828464833 conn(0x7fea940b58e0 msgr2=0x7fea9406fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:48.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.200+0000 7fea9b200640 1 -- 172.21.15.32:0/2828464833 shutdown_connections 2024-03-19T06:21:48.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.200+0000 7fea9b200640 1 -- 172.21.15.32:0/2828464833 wait complete. 2024-03-19T06:21:48.212 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:21:48.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f2270000640 1 Processor -- start 2024-03-19T06:21:48.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f2270000640 1 -- start start 2024-03-19T06:21:48.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f2270000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f226815a7c0 0x7f22680cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f2270000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22680cc680 0x7f226815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f2270000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f22680b4c50 0x7f22680b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f2270000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226815e860 con 0x7f22680b4c50 2024-03-19T06:21:48.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f2270000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22680cb670 con 0x7f226815a7c0 2024-03-19T06:21:48.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f2270000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22680cb950 con 0x7f22680cc680 2024-03-19T06:21:48.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f226e000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f22680b4c50 0x7f22680b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f226e000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f22680b4c50 0x7f22680b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57704/0 (socket says 172.21.15.32:57704) 2024-03-19T06:21:48.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f226e000640 1 -- 172.21.15.32:0/2989507646 learned_addr learned my addr 172.21.15.32:0/2989507646 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:48.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f226cc00640 1 --2- 172.21.15.32:0/2989507646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22680cc680 0x7f226815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f226d600640 1 --2- 172.21.15.32:0/2989507646 >> v2:172.21.15.171:3300/0 conn(0x7f226815a7c0 0x7f22680cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f226e000640 1 -- 172.21.15.32:0/2989507646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22680cc680 msgr2=0x7f226815ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:48.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f226e000640 1 --2- 172.21.15.32:0/2989507646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22680cc680 0x7f226815ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f226e000640 1 -- 172.21.15.32:0/2989507646 >> v2:172.21.15.171:3300/0 conn(0x7f226815a7c0 msgr2=0x7f22680cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:48.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f226e000640 1 --2- 172.21.15.32:0/2989507646 >> v2:172.21.15.171:3300/0 conn(0x7f226815a7c0 0x7f22680cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.364+0000 7f226e000640 1 -- 172.21.15.32:0/2989507646 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226815e4f0 con 0x7f22680b4c50 2024-03-19T06:21:48.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.368+0000 7f226e000640 1 --2- 172.21.15.32:0/2989507646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22680b4c50 0x7f22680b50e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f22680d06b0 tx=0x7f226001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9220523ecb0110 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:48.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.368+0000 7f2267e00640 1 -- 172.21.15.32:0/2989507646 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22600a56f0 con 0x7f22680b4c50 2024-03-19T06:21:48.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.368+0000 7f2267e00640 1 -- 172.21.15.32:0/2989507646 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22600a5890 con 0x7f22680b4c50 2024-03-19T06:21:48.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.368+0000 7f2267e00640 1 -- 172.21.15.32:0/2989507646 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22600a5c60 con 0x7f22680b4c50 2024-03-19T06:21:48.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.368+0000 7f2270000640 1 -- 172.21.15.32:0/2989507646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22680b4c50 msgr2=0x7f22680b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.368+0000 7f2270000640 1 --2- 172.21.15.32:0/2989507646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22680b4c50 0x7f22680b50e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f22680d06b0 tx=0x7f226001c960 comp rx=0 tx=0).stop 2024-03-19T06:21:48.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.368+0000 7f2270000640 1 -- 172.21.15.32:0/2989507646 shutdown_connections 2024-03-19T06:21:48.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.368+0000 7f2270000640 1 --2- 172.21.15.32:0/2989507646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22680b4c50 0x7f22680b50e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.368+0000 7f2270000640 1 --2- 172.21.15.32:0/2989507646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22680cc680 0x7f226815ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.368+0000 7f2270000640 1 --2- 172.21.15.32:0/2989507646 >> v2:172.21.15.171:3300/0 conn(0x7f226815a7c0 0x7f22680cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.368+0000 7f2270000640 1 -- 172.21.15.32:0/2989507646 >> 172.21.15.32:0/2989507646 conn(0x7f22680b1280 msgr2=0x7f22680b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:48.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.368+0000 7f2270000640 1 -- 172.21.15.32:0/2989507646 shutdown_connections 2024-03-19T06:21:48.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.368+0000 7f2270000640 1 -- 172.21.15.32:0/2989507646 wait complete. 2024-03-19T06:21:48.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.368+0000 7f2270000640 1 Processor -- start 2024-03-19T06:21:48.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.368+0000 7f2270000640 1 -- start start 2024-03-19T06:21:48.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f2270000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22680b4c50 0x7f22680affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f2270000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22680cc680 0x7f226815aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f2270000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f226815a7c0 0x7f226815d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f2270000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22680cbdb0 con 0x7f22680cc680 2024-03-19T06:21:48.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f2270000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22680cbc30 con 0x7f226815a7c0 2024-03-19T06:21:48.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f2270000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22680c9c00 con 0x7f22680b4c50 2024-03-19T06:21:48.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f226cc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22680cc680 0x7f226815aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f226cc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22680cc680 0x7f226815aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57720/0 (socket says 172.21.15.32:57720) 2024-03-19T06:21:48.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f226cc00640 1 -- 172.21.15.32:0/1607792649 learned_addr learned my addr 172.21.15.32:0/1607792649 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:48.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f226d600640 1 --2- 172.21.15.32:0/1607792649 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22680b4c50 0x7f22680affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f226e000640 1 --2- 172.21.15.32:0/1607792649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f226815a7c0 0x7f226815d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f226cc00640 1 -- 172.21.15.32:0/1607792649 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22680b4c50 msgr2=0x7f22680affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f226cc00640 1 --2- 172.21.15.32:0/1607792649 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22680b4c50 0x7f22680affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f226cc00640 1 -- 172.21.15.32:0/1607792649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f226815a7c0 msgr2=0x7f226815d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f226cc00640 1 --2- 172.21.15.32:0/1607792649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f226815a7c0 0x7f226815d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f226cc00640 1 -- 172.21.15.32:0/1607792649 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226815b8b0 con 0x7f22680cc680 2024-03-19T06:21:48.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f226cc00640 1 --2- 172.21.15.32:0/1607792649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22680cc680 0x7f226815aed0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f225400d800 tx=0x7f225400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:48.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f2265600640 1 -- 172.21.15.32:0/1607792649 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254018020 con 0x7f22680cc680 2024-03-19T06:21:48.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f2265600640 1 -- 172.21.15.32:0/1607792649 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22540096c0 con 0x7f22680cc680 2024-03-19T06:21:48.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f2265600640 1 -- 172.21.15.32:0/1607792649 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254009ab0 con 0x7f22680cc680 2024-03-19T06:21:48.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f2270000640 1 -- 172.21.15.32:0/1607792649 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226815bb90 con 0x7f22680cc680 2024-03-19T06:21:48.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f2270000640 1 -- 172.21.15.32:0/1607792649 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226815c150 con 0x7f22680cc680 2024-03-19T06:21:48.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.372+0000 7f2270000640 1 -- 172.21.15.32:0/1607792649 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22680749e0 con 0x7f22680cc680 2024-03-19T06:21:48.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.376+0000 7f2265600640 1 -- 172.21.15.32:0/1607792649 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f225401b020 con 0x7f22680cc680 2024-03-19T06:21:48.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.376+0000 7f2265600640 1 --2- 172.21.15.32:0/1607792649 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2248067660 0x7f2248069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.376+0000 7f2265600640 1 -- 172.21.15.32:0/1607792649 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2254085de0 con 0x7f22680cc680 2024-03-19T06:21:48.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.376+0000 7f226d600640 1 --2- 172.21.15.32:0/1607792649 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2248067660 0x7f2248069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.376+0000 7f226d600640 1 --2- 172.21.15.32:0/1607792649 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2248067660 0x7f2248069b20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f226815f170 tx=0x7f225c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:48.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.380+0000 7f2265600640 1 -- 172.21.15.32:0/1607792649 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2254022020 con 0x7f22680cc680 2024-03-19T06:21:48.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.552+0000 7f2270000640 1 -- 172.21.15.32:0/1607792649 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f22680ce2d0 con 0x7f22680cc680 2024-03-19T06:21:48.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.556+0000 7f2265600640 1 -- 172.21.15.32:0/1607792649 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2254056370 con 0x7f22680cc680 2024-03-19T06:21:48.548 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:21:48.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.556+0000 7f2270000640 1 -- 172.21.15.32:0/1607792649 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2248067660 msgr2=0x7f2248069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.556+0000 7f2270000640 1 --2- 172.21.15.32:0/1607792649 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2248067660 0x7f2248069b20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f226815f170 tx=0x7f225c008040 comp rx=0 tx=0).stop 2024-03-19T06:21:48.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.556+0000 7f2270000640 1 -- 172.21.15.32:0/1607792649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22680cc680 msgr2=0x7f226815aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.556+0000 7f2270000640 1 --2- 172.21.15.32:0/1607792649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22680cc680 0x7f226815aed0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f225400d800 tx=0x7f225400dcc0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.556+0000 7f2270000640 1 -- 172.21.15.32:0/1607792649 shutdown_connections 2024-03-19T06:21:48.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.556+0000 7f2270000640 1 --2- 172.21.15.32:0/1607792649 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2248067660 0x7f2248069b20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.556+0000 7f2270000640 1 --2- 172.21.15.32:0/1607792649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f226815a7c0 0x7f226815d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.556+0000 7f2270000640 1 --2- 172.21.15.32:0/1607792649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22680cc680 0x7f226815aed0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.556+0000 7f2270000640 1 --2- 172.21.15.32:0/1607792649 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22680b4c50 0x7f22680affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.556+0000 7f2270000640 1 -- 172.21.15.32:0/1607792649 >> 172.21.15.32:0/1607792649 conn(0x7f22680b1280 msgr2=0x7f22680af5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.556+0000 7f2270000640 1 -- 172.21.15.32:0/1607792649 shutdown_connections 2024-03-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.556+0000 7f2270000640 1 -- 172.21.15.32:0/1607792649 wait complete. 2024-03-19T06:21:48.570 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:21:48.570 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:21:48.579 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:48.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.728+0000 7f2475200640 1 Processor -- start 2024-03-19T06:21:48.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.728+0000 7f2475200640 1 -- start start 2024-03-19T06:21:48.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.728+0000 7f2475200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f247006b450 0x7f24700cc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.728+0000 7f2475200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f24700cd270 0x7f24700b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.728+0000 7f2475200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247015be40 con 0x7f247015ba60 2024-03-19T06:21:48.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.728+0000 7f2475200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24700c4030 con 0x7f24700cd270 2024-03-19T06:21:48.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.728+0000 7f2475200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24700cd6c0 con 0x7f247006b450 2024-03-19T06:21:48.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.728+0000 7f246e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f24700cd270 0x7f24700b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.728+0000 7f246e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f24700cd270 0x7f24700b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57736/0 (socket says 172.21.15.32:57736) 2024-03-19T06:21:48.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.728+0000 7f246e800640 1 -- 172.21.15.32:0/4178409921 learned_addr learned my addr 172.21.15.32:0/4178409921 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:48.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.728+0000 7f2465400640 1 --2- 172.21.15.32:0/4178409921 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f247006b450 0x7f24700cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.728+0000 7f246e800640 1 -- 172.21.15.32:0/4178409921 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f247006b450 msgr2=0x7f24700cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:48.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.728+0000 7f246e800640 1 --2- 172.21.15.32:0/4178409921 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f247006b450 0x7f24700cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.728+0000 7f246e800640 1 -- 172.21.15.32:0/4178409921 >> v1:172.21.15.171:6789/0 conn(0x7f247015ba60 legacy=0x7f247006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.728+0000 7f246e800640 1 -- 172.21.15.32:0/4178409921 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24700cd970 con 0x7f24700cd270 2024-03-19T06:21:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.732+0000 7f246e800640 1 --2- 172.21.15.32:0/4178409921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24700cd270 0x7f24700b3df0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2468009e50 tx=0x7f246801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e2950043bebf3c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.732+0000 7f246d400640 1 -- 172.21.15.32:0/4178409921 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24680a58d0 con 0x7f24700cd270 2024-03-19T06:21:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.732+0000 7f246d400640 1 -- 172.21.15.32:0/4178409921 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24680a5a70 con 0x7f24700cd270 2024-03-19T06:21:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.732+0000 7f246d400640 1 -- 172.21.15.32:0/4178409921 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24680a5e40 con 0x7f24700cd270 2024-03-19T06:21:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.732+0000 7f2475200640 1 -- 172.21.15.32:0/4178409921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24700cd270 msgr2=0x7f24700b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.732+0000 7f2475200640 1 --2- 172.21.15.32:0/4178409921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24700cd270 0x7f24700b3df0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2468009e50 tx=0x7f246801ca00 comp rx=0 tx=0).stop 2024-03-19T06:21:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.732+0000 7f2475200640 1 -- 172.21.15.32:0/4178409921 shutdown_connections 2024-03-19T06:21:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.732+0000 7f2475200640 1 --2- 172.21.15.32:0/4178409921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24700cd270 0x7f24700b3df0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.732+0000 7f2475200640 1 --2- 172.21.15.32:0/4178409921 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f247006b450 0x7f24700cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.732+0000 7f2475200640 1 -- 172.21.15.32:0/4178409921 >> 172.21.15.32:0/4178409921 conn(0x7f24700b2250 msgr2=0x7f24700b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.732+0000 7f2475200640 1 -- 172.21.15.32:0/4178409921 shutdown_connections 2024-03-19T06:21:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.732+0000 7f2475200640 1 -- 172.21.15.32:0/4178409921 wait complete. 2024-03-19T06:21:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.732+0000 7f2475200640 1 Processor -- start 2024-03-19T06:21:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.732+0000 7f2475200640 1 -- start start 2024-03-19T06:21:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2475200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f247006b450 0x7f24701517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2475200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24700cd270 0x7f2470153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2475200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f247015ba60 0x7f24700b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2475200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700b4b40 con 0x7f24700cd270 2024-03-19T06:21:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2475200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700cdf30 con 0x7f247006b450 2024-03-19T06:21:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2475200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24700b4cc0 con 0x7f247015ba60 2024-03-19T06:21:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2465400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24700cd270 0x7f2470153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2465400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24700cd270 0x7f2470153c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57750/0 (socket says 172.21.15.32:57750) 2024-03-19T06:21:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2465400640 1 -- 172.21.15.32:0/1139118060 learned_addr learned my addr 172.21.15.32:0/1139118060 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f246e800640 1 --2- 172.21.15.32:0/1139118060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f247015ba60 0x7f24700b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f246de00640 1 --2- 172.21.15.32:0/1139118060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f247006b450 0x7f24701517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2465400640 1 -- 172.21.15.32:0/1139118060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f247015ba60 msgr2=0x7f24700b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2465400640 1 --2- 172.21.15.32:0/1139118060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f247015ba60 0x7f24700b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2465400640 1 -- 172.21.15.32:0/1139118060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f247006b450 msgr2=0x7f24701517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2465400640 1 --2- 172.21.15.32:0/1139118060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f247006b450 0x7f24701517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2465400640 1 -- 172.21.15.32:0/1139118060 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24701509e0 con 0x7f24700cd270 2024-03-19T06:21:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2465400640 1 --2- 172.21.15.32:0/1139118060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24700cd270 0x7f2470153c50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f245800d800 tx=0x7f245800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2466a00640 1 -- 172.21.15.32:0/1139118060 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245800b6c0 con 0x7f24700cd270 2024-03-19T06:21:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2466a00640 1 -- 172.21.15.32:0/1139118060 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2458019070 con 0x7f24700cd270 2024-03-19T06:21:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2466a00640 1 -- 172.21.15.32:0/1139118060 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245800ba60 con 0x7f24700cd270 2024-03-19T06:21:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2475200640 1 -- 172.21.15.32:0/1139118060 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2470150cc0 con 0x7f24700cd270 2024-03-19T06:21:48.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2475200640 1 -- 172.21.15.32:0/1139118060 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2470151280 con 0x7f24700cd270 2024-03-19T06:21:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.736+0000 7f2475200640 1 -- 172.21.15.32:0/1139118060 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24700749e0 con 0x7f24700cd270 2024-03-19T06:21:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.740+0000 7f2466a00640 1 -- 172.21.15.32:0/1139118060 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f245800bc00 con 0x7f24700cd270 2024-03-19T06:21:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.740+0000 7f2466a00640 1 --2- 172.21.15.32:0/1139118060 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f244c067660 0x7f244c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:48.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.740+0000 7f2466a00640 1 -- 172.21.15.32:0/1139118060 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2458085cc0 con 0x7f24700cd270 2024-03-19T06:21:48.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.740+0000 7f246de00640 1 --2- 172.21.15.32:0/1139118060 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f244c067660 0x7f244c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:48.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.740+0000 7f246de00640 1 --2- 172.21.15.32:0/1139118060 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f244c067660 0x7f244c069b20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2460001770 tx=0x7f2460009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:48.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.744+0000 7f2466a00640 1 -- 172.21.15.32:0/1139118060 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f245808c080 con 0x7f24700cd270 2024-03-19T06:21:48.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.908+0000 7f2475200640 1 -- 172.21.15.32:0/1139118060 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f247006e0d0 con 0x7f24700cd270 2024-03-19T06:21:48.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.908+0000 7f2466a00640 1 -- 172.21.15.32:0/1139118060 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f2458056250 con 0x7f24700cd270 2024-03-19T06:21:48.901 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:48.901 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:10.423479+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:48.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.912+0000 7f2475200640 1 -- 172.21.15.32:0/1139118060 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f244c067660 msgr2=0x7f244c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.912+0000 7f2475200640 1 --2- 172.21.15.32:0/1139118060 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f244c067660 0x7f244c069b20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2460001770 tx=0x7f2460009040 comp rx=0 tx=0).stop 2024-03-19T06:21:48.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.912+0000 7f2475200640 1 -- 172.21.15.32:0/1139118060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24700cd270 msgr2=0x7f2470153c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:48.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.912+0000 7f2475200640 1 --2- 172.21.15.32:0/1139118060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24700cd270 0x7f2470153c50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f245800d800 tx=0x7f245800dcc0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.912+0000 7f2475200640 1 -- 172.21.15.32:0/1139118060 shutdown_connections 2024-03-19T06:21:48.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.912+0000 7f2475200640 1 --2- 172.21.15.32:0/1139118060 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f244c067660 0x7f244c069b20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.912+0000 7f2475200640 1 --2- 172.21.15.32:0/1139118060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f247015ba60 0x7f24700b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.912+0000 7f2475200640 1 --2- 172.21.15.32:0/1139118060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24700cd270 0x7f2470153c50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.912+0000 7f2475200640 1 --2- 172.21.15.32:0/1139118060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f247006b450 0x7f24701517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:48.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.912+0000 7f2475200640 1 -- 172.21.15.32:0/1139118060 >> 172.21.15.32:0/1139118060 conn(0x7f24700b2250 msgr2=0x7f247006f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:48.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.912+0000 7f2475200640 1 -- 172.21.15.32:0/1139118060 shutdown_connections 2024-03-19T06:21:48.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:48.912+0000 7f2475200640 1 -- 172.21.15.32:0/1139118060 wait complete. 2024-03-19T06:21:48.923 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:21:07.089673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:21:07.801319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:48.924 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:49.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.076+0000 7f5730e00640 1 Processor -- start 2024-03-19T06:21:49.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.076+0000 7f5730e00640 1 -- start start 2024-03-19T06:21:49.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.076+0000 7f5730e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f572c146700 0x7f572c0b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.076+0000 7f5730e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f572c146ae0 0x7f572c06ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.076+0000 7f5730e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572c0b2dd0 con 0x7f572c072200 2024-03-19T06:21:49.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.076+0000 7f5730e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572c0b30a0 con 0x7f572c146ae0 2024-03-19T06:21:49.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.076+0000 7f5730e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0b3380 con 0x7f572c146700 2024-03-19T06:21:49.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.076+0000 7f5729e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f572c146700 0x7f572c0b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.076+0000 7f5729e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f572c146700 0x7f572c0b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:32930/0 (socket says 172.21.15.32:32930) 2024-03-19T06:21:49.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.076+0000 7f5729e00640 1 -- 172.21.15.32:0/3688431133 learned_addr learned my addr 172.21.15.32:0/3688431133 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:49.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.076+0000 7f5723e00640 1 --2- 172.21.15.32:0/3688431133 >> v2:172.21.15.171:3300/0 conn(0x7f572c146ae0 0x7f572c06ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.076+0000 7f5729e00640 1 -- 172.21.15.32:0/3688431133 >> v2:172.21.15.171:3300/0 conn(0x7f572c146ae0 msgr2=0x7f572c06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:49.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.076+0000 7f5729e00640 1 --2- 172.21.15.32:0/3688431133 >> v2:172.21.15.171:3300/0 conn(0x7f572c146ae0 0x7f572c06ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.076+0000 7f5729e00640 1 -- 172.21.15.32:0/3688431133 >> v1:172.21.15.171:6789/0 conn(0x7f572c072200 legacy=0x7f572c161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.076+0000 7f5729e00640 1 -- 172.21.15.32:0/3688431133 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c0b3660 con 0x7f572c146700 2024-03-19T06:21:49.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.080+0000 7f5729e00640 1 --2- 172.21.15.32:0/3688431133 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f572c146700 0x7f572c0b2890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f571c009870 tx=0x7f571c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b37ede09ce65a9e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:49.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.080+0000 7f5729400640 1 -- 172.21.15.32:0/3688431133 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c0b0070 con 0x7f572c146700 2024-03-19T06:21:49.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.080+0000 7f5729400640 1 -- 172.21.15.32:0/3688431133 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c004230 con 0x7f572c146700 2024-03-19T06:21:49.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.080+0000 7f5729400640 1 -- 172.21.15.32:0/3688431133 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c003620 con 0x7f572c146700 2024-03-19T06:21:49.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.080+0000 7f5730e00640 1 -- 172.21.15.32:0/3688431133 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f572c146700 msgr2=0x7f572c0b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.080+0000 7f5730e00640 1 --2- 172.21.15.32:0/3688431133 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f572c146700 0x7f572c0b2890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f571c009870 tx=0x7f571c01c3f0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.080+0000 7f5730e00640 1 -- 172.21.15.32:0/3688431133 shutdown_connections 2024-03-19T06:21:49.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.080+0000 7f5730e00640 1 --2- 172.21.15.32:0/3688431133 >> v2:172.21.15.171:3300/0 conn(0x7f572c146ae0 0x7f572c06ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.080+0000 7f5730e00640 1 --2- 172.21.15.32:0/3688431133 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f572c146700 0x7f572c0b2890 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.080+0000 7f5730e00640 1 -- 172.21.15.32:0/3688431133 >> 172.21.15.32:0/3688431133 conn(0x7f572c0b1590 msgr2=0x7f572c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:49.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.080+0000 7f5730e00640 1 -- 172.21.15.32:0/3688431133 shutdown_connections 2024-03-19T06:21:49.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.080+0000 7f5730e00640 1 -- 172.21.15.32:0/3688431133 wait complete. 2024-03-19T06:21:49.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5730e00640 1 Processor -- start 2024-03-19T06:21:49.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5730e00640 1 -- start start 2024-03-19T06:21:49.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5730e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f572c072200 0x7f572c1401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5730e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f572c146700 0x7f572c06ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5730e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f572c146ae0 0x7f572c06b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5730e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c06e9a0 con 0x7f572c072200 2024-03-19T06:21:49.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5730e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0b3c20 con 0x7f572c146700 2024-03-19T06:21:49.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5730e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c06eb20 con 0x7f572c146ae0 2024-03-19T06:21:49.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5729e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f572c072200 0x7f572c1401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5729e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f572c072200 0x7f572c1401a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57760/0 (socket says 172.21.15.32:57760) 2024-03-19T06:21:49.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5729e00640 1 -- 172.21.15.32:0/1687438831 learned_addr learned my addr 172.21.15.32:0/1687438831 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:49.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5723e00640 1 --2- 172.21.15.32:0/1687438831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f572c146700 0x7f572c06ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f572a800640 1 --2- 172.21.15.32:0/1687438831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f572c146ae0 0x7f572c06b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5729e00640 1 -- 172.21.15.32:0/1687438831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f572c146ae0 msgr2=0x7f572c06b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5729e00640 1 --2- 172.21.15.32:0/1687438831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f572c146ae0 0x7f572c06b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5729e00640 1 -- 172.21.15.32:0/1687438831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f572c146700 msgr2=0x7f572c06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5729e00640 1 --2- 172.21.15.32:0/1687438831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f572c146700 0x7f572c06ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5729e00640 1 -- 172.21.15.32:0/1687438831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c143360 con 0x7f572c072200 2024-03-19T06:21:49.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5723e00640 1 --2- 172.21.15.32:0/1687438831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f572c146700 0x7f572c06ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:49.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5729e00640 1 --2- 172.21.15.32:0/1687438831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f572c072200 0x7f572c1401a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f571c0ae040 tx=0x7f571c019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:49.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5722000640 1 -- 172.21.15.32:0/1687438831 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c0bc070 con 0x7f572c072200 2024-03-19T06:21:49.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5722000640 1 -- 172.21.15.32:0/1687438831 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c0ab660 con 0x7f572c072200 2024-03-19T06:21:49.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5722000640 1 -- 172.21.15.32:0/1687438831 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c0b0040 con 0x7f572c072200 2024-03-19T06:21:49.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5730e00640 1 -- 172.21.15.32:0/1687438831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572c1f3980 con 0x7f572c072200 2024-03-19T06:21:49.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5730e00640 1 -- 172.21.15.32:0/1687438831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572c1406e0 con 0x7f572c072200 2024-03-19T06:21:49.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.084+0000 7f5730e00640 1 -- 172.21.15.32:0/1687438831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572c0749e0 con 0x7f572c072200 2024-03-19T06:21:49.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.088+0000 7f5722000640 1 -- 172.21.15.32:0/1687438831 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f571c0aba50 con 0x7f572c072200 2024-03-19T06:21:49.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.088+0000 7f5722000640 1 --2- 172.21.15.32:0/1687438831 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5708067660 0x7f5708069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.088+0000 7f5722000640 1 -- 172.21.15.32:0/1687438831 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f571c11f630 con 0x7f572c072200 2024-03-19T06:21:49.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.088+0000 7f5723e00640 1 --2- 172.21.15.32:0/1687438831 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5708067660 0x7f5708069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.088+0000 7f5723e00640 1 --2- 172.21.15.32:0/1687438831 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5708067660 0x7f5708069b20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f572c0cb6d0 tx=0x7f5714008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:49.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.092+0000 7f5722000640 1 -- 172.21.15.32:0/1687438831 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f571c016070 con 0x7f572c072200 2024-03-19T06:21:49.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.256+0000 7f5730e00640 1 -- 172.21.15.32:0/1687438831 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f572c0b1ba0 con 0x7f572c072200 2024-03-19T06:21:49.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.256+0000 7f5722000640 1 -- 172.21.15.32:0/1687438831 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f571c0f0290 con 0x7f572c072200 2024-03-19T06:21:49.247 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.256+0000 7f5730e00640 1 -- 172.21.15.32:0/1687438831 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5708067660 msgr2=0x7f5708069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.256+0000 7f5730e00640 1 --2- 172.21.15.32:0/1687438831 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5708067660 0x7f5708069b20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f572c0cb6d0 tx=0x7f5714008040 comp rx=0 tx=0).stop 2024-03-19T06:21:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.256+0000 7f5730e00640 1 -- 172.21.15.32:0/1687438831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f572c072200 msgr2=0x7f572c1401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.256+0000 7f5730e00640 1 --2- 172.21.15.32:0/1687438831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f572c072200 0x7f572c1401a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f571c0ae040 tx=0x7f571c019190 comp rx=0 tx=0).stop 2024-03-19T06:21:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.256+0000 7f5730e00640 1 -- 172.21.15.32:0/1687438831 shutdown_connections 2024-03-19T06:21:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.256+0000 7f5730e00640 1 --2- 172.21.15.32:0/1687438831 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5708067660 0x7f5708069b20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.256+0000 7f5730e00640 1 --2- 172.21.15.32:0/1687438831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f572c146ae0 0x7f572c06b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.256+0000 7f5730e00640 1 --2- 172.21.15.32:0/1687438831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f572c146700 0x7f572c06ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.256+0000 7f5730e00640 1 --2- 172.21.15.32:0/1687438831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f572c072200 0x7f572c1401a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.256+0000 7f5730e00640 1 -- 172.21.15.32:0/1687438831 >> 172.21.15.32:0/1687438831 conn(0x7f572c0b1590 msgr2=0x7f572c0af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.256+0000 7f5730e00640 1 -- 172.21.15.32:0/1687438831 shutdown_connections 2024-03-19T06:21:49.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.256+0000 7f5730e00640 1 -- 172.21.15.32:0/1687438831 wait complete. 2024-03-19T06:21:49.269 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:21:49.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.420+0000 7f8ac7c00640 1 Processor -- start 2024-03-19T06:21:49.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.420+0000 7f8ac7c00640 1 -- start start 2024-03-19T06:21:49.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.420+0000 7f8ac7c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8ac0146700 0x7f8ac00b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.420+0000 7f8ac7c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8ac0146ae0 0x7f8ac006ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.420+0000 7f8ac7c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac00b2dd0 con 0x7f8ac0072200 2024-03-19T06:21:49.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.420+0000 7f8ac7c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac00b30a0 con 0x7f8ac0146700 2024-03-19T06:21:49.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.420+0000 7f8ac7c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac00b3380 con 0x7f8ac0146ae0 2024-03-19T06:21:49.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.420+0000 7f8ac5200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8ac0146700 0x7f8ac00b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.420+0000 7f8ac5200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8ac0146700 0x7f8ac00b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57764/0 (socket says 172.21.15.32:57764) 2024-03-19T06:21:49.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.420+0000 7f8ac5200640 1 -- 172.21.15.32:0/3780765664 learned_addr learned my addr 172.21.15.32:0/3780765664 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:49.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.420+0000 7f8ab7e00640 1 --2- 172.21.15.32:0/3780765664 >> v2:172.21.15.171:3300/0 conn(0x7f8ac0146ae0 0x7f8ac006ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.420+0000 7f8ac5200640 1 -- 172.21.15.32:0/3780765664 >> v2:172.21.15.171:3300/0 conn(0x7f8ac0146ae0 msgr2=0x7f8ac006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:49.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.420+0000 7f8ac5200640 1 --2- 172.21.15.32:0/3780765664 >> v2:172.21.15.171:3300/0 conn(0x7f8ac0146ae0 0x7f8ac006ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.420+0000 7f8ac5200640 1 -- 172.21.15.32:0/3780765664 >> v1:172.21.15.171:6789/0 conn(0x7f8ac0072200 legacy=0x7f8ac0161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.420+0000 7f8ac5200640 1 -- 172.21.15.32:0/3780765664 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac00b3660 con 0x7f8ac0146700 2024-03-19T06:21:49.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.424+0000 7f8ac5200640 1 --2- 172.21.15.32:0/3780765664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ac0146700 0x7f8ac00b2890 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0072970 tx=0x7f8ab001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431fc4a4a8d1158 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:49.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.424+0000 7f8abfe00640 1 -- 172.21.15.32:0/3780765664 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab00ab600 con 0x7f8ac0146700 2024-03-19T06:21:49.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.424+0000 7f8abfe00640 1 -- 172.21.15.32:0/3780765664 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab00b0070 con 0x7f8ac0146700 2024-03-19T06:21:49.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.424+0000 7f8abfe00640 1 -- 172.21.15.32:0/3780765664 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab00ab9c0 con 0x7f8ac0146700 2024-03-19T06:21:49.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.424+0000 7f8ac7c00640 1 -- 172.21.15.32:0/3780765664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ac0146700 msgr2=0x7f8ac00b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.424+0000 7f8ac7c00640 1 --2- 172.21.15.32:0/3780765664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ac0146700 0x7f8ac00b2890 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0072970 tx=0x7f8ab001c4f0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.424+0000 7f8ac7c00640 1 -- 172.21.15.32:0/3780765664 shutdown_connections 2024-03-19T06:21:49.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.424+0000 7f8ac7c00640 1 --2- 172.21.15.32:0/3780765664 >> v2:172.21.15.171:3300/0 conn(0x7f8ac0146ae0 0x7f8ac006ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.424+0000 7f8ac7c00640 1 --2- 172.21.15.32:0/3780765664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ac0146700 0x7f8ac00b2890 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.424+0000 7f8ac7c00640 1 -- 172.21.15.32:0/3780765664 >> 172.21.15.32:0/3780765664 conn(0x7f8ac00b1590 msgr2=0x7f8ac00b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:49.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.424+0000 7f8ac7c00640 1 -- 172.21.15.32:0/3780765664 shutdown_connections 2024-03-19T06:21:49.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.424+0000 7f8ac7c00640 1 -- 172.21.15.32:0/3780765664 wait complete. 2024-03-19T06:21:49.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ac7c00640 1 Processor -- start 2024-03-19T06:21:49.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ac7c00640 1 -- start start 2024-03-19T06:21:49.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ac7c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac0072200 0x7f8ac013e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ac7c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ac0146700 0x7f8ac0160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ac7c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ac0146ae0 0x7f8ac0143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ac7c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac016ac10 con 0x7f8ac0146700 2024-03-19T06:21:49.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ac7c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac006b690 con 0x7f8ac0072200 2024-03-19T06:21:49.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ac7c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac016ad90 con 0x7f8ac0146ae0 2024-03-19T06:21:49.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ab7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ac0146700 0x7f8ac0160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ab7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ac0146700 0x7f8ac0160b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57780/0 (socket says 172.21.15.32:57780) 2024-03-19T06:21:49.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ab7e00640 1 -- 172.21.15.32:0/3009486771 learned_addr learned my addr 172.21.15.32:0/3009486771 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:49.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ac5200640 1 --2- 172.21.15.32:0/3009486771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac0072200 0x7f8ac013e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ac5c00640 1 --2- 172.21.15.32:0/3009486771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ac0146ae0 0x7f8ac0143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ab7e00640 1 -- 172.21.15.32:0/3009486771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ac0146ae0 msgr2=0x7f8ac0143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ab7e00640 1 --2- 172.21.15.32:0/3009486771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ac0146ae0 0x7f8ac0143f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ab7e00640 1 -- 172.21.15.32:0/3009486771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac0072200 msgr2=0x7f8ac013e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ab7e00640 1 --2- 172.21.15.32:0/3009486771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac0072200 0x7f8ac013e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ab7e00640 1 -- 172.21.15.32:0/3009486771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac013ea70 con 0x7f8ac0146700 2024-03-19T06:21:49.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ac5c00640 1 --2- 172.21.15.32:0/3009486771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ac0146ae0 0x7f8ac0143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:49.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ab7e00640 1 --2- 172.21.15.32:0/3009486771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ac0146700 0x7f8ac0160b80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800d800 tx=0x7f8aa800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:49.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8abd600640 1 -- 172.21.15.32:0/3009486771 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa800b6c0 con 0x7f8ac0146700 2024-03-19T06:21:49.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8abd600640 1 -- 172.21.15.32:0/3009486771 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa8019070 con 0x7f8ac0146700 2024-03-19T06:21:49.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8abd600640 1 -- 172.21.15.32:0/3009486771 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa800bae0 con 0x7f8ac0146700 2024-03-19T06:21:49.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ac7c00640 1 -- 172.21.15.32:0/3009486771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac013ee50 con 0x7f8ac0146700 2024-03-19T06:21:49.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.428+0000 7f8ac7c00640 1 -- 172.21.15.32:0/3009486771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac013f410 con 0x7f8ac0146700 2024-03-19T06:21:49.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.432+0000 7f8ac7c00640 1 -- 172.21.15.32:0/3009486771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac00749e0 con 0x7f8ac0146700 2024-03-19T06:21:49.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.432+0000 7f8abd600640 1 -- 172.21.15.32:0/3009486771 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8aa800bc80 con 0x7f8ac0146700 2024-03-19T06:21:49.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.432+0000 7f8abd600640 1 --2- 172.21.15.32:0/3009486771 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a9c067660 0x7f8a9c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.432+0000 7f8abd600640 1 -- 172.21.15.32:0/3009486771 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8aa8085dd0 con 0x7f8ac0146700 2024-03-19T06:21:49.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.432+0000 7f8ac5200640 1 --2- 172.21.15.32:0/3009486771 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a9c067660 0x7f8a9c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.432+0000 7f8ac5200640 1 --2- 172.21.15.32:0/3009486771 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a9c067660 0x7f8a9c069b20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00af000 tx=0x7f8ab00a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:49.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.436+0000 7f8abd600640 1 -- 172.21.15.32:0/3009486771 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f8aa80569b0 con 0x7f8ac0146700 2024-03-19T06:21:49.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.604+0000 7f8ac7c00640 1 -- 172.21.15.32:0/3009486771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ac0161ad0 con 0x7f8ac0146700 2024-03-19T06:21:49.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.604+0000 7f8abd600640 1 -- 172.21.15.32:0/3009486771 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8aa80562b0 con 0x7f8ac0146700 2024-03-19T06:21:49.595 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:21:49.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.604+0000 7f8ac7c00640 1 -- 172.21.15.32:0/3009486771 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a9c067660 msgr2=0x7f8a9c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.604+0000 7f8ac7c00640 1 --2- 172.21.15.32:0/3009486771 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a9c067660 0x7f8a9c069b20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00af000 tx=0x7f8ab00a7000 comp rx=0 tx=0).stop 2024-03-19T06:21:49.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.604+0000 7f8ac7c00640 1 -- 172.21.15.32:0/3009486771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ac0146700 msgr2=0x7f8ac0160b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.604+0000 7f8ac7c00640 1 --2- 172.21.15.32:0/3009486771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ac0146700 0x7f8ac0160b80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800d800 tx=0x7f8aa800dcc0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.604+0000 7f8ac7c00640 1 -- 172.21.15.32:0/3009486771 shutdown_connections 2024-03-19T06:21:49.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.604+0000 7f8ac7c00640 1 --2- 172.21.15.32:0/3009486771 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a9c067660 0x7f8a9c069b20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.604+0000 7f8ac7c00640 1 --2- 172.21.15.32:0/3009486771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ac0146ae0 0x7f8ac0143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.604+0000 7f8ac7c00640 1 --2- 172.21.15.32:0/3009486771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ac0146700 0x7f8ac0160b80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.604+0000 7f8ac7c00640 1 --2- 172.21.15.32:0/3009486771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac0072200 0x7f8ac013e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.604+0000 7f8ac7c00640 1 -- 172.21.15.32:0/3009486771 >> 172.21.15.32:0/3009486771 conn(0x7f8ac00b1590 msgr2=0x7f8ac00ad4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:49.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.604+0000 7f8ac7c00640 1 -- 172.21.15.32:0/3009486771 shutdown_connections 2024-03-19T06:21:49.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.604+0000 7f8ac7c00640 1 -- 172.21.15.32:0/3009486771 wait complete. 2024-03-19T06:21:49.617 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:21:49.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.768+0000 7f4ba3600640 1 Processor -- start 2024-03-19T06:21:49.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.768+0000 7f4ba3600640 1 -- start start 2024-03-19T06:21:49.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.768+0000 7f4ba3600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b9c15a840 0x7f4b9c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.768+0000 7f4ba3600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4b9c0aea70 0x7f4b9c06ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.768+0000 7f4ba3600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4b9c06b280 0x7f4b9c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.768+0000 7f4ba3600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9c0cdc20 con 0x7f4b9c06b280 2024-03-19T06:21:49.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.768+0000 7f4ba3600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9c0af2d0 con 0x7f4b9c0aea70 2024-03-19T06:21:49.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.768+0000 7f4ba3600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c15eea0 con 0x7f4b9c15a840 2024-03-19T06:21:49.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.768+0000 7f4ba1600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4b9c06b280 0x7f4b9c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.768+0000 7f4ba1600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4b9c06b280 0x7f4b9c06d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57790/0 (socket says 172.21.15.32:57790) 2024-03-19T06:21:49.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.768+0000 7f4ba1600640 1 -- 172.21.15.32:0/469116404 learned_addr learned my addr 172.21.15.32:0/469116404 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:49.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.772+0000 7f4b9be00640 1 --2- 172.21.15.32:0/469116404 >> v2:172.21.15.171:3300/0 conn(0x7f4b9c0aea70 0x7f4b9c06ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.772+0000 7f4ba0c00640 1 --2- 172.21.15.32:0/469116404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b9c15a840 0x7f4b9c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.772+0000 7f4ba1600640 1 -- 172.21.15.32:0/469116404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b9c15a840 msgr2=0x7f4b9c06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:49.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.772+0000 7f4ba1600640 1 --2- 172.21.15.32:0/469116404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b9c15a840 0x7f4b9c06f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.772+0000 7f4ba1600640 1 -- 172.21.15.32:0/469116404 >> v2:172.21.15.171:3300/0 conn(0x7f4b9c0aea70 msgr2=0x7f4b9c06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:49.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.772+0000 7f4ba1600640 1 --2- 172.21.15.32:0/469116404 >> v2:172.21.15.171:3300/0 conn(0x7f4b9c0aea70 0x7f4b9c06ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.772+0000 7f4ba1600640 1 -- 172.21.15.32:0/469116404 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c15f180 con 0x7f4b9c06b280 2024-03-19T06:21:49.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.772+0000 7f4b9be00640 1 --2- 172.21.15.32:0/469116404 >> v2:172.21.15.171:3300/0 conn(0x7f4b9c0aea70 0x7f4b9c06ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:49.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.772+0000 7f4ba1600640 1 --2- 172.21.15.32:0/469116404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b9c06b280 0x7f4b9c06d5b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0b2390 tx=0x7f4b9401c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da109ffb0aaf1fb9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:49.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.772+0000 7f4b9b400640 1 -- 172.21.15.32:0/469116404 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b940ac070 con 0x7f4b9c06b280 2024-03-19T06:21:49.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.772+0000 7f4b9b400640 1 -- 172.21.15.32:0/469116404 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b940a8410 con 0x7f4b9c06b280 2024-03-19T06:21:49.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.772+0000 7f4b9b400640 1 -- 172.21.15.32:0/469116404 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b940a87e0 con 0x7f4b9c06b280 2024-03-19T06:21:49.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.772+0000 7f4ba3600640 1 -- 172.21.15.32:0/469116404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b9c06b280 msgr2=0x7f4b9c06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.772+0000 7f4ba3600640 1 --2- 172.21.15.32:0/469116404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b9c06b280 0x7f4b9c06d5b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0b2390 tx=0x7f4b9401c610 comp rx=0 tx=0).stop 2024-03-19T06:21:49.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba3600640 1 -- 172.21.15.32:0/469116404 shutdown_connections 2024-03-19T06:21:49.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba3600640 1 --2- 172.21.15.32:0/469116404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b9c06b280 0x7f4b9c06d5b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba3600640 1 --2- 172.21.15.32:0/469116404 >> v2:172.21.15.171:3300/0 conn(0x7f4b9c0aea70 0x7f4b9c06ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba3600640 1 --2- 172.21.15.32:0/469116404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b9c15a840 0x7f4b9c06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba3600640 1 -- 172.21.15.32:0/469116404 >> 172.21.15.32:0/469116404 conn(0x7f4b9c0b1590 msgr2=0x7f4b9c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:49.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba3600640 1 -- 172.21.15.32:0/469116404 shutdown_connections 2024-03-19T06:21:49.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba3600640 1 -- 172.21.15.32:0/469116404 wait complete. 2024-03-19T06:21:49.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba3600640 1 Processor -- start 2024-03-19T06:21:49.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba3600640 1 -- start start 2024-03-19T06:21:49.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba3600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b9c06b280 0x7f4b9c0acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba3600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b9c0aea70 0x7f4b9c15b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba3600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b9c15a840 0x7f4b9c140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba3600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0ce210 con 0x7f4b9c15a840 2024-03-19T06:21:49.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba3600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0ce090 con 0x7f4b9c0aea70 2024-03-19T06:21:49.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba3600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0ce390 con 0x7f4b9c06b280 2024-03-19T06:21:49.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba1600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b9c15a840 0x7f4b9c140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba1600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b9c15a840 0x7f4b9c140e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57806/0 (socket says 172.21.15.32:57806) 2024-03-19T06:21:49.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba1600640 1 -- 172.21.15.32:0/2319679046 learned_addr learned my addr 172.21.15.32:0/2319679046 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:49.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4b9be00640 1 --2- 172.21.15.32:0/2319679046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b9c0aea70 0x7f4b9c15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba0c00640 1 --2- 172.21.15.32:0/2319679046 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b9c06b280 0x7f4b9c0acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba1600640 1 -- 172.21.15.32:0/2319679046 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b9c06b280 msgr2=0x7f4b9c0acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba1600640 1 --2- 172.21.15.32:0/2319679046 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b9c06b280 0x7f4b9c0acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba1600640 1 -- 172.21.15.32:0/2319679046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b9c0aea70 msgr2=0x7f4b9c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba1600640 1 --2- 172.21.15.32:0/2319679046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b9c0aea70 0x7f4b9c15b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba1600640 1 -- 172.21.15.32:0/2319679046 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c157ea0 con 0x7f4b9c15a840 2024-03-19T06:21:49.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4b9be00640 1 --2- 172.21.15.32:0/2319679046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b9c0aea70 0x7f4b9c15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:49.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4ba1600640 1 --2- 172.21.15.32:0/2319679046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b9c15a840 0x7f4b9c140e20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4b9401acc0 tx=0x7f4b940193b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:49.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4b98c00640 1 -- 172.21.15.32:0/2319679046 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b940ac040 con 0x7f4b9c15a840 2024-03-19T06:21:49.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.776+0000 7f4b98c00640 1 -- 172.21.15.32:0/2319679046 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b940bd650 con 0x7f4b9c15a840 2024-03-19T06:21:49.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.780+0000 7f4ba3600640 1 -- 172.21.15.32:0/2319679046 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9c15e350 con 0x7f4b9c15a840 2024-03-19T06:21:49.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.780+0000 7f4b98c00640 1 -- 172.21.15.32:0/2319679046 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94009510 con 0x7f4b9c15a840 2024-03-19T06:21:49.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.780+0000 7f4ba3600640 1 -- 172.21.15.32:0/2319679046 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9c15e910 con 0x7f4b9c15a840 2024-03-19T06:21:49.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.780+0000 7f4ba3600640 1 -- 172.21.15.32:0/2319679046 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9c0749e0 con 0x7f4b9c15a840 2024-03-19T06:21:49.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.780+0000 7f4b98c00640 1 -- 172.21.15.32:0/2319679046 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f4b940af070 con 0x7f4b9c15a840 2024-03-19T06:21:49.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.780+0000 7f4b98c00640 1 --2- 172.21.15.32:0/2319679046 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4b7c0676b0 0x7f4b7c069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:49.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.780+0000 7f4b98c00640 1 -- 172.21.15.32:0/2319679046 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b941202b0 con 0x7f4b9c15a840 2024-03-19T06:21:49.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.780+0000 7f4ba0c00640 1 --2- 172.21.15.32:0/2319679046 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4b7c0676b0 0x7f4b7c069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:49.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.784+0000 7f4ba0c00640 1 --2- 172.21.15.32:0/2319679046 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4b7c0676b0 0x7f4b7c069b70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000b930 tx=0x7f4b90008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:49.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.784+0000 7f4b98c00640 1 -- 172.21.15.32:0/2319679046 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f4b940165e0 con 0x7f4b9c15a840 2024-03-19T06:21:49.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.944+0000 7f4ba3600640 1 -- 172.21.15.32:0/2319679046 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b9c06e6c0 con 0x7f4b9c15a840 2024-03-19T06:21:49.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.944+0000 7f4b98c00640 1 -- 172.21.15.32:0/2319679046 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b940b0e90 con 0x7f4b9c15a840 2024-03-19T06:21:49.939 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:21:49.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.948+0000 7f4ba3600640 1 -- 172.21.15.32:0/2319679046 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4b7c0676b0 msgr2=0x7f4b7c069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.948+0000 7f4ba3600640 1 --2- 172.21.15.32:0/2319679046 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4b7c0676b0 0x7f4b7c069b70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000b930 tx=0x7f4b90008040 comp rx=0 tx=0).stop 2024-03-19T06:21:49.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.948+0000 7f4ba3600640 1 -- 172.21.15.32:0/2319679046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b9c15a840 msgr2=0x7f4b9c140e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:49.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.948+0000 7f4ba3600640 1 --2- 172.21.15.32:0/2319679046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b9c15a840 0x7f4b9c140e20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4b9401acc0 tx=0x7f4b940193b0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.948+0000 7f4ba3600640 1 -- 172.21.15.32:0/2319679046 shutdown_connections 2024-03-19T06:21:49.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.948+0000 7f4ba3600640 1 --2- 172.21.15.32:0/2319679046 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4b7c0676b0 0x7f4b7c069b70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.948+0000 7f4ba3600640 1 --2- 172.21.15.32:0/2319679046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b9c15a840 0x7f4b9c140e20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.948+0000 7f4ba3600640 1 --2- 172.21.15.32:0/2319679046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b9c0aea70 0x7f4b9c15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.948+0000 7f4ba3600640 1 --2- 172.21.15.32:0/2319679046 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b9c06b280 0x7f4b9c0acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:49.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.948+0000 7f4ba3600640 1 -- 172.21.15.32:0/2319679046 >> 172.21.15.32:0/2319679046 conn(0x7f4b9c0b1590 msgr2=0x7f4b9c0b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:49.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.948+0000 7f4ba3600640 1 -- 172.21.15.32:0/2319679046 shutdown_connections 2024-03-19T06:21:49.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:49.948+0000 7f4ba3600640 1 -- 172.21.15.32:0/2319679046 wait complete. 2024-03-19T06:21:49.960 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:21:50.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.112+0000 7fb9ba000640 1 Processor -- start 2024-03-19T06:21:50.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.112+0000 7fb9ba000640 1 -- start start 2024-03-19T06:21:50.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.112+0000 7fb9ba000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9b40b2d70 0x7fb9b40cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:50.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.112+0000 7fb9ba000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb9b40cfc20 0x7fb9b415f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:50.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.112+0000 7fb9ba000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b415be10 con 0x7fb9b415ba30 2024-03-19T06:21:50.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.112+0000 7fb9ba000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b406b710 con 0x7fb9b40cfc20 2024-03-19T06:21:50.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.112+0000 7fb9ba000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b415cdd0 con 0x7fb9b40b2d70 2024-03-19T06:21:50.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.112+0000 7fb9b3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb9b40cfc20 0x7fb9b415f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:50.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.112+0000 7fb9b3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb9b40cfc20 0x7fb9b415f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57814/0 (socket says 172.21.15.32:57814) 2024-03-19T06:21:50.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.112+0000 7fb9b3e00640 1 -- 172.21.15.32:0/3490436969 learned_addr learned my addr 172.21.15.32:0/3490436969 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:50.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.112+0000 7fb9b2a00640 1 --2- 172.21.15.32:0/3490436969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9b40b2d70 0x7fb9b40cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:50.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.112+0000 7fb9b3e00640 1 -- 172.21.15.32:0/3490436969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9b40b2d70 msgr2=0x7fb9b40cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:50.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.112+0000 7fb9b3e00640 1 --2- 172.21.15.32:0/3490436969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9b40b2d70 0x7fb9b40cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.112+0000 7fb9b3e00640 1 -- 172.21.15.32:0/3490436969 >> v1:172.21.15.171:6789/0 conn(0x7fb9b415ba30 legacy=0x7fb9b40cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:50.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.112+0000 7fb9b3e00640 1 -- 172.21.15.32:0/3490436969 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b406ade0 con 0x7fb9b40cfc20 2024-03-19T06:21:50.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.116+0000 7fb9b3e00640 1 --2- 172.21.15.32:0/3490436969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b40cfc20 0x7fb9b415f5b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009e50 tx=0x7fb9ac01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7c43a6908b19c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:50.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.116+0000 7fb9b2000640 1 -- 172.21.15.32:0/3490436969 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac0a58d0 con 0x7fb9b40cfc20 2024-03-19T06:21:50.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.116+0000 7fb9b2000640 1 -- 172.21.15.32:0/3490436969 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac0a5a70 con 0x7fb9b40cfc20 2024-03-19T06:21:50.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.116+0000 7fb9b2000640 1 -- 172.21.15.32:0/3490436969 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac0a5e40 con 0x7fb9b40cfc20 2024-03-19T06:21:50.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.116+0000 7fb9ba000640 1 -- 172.21.15.32:0/3490436969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b40cfc20 msgr2=0x7fb9b415f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:50.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.116+0000 7fb9ba000640 1 --2- 172.21.15.32:0/3490436969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b40cfc20 0x7fb9b415f5b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009e50 tx=0x7fb9ac01ca00 comp rx=0 tx=0).stop 2024-03-19T06:21:50.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.116+0000 7fb9ba000640 1 -- 172.21.15.32:0/3490436969 shutdown_connections 2024-03-19T06:21:50.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.116+0000 7fb9ba000640 1 --2- 172.21.15.32:0/3490436969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b40cfc20 0x7fb9b415f5b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.116+0000 7fb9ba000640 1 --2- 172.21.15.32:0/3490436969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9b40b2d70 0x7fb9b40cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.116+0000 7fb9ba000640 1 -- 172.21.15.32:0/3490436969 >> 172.21.15.32:0/3490436969 conn(0x7fb9b40b2250 msgr2=0x7fb9b40b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:50.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.116+0000 7fb9ba000640 1 -- 172.21.15.32:0/3490436969 shutdown_connections 2024-03-19T06:21:50.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.116+0000 7fb9ba000640 1 -- 172.21.15.32:0/3490436969 wait complete. 2024-03-19T06:21:50.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.116+0000 7fb9ba000640 1 Processor -- start 2024-03-19T06:21:50.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.116+0000 7fb9ba000640 1 -- start start 2024-03-19T06:21:50.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9ba000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9b40b2d70 0x7fb9b40b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:50.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9ba000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9b40cfc20 0x7fb9b414ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:50.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9ba000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b415ba30 0x7fb9b415a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:50.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9ba000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b415cb20 con 0x7fb9b415ba30 2024-03-19T06:21:50.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9ba000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b415c9a0 con 0x7fb9b40b2d70 2024-03-19T06:21:50.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9ba000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b40d0040 con 0x7fb9b40cfc20 2024-03-19T06:21:50.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9b3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b415ba30 0x7fb9b415a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:50.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9b3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b415ba30 0x7fb9b415a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57822/0 (socket says 172.21.15.32:57822) 2024-03-19T06:21:50.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9b3e00640 1 -- 172.21.15.32:0/14274288 learned_addr learned my addr 172.21.15.32:0/14274288 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:50.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9b3400640 1 --2- 172.21.15.32:0/14274288 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9b40b2d70 0x7fb9b40b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:50.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9b2a00640 1 --2- 172.21.15.32:0/14274288 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9b40cfc20 0x7fb9b414ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:50.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9b3e00640 1 -- 172.21.15.32:0/14274288 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9b40cfc20 msgr2=0x7fb9b414ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:50.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9b3e00640 1 --2- 172.21.15.32:0/14274288 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9b40cfc20 0x7fb9b414ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9b3e00640 1 -- 172.21.15.32:0/14274288 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9b40b2d70 msgr2=0x7fb9b40b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:50.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9b3e00640 1 --2- 172.21.15.32:0/14274288 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9b40b2d70 0x7fb9b40b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9b3e00640 1 -- 172.21.15.32:0/14274288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b40c41e0 con 0x7fb9b415ba30 2024-03-19T06:21:50.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9b3e00640 1 --2- 172.21.15.32:0/14274288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b415ba30 0x7fb9b415a690 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009e50 tx=0x7fb9ac0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:50.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9ab400640 1 -- 172.21.15.32:0/14274288 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac0bc020 con 0x7fb9b415ba30 2024-03-19T06:21:50.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9ab400640 1 -- 172.21.15.32:0/14274288 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac0b8470 con 0x7fb9b415ba30 2024-03-19T06:21:50.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9ab400640 1 -- 172.21.15.32:0/14274288 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac0a58d0 con 0x7fb9b415ba30 2024-03-19T06:21:50.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9ba000640 1 -- 172.21.15.32:0/14274288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b40c44c0 con 0x7fb9b415ba30 2024-03-19T06:21:50.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9ba000640 1 -- 172.21.15.32:0/14274288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b40c4a80 con 0x7fb9b415ba30 2024-03-19T06:21:50.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.120+0000 7fb9ba000640 1 -- 172.21.15.32:0/14274288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b40749e0 con 0x7fb9b415ba30 2024-03-19T06:21:50.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.124+0000 7fb9ab400640 1 -- 172.21.15.32:0/14274288 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb9ac0bf020 con 0x7fb9b415ba30 2024-03-19T06:21:50.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.124+0000 7fb9ab400640 1 --2- 172.21.15.32:0/14274288 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb994067660 0x7fb994069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:50.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.124+0000 7fb9ab400640 1 -- 172.21.15.32:0/14274288 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9ac120f00 con 0x7fb9b415ba30 2024-03-19T06:21:50.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.124+0000 7fb9b3400640 1 --2- 172.21.15.32:0/14274288 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb994067660 0x7fb994069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:50.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.124+0000 7fb9b3400640 1 --2- 172.21.15.32:0/14274288 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb994067660 0x7fb994069b20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4001650 tx=0x7fb9a4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:50.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.132+0000 7fb9ab400640 1 -- 172.21.15.32:0/14274288 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fb9ac0c6030 con 0x7fb9b415ba30 2024-03-19T06:21:50.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.312+0000 7fb9ba000640 1 -- 172.21.15.32:0/14274288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb9b40b66a0 con 0x7fb9b415ba30 2024-03-19T06:21:50.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.312+0000 7fb9ab400640 1 -- 172.21.15.32:0/14274288 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb9ac016620 con 0x7fb9b415ba30 2024-03-19T06:21:50.305 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:21:50.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.312+0000 7fb9ba000640 1 -- 172.21.15.32:0/14274288 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb994067660 msgr2=0x7fb994069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:50.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.312+0000 7fb9ba000640 1 --2- 172.21.15.32:0/14274288 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb994067660 0x7fb994069b20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4001650 tx=0x7fb9a4009040 comp rx=0 tx=0).stop 2024-03-19T06:21:50.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.312+0000 7fb9ba000640 1 -- 172.21.15.32:0/14274288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b415ba30 msgr2=0x7fb9b415a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:50.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.312+0000 7fb9ba000640 1 --2- 172.21.15.32:0/14274288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b415ba30 0x7fb9b415a690 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009e50 tx=0x7fb9ac0197a0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.316+0000 7fb9ba000640 1 -- 172.21.15.32:0/14274288 shutdown_connections 2024-03-19T06:21:50.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.316+0000 7fb9ba000640 1 --2- 172.21.15.32:0/14274288 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb994067660 0x7fb994069b20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.316+0000 7fb9ba000640 1 --2- 172.21.15.32:0/14274288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9b415ba30 0x7fb9b415a690 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.316+0000 7fb9ba000640 1 --2- 172.21.15.32:0/14274288 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9b40cfc20 0x7fb9b414ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.316+0000 7fb9ba000640 1 --2- 172.21.15.32:0/14274288 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9b40b2d70 0x7fb9b40b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.316+0000 7fb9ba000640 1 -- 172.21.15.32:0/14274288 >> 172.21.15.32:0/14274288 conn(0x7fb9b40b2250 msgr2=0x7fb9b4166180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:50.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.316+0000 7fb9ba000640 1 -- 172.21.15.32:0/14274288 shutdown_connections 2024-03-19T06:21:50.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.316+0000 7fb9ba000640 1 -- 172.21.15.32:0/14274288 wait complete. 2024-03-19T06:21:50.325 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi171.front.sepia.ceph.com... 2024-03-19T06:21:50.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:50.326 DEBUG:teuthology.orchestra.run.smithi171:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-03-19T06:21:50.354 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:21:50.354 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:21:50.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:50.354 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-19T06:21:50.418 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:21:50.418 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:21:50.427 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:21:50.427 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:21:50.479 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:50.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.676+0000 7f8118200640 1 Processor -- start 2024-03-19T06:21:50.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.676+0000 7f8118200640 1 -- start start 2024-03-19T06:21:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.680+0000 7f8118200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f81100cc2e0 0x7f81100ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.680+0000 7f8118200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81100d0180 0x7f81100cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.680+0000 7f8118200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811006ad40 con 0x7f8110161270 2024-03-19T06:21:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.680+0000 7f8118200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811006b020 con 0x7f81100cc2e0 2024-03-19T06:21:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.680+0000 7f8118200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811006b300 con 0x7f81100d0180 2024-03-19T06:21:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.680+0000 7f8114e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f81100cc2e0 0x7f81100ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.680+0000 7f8114e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f81100cc2e0 0x7f81100ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57838/0 (socket says 172.21.15.32:57838) 2024-03-19T06:21:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.680+0000 7f8114e00640 1 -- 172.21.15.32:0/1209831118 learned_addr learned my addr 172.21.15.32:0/1209831118 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.680+0000 7f8116200640 1 --2- 172.21.15.32:0/1209831118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81100d0180 0x7f81100cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.680+0000 7f8114e00640 1 -- 172.21.15.32:0/1209831118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81100d0180 msgr2=0x7f81100cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.680+0000 7f8114e00640 1 --2- 172.21.15.32:0/1209831118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81100d0180 0x7f81100cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.680+0000 7f8114e00640 1 -- 172.21.15.32:0/1209831118 >> v1:172.21.15.171:6789/0 conn(0x7f8110161270 legacy=0x7f81100cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:50.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.680+0000 7f8114e00640 1 -- 172.21.15.32:0/1209831118 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811006b5e0 con 0x7f81100cc2e0 2024-03-19T06:21:50.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.680+0000 7f8116200640 1 --2- 172.21.15.32:0/1209831118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81100d0180 0x7f81100cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:50.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.680+0000 7f8114e00640 1 --2- 172.21.15.32:0/1209831118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81100cc2e0 0x7f81100ce290 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009870 tx=0x7f80fc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd83e0c20425b1c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.680+0000 7f810fe00640 1 -- 172.21.15.32:0/1209831118 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0ab5f0 con 0x7f81100cc2e0 2024-03-19T06:21:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f810fe00640 1 -- 172.21.15.32:0/1209831118 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc0b0070 con 0x7f81100cc2e0 2024-03-19T06:21:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f810fe00640 1 -- 172.21.15.32:0/1209831118 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0ab9b0 con 0x7f81100cc2e0 2024-03-19T06:21:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8118200640 1 -- 172.21.15.32:0/1209831118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81100cc2e0 msgr2=0x7f81100ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8118200640 1 --2- 172.21.15.32:0/1209831118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81100cc2e0 0x7f81100ce290 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009870 tx=0x7f80fc01c520 comp rx=0 tx=0).stop 2024-03-19T06:21:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8118200640 1 -- 172.21.15.32:0/1209831118 shutdown_connections 2024-03-19T06:21:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8118200640 1 --2- 172.21.15.32:0/1209831118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81100d0180 0x7f81100cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8118200640 1 --2- 172.21.15.32:0/1209831118 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81100cc2e0 0x7f81100ce290 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8118200640 1 -- 172.21.15.32:0/1209831118 >> 172.21.15.32:0/1209831118 conn(0x7f81100b2250 msgr2=0x7f81100b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:50.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8118200640 1 -- 172.21.15.32:0/1209831118 shutdown_connections 2024-03-19T06:21:50.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8118200640 1 -- 172.21.15.32:0/1209831118 wait complete. 2024-03-19T06:21:50.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8118200640 1 Processor -- start 2024-03-19T06:21:50.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8118200640 1 -- start start 2024-03-19T06:21:50.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8118200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81100cc2e0 0x7f811015d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:50.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8118200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81100d0180 0x7f81101fa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:50.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8118200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8110161270 0x7f81100b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8118200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100cda70 con 0x7f81100d0180 2024-03-19T06:21:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8118200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100cd8f0 con 0x7f81100cc2e0 2024-03-19T06:21:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8118200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81100cdbf0 con 0x7f8110161270 2024-03-19T06:21:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8114e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81100d0180 0x7f81101fa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8114e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81100d0180 0x7f81101fa280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57850/0 (socket says 172.21.15.32:57850) 2024-03-19T06:21:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8114e00640 1 -- 172.21.15.32:0/3883294536 learned_addr learned my addr 172.21.15.32:0/3883294536 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8116200640 1 --2- 172.21.15.32:0/3883294536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8110161270 0x7f81100b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8115800640 1 --2- 172.21.15.32:0/3883294536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81100cc2e0 0x7f811015d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8114e00640 1 -- 172.21.15.32:0/3883294536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8110161270 msgr2=0x7f81100b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8114e00640 1 --2- 172.21.15.32:0/3883294536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8110161270 0x7f81100b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8114e00640 1 -- 172.21.15.32:0/3883294536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81100cc2e0 msgr2=0x7f811015d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8114e00640 1 --2- 172.21.15.32:0/3883294536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81100cc2e0 0x7f811015d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8114e00640 1 -- 172.21.15.32:0/3883294536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8110066fe0 con 0x7f81100d0180 2024-03-19T06:21:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.684+0000 7f8116200640 1 --2- 172.21.15.32:0/3883294536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8110161270 0x7f81100b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.688+0000 7f8114e00640 1 --2- 172.21.15.32:0/3883294536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81100d0180 0x7f81101fa280 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0ad040 tx=0x7f80fc01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:50.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.688+0000 7f810d600640 1 -- 172.21.15.32:0/3883294536 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0be5f0 con 0x7f81100d0180 2024-03-19T06:21:50.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.688+0000 7f810d600640 1 -- 172.21.15.32:0/3883294536 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc0be7b0 con 0x7f81100d0180 2024-03-19T06:21:50.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.688+0000 7f8118200640 1 -- 172.21.15.32:0/3883294536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81101fac60 con 0x7f81100d0180 2024-03-19T06:21:50.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.688+0000 7f810d600640 1 -- 172.21.15.32:0/3883294536 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0beba0 con 0x7f81100d0180 2024-03-19T06:21:50.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.688+0000 7f8118200640 1 -- 172.21.15.32:0/3883294536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81100c4b30 con 0x7f81100d0180 2024-03-19T06:21:50.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.688+0000 7f8118200640 1 -- 172.21.15.32:0/3883294536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81101fb180 con 0x7f81100d0180 2024-03-19T06:21:50.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.688+0000 7f810d600640 1 -- 172.21.15.32:0/3883294536 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f80fc0b43f0 con 0x7f81100d0180 2024-03-19T06:21:50.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.688+0000 7f810d600640 1 --2- 172.21.15.32:0/3883294536 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f80f0067660 0x7f80f0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:50.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.688+0000 7f810d600640 1 -- 172.21.15.32:0/3883294536 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f80fc120580 con 0x7f81100d0180 2024-03-19T06:21:50.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.688+0000 7f8115800640 1 --2- 172.21.15.32:0/3883294536 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f80f0067660 0x7f80f0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:50.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.692+0000 7f8115800640 1 --2- 172.21.15.32:0/3883294536 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f80f0067660 0x7f80f0069b20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f811015e1c0 tx=0x7f8104008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:50.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.692+0000 7f810d600640 1 -- 172.21.15.32:0/3883294536 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f81101fb180 con 0x7f81100d0180 2024-03-19T06:21:50.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.860+0000 7f8118200640 1 -- 172.21.15.32:0/3883294536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81100749e0 con 0x7f81100d0180 2024-03-19T06:21:50.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.860+0000 7f810d600640 1 -- 172.21.15.32:0/3883294536 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f80fc0c4060 con 0x7f81100d0180 2024-03-19T06:21:50.853 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:50.853 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:50.564096+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:50.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.864+0000 7f8118200640 1 -- 172.21.15.32:0/3883294536 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f80f0067660 msgr2=0x7f80f0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:50.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.864+0000 7f8118200640 1 --2- 172.21.15.32:0/3883294536 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f80f0067660 0x7f80f0069b20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f811015e1c0 tx=0x7f8104008040 comp rx=0 tx=0).stop 2024-03-19T06:21:50.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.864+0000 7f8118200640 1 -- 172.21.15.32:0/3883294536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81100d0180 msgr2=0x7f81101fa280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:50.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.864+0000 7f8118200640 1 --2- 172.21.15.32:0/3883294536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81100d0180 0x7f81101fa280 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0ad040 tx=0x7f80fc01ad60 comp rx=0 tx=0).stop 2024-03-19T06:21:50.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.864+0000 7f8118200640 1 -- 172.21.15.32:0/3883294536 shutdown_connections 2024-03-19T06:21:50.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.864+0000 7f8118200640 1 --2- 172.21.15.32:0/3883294536 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f80f0067660 0x7f80f0069b20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.864+0000 7f8118200640 1 --2- 172.21.15.32:0/3883294536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8110161270 0x7f81100b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.864+0000 7f8118200640 1 --2- 172.21.15.32:0/3883294536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81100d0180 0x7f81101fa280 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.864+0000 7f8118200640 1 --2- 172.21.15.32:0/3883294536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81100cc2e0 0x7f811015d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:50.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.864+0000 7f8118200640 1 -- 172.21.15.32:0/3883294536 >> 172.21.15.32:0/3883294536 conn(0x7f81100b2250 msgr2=0x7f8110160130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:50.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.864+0000 7f8118200640 1 -- 172.21.15.32:0/3883294536 shutdown_connections 2024-03-19T06:21:50.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:50.864+0000 7f8118200640 1 -- 172.21.15.32:0/3883294536 wait complete. 2024-03-19T06:21:50.874 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:21:07.089673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:21:07.801319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:50.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:51.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba5c400640 1 Processor -- start 2024-03-19T06:21:51.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba5c400640 1 -- start start 2024-03-19T06:21:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba5c400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba540d0870 0x7fba540d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba5c400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba540ce920 con 0x7fba5415a8a0 2024-03-19T06:21:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba5c400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba540ae260 con 0x7fba540aed40 2024-03-19T06:21:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba5c400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba540707e0 con 0x7fba540d0870 2024-03-19T06:21:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba59a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fba5415a8a0 0x7fba540700d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33092/0 (socket says 172.21.15.32:33092) 2024-03-19T06:21:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba59a00640 1 -- 172.21.15.32:0/1705619794 learned_addr learned my addr 172.21.15.32:0/1705619794 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba59000640 1 --2- 172.21.15.32:0/1705619794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba540d0870 0x7fba540d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba53e00640 1 -- 172.21.15.32:0/1705619794 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933352388 0 0) 0x7fba540ce920 con 0x7fba5415a8a0 2024-03-19T06:21:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba53e00640 1 -- 172.21.15.32:0/1705619794 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba3c003530 con 0x7fba5415a8a0 2024-03-19T06:21:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba53e00640 1 -- 172.21.15.32:0/1705619794 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1507060201 0 0) 0x7fba3c003530 con 0x7fba5415a8a0 2024-03-19T06:21:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba53e00640 1 -- 172.21.15.32:0/1705619794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba540d0870 msgr2=0x7fba540d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba53e00640 1 --2- 172.21.15.32:0/1705619794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba540d0870 0x7fba540d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba53e00640 1 -- 172.21.15.32:0/1705619794 >> v1:172.21.15.171:6789/0 conn(0x7fba540aed40 legacy=0x7fba540af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba53e00640 1 -- 172.21.15.32:0/1705619794 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba540ae540 con 0x7fba5415a8a0 2024-03-19T06:21:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba53e00640 1 -- 172.21.15.32:0/1705619794 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fba48001680 con 0x7fba5415a8a0 2024-03-19T06:21:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba53e00640 1 -- 172.21.15.32:0/1705619794 >> v1:172.21.15.32:6789/0 conn(0x7fba5415a8a0 legacy=0x7fba540700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba53e00640 1 --2- 172.21.15.32:0/1705619794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba3c0039f0 0x7fba3c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba53e00640 1 --2- 172.21.15.32:0/1705619794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba540d0870 0x7fba3c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba53e00640 1 --2- 172.21.15.32:0/1705619794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba3c004d50 0x7fba3c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba53e00640 1 -- 172.21.15.32:0/1705619794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba540707e0 con 0x7fba3c004d50 2024-03-19T06:21:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba53e00640 1 -- 172.21.15.32:0/1705619794 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c00ba80 con 0x7fba3c0039f0 2024-03-19T06:21:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba53e00640 1 -- 172.21.15.32:0/1705619794 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c00de90 con 0x7fba540d0870 2024-03-19T06:21:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba5a400640 1 --2- 172.21.15.32:0/1705619794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba3c004d50 0x7fba3c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba59a00640 1 --2- 172.21.15.32:0/1705619794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba3c0039f0 0x7fba3c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba59000640 1 --2- 172.21.15.32:0/1705619794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba540d0870 0x7fba3c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba5a400640 1 -- 172.21.15.32:0/1705619794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba540d0870 msgr2=0x7fba3c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba5a400640 1 --2- 172.21.15.32:0/1705619794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba540d0870 0x7fba3c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba5a400640 1 -- 172.21.15.32:0/1705619794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba3c0039f0 msgr2=0x7fba3c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba5a400640 1 --2- 172.21.15.32:0/1705619794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba3c0039f0 0x7fba3c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.028+0000 7fba5a400640 1 -- 172.21.15.32:0/1705619794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c003530 con 0x7fba3c004d50 2024-03-19T06:21:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.032+0000 7fba5a400640 1 --2- 172.21.15.32:0/1705619794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba3c004d50 0x7fba3c0051d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fba4c001e40 tx=0x7fba4c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a28160df2e1e34e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:51.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.032+0000 7fba53e00640 1 -- 172.21.15.32:0/1705619794 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c001a90 con 0x7fba3c004d50 2024-03-19T06:21:51.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.032+0000 7fba53e00640 1 -- 172.21.15.32:0/1705619794 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c003b80 con 0x7fba3c004d50 2024-03-19T06:21:51.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.032+0000 7fba53e00640 1 -- 172.21.15.32:0/1705619794 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c005080 con 0x7fba3c004d50 2024-03-19T06:21:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.032+0000 7fba5c400640 1 -- 172.21.15.32:0/1705619794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba3c004d50 msgr2=0x7fba3c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.032+0000 7fba5c400640 1 --2- 172.21.15.32:0/1705619794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba3c004d50 0x7fba3c0051d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fba4c001e40 tx=0x7fba4c01c760 comp rx=0 tx=0).stop 2024-03-19T06:21:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.032+0000 7fba5a400640 1 -- 172.21.15.32:0/1705619794 reap_dead start 2024-03-19T06:21:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.032+0000 7fba5c400640 1 -- 172.21.15.32:0/1705619794 shutdown_connections 2024-03-19T06:21:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.032+0000 7fba5c400640 1 -- 172.21.15.32:0/1705619794 >> 172.21.15.32:0/1705619794 conn(0x7fba54099a70 msgr2=0x7fba54099e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.032+0000 7fba5c400640 1 -- 172.21.15.32:0/1705619794 shutdown_connections 2024-03-19T06:21:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.032+0000 7fba5c400640 1 -- 172.21.15.32:0/1705619794 wait complete. 2024-03-19T06:21:51.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba5c400640 1 Processor -- start 2024-03-19T06:21:51.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba5c400640 1 -- start start 2024-03-19T06:21:51.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba5c400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba3c004d50 0x7fba5414f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba5c400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba540c9d50 0x7fba54152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba5c400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba540ca1d0 0x7fba54153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba5c400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5415ae00 con 0x7fba3c004d50 2024-03-19T06:21:51.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba5c400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5415ac80 con 0x7fba540ca1d0 2024-03-19T06:21:51.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba5c400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba540ce4b0 con 0x7fba540c9d50 2024-03-19T06:21:51.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba59a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba3c004d50 0x7fba5414f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba59a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba3c004d50 0x7fba5414f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57860/0 (socket says 172.21.15.32:57860) 2024-03-19T06:21:51.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba59a00640 1 -- 172.21.15.32:0/2549381573 learned_addr learned my addr 172.21.15.32:0/2549381573 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:51.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba59000640 1 --2- 172.21.15.32:0/2549381573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba540c9d50 0x7fba54152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba5a400640 1 --2- 172.21.15.32:0/2549381573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba540ca1d0 0x7fba54153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba59a00640 1 -- 172.21.15.32:0/2549381573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba540c9d50 msgr2=0x7fba54152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba59a00640 1 --2- 172.21.15.32:0/2549381573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba540c9d50 0x7fba54152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba59a00640 1 -- 172.21.15.32:0/2549381573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba540ca1d0 msgr2=0x7fba54153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba59a00640 1 --2- 172.21.15.32:0/2549381573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba540ca1d0 0x7fba54153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba59a00640 1 -- 172.21.15.32:0/2549381573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba540ca7a0 con 0x7fba3c004d50 2024-03-19T06:21:51.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba5a400640 1 --2- 172.21.15.32:0/2549381573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba540ca1d0 0x7fba54153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:51.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba59000640 1 --2- 172.21.15.32:0/2549381573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba540c9d50 0x7fba54152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:51.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba59a00640 1 --2- 172.21.15.32:0/2549381573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba3c004d50 0x7fba5414f6e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fba480073a0 tx=0x7fba48007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:51.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba51600640 1 -- 172.21.15.32:0/2549381573 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4801a070 con 0x7fba3c004d50 2024-03-19T06:21:51.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba51600640 1 -- 172.21.15.32:0/2549381573 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4800f930 con 0x7fba3c004d50 2024-03-19T06:21:51.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba51600640 1 -- 172.21.15.32:0/2549381573 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4800fd20 con 0x7fba3c004d50 2024-03-19T06:21:51.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba5c400640 1 -- 172.21.15.32:0/2549381573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba540c69a0 con 0x7fba3c004d50 2024-03-19T06:21:51.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.036+0000 7fba5c400640 1 -- 172.21.15.32:0/2549381573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba540c6f60 con 0x7fba3c004d50 2024-03-19T06:21:51.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.040+0000 7fba5c400640 1 -- 172.21.15.32:0/2549381573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba540c7160 con 0x7fba3c004d50 2024-03-19T06:21:51.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.040+0000 7fba51600640 1 -- 172.21.15.32:0/2549381573 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fba4801d360 con 0x7fba3c004d50 2024-03-19T06:21:51.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.040+0000 7fba51600640 1 --2- 172.21.15.32:0/2549381573 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba34067660 0x7fba34069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.040+0000 7fba51600640 1 -- 172.21.15.32:0/2549381573 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fba48085300 con 0x7fba3c004d50 2024-03-19T06:21:51.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.040+0000 7fba59000640 1 --2- 172.21.15.32:0/2549381573 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba34067660 0x7fba34069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.040+0000 7fba59000640 1 --2- 172.21.15.32:0/2549381573 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba34067660 0x7fba34069b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fba540cdab0 tx=0x7fba40008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:51.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.044+0000 7fba51600640 1 -- 172.21.15.32:0/2549381573 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fba540c7160 con 0x7fba3c004d50 2024-03-19T06:21:51.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.208+0000 7fba5c400640 1 -- 172.21.15.32:0/2549381573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fba540749e0 con 0x7fba3c004d50 2024-03-19T06:21:51.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.208+0000 7fba51600640 1 -- 172.21.15.32:0/2549381573 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba48055fc0 con 0x7fba3c004d50 2024-03-19T06:21:51.200 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:51.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.208+0000 7fba5c400640 1 -- 172.21.15.32:0/2549381573 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba34067660 msgr2=0x7fba34069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.208+0000 7fba5c400640 1 --2- 172.21.15.32:0/2549381573 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba34067660 0x7fba34069b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fba540cdab0 tx=0x7fba40008040 comp rx=0 tx=0).stop 2024-03-19T06:21:51.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.208+0000 7fba5c400640 1 -- 172.21.15.32:0/2549381573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba3c004d50 msgr2=0x7fba5414f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.208+0000 7fba5c400640 1 --2- 172.21.15.32:0/2549381573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba3c004d50 0x7fba5414f6e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fba480073a0 tx=0x7fba48007860 comp rx=0 tx=0).stop 2024-03-19T06:21:51.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.208+0000 7fba5c400640 1 -- 172.21.15.32:0/2549381573 shutdown_connections 2024-03-19T06:21:51.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.208+0000 7fba5c400640 1 --2- 172.21.15.32:0/2549381573 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba34067660 0x7fba34069b20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.208+0000 7fba5c400640 1 --2- 172.21.15.32:0/2549381573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba540ca1d0 0x7fba54153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.208+0000 7fba5c400640 1 --2- 172.21.15.32:0/2549381573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba540c9d50 0x7fba54152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.208+0000 7fba5c400640 1 --2- 172.21.15.32:0/2549381573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba3c004d50 0x7fba5414f6e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.208+0000 7fba5c400640 1 -- 172.21.15.32:0/2549381573 >> 172.21.15.32:0/2549381573 conn(0x7fba54099a70 msgr2=0x7fba54099e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:51.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.208+0000 7fba5c400640 1 -- 172.21.15.32:0/2549381573 shutdown_connections 2024-03-19T06:21:51.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.208+0000 7fba5c400640 1 -- 172.21.15.32:0/2549381573 wait complete. 2024-03-19T06:21:51.222 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:21:51.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.372+0000 7f64b2000640 1 Processor -- start 2024-03-19T06:21:51.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.372+0000 7f64b2000640 1 -- start start 2024-03-19T06:21:51.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.372+0000 7f64b2000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f64ac071550 0x7f64ac071930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.372+0000 7f64b2000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ac0b3690 0x7f64ac150f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.372+0000 7f64b2000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac071e70 con 0x7f64ac150ad0 2024-03-19T06:21:51.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.372+0000 7f64b2000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ac1514a0 con 0x7f64ac071550 2024-03-19T06:21:51.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.372+0000 7f64b2000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0b3c00 con 0x7f64ac0b3690 2024-03-19T06:21:51.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.372+0000 7f64a3e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f64ac150ad0 0x7f64ac0b2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33104/0 (socket says 172.21.15.32:33104) 2024-03-19T06:21:51.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64a3e00640 1 -- 172.21.15.32:0/4001864865 learned_addr learned my addr 172.21.15.32:0/4001864865 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:51.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64ab400640 1 --2- 172.21.15.32:0/4001864865 >> v2:172.21.15.171:3300/0 conn(0x7f64ac071550 0x7f64ac071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64abe00640 1 --2- 172.21.15.32:0/4001864865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ac0b3690 0x7f64ac150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64aaa00640 1 -- 172.21.15.32:0/4001864865 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572117176 0 0) 0x7f64ac071e70 con 0x7f64ac150ad0 2024-03-19T06:21:51.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64aaa00640 1 -- 172.21.15.32:0/4001864865 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6490003530 con 0x7f64ac150ad0 2024-03-19T06:21:51.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64aaa00640 1 -- 172.21.15.32:0/4001864865 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2845380111 0 0) 0x7f6490003530 con 0x7f64ac150ad0 2024-03-19T06:21:51.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64aaa00640 1 -- 172.21.15.32:0/4001864865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ac0b3690 msgr2=0x7f64ac150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:51.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64aaa00640 1 --2- 172.21.15.32:0/4001864865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ac0b3690 0x7f64ac150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64aaa00640 1 -- 172.21.15.32:0/4001864865 >> v2:172.21.15.171:3300/0 conn(0x7f64ac071550 msgr2=0x7f64ac071930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:51.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64aaa00640 1 --2- 172.21.15.32:0/4001864865 >> v2:172.21.15.171:3300/0 conn(0x7f64ac071550 0x7f64ac071930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64aaa00640 1 -- 172.21.15.32:0/4001864865 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac0b3ee0 con 0x7f64ac150ad0 2024-03-19T06:21:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64aaa00640 1 -- 172.21.15.32:0/4001864865 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f6494001680 con 0x7f64ac150ad0 2024-03-19T06:21:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64ab400640 1 --2- 172.21.15.32:0/4001864865 >> v2:172.21.15.171:3300/0 conn(0x7f64ac071550 0x7f64ac071930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64abe00640 1 --2- 172.21.15.32:0/4001864865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ac0b3690 0x7f64ac150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64aaa00640 1 -- 172.21.15.32:0/4001864865 >> v1:172.21.15.32:6789/0 conn(0x7f64ac150ad0 legacy=0x7f64ac0b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64aaa00640 1 --2- 172.21.15.32:0/4001864865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64900039c0 0x7f6490003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64aaa00640 1 --2- 172.21.15.32:0/4001864865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6490004810 0x7f6490004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64aaa00640 1 --2- 172.21.15.32:0/4001864865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ac0b3690 0x7f64900051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64aaa00640 1 -- 172.21.15.32:0/4001864865 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac1514a0 con 0x7f6490004810 2024-03-19T06:21:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64aaa00640 1 -- 172.21.15.32:0/4001864865 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0b3c00 con 0x7f64900039c0 2024-03-19T06:21:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64aaa00640 1 -- 172.21.15.32:0/4001864865 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649000b9d0 con 0x7f64ac0b3690 2024-03-19T06:21:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64a3e00640 1 --2- 172.21.15.32:0/4001864865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6490004810 0x7f6490004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64ab400640 1 --2- 172.21.15.32:0/4001864865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64900039c0 0x7f6490003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64abe00640 1 --2- 172.21.15.32:0/4001864865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ac0b3690 0x7f64900051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64a3e00640 1 -- 172.21.15.32:0/4001864865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ac0b3690 msgr2=0x7f64900051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:51.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64a3e00640 1 --2- 172.21.15.32:0/4001864865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ac0b3690 0x7f64900051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64a3e00640 1 -- 172.21.15.32:0/4001864865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64900039c0 msgr2=0x7f6490003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:51.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64a3e00640 1 --2- 172.21.15.32:0/4001864865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64900039c0 0x7f6490003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.376+0000 7f64a3e00640 1 -- 172.21.15.32:0/4001864865 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6490003530 con 0x7f6490004810 2024-03-19T06:21:51.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.380+0000 7f64a3e00640 1 --2- 172.21.15.32:0/4001864865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6490004810 0x7f6490004c90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f649400c240 tx=0x7f649401f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3270ebb45e7e68 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:51.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.380+0000 7f64aaa00640 1 -- 172.21.15.32:0/4001864865 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494007d40 con 0x7f6490004810 2024-03-19T06:21:51.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.380+0000 7f64aaa00640 1 -- 172.21.15.32:0/4001864865 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6494005b00 con 0x7f6490004810 2024-03-19T06:21:51.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.380+0000 7f64aaa00640 1 -- 172.21.15.32:0/4001864865 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494007070 con 0x7f6490004810 2024-03-19T06:21:51.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.380+0000 7f64b2000640 1 -- 172.21.15.32:0/4001864865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6490004810 msgr2=0x7f6490004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.380+0000 7f64b2000640 1 --2- 172.21.15.32:0/4001864865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6490004810 0x7f6490004c90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f649400c240 tx=0x7f649401f410 comp rx=0 tx=0).stop 2024-03-19T06:21:51.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.380+0000 7f64abe00640 1 -- 172.21.15.32:0/4001864865 reap_dead start 2024-03-19T06:21:51.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.380+0000 7f64b2000640 1 -- 172.21.15.32:0/4001864865 shutdown_connections 2024-03-19T06:21:51.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.380+0000 7f64b2000640 1 -- 172.21.15.32:0/4001864865 >> 172.21.15.32:0/4001864865 conn(0x7f64ac0b1590 msgr2=0x7f64ac0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:51.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.380+0000 7f64b2000640 1 -- 172.21.15.32:0/4001864865 shutdown_connections 2024-03-19T06:21:51.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.380+0000 7f64b2000640 1 -- 172.21.15.32:0/4001864865 wait complete. 2024-03-19T06:21:51.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.380+0000 7f64b2000640 1 Processor -- start 2024-03-19T06:21:51.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.380+0000 7f64b2000640 1 -- start start 2024-03-19T06:21:51.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.380+0000 7f64b2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6490004810 0x7f64ac14a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64b2000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ac0cf630 0x7f64ac1473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64b2000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64ac156c70 0x7f64ac154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64b2000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac150f60 con 0x7f6490004810 2024-03-19T06:21:51.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64b2000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0b44a0 con 0x7f64ac156c70 2024-03-19T06:21:51.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64b2000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac1510e0 con 0x7f64ac0cf630 2024-03-19T06:21:51.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64ab400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6490004810 0x7f64ac14a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64ab400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6490004810 0x7f64ac14a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57878/0 (socket says 172.21.15.32:57878) 2024-03-19T06:21:51.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64ab400640 1 -- 172.21.15.32:0/3028104198 learned_addr learned my addr 172.21.15.32:0/3028104198 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:51.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64abe00640 1 --2- 172.21.15.32:0/3028104198 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64ac156c70 0x7f64ac154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64a3e00640 1 --2- 172.21.15.32:0/3028104198 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ac0cf630 0x7f64ac1473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64ab400640 1 -- 172.21.15.32:0/3028104198 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ac0cf630 msgr2=0x7f64ac1473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64ab400640 1 --2- 172.21.15.32:0/3028104198 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ac0cf630 0x7f64ac1473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64ab400640 1 -- 172.21.15.32:0/3028104198 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64ac156c70 msgr2=0x7f64ac154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64ab400640 1 --2- 172.21.15.32:0/3028104198 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64ac156c70 0x7f64ac154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64ab400640 1 -- 172.21.15.32:0/3028104198 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac0cd020 con 0x7f6490004810 2024-03-19T06:21:51.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64a3e00640 1 --2- 172.21.15.32:0/3028104198 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ac0cf630 0x7f64ac1473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:51.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64ab400640 1 --2- 172.21.15.32:0/3028104198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6490004810 0x7f64ac14a290 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f649c0119d0 tx=0x7f649c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:51.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64a3400640 1 -- 172.21.15.32:0/3028104198 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649c00b040 con 0x7f6490004810 2024-03-19T06:21:51.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64a3400640 1 -- 172.21.15.32:0/3028104198 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649c00fe50 con 0x7f6490004810 2024-03-19T06:21:51.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64a3400640 1 -- 172.21.15.32:0/3028104198 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649c004260 con 0x7f6490004810 2024-03-19T06:21:51.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64b2000640 1 -- 172.21.15.32:0/3028104198 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac1478e0 con 0x7f6490004810 2024-03-19T06:21:51.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64b2000640 1 -- 172.21.15.32:0/3028104198 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac0cd2c0 con 0x7f6490004810 2024-03-19T06:21:51.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64b2000640 1 -- 172.21.15.32:0/3028104198 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ac0749e0 con 0x7f6490004810 2024-03-19T06:21:51.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.384+0000 7f64a3400640 1 -- 172.21.15.32:0/3028104198 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f649c003620 con 0x7f6490004810 2024-03-19T06:21:51.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.388+0000 7f64a3400640 1 --2- 172.21.15.32:0/3028104198 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6488067690 0x7f6488069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.388+0000 7f64a3400640 1 -- 172.21.15.32:0/3028104198 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f649c086270 con 0x7f6490004810 2024-03-19T06:21:51.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.388+0000 7f64a3e00640 1 --2- 172.21.15.32:0/3028104198 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6488067690 0x7f6488069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.388+0000 7f64a3e00640 1 --2- 172.21.15.32:0/3028104198 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6488067690 0x7f6488069b50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f64940ae000 tx=0x7f64ac15a5c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:51.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.392+0000 7f64a3400640 1 -- 172.21.15.32:0/3028104198 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f649c056e70 con 0x7f6490004810 2024-03-19T06:21:51.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.552+0000 7f64b2000640 1 -- 172.21.15.32:0/3028104198 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64ac0722a0 con 0x7f6490004810 2024-03-19T06:21:51.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.552+0000 7f64a3400640 1 -- 172.21.15.32:0/3028104198 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f649c056770 con 0x7f6490004810 2024-03-19T06:21:51.546 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:21:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.556+0000 7f64b2000640 1 -- 172.21.15.32:0/3028104198 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6488067690 msgr2=0x7f6488069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.556+0000 7f64b2000640 1 --2- 172.21.15.32:0/3028104198 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6488067690 0x7f6488069b50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f64940ae000 tx=0x7f64ac15a5c0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.556+0000 7f64b2000640 1 -- 172.21.15.32:0/3028104198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6490004810 msgr2=0x7f64ac14a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.556+0000 7f64b2000640 1 --2- 172.21.15.32:0/3028104198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6490004810 0x7f64ac14a290 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f649c0119d0 tx=0x7f649c011e90 comp rx=0 tx=0).stop 2024-03-19T06:21:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.556+0000 7f64b2000640 1 -- 172.21.15.32:0/3028104198 shutdown_connections 2024-03-19T06:21:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.556+0000 7f64b2000640 1 --2- 172.21.15.32:0/3028104198 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6488067690 0x7f6488069b50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.556+0000 7f64b2000640 1 --2- 172.21.15.32:0/3028104198 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64ac156c70 0x7f64ac154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.556+0000 7f64b2000640 1 --2- 172.21.15.32:0/3028104198 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64ac0cf630 0x7f64ac1473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.556+0000 7f64b2000640 1 --2- 172.21.15.32:0/3028104198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6490004810 0x7f64ac14a290 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.556+0000 7f64b2000640 1 -- 172.21.15.32:0/3028104198 >> 172.21.15.32:0/3028104198 conn(0x7f64ac0b1590 msgr2=0x7f64ac0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:51.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.556+0000 7f64b2000640 1 -- 172.21.15.32:0/3028104198 shutdown_connections 2024-03-19T06:21:51.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.556+0000 7f64b2000640 1 -- 172.21.15.32:0/3028104198 wait complete. 2024-03-19T06:21:51.569 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:21:51.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b63600640 1 Processor -- start 2024-03-19T06:21:51.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b63600640 1 -- start start 2024-03-19T06:21:51.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b63600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8b5c15a840 0x7f8b5c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b63600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b5c0aea70 0x7f8b5c06ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b63600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8b5c06b280 0x7f8b5c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b63600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5c0cdc20 con 0x7f8b5c06b280 2024-03-19T06:21:51.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b63600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5c0af2d0 con 0x7f8b5c15a840 2024-03-19T06:21:51.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b63600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c15eea0 con 0x7f8b5c0aea70 2024-03-19T06:21:51.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b61600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8b5c06b280 0x7f8b5c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b61600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8b5c06b280 0x7f8b5c06d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57888/0 (socket says 172.21.15.32:57888) 2024-03-19T06:21:51.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b61600640 1 -- 172.21.15.32:0/938009575 learned_addr learned my addr 172.21.15.32:0/938009575 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:51.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b60c00640 1 --2- 172.21.15.32:0/938009575 >> v2:172.21.15.171:3300/0 conn(0x7f8b5c15a840 0x7f8b5c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b5be00640 1 --2- 172.21.15.32:0/938009575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b5c0aea70 0x7f8b5c06ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b61600640 1 -- 172.21.15.32:0/938009575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b5c0aea70 msgr2=0x7f8b5c06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:51.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b61600640 1 --2- 172.21.15.32:0/938009575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b5c0aea70 0x7f8b5c06ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b61600640 1 -- 172.21.15.32:0/938009575 >> v2:172.21.15.171:3300/0 conn(0x7f8b5c15a840 msgr2=0x7f8b5c06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:51.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b61600640 1 --2- 172.21.15.32:0/938009575 >> v2:172.21.15.171:3300/0 conn(0x7f8b5c15a840 0x7f8b5c06f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.720+0000 7f8b61600640 1 -- 172.21.15.32:0/938009575 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c15f180 con 0x7f8b5c06b280 2024-03-19T06:21:51.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.724+0000 7f8b61600640 1 --2- 172.21.15.32:0/938009575 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b5c06b280 0x7f8b5c06d5b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c06f6f0 tx=0x7f8b5401c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d63ed69c16362b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:51.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.724+0000 7f8b5b400640 1 -- 172.21.15.32:0/938009575 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b540ac070 con 0x7f8b5c06b280 2024-03-19T06:21:51.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.724+0000 7f8b5b400640 1 -- 172.21.15.32:0/938009575 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b540a8410 con 0x7f8b5c06b280 2024-03-19T06:21:51.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.724+0000 7f8b5b400640 1 -- 172.21.15.32:0/938009575 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b540a87e0 con 0x7f8b5c06b280 2024-03-19T06:21:51.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.724+0000 7f8b63600640 1 -- 172.21.15.32:0/938009575 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b5c06b280 msgr2=0x7f8b5c06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.724+0000 7f8b63600640 1 --2- 172.21.15.32:0/938009575 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b5c06b280 0x7f8b5c06d5b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c06f6f0 tx=0x7f8b5401c610 comp rx=0 tx=0).stop 2024-03-19T06:21:51.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.724+0000 7f8b63600640 1 -- 172.21.15.32:0/938009575 shutdown_connections 2024-03-19T06:21:51.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.724+0000 7f8b63600640 1 --2- 172.21.15.32:0/938009575 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b5c06b280 0x7f8b5c06d5b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.724+0000 7f8b63600640 1 --2- 172.21.15.32:0/938009575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b5c0aea70 0x7f8b5c06ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.724+0000 7f8b63600640 1 --2- 172.21.15.32:0/938009575 >> v2:172.21.15.171:3300/0 conn(0x7f8b5c15a840 0x7f8b5c06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.724+0000 7f8b63600640 1 -- 172.21.15.32:0/938009575 >> 172.21.15.32:0/938009575 conn(0x7f8b5c0b1590 msgr2=0x7f8b5c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:51.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.724+0000 7f8b63600640 1 -- 172.21.15.32:0/938009575 shutdown_connections 2024-03-19T06:21:51.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.724+0000 7f8b63600640 1 -- 172.21.15.32:0/938009575 wait complete. 2024-03-19T06:21:51.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b63600640 1 Processor -- start 2024-03-19T06:21:51.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b63600640 1 -- start start 2024-03-19T06:21:51.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b63600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b5c06b280 0x7f8b5c1f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b63600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b5c0aea70 0x7f8b5c14e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b63600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b5c15a840 0x7f8b5c153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b63600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0ce210 con 0x7f8b5c15a840 2024-03-19T06:21:51.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b63600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0ce090 con 0x7f8b5c06b280 2024-03-19T06:21:51.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b63600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0ce390 con 0x7f8b5c0aea70 2024-03-19T06:21:51.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b61600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b5c15a840 0x7f8b5c153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b61600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b5c15a840 0x7f8b5c153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57896/0 (socket says 172.21.15.32:57896) 2024-03-19T06:21:51.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b61600640 1 -- 172.21.15.32:0/1301953304 learned_addr learned my addr 172.21.15.32:0/1301953304 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:51.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b5be00640 1 --2- 172.21.15.32:0/1301953304 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b5c0aea70 0x7f8b5c14e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b60c00640 1 --2- 172.21.15.32:0/1301953304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b5c06b280 0x7f8b5c1f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b61600640 1 -- 172.21.15.32:0/1301953304 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b5c0aea70 msgr2=0x7f8b5c14e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b61600640 1 --2- 172.21.15.32:0/1301953304 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b5c0aea70 0x7f8b5c14e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b61600640 1 -- 172.21.15.32:0/1301953304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b5c06b280 msgr2=0x7f8b5c1f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b61600640 1 --2- 172.21.15.32:0/1301953304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b5c06b280 0x7f8b5c1f6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b61600640 1 -- 172.21.15.32:0/1301953304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c14eff0 con 0x7f8b5c15a840 2024-03-19T06:21:51.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b61600640 1 --2- 172.21.15.32:0/1301953304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b5c15a840 0x7f8b5c153910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8b5401ceb0 tx=0x7f8b540193b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:51.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b58c00640 1 -- 172.21.15.32:0/1301953304 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b540bf070 con 0x7f8b5c15a840 2024-03-19T06:21:51.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b58c00640 1 -- 172.21.15.32:0/1301953304 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b540090d0 con 0x7f8b5c15a840 2024-03-19T06:21:51.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b58c00640 1 -- 172.21.15.32:0/1301953304 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b540ac040 con 0x7f8b5c15a840 2024-03-19T06:21:51.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b63600640 1 -- 172.21.15.32:0/1301953304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5c14f2d0 con 0x7f8b5c15a840 2024-03-19T06:21:51.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.728+0000 7f8b63600640 1 -- 172.21.15.32:0/1301953304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5c14f890 con 0x7f8b5c15a840 2024-03-19T06:21:51.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.732+0000 7f8b63600640 1 -- 172.21.15.32:0/1301953304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5c0749e0 con 0x7f8b5c15a840 2024-03-19T06:21:51.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.732+0000 7f8b58c00640 1 -- 172.21.15.32:0/1301953304 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8b540c2070 con 0x7f8b5c15a840 2024-03-19T06:21:51.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.732+0000 7f8b58c00640 1 --2- 172.21.15.32:0/1301953304 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8b3c067660 0x7f8b3c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:51.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.732+0000 7f8b58c00640 1 -- 172.21.15.32:0/1301953304 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8b5411fbd0 con 0x7f8b5c15a840 2024-03-19T06:21:51.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.732+0000 7f8b60c00640 1 --2- 172.21.15.32:0/1301953304 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8b3c067660 0x7f8b3c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:51.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.732+0000 7f8b60c00640 1 --2- 172.21.15.32:0/1301953304 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8b3c067660 0x7f8b3c069b20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009ac0 tx=0x7f8b50009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:51.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.736+0000 7f8b58c00640 1 -- 172.21.15.32:0/1301953304 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f8b540165e0 con 0x7f8b5c15a840 2024-03-19T06:21:51.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.900+0000 7f8b63600640 1 -- 172.21.15.32:0/1301953304 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b5c164560 con 0x7f8b5c15a840 2024-03-19T06:21:51.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.900+0000 7f8b58c00640 1 -- 172.21.15.32:0/1301953304 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b540f0200 con 0x7f8b5c15a840 2024-03-19T06:21:51.894 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:21:51.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.904+0000 7f8b63600640 1 -- 172.21.15.32:0/1301953304 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8b3c067660 msgr2=0x7f8b3c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.904+0000 7f8b63600640 1 --2- 172.21.15.32:0/1301953304 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8b3c067660 0x7f8b3c069b20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009ac0 tx=0x7f8b50009190 comp rx=0 tx=0).stop 2024-03-19T06:21:51.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.904+0000 7f8b63600640 1 -- 172.21.15.32:0/1301953304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b5c15a840 msgr2=0x7f8b5c153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:51.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.904+0000 7f8b63600640 1 --2- 172.21.15.32:0/1301953304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b5c15a840 0x7f8b5c153910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8b5401ceb0 tx=0x7f8b540193b0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.904+0000 7f8b63600640 1 -- 172.21.15.32:0/1301953304 shutdown_connections 2024-03-19T06:21:51.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.904+0000 7f8b63600640 1 --2- 172.21.15.32:0/1301953304 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8b3c067660 0x7f8b3c069b20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.904+0000 7f8b63600640 1 --2- 172.21.15.32:0/1301953304 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b5c15a840 0x7f8b5c153910 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.904+0000 7f8b63600640 1 --2- 172.21.15.32:0/1301953304 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b5c0aea70 0x7f8b5c14e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.904+0000 7f8b63600640 1 --2- 172.21.15.32:0/1301953304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b5c06b280 0x7f8b5c1f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:51.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.904+0000 7f8b63600640 1 -- 172.21.15.32:0/1301953304 >> 172.21.15.32:0/1301953304 conn(0x7f8b5c0b1590 msgr2=0x7f8b5c164d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:51.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.904+0000 7f8b63600640 1 -- 172.21.15.32:0/1301953304 shutdown_connections 2024-03-19T06:21:51.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:51.904+0000 7f8b63600640 1 -- 172.21.15.32:0/1301953304 wait complete. 2024-03-19T06:21:51.915 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:21:52.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.064+0000 7f728da00640 1 Processor -- start 2024-03-19T06:21:52.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.064+0000 7f728da00640 1 -- start start 2024-03-19T06:21:52.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.068+0000 7f728da00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72880aecf0 0x7f72880ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.068+0000 7f728da00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728815fe20 con 0x7f728815c010 2024-03-19T06:21:52.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.068+0000 7f728da00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7288160100 con 0x7f728806d6c0 2024-03-19T06:21:52.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.068+0000 7f728da00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72881603e0 con 0x7f72880aecf0 2024-03-19T06:21:52.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.068+0000 7f727fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f728815c010 0x7f728815f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33114/0 (socket says 172.21.15.32:33114) 2024-03-19T06:21:52.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.068+0000 7f727fe00640 1 -- 172.21.15.32:0/2680638852 learned_addr learned my addr 172.21.15.32:0/2680638852 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:52.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.068+0000 7f7286a00640 1 --2- 172.21.15.32:0/2680638852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72880aecf0 0x7f72880ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.068+0000 7f7286000640 1 -- 172.21.15.32:0/2680638852 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138552374 0 0) 0x7f728815fe20 con 0x7f728815c010 2024-03-19T06:21:52.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.068+0000 7f7286000640 1 -- 172.21.15.32:0/2680638852 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f726c003530 con 0x7f728815c010 2024-03-19T06:21:52.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.068+0000 7f7286000640 1 -- 172.21.15.32:0/2680638852 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222167573 0 0) 0x7f7288160100 con 0x7f728806d6c0 2024-03-19T06:21:52.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.068+0000 7f7286000640 1 -- 172.21.15.32:0/2680638852 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f728815fe20 con 0x7f728806d6c0 2024-03-19T06:21:52.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.068+0000 7f7286a00640 1 -- 172.21.15.32:0/2680638852 >> v1:172.21.15.171:6789/0 conn(0x7f728806d6c0 legacy=0x7f72880cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.068+0000 7f7286a00640 1 -- 172.21.15.32:0/2680638852 >> v1:172.21.15.32:6789/0 conn(0x7f728815c010 legacy=0x7f728815f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.068+0000 7f7286a00640 1 -- 172.21.15.32:0/2680638852 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72880ca1f0 con 0x7f72880aecf0 2024-03-19T06:21:52.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f7286a00640 1 --2- 172.21.15.32:0/2680638852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72880aecf0 0x7f72880ca9f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7288160560 tx=0x7f727801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46891dea0df2b297 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:52.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f7286000640 1 -- 172.21.15.32:0/2680638852 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72780b0070 con 0x7f72880aecf0 2024-03-19T06:21:52.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f7286000640 1 -- 172.21.15.32:0/2680638852 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72780ab600 con 0x7f72880aecf0 2024-03-19T06:21:52.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f7286000640 1 -- 172.21.15.32:0/2680638852 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72780ab9d0 con 0x7f72880aecf0 2024-03-19T06:21:52.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f728da00640 1 -- 172.21.15.32:0/2680638852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72880aecf0 msgr2=0x7f72880ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f728da00640 1 --2- 172.21.15.32:0/2680638852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72880aecf0 0x7f72880ca9f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7288160560 tx=0x7f727801c430 comp rx=0 tx=0).stop 2024-03-19T06:21:52.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f728da00640 1 -- 172.21.15.32:0/2680638852 shutdown_connections 2024-03-19T06:21:52.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f728da00640 1 --2- 172.21.15.32:0/2680638852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72880aecf0 0x7f72880ca9f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f728da00640 1 -- 172.21.15.32:0/2680638852 >> 172.21.15.32:0/2680638852 conn(0x7f72880b1280 msgr2=0x7f72880b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:52.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f728da00640 1 -- 172.21.15.32:0/2680638852 shutdown_connections 2024-03-19T06:21:52.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f728da00640 1 -- 172.21.15.32:0/2680638852 wait complete. 2024-03-19T06:21:52.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f728da00640 1 Processor -- start 2024-03-19T06:21:52.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f728da00640 1 -- start start 2024-03-19T06:21:52.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f728da00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f728806d6c0 0x7f72880c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f728da00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72880aecf0 0x7f728814aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f728da00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f728815c010 0x7f72880cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f728da00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728816a030 con 0x7f72880aecf0 2024-03-19T06:21:52.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f728da00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7288169eb0 con 0x7f728806d6c0 2024-03-19T06:21:52.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f728da00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728816a1b0 con 0x7f728815c010 2024-03-19T06:21:52.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.072+0000 7f727fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72880aecf0 0x7f728814aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f727fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72880aecf0 0x7f728814aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57902/0 (socket says 172.21.15.32:57902) 2024-03-19T06:21:52.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f7286a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f728806d6c0 0x7f72880c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f727fe00640 1 -- 172.21.15.32:0/2453125229 learned_addr learned my addr 172.21.15.32:0/2453125229 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:52.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f7287400640 1 --2- 172.21.15.32:0/2453125229 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f728815c010 0x7f72880cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f727fe00640 1 -- 172.21.15.32:0/2453125229 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f728815c010 msgr2=0x7f72880cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f727fe00640 1 --2- 172.21.15.32:0/2453125229 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f728815c010 0x7f72880cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f727fe00640 1 -- 172.21.15.32:0/2453125229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f728806d6c0 msgr2=0x7f72880c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f727fe00640 1 --2- 172.21.15.32:0/2453125229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f728806d6c0 0x7f72880c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f727fe00640 1 -- 172.21.15.32:0/2453125229 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7288136d70 con 0x7f72880aecf0 2024-03-19T06:21:52.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f727fe00640 1 --2- 172.21.15.32:0/2453125229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72880aecf0 0x7f728814aff0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7270005890 tx=0x7f727000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:52.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f727ea00640 1 -- 172.21.15.32:0/2453125229 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270017070 con 0x7f72880aecf0 2024-03-19T06:21:52.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f727ea00640 1 -- 172.21.15.32:0/2453125229 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7270005cf0 con 0x7f72880aecf0 2024-03-19T06:21:52.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f727ea00640 1 -- 172.21.15.32:0/2453125229 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270007270 con 0x7f72880aecf0 2024-03-19T06:21:52.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f728da00640 1 -- 172.21.15.32:0/2453125229 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7288137050 con 0x7f72880aecf0 2024-03-19T06:21:52.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f728da00640 1 -- 172.21.15.32:0/2453125229 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7288137610 con 0x7f72880aecf0 2024-03-19T06:21:52.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f728da00640 1 -- 172.21.15.32:0/2453125229 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72880749e0 con 0x7f72880aecf0 2024-03-19T06:21:52.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f727ea00640 1 -- 172.21.15.32:0/2453125229 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f727001a070 con 0x7f72880aecf0 2024-03-19T06:21:52.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f727ea00640 1 --2- 172.21.15.32:0/2453125229 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7264067690 0x7f7264069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.076+0000 7f727ea00640 1 -- 172.21.15.32:0/2453125229 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7270084bd0 con 0x7f72880aecf0 2024-03-19T06:21:52.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.080+0000 7f7286a00640 1 --2- 172.21.15.32:0/2453125229 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7264067690 0x7f7264069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.080+0000 7f7286a00640 1 --2- 172.21.15.32:0/2453125229 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7264067690 0x7f7264069b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f72880cf450 tx=0x7f72780a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:52.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.080+0000 7f727ea00640 1 -- 172.21.15.32:0/2453125229 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f7270055170 con 0x7f72880aecf0 2024-03-19T06:21:52.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.256+0000 7f728da00640 1 -- 172.21.15.32:0/2453125229 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7288166ec0 con 0x7f72880aecf0 2024-03-19T06:21:52.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.256+0000 7f727ea00640 1 -- 172.21.15.32:0/2453125229 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7270059210 con 0x7f72880aecf0 2024-03-19T06:21:52.248 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:21:52.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.256+0000 7f728da00640 1 -- 172.21.15.32:0/2453125229 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7264067690 msgr2=0x7f7264069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.256+0000 7f728da00640 1 --2- 172.21.15.32:0/2453125229 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7264067690 0x7f7264069b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f72880cf450 tx=0x7f72780a6000 comp rx=0 tx=0).stop 2024-03-19T06:21:52.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.256+0000 7f728da00640 1 -- 172.21.15.32:0/2453125229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72880aecf0 msgr2=0x7f728814aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.256+0000 7f728da00640 1 --2- 172.21.15.32:0/2453125229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72880aecf0 0x7f728814aff0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7270005890 tx=0x7f727000c960 comp rx=0 tx=0).stop 2024-03-19T06:21:52.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.256+0000 7f728da00640 1 -- 172.21.15.32:0/2453125229 shutdown_connections 2024-03-19T06:21:52.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.256+0000 7f728da00640 1 --2- 172.21.15.32:0/2453125229 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7264067690 0x7f7264069b50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.256+0000 7f728da00640 1 --2- 172.21.15.32:0/2453125229 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f728815c010 0x7f72880cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.256+0000 7f728da00640 1 --2- 172.21.15.32:0/2453125229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72880aecf0 0x7f728814aff0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.256+0000 7f728da00640 1 --2- 172.21.15.32:0/2453125229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f728806d6c0 0x7f72880c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.256+0000 7f728da00640 1 -- 172.21.15.32:0/2453125229 >> 172.21.15.32:0/2453125229 conn(0x7f72880b1280 msgr2=0x7f72880c9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:52.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.256+0000 7f728da00640 1 -- 172.21.15.32:0/2453125229 shutdown_connections 2024-03-19T06:21:52.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.256+0000 7f728da00640 1 -- 172.21.15.32:0/2453125229 wait complete. 2024-03-19T06:21:52.270 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:21:52.270 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:21:52.279 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:52.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9f2a00640 1 Processor -- start 2024-03-19T06:21:52.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9f2a00640 1 -- start start 2024-03-19T06:21:52.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9f2a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc9ec0cdaa0 0x7fc9ec0cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9f2a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ec15bf00 con 0x7fc9ec09a480 2024-03-19T06:21:52.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9f2a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ec0cc5d0 con 0x7fc9ec15bb20 2024-03-19T06:21:52.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9f2a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ec0cc3a0 con 0x7fc9ec0cdaa0 2024-03-19T06:21:52.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9e3400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc9ec09a480 0x7fc9ec0cd390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33128/0 (socket says 172.21.15.32:33128) 2024-03-19T06:21:52.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9e3400640 1 -- 172.21.15.32:0/4115296450 learned_addr learned my addr 172.21.15.32:0/4115296450 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:52.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9f0a00640 1 --2- 172.21.15.32:0/4115296450 >> v2:172.21.15.171:3300/0 conn(0x7fc9ec0cdaa0 0x7fc9ec0cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9eb400640 1 -- 172.21.15.32:0/4115296450 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581947989 0 0) 0x7fc9ec15bf00 con 0x7fc9ec09a480 2024-03-19T06:21:52.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9eb400640 1 -- 172.21.15.32:0/4115296450 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9d0003530 con 0x7fc9ec09a480 2024-03-19T06:21:52.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9eb400640 1 -- 172.21.15.32:0/4115296450 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2023495701 0 0) 0x7fc9d0003530 con 0x7fc9ec09a480 2024-03-19T06:21:52.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9eb400640 1 -- 172.21.15.32:0/4115296450 >> v2:172.21.15.171:3300/0 conn(0x7fc9ec0cdaa0 msgr2=0x7fc9ec0cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:52.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9eb400640 1 --2- 172.21.15.32:0/4115296450 >> v2:172.21.15.171:3300/0 conn(0x7fc9ec0cdaa0 0x7fc9ec0cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9eb400640 1 -- 172.21.15.32:0/4115296450 >> v1:172.21.15.171:6789/0 conn(0x7fc9ec15bb20 legacy=0x7fc9ec0c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9eb400640 1 -- 172.21.15.32:0/4115296450 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec0cc8b0 con 0x7fc9ec09a480 2024-03-19T06:21:52.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9eb400640 1 -- 172.21.15.32:0/4115296450 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fc9d4001680 con 0x7fc9ec09a480 2024-03-19T06:21:52.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9eb400640 1 -- 172.21.15.32:0/4115296450 >> v1:172.21.15.32:6789/0 conn(0x7fc9ec09a480 legacy=0x7fc9ec0cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9eb400640 1 --2- 172.21.15.32:0/4115296450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9d00039c0 0x7fc9d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9eb400640 1 --2- 172.21.15.32:0/4115296450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9d0004810 0x7fc9d0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9eb400640 1 --2- 172.21.15.32:0/4115296450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d00051d0 0x7fc9d000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9eb400640 1 -- 172.21.15.32:0/4115296450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d000bff0 con 0x7fc9d0004810 2024-03-19T06:21:52.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9eb400640 1 -- 172.21.15.32:0/4115296450 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d000c1a0 con 0x7fc9d00039c0 2024-03-19T06:21:52.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9eb400640 1 -- 172.21.15.32:0/4115296450 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d000c3a0 con 0x7fc9d00051d0 2024-03-19T06:21:52.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9e3400640 1 --2- 172.21.15.32:0/4115296450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9d0004810 0x7fc9d0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9ebe00640 1 --2- 172.21.15.32:0/4115296450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9d00039c0 0x7fc9d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9f0a00640 1 --2- 172.21.15.32:0/4115296450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d00051d0 0x7fc9d000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9e3400640 1 -- 172.21.15.32:0/4115296450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d00051d0 msgr2=0x7fc9d000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:52.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9e3400640 1 --2- 172.21.15.32:0/4115296450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d00051d0 0x7fc9d000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9e3400640 1 -- 172.21.15.32:0/4115296450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9d00039c0 msgr2=0x7fc9d0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:52.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9e3400640 1 --2- 172.21.15.32:0/4115296450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9d00039c0 0x7fc9d0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9e3400640 1 -- 172.21.15.32:0/4115296450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d0003530 con 0x7fc9d0004810 2024-03-19T06:21:52.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.476+0000 7fc9f0a00640 1 --2- 172.21.15.32:0/4115296450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d00051d0 0x7fc9d000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:52.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.480+0000 7fc9f0a00640 1 -- 172.21.15.32:0/4115296450 reap_dead start 2024-03-19T06:21:52.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.480+0000 7fc9e3400640 1 --2- 172.21.15.32:0/4115296450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9d0004810 0x7fc9d0004c90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400c160 tx=0x7fc9d401cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2752bd60b4d3cb07 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:52.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.480+0000 7fc9eb400640 1 -- 172.21.15.32:0/4115296450 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4007c90 con 0x7fc9d0004810 2024-03-19T06:21:52.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.480+0000 7fc9eb400640 1 -- 172.21.15.32:0/4115296450 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d40a9070 con 0x7fc9d0004810 2024-03-19T06:21:52.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.480+0000 7fc9eb400640 1 -- 172.21.15.32:0/4115296450 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4005d80 con 0x7fc9d0004810 2024-03-19T06:21:52.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.480+0000 7fc9f2a00640 1 -- 172.21.15.32:0/4115296450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9d0004810 msgr2=0x7fc9d0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.480+0000 7fc9f2a00640 1 --2- 172.21.15.32:0/4115296450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9d0004810 0x7fc9d0004c90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400c160 tx=0x7fc9d401cb40 comp rx=0 tx=0).stop 2024-03-19T06:21:52.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.480+0000 7fc9f2a00640 1 -- 172.21.15.32:0/4115296450 shutdown_connections 2024-03-19T06:21:52.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.480+0000 7fc9f2a00640 1 --2- 172.21.15.32:0/4115296450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9d0004810 0x7fc9d0004c90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.480+0000 7fc9f2a00640 1 -- 172.21.15.32:0/4115296450 >> 172.21.15.32:0/4115296450 conn(0x7fc9ec0d1890 msgr2=0x7fc9ec0d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:52.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.480+0000 7fc9f2a00640 1 -- 172.21.15.32:0/4115296450 shutdown_connections 2024-03-19T06:21:52.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.480+0000 7fc9f2a00640 1 -- 172.21.15.32:0/4115296450 wait complete. 2024-03-19T06:21:52.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f2a00640 1 Processor -- start 2024-03-19T06:21:52.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f2a00640 1 -- start start 2024-03-19T06:21:52.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f2a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d0004810 0x7fc9ec152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f2a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9ec0cab30 0x7fc9ec0cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f2a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9ec1f3860 0x7fc9ec1f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f2a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0cce70 con 0x7fc9ec1f3860 2024-03-19T06:21:52.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f2a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0cfbb0 con 0x7fc9ec0cab30 2024-03-19T06:21:52.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f2a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0cf460 con 0x7fc9d0004810 2024-03-19T06:21:52.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f0a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9ec1f3860 0x7fc9ec1f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f0a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9ec1f3860 0x7fc9ec1f3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57930/0 (socket says 172.21.15.32:57930) 2024-03-19T06:21:52.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f0a00640 1 -- 172.21.15.32:0/3787109929 learned_addr learned my addr 172.21.15.32:0/3787109929 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:52.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9e3400640 1 --2- 172.21.15.32:0/3787109929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9ec0cab30 0x7fc9ec0cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9ebe00640 1 --2- 172.21.15.32:0/3787109929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d0004810 0x7fc9ec152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f0a00640 1 -- 172.21.15.32:0/3787109929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d0004810 msgr2=0x7fc9ec152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f0a00640 1 --2- 172.21.15.32:0/3787109929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d0004810 0x7fc9ec152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f0a00640 1 -- 172.21.15.32:0/3787109929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9ec0cab30 msgr2=0x7fc9ec0cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f0a00640 1 --2- 172.21.15.32:0/3787109929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9ec0cab30 0x7fc9ec0cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f0a00640 1 -- 172.21.15.32:0/3787109929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec09bed0 con 0x7fc9ec1f3860 2024-03-19T06:21:52.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f0a00640 1 --2- 172.21.15.32:0/3787109929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9ec1f3860 0x7fc9ec1f3ce0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec06e960 tx=0x7fc9e4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:52.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9e8c00640 1 -- 172.21.15.32:0/3787109929 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4010de0 con 0x7fc9ec1f3860 2024-03-19T06:21:52.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9e8c00640 1 -- 172.21.15.32:0/3787109929 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e40039a0 con 0x7fc9ec1f3860 2024-03-19T06:21:52.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f2a00640 1 -- 172.21.15.32:0/3787109929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ec09c1b0 con 0x7fc9ec1f3860 2024-03-19T06:21:52.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9e8c00640 1 -- 172.21.15.32:0/3787109929 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4003dd0 con 0x7fc9ec1f3860 2024-03-19T06:21:52.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.484+0000 7fc9f2a00640 1 -- 172.21.15.32:0/3787109929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ec09c770 con 0x7fc9ec1f3860 2024-03-19T06:21:52.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.488+0000 7fc9f2a00640 1 -- 172.21.15.32:0/3787109929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ec0b7810 con 0x7fc9ec1f3860 2024-03-19T06:21:52.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.488+0000 7fc9e8c00640 1 -- 172.21.15.32:0/3787109929 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc9e401e020 con 0x7fc9ec1f3860 2024-03-19T06:21:52.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.488+0000 7fc9e8c00640 1 --2- 172.21.15.32:0/3787109929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc9c8067690 0x7fc9c8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.488+0000 7fc9e8c00640 1 -- 172.21.15.32:0/3787109929 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc9e4085fb0 con 0x7fc9ec1f3860 2024-03-19T06:21:52.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.488+0000 7fc9ebe00640 1 --2- 172.21.15.32:0/3787109929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc9c8067690 0x7fc9c8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.492+0000 7fc9ebe00640 1 --2- 172.21.15.32:0/3787109929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc9c8067690 0x7fc9c8069b50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc007990 tx=0x7fc9dc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:52.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.492+0000 7fc9e8c00640 1 -- 172.21.15.32:0/3787109929 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fc9e4025020 con 0x7fc9ec1f3860 2024-03-19T06:21:52.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.656+0000 7fc9f2a00640 1 -- 172.21.15.32:0/3787109929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9ec0742f0 con 0x7fc9ec1f3860 2024-03-19T06:21:52.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.660+0000 7fc9e8c00640 1 -- 172.21.15.32:0/3787109929 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fc9e40564c0 con 0x7fc9ec1f3860 2024-03-19T06:21:52.651 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:52.652 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":24,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:51.568754+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:52.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.660+0000 7fc9f2a00640 1 -- 172.21.15.32:0/3787109929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc9c8067690 msgr2=0x7fc9c8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.660+0000 7fc9f2a00640 1 --2- 172.21.15.32:0/3787109929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc9c8067690 0x7fc9c8069b50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc007990 tx=0x7fc9dc009040 comp rx=0 tx=0).stop 2024-03-19T06:21:52.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.660+0000 7fc9f2a00640 1 -- 172.21.15.32:0/3787109929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9ec1f3860 msgr2=0x7fc9ec1f3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.660+0000 7fc9f2a00640 1 --2- 172.21.15.32:0/3787109929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9ec1f3860 0x7fc9ec1f3ce0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec06e960 tx=0x7fc9e4010590 comp rx=0 tx=0).stop 2024-03-19T06:21:52.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.660+0000 7fc9f2a00640 1 -- 172.21.15.32:0/3787109929 shutdown_connections 2024-03-19T06:21:52.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.660+0000 7fc9f2a00640 1 --2- 172.21.15.32:0/3787109929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc9c8067690 0x7fc9c8069b50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.660+0000 7fc9f2a00640 1 --2- 172.21.15.32:0/3787109929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc9ec1f3860 0x7fc9ec1f3ce0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.660+0000 7fc9f2a00640 1 --2- 172.21.15.32:0/3787109929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9ec0cab30 0x7fc9ec0cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.660+0000 7fc9f2a00640 1 --2- 172.21.15.32:0/3787109929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d0004810 0x7fc9ec152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.660+0000 7fc9f2a00640 1 -- 172.21.15.32:0/3787109929 >> 172.21.15.32:0/3787109929 conn(0x7fc9ec0d1890 msgr2=0x7fc9ec15b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:52.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.660+0000 7fc9f2a00640 1 -- 172.21.15.32:0/3787109929 shutdown_connections 2024-03-19T06:21:52.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.660+0000 7fc9f2a00640 1 -- 172.21.15.32:0/3787109929 wait complete. 2024-03-19T06:21:52.673 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:21:07.089673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:21:07.801319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:52.673 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:52.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f8464e00640 1 Processor -- start 2024-03-19T06:21:52.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f8464e00640 1 -- start start 2024-03-19T06:21:52.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f8464e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f846006b450 0x7f846006f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f8464e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84600aea70 0x7f84600ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f8464e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84600af2d0 con 0x7f846015a840 2024-03-19T06:21:52.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f8464e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84600cdc20 con 0x7f846006b450 2024-03-19T06:21:52.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f8464e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846015eea0 con 0x7f84600aea70 2024-03-19T06:21:52.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f845de00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f846015a840 0x7f846006ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33136/0 (socket says 172.21.15.32:33136) 2024-03-19T06:21:52.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f845de00640 1 -- 172.21.15.32:0/951063996 learned_addr learned my addr 172.21.15.32:0/951063996 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:52.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f8457e00640 1 --2- 172.21.15.32:0/951063996 >> v2:172.21.15.171:3300/0 conn(0x7f846006b450 0x7f846006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f845d400640 1 -- 172.21.15.32:0/951063996 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554981766 0 0) 0x7f84600af2d0 con 0x7f846015a840 2024-03-19T06:21:52.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f845e800640 1 --2- 172.21.15.32:0/951063996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84600aea70 0x7f84600ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f845d400640 1 -- 172.21.15.32:0/951063996 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8444003530 con 0x7f846015a840 2024-03-19T06:21:52.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f845d400640 1 -- 172.21.15.32:0/951063996 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3547710990 0 0) 0x7f8444003530 con 0x7f846015a840 2024-03-19T06:21:52.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f845d400640 1 -- 172.21.15.32:0/951063996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84600aea70 msgr2=0x7f84600ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:52.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f845d400640 1 --2- 172.21.15.32:0/951063996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84600aea70 0x7f84600ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f845d400640 1 -- 172.21.15.32:0/951063996 >> v2:172.21.15.171:3300/0 conn(0x7f846006b450 msgr2=0x7f846006f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:52.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f845d400640 1 --2- 172.21.15.32:0/951063996 >> v2:172.21.15.171:3300/0 conn(0x7f846006b450 0x7f846006f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f845d400640 1 -- 172.21.15.32:0/951063996 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846015f180 con 0x7f846015a840 2024-03-19T06:21:52.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.824+0000 7f845d400640 1 -- 172.21.15.32:0/951063996 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f8450001680 con 0x7f846015a840 2024-03-19T06:21:52.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845d400640 1 -- 172.21.15.32:0/951063996 >> v1:172.21.15.32:6789/0 conn(0x7f846015a840 legacy=0x7f846006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845d400640 1 --2- 172.21.15.32:0/951063996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84600aea70 0x7f84440039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845d400640 1 --2- 172.21.15.32:0/951063996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8444003f40 0x7f8444004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845d400640 1 --2- 172.21.15.32:0/951063996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8444004d50 0x7f84440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845d400640 1 -- 172.21.15.32:0/951063996 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84600cdc20 con 0x7f8444004d50 2024-03-19T06:21:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845d400640 1 -- 172.21.15.32:0/951063996 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846015eea0 con 0x7f8444003f40 2024-03-19T06:21:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845d400640 1 -- 172.21.15.32:0/951063996 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844400bab0 con 0x7f84600aea70 2024-03-19T06:21:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845e800640 1 --2- 172.21.15.32:0/951063996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8444004d50 0x7f84440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f8457e00640 1 --2- 172.21.15.32:0/951063996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8444003f40 0x7f8444004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845de00640 1 --2- 172.21.15.32:0/951063996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84600aea70 0x7f84440039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845e800640 1 -- 172.21.15.32:0/951063996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84600aea70 msgr2=0x7f84440039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845e800640 1 --2- 172.21.15.32:0/951063996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84600aea70 0x7f84440039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845e800640 1 -- 172.21.15.32:0/951063996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8444003f40 msgr2=0x7f8444004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845e800640 1 --2- 172.21.15.32:0/951063996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8444003f40 0x7f8444004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845e800640 1 -- 172.21.15.32:0/951063996 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8444003530 con 0x7f8444004d50 2024-03-19T06:21:52.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845e800640 1 --2- 172.21.15.32:0/951063996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8444004d50 0x7f84440051d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8458009fc0 tx=0x7f845801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfab9c4ef89b11c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:52.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845d400640 1 -- 172.21.15.32:0/951063996 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84580b2070 con 0x7f8444004d50 2024-03-19T06:21:52.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845d400640 1 -- 172.21.15.32:0/951063996 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84580a5c90 con 0x7f8444004d50 2024-03-19T06:21:52.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.828+0000 7f845d400640 1 -- 172.21.15.32:0/951063996 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458009c10 con 0x7f8444004d50 2024-03-19T06:21:52.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f8464e00640 1 -- 172.21.15.32:0/951063996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8444004d50 msgr2=0x7f84440051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f8464e00640 1 --2- 172.21.15.32:0/951063996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8444004d50 0x7f84440051d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8458009fc0 tx=0x7f845801cc40 comp rx=0 tx=0).stop 2024-03-19T06:21:52.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f845e800640 1 -- 172.21.15.32:0/951063996 reap_dead start 2024-03-19T06:21:52.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f8464e00640 1 -- 172.21.15.32:0/951063996 shutdown_connections 2024-03-19T06:21:52.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f8464e00640 1 -- 172.21.15.32:0/951063996 >> 172.21.15.32:0/951063996 conn(0x7f84600b1590 msgr2=0x7f84600b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:52.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f8464e00640 1 -- 172.21.15.32:0/951063996 shutdown_connections 2024-03-19T06:21:52.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f8464e00640 1 -- 172.21.15.32:0/951063996 wait complete. 2024-03-19T06:21:52.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f8464e00640 1 Processor -- start 2024-03-19T06:21:52.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f8464e00640 1 -- start start 2024-03-19T06:21:52.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f8464e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8444004d50 0x7f846014b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f8464e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84600cf230 0x7f84600cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f8464e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f846014d2a0 0x7f846014d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f8464e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84600cea20 con 0x7f846014d2a0 2024-03-19T06:21:52.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f8464e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84600ce8a0 con 0x7f8444004d50 2024-03-19T06:21:52.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f8464e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84600ceba0 con 0x7f84600cf230 2024-03-19T06:21:52.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f845e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f846014d2a0 0x7f846014d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f845e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f846014d2a0 0x7f846014d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57942/0 (socket says 172.21.15.32:57942) 2024-03-19T06:21:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f845e800640 1 -- 172.21.15.32:0/650272236 learned_addr learned my addr 172.21.15.32:0/650272236 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f845de00640 1 --2- 172.21.15.32:0/650272236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8444004d50 0x7f846014b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f8457e00640 1 --2- 172.21.15.32:0/650272236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84600cf230 0x7f84600cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f845e800640 1 -- 172.21.15.32:0/650272236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84600cf230 msgr2=0x7f84600cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f845e800640 1 --2- 172.21.15.32:0/650272236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84600cf230 0x7f84600cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f845e800640 1 -- 172.21.15.32:0/650272236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8444004d50 msgr2=0x7f846014b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.832+0000 7f845e800640 1 --2- 172.21.15.32:0/650272236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8444004d50 0x7f846014b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.836+0000 7f845e800640 1 -- 172.21.15.32:0/650272236 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846014df90 con 0x7f846014d2a0 2024-03-19T06:21:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.836+0000 7f845e800640 1 --2- 172.21.15.32:0/650272236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f846014d2a0 0x7f846014d720 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f84580b0040 tx=0x7f8458009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.836+0000 7f8456000640 1 -- 172.21.15.32:0/650272236 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84580bd070 con 0x7f846014d2a0 2024-03-19T06:21:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.836+0000 7f8456000640 1 -- 172.21.15.32:0/650272236 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84580a5a90 con 0x7f846014d2a0 2024-03-19T06:21:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.836+0000 7f8456000640 1 -- 172.21.15.32:0/650272236 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84580b2040 con 0x7f846014d2a0 2024-03-19T06:21:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.836+0000 7f8464e00640 1 -- 172.21.15.32:0/650272236 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8460157410 con 0x7f846014d2a0 2024-03-19T06:21:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.836+0000 7f8464e00640 1 -- 172.21.15.32:0/650272236 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84601579d0 con 0x7f846014d2a0 2024-03-19T06:21:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.836+0000 7f8464e00640 1 -- 172.21.15.32:0/650272236 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8460157bd0 con 0x7f846014d2a0 2024-03-19T06:21:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.836+0000 7f8456000640 1 -- 172.21.15.32:0/650272236 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f84580c0070 con 0x7f846014d2a0 2024-03-19T06:21:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.836+0000 7f8456000640 1 --2- 172.21.15.32:0/650272236 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f843c067600 0x7f843c069ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.836+0000 7f8456000640 1 -- 172.21.15.32:0/650272236 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f845811f600 con 0x7f846014d2a0 2024-03-19T06:21:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.836+0000 7f845de00640 1 --2- 172.21.15.32:0/650272236 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f843c067600 0x7f843c069ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:52.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.840+0000 7f845de00640 1 --2- 172.21.15.32:0/650272236 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f843c067600 0x7f843c069ac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8450000c10 tx=0x7f8450007900 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:52.840+0000 7f8456000640 1 -- 172.21.15.32:0/650272236 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f8460157bd0 con 0x7f846014d2a0 2024-03-19T06:21:53.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.008+0000 7f8464e00640 1 -- 172.21.15.32:0/650272236 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84600749e0 con 0x7f846014d2a0 2024-03-19T06:21:53.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.008+0000 7f8456000640 1 -- 172.21.15.32:0/650272236 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8458016990 con 0x7f846014d2a0 2024-03-19T06:21:53.001 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.012+0000 7f8464e00640 1 -- 172.21.15.32:0/650272236 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f843c067600 msgr2=0x7f843c069ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.012+0000 7f8464e00640 1 --2- 172.21.15.32:0/650272236 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f843c067600 0x7f843c069ac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8450000c10 tx=0x7f8450007900 comp rx=0 tx=0).stop 2024-03-19T06:21:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.012+0000 7f8464e00640 1 -- 172.21.15.32:0/650272236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f846014d2a0 msgr2=0x7f846014d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.012+0000 7f8464e00640 1 --2- 172.21.15.32:0/650272236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f846014d2a0 0x7f846014d720 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f84580b0040 tx=0x7f8458009750 comp rx=0 tx=0).stop 2024-03-19T06:21:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.012+0000 7f8464e00640 1 -- 172.21.15.32:0/650272236 shutdown_connections 2024-03-19T06:21:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.012+0000 7f8464e00640 1 --2- 172.21.15.32:0/650272236 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f843c067600 0x7f843c069ac0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.012+0000 7f8464e00640 1 --2- 172.21.15.32:0/650272236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f846014d2a0 0x7f846014d720 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.012+0000 7f8464e00640 1 --2- 172.21.15.32:0/650272236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84600cf230 0x7f84600cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.012+0000 7f8464e00640 1 --2- 172.21.15.32:0/650272236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8444004d50 0x7f846014b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.012+0000 7f8464e00640 1 -- 172.21.15.32:0/650272236 >> 172.21.15.32:0/650272236 conn(0x7f84600b1590 msgr2=0x7f8460154af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.012+0000 7f8464e00640 1 -- 172.21.15.32:0/650272236 shutdown_connections 2024-03-19T06:21:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.012+0000 7f8464e00640 1 -- 172.21.15.32:0/650272236 wait complete. 2024-03-19T06:21:53.022 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:21:53.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.172+0000 7fa8d7a00640 1 Processor -- start 2024-03-19T06:21:53.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.172+0000 7fa8d7a00640 1 -- start start 2024-03-19T06:21:53.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8d7a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa8d006eed0 0x7fa8d00ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8d7a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d006e320 0x7fa8d015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8d7a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d00cc290 con 0x7fa8d006ad40 2024-03-19T06:21:53.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8d7a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d006dbb0 con 0x7fa8d006eed0 2024-03-19T06:21:53.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8d7a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00cc570 con 0x7fa8d006e320 2024-03-19T06:21:53.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8d5000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa8d006ad40 0x7fa8d006b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33140/0 (socket says 172.21.15.32:33140) 2024-03-19T06:21:53.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8d5000640 1 -- 172.21.15.32:0/4036948771 learned_addr learned my addr 172.21.15.32:0/4036948771 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:53.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cfe00640 1 --2- 172.21.15.32:0/4036948771 >> v2:172.21.15.171:3300/0 conn(0x7fa8d006eed0 0x7fa8d00ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8d5a00640 1 --2- 172.21.15.32:0/4036948771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d006e320 0x7fa8d015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cf400640 1 -- 172.21.15.32:0/4036948771 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320304548 0 0) 0x7fa8d00cc290 con 0x7fa8d006ad40 2024-03-19T06:21:53.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cf400640 1 -- 172.21.15.32:0/4036948771 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8b8003530 con 0x7fa8d006ad40 2024-03-19T06:21:53.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cf400640 1 -- 172.21.15.32:0/4036948771 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2453604380 0 0) 0x7fa8b8003530 con 0x7fa8d006ad40 2024-03-19T06:21:53.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cf400640 1 -- 172.21.15.32:0/4036948771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d006e320 msgr2=0x7fa8d015bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:53.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cf400640 1 --2- 172.21.15.32:0/4036948771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d006e320 0x7fa8d015bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cf400640 1 -- 172.21.15.32:0/4036948771 >> v2:172.21.15.171:3300/0 conn(0x7fa8d006eed0 msgr2=0x7fa8d00ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:53.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cf400640 1 --2- 172.21.15.32:0/4036948771 >> v2:172.21.15.171:3300/0 conn(0x7fa8d006eed0 0x7fa8d00ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cf400640 1 -- 172.21.15.32:0/4036948771 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d00cc850 con 0x7fa8d006ad40 2024-03-19T06:21:53.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cf400640 1 -- 172.21.15.32:0/4036948771 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fa8c4001680 con 0x7fa8d006ad40 2024-03-19T06:21:53.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cf400640 1 -- 172.21.15.32:0/4036948771 >> v1:172.21.15.32:6789/0 conn(0x7fa8d006ad40 legacy=0x7fa8d006b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cf400640 1 --2- 172.21.15.32:0/4036948771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8b80039c0 0x7fa8b8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cf400640 1 --2- 172.21.15.32:0/4036948771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8b8004810 0x7fa8b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cf400640 1 --2- 172.21.15.32:0/4036948771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d006e320 0x7fa8b80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cf400640 1 -- 172.21.15.32:0/4036948771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d006dbb0 con 0x7fa8b8004810 2024-03-19T06:21:53.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cf400640 1 -- 172.21.15.32:0/4036948771 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00cc570 con 0x7fa8b80039c0 2024-03-19T06:21:53.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cf400640 1 -- 172.21.15.32:0/4036948771 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b800b9d0 con 0x7fa8d006e320 2024-03-19T06:21:53.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cfe00640 1 --2- 172.21.15.32:0/4036948771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8b8004810 0x7fa8b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8d5000640 1 --2- 172.21.15.32:0/4036948771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8b80039c0 0x7fa8b8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8d5a00640 1 --2- 172.21.15.32:0/4036948771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d006e320 0x7fa8b80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cfe00640 1 -- 172.21.15.32:0/4036948771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d006e320 msgr2=0x7fa8b80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:53.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cfe00640 1 --2- 172.21.15.32:0/4036948771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d006e320 0x7fa8b80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cfe00640 1 -- 172.21.15.32:0/4036948771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8b80039c0 msgr2=0x7fa8b8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:53.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cfe00640 1 --2- 172.21.15.32:0/4036948771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8b80039c0 0x7fa8b8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.176+0000 7fa8cfe00640 1 -- 172.21.15.32:0/4036948771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b8003530 con 0x7fa8b8004810 2024-03-19T06:21:53.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.180+0000 7fa8cfe00640 1 --2- 172.21.15.32:0/4036948771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8b8004810 0x7fa8b8004c90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009b10 tx=0x7fa8bc01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a269e2e321b87267 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:53.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.180+0000 7fa8cf400640 1 -- 172.21.15.32:0/4036948771 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0b2070 con 0x7fa8b8004810 2024-03-19T06:21:53.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.180+0000 7fa8cf400640 1 -- 172.21.15.32:0/4036948771 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc0a5590 con 0x7fa8b8004810 2024-03-19T06:21:53.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.180+0000 7fa8cf400640 1 -- 172.21.15.32:0/4036948771 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0096b0 con 0x7fa8b8004810 2024-03-19T06:21:53.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.180+0000 7fa8d7a00640 1 -- 172.21.15.32:0/4036948771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8b8004810 msgr2=0x7fa8b8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.180+0000 7fa8d7a00640 1 --2- 172.21.15.32:0/4036948771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8b8004810 0x7fa8b8004c90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009b10 tx=0x7fa8bc01ca80 comp rx=0 tx=0).stop 2024-03-19T06:21:53.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.180+0000 7fa8d5a00640 1 -- 172.21.15.32:0/4036948771 reap_dead start 2024-03-19T06:21:53.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.180+0000 7fa8d7a00640 1 -- 172.21.15.32:0/4036948771 shutdown_connections 2024-03-19T06:21:53.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.180+0000 7fa8d7a00640 1 -- 172.21.15.32:0/4036948771 >> 172.21.15.32:0/4036948771 conn(0x7fa8d00b1590 msgr2=0x7fa8d00b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:53.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.180+0000 7fa8d7a00640 1 -- 172.21.15.32:0/4036948771 shutdown_connections 2024-03-19T06:21:53.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.180+0000 7fa8d7a00640 1 -- 172.21.15.32:0/4036948771 wait complete. 2024-03-19T06:21:53.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.180+0000 7fa8d7a00640 1 Processor -- start 2024-03-19T06:21:53.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d7a00640 1 -- start start 2024-03-19T06:21:53.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d7a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8b8004810 0x7fa8d0156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d7a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8d014bf10 0x7fa8d014fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d7a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d0159540 0x7fa8d01599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d7a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d015c7f0 con 0x7fa8d0159540 2024-03-19T06:21:53.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d7a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d015c670 con 0x7fa8d014bf10 2024-03-19T06:21:53.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d7a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d015c970 con 0x7fa8b8004810 2024-03-19T06:21:53.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d5a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d0159540 0x7fa8d01599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d5a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d0159540 0x7fa8d01599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57966/0 (socket says 172.21.15.32:57966) 2024-03-19T06:21:53.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d5000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8b8004810 0x7fa8d0156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8cfe00640 1 --2- 172.21.15.32:0/992606835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8d014bf10 0x7fa8d014fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d5a00640 1 -- 172.21.15.32:0/992606835 learned_addr learned my addr 172.21.15.32:0/992606835 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:53.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d5a00640 1 -- 172.21.15.32:0/992606835 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8b8004810 msgr2=0x7fa8d0156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d5a00640 1 --2- 172.21.15.32:0/992606835 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8b8004810 0x7fa8d0156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d5a00640 1 -- 172.21.15.32:0/992606835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8d014bf10 msgr2=0x7fa8d014fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d5a00640 1 --2- 172.21.15.32:0/992606835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8d014bf10 0x7fa8d014fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d5a00640 1 -- 172.21.15.32:0/992606835 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d006d6f0 con 0x7fa8d0159540 2024-03-19T06:21:53.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d5a00640 1 --2- 172.21.15.32:0/992606835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d0159540 0x7fa8d01599f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa8d006fa60 tx=0x7fa8c80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:53.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8ccc00640 1 -- 172.21.15.32:0/992606835 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8011e40 con 0x7fa8d0159540 2024-03-19T06:21:53.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8ccc00640 1 -- 172.21.15.32:0/992606835 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c801b070 con 0x7fa8d0159540 2024-03-19T06:21:53.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8ccc00640 1 -- 172.21.15.32:0/992606835 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80039a0 con 0x7fa8d0159540 2024-03-19T06:21:53.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d7a00640 1 -- 172.21.15.32:0/992606835 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d01f6df0 con 0x7fa8d0159540 2024-03-19T06:21:53.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d7a00640 1 -- 172.21.15.32:0/992606835 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d01502b0 con 0x7fa8d0159540 2024-03-19T06:21:53.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.184+0000 7fa8d7a00640 1 -- 172.21.15.32:0/992606835 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d00749e0 con 0x7fa8d0159540 2024-03-19T06:21:53.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.188+0000 7fa8ccc00640 1 -- 172.21.15.32:0/992606835 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa8c8003b40 con 0x7fa8d0159540 2024-03-19T06:21:53.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.188+0000 7fa8ccc00640 1 --2- 172.21.15.32:0/992606835 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa8b0067690 0x7fa8b0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.188+0000 7fa8ccc00640 1 -- 172.21.15.32:0/992606835 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa8c8085d80 con 0x7fa8d0159540 2024-03-19T06:21:53.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.188+0000 7fa8d5000640 1 --2- 172.21.15.32:0/992606835 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa8b0067690 0x7fa8b0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.188+0000 7fa8d5000640 1 --2- 172.21.15.32:0/992606835 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa8b0067690 0x7fa8b0069b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40015e0 tx=0x7fa8c4007900 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:53.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.192+0000 7fa8ccc00640 1 -- 172.21.15.32:0/992606835 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fa8c8056a10 con 0x7fa8d0159540 2024-03-19T06:21:53.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.352+0000 7fa8d7a00640 1 -- 172.21.15.32:0/992606835 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8d006d900 con 0x7fa8d0159540 2024-03-19T06:21:53.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.352+0000 7fa8ccc00640 1 -- 172.21.15.32:0/992606835 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8c8056310 con 0x7fa8d0159540 2024-03-19T06:21:53.345 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:21:53.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.352+0000 7fa8d7a00640 1 -- 172.21.15.32:0/992606835 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa8b0067690 msgr2=0x7fa8b0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.352+0000 7fa8d7a00640 1 --2- 172.21.15.32:0/992606835 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa8b0067690 0x7fa8b0069b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40015e0 tx=0x7fa8c4007900 comp rx=0 tx=0).stop 2024-03-19T06:21:53.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.356+0000 7fa8d7a00640 1 -- 172.21.15.32:0/992606835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d0159540 msgr2=0x7fa8d01599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.356+0000 7fa8d7a00640 1 --2- 172.21.15.32:0/992606835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d0159540 0x7fa8d01599f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa8d006fa60 tx=0x7fa8c80115a0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.356+0000 7fa8d7a00640 1 -- 172.21.15.32:0/992606835 shutdown_connections 2024-03-19T06:21:53.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.356+0000 7fa8d7a00640 1 --2- 172.21.15.32:0/992606835 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa8b0067690 0x7fa8b0069b50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.356+0000 7fa8d7a00640 1 --2- 172.21.15.32:0/992606835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8d0159540 0x7fa8d01599f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.356+0000 7fa8d7a00640 1 --2- 172.21.15.32:0/992606835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8d014bf10 0x7fa8d014fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.356+0000 7fa8d7a00640 1 --2- 172.21.15.32:0/992606835 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8b8004810 0x7fa8d0156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.356+0000 7fa8d7a00640 1 -- 172.21.15.32:0/992606835 >> 172.21.15.32:0/992606835 conn(0x7fa8d00b1590 msgr2=0x7fa8d014d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:53.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.356+0000 7fa8d7a00640 1 -- 172.21.15.32:0/992606835 shutdown_connections 2024-03-19T06:21:53.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.356+0000 7fa8d7a00640 1 -- 172.21.15.32:0/992606835 wait complete. 2024-03-19T06:21:53.366 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:21:53.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.516+0000 7f377ba00640 1 Processor -- start 2024-03-19T06:21:53.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.516+0000 7f377ba00640 1 -- start start 2024-03-19T06:21:53.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.516+0000 7f377ba00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f377406b450 0x7f377406f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.516+0000 7f377ba00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f37740aea70 0x7f37740ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.516+0000 7f377ba00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37740af2d0 con 0x7f377415a840 2024-03-19T06:21:53.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.516+0000 7f377ba00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37740cdc20 con 0x7f37740aea70 2024-03-19T06:21:53.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.516+0000 7f377ba00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377415eea0 con 0x7f377406b450 2024-03-19T06:21:53.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.516+0000 7f3779000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f377415a840 0x7f377406ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33156/0 (socket says 172.21.15.32:33156) 2024-03-19T06:21:53.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.520+0000 7f3779000640 1 -- 172.21.15.32:0/4154819497 learned_addr learned my addr 172.21.15.32:0/4154819497 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:53.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.516+0000 7f3779a00640 1 --2- 172.21.15.32:0/4154819497 >> v2:172.21.15.32:3300/0 conn(0x7f37740aea70 0x7f37740ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.520+0000 7f3773e00640 1 --2- 172.21.15.32:0/4154819497 >> v2:172.21.15.171:3300/0 conn(0x7f377406b450 0x7f377406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.520+0000 7f3779a00640 1 -- 172.21.15.32:0/4154819497 >> v2:172.21.15.171:3300/0 conn(0x7f377406b450 msgr2=0x7f377406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:53.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.520+0000 7f3779a00640 1 --2- 172.21.15.32:0/4154819497 >> v2:172.21.15.171:3300/0 conn(0x7f377406b450 0x7f377406f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.520+0000 7f3779a00640 1 -- 172.21.15.32:0/4154819497 >> v1:172.21.15.32:6789/0 conn(0x7f377415a840 legacy=0x7f377406ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.520+0000 7f3779a00640 1 -- 172.21.15.32:0/4154819497 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377415f180 con 0x7f37740aea70 2024-03-19T06:21:53.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.520+0000 7f3773400640 1 -- 172.21.15.32:0/4154819497 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673451072 0 0) 0x7f37740af2d0 con 0x7f377415a840 2024-03-19T06:21:53.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.520+0000 7f3779a00640 1 --2- 172.21.15.32:0/4154819497 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37740aea70 0x7f37740ce0b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f377406ed40 tx=0x7f376c01c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfec892824bc0e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:53.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.520+0000 7f3773400640 1 -- 172.21.15.32:0/4154819497 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c0b2070 con 0x7f37740aea70 2024-03-19T06:21:53.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.520+0000 7f3773400640 1 -- 172.21.15.32:0/4154819497 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c0a5980 con 0x7f37740aea70 2024-03-19T06:21:53.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.520+0000 7f3773400640 1 -- 172.21.15.32:0/4154819497 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c0a5d50 con 0x7f37740aea70 2024-03-19T06:21:53.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f377ba00640 1 -- 172.21.15.32:0/4154819497 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37740aea70 msgr2=0x7f37740ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f377ba00640 1 --2- 172.21.15.32:0/4154819497 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37740aea70 0x7f37740ce0b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f377406ed40 tx=0x7f376c01c860 comp rx=0 tx=0).stop 2024-03-19T06:21:53.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f377ba00640 1 -- 172.21.15.32:0/4154819497 shutdown_connections 2024-03-19T06:21:53.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f377ba00640 1 --2- 172.21.15.32:0/4154819497 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37740aea70 0x7f37740ce0b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f377ba00640 1 --2- 172.21.15.32:0/4154819497 >> v2:172.21.15.171:3300/0 conn(0x7f377406b450 0x7f377406f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f377ba00640 1 -- 172.21.15.32:0/4154819497 >> 172.21.15.32:0/4154819497 conn(0x7f37740b1590 msgr2=0x7f37740b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:53.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f377ba00640 1 -- 172.21.15.32:0/4154819497 shutdown_connections 2024-03-19T06:21:53.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f377ba00640 1 -- 172.21.15.32:0/4154819497 wait complete. 2024-03-19T06:21:53.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f377ba00640 1 Processor -- start 2024-03-19T06:21:53.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f377ba00640 1 -- start start 2024-03-19T06:21:53.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f377ba00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f377406b450 0x7f377413d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f377ba00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37740aea70 0x7f37740b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f377ba00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f377415a840 0x7f37740b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f377ba00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37740cef80 con 0x7f37740aea70 2024-03-19T06:21:53.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f377ba00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37740cee00 con 0x7f377406b450 2024-03-19T06:21:53.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f377ba00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37740cf100 con 0x7f377415a840 2024-03-19T06:21:53.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f3773e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37740aea70 0x7f37740b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f3773e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37740aea70 0x7f37740b0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57982/0 (socket says 172.21.15.32:57982) 2024-03-19T06:21:53.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f3773e00640 1 -- 172.21.15.32:0/342006004 learned_addr learned my addr 172.21.15.32:0/342006004 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:53.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f3779a00640 1 --2- 172.21.15.32:0/342006004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f377415a840 0x7f37740b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f3779000640 1 --2- 172.21.15.32:0/342006004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f377406b450 0x7f377413d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f3773e00640 1 -- 172.21.15.32:0/342006004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f377415a840 msgr2=0x7f37740b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f3773e00640 1 --2- 172.21.15.32:0/342006004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f377415a840 0x7f37740b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f3773e00640 1 -- 172.21.15.32:0/342006004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f377406b450 msgr2=0x7f377413d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f3773e00640 1 --2- 172.21.15.32:0/342006004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f377406b450 0x7f377413d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f3773e00640 1 -- 172.21.15.32:0/342006004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3774157640 con 0x7f37740aea70 2024-03-19T06:21:53.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f3779a00640 1 --2- 172.21.15.32:0/342006004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f377415a840 0x7f37740b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:53.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.524+0000 7f3773e00640 1 --2- 172.21.15.32:0/342006004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37740aea70 0x7f37740b0720 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f376000e930 tx=0x7f376000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:53.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.528+0000 7f3770c00640 1 -- 172.21.15.32:0/342006004 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760017070 con 0x7f37740aea70 2024-03-19T06:21:53.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.528+0000 7f3770c00640 1 -- 172.21.15.32:0/342006004 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376000ca00 con 0x7f37740aea70 2024-03-19T06:21:53.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.528+0000 7f377ba00640 1 -- 172.21.15.32:0/342006004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3774157920 con 0x7f37740aea70 2024-03-19T06:21:53.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.528+0000 7f3770c00640 1 -- 172.21.15.32:0/342006004 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376000cdb0 con 0x7f37740aea70 2024-03-19T06:21:53.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.528+0000 7f377ba00640 1 -- 172.21.15.32:0/342006004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3774157ee0 con 0x7f37740aea70 2024-03-19T06:21:53.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.528+0000 7f377ba00640 1 -- 172.21.15.32:0/342006004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37740749e0 con 0x7f37740aea70 2024-03-19T06:21:53.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.528+0000 7f3770c00640 1 -- 172.21.15.32:0/342006004 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f376001a070 con 0x7f37740aea70 2024-03-19T06:21:53.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.528+0000 7f3770c00640 1 --2- 172.21.15.32:0/342006004 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3754067660 0x7f3754069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.528+0000 7f3770c00640 1 -- 172.21.15.32:0/342006004 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3760085d90 con 0x7f37740aea70 2024-03-19T06:21:53.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.528+0000 7f3779000640 1 --2- 172.21.15.32:0/342006004 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3754067660 0x7f3754069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.532+0000 7f3779000640 1 --2- 172.21.15.32:0/342006004 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3754067660 0x7f3754069b20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3768000f70 tx=0x7f3768007c10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:53.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.532+0000 7f3770c00640 1 -- 172.21.15.32:0/342006004 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f37600569b0 con 0x7f37740aea70 2024-03-19T06:21:53.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.696+0000 7f377ba00640 1 -- 172.21.15.32:0/342006004 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37740ce2d0 con 0x7f37740aea70 2024-03-19T06:21:53.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.696+0000 7f3770c00640 1 -- 172.21.15.32:0/342006004 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f37600562b0 con 0x7f37740aea70 2024-03-19T06:21:53.688 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:21:53.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.696+0000 7f377ba00640 1 -- 172.21.15.32:0/342006004 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3754067660 msgr2=0x7f3754069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.696+0000 7f377ba00640 1 --2- 172.21.15.32:0/342006004 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3754067660 0x7f3754069b20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3768000f70 tx=0x7f3768007c10 comp rx=0 tx=0).stop 2024-03-19T06:21:53.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.696+0000 7f377ba00640 1 -- 172.21.15.32:0/342006004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37740aea70 msgr2=0x7f37740b0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.696+0000 7f377ba00640 1 --2- 172.21.15.32:0/342006004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37740aea70 0x7f37740b0720 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f376000e930 tx=0x7f376000edf0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.696+0000 7f377ba00640 1 -- 172.21.15.32:0/342006004 shutdown_connections 2024-03-19T06:21:53.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.696+0000 7f377ba00640 1 --2- 172.21.15.32:0/342006004 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3754067660 0x7f3754069b20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.696+0000 7f377ba00640 1 --2- 172.21.15.32:0/342006004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f377415a840 0x7f37740b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.696+0000 7f377ba00640 1 --2- 172.21.15.32:0/342006004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37740aea70 0x7f37740b0720 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.696+0000 7f377ba00640 1 --2- 172.21.15.32:0/342006004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f377406b450 0x7f377413d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.696+0000 7f377ba00640 1 -- 172.21.15.32:0/342006004 >> 172.21.15.32:0/342006004 conn(0x7f37740b1590 msgr2=0x7f377406ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:53.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.696+0000 7f377ba00640 1 -- 172.21.15.32:0/342006004 shutdown_connections 2024-03-19T06:21:53.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.696+0000 7f377ba00640 1 -- 172.21.15.32:0/342006004 wait complete. 2024-03-19T06:21:53.709 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:21:53.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.856+0000 7f8a53400640 1 Processor -- start 2024-03-19T06:21:53.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.856+0000 7f8a53400640 1 -- start start 2024-03-19T06:21:53.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.860+0000 7f8a53400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8a4c0aecf0 0x7f8a4c0ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.860+0000 7f8a53400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4c15fe20 con 0x7f8a4c06d6c0 2024-03-19T06:21:53.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.860+0000 7f8a53400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4c160100 con 0x7f8a4c15c010 2024-03-19T06:21:53.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.860+0000 7f8a53400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4c1603e0 con 0x7f8a4c0aecf0 2024-03-19T06:21:53.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.860+0000 7f8a50a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8a4c0aecf0 0x7f8a4c0ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.860+0000 7f8a51400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8a4c06d6c0 0x7f8a4c0cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47648/0 (socket says 172.21.15.32:47648) 2024-03-19T06:21:53.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.860+0000 7f8a51400640 1 -- 172.21.15.32:0/4294401271 learned_addr learned my addr 172.21.15.32:0/4294401271 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:53.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.860+0000 7f8a50a00640 1 -- 172.21.15.32:0/4294401271 >> v1:172.21.15.171:6789/0 conn(0x7f8a4c15c010 legacy=0x7f8a4c15f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:53.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.860+0000 7f8a50a00640 1 -- 172.21.15.32:0/4294401271 >> v1:172.21.15.32:6789/0 conn(0x7f8a4c06d6c0 legacy=0x7f8a4c0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.860+0000 7f8a50a00640 1 -- 172.21.15.32:0/4294401271 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c0ca1f0 con 0x7f8a4c0aecf0 2024-03-19T06:21:53.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a50a00640 1 --2- 172.21.15.32:0/4294401271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c0aecf0 0x7f8a4c0ca9f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8a400097c0 tx=0x7f8a4001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cee549ed23338e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:53.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a4b400640 1 -- 172.21.15.32:0/4294401271 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a400b0070 con 0x7f8a4c0aecf0 2024-03-19T06:21:53.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a4b400640 1 -- 172.21.15.32:0/4294401271 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a400ab600 con 0x7f8a4c0aecf0 2024-03-19T06:21:53.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a4b400640 1 -- 172.21.15.32:0/4294401271 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a400ab9d0 con 0x7f8a4c0aecf0 2024-03-19T06:21:53.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a53400640 1 -- 172.21.15.32:0/4294401271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c0aecf0 msgr2=0x7f8a4c0ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a53400640 1 --2- 172.21.15.32:0/4294401271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c0aecf0 0x7f8a4c0ca9f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8a400097c0 tx=0x7f8a4001c410 comp rx=0 tx=0).stop 2024-03-19T06:21:53.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a53400640 1 -- 172.21.15.32:0/4294401271 shutdown_connections 2024-03-19T06:21:53.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a53400640 1 --2- 172.21.15.32:0/4294401271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c0aecf0 0x7f8a4c0ca9f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a53400640 1 -- 172.21.15.32:0/4294401271 >> 172.21.15.32:0/4294401271 conn(0x7f8a4c0b1280 msgr2=0x7f8a4c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:53.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a53400640 1 -- 172.21.15.32:0/4294401271 shutdown_connections 2024-03-19T06:21:53.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a53400640 1 -- 172.21.15.32:0/4294401271 wait complete. 2024-03-19T06:21:53.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a53400640 1 Processor -- start 2024-03-19T06:21:53.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a53400640 1 -- start start 2024-03-19T06:21:53.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a53400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c06d6c0 0x7f8a4c155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a53400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a4c0aecf0 0x7f8a4c1538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a53400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a4c15c010 0x7f8a4c153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a53400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c16a030 con 0x7f8a4c06d6c0 2024-03-19T06:21:53.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a53400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c169eb0 con 0x7f8a4c0aecf0 2024-03-19T06:21:53.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a53400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c16a1b0 con 0x7f8a4c15c010 2024-03-19T06:21:53.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a50a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c06d6c0 0x7f8a4c155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a50a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c06d6c0 0x7f8a4c155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47392/0 (socket says 172.21.15.32:47392) 2024-03-19T06:21:53.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.864+0000 7f8a50a00640 1 -- 172.21.15.32:0/4169235003 learned_addr learned my addr 172.21.15.32:0/4169235003 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:53.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.868+0000 7f8a4be00640 1 --2- 172.21.15.32:0/4169235003 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a4c0aecf0 0x7f8a4c1538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.868+0000 7f8a51400640 1 --2- 172.21.15.32:0/4169235003 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a4c15c010 0x7f8a4c153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.868+0000 7f8a50a00640 1 -- 172.21.15.32:0/4169235003 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a4c15c010 msgr2=0x7f8a4c153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.868+0000 7f8a50a00640 1 --2- 172.21.15.32:0/4169235003 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a4c15c010 0x7f8a4c153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.868+0000 7f8a50a00640 1 -- 172.21.15.32:0/4169235003 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a4c0aecf0 msgr2=0x7f8a4c1538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:53.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.868+0000 7f8a50a00640 1 --2- 172.21.15.32:0/4169235003 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a4c0aecf0 0x7f8a4c1538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:53.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.868+0000 7f8a50a00640 1 -- 172.21.15.32:0/4169235003 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c0b4270 con 0x7f8a4c06d6c0 2024-03-19T06:21:53.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.868+0000 7f8a50a00640 1 --2- 172.21.15.32:0/4169235003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c06d6c0 0x7f8a4c155060 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8a4001a040 tx=0x7f8a400191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:53.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.868+0000 7f8a48c00640 1 -- 172.21.15.32:0/4169235003 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a400b8020 con 0x7f8a4c06d6c0 2024-03-19T06:21:53.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.868+0000 7f8a48c00640 1 -- 172.21.15.32:0/4169235003 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a400b4630 con 0x7f8a4c06d6c0 2024-03-19T06:21:53.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.868+0000 7f8a53400640 1 -- 172.21.15.32:0/4169235003 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4c0b4550 con 0x7f8a4c06d6c0 2024-03-19T06:21:53.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.868+0000 7f8a48c00640 1 -- 172.21.15.32:0/4169235003 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a400b0040 con 0x7f8a4c06d6c0 2024-03-19T06:21:53.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.868+0000 7f8a53400640 1 -- 172.21.15.32:0/4169235003 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c155eb0 con 0x7f8a4c06d6c0 2024-03-19T06:21:53.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.868+0000 7f8a53400640 1 -- 172.21.15.32:0/4169235003 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4c155ca0 con 0x7f8a4c06d6c0 2024-03-19T06:21:53.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.868+0000 7f8a48c00640 1 -- 172.21.15.32:0/4169235003 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8a400bb020 con 0x7f8a4c06d6c0 2024-03-19T06:21:53.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.868+0000 7f8a48c00640 1 --2- 172.21.15.32:0/4169235003 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a2c067660 0x7f8a2c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:53.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.872+0000 7f8a48c00640 1 -- 172.21.15.32:0/4169235003 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8a4011f510 con 0x7f8a4c06d6c0 2024-03-19T06:21:53.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.872+0000 7f8a4be00640 1 --2- 172.21.15.32:0/4169235003 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a2c067660 0x7f8a2c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:53.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.872+0000 7f8a4be00640 1 --2- 172.21.15.32:0/4169235003 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a2c067660 0x7f8a2c069b20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0cf0f0 tx=0x7f8a38009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:53.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:53.876+0000 7f8a48c00640 1 -- 172.21.15.32:0/4169235003 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f8a400c2030 con 0x7f8a4c06d6c0 2024-03-19T06:21:54.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.052+0000 7f8a53400640 1 -- 172.21.15.32:0/4169235003 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8a4c0749e0 con 0x7f8a4c06d6c0 2024-03-19T06:21:54.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.052+0000 7f8a48c00640 1 -- 172.21.15.32:0/4169235003 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8a40016090 con 0x7f8a4c06d6c0 2024-03-19T06:21:54.044 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:21:54.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.052+0000 7f8a53400640 1 -- 172.21.15.32:0/4169235003 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a2c067660 msgr2=0x7f8a2c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:54.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.052+0000 7f8a53400640 1 --2- 172.21.15.32:0/4169235003 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a2c067660 0x7f8a2c069b20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0cf0f0 tx=0x7f8a38009040 comp rx=0 tx=0).stop 2024-03-19T06:21:54.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.052+0000 7f8a53400640 1 -- 172.21.15.32:0/4169235003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c06d6c0 msgr2=0x7f8a4c155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.052+0000 7f8a53400640 1 --2- 172.21.15.32:0/4169235003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c06d6c0 0x7f8a4c155060 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8a4001a040 tx=0x7f8a400191b0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.052+0000 7f8a53400640 1 -- 172.21.15.32:0/4169235003 shutdown_connections 2024-03-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.052+0000 7f8a53400640 1 --2- 172.21.15.32:0/4169235003 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8a2c067660 0x7f8a2c069b20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.052+0000 7f8a53400640 1 --2- 172.21.15.32:0/4169235003 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a4c15c010 0x7f8a4c153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.052+0000 7f8a53400640 1 --2- 172.21.15.32:0/4169235003 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a4c0aecf0 0x7f8a4c1538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.052+0000 7f8a53400640 1 --2- 172.21.15.32:0/4169235003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8a4c06d6c0 0x7f8a4c155060 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.052+0000 7f8a53400640 1 -- 172.21.15.32:0/4169235003 >> 172.21.15.32:0/4169235003 conn(0x7f8a4c0b1280 msgr2=0x7f8a4c15d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.052+0000 7f8a53400640 1 -- 172.21.15.32:0/4169235003 shutdown_connections 2024-03-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.052+0000 7f8a53400640 1 -- 172.21.15.32:0/4169235003 wait complete. 2024-03-19T06:21:54.066 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi032.front.sepia.ceph.com... 2024-03-19T06:21:54.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:54.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-03-19T06:21:54.087 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:21:54.087 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:21:54.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:54.087 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-19T06:21:54.143 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:21:54.143 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:21:54.153 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:21:54.153 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:21:54.204 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:54.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.352+0000 7f7f4f800640 1 Processor -- start 2024-03-19T06:21:54.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.352+0000 7f7f4f800640 1 -- start start 2024-03-19T06:21:54.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.352+0000 7f7f4f800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f480af3b0 0x7f7f4815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:54.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.352+0000 7f7f4f800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7f4806be50 0x7f7f480b3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:54.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.352+0000 7f7f4f800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f4815f030 con 0x7f7f480b30e0 2024-03-19T06:21:54.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.352+0000 7f7f4f800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f480b3a80 con 0x7f7f4806be50 2024-03-19T06:21:54.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.352+0000 7f7f4f800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4806ee30 con 0x7f7f480af3b0 2024-03-19T06:21:54.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.352+0000 7f7f4d800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7f4806be50 0x7f7f480b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:54.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.352+0000 7f7f4d800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7f4806be50 0x7f7f480b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47400/0 (socket says 172.21.15.32:47400) 2024-03-19T06:21:54.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.352+0000 7f7f4d800640 1 -- 172.21.15.32:0/2183591789 learned_addr learned my addr 172.21.15.32:0/2183591789 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:54.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.352+0000 7f7f4ce00640 1 --2- 172.21.15.32:0/2183591789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f480af3b0 0x7f7f4815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:54.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.352+0000 7f7f4d800640 1 -- 172.21.15.32:0/2183591789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f480af3b0 msgr2=0x7f7f4815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:54.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.352+0000 7f7f4d800640 1 --2- 172.21.15.32:0/2183591789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f480af3b0 0x7f7f4815eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.356+0000 7f7f4d800640 1 -- 172.21.15.32:0/2183591789 >> v1:172.21.15.171:6789/0 conn(0x7f7f480b30e0 legacy=0x7f7f48161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:54.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.356+0000 7f7f4d800640 1 -- 172.21.15.32:0/2183591789 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4806e220 con 0x7f7f4806be50 2024-03-19T06:21:54.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.356+0000 7f7f4d800640 1 --2- 172.21.15.32:0/2183591789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4806be50 0x7f7f480b3540 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009e50 tx=0x7f7f4001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97521354bda07c55 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:54.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.356+0000 7f7f47e00640 1 -- 172.21.15.32:0/2183591789 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f400a57e0 con 0x7f7f4806be50 2024-03-19T06:21:54.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.356+0000 7f7f47e00640 1 -- 172.21.15.32:0/2183591789 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f400a5980 con 0x7f7f4806be50 2024-03-19T06:21:54.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.356+0000 7f7f47e00640 1 -- 172.21.15.32:0/2183591789 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f400a5d50 con 0x7f7f4806be50 2024-03-19T06:21:54.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.356+0000 7f7f4f800640 1 -- 172.21.15.32:0/2183591789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4806be50 msgr2=0x7f7f480b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:54.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.356+0000 7f7f4f800640 1 --2- 172.21.15.32:0/2183591789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4806be50 0x7f7f480b3540 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009e50 tx=0x7f7f4001ca00 comp rx=0 tx=0).stop 2024-03-19T06:21:54.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.356+0000 7f7f4f800640 1 -- 172.21.15.32:0/2183591789 shutdown_connections 2024-03-19T06:21:54.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.356+0000 7f7f4f800640 1 --2- 172.21.15.32:0/2183591789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f4806be50 0x7f7f480b3540 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.356+0000 7f7f4f800640 1 --2- 172.21.15.32:0/2183591789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f480af3b0 0x7f7f4815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.356+0000 7f7f4f800640 1 -- 172.21.15.32:0/2183591789 >> 172.21.15.32:0/2183591789 conn(0x7f7f480cfec0 msgr2=0x7f7f480d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:54.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.356+0000 7f7f4f800640 1 -- 172.21.15.32:0/2183591789 shutdown_connections 2024-03-19T06:21:54.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.356+0000 7f7f4f800640 1 -- 172.21.15.32:0/2183591789 wait complete. 2024-03-19T06:21:54.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4f800640 1 Processor -- start 2024-03-19T06:21:54.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4f800640 1 -- start start 2024-03-19T06:21:54.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4f800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f4806be50 0x7f7f480b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:54.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4f800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f480af3b0 0x7f7f480cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4f800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f480b30e0 0x7f7f480ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4f800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f48066e20 con 0x7f7f480b30e0 2024-03-19T06:21:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4f800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f480af790 con 0x7f7f4806be50 2024-03-19T06:21:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4f800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4806dec0 con 0x7f7f480af3b0 2024-03-19T06:21:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f480b30e0 0x7f7f480ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f480b30e0 0x7f7f480ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47416/0 (socket says 172.21.15.32:47416) 2024-03-19T06:21:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4d800640 1 -- 172.21.15.32:0/431615681 learned_addr learned my addr 172.21.15.32:0/431615681 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4ce00640 1 --2- 172.21.15.32:0/431615681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f4806be50 0x7f7f480b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f3fe00640 1 --2- 172.21.15.32:0/431615681 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f480af3b0 0x7f7f480cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4d800640 1 -- 172.21.15.32:0/431615681 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f480af3b0 msgr2=0x7f7f480cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4d800640 1 --2- 172.21.15.32:0/431615681 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f480af3b0 0x7f7f480cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4d800640 1 -- 172.21.15.32:0/431615681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f4806be50 msgr2=0x7f7f480b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4d800640 1 --2- 172.21.15.32:0/431615681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f4806be50 0x7f7f480b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4d800640 1 -- 172.21.15.32:0/431615681 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f48154ed0 con 0x7f7f480b30e0 2024-03-19T06:21:54.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4d800640 1 --2- 172.21.15.32:0/431615681 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f480b30e0 0x7f7f480ccdd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7f4001a630 tx=0x7f7f400197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:54.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f45600640 1 -- 172.21.15.32:0/431615681 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f400bc020 con 0x7f7f480b30e0 2024-03-19T06:21:54.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f45600640 1 -- 172.21.15.32:0/431615681 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f400b8670 con 0x7f7f480b30e0 2024-03-19T06:21:54.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f45600640 1 -- 172.21.15.32:0/431615681 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f400b8a60 con 0x7f7f480b30e0 2024-03-19T06:21:54.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4f800640 1 -- 172.21.15.32:0/431615681 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f48155870 con 0x7f7f480b30e0 2024-03-19T06:21:54.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.360+0000 7f7f4f800640 1 -- 172.21.15.32:0/431615681 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f481546d0 con 0x7f7f480b30e0 2024-03-19T06:21:54.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.364+0000 7f7f4f800640 1 -- 172.21.15.32:0/431615681 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f480749e0 con 0x7f7f480b30e0 2024-03-19T06:21:54.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.364+0000 7f7f45600640 1 -- 172.21.15.32:0/431615681 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7f400bf020 con 0x7f7f480b30e0 2024-03-19T06:21:54.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.364+0000 7f7f45600640 1 --2- 172.21.15.32:0/431615681 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7f24067660 0x7f7f24069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:54.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.364+0000 7f7f45600640 1 -- 172.21.15.32:0/431615681 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7f40120b10 con 0x7f7f480b30e0 2024-03-19T06:21:54.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.364+0000 7f7f4ce00640 1 --2- 172.21.15.32:0/431615681 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7f24067660 0x7f7f24069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:54.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.364+0000 7f7f4ce00640 1 --2- 172.21.15.32:0/431615681 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7f24067660 0x7f7f24069b20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800b9d0 tx=0x7f7f38008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:54.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.368+0000 7f7f45600640 1 -- 172.21.15.32:0/431615681 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f7f400c6030 con 0x7f7f480b30e0 2024-03-19T06:21:54.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.532+0000 7f7f4f800640 1 -- 172.21.15.32:0/431615681 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f4806cc10 con 0x7f7f480b30e0 2024-03-19T06:21:54.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.536+0000 7f7f45600640 1 -- 172.21.15.32:0/431615681 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f7f40016620 con 0x7f7f480b30e0 2024-03-19T06:21:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:54.527 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":24,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:51.568754+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:54.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.536+0000 7f7f4f800640 1 -- 172.21.15.32:0/431615681 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7f24067660 msgr2=0x7f7f24069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:54.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.536+0000 7f7f4f800640 1 --2- 172.21.15.32:0/431615681 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7f24067660 0x7f7f24069b20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800b9d0 tx=0x7f7f38008040 comp rx=0 tx=0).stop 2024-03-19T06:21:54.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.536+0000 7f7f4f800640 1 -- 172.21.15.32:0/431615681 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f480b30e0 msgr2=0x7f7f480ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:54.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.536+0000 7f7f4f800640 1 --2- 172.21.15.32:0/431615681 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f480b30e0 0x7f7f480ccdd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7f4001a630 tx=0x7f7f400197a0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.536+0000 7f7f4f800640 1 -- 172.21.15.32:0/431615681 shutdown_connections 2024-03-19T06:21:54.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.536+0000 7f7f4f800640 1 --2- 172.21.15.32:0/431615681 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7f24067660 0x7f7f24069b20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.536+0000 7f7f4f800640 1 --2- 172.21.15.32:0/431615681 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f480b30e0 0x7f7f480ccdd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.536+0000 7f7f4f800640 1 --2- 172.21.15.32:0/431615681 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f480af3b0 0x7f7f480cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.536+0000 7f7f4f800640 1 --2- 172.21.15.32:0/431615681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f4806be50 0x7f7f480b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.536+0000 7f7f4f800640 1 -- 172.21.15.32:0/431615681 >> 172.21.15.32:0/431615681 conn(0x7f7f480cfec0 msgr2=0x7f7f480d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:54.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.536+0000 7f7f4f800640 1 -- 172.21.15.32:0/431615681 shutdown_connections 2024-03-19T06:21:54.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.536+0000 7f7f4f800640 1 -- 172.21.15.32:0/431615681 wait complete. 2024-03-19T06:21:54.549 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:21:07.089673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:21:07.801319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:54.549 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:54.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.700+0000 7f6701400640 1 Processor -- start 2024-03-19T06:21:54.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.700+0000 7f6701400640 1 -- start start 2024-03-19T06:21:54.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.700+0000 7f6701400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f66fc15a840 0x7f66fc06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:54.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.700+0000 7f6701400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f66fc06b450 0x7f66fc0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:54.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.700+0000 7f6701400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66fc0af2d0 con 0x7f66fc0aea70 2024-03-19T06:21:54.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.700+0000 7f6701400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc0cdc20 con 0x7f66fc06b450 2024-03-19T06:21:54.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.700+0000 7f6701400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc15eea0 con 0x7f66fc15a840 2024-03-19T06:21:54.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.700+0000 7f66fb200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f66fc06b450 0x7f66fc0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:54.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.700+0000 7f66fb200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f66fc06b450 0x7f66fc0ce0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47426/0 (socket says 172.21.15.32:47426) 2024-03-19T06:21:54.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.700+0000 7f66fb200640 1 -- 172.21.15.32:0/3475209803 learned_addr learned my addr 172.21.15.32:0/3475209803 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:54.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.700+0000 7f66fa800640 1 --2- 172.21.15.32:0/3475209803 >> v2:172.21.15.171:3300/0 conn(0x7f66fc15a840 0x7f66fc06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:54.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f66fb200640 1 -- 172.21.15.32:0/3475209803 >> v2:172.21.15.171:3300/0 conn(0x7f66fc15a840 msgr2=0x7f66fc06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:54.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f66fb200640 1 --2- 172.21.15.32:0/3475209803 >> v2:172.21.15.171:3300/0 conn(0x7f66fc15a840 0x7f66fc06f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f66fb200640 1 -- 172.21.15.32:0/3475209803 >> v1:172.21.15.171:6789/0 conn(0x7f66fc0aea70 legacy=0x7f66fc06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:54.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f66fb200640 1 -- 172.21.15.32:0/3475209803 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc15f180 con 0x7f66fc06b450 2024-03-19T06:21:54.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f66fa800640 1 --2- 172.21.15.32:0/3475209803 >> v2:172.21.15.171:3300/0 conn(0x7f66fc15a840 0x7f66fc06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:54.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f66fb200640 1 --2- 172.21.15.32:0/3475209803 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66fc06b450 0x7f66fc0ce0b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0cdda0 tx=0x7f66f401eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249342536d824dce server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:54.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f66f9e00640 1 -- 172.21.15.32:0/3475209803 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f400b2d0 con 0x7f66fc06b450 2024-03-19T06:21:54.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f66f9e00640 1 -- 172.21.15.32:0/3475209803 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f400b470 con 0x7f66fc06b450 2024-03-19T06:21:54.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f66f9e00640 1 -- 172.21.15.32:0/3475209803 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f40a7c70 con 0x7f66fc06b450 2024-03-19T06:21:54.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f6701400640 1 -- 172.21.15.32:0/3475209803 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66fc06b450 msgr2=0x7f66fc0ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:54.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f6701400640 1 --2- 172.21.15.32:0/3475209803 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66fc06b450 0x7f66fc0ce0b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0cdda0 tx=0x7f66f401eb20 comp rx=0 tx=0).stop 2024-03-19T06:21:54.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f6701400640 1 -- 172.21.15.32:0/3475209803 shutdown_connections 2024-03-19T06:21:54.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f6701400640 1 --2- 172.21.15.32:0/3475209803 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66fc06b450 0x7f66fc0ce0b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f6701400640 1 --2- 172.21.15.32:0/3475209803 >> v2:172.21.15.171:3300/0 conn(0x7f66fc15a840 0x7f66fc06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f6701400640 1 -- 172.21.15.32:0/3475209803 >> 172.21.15.32:0/3475209803 conn(0x7f66fc0b1590 msgr2=0x7f66fc0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:54.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f6701400640 1 -- 172.21.15.32:0/3475209803 shutdown_connections 2024-03-19T06:21:54.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.704+0000 7f6701400640 1 -- 172.21.15.32:0/3475209803 wait complete. 2024-03-19T06:21:54.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f6701400640 1 Processor -- start 2024-03-19T06:21:54.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f6701400640 1 -- start start 2024-03-19T06:21:54.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f6701400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66fc06b450 0x7f66fc158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:54.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f6701400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66fc0aea70 0x7f66fc13eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:54.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f6701400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66fc15a840 0x7f66fc151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:54.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f6701400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc0cef80 con 0x7f66fc0aea70 2024-03-19T06:21:54.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f6701400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc0cee00 con 0x7f66fc06b450 2024-03-19T06:21:54.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f6701400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc0cf100 con 0x7f66fc15a840 2024-03-19T06:21:54.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f66f3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66fc0aea70 0x7f66fc13eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:54.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f66fa800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66fc06b450 0x7f66fc158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:54.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f66f3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66fc0aea70 0x7f66fc13eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47428/0 (socket says 172.21.15.32:47428) 2024-03-19T06:21:54.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f66f3e00640 1 -- 172.21.15.32:0/719621189 learned_addr learned my addr 172.21.15.32:0/719621189 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:54.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f66fb200640 1 --2- 172.21.15.32:0/719621189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66fc15a840 0x7f66fc151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:54.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f66f3e00640 1 -- 172.21.15.32:0/719621189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66fc15a840 msgr2=0x7f66fc151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:54.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f66f3e00640 1 --2- 172.21.15.32:0/719621189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66fc15a840 0x7f66fc151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f66f3e00640 1 -- 172.21.15.32:0/719621189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66fc06b450 msgr2=0x7f66fc158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:54.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f66f3e00640 1 --2- 172.21.15.32:0/719621189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66fc06b450 0x7f66fc158bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f66f3e00640 1 -- 172.21.15.32:0/719621189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc0b4390 con 0x7f66fc0aea70 2024-03-19T06:21:54.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f66f3e00640 1 --2- 172.21.15.32:0/719621189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66fc0aea70 0x7f66fc13eab0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f66e400c430 tx=0x7f66e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:54.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f66f2a00640 1 -- 172.21.15.32:0/719621189 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e40052d0 con 0x7f66fc0aea70 2024-03-19T06:21:54.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f66f2a00640 1 -- 172.21.15.32:0/719621189 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e4005470 con 0x7f66fc0aea70 2024-03-19T06:21:54.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f66f2a00640 1 -- 172.21.15.32:0/719621189 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4007260 con 0x7f66fc0aea70 2024-03-19T06:21:54.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.708+0000 7f6701400640 1 -- 172.21.15.32:0/719621189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66fc0b4670 con 0x7f66fc0aea70 2024-03-19T06:21:54.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.712+0000 7f6701400640 1 -- 172.21.15.32:0/719621189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc13eff0 con 0x7f66fc0aea70 2024-03-19T06:21:54.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.712+0000 7f6701400640 1 -- 172.21.15.32:0/719621189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66fc0749e0 con 0x7f66fc0aea70 2024-03-19T06:21:54.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.712+0000 7f66f2a00640 1 -- 172.21.15.32:0/719621189 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f66e4007400 con 0x7f66fc0aea70 2024-03-19T06:21:54.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.712+0000 7f66f2a00640 1 --2- 172.21.15.32:0/719621189 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f66d8067660 0x7f66d8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:54.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.712+0000 7f66f2a00640 1 -- 172.21.15.32:0/719621189 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f66e4084d20 con 0x7f66fc0aea70 2024-03-19T06:21:54.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.712+0000 7f66fa800640 1 --2- 172.21.15.32:0/719621189 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f66d8067660 0x7f66d8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:54.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.712+0000 7f66fa800640 1 --2- 172.21.15.32:0/719621189 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f66d8067660 0x7f66d8069b20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0045f0 tx=0x7f66ec008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:54.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.716+0000 7f66f2a00640 1 -- 172.21.15.32:0/719621189 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f66e4055360 con 0x7f66fc0aea70 2024-03-19T06:21:54.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.880+0000 7f6701400640 1 -- 172.21.15.32:0/719621189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f66fc0b4840 con 0x7f66fc0aea70 2024-03-19T06:21:54.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.880+0000 7f66f2a00640 1 -- 172.21.15.32:0/719621189 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66e4059400 con 0x7f66fc0aea70 2024-03-19T06:21:54.873 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:54.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.884+0000 7f6701400640 1 -- 172.21.15.32:0/719621189 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f66d8067660 msgr2=0x7f66d8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:54.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.884+0000 7f6701400640 1 --2- 172.21.15.32:0/719621189 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f66d8067660 0x7f66d8069b20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0045f0 tx=0x7f66ec008040 comp rx=0 tx=0).stop 2024-03-19T06:21:54.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.884+0000 7f6701400640 1 -- 172.21.15.32:0/719621189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66fc0aea70 msgr2=0x7f66fc13eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:54.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.884+0000 7f6701400640 1 --2- 172.21.15.32:0/719621189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66fc0aea70 0x7f66fc13eab0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f66e400c430 tx=0x7f66e400c8f0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.884+0000 7f6701400640 1 -- 172.21.15.32:0/719621189 shutdown_connections 2024-03-19T06:21:54.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.884+0000 7f6701400640 1 --2- 172.21.15.32:0/719621189 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f66d8067660 0x7f66d8069b20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.884+0000 7f6701400640 1 --2- 172.21.15.32:0/719621189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66fc15a840 0x7f66fc151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.884+0000 7f6701400640 1 --2- 172.21.15.32:0/719621189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66fc0aea70 0x7f66fc13eab0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.884+0000 7f6701400640 1 --2- 172.21.15.32:0/719621189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66fc06b450 0x7f66fc158bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:54.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.884+0000 7f6701400640 1 -- 172.21.15.32:0/719621189 >> 172.21.15.32:0/719621189 conn(0x7f66fc0b1590 msgr2=0x7f66fc071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:54.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.884+0000 7f6701400640 1 -- 172.21.15.32:0/719621189 shutdown_connections 2024-03-19T06:21:54.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:54.884+0000 7f6701400640 1 -- 172.21.15.32:0/719621189 wait complete. 2024-03-19T06:21:54.893 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:21:55.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.044+0000 7ff31dc00640 1 Processor -- start 2024-03-19T06:21:55.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.044+0000 7ff31dc00640 1 -- start start 2024-03-19T06:21:55.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.044+0000 7ff31dc00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff3180aea70 0x7ff31806f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.044+0000 7ff31dc00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3180af2d0 con 0x7ff31815a840 2024-03-19T06:21:55.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.044+0000 7ff31dc00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31815eea0 con 0x7ff31806b450 2024-03-19T06:21:55.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.044+0000 7ff31dc00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3180cdc20 con 0x7ff3180aea70 2024-03-19T06:21:55.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.048+0000 7ff316a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff31815a840 0x7ff31806ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47656/0 (socket says 172.21.15.32:47656) 2024-03-19T06:21:55.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.048+0000 7ff316a00640 1 -- 172.21.15.32:0/2739288149 learned_addr learned my addr 172.21.15.32:0/2739288149 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:55.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.048+0000 7ff317400640 1 --2- 172.21.15.32:0/2739288149 >> v2:172.21.15.171:3300/0 conn(0x7ff3180aea70 0x7ff31806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.048+0000 7ff316000640 1 -- 172.21.15.32:0/2739288149 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221159600 0 0) 0x7ff3180af2d0 con 0x7ff31815a840 2024-03-19T06:21:55.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.048+0000 7ff316000640 1 -- 172.21.15.32:0/2739288149 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2fc003530 con 0x7ff31815a840 2024-03-19T06:21:55.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.048+0000 7ff316000640 1 -- 172.21.15.32:0/2739288149 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775257316 0 0) 0x7ff31815eea0 con 0x7ff31806b450 2024-03-19T06:21:55.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.048+0000 7ff316000640 1 -- 172.21.15.32:0/2739288149 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3180af2d0 con 0x7ff31806b450 2024-03-19T06:21:55.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.048+0000 7ff317400640 1 -- 172.21.15.32:0/2739288149 >> v1:172.21.15.171:6789/0 conn(0x7ff31806b450 legacy=0x7ff3180ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.048+0000 7ff317400640 1 -- 172.21.15.32:0/2739288149 >> v1:172.21.15.32:6789/0 conn(0x7ff31815a840 legacy=0x7ff31806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.048+0000 7ff317400640 1 -- 172.21.15.32:0/2739288149 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31815f180 con 0x7ff3180aea70 2024-03-19T06:21:55.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.048+0000 7ff317400640 1 --2- 172.21.15.32:0/2739288149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3180aea70 0x7ff31806f040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff310009d90 tx=0x7ff31001c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=636e717e4201b51 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:55.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff316000640 1 -- 172.21.15.32:0/2739288149 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3100b2070 con 0x7ff3180aea70 2024-03-19T06:21:55.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff316000640 1 -- 172.21.15.32:0/2739288149 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3100a59c0 con 0x7ff3180aea70 2024-03-19T06:21:55.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff316000640 1 -- 172.21.15.32:0/2739288149 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3100a5d70 con 0x7ff3180aea70 2024-03-19T06:21:55.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff31dc00640 1 -- 172.21.15.32:0/2739288149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3180aea70 msgr2=0x7ff31806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff31dc00640 1 --2- 172.21.15.32:0/2739288149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3180aea70 0x7ff31806f040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff310009d90 tx=0x7ff31001c8a0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff31dc00640 1 -- 172.21.15.32:0/2739288149 shutdown_connections 2024-03-19T06:21:55.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff31dc00640 1 --2- 172.21.15.32:0/2739288149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3180aea70 0x7ff31806f040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff31dc00640 1 -- 172.21.15.32:0/2739288149 >> 172.21.15.32:0/2739288149 conn(0x7ff3180b1590 msgr2=0x7ff3180b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:55.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff31dc00640 1 -- 172.21.15.32:0/2739288149 shutdown_connections 2024-03-19T06:21:55.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff31dc00640 1 -- 172.21.15.32:0/2739288149 wait complete. 2024-03-19T06:21:55.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff31dc00640 1 Processor -- start 2024-03-19T06:21:55.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff31dc00640 1 -- start start 2024-03-19T06:21:55.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff31dc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31806b450 0x7ff3181426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff31dc00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3180aea70 0x7ff318151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff31dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff31815a840 0x7ff318151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff31dc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180cf150 con 0x7ff31815a840 2024-03-19T06:21:55.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff31dc00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180cefd0 con 0x7ff3180aea70 2024-03-19T06:21:55.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff31dc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180cf2d0 con 0x7ff31806b450 2024-03-19T06:21:55.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff317400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff31815a840 0x7ff318151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff317400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff31815a840 0x7ff318151a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47434/0 (socket says 172.21.15.32:47434) 2024-03-19T06:21:55.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff317400640 1 -- 172.21.15.32:0/2359059416 learned_addr learned my addr 172.21.15.32:0/2359059416 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:55.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff316a00640 1 --2- 172.21.15.32:0/2359059416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31806b450 0x7ff3181426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff30fe00640 1 --2- 172.21.15.32:0/2359059416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3180aea70 0x7ff318151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.052+0000 7ff317400640 1 -- 172.21.15.32:0/2359059416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31806b450 msgr2=0x7ff3181426e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff317400640 1 --2- 172.21.15.32:0/2359059416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31806b450 0x7ff3181426e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff317400640 1 -- 172.21.15.32:0/2359059416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3180aea70 msgr2=0x7ff318151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff317400640 1 --2- 172.21.15.32:0/2359059416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3180aea70 0x7ff318151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff317400640 1 -- 172.21.15.32:0/2359059416 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31814b5b0 con 0x7ff31815a840 2024-03-19T06:21:55.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff30fe00640 1 --2- 172.21.15.32:0/2359059416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3180aea70 0x7ff318151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:55.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff316a00640 1 --2- 172.21.15.32:0/2359059416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31806b450 0x7ff3181426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:55.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff317400640 1 --2- 172.21.15.32:0/2359059416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff31815a840 0x7ff318151a40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff3100b0040 tx=0x7ff310019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:55.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff30ea00640 1 -- 172.21.15.32:0/2359059416 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3100b2050 con 0x7ff31815a840 2024-03-19T06:21:55.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff30ea00640 1 -- 172.21.15.32:0/2359059416 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3100be070 con 0x7ff31815a840 2024-03-19T06:21:55.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff31dc00640 1 -- 172.21.15.32:0/2359059416 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31814b890 con 0x7ff31815a840 2024-03-19T06:21:55.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff30ea00640 1 -- 172.21.15.32:0/2359059416 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3100ada70 con 0x7ff31815a840 2024-03-19T06:21:55.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff31dc00640 1 -- 172.21.15.32:0/2359059416 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31814be50 con 0x7ff31815a840 2024-03-19T06:21:55.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff31dc00640 1 -- 172.21.15.32:0/2359059416 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3180749e0 con 0x7ff31815a840 2024-03-19T06:21:55.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff30ea00640 1 -- 172.21.15.32:0/2359059416 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff3100adc10 con 0x7ff31815a840 2024-03-19T06:21:55.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff30ea00640 1 --2- 172.21.15.32:0/2359059416 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff2f4067660 0x7ff2f4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff30ea00640 1 -- 172.21.15.32:0/2359059416 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff310120c70 con 0x7ff31815a840 2024-03-19T06:21:55.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.056+0000 7ff316a00640 1 --2- 172.21.15.32:0/2359059416 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff2f4067660 0x7ff2f4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.060+0000 7ff316a00640 1 --2- 172.21.15.32:0/2359059416 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff2f4067660 0x7ff2f4069b20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff308000f70 tx=0x7ff308009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:55.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.060+0000 7ff30ea00640 1 -- 172.21.15.32:0/2359059416 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7ff310016520 con 0x7ff31815a840 2024-03-19T06:21:55.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.224+0000 7ff31dc00640 1 -- 172.21.15.32:0/2359059416 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3180cce20 con 0x7ff31815a840 2024-03-19T06:21:55.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.224+0000 7ff30ea00640 1 -- 172.21.15.32:0/2359059416 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff3100f1980 con 0x7ff31815a840 2024-03-19T06:21:55.215 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:21:55.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.224+0000 7ff31dc00640 1 -- 172.21.15.32:0/2359059416 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff2f4067660 msgr2=0x7ff2f4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.224+0000 7ff31dc00640 1 --2- 172.21.15.32:0/2359059416 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff2f4067660 0x7ff2f4069b20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff308000f70 tx=0x7ff308009040 comp rx=0 tx=0).stop 2024-03-19T06:21:55.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.224+0000 7ff31dc00640 1 -- 172.21.15.32:0/2359059416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff31815a840 msgr2=0x7ff318151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.224+0000 7ff31dc00640 1 --2- 172.21.15.32:0/2359059416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff31815a840 0x7ff318151a40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff3100b0040 tx=0x7ff310019640 comp rx=0 tx=0).stop 2024-03-19T06:21:55.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.224+0000 7ff31dc00640 1 -- 172.21.15.32:0/2359059416 shutdown_connections 2024-03-19T06:21:55.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.224+0000 7ff31dc00640 1 --2- 172.21.15.32:0/2359059416 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff2f4067660 0x7ff2f4069b20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.224+0000 7ff31dc00640 1 --2- 172.21.15.32:0/2359059416 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff31815a840 0x7ff318151a40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.224+0000 7ff31dc00640 1 --2- 172.21.15.32:0/2359059416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3180aea70 0x7ff318151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.224+0000 7ff31dc00640 1 --2- 172.21.15.32:0/2359059416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31806b450 0x7ff3181426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.224+0000 7ff31dc00640 1 -- 172.21.15.32:0/2359059416 >> 172.21.15.32:0/2359059416 conn(0x7ff3180b1590 msgr2=0x7ff3180b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:55.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.224+0000 7ff31dc00640 1 -- 172.21.15.32:0/2359059416 shutdown_connections 2024-03-19T06:21:55.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.224+0000 7ff31dc00640 1 -- 172.21.15.32:0/2359059416 wait complete. 2024-03-19T06:21:55.236 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:21:55.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.388+0000 7f63da400640 1 Processor -- start 2024-03-19T06:21:55.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.388+0000 7f63da400640 1 -- start start 2024-03-19T06:21:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.388+0000 7f63da400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f63d415c6d0 0x7f63d415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.388+0000 7f63da400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63d406d870 0x7f63d40cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.388+0000 7f63da400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d415faa0 con 0x7f63d415f250 2024-03-19T06:21:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.388+0000 7f63da400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d415d190 con 0x7f63d415c6d0 2024-03-19T06:21:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.388+0000 7f63da400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d415fd80 con 0x7f63d406d870 2024-03-19T06:21:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.388+0000 7f63d9000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f63d415c6d0 0x7f63d415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.388+0000 7f63d3e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f63d415f250 0x7f63d406d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47672/0 (socket says 172.21.15.32:47672) 2024-03-19T06:21:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.388+0000 7f63d3e00640 1 -- 172.21.15.32:0/3571634148 learned_addr learned my addr 172.21.15.32:0/3571634148 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.388+0000 7f63d9000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f63d415c6d0 0x7f63d415bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47436/0 (socket says 172.21.15.32:47436) 2024-03-19T06:21:55.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.388+0000 7f63d9a00640 1 --2- 172.21.15.32:0/3571634148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63d406d870 0x7f63d40cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.388+0000 7f63d9000640 1 -- 172.21.15.32:0/3571634148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63d406d870 msgr2=0x7f63d40cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:55.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.388+0000 7f63d9000640 1 --2- 172.21.15.32:0/3571634148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63d406d870 0x7f63d40cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.388+0000 7f63d9000640 1 -- 172.21.15.32:0/3571634148 >> v1:172.21.15.32:6789/0 conn(0x7f63d415f250 legacy=0x7f63d406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.388+0000 7f63d9000640 1 -- 172.21.15.32:0/3571634148 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d4160060 con 0x7f63d415c6d0 2024-03-19T06:21:55.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.392+0000 7f63d9000640 1 --2- 172.21.15.32:0/3571634148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63d415c6d0 0x7f63d415bc60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f63c80097c0 tx=0x7f63c801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49dca8bf445fd85 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:55.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.392+0000 7f63d3400640 1 -- 172.21.15.32:0/3571634148 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c80aa5f0 con 0x7f63d415c6d0 2024-03-19T06:21:55.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.392+0000 7f63d3400640 1 -- 172.21.15.32:0/3571634148 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c80af070 con 0x7f63d415c6d0 2024-03-19T06:21:55.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.392+0000 7f63d3400640 1 -- 172.21.15.32:0/3571634148 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c80aa9b0 con 0x7f63d415c6d0 2024-03-19T06:21:55.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.392+0000 7f63da400640 1 -- 172.21.15.32:0/3571634148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63d415c6d0 msgr2=0x7f63d415bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.392+0000 7f63da400640 1 --2- 172.21.15.32:0/3571634148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63d415c6d0 0x7f63d415bc60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f63c80097c0 tx=0x7f63c801c470 comp rx=0 tx=0).stop 2024-03-19T06:21:55.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.392+0000 7f63da400640 1 -- 172.21.15.32:0/3571634148 shutdown_connections 2024-03-19T06:21:55.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.392+0000 7f63da400640 1 --2- 172.21.15.32:0/3571634148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63d406d870 0x7f63d40cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.392+0000 7f63da400640 1 --2- 172.21.15.32:0/3571634148 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63d415c6d0 0x7f63d415bc60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.392+0000 7f63da400640 1 -- 172.21.15.32:0/3571634148 >> 172.21.15.32:0/3571634148 conn(0x7f63d40b16b0 msgr2=0x7f63d406ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:55.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.392+0000 7f63da400640 1 -- 172.21.15.32:0/3571634148 shutdown_connections 2024-03-19T06:21:55.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.392+0000 7f63da400640 1 -- 172.21.15.32:0/3571634148 wait complete. 2024-03-19T06:21:55.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63da400640 1 Processor -- start 2024-03-19T06:21:55.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63da400640 1 -- start start 2024-03-19T06:21:55.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63da400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63d406d870 0x7f63d4152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63da400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63d415c6d0 0x7f63d4141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63da400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63d415f250 0x7f63d40c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63da400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d415d7a0 con 0x7f63d415f250 2024-03-19T06:21:55.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63da400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d415d620 con 0x7f63d415c6d0 2024-03-19T06:21:55.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63da400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d415d920 con 0x7f63d406d870 2024-03-19T06:21:55.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63d9a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63d415f250 0x7f63d40c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63d9a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63d415f250 0x7f63d40c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47448/0 (socket says 172.21.15.32:47448) 2024-03-19T06:21:55.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63d9a00640 1 -- 172.21.15.32:0/1778638643 learned_addr learned my addr 172.21.15.32:0/1778638643 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:55.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63d9000640 1 --2- 172.21.15.32:0/1778638643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63d406d870 0x7f63d4152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63d3e00640 1 --2- 172.21.15.32:0/1778638643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63d415c6d0 0x7f63d4141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63d9a00640 1 -- 172.21.15.32:0/1778638643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63d406d870 msgr2=0x7f63d4152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63d9a00640 1 --2- 172.21.15.32:0/1778638643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63d406d870 0x7f63d4152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63d9a00640 1 -- 172.21.15.32:0/1778638643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63d415c6d0 msgr2=0x7f63d4141c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63d9a00640 1 --2- 172.21.15.32:0/1778638643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63d415c6d0 0x7f63d4141c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63d9a00640 1 -- 172.21.15.32:0/1778638643 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d40cda00 con 0x7f63d415f250 2024-03-19T06:21:55.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63d3e00640 1 --2- 172.21.15.32:0/1778638643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63d415c6d0 0x7f63d4141c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:55.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63d9a00640 1 --2- 172.21.15.32:0/1778638643 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63d415f250 0x7f63d40c86d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00efc0 tx=0x7f63cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:55.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63d0c00640 1 -- 172.21.15.32:0/1778638643 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc018020 con 0x7f63d415f250 2024-03-19T06:21:55.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63d0c00640 1 -- 172.21.15.32:0/1778638643 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc014480 con 0x7f63d415f250 2024-03-19T06:21:55.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63d0c00640 1 -- 172.21.15.32:0/1778638643 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc014870 con 0x7f63d415f250 2024-03-19T06:21:55.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63da400640 1 -- 172.21.15.32:0/1778638643 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d40cdca0 con 0x7f63d415f250 2024-03-19T06:21:55.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.396+0000 7f63da400640 1 -- 172.21.15.32:0/1778638643 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d40ce260 con 0x7f63d415f250 2024-03-19T06:21:55.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.400+0000 7f63da400640 1 -- 172.21.15.32:0/1778638643 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d4075090 con 0x7f63d415f250 2024-03-19T06:21:55.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.400+0000 7f63d0c00640 1 -- 172.21.15.32:0/1778638643 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f63cc01b020 con 0x7f63d415f250 2024-03-19T06:21:55.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.400+0000 7f63d0c00640 1 --2- 172.21.15.32:0/1778638643 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f63b4067660 0x7f63b4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.400+0000 7f63d0c00640 1 -- 172.21.15.32:0/1778638643 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f63cc086780 con 0x7f63d415f250 2024-03-19T06:21:55.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.400+0000 7f63d9000640 1 --2- 172.21.15.32:0/1778638643 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f63b4067660 0x7f63b4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.400+0000 7f63d9000640 1 --2- 172.21.15.32:0/1778638643 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f63b4067660 0x7f63b4069b20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f63c80ae000 tx=0x7f63c80a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:55.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.404+0000 7f63d0c00640 1 -- 172.21.15.32:0/1778638643 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f63cc022030 con 0x7f63d415f250 2024-03-19T06:21:55.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.568+0000 7f63da400640 1 -- 172.21.15.32:0/1778638643 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63d406ba70 con 0x7f63d415f250 2024-03-19T06:21:55.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.568+0000 7f63d0c00640 1 -- 172.21.15.32:0/1778638643 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f63cc010040 con 0x7f63d415f250 2024-03-19T06:21:55.562 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:21:55.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.572+0000 7f63da400640 1 -- 172.21.15.32:0/1778638643 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f63b4067660 msgr2=0x7f63b4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.572+0000 7f63da400640 1 --2- 172.21.15.32:0/1778638643 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f63b4067660 0x7f63b4069b20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f63c80ae000 tx=0x7f63c80a7000 comp rx=0 tx=0).stop 2024-03-19T06:21:55.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.572+0000 7f63da400640 1 -- 172.21.15.32:0/1778638643 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63d415f250 msgr2=0x7f63d40c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.572+0000 7f63da400640 1 --2- 172.21.15.32:0/1778638643 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63d415f250 0x7f63d40c86d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00efc0 tx=0x7f63cc00c490 comp rx=0 tx=0).stop 2024-03-19T06:21:55.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.572+0000 7f63da400640 1 -- 172.21.15.32:0/1778638643 shutdown_connections 2024-03-19T06:21:55.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.572+0000 7f63da400640 1 --2- 172.21.15.32:0/1778638643 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f63b4067660 0x7f63b4069b20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.572+0000 7f63da400640 1 --2- 172.21.15.32:0/1778638643 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63d415f250 0x7f63d40c86d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.572+0000 7f63da400640 1 --2- 172.21.15.32:0/1778638643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63d415c6d0 0x7f63d4141c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.572+0000 7f63da400640 1 --2- 172.21.15.32:0/1778638643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f63d406d870 0x7f63d4152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.572+0000 7f63da400640 1 -- 172.21.15.32:0/1778638643 >> 172.21.15.32:0/1778638643 conn(0x7f63d40b16b0 msgr2=0x7f63d40ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:55.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.572+0000 7f63da400640 1 -- 172.21.15.32:0/1778638643 shutdown_connections 2024-03-19T06:21:55.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.572+0000 7f63da400640 1 -- 172.21.15.32:0/1778638643 wait complete. 2024-03-19T06:21:55.584 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:21:55.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.732+0000 7f6946c00640 1 Processor -- start 2024-03-19T06:21:55.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.732+0000 7f6946c00640 1 -- start start 2024-03-19T06:21:55.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.732+0000 7f6946c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6940161270 0x7f69400ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.732+0000 7f6946c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f69400cc2e0 0x7f69400cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.732+0000 7f6946c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f694006ad40 con 0x7f69400cfa70 2024-03-19T06:21:55.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.732+0000 7f6946c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f694006b020 con 0x7f6940161270 2024-03-19T06:21:55.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.732+0000 7f6946c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f694006b300 con 0x7f69400cc2e0 2024-03-19T06:21:55.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.736+0000 7f693fe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6940161270 0x7f69400ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.736+0000 7f693fe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6940161270 0x7f69400ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47454/0 (socket says 172.21.15.32:47454) 2024-03-19T06:21:55.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.736+0000 7f693fe00640 1 -- 172.21.15.32:0/1485596618 learned_addr learned my addr 172.21.15.32:0/1485596618 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:55.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.736+0000 7f6937400640 1 --1- 172.21.15.32:0/1485596618 >> v1:172.21.15.32:6789/0 conn(0x7f69400cfa70 0x7f69400cfee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47688/0 (socket says 172.21.15.32:47688) 2024-03-19T06:21:55.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.736+0000 7f6944c00640 1 --2- 172.21.15.32:0/1485596618 >> v2:172.21.15.171:3300/0 conn(0x7f69400cc2e0 0x7f69400cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.736+0000 7f693fe00640 1 -- 172.21.15.32:0/1485596618 >> v2:172.21.15.171:3300/0 conn(0x7f69400cc2e0 msgr2=0x7f69400cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:55.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.736+0000 7f693fe00640 1 --2- 172.21.15.32:0/1485596618 >> v2:172.21.15.171:3300/0 conn(0x7f69400cc2e0 0x7f69400cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.736+0000 7f693fe00640 1 -- 172.21.15.32:0/1485596618 >> v1:172.21.15.32:6789/0 conn(0x7f69400cfa70 legacy=0x7f69400cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.736+0000 7f693fe00640 1 -- 172.21.15.32:0/1485596618 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694006b5e0 con 0x7f6940161270 2024-03-19T06:21:55.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.736+0000 7f693f400640 1 -- 172.21.15.32:0/1485596618 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632866015 0 0) 0x7f694006ad40 con 0x7f69400cfa70 2024-03-19T06:21:55.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.736+0000 7f6944c00640 1 --2- 172.21.15.32:0/1485596618 >> v2:172.21.15.171:3300/0 conn(0x7f69400cc2e0 0x7f69400cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:55.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.736+0000 7f693fe00640 1 --2- 172.21.15.32:0/1485596618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6940161270 0x7f69400ce290 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6940071a20 tx=0x7f693001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d77a36d1d386129 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:55.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.736+0000 7f693f400640 1 -- 172.21.15.32:0/1485596618 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69300ab430 con 0x7f6940161270 2024-03-19T06:21:55.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.736+0000 7f693f400640 1 -- 172.21.15.32:0/1485596618 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69300b0070 con 0x7f6940161270 2024-03-19T06:21:55.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.736+0000 7f693f400640 1 -- 172.21.15.32:0/1485596618 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69300ab7f0 con 0x7f6940161270 2024-03-19T06:21:55.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6946c00640 1 -- 172.21.15.32:0/1485596618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6940161270 msgr2=0x7f69400ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6946c00640 1 --2- 172.21.15.32:0/1485596618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6940161270 0x7f69400ce290 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6940071a20 tx=0x7f693001c520 comp rx=0 tx=0).stop 2024-03-19T06:21:55.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6946c00640 1 -- 172.21.15.32:0/1485596618 shutdown_connections 2024-03-19T06:21:55.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6946c00640 1 --2- 172.21.15.32:0/1485596618 >> v2:172.21.15.171:3300/0 conn(0x7f69400cc2e0 0x7f69400cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6946c00640 1 --2- 172.21.15.32:0/1485596618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6940161270 0x7f69400ce290 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6946c00640 1 -- 172.21.15.32:0/1485596618 >> 172.21.15.32:0/1485596618 conn(0x7f69400b2250 msgr2=0x7f69400b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:55.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6946c00640 1 -- 172.21.15.32:0/1485596618 shutdown_connections 2024-03-19T06:21:55.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6946c00640 1 -- 172.21.15.32:0/1485596618 wait complete. 2024-03-19T06:21:55.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6946c00640 1 Processor -- start 2024-03-19T06:21:55.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6946c00640 1 -- start start 2024-03-19T06:21:55.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6946c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69400cc2e0 0x7f69400c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6946c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69400cfa70 0x7f69400c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6946c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6940161270 0x7f694015bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6946c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69400cda30 con 0x7f6940161270 2024-03-19T06:21:55.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6946c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69400cd8b0 con 0x7f69400cfa70 2024-03-19T06:21:55.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6946c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69400cdbb0 con 0x7f69400cc2e0 2024-03-19T06:21:55.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6944c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6940161270 0x7f694015bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6944c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6940161270 0x7f694015bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47466/0 (socket says 172.21.15.32:47466) 2024-03-19T06:21:55.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6944c00640 1 -- 172.21.15.32:0/1994852825 learned_addr learned my addr 172.21.15.32:0/1994852825 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:55.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f693fe00640 1 --2- 172.21.15.32:0/1994852825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69400cc2e0 0x7f69400c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6937400640 1 --2- 172.21.15.32:0/1994852825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69400cfa70 0x7f69400c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6944c00640 1 -- 172.21.15.32:0/1994852825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69400cc2e0 msgr2=0x7f69400c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6944c00640 1 --2- 172.21.15.32:0/1994852825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69400cc2e0 0x7f69400c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6944c00640 1 -- 172.21.15.32:0/1994852825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69400cfa70 msgr2=0x7f69400c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6944c00640 1 --2- 172.21.15.32:0/1994852825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69400cfa70 0x7f69400c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6944c00640 1 -- 172.21.15.32:0/1994852825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69400c5350 con 0x7f6940161270 2024-03-19T06:21:55.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.740+0000 7f6937400640 1 --2- 172.21.15.32:0/1994852825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69400cfa70 0x7f69400c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:55.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.744+0000 7f6944c00640 1 --2- 172.21.15.32:0/1994852825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6940161270 0x7f694015bc70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f693800cea0 tx=0x7f693800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:55.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.744+0000 7f693cc00640 1 -- 172.21.15.32:0/1994852825 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6938003ba0 con 0x7f6940161270 2024-03-19T06:21:55.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.744+0000 7f693cc00640 1 -- 172.21.15.32:0/1994852825 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6938003d60 con 0x7f6940161270 2024-03-19T06:21:55.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.744+0000 7f693cc00640 1 -- 172.21.15.32:0/1994852825 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693800d880 con 0x7f6940161270 2024-03-19T06:21:55.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.744+0000 7f6946c00640 1 -- 172.21.15.32:0/1994852825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69400c5630 con 0x7f6940161270 2024-03-19T06:21:55.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.744+0000 7f6946c00640 1 -- 172.21.15.32:0/1994852825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69400c5bf0 con 0x7f6940161270 2024-03-19T06:21:55.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.744+0000 7f6946c00640 1 -- 172.21.15.32:0/1994852825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69400749e0 con 0x7f6940161270 2024-03-19T06:21:55.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.744+0000 7f693cc00640 1 -- 172.21.15.32:0/1994852825 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f693800da20 con 0x7f6940161270 2024-03-19T06:21:55.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.744+0000 7f693cc00640 1 --2- 172.21.15.32:0/1994852825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f691c067660 0x7f691c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.744+0000 7f693cc00640 1 -- 172.21.15.32:0/1994852825 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f69380862f0 con 0x7f6940161270 2024-03-19T06:21:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.744+0000 7f693fe00640 1 --2- 172.21.15.32:0/1994852825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f691c067660 0x7f691c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:55.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.748+0000 7f693fe00640 1 --2- 172.21.15.32:0/1994852825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f691c067660 0x7f691c069b20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f69300af000 tx=0x7f69300a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:55.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.748+0000 7f693cc00640 1 -- 172.21.15.32:0/1994852825 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f6938056800 con 0x7f6940161270 2024-03-19T06:21:55.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.924+0000 7f6946c00640 1 -- 172.21.15.32:0/1994852825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f694006d420 con 0x7f6940161270 2024-03-19T06:21:55.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.924+0000 7f693cc00640 1 -- 172.21.15.32:0/1994852825 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f693805a8a0 con 0x7f6940161270 2024-03-19T06:21:55.916 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:21:55.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.924+0000 7f6946c00640 1 -- 172.21.15.32:0/1994852825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f691c067660 msgr2=0x7f691c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.924+0000 7f6946c00640 1 --2- 172.21.15.32:0/1994852825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f691c067660 0x7f691c069b20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f69300af000 tx=0x7f69300a7000 comp rx=0 tx=0).stop 2024-03-19T06:21:55.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.924+0000 7f6946c00640 1 -- 172.21.15.32:0/1994852825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6940161270 msgr2=0x7f694015bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:55.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.924+0000 7f6946c00640 1 --2- 172.21.15.32:0/1994852825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6940161270 0x7f694015bc70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f693800cea0 tx=0x7f693800cf90 comp rx=0 tx=0).stop 2024-03-19T06:21:55.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.924+0000 7f6946c00640 1 -- 172.21.15.32:0/1994852825 shutdown_connections 2024-03-19T06:21:55.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.924+0000 7f6946c00640 1 --2- 172.21.15.32:0/1994852825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f691c067660 0x7f691c069b20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.924+0000 7f6946c00640 1 --2- 172.21.15.32:0/1994852825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6940161270 0x7f694015bc70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.924+0000 7f6946c00640 1 --2- 172.21.15.32:0/1994852825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69400cfa70 0x7f69400c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.928+0000 7f6946c00640 1 --2- 172.21.15.32:0/1994852825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69400cc2e0 0x7f69400c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:55.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.928+0000 7f6946c00640 1 -- 172.21.15.32:0/1994852825 >> 172.21.15.32:0/1994852825 conn(0x7f69400b2250 msgr2=0x7f694006e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:55.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.928+0000 7f6946c00640 1 -- 172.21.15.32:0/1994852825 shutdown_connections 2024-03-19T06:21:55.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:55.928+0000 7f6946c00640 1 -- 172.21.15.32:0/1994852825 wait complete. 2024-03-19T06:21:55.938 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:21:55.938 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:21:55.948 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:56.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24ee800640 1 Processor -- start 2024-03-19T06:21:56.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24ee800640 1 -- start start 2024-03-19T06:21:56.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24ee800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f24e80aecf0 0x7f24e80ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24ee800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e815fe20 con 0x7f24e815c010 2024-03-19T06:21:56.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24ee800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e8160100 con 0x7f24e806d6c0 2024-03-19T06:21:56.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24ee800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e81603e0 con 0x7f24e80aecf0 2024-03-19T06:21:56.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24dfe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f24e815c010 0x7f24e815f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47698/0 (socket says 172.21.15.32:47698) 2024-03-19T06:21:56.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24dfe00640 1 -- 172.21.15.32:0/2771074477 learned_addr learned my addr 172.21.15.32:0/2771074477 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:56.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24e6a00640 1 -- 172.21.15.32:0/2771074477 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987054062 0 0) 0x7f24e815fe20 con 0x7f24e815c010 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24e6a00640 1 -- 172.21.15.32:0/2771074477 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24cc003530 con 0x7f24e815c010 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24e7400640 1 --2- 172.21.15.32:0/2771074477 >> v2:172.21.15.171:3300/0 conn(0x7f24e80aecf0 0x7f24e80ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24e6a00640 1 -- 172.21.15.32:0/2771074477 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1425444232 0 0) 0x7f24cc003530 con 0x7f24e815c010 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24e6a00640 1 -- 172.21.15.32:0/2771074477 >> v2:172.21.15.171:3300/0 conn(0x7f24e80aecf0 msgr2=0x7f24e80ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24e6a00640 1 --2- 172.21.15.32:0/2771074477 >> v2:172.21.15.171:3300/0 conn(0x7f24e80aecf0 0x7f24e80ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24e6a00640 1 -- 172.21.15.32:0/2771074477 >> v1:172.21.15.171:6789/0 conn(0x7f24e806d6c0 legacy=0x7f24e80cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24e6a00640 1 -- 172.21.15.32:0/2771074477 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e80ca1f0 con 0x7f24e815c010 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24e6a00640 1 -- 172.21.15.32:0/2771074477 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f24d0001680 con 0x7f24e815c010 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24e6a00640 1 -- 172.21.15.32:0/2771074477 >> v1:172.21.15.32:6789/0 conn(0x7f24e815c010 legacy=0x7f24e815f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.096+0000 7f24e6a00640 1 --2- 172.21.15.32:0/2771074477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24cc003a10 0x7f24cc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.100+0000 7f24e6a00640 1 --2- 172.21.15.32:0/2771074477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24cc004810 0x7f24cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.100+0000 7f24e6a00640 1 --2- 172.21.15.32:0/2771074477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24cc0052f0 0x7f24cc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.100+0000 7f24e6a00640 1 -- 172.21.15.32:0/2771074477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e81603e0 con 0x7f24cc003a10 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.100+0000 7f24e6a00640 1 -- 172.21.15.32:0/2771074477 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc00c210 con 0x7f24cc0052f0 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.100+0000 7f24e6a00640 1 -- 172.21.15.32:0/2771074477 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc00c410 con 0x7f24cc004810 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.100+0000 7f24e7400640 1 --2- 172.21.15.32:0/2771074477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24cc003a10 0x7f24cc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.100+0000 7f24dfe00640 1 --2- 172.21.15.32:0/2771074477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24cc004810 0x7f24cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.100+0000 7f24e7e00640 1 --2- 172.21.15.32:0/2771074477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24cc0052f0 0x7f24cc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.100+0000 7f24e7400640 1 -- 172.21.15.32:0/2771074477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24cc004810 msgr2=0x7f24cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:56.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.100+0000 7f24e7400640 1 --2- 172.21.15.32:0/2771074477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24cc004810 0x7f24cc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.100+0000 7f24e7400640 1 -- 172.21.15.32:0/2771074477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24cc0052f0 msgr2=0x7f24cc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:56.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.100+0000 7f24e7400640 1 --2- 172.21.15.32:0/2771074477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24cc0052f0 0x7f24cc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.100+0000 7f24e7400640 1 -- 172.21.15.32:0/2771074477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc003530 con 0x7f24cc003a10 2024-03-19T06:21:56.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.100+0000 7f24e7e00640 1 --2- 172.21.15.32:0/2771074477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24cc0052f0 0x7f24cc00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:56.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.100+0000 7f24e7e00640 1 -- 172.21.15.32:0/2771074477 reap_dead start 2024-03-19T06:21:56.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.100+0000 7f24e7400640 1 --2- 172.21.15.32:0/2771074477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24cc003a10 0x7f24cc003e30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f24d800ba30 tx=0x7f24d801c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8223c84c6dd91b00 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:56.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24e6a00640 1 -- 172.21.15.32:0/2771074477 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d800b600 con 0x7f24cc003a10 2024-03-19T06:21:56.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24e6a00640 1 -- 172.21.15.32:0/2771074477 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d80b1070 con 0x7f24cc003a10 2024-03-19T06:21:56.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24e6a00640 1 -- 172.21.15.32:0/2771074477 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d80ac840 con 0x7f24cc003a10 2024-03-19T06:21:56.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24ee800640 1 -- 172.21.15.32:0/2771074477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24cc003a10 msgr2=0x7f24cc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24ee800640 1 --2- 172.21.15.32:0/2771074477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24cc003a10 0x7f24cc003e30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f24d800ba30 tx=0x7f24d801c6a0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24ee800640 1 -- 172.21.15.32:0/2771074477 shutdown_connections 2024-03-19T06:21:56.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24ee800640 1 --2- 172.21.15.32:0/2771074477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24cc003a10 0x7f24cc003e30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24ee800640 1 -- 172.21.15.32:0/2771074477 >> 172.21.15.32:0/2771074477 conn(0x7f24e80b1280 msgr2=0x7f24e80b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:56.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24ee800640 1 -- 172.21.15.32:0/2771074477 shutdown_connections 2024-03-19T06:21:56.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24ee800640 1 -- 172.21.15.32:0/2771074477 wait complete. 2024-03-19T06:21:56.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24ee800640 1 Processor -- start 2024-03-19T06:21:56.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24ee800640 1 -- start start 2024-03-19T06:21:56.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24ee800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24cc003a10 0x7f24e81e7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24ee800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24e80c8b60 0x7f24e81e9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24ee800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24e80c8fe0 0x7f24e8148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24ee800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e815f8b0 con 0x7f24cc003a10 2024-03-19T06:21:56.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24ee800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e815f730 con 0x7f24e80c8b60 2024-03-19T06:21:56.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24ee800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e815fa30 con 0x7f24e80c8fe0 2024-03-19T06:21:56.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24e7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24cc003a10 0x7f24e81e7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24e7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24cc003a10 0x7f24e81e7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47486/0 (socket says 172.21.15.32:47486) 2024-03-19T06:21:56.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24e7400640 1 -- 172.21.15.32:0/1044506540 learned_addr learned my addr 172.21.15.32:0/1044506540 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:56.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24e7e00640 1 --2- 172.21.15.32:0/1044506540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24e80c8fe0 0x7f24e8148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.104+0000 7f24dfe00640 1 --2- 172.21.15.32:0/1044506540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24e80c8b60 0x7f24e81e9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24e7400640 1 -- 172.21.15.32:0/1044506540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24e80c8fe0 msgr2=0x7f24e8148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24e7400640 1 --2- 172.21.15.32:0/1044506540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24e80c8fe0 0x7f24e8148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24e7400640 1 -- 172.21.15.32:0/1044506540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24e80c8b60 msgr2=0x7f24e81e9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24e7400640 1 --2- 172.21.15.32:0/1044506540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24e80c8b60 0x7f24e81e9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24e7400640 1 -- 172.21.15.32:0/1044506540 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e81e78b0 con 0x7f24cc003a10 2024-03-19T06:21:56.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24e7e00640 1 --2- 172.21.15.32:0/1044506540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24e80c8fe0 0x7f24e8148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:56.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24dfe00640 1 --2- 172.21.15.32:0/1044506540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24e80c8b60 0x7f24e81e9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:56.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24e7400640 1 --2- 172.21.15.32:0/1044506540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24cc003a10 0x7f24e81e7370 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f24d80ae040 tx=0x7f24cc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:56.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24df400640 1 -- 172.21.15.32:0/1044506540 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d80bb070 con 0x7f24cc003a10 2024-03-19T06:21:56.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24df400640 1 -- 172.21.15.32:0/1044506540 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d8004220 con 0x7f24cc003a10 2024-03-19T06:21:56.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24df400640 1 -- 172.21.15.32:0/1044506540 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8003620 con 0x7f24cc003a10 2024-03-19T06:21:56.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24ee800640 1 -- 172.21.15.32:0/1044506540 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e81fa800 con 0x7f24cc003a10 2024-03-19T06:21:56.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24ee800640 1 -- 172.21.15.32:0/1044506540 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e81fadc0 con 0x7f24cc003a10 2024-03-19T06:21:56.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24ee800640 1 -- 172.21.15.32:0/1044506540 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e80749e0 con 0x7f24cc003a10 2024-03-19T06:21:56.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24df400640 1 -- 172.21.15.32:0/1044506540 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f24d80ab070 con 0x7f24cc003a10 2024-03-19T06:21:56.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24df400640 1 --2- 172.21.15.32:0/1044506540 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f24c4067660 0x7f24c4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24df400640 1 -- 172.21.15.32:0/1044506540 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f24d811f970 con 0x7f24cc003a10 2024-03-19T06:21:56.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.108+0000 7f24dfe00640 1 --2- 172.21.15.32:0/1044506540 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f24c4067660 0x7f24c4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.112+0000 7f24dfe00640 1 --2- 172.21.15.32:0/1044506540 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f24c4067660 0x7f24c4069b20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f24d0001060 tx=0x7f24d0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:56.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.112+0000 7f24df400640 1 -- 172.21.15.32:0/1044506540 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f24d80163b0 con 0x7f24cc003a10 2024-03-19T06:21:56.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.276+0000 7f24ee800640 1 -- 172.21.15.32:0/1044506540 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24e8067740 con 0x7f24cc003a10 2024-03-19T06:21:56.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.276+0000 7f24df400640 1 -- 172.21.15.32:0/1044506540 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f24d80f0680 con 0x7f24cc003a10 2024-03-19T06:21:56.270 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:56.270 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":24,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:51.568754+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:56.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.280+0000 7f24ee800640 1 -- 172.21.15.32:0/1044506540 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f24c4067660 msgr2=0x7f24c4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.280+0000 7f24ee800640 1 --2- 172.21.15.32:0/1044506540 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f24c4067660 0x7f24c4069b20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f24d0001060 tx=0x7f24d0009040 comp rx=0 tx=0).stop 2024-03-19T06:21:56.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.280+0000 7f24ee800640 1 -- 172.21.15.32:0/1044506540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24cc003a10 msgr2=0x7f24e81e7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.280+0000 7f24ee800640 1 --2- 172.21.15.32:0/1044506540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24cc003a10 0x7f24e81e7370 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f24d80ae040 tx=0x7f24cc005840 comp rx=0 tx=0).stop 2024-03-19T06:21:56.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.280+0000 7f24ee800640 1 -- 172.21.15.32:0/1044506540 shutdown_connections 2024-03-19T06:21:56.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.280+0000 7f24ee800640 1 --2- 172.21.15.32:0/1044506540 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f24c4067660 0x7f24c4069b20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.280+0000 7f24ee800640 1 --2- 172.21.15.32:0/1044506540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24e80c8fe0 0x7f24e8148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.280+0000 7f24ee800640 1 --2- 172.21.15.32:0/1044506540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24e80c8b60 0x7f24e81e9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.280+0000 7f24ee800640 1 --2- 172.21.15.32:0/1044506540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24cc003a10 0x7f24e81e7370 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.280+0000 7f24ee800640 1 -- 172.21.15.32:0/1044506540 >> 172.21.15.32:0/1044506540 conn(0x7f24e80b1280 msgr2=0x7f24e80af1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:56.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.280+0000 7f24ee800640 1 -- 172.21.15.32:0/1044506540 shutdown_connections 2024-03-19T06:21:56.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.280+0000 7f24ee800640 1 -- 172.21.15.32:0/1044506540 wait complete. 2024-03-19T06:21:56.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:21:07.089673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:21:07.801319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:56.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:56.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.444+0000 7f1457c00640 1 Processor -- start 2024-03-19T06:21:56.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.444+0000 7f1457c00640 1 -- start start 2024-03-19T06:21:56.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.444+0000 7f1457c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f14500b3b40 0x7f14500cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.444+0000 7f1457c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14500d14b0 con 0x7f145015ba00 2024-03-19T06:21:56.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.444+0000 7f1457c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14500d1790 con 0x7f14500b36d0 2024-03-19T06:21:56.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.444+0000 7f1457c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14500d20c0 con 0x7f14500b3b40 2024-03-19T06:21:56.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.444+0000 7f1455200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f145015ba00 0x7f14500b6ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47714/0 (socket says 172.21.15.32:47714) 2024-03-19T06:21:56.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.444+0000 7f1455200640 1 -- 172.21.15.32:0/266978937 learned_addr learned my addr 172.21.15.32:0/266978937 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:56.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.444+0000 7f1455c00640 1 --2- 172.21.15.32:0/266978937 >> v2:172.21.15.32:3300/0 conn(0x7f14500b3b40 0x7f14500cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.444+0000 7f1455c00640 1 -- 172.21.15.32:0/266978937 >> v1:172.21.15.171:6789/0 conn(0x7f14500b36d0 legacy=0x7f14500cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.444+0000 7f1455c00640 1 -- 172.21.15.32:0/266978937 >> v1:172.21.15.32:6789/0 conn(0x7f145015ba00 legacy=0x7f14500b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.444+0000 7f1455c00640 1 -- 172.21.15.32:0/266978937 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14500d1a70 con 0x7f14500b3b40 2024-03-19T06:21:56.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.444+0000 7f144fe00640 1 -- 172.21.15.32:0/266978937 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818709981 0 0) 0x7f14500d1790 con 0x7f14500b36d0 2024-03-19T06:21:56.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.448+0000 7f1455c00640 1 --2- 172.21.15.32:0/266978937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14500b3b40 0x7f14500cfff0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f14500d2240 tx=0x7f144801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0950ece51acb583 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:56.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.448+0000 7f144fe00640 1 -- 172.21.15.32:0/266978937 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14480b2070 con 0x7f14500b3b40 2024-03-19T06:21:56.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.448+0000 7f144fe00640 1 -- 172.21.15.32:0/266978937 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14480a58d0 con 0x7f14500b3b40 2024-03-19T06:21:56.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.448+0000 7f144fe00640 1 -- 172.21.15.32:0/266978937 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14480a5ca0 con 0x7f14500b3b40 2024-03-19T06:21:56.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.448+0000 7f1457c00640 1 -- 172.21.15.32:0/266978937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14500b3b40 msgr2=0x7f14500cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.448+0000 7f1457c00640 1 --2- 172.21.15.32:0/266978937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14500b3b40 0x7f14500cfff0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f14500d2240 tx=0x7f144801c870 comp rx=0 tx=0).stop 2024-03-19T06:21:56.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.448+0000 7f1457c00640 1 -- 172.21.15.32:0/266978937 shutdown_connections 2024-03-19T06:21:56.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.448+0000 7f1457c00640 1 --2- 172.21.15.32:0/266978937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14500b3b40 0x7f14500cfff0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.448+0000 7f1457c00640 1 -- 172.21.15.32:0/266978937 >> 172.21.15.32:0/266978937 conn(0x7f1450066ca0 msgr2=0x7f14500670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:56.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.448+0000 7f1457c00640 1 -- 172.21.15.32:0/266978937 shutdown_connections 2024-03-19T06:21:56.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.448+0000 7f1457c00640 1 -- 172.21.15.32:0/266978937 wait complete. 2024-03-19T06:21:56.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1457c00640 1 Processor -- start 2024-03-19T06:21:56.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1457c00640 1 -- start start 2024-03-19T06:21:56.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1457c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14500b36d0 0x7f145015a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1457c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14500b3b40 0x7f14500c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1457c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f145015ba00 0x7f14500c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1457c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14500b3f40 con 0x7f14500b3b40 2024-03-19T06:21:56.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1457c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14500b7700 con 0x7f14500b36d0 2024-03-19T06:21:56.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1457c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145015bde0 con 0x7f145015ba00 2024-03-19T06:21:56.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1447e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14500b3b40 0x7f14500c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1447e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14500b3b40 0x7f14500c92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47506/0 (socket says 172.21.15.32:47506) 2024-03-19T06:21:56.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1447e00640 1 -- 172.21.15.32:0/2587964606 learned_addr learned my addr 172.21.15.32:0/2587964606 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:56.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1455c00640 1 --2- 172.21.15.32:0/2587964606 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f145015ba00 0x7f14500c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1455200640 1 --2- 172.21.15.32:0/2587964606 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14500b36d0 0x7f145015a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1447e00640 1 -- 172.21.15.32:0/2587964606 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f145015ba00 msgr2=0x7f14500c73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1447e00640 1 --2- 172.21.15.32:0/2587964606 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f145015ba00 0x7f14500c73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1447e00640 1 -- 172.21.15.32:0/2587964606 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14500b36d0 msgr2=0x7f145015a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1447e00640 1 --2- 172.21.15.32:0/2587964606 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14500b36d0 0x7f145015a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1447e00640 1 -- 172.21.15.32:0/2587964606 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145015c680 con 0x7f14500b3b40 2024-03-19T06:21:56.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1455c00640 1 --2- 172.21.15.32:0/2587964606 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f145015ba00 0x7f14500c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:56.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1447e00640 1 --2- 172.21.15.32:0/2587964606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14500b3b40 0x7f14500c92e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f143800c4d0 tx=0x7f143800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:56.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f144d600640 1 -- 172.21.15.32:0/2587964606 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438017070 con 0x7f14500b3b40 2024-03-19T06:21:56.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f144d600640 1 -- 172.21.15.32:0/2587964606 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1438005480 con 0x7f14500b3b40 2024-03-19T06:21:56.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f144d600640 1 -- 172.21.15.32:0/2587964606 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438003840 con 0x7f14500b3b40 2024-03-19T06:21:56.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1457c00640 1 -- 172.21.15.32:0/2587964606 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145015c920 con 0x7f14500b3b40 2024-03-19T06:21:56.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1457c00640 1 -- 172.21.15.32:0/2587964606 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145015cee0 con 0x7f14500b3b40 2024-03-19T06:21:56.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.452+0000 7f1457c00640 1 -- 172.21.15.32:0/2587964606 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14500749e0 con 0x7f14500b3b40 2024-03-19T06:21:56.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.456+0000 7f144d600640 1 -- 172.21.15.32:0/2587964606 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f143801a070 con 0x7f14500b3b40 2024-03-19T06:21:56.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.456+0000 7f144d600640 1 --2- 172.21.15.32:0/2587964606 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f142c067660 0x7f142c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.456+0000 7f144d600640 1 -- 172.21.15.32:0/2587964606 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1438084d00 con 0x7f14500b3b40 2024-03-19T06:21:56.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.456+0000 7f1455200640 1 --2- 172.21.15.32:0/2587964606 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f142c067660 0x7f142c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.456+0000 7f1455200640 1 --2- 172.21.15.32:0/2587964606 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f142c067660 0x7f142c069b20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f14400058b0 tx=0x7f144000b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:56.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.460+0000 7f144d600640 1 -- 172.21.15.32:0/2587964606 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f14380559c0 con 0x7f14500b3b40 2024-03-19T06:21:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.624+0000 7f1457c00640 1 -- 172.21.15.32:0/2587964606 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14500cf0b0 con 0x7f14500b3b40 2024-03-19T06:21:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.624+0000 7f144d600640 1 -- 172.21.15.32:0/2587964606 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14380552c0 con 0x7f14500b3b40 2024-03-19T06:21:56.616 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:56.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.624+0000 7f1457c00640 1 -- 172.21.15.32:0/2587964606 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f142c067660 msgr2=0x7f142c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.624+0000 7f1457c00640 1 --2- 172.21.15.32:0/2587964606 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f142c067660 0x7f142c069b20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f14400058b0 tx=0x7f144000b040 comp rx=0 tx=0).stop 2024-03-19T06:21:56.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.624+0000 7f1457c00640 1 -- 172.21.15.32:0/2587964606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14500b3b40 msgr2=0x7f14500c92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.624+0000 7f1457c00640 1 --2- 172.21.15.32:0/2587964606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14500b3b40 0x7f14500c92e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f143800c4d0 tx=0x7f143800c990 comp rx=0 tx=0).stop 2024-03-19T06:21:56.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.624+0000 7f1457c00640 1 -- 172.21.15.32:0/2587964606 shutdown_connections 2024-03-19T06:21:56.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.624+0000 7f1457c00640 1 --2- 172.21.15.32:0/2587964606 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f142c067660 0x7f142c069b20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.624+0000 7f1457c00640 1 --2- 172.21.15.32:0/2587964606 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f145015ba00 0x7f14500c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.624+0000 7f1457c00640 1 --2- 172.21.15.32:0/2587964606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14500b3b40 0x7f14500c92e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.624+0000 7f1457c00640 1 --2- 172.21.15.32:0/2587964606 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14500b36d0 0x7f145015a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.624+0000 7f1457c00640 1 -- 172.21.15.32:0/2587964606 >> 172.21.15.32:0/2587964606 conn(0x7f1450066ca0 msgr2=0x7f14500b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:56.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.624+0000 7f1457c00640 1 -- 172.21.15.32:0/2587964606 shutdown_connections 2024-03-19T06:21:56.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.624+0000 7f1457c00640 1 -- 172.21.15.32:0/2587964606 wait complete. 2024-03-19T06:21:56.637 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:21:56.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.788+0000 7fde6fe00640 1 Processor -- start 2024-03-19T06:21:56.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.788+0000 7fde6fe00640 1 -- start start 2024-03-19T06:21:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.788+0000 7fde6fe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde700b2960 0x7fde700cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.788+0000 7fde6fe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fde7006c550 0x7fde700d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.788+0000 7fde6fe00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7015dfc0 con 0x7fde7015dbe0 2024-03-19T06:21:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.788+0000 7fde6fe00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde700b1220 con 0x7fde7006c550 2024-03-19T06:21:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.788+0000 7fde6fe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde700ce760 con 0x7fde700b2960 2024-03-19T06:21:56.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.788+0000 7fde6e000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde700b2960 0x7fde700cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.788+0000 7fde6e000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde700b2960 0x7fde700cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:48390/0 (socket says 172.21.15.32:48390) 2024-03-19T06:21:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.788+0000 7fde6e000640 1 -- 172.21.15.32:0/574224002 learned_addr learned my addr 172.21.15.32:0/574224002 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.788+0000 7fde6f400640 1 --2- 172.21.15.32:0/574224002 >> v2:172.21.15.171:3300/0 conn(0x7fde7006c550 0x7fde700d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.788+0000 7fde6ea00640 1 --1- 172.21.15.32:0/574224002 >> v1:172.21.15.171:6789/0 conn(0x7fde7015dbe0 0x7fde700cdf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:37038/0 (socket says 172.21.15.32:37038) 2024-03-19T06:21:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.788+0000 7fde6d600640 1 -- 172.21.15.32:0/574224002 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714480850 0 0) 0x7fde7015dfc0 con 0x7fde7015dbe0 2024-03-19T06:21:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.788+0000 7fde6d600640 1 -- 172.21.15.32:0/574224002 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde54003530 con 0x7fde7015dbe0 2024-03-19T06:21:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.788+0000 7fde6f400640 1 -- 172.21.15.32:0/574224002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde700b2960 msgr2=0x7fde700cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.788+0000 7fde6f400640 1 --2- 172.21.15.32:0/574224002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde700b2960 0x7fde700cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.792+0000 7fde6f400640 1 -- 172.21.15.32:0/574224002 >> v1:172.21.15.171:6789/0 conn(0x7fde7015dbe0 legacy=0x7fde700cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.792+0000 7fde6f400640 1 -- 172.21.15.32:0/574224002 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde700cea40 con 0x7fde7006c550 2024-03-19T06:21:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.792+0000 7fde6e000640 1 --2- 172.21.15.32:0/574224002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde700b2960 0x7fde700cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:21:56.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.792+0000 7fde6f400640 1 --2- 172.21.15.32:0/574224002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde7006c550 0x7fde700d01c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fde68009d90 tx=0x7fde6801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bef811102485667 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:56.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.792+0000 7fde6d600640 1 -- 172.21.15.32:0/574224002 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde680b2070 con 0x7fde7006c550 2024-03-19T06:21:56.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.792+0000 7fde6d600640 1 -- 172.21.15.32:0/574224002 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde680a5940 con 0x7fde7006c550 2024-03-19T06:21:56.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.792+0000 7fde6d600640 1 -- 172.21.15.32:0/574224002 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde680a5d10 con 0x7fde7006c550 2024-03-19T06:21:56.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.792+0000 7fde6fe00640 1 -- 172.21.15.32:0/574224002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde7006c550 msgr2=0x7fde700d01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.792+0000 7fde6fe00640 1 --2- 172.21.15.32:0/574224002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde7006c550 0x7fde700d01c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fde68009d90 tx=0x7fde6801c970 comp rx=0 tx=0).stop 2024-03-19T06:21:56.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.792+0000 7fde6fe00640 1 -- 172.21.15.32:0/574224002 shutdown_connections 2024-03-19T06:21:56.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.792+0000 7fde6fe00640 1 --2- 172.21.15.32:0/574224002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde7006c550 0x7fde700d01c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.792+0000 7fde6fe00640 1 --2- 172.21.15.32:0/574224002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde700b2960 0x7fde700cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.792+0000 7fde6fe00640 1 -- 172.21.15.32:0/574224002 >> 172.21.15.32:0/574224002 conn(0x7fde7008b000 msgr2=0x7fde7008b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:56.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.792+0000 7fde6fe00640 1 -- 172.21.15.32:0/574224002 shutdown_connections 2024-03-19T06:21:56.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.792+0000 7fde6fe00640 1 -- 172.21.15.32:0/574224002 wait complete. 2024-03-19T06:21:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6fe00640 1 Processor -- start 2024-03-19T06:21:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6fe00640 1 -- start start 2024-03-19T06:21:56.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6fe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde7006c550 0x7fde700c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde700b2960 0x7fde700af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6fe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde7015dbe0 0x7fde700af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6fe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde700b2270 con 0x7fde700b2960 2024-03-19T06:21:56.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6fe00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde700b20f0 con 0x7fde7006c550 2024-03-19T06:21:56.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6fe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde700b23f0 con 0x7fde7015dbe0 2024-03-19T06:21:56.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6e000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde700b2960 0x7fde700af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6e000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde700b2960 0x7fde700af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47508/0 (socket says 172.21.15.32:47508) 2024-03-19T06:21:56.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6e000640 1 -- 172.21.15.32:0/998272591 learned_addr learned my addr 172.21.15.32:0/998272591 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:56.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6ea00640 1 --2- 172.21.15.32:0/998272591 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde7006c550 0x7fde700c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6f400640 1 --2- 172.21.15.32:0/998272591 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde7015dbe0 0x7fde700af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6e000640 1 -- 172.21.15.32:0/998272591 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde7015dbe0 msgr2=0x7fde700af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6e000640 1 --2- 172.21.15.32:0/998272591 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde7015dbe0 0x7fde700af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6e000640 1 -- 172.21.15.32:0/998272591 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde7006c550 msgr2=0x7fde700c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6e000640 1 --2- 172.21.15.32:0/998272591 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde7006c550 0x7fde700c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6e000640 1 -- 172.21.15.32:0/998272591 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde700c8ec0 con 0x7fde700b2960 2024-03-19T06:21:56.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6e000640 1 --2- 172.21.15.32:0/998272591 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde700b2960 0x7fde700af370 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00e960 tx=0x7fde5c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:56.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde66a00640 1 -- 172.21.15.32:0/998272591 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c017070 con 0x7fde700b2960 2024-03-19T06:21:56.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde66a00640 1 -- 172.21.15.32:0/998272591 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c00ca00 con 0x7fde700b2960 2024-03-19T06:21:56.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde66a00640 1 -- 172.21.15.32:0/998272591 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c00cdb0 con 0x7fde700b2960 2024-03-19T06:21:56.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6fe00640 1 -- 172.21.15.32:0/998272591 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde700c9210 con 0x7fde700b2960 2024-03-19T06:21:56.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.796+0000 7fde6fe00640 1 -- 172.21.15.32:0/998272591 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde700c97d0 con 0x7fde700b2960 2024-03-19T06:21:56.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.800+0000 7fde6fe00640 1 -- 172.21.15.32:0/998272591 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde70075090 con 0x7fde700b2960 2024-03-19T06:21:56.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.800+0000 7fde66a00640 1 -- 172.21.15.32:0/998272591 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fde5c01a070 con 0x7fde700b2960 2024-03-19T06:21:56.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.800+0000 7fde66a00640 1 --2- 172.21.15.32:0/998272591 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fde50067660 0x7fde50069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:56.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.800+0000 7fde66a00640 1 -- 172.21.15.32:0/998272591 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fde5c085ae0 con 0x7fde700b2960 2024-03-19T06:21:56.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.800+0000 7fde6ea00640 1 --2- 172.21.15.32:0/998272591 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fde50067660 0x7fde50069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:56.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.800+0000 7fde6ea00640 1 --2- 172.21.15.32:0/998272591 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fde50067660 0x7fde50069b20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fde60000f70 tx=0x7fde60007d00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:56.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.804+0000 7fde66a00640 1 -- 172.21.15.32:0/998272591 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fde5c056080 con 0x7fde700b2960 2024-03-19T06:21:56.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.968+0000 7fde6fe00640 1 -- 172.21.15.32:0/998272591 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde700cd7e0 con 0x7fde700b2960 2024-03-19T06:21:56.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.968+0000 7fde66a00640 1 -- 172.21.15.32:0/998272591 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde5c05a120 con 0x7fde700b2960 2024-03-19T06:21:56.962 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:21:56.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.972+0000 7fde6fe00640 1 -- 172.21.15.32:0/998272591 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fde50067660 msgr2=0x7fde50069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.972+0000 7fde6fe00640 1 --2- 172.21.15.32:0/998272591 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fde50067660 0x7fde50069b20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fde60000f70 tx=0x7fde60007d00 comp rx=0 tx=0).stop 2024-03-19T06:21:56.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.972+0000 7fde6fe00640 1 -- 172.21.15.32:0/998272591 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde700b2960 msgr2=0x7fde700af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:56.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.972+0000 7fde6fe00640 1 --2- 172.21.15.32:0/998272591 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde700b2960 0x7fde700af370 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00e960 tx=0x7fde5c00ee20 comp rx=0 tx=0).stop 2024-03-19T06:21:56.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.972+0000 7fde6fe00640 1 -- 172.21.15.32:0/998272591 shutdown_connections 2024-03-19T06:21:56.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.972+0000 7fde6fe00640 1 --2- 172.21.15.32:0/998272591 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fde50067660 0x7fde50069b20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.972+0000 7fde6fe00640 1 --2- 172.21.15.32:0/998272591 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde7015dbe0 0x7fde700af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.972+0000 7fde6fe00640 1 --2- 172.21.15.32:0/998272591 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde700b2960 0x7fde700af370 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.972+0000 7fde6fe00640 1 --2- 172.21.15.32:0/998272591 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde7006c550 0x7fde700c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:56.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.972+0000 7fde6fe00640 1 -- 172.21.15.32:0/998272591 >> 172.21.15.32:0/998272591 conn(0x7fde7008b000 msgr2=0x7fde70074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:56.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.972+0000 7fde6fe00640 1 -- 172.21.15.32:0/998272591 shutdown_connections 2024-03-19T06:21:56.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:56.972+0000 7fde6fe00640 1 -- 172.21.15.32:0/998272591 wait complete. 2024-03-19T06:21:56.982 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:21:57.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.132+0000 7fb170000640 1 Processor -- start 2024-03-19T06:21:57.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.132+0000 7fb170000640 1 -- start start 2024-03-19T06:21:57.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.136+0000 7fb170000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb16806ad40 0x7fb16806b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.136+0000 7fb170000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb16806e320 0x7fb16815bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.136+0000 7fb170000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16806b660 con 0x7fb16806eed0 2024-03-19T06:21:57.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.136+0000 7fb170000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1680cd420 con 0x7fb16806e320 2024-03-19T06:21:57.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.136+0000 7fb170000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16806dbb0 con 0x7fb16806ad40 2024-03-19T06:21:57.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.136+0000 7fb16cc00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb16806eed0 0x7fb1680ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47724/0 (socket says 172.21.15.32:47724) 2024-03-19T06:21:57.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.136+0000 7fb16cc00640 1 -- 172.21.15.32:0/2048255205 learned_addr learned my addr 172.21.15.32:0/2048255205 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:57.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.136+0000 7fb16e000640 1 --2- 172.21.15.32:0/2048255205 >> v2:172.21.15.32:3300/0 conn(0x7fb16806e320 0x7fb16815bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.136+0000 7fb16d600640 1 --2- 172.21.15.32:0/2048255205 >> v2:172.21.15.171:3300/0 conn(0x7fb16806ad40 0x7fb16806b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.136+0000 7fb16e000640 1 -- 172.21.15.32:0/2048255205 >> v2:172.21.15.171:3300/0 conn(0x7fb16806ad40 msgr2=0x7fb16806b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:57.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.136+0000 7fb16e000640 1 --2- 172.21.15.32:0/2048255205 >> v2:172.21.15.171:3300/0 conn(0x7fb16806ad40 0x7fb16806b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.136+0000 7fb16e000640 1 -- 172.21.15.32:0/2048255205 >> v1:172.21.15.32:6789/0 conn(0x7fb16806eed0 legacy=0x7fb1680ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:57.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.136+0000 7fb16e000640 1 -- 172.21.15.32:0/2048255205 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1680cc290 con 0x7fb16806e320 2024-03-19T06:21:57.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.136+0000 7fb16e000640 1 --2- 172.21.15.32:0/2048255205 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb16806e320 0x7fb16815bc50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb1680b24e0 tx=0x7fb16001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7f2dd19138833f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:57.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb167e00640 1 -- 172.21.15.32:0/2048255205 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1600b2070 con 0x7fb16806e320 2024-03-19T06:21:57.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb167e00640 1 -- 172.21.15.32:0/2048255205 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16815c9a0 con 0x7fb16806e320 2024-03-19T06:21:57.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb167e00640 1 -- 172.21.15.32:0/2048255205 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1600a5b50 con 0x7fb16806e320 2024-03-19T06:21:57.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb170000640 1 -- 172.21.15.32:0/2048255205 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb16806e320 msgr2=0x7fb16815bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:57.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb170000640 1 --2- 172.21.15.32:0/2048255205 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb16806e320 0x7fb16815bc50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb1680b24e0 tx=0x7fb16001c870 comp rx=0 tx=0).stop 2024-03-19T06:21:57.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb170000640 1 -- 172.21.15.32:0/2048255205 shutdown_connections 2024-03-19T06:21:57.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb170000640 1 --2- 172.21.15.32:0/2048255205 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb16806e320 0x7fb16815bc50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb170000640 1 --2- 172.21.15.32:0/2048255205 >> v2:172.21.15.171:3300/0 conn(0x7fb16806ad40 0x7fb16806b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb170000640 1 -- 172.21.15.32:0/2048255205 >> 172.21.15.32:0/2048255205 conn(0x7fb1680b1590 msgr2=0x7fb1680b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:57.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb170000640 1 -- 172.21.15.32:0/2048255205 shutdown_connections 2024-03-19T06:21:57.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb170000640 1 -- 172.21.15.32:0/2048255205 wait complete. 2024-03-19T06:21:57.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb170000640 1 Processor -- start 2024-03-19T06:21:57.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb170000640 1 -- start start 2024-03-19T06:21:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb170000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb16806ad40 0x7fb168150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb170000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb16806e320 0x7fb1681558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb170000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb16806eed0 0x7fb16814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb170000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168168690 con 0x7fb16806e320 2024-03-19T06:21:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb170000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168168510 con 0x7fb16806ad40 2024-03-19T06:21:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb170000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb168168810 con 0x7fb16806eed0 2024-03-19T06:21:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb16cc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb16806e320 0x7fb1681558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb16cc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb16806e320 0x7fb1681558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47530/0 (socket says 172.21.15.32:47530) 2024-03-19T06:21:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb16cc00640 1 -- 172.21.15.32:0/3817364786 learned_addr learned my addr 172.21.15.32:0/3817364786 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb16d600640 1 --2- 172.21.15.32:0/3817364786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb16806ad40 0x7fb168150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.140+0000 7fb16e000640 1 --2- 172.21.15.32:0/3817364786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb16806eed0 0x7fb16814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.144+0000 7fb16cc00640 1 -- 172.21.15.32:0/3817364786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb16806eed0 msgr2=0x7fb16814dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.144+0000 7fb16cc00640 1 --2- 172.21.15.32:0/3817364786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb16806eed0 0x7fb16814dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.144+0000 7fb16cc00640 1 -- 172.21.15.32:0/3817364786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb16806ad40 msgr2=0x7fb168150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.144+0000 7fb16cc00640 1 --2- 172.21.15.32:0/3817364786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb16806ad40 0x7fb168150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.144+0000 7fb16cc00640 1 -- 172.21.15.32:0/3817364786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb168154b20 con 0x7fb16806e320 2024-03-19T06:21:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.144+0000 7fb16cc00640 1 --2- 172.21.15.32:0/3817364786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb16806e320 0x7fb1681558e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb15400c370 tx=0x7fb15400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.144+0000 7fb165600640 1 -- 172.21.15.32:0/3817364786 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154017070 con 0x7fb16806e320 2024-03-19T06:21:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.144+0000 7fb165600640 1 -- 172.21.15.32:0/3817364786 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb154005cf0 con 0x7fb16806e320 2024-03-19T06:21:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.144+0000 7fb165600640 1 -- 172.21.15.32:0/3817364786 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1540072f0 con 0x7fb16806e320 2024-03-19T06:21:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.144+0000 7fb170000640 1 -- 172.21.15.32:0/3817364786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb168154e00 con 0x7fb16806e320 2024-03-19T06:21:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.144+0000 7fb170000640 1 -- 172.21.15.32:0/3817364786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1681514d0 con 0x7fb16806e320 2024-03-19T06:21:57.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.144+0000 7fb170000640 1 -- 172.21.15.32:0/3817364786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1680749e0 con 0x7fb16806e320 2024-03-19T06:21:57.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.144+0000 7fb165600640 1 -- 172.21.15.32:0/3817364786 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb15401a070 con 0x7fb16806e320 2024-03-19T06:21:57.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.144+0000 7fb165600640 1 --2- 172.21.15.32:0/3817364786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb148067660 0x7fb148069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.144+0000 7fb165600640 1 -- 172.21.15.32:0/3817364786 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb154084cf0 con 0x7fb16806e320 2024-03-19T06:21:57.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.148+0000 7fb16d600640 1 --2- 172.21.15.32:0/3817364786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb148067660 0x7fb148069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.148+0000 7fb16d600640 1 --2- 172.21.15.32:0/3817364786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb148067660 0x7fb148069b20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb16815e600 tx=0x7fb15c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:57.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.148+0000 7fb165600640 1 -- 172.21.15.32:0/3817364786 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fb154055200 con 0x7fb16806e320 2024-03-19T06:21:57.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.312+0000 7fb170000640 1 -- 172.21.15.32:0/3817364786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb168154fd0 con 0x7fb16806e320 2024-03-19T06:21:57.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.312+0000 7fb165600640 1 -- 172.21.15.32:0/3817364786 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1540592a0 con 0x7fb16806e320 2024-03-19T06:21:57.304 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:21:57.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.312+0000 7fb170000640 1 -- 172.21.15.32:0/3817364786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb148067660 msgr2=0x7fb148069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:57.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.312+0000 7fb170000640 1 --2- 172.21.15.32:0/3817364786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb148067660 0x7fb148069b20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb16815e600 tx=0x7fb15c008040 comp rx=0 tx=0).stop 2024-03-19T06:21:57.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.312+0000 7fb170000640 1 -- 172.21.15.32:0/3817364786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb16806e320 msgr2=0x7fb1681558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:57.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.312+0000 7fb170000640 1 --2- 172.21.15.32:0/3817364786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb16806e320 0x7fb1681558e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb15400c370 tx=0x7fb15400c830 comp rx=0 tx=0).stop 2024-03-19T06:21:57.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.312+0000 7fb170000640 1 -- 172.21.15.32:0/3817364786 shutdown_connections 2024-03-19T06:21:57.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.312+0000 7fb170000640 1 --2- 172.21.15.32:0/3817364786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb148067660 0x7fb148069b20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.312+0000 7fb170000640 1 --2- 172.21.15.32:0/3817364786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb16806eed0 0x7fb16814dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.312+0000 7fb170000640 1 --2- 172.21.15.32:0/3817364786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb16806e320 0x7fb1681558e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.312+0000 7fb170000640 1 --2- 172.21.15.32:0/3817364786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb16806ad40 0x7fb168150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.312+0000 7fb170000640 1 -- 172.21.15.32:0/3817364786 >> 172.21.15.32:0/3817364786 conn(0x7fb1680b1590 msgr2=0x7fb168074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:57.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.312+0000 7fb170000640 1 -- 172.21.15.32:0/3817364786 shutdown_connections 2024-03-19T06:21:57.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.312+0000 7fb170000640 1 -- 172.21.15.32:0/3817364786 wait complete. 2024-03-19T06:21:57.325 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:21:57.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.476+0000 7f203b400640 1 Processor -- start 2024-03-19T06:21:57.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.476+0000 7f203b400640 1 -- start start 2024-03-19T06:21:57.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.480+0000 7f203b400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f203415a7c0 0x7f20340cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.480+0000 7f203b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20340b4c50 0x7f20340b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.480+0000 7f203b400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20340cb670 con 0x7f20340cc680 2024-03-19T06:21:57.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.480+0000 7f203b400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20340b5600 con 0x7f203415a7c0 2024-03-19T06:21:57.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.480+0000 7f203b400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203415f400 con 0x7f20340b4c50 2024-03-19T06:21:57.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.480+0000 7f2038a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f203415a7c0 0x7f20340cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.480+0000 7f2038a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f203415a7c0 0x7f20340cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47540/0 (socket says 172.21.15.32:47540) 2024-03-19T06:21:57.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.480+0000 7f2038a00640 1 -- 172.21.15.32:0/3486483206 learned_addr learned my addr 172.21.15.32:0/3486483206 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:57.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.480+0000 7f2039400640 1 --2- 172.21.15.32:0/3486483206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20340b4c50 0x7f20340b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.480+0000 7f2038a00640 1 -- 172.21.15.32:0/3486483206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20340b4c50 msgr2=0x7f20340b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:57.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.480+0000 7f2038a00640 1 --2- 172.21.15.32:0/3486483206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20340b4c50 0x7f20340b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.480+0000 7f2038a00640 1 -- 172.21.15.32:0/3486483206 >> v1:172.21.15.171:6789/0 conn(0x7f20340cc680 legacy=0x7f203415ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:57.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.480+0000 7f2038a00640 1 -- 172.21.15.32:0/3486483206 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20340cb950 con 0x7f203415a7c0 2024-03-19T06:21:57.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.480+0000 7f2039400640 1 --2- 172.21.15.32:0/3486483206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20340b4c50 0x7f20340b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:57.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.484+0000 7f2038a00640 1 --2- 172.21.15.32:0/3486483206 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f203415a7c0 0x7f20340cae20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2028009870 tx=0x7f202801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed65827a111feae9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:57.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.484+0000 7f2033400640 1 -- 172.21.15.32:0/3486483206 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280b2070 con 0x7f203415a7c0 2024-03-19T06:21:57.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.484+0000 7f2033400640 1 -- 172.21.15.32:0/3486483206 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20280ad640 con 0x7f203415a7c0 2024-03-19T06:21:57.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.484+0000 7f2033400640 1 -- 172.21.15.32:0/3486483206 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280ada10 con 0x7f203415a7c0 2024-03-19T06:21:57.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.484+0000 7f203b400640 1 -- 172.21.15.32:0/3486483206 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f203415a7c0 msgr2=0x7f20340cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:57.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.484+0000 7f203b400640 1 --2- 172.21.15.32:0/3486483206 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f203415a7c0 0x7f20340cae20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2028009870 tx=0x7f202801c520 comp rx=0 tx=0).stop 2024-03-19T06:21:57.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.484+0000 7f203b400640 1 -- 172.21.15.32:0/3486483206 shutdown_connections 2024-03-19T06:21:57.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.484+0000 7f203b400640 1 --2- 172.21.15.32:0/3486483206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20340b4c50 0x7f20340b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.484+0000 7f203b400640 1 --2- 172.21.15.32:0/3486483206 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f203415a7c0 0x7f20340cae20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.484+0000 7f203b400640 1 -- 172.21.15.32:0/3486483206 >> 172.21.15.32:0/3486483206 conn(0x7f20340b1280 msgr2=0x7f20340b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:57.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.484+0000 7f203b400640 1 -- 172.21.15.32:0/3486483206 shutdown_connections 2024-03-19T06:21:57.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.484+0000 7f203b400640 1 -- 172.21.15.32:0/3486483206 wait complete. 2024-03-19T06:21:57.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.484+0000 7f203b400640 1 Processor -- start 2024-03-19T06:21:57.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.484+0000 7f203b400640 1 -- start start 2024-03-19T06:21:57.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f203b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20340b4c50 0x7f203415ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f203b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20340cc680 0x7f2034148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f203b400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f203415a7c0 0x7f2034159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f203b400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20340cbdb0 con 0x7f20340cc680 2024-03-19T06:21:57.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f203b400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20340cbc30 con 0x7f203415a7c0 2024-03-19T06:21:57.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f203b400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20341677f0 con 0x7f20340b4c50 2024-03-19T06:21:57.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f2033e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20340cc680 0x7f2034148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f2033e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20340cc680 0x7f2034148f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47556/0 (socket says 172.21.15.32:47556) 2024-03-19T06:21:57.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f2033e00640 1 -- 172.21.15.32:0/1997989660 learned_addr learned my addr 172.21.15.32:0/1997989660 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:57.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f2038a00640 1 --2- 172.21.15.32:0/1997989660 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20340b4c50 0x7f203415ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f2039400640 1 --2- 172.21.15.32:0/1997989660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f203415a7c0 0x7f2034159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f2033e00640 1 -- 172.21.15.32:0/1997989660 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20340b4c50 msgr2=0x7f203415ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f2033e00640 1 --2- 172.21.15.32:0/1997989660 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20340b4c50 0x7f203415ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f2033e00640 1 -- 172.21.15.32:0/1997989660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f203415a7c0 msgr2=0x7f2034159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f2033e00640 1 --2- 172.21.15.32:0/1997989660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f203415a7c0 0x7f2034159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f2033e00640 1 -- 172.21.15.32:0/1997989660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2034151d70 con 0x7f20340cc680 2024-03-19T06:21:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f2033e00640 1 --2- 172.21.15.32:0/1997989660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20340cc680 0x7f2034148f30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f202000b410 tx=0x7f202000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:57.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f2030c00640 1 -- 172.21.15.32:0/1997989660 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020015030 con 0x7f20340cc680 2024-03-19T06:21:57.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f2030c00640 1 -- 172.21.15.32:0/1997989660 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2020004020 con 0x7f20340cc680 2024-03-19T06:21:57.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f2030c00640 1 -- 172.21.15.32:0/1997989660 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020004410 con 0x7f20340cc680 2024-03-19T06:21:57.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f203b400640 1 -- 172.21.15.32:0/1997989660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20341579a0 con 0x7f20340cc680 2024-03-19T06:21:57.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f203b400640 1 -- 172.21.15.32:0/1997989660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2034151fe0 con 0x7f20340cc680 2024-03-19T06:21:57.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.488+0000 7f203b400640 1 -- 172.21.15.32:0/1997989660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20340749e0 con 0x7f20340cc680 2024-03-19T06:21:57.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.492+0000 7f2030c00640 1 -- 172.21.15.32:0/1997989660 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2020018070 con 0x7f20340cc680 2024-03-19T06:21:57.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.492+0000 7f2030c00640 1 --2- 172.21.15.32:0/1997989660 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2014067660 0x7f2014069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.492+0000 7f2030c00640 1 -- 172.21.15.32:0/1997989660 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2020085380 con 0x7f20340cc680 2024-03-19T06:21:57.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.492+0000 7f2038a00640 1 --2- 172.21.15.32:0/1997989660 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2014067660 0x7f2014069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.492+0000 7f2038a00640 1 --2- 172.21.15.32:0/1997989660 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2014067660 0x7f2014069b20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f20280af000 tx=0x7f2028009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:57.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.496+0000 7f2030c00640 1 -- 172.21.15.32:0/1997989660 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2020055f70 con 0x7f20340cc680 2024-03-19T06:21:57.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.668+0000 7f203b400640 1 -- 172.21.15.32:0/1997989660 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f20340cc270 con 0x7f20340cc680 2024-03-19T06:21:57.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.672+0000 7f2030c00640 1 -- 172.21.15.32:0/1997989660 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2020055870 con 0x7f20340cc680 2024-03-19T06:21:57.663 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:21:57.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.672+0000 7f203b400640 1 -- 172.21.15.32:0/1997989660 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2014067660 msgr2=0x7f2014069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:57.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.672+0000 7f203b400640 1 --2- 172.21.15.32:0/1997989660 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2014067660 0x7f2014069b20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f20280af000 tx=0x7f2028009040 comp rx=0 tx=0).stop 2024-03-19T06:21:57.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.672+0000 7f203b400640 1 -- 172.21.15.32:0/1997989660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20340cc680 msgr2=0x7f2034148f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:57.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.672+0000 7f203b400640 1 --2- 172.21.15.32:0/1997989660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20340cc680 0x7f2034148f30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f202000b410 tx=0x7f202000b8d0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.672+0000 7f203b400640 1 -- 172.21.15.32:0/1997989660 shutdown_connections 2024-03-19T06:21:57.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.672+0000 7f203b400640 1 --2- 172.21.15.32:0/1997989660 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2014067660 0x7f2014069b20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.672+0000 7f203b400640 1 --2- 172.21.15.32:0/1997989660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f203415a7c0 0x7f2034159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.672+0000 7f203b400640 1 --2- 172.21.15.32:0/1997989660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20340cc680 0x7f2034148f30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.672+0000 7f203b400640 1 --2- 172.21.15.32:0/1997989660 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20340b4c50 0x7f203415ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.672+0000 7f203b400640 1 -- 172.21.15.32:0/1997989660 >> 172.21.15.32:0/1997989660 conn(0x7f20340b1280 msgr2=0x7f2034071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:57.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.672+0000 7f203b400640 1 -- 172.21.15.32:0/1997989660 shutdown_connections 2024-03-19T06:21:57.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.672+0000 7f203b400640 1 -- 172.21.15.32:0/1997989660 wait complete. 2024-03-19T06:21:57.683 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi171.front.sepia.ceph.com... 2024-03-19T06:21:57.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:57.683 DEBUG:teuthology.orchestra.run.smithi171:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-03-19T06:21:57.705 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:21:57.705 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:21:57.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:21:57.706 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-19T06:21:57.756 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-19T06:21:57.756 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:21:57.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.904+0000 7fe53a200640 1 Processor -- start 2024-03-19T06:21:57.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.904+0000 7fe53a200640 1 -- start start 2024-03-19T06:21:57.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.904+0000 7fe53a200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe5340ae0b0 0x7fe5340acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.904+0000 7fe53a200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe53406c460 0x7fe534154130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.904+0000 7fe53a200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53415e520 con 0x7fe53415dff0 2024-03-19T06:21:57.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.904+0000 7fe53a200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53415f1b0 con 0x7fe5340ae0b0 2024-03-19T06:21:57.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.904+0000 7fe53a200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53415e800 con 0x7fe53406c460 2024-03-19T06:21:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe52be00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe53415dff0 0x7fe53406bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47736/0 (socket says 172.21.15.32:47736) 2024-03-19T06:21:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe52be00640 1 -- 172.21.15.32:0/829599424 learned_addr learned my addr 172.21.15.32:0/829599424 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe533400640 1 --2- 172.21.15.32:0/829599424 >> v2:172.21.15.171:3300/0 conn(0x7fe5340ae0b0 0x7fe5340acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe533e00640 1 --2- 172.21.15.32:0/829599424 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe53406c460 0x7fe534154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe532a00640 1 -- 172.21.15.32:0/829599424 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964975284 0 0) 0x7fe53415e520 con 0x7fe53415dff0 2024-03-19T06:21:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe532a00640 1 -- 172.21.15.32:0/829599424 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe518003530 con 0x7fe53415dff0 2024-03-19T06:21:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe532a00640 1 -- 172.21.15.32:0/829599424 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3518069264 0 0) 0x7fe518003530 con 0x7fe53415dff0 2024-03-19T06:21:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe532a00640 1 -- 172.21.15.32:0/829599424 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe53406c460 msgr2=0x7fe534154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe532a00640 1 --2- 172.21.15.32:0/829599424 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe53406c460 0x7fe534154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe532a00640 1 -- 172.21.15.32:0/829599424 >> v2:172.21.15.171:3300/0 conn(0x7fe5340ae0b0 msgr2=0x7fe5340acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe532a00640 1 --2- 172.21.15.32:0/829599424 >> v2:172.21.15.171:3300/0 conn(0x7fe5340ae0b0 0x7fe5340acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe532a00640 1 -- 172.21.15.32:0/829599424 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53415eae0 con 0x7fe53415dff0 2024-03-19T06:21:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe532a00640 1 -- 172.21.15.32:0/829599424 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fe51c001680 con 0x7fe53415dff0 2024-03-19T06:21:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe532a00640 1 -- 172.21.15.32:0/829599424 >> v1:172.21.15.32:6789/0 conn(0x7fe53415dff0 legacy=0x7fe53406bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:57.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe532a00640 1 --2- 172.21.15.32:0/829599424 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe53406c460 0x7fe5180039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe532a00640 1 --2- 172.21.15.32:0/829599424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe518003f40 0x7fe518004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe532a00640 1 --2- 172.21.15.32:0/829599424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe518004d50 0x7fe5180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe532a00640 1 -- 172.21.15.32:0/829599424 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53415f1b0 con 0x7fe518004d50 2024-03-19T06:21:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe532a00640 1 -- 172.21.15.32:0/829599424 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53415e800 con 0x7fe518003f40 2024-03-19T06:21:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe532a00640 1 -- 172.21.15.32:0/829599424 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51800b9d0 con 0x7fe53406c460 2024-03-19T06:21:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe533e00640 1 --2- 172.21.15.32:0/829599424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe518004d50 0x7fe5180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe533400640 1 --2- 172.21.15.32:0/829599424 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe53406c460 0x7fe5180039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe52be00640 1 --2- 172.21.15.32:0/829599424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe518003f40 0x7fe518004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe533e00640 1 -- 172.21.15.32:0/829599424 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe53406c460 msgr2=0x7fe5180039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe533e00640 1 --2- 172.21.15.32:0/829599424 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe53406c460 0x7fe5180039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe533e00640 1 -- 172.21.15.32:0/829599424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe518003f40 msgr2=0x7fe518004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe533e00640 1 --2- 172.21.15.32:0/829599424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe518003f40 0x7fe518004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe533e00640 1 -- 172.21.15.32:0/829599424 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe518003530 con 0x7fe518004d50 2024-03-19T06:21:57.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.908+0000 7fe52be00640 1 --2- 172.21.15.32:0/829599424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe518003f40 0x7fe518004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:57.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.912+0000 7fe533e00640 1 --2- 172.21.15.32:0/829599424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe518004d50 0x7fe5180051d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009f90 tx=0x7fe52c01cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9e1fff2e177e0a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:57.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.912+0000 7fe532a00640 1 -- 172.21.15.32:0/829599424 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0b2070 con 0x7fe518004d50 2024-03-19T06:21:57.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.912+0000 7fe532a00640 1 -- 172.21.15.32:0/829599424 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c0a5c50 con 0x7fe518004d50 2024-03-19T06:21:57.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.912+0000 7fe532a00640 1 -- 172.21.15.32:0/829599424 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c009c10 con 0x7fe518004d50 2024-03-19T06:21:57.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.912+0000 7fe53a200640 1 -- 172.21.15.32:0/829599424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe518004d50 msgr2=0x7fe5180051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:57.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.912+0000 7fe53a200640 1 --2- 172.21.15.32:0/829599424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe518004d50 0x7fe5180051d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009f90 tx=0x7fe52c01cbe0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.912+0000 7fe533e00640 1 -- 172.21.15.32:0/829599424 reap_dead start 2024-03-19T06:21:57.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.912+0000 7fe53a200640 1 -- 172.21.15.32:0/829599424 shutdown_connections 2024-03-19T06:21:57.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.912+0000 7fe53a200640 1 -- 172.21.15.32:0/829599424 >> 172.21.15.32:0/829599424 conn(0x7fe534071c50 msgr2=0x7fe534072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:57.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.912+0000 7fe53a200640 1 -- 172.21.15.32:0/829599424 shutdown_connections 2024-03-19T06:21:57.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.912+0000 7fe53a200640 1 -- 172.21.15.32:0/829599424 wait complete. 2024-03-19T06:21:57.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.912+0000 7fe53a200640 1 Processor -- start 2024-03-19T06:21:57.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.912+0000 7fe53a200640 1 -- start start 2024-03-19T06:21:57.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe53a200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe518004d50 0x7fe5341536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe53a200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe534159bf0 0x7fe53415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe53a200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe53415d1a0 0x7fe534155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe53a200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340ae490 con 0x7fe53415d1a0 2024-03-19T06:21:57.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe53a200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe534072d60 con 0x7fe518004d50 2024-03-19T06:21:57.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe53a200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe534154130 con 0x7fe534159bf0 2024-03-19T06:21:57.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe533e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe53415d1a0 0x7fe534155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe533e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe53415d1a0 0x7fe534155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47580/0 (socket says 172.21.15.32:47580) 2024-03-19T06:21:57.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe533e00640 1 -- 172.21.15.32:0/2714174701 learned_addr learned my addr 172.21.15.32:0/2714174701 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:57.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe533400640 1 --2- 172.21.15.32:0/2714174701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe518004d50 0x7fe5341536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe533e00640 1 -- 172.21.15.32:0/2714174701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe534159bf0 msgr2=0x7fe53415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:57.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe52be00640 1 --2- 172.21.15.32:0/2714174701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe534159bf0 0x7fe53415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe533e00640 1 --2- 172.21.15.32:0/2714174701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe534159bf0 0x7fe53415cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe533e00640 1 -- 172.21.15.32:0/2714174701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe518004d50 msgr2=0x7fe5341536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:57.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe533e00640 1 --2- 172.21.15.32:0/2714174701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe518004d50 0x7fe5341536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:57.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe533e00640 1 -- 172.21.15.32:0/2714174701 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5341f6b20 con 0x7fe53415d1a0 2024-03-19T06:21:57.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe533400640 1 --2- 172.21.15.32:0/2714174701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe518004d50 0x7fe5341536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:57.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe52be00640 1 --2- 172.21.15.32:0/2714174701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe534159bf0 0x7fe53415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:57.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe533e00640 1 --2- 172.21.15.32:0/2714174701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe53415d1a0 0x7fe534155520 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009f90 tx=0x7fe52c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:57.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe52b400640 1 -- 172.21.15.32:0/2714174701 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0bd070 con 0x7fe53415d1a0 2024-03-19T06:21:57.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe52b400640 1 -- 172.21.15.32:0/2714174701 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c0a5a50 con 0x7fe53415d1a0 2024-03-19T06:21:57.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe52b400640 1 -- 172.21.15.32:0/2714174701 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0b2040 con 0x7fe53415d1a0 2024-03-19T06:21:57.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe53a200640 1 -- 172.21.15.32:0/2714174701 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5341f6dc0 con 0x7fe53415d1a0 2024-03-19T06:21:57.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe53a200640 1 -- 172.21.15.32:0/2714174701 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5341f7380 con 0x7fe53415d1a0 2024-03-19T06:21:57.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe53a200640 1 -- 172.21.15.32:0/2714174701 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53415d620 con 0x7fe53415d1a0 2024-03-19T06:21:57.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.916+0000 7fe52b400640 1 -- 172.21.15.32:0/2714174701 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe52c0c0070 con 0x7fe53415d1a0 2024-03-19T06:21:57.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.920+0000 7fe52b400640 1 --2- 172.21.15.32:0/2714174701 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe510067660 0x7fe510069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:57.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.920+0000 7fe52b400640 1 -- 172.21.15.32:0/2714174701 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe52c11f5a0 con 0x7fe53415d1a0 2024-03-19T06:21:57.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.920+0000 7fe533400640 1 --2- 172.21.15.32:0/2714174701 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe510067660 0x7fe510069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:57.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.920+0000 7fe533400640 1 --2- 172.21.15.32:0/2714174701 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe510067660 0x7fe510069b20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe524009aa0 tx=0x7fe524008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:57.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:57.924+0000 7fe52b400640 1 -- 172.21.15.32:0/2714174701 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fe52c016950 con 0x7fe53415d1a0 2024-03-19T06:21:58.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.120+0000 7fe53a200640 1 -- 172.21.15.32:0/2714174701 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5340749e0 con 0x7fe53415d1a0 2024-03-19T06:21:58.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.120+0000 7fe52b400640 1 -- 172.21.15.32:0/2714174701 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4935 (secure 0 0 0) 0x7fe52c0a5c20 con 0x7fe53415d1a0 2024-03-19T06:21:58.112 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:58.112 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/3555048948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3555048948},{"type":"v1","addr":"172.21.15.32:6834","nonce":3555048948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3484789829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3484789829},{"type":"v1","addr":"172.21.15.171:6836","nonce":3484789829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/851750022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":851750022},{"type":"v1","addr":"172.21.15.171:6837","nonce":851750022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:21:08.817580+0000","modified":"2024-03-19T06:21:11.829499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/1902889035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":1902889035},{"type":"v1","addr":"172.21.15.32:6835","nonce":1902889035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-19T06:21:58.112 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-03-19T06:21:58.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.120+0000 7fe53a200640 1 -- 172.21.15.32:0/2714174701 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe510067660 msgr2=0x7fe510069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:58.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.120+0000 7fe53a200640 1 --2- 172.21.15.32:0/2714174701 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe510067660 0x7fe510069b20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe524009aa0 tx=0x7fe524008040 comp rx=0 tx=0).stop 2024-03-19T06:21:58.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.120+0000 7fe53a200640 1 -- 172.21.15.32:0/2714174701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe53415d1a0 msgr2=0x7fe534155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:58.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.120+0000 7fe53a200640 1 --2- 172.21.15.32:0/2714174701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe53415d1a0 0x7fe534155520 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009f90 tx=0x7fe52c009750 comp rx=0 tx=0).stop 2024-03-19T06:21:58.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.120+0000 7fe53a200640 1 -- 172.21.15.32:0/2714174701 shutdown_connections 2024-03-19T06:21:58.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.120+0000 7fe53a200640 1 --2- 172.21.15.32:0/2714174701 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe510067660 0x7fe510069b20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.120+0000 7fe53a200640 1 --2- 172.21.15.32:0/2714174701 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe53415d1a0 0x7fe534155520 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.120+0000 7fe53a200640 1 --2- 172.21.15.32:0/2714174701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe534159bf0 0x7fe53415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.120+0000 7fe53a200640 1 --2- 172.21.15.32:0/2714174701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe518004d50 0x7fe5341536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.120+0000 7fe53a200640 1 -- 172.21.15.32:0/2714174701 >> 172.21.15.32:0/2714174701 conn(0x7fe534071c50 msgr2=0x7fe5340b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:58.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.120+0000 7fe53a200640 1 -- 172.21.15.32:0/2714174701 shutdown_connections 2024-03-19T06:21:58.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.120+0000 7fe53a200640 1 -- 172.21.15.32:0/2714174701 wait complete. 2024-03-19T06:21:58.133 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:21:58.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.280+0000 7f5549000640 1 Processor -- start 2024-03-19T06:21:58.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.280+0000 7f5549000640 1 -- start start 2024-03-19T06:21:58.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.280+0000 7f5549000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f55440aecf0 0x7f55440ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.280+0000 7f5549000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f554415c010 0x7f554415f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.284+0000 7f5549000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554415fe20 con 0x7f554406d6c0 2024-03-19T06:21:58.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.284+0000 7f5549000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55441603e0 con 0x7f55440aecf0 2024-03-19T06:21:58.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.284+0000 7f5549000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5544160100 con 0x7f554415c010 2024-03-19T06:21:58.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.284+0000 7f5541e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f55440aecf0 0x7f55440ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.284+0000 7f5542800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f554406d6c0 0x7f55440cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47742/0 (socket says 172.21.15.32:47742) 2024-03-19T06:21:58.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.284+0000 7f5542800640 1 -- 172.21.15.32:0/1204207143 learned_addr learned my addr 172.21.15.32:0/1204207143 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:58.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.284+0000 7f5539400640 1 --2- 172.21.15.32:0/1204207143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f554415c010 0x7f554415f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.284+0000 7f5541e00640 1 -- 172.21.15.32:0/1204207143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f554415c010 msgr2=0x7f554415f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:58.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.284+0000 7f5541e00640 1 --2- 172.21.15.32:0/1204207143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f554415c010 0x7f554415f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.284+0000 7f5541e00640 1 -- 172.21.15.32:0/1204207143 >> v1:172.21.15.32:6789/0 conn(0x7f554406d6c0 legacy=0x7f55440cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:58.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.284+0000 7f5541e00640 1 -- 172.21.15.32:0/1204207143 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55440ca1f0 con 0x7f55440aecf0 2024-03-19T06:21:58.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.284+0000 7f5541400640 1 -- 172.21.15.32:0/1204207143 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305538478 0 0) 0x7f554415fe20 con 0x7f554406d6c0 2024-03-19T06:21:58.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.284+0000 7f5541e00640 1 --2- 172.21.15.32:0/1204207143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55440aecf0 0x7f55440ca9f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f55340097c0 tx=0x7f553401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8faa69783b3d4398 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:58.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.284+0000 7f5541400640 1 -- 172.21.15.32:0/1204207143 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55340b0070 con 0x7f55440aecf0 2024-03-19T06:21:58.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.284+0000 7f5541400640 1 -- 172.21.15.32:0/1204207143 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55340ab600 con 0x7f55440aecf0 2024-03-19T06:21:58.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.284+0000 7f5541400640 1 -- 172.21.15.32:0/1204207143 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55340ab9d0 con 0x7f55440aecf0 2024-03-19T06:21:58.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5549000640 1 -- 172.21.15.32:0/1204207143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55440aecf0 msgr2=0x7f55440ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:58.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5549000640 1 --2- 172.21.15.32:0/1204207143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55440aecf0 0x7f55440ca9f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f55340097c0 tx=0x7f553401c410 comp rx=0 tx=0).stop 2024-03-19T06:21:58.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5549000640 1 -- 172.21.15.32:0/1204207143 shutdown_connections 2024-03-19T06:21:58.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5549000640 1 --2- 172.21.15.32:0/1204207143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f554415c010 0x7f554415f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5549000640 1 --2- 172.21.15.32:0/1204207143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55440aecf0 0x7f55440ca9f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5549000640 1 -- 172.21.15.32:0/1204207143 >> 172.21.15.32:0/1204207143 conn(0x7f55440b1280 msgr2=0x7f55440b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:58.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5549000640 1 -- 172.21.15.32:0/1204207143 shutdown_connections 2024-03-19T06:21:58.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5549000640 1 -- 172.21.15.32:0/1204207143 wait complete. 2024-03-19T06:21:58.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5549000640 1 Processor -- start 2024-03-19T06:21:58.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5549000640 1 -- start start 2024-03-19T06:21:58.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5549000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f554406d6c0 0x7f5544158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5549000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55440aecf0 0x7f55440cf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5549000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f554415c010 0x7f5544162ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5549000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554415fbe0 con 0x7f554406d6c0 2024-03-19T06:21:58.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5549000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554415fa60 con 0x7f55440aecf0 2024-03-19T06:21:58.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5549000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5544168ea0 con 0x7f554415c010 2024-03-19T06:21:58.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5541e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f554406d6c0 0x7f5544158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5541e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f554406d6c0 0x7f5544158400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47610/0 (socket says 172.21.15.32:47610) 2024-03-19T06:21:58.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5541e00640 1 -- 172.21.15.32:0/4170403841 learned_addr learned my addr 172.21.15.32:0/4170403841 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:58.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5539400640 1 --2- 172.21.15.32:0/4170403841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55440aecf0 0x7f55440cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5542800640 1 --2- 172.21.15.32:0/4170403841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f554415c010 0x7f5544162ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5541e00640 1 -- 172.21.15.32:0/4170403841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f554415c010 msgr2=0x7f5544162ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:58.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5541e00640 1 --2- 172.21.15.32:0/4170403841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f554415c010 0x7f5544162ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5541e00640 1 -- 172.21.15.32:0/4170403841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55440aecf0 msgr2=0x7f55440cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:58.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5541e00640 1 --2- 172.21.15.32:0/4170403841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55440aecf0 0x7f55440cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5541e00640 1 -- 172.21.15.32:0/4170403841 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5544161320 con 0x7f554406d6c0 2024-03-19T06:21:58.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.288+0000 7f5539400640 1 --2- 172.21.15.32:0/4170403841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55440aecf0 0x7f55440cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:58.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.292+0000 7f5541e00640 1 --2- 172.21.15.32:0/4170403841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f554406d6c0 0x7f5544158400 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f55340ae040 tx=0x7f553401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:58.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.292+0000 7f553aa00640 1 -- 172.21.15.32:0/4170403841 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55340bb070 con 0x7f554406d6c0 2024-03-19T06:21:58.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.292+0000 7f553aa00640 1 -- 172.21.15.32:0/4170403841 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5534004020 con 0x7f554406d6c0 2024-03-19T06:21:58.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.292+0000 7f553aa00640 1 -- 172.21.15.32:0/4170403841 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55340b0040 con 0x7f554406d6c0 2024-03-19T06:21:58.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.292+0000 7f5549000640 1 -- 172.21.15.32:0/4170403841 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55440cdd30 con 0x7f554406d6c0 2024-03-19T06:21:58.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.292+0000 7f5549000640 1 -- 172.21.15.32:0/4170403841 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55440ce2f0 con 0x7f554406d6c0 2024-03-19T06:21:58.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.292+0000 7f5549000640 1 -- 172.21.15.32:0/4170403841 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55440749e0 con 0x7f554406d6c0 2024-03-19T06:21:58.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.292+0000 7f553aa00640 1 -- 172.21.15.32:0/4170403841 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5534003620 con 0x7f554406d6c0 2024-03-19T06:21:58.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.292+0000 7f553aa00640 1 --2- 172.21.15.32:0/4170403841 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55200676b0 0x7f5520069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.292+0000 7f553aa00640 1 -- 172.21.15.32:0/4170403841 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f553411fde0 con 0x7f554406d6c0 2024-03-19T06:21:58.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.292+0000 7f5539400640 1 --2- 172.21.15.32:0/4170403841 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55200676b0 0x7f5520069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.296+0000 7f5539400640 1 --2- 172.21.15.32:0/4170403841 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55200676b0 0x7f5520069b70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f554415c450 tx=0x7f552c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:58.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.296+0000 7f553aa00640 1 -- 172.21.15.32:0/4170403841 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f5534016090 con 0x7f554406d6c0 2024-03-19T06:21:58.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.460+0000 7f5549000640 1 -- 172.21.15.32:0/4170403841 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55440cb140 con 0x7f554406d6c0 2024-03-19T06:21:58.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.464+0000 7f553aa00640 1 -- 172.21.15.32:0/4170403841 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f55340f09c0 con 0x7f554406d6c0 2024-03-19T06:21:58.455 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:58.455 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":24,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:51.568754+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:21:58.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.464+0000 7f5549000640 1 -- 172.21.15.32:0/4170403841 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55200676b0 msgr2=0x7f5520069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:58.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.464+0000 7f5549000640 1 --2- 172.21.15.32:0/4170403841 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55200676b0 0x7f5520069b70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f554415c450 tx=0x7f552c008040 comp rx=0 tx=0).stop 2024-03-19T06:21:58.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.464+0000 7f5549000640 1 -- 172.21.15.32:0/4170403841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f554406d6c0 msgr2=0x7f5544158400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:58.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.464+0000 7f5549000640 1 --2- 172.21.15.32:0/4170403841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f554406d6c0 0x7f5544158400 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f55340ae040 tx=0x7f553401ac50 comp rx=0 tx=0).stop 2024-03-19T06:21:58.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.464+0000 7f5549000640 1 -- 172.21.15.32:0/4170403841 shutdown_connections 2024-03-19T06:21:58.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.464+0000 7f5549000640 1 --2- 172.21.15.32:0/4170403841 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f55200676b0 0x7f5520069b70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.464+0000 7f5549000640 1 --2- 172.21.15.32:0/4170403841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f554415c010 0x7f5544162ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.464+0000 7f5549000640 1 --2- 172.21.15.32:0/4170403841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55440aecf0 0x7f55440cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.464+0000 7f5549000640 1 --2- 172.21.15.32:0/4170403841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f554406d6c0 0x7f5544158400 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.464+0000 7f5549000640 1 -- 172.21.15.32:0/4170403841 >> 172.21.15.32:0/4170403841 conn(0x7f55440b1280 msgr2=0x7f554415d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:58.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.464+0000 7f5549000640 1 -- 172.21.15.32:0/4170403841 shutdown_connections 2024-03-19T06:21:58.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.464+0000 7f5549000640 1 -- 172.21.15.32:0/4170403841 wait complete. 2024-03-19T06:21:58.477 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:21:07.089673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:21:07.801319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:21:58.477 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:21:58.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.628+0000 7f968f200640 1 Processor -- start 2024-03-19T06:21:58.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f968f200640 1 -- start start 2024-03-19T06:21:58.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f968f200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f969015dca0 0x7f96900b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f968f200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f96900af620 0x7f969006ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f968f200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96900afaa0 0x7f969006b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f968f200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96900b5740 con 0x7f969015dca0 2024-03-19T06:21:58.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f968f200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96900ae110 con 0x7f96900af620 2024-03-19T06:21:58.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f968f200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969015e080 con 0x7f96900afaa0 2024-03-19T06:21:58.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f968de00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f969015dca0 0x7f96900b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f968de00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f969015dca0 0x7f96900b3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47624/0 (socket says 172.21.15.32:47624) 2024-03-19T06:21:58.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f968de00640 1 -- 172.21.15.32:0/3156637793 learned_addr learned my addr 172.21.15.32:0/3156637793 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:58.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f9687e00640 1 --2- 172.21.15.32:0/3156637793 >> v2:172.21.15.171:3300/0 conn(0x7f96900af620 0x7f969006ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f968e800640 1 --2- 172.21.15.32:0/3156637793 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96900afaa0 0x7f969006b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f968de00640 1 -- 172.21.15.32:0/3156637793 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96900afaa0 msgr2=0x7f969006b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:58.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f968de00640 1 --2- 172.21.15.32:0/3156637793 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96900afaa0 0x7f969006b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f968de00640 1 -- 172.21.15.32:0/3156637793 >> v2:172.21.15.171:3300/0 conn(0x7f96900af620 msgr2=0x7f969006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:58.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f968de00640 1 --2- 172.21.15.32:0/3156637793 >> v2:172.21.15.171:3300/0 conn(0x7f96900af620 0x7f969006ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f968de00640 1 -- 172.21.15.32:0/3156637793 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900ad500 con 0x7f969015dca0 2024-03-19T06:21:58.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.632+0000 7f9687e00640 1 --2- 172.21.15.32:0/3156637793 >> v2:172.21.15.171:3300/0 conn(0x7f96900af620 0x7f969006ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:58.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.636+0000 7f968de00640 1 --2- 172.21.15.32:0/3156637793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969015dca0 0x7f96900b3380 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f96900cea00 tx=0x7f968001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a43ae1099e09b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:58.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.636+0000 7f968d400640 1 -- 172.21.15.32:0/3156637793 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96800a6040 con 0x7f969015dca0 2024-03-19T06:21:58.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.636+0000 7f968d400640 1 -- 172.21.15.32:0/3156637793 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96800af070 con 0x7f969015dca0 2024-03-19T06:21:58.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.636+0000 7f968d400640 1 -- 172.21.15.32:0/3156637793 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96800aa860 con 0x7f969015dca0 2024-03-19T06:21:58.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.636+0000 7f968f200640 1 -- 172.21.15.32:0/3156637793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969015dca0 msgr2=0x7f96900b3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:58.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.636+0000 7f968f200640 1 --2- 172.21.15.32:0/3156637793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969015dca0 0x7f96900b3380 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f96900cea00 tx=0x7f968001c520 comp rx=0 tx=0).stop 2024-03-19T06:21:58.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.636+0000 7f968f200640 1 -- 172.21.15.32:0/3156637793 shutdown_connections 2024-03-19T06:21:58.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.636+0000 7f968f200640 1 --2- 172.21.15.32:0/3156637793 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96900afaa0 0x7f969006b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.636+0000 7f968f200640 1 --2- 172.21.15.32:0/3156637793 >> v2:172.21.15.171:3300/0 conn(0x7f96900af620 0x7f969006ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.636+0000 7f968f200640 1 --2- 172.21.15.32:0/3156637793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969015dca0 0x7f96900b3380 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.636+0000 7f968f200640 1 -- 172.21.15.32:0/3156637793 >> 172.21.15.32:0/3156637793 conn(0x7f96900b58e0 msgr2=0x7f96900b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:58.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.636+0000 7f968f200640 1 -- 172.21.15.32:0/3156637793 shutdown_connections 2024-03-19T06:21:58.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.636+0000 7f968f200640 1 -- 172.21.15.32:0/3156637793 wait complete. 2024-03-19T06:21:58.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.636+0000 7f968f200640 1 Processor -- start 2024-03-19T06:21:58.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.636+0000 7f968f200640 1 -- start start 2024-03-19T06:21:58.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968f200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96900af620 0x7f969014c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968f200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96900afaa0 0x7f96900cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968f200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969015dca0 0x7f9690155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968f200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900b00e0 con 0x7f969015dca0 2024-03-19T06:21:58.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968f200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900aff60 con 0x7f96900afaa0 2024-03-19T06:21:58.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968f200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900aedb0 con 0x7f96900af620 2024-03-19T06:21:58.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969015dca0 0x7f9690155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969015dca0 0x7f9690155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47634/0 (socket says 172.21.15.32:47634) 2024-03-19T06:21:58.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968e800640 1 -- 172.21.15.32:0/1909446193 learned_addr learned my addr 172.21.15.32:0/1909446193 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:58.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968de00640 1 --2- 172.21.15.32:0/1909446193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96900af620 0x7f969014c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f9687e00640 1 --2- 172.21.15.32:0/1909446193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96900afaa0 0x7f96900cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968e800640 1 -- 172.21.15.32:0/1909446193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96900af620 msgr2=0x7f969014c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:58.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968e800640 1 --2- 172.21.15.32:0/1909446193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96900af620 0x7f969014c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968e800640 1 -- 172.21.15.32:0/1909446193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96900afaa0 msgr2=0x7f96900cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:58.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968e800640 1 --2- 172.21.15.32:0/1909446193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96900afaa0 0x7f96900cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968e800640 1 -- 172.21.15.32:0/1909446193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969015d050 con 0x7f969015dca0 2024-03-19T06:21:58.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968e800640 1 --2- 172.21.15.32:0/1909446193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969015dca0 0x7f9690155930 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9688007e30 tx=0x7f968800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:58.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f9686000640 1 -- 172.21.15.32:0/1909446193 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688014620 con 0x7f969015dca0 2024-03-19T06:21:58.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f9686000640 1 -- 172.21.15.32:0/1909446193 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9688019070 con 0x7f969015dca0 2024-03-19T06:21:58.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968f200640 1 -- 172.21.15.32:0/1909446193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969015d330 con 0x7f969015dca0 2024-03-19T06:21:58.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f9686000640 1 -- 172.21.15.32:0/1909446193 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688014a00 con 0x7f969015dca0 2024-03-19T06:21:58.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968f200640 1 -- 172.21.15.32:0/1909446193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969014e570 con 0x7f969015dca0 2024-03-19T06:21:58.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f968f200640 1 -- 172.21.15.32:0/1909446193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9690075090 con 0x7f969015dca0 2024-03-19T06:21:58.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.640+0000 7f9686000640 1 -- 172.21.15.32:0/1909446193 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9688014ba0 con 0x7f969015dca0 2024-03-19T06:21:58.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.644+0000 7f9686000640 1 --2- 172.21.15.32:0/1909446193 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f966c067660 0x7f966c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.644+0000 7f9686000640 1 -- 172.21.15.32:0/1909446193 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9688085fd0 con 0x7f969015dca0 2024-03-19T06:21:58.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.644+0000 7f968de00640 1 --2- 172.21.15.32:0/1909446193 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f966c067660 0x7f966c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.644+0000 7f968de00640 1 --2- 172.21.15.32:0/1909446193 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f966c067660 0x7f966c069b20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f96800ae000 tx=0x7f96800a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:58.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.648+0000 7f9686000640 1 -- 172.21.15.32:0/1909446193 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f9688056580 con 0x7f969015dca0 2024-03-19T06:21:58.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.812+0000 7f968f200640 1 -- 172.21.15.32:0/1909446193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f969006b870 con 0x7f969015dca0 2024-03-19T06:21:58.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.812+0000 7f9686000640 1 -- 172.21.15.32:0/1909446193 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f968805a620 con 0x7f969015dca0 2024-03-19T06:21:58.806 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:21:58.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.816+0000 7f968f200640 1 -- 172.21.15.32:0/1909446193 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f966c067660 msgr2=0x7f966c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:58.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.816+0000 7f968f200640 1 --2- 172.21.15.32:0/1909446193 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f966c067660 0x7f966c069b20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f96800ae000 tx=0x7f96800a7000 comp rx=0 tx=0).stop 2024-03-19T06:21:58.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.816+0000 7f968f200640 1 -- 172.21.15.32:0/1909446193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969015dca0 msgr2=0x7f9690155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:58.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.816+0000 7f968f200640 1 --2- 172.21.15.32:0/1909446193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969015dca0 0x7f9690155930 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9688007e30 tx=0x7f968800e4b0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.816+0000 7f968f200640 1 -- 172.21.15.32:0/1909446193 shutdown_connections 2024-03-19T06:21:58.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.816+0000 7f968f200640 1 --2- 172.21.15.32:0/1909446193 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f966c067660 0x7f966c069b20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.816+0000 7f968f200640 1 --2- 172.21.15.32:0/1909446193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f969015dca0 0x7f9690155930 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.816+0000 7f968f200640 1 --2- 172.21.15.32:0/1909446193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96900afaa0 0x7f96900cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.816+0000 7f968f200640 1 --2- 172.21.15.32:0/1909446193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96900af620 0x7f969014c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.816+0000 7f968f200640 1 -- 172.21.15.32:0/1909446193 >> 172.21.15.32:0/1909446193 conn(0x7f96900b58e0 msgr2=0x7f969006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:58.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.816+0000 7f968f200640 1 -- 172.21.15.32:0/1909446193 shutdown_connections 2024-03-19T06:21:58.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.816+0000 7f968f200640 1 -- 172.21.15.32:0/1909446193 wait complete. 2024-03-19T06:21:58.827 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:21:58.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.976+0000 7f16c8e00640 1 Processor -- start 2024-03-19T06:21:58.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.976+0000 7f16c8e00640 1 -- start start 2024-03-19T06:21:58.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.980+0000 7f16c8e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16c406ad40 0x7f16c406b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.980+0000 7f16c8e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f16c406eed0 0x7f16c40ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.980+0000 7f16c8e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f16c406e320 0x7f16c415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.980+0000 7f16c8e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c406dbb0 con 0x7f16c406e320 2024-03-19T06:21:58.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.980+0000 7f16c8e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c406b660 con 0x7f16c406eed0 2024-03-19T06:21:58.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.980+0000 7f16c8e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40cc290 con 0x7f16c406ad40 2024-03-19T06:21:58.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.980+0000 7f16c2800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f16c406e320 0x7f16c415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.980+0000 7f16c2800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f16c406e320 0x7f16c415bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47642/0 (socket says 172.21.15.32:47642) 2024-03-19T06:21:58.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.980+0000 7f16c2800640 1 -- 172.21.15.32:0/96149276 learned_addr learned my addr 172.21.15.32:0/96149276 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:58.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.980+0000 7f16b9400640 1 --2- 172.21.15.32:0/96149276 >> v2:172.21.15.171:3300/0 conn(0x7f16c406eed0 0x7f16c40ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.980+0000 7f16c1e00640 1 --2- 172.21.15.32:0/96149276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16c406ad40 0x7f16c406b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.980+0000 7f16c2800640 1 -- 172.21.15.32:0/96149276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16c406ad40 msgr2=0x7f16c406b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:58.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.980+0000 7f16c2800640 1 --2- 172.21.15.32:0/96149276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16c406ad40 0x7f16c406b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.980+0000 7f16c2800640 1 -- 172.21.15.32:0/96149276 >> v2:172.21.15.171:3300/0 conn(0x7f16c406eed0 msgr2=0x7f16c40ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:58.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.980+0000 7f16c2800640 1 --2- 172.21.15.32:0/96149276 >> v2:172.21.15.171:3300/0 conn(0x7f16c406eed0 0x7f16c40ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.980+0000 7f16c2800640 1 -- 172.21.15.32:0/96149276 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c40cc570 con 0x7f16c406e320 2024-03-19T06:21:58.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c2800640 1 --2- 172.21.15.32:0/96149276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c406e320 0x7f16c415bc50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f16c40b4c50 tx=0x7f16bc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afb84c0e1a4764d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:58.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c1400640 1 -- 172.21.15.32:0/96149276 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0a57b0 con 0x7f16c406e320 2024-03-19T06:21:58.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c1400640 1 -- 172.21.15.32:0/96149276 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c415c9a0 con 0x7f16c406e320 2024-03-19T06:21:58.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c1400640 1 -- 172.21.15.32:0/96149276 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0a5b70 con 0x7f16c406e320 2024-03-19T06:21:58.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 -- 172.21.15.32:0/96149276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c406e320 msgr2=0x7f16c415bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:58.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 --2- 172.21.15.32:0/96149276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c406e320 0x7f16c415bc50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f16c40b4c50 tx=0x7f16bc01c930 comp rx=0 tx=0).stop 2024-03-19T06:21:58.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 -- 172.21.15.32:0/96149276 shutdown_connections 2024-03-19T06:21:58.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 --2- 172.21.15.32:0/96149276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c406e320 0x7f16c415bc50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 --2- 172.21.15.32:0/96149276 >> v2:172.21.15.171:3300/0 conn(0x7f16c406eed0 0x7f16c40ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 --2- 172.21.15.32:0/96149276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16c406ad40 0x7f16c406b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 -- 172.21.15.32:0/96149276 >> 172.21.15.32:0/96149276 conn(0x7f16c40b1590 msgr2=0x7f16c40b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:58.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 -- 172.21.15.32:0/96149276 shutdown_connections 2024-03-19T06:21:58.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 -- 172.21.15.32:0/96149276 wait complete. 2024-03-19T06:21:58.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 Processor -- start 2024-03-19T06:21:58.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 -- start start 2024-03-19T06:21:58.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16c406ad40 0x7f16c4151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c406e320 0x7f16c40b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16c406eed0 0x7f16c414b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40716d0 con 0x7f16c406e320 2024-03-19T06:21:58.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c4071550 con 0x7f16c406ad40 2024-03-19T06:21:58.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16c8e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c4071850 con 0x7f16c406eed0 2024-03-19T06:21:58.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.984+0000 7f16b9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c406e320 0x7f16c40b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16b9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c406e320 0x7f16c40b4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47648/0 (socket says 172.21.15.32:47648) 2024-03-19T06:21:58.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16b9400640 1 -- 172.21.15.32:0/246415069 learned_addr learned my addr 172.21.15.32:0/246415069 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:58.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16c1e00640 1 --2- 172.21.15.32:0/246415069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16c406ad40 0x7f16c4151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16c2800640 1 --2- 172.21.15.32:0/246415069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16c406eed0 0x7f16c414b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16b9400640 1 -- 172.21.15.32:0/246415069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16c406eed0 msgr2=0x7f16c414b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:58.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16b9400640 1 --2- 172.21.15.32:0/246415069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16c406eed0 0x7f16c414b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16b9400640 1 -- 172.21.15.32:0/246415069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16c406ad40 msgr2=0x7f16c4151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:58.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16b9400640 1 --2- 172.21.15.32:0/246415069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16c406ad40 0x7f16c4151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:58.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16b9400640 1 -- 172.21.15.32:0/246415069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c414d740 con 0x7f16c406e320 2024-03-19T06:21:58.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16b9400640 1 --2- 172.21.15.32:0/246415069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c406e320 0x7f16c40b4400 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00d800 tx=0x7f16ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:58.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16baa00640 1 -- 172.21.15.32:0/246415069 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac00b660 con 0x7f16c406e320 2024-03-19T06:21:58.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16baa00640 1 -- 172.21.15.32:0/246415069 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ac019070 con 0x7f16c406e320 2024-03-19T06:21:58.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16c8e00640 1 -- 172.21.15.32:0/246415069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c414da20 con 0x7f16c406e320 2024-03-19T06:21:58.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16baa00640 1 -- 172.21.15.32:0/246415069 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac00ba20 con 0x7f16c406e320 2024-03-19T06:21:58.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16c8e00640 1 -- 172.21.15.32:0/246415069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c40b4940 con 0x7f16c406e320 2024-03-19T06:21:58.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16c8e00640 1 -- 172.21.15.32:0/246415069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c4151960 con 0x7f16c406e320 2024-03-19T06:21:58.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.988+0000 7f16baa00640 1 -- 172.21.15.32:0/246415069 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f16ac00bbc0 con 0x7f16c406e320 2024-03-19T06:21:58.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.992+0000 7f16baa00640 1 --2- 172.21.15.32:0/246415069 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f16a0067660 0x7f16a0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:58.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.992+0000 7f16baa00640 1 -- 172.21.15.32:0/246415069 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f16ac085b30 con 0x7f16c406e320 2024-03-19T06:21:58.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.992+0000 7f16c1e00640 1 --2- 172.21.15.32:0/246415069 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f16a0067660 0x7f16a0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:58.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.992+0000 7f16c1e00640 1 --2- 172.21.15.32:0/246415069 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f16a0067660 0x7f16a0069b20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f16b4006aa0 tx=0x7f16b4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:58.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:58.996+0000 7f16baa00640 1 -- 172.21.15.32:0/246415069 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f16c4151960 con 0x7f16c406e320 2024-03-19T06:21:59.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.156+0000 7f16c8e00640 1 -- 172.21.15.32:0/246415069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16c40749e0 con 0x7f16c406e320 2024-03-19T06:21:59.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.156+0000 7f16baa00640 1 -- 172.21.15.32:0/246415069 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16ac0560d0 con 0x7f16c406e320 2024-03-19T06:21:59.148 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:21:59.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.156+0000 7f16c8e00640 1 -- 172.21.15.32:0/246415069 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f16a0067660 msgr2=0x7f16a0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:59.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.156+0000 7f16c8e00640 1 --2- 172.21.15.32:0/246415069 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f16a0067660 0x7f16a0069b20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f16b4006aa0 tx=0x7f16b4008040 comp rx=0 tx=0).stop 2024-03-19T06:21:59.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.156+0000 7f16c8e00640 1 -- 172.21.15.32:0/246415069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c406e320 msgr2=0x7f16c40b4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:59.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.156+0000 7f16c8e00640 1 --2- 172.21.15.32:0/246415069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c406e320 0x7f16c40b4400 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00d800 tx=0x7f16ac00dcc0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.156+0000 7f16c8e00640 1 -- 172.21.15.32:0/246415069 shutdown_connections 2024-03-19T06:21:59.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.156+0000 7f16c8e00640 1 --2- 172.21.15.32:0/246415069 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f16a0067660 0x7f16a0069b20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.156+0000 7f16c8e00640 1 --2- 172.21.15.32:0/246415069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16c406eed0 0x7f16c414b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.156+0000 7f16c8e00640 1 --2- 172.21.15.32:0/246415069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16c406e320 0x7f16c40b4400 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.156+0000 7f16c8e00640 1 --2- 172.21.15.32:0/246415069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16c406ad40 0x7f16c4151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.156+0000 7f16c8e00640 1 -- 172.21.15.32:0/246415069 >> 172.21.15.32:0/246415069 conn(0x7f16c40b1590 msgr2=0x7f16c4071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:59.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.156+0000 7f16c8e00640 1 -- 172.21.15.32:0/246415069 shutdown_connections 2024-03-19T06:21:59.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.156+0000 7f16c8e00640 1 -- 172.21.15.32:0/246415069 wait complete. 2024-03-19T06:21:59.169 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:21:59.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f8767000640 1 Processor -- start 2024-03-19T06:21:59.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f8767000640 1 -- start start 2024-03-19T06:21:59.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f8767000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87600b36d0 0x7f87600b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:59.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f8767000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f87600cf8e0 0x7f87600cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:59.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f8767000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87600d14b0 con 0x7f876015ba00 2024-03-19T06:21:59.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f8767000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87600d20c0 con 0x7f87600cf8e0 2024-03-19T06:21:59.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f8767000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87600b4050 con 0x7f87600b36d0 2024-03-19T06:21:59.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f875fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f876015ba00 0x7f87600b6ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47758/0 (socket says 172.21.15.32:47758) 2024-03-19T06:21:59.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f875fe00640 1 -- 172.21.15.32:0/2850508509 learned_addr learned my addr 172.21.15.32:0/2850508509 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:21:59.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f8765000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f87600cf8e0 0x7f87600cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:59.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f8757400640 1 --2- 172.21.15.32:0/2850508509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87600b36d0 0x7f87600b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:59.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f875f400640 1 -- 172.21.15.32:0/2850508509 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640848534 0 0) 0x7f87600d14b0 con 0x7f876015ba00 2024-03-19T06:21:59.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f875f400640 1 -- 172.21.15.32:0/2850508509 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8744003530 con 0x7f876015ba00 2024-03-19T06:21:59.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f8765000640 1 -- 172.21.15.32:0/2850508509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87600b36d0 msgr2=0x7f87600b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:59.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f8765000640 1 --2- 172.21.15.32:0/2850508509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87600b36d0 0x7f87600b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f8765000640 1 -- 172.21.15.32:0/2850508509 >> v1:172.21.15.32:6789/0 conn(0x7f876015ba00 legacy=0x7f87600b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:59.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f8765000640 1 -- 172.21.15.32:0/2850508509 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87600d1790 con 0x7f87600cf8e0 2024-03-19T06:21:59.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.320+0000 7f8757400640 1 --2- 172.21.15.32:0/2850508509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87600b36d0 0x7f87600b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:59.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.324+0000 7f8765000640 1 --2- 172.21.15.32:0/2850508509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87600cf8e0 0x7f87600cfd30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8758009d90 tx=0x7f875801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96ebb0843bb3bf3 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:59.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.324+0000 7f875f400640 1 -- 172.21.15.32:0/2850508509 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87580b4070 con 0x7f87600cf8e0 2024-03-19T06:21:59.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.324+0000 7f875f400640 1 -- 172.21.15.32:0/2850508509 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87580af600 con 0x7f87600cf8e0 2024-03-19T06:21:59.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.324+0000 7f875f400640 1 -- 172.21.15.32:0/2850508509 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87580af9d0 con 0x7f87600cf8e0 2024-03-19T06:21:59.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.324+0000 7f8767000640 1 -- 172.21.15.32:0/2850508509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87600cf8e0 msgr2=0x7f87600cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:59.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.324+0000 7f8767000640 1 --2- 172.21.15.32:0/2850508509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87600cf8e0 0x7f87600cfd30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8758009d90 tx=0x7f875801f150 comp rx=0 tx=0).stop 2024-03-19T06:21:59.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.324+0000 7f8767000640 1 -- 172.21.15.32:0/2850508509 shutdown_connections 2024-03-19T06:21:59.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.324+0000 7f8767000640 1 --2- 172.21.15.32:0/2850508509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87600cf8e0 0x7f87600cfd30 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.324+0000 7f8767000640 1 --2- 172.21.15.32:0/2850508509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87600b36d0 0x7f87600b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.324+0000 7f8767000640 1 -- 172.21.15.32:0/2850508509 >> 172.21.15.32:0/2850508509 conn(0x7f8760066ca0 msgr2=0x7f87600670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:59.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.324+0000 7f8767000640 1 -- 172.21.15.32:0/2850508509 shutdown_connections 2024-03-19T06:21:59.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.324+0000 7f8767000640 1 -- 172.21.15.32:0/2850508509 wait complete. 2024-03-19T06:21:59.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f8767000640 1 Processor -- start 2024-03-19T06:21:59.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f8767000640 1 -- start start 2024-03-19T06:21:59.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f8767000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87600b36d0 0x7f87600c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:59.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f8767000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87600cf8e0 0x7f876006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:59.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f8767000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f876015ba00 0x7f876015e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:59.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f8767000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87600b7700 con 0x7f87600b36d0 2024-03-19T06:21:59.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f8767000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87600d1d50 con 0x7f876015ba00 2024-03-19T06:21:59.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f8767000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876015bde0 con 0x7f87600cf8e0 2024-03-19T06:21:59.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f875fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87600b36d0 0x7f87600c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:59.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f875fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87600b36d0 0x7f87600c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47656/0 (socket says 172.21.15.32:47656) 2024-03-19T06:21:59.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f875fe00640 1 -- 172.21.15.32:0/2733625607 learned_addr learned my addr 172.21.15.32:0/2733625607 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:59.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f8757400640 1 --2- 172.21.15.32:0/2733625607 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87600cf8e0 0x7f876006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:59.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f8765000640 1 --2- 172.21.15.32:0/2733625607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f876015ba00 0x7f876015e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:59.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f875fe00640 1 -- 172.21.15.32:0/2733625607 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87600cf8e0 msgr2=0x7f876006d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:59.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f875fe00640 1 --2- 172.21.15.32:0/2733625607 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87600cf8e0 0x7f876006d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f875fe00640 1 -- 172.21.15.32:0/2733625607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f876015ba00 msgr2=0x7f876015e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:59.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f875fe00640 1 --2- 172.21.15.32:0/2733625607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f876015ba00 0x7f876015e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f875fe00640 1 -- 172.21.15.32:0/2733625607 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87600c74c0 con 0x7f87600b36d0 2024-03-19T06:21:59.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f8757400640 1 --2- 172.21.15.32:0/2733625607 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87600cf8e0 0x7f876006d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:59.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f8765000640 1 --2- 172.21.15.32:0/2733625607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f876015ba00 0x7f876015e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:59.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f875fe00640 1 --2- 172.21.15.32:0/2733625607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87600b36d0 0x7f87600c6e00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f875000c3c0 tx=0x7f875000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:59.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f875cc00640 1 -- 172.21.15.32:0/2733625607 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750017070 con 0x7f87600b36d0 2024-03-19T06:21:59.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f875cc00640 1 -- 172.21.15.32:0/2733625607 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8750005cf0 con 0x7f87600b36d0 2024-03-19T06:21:59.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f875cc00640 1 -- 172.21.15.32:0/2733625607 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87500072f0 con 0x7f87600b36d0 2024-03-19T06:21:59.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f8767000640 1 -- 172.21.15.32:0/2733625607 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87600c77a0 con 0x7f87600b36d0 2024-03-19T06:21:59.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f8767000640 1 -- 172.21.15.32:0/2733625607 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87600c7d60 con 0x7f87600b36d0 2024-03-19T06:21:59.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.328+0000 7f8767000640 1 -- 172.21.15.32:0/2733625607 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87600749e0 con 0x7f87600b36d0 2024-03-19T06:21:59.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.332+0000 7f875cc00640 1 -- 172.21.15.32:0/2733625607 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f875001a070 con 0x7f87600b36d0 2024-03-19T06:21:59.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.332+0000 7f875cc00640 1 --2- 172.21.15.32:0/2733625607 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f873c067660 0x7f873c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:59.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.332+0000 7f875cc00640 1 -- 172.21.15.32:0/2733625607 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8750084db0 con 0x7f87600b36d0 2024-03-19T06:21:59.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.332+0000 7f8757400640 1 --2- 172.21.15.32:0/2733625607 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f873c067660 0x7f873c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:59.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.332+0000 7f8757400640 1 --2- 172.21.15.32:0/2733625607 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f873c067660 0x7f873c069b20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f87600cc360 tx=0x7f8748008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:59.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.336+0000 7f875cc00640 1 -- 172.21.15.32:0/2733625607 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f8750089070 con 0x7f87600b36d0 2024-03-19T06:21:59.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.496+0000 7f8767000640 1 -- 172.21.15.32:0/2733625607 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f876015f350 con 0x7f87600b36d0 2024-03-19T06:21:59.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.496+0000 7f875cc00640 1 -- 172.21.15.32:0/2733625607 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8750055910 con 0x7f87600b36d0 2024-03-19T06:21:59.490 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:21:59.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.500+0000 7f8767000640 1 -- 172.21.15.32:0/2733625607 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f873c067660 msgr2=0x7f873c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:59.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.500+0000 7f8767000640 1 --2- 172.21.15.32:0/2733625607 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f873c067660 0x7f873c069b20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f87600cc360 tx=0x7f8748008040 comp rx=0 tx=0).stop 2024-03-19T06:21:59.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.500+0000 7f8767000640 1 -- 172.21.15.32:0/2733625607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87600b36d0 msgr2=0x7f87600c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:59.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.500+0000 7f8767000640 1 --2- 172.21.15.32:0/2733625607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87600b36d0 0x7f87600c6e00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f875000c3c0 tx=0x7f875000c880 comp rx=0 tx=0).stop 2024-03-19T06:21:59.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.500+0000 7f8767000640 1 -- 172.21.15.32:0/2733625607 shutdown_connections 2024-03-19T06:21:59.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.500+0000 7f8767000640 1 --2- 172.21.15.32:0/2733625607 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f873c067660 0x7f873c069b20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.500+0000 7f8767000640 1 --2- 172.21.15.32:0/2733625607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f876015ba00 0x7f876015e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.500+0000 7f8767000640 1 --2- 172.21.15.32:0/2733625607 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87600cf8e0 0x7f876006d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.500+0000 7f8767000640 1 --2- 172.21.15.32:0/2733625607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87600b36d0 0x7f87600c6e00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.500+0000 7f8767000640 1 -- 172.21.15.32:0/2733625607 >> 172.21.15.32:0/2733625607 conn(0x7f8760066ca0 msgr2=0x7f87600cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:59.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.500+0000 7f8767000640 1 -- 172.21.15.32:0/2733625607 shutdown_connections 2024-03-19T06:21:59.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.500+0000 7f8767000640 1 -- 172.21.15.32:0/2733625607 wait complete. 2024-03-19T06:21:59.511 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:21:59.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.660+0000 7f5405200640 1 Processor -- start 2024-03-19T06:21:59.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.660+0000 7f5405200640 1 -- start start 2024-03-19T06:21:59.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.660+0000 7f5405200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54000cc680 0x7f540015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:59.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.660+0000 7f5405200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54000b4c50 0x7f54000b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:59.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.660+0000 7f5405200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54000cb670 con 0x7f540015a7c0 2024-03-19T06:21:59.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.660+0000 7f5405200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54000b5600 con 0x7f54000cc680 2024-03-19T06:21:59.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.660+0000 7f5405200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540015e860 con 0x7f54000b4c50 2024-03-19T06:21:59.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.660+0000 7f53f5400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54000cc680 0x7f540015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:59.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.660+0000 7f53f5400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54000cc680 0x7f540015ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47660/0 (socket says 172.21.15.32:47660) 2024-03-19T06:21:59.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.660+0000 7f53f5400640 1 -- 172.21.15.32:0/600202382 learned_addr learned my addr 172.21.15.32:0/600202382 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:59.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.660+0000 7f53fe800640 1 --2- 172.21.15.32:0/600202382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54000b4c50 0x7f54000b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:59.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f53f5400640 1 -- 172.21.15.32:0/600202382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54000b4c50 msgr2=0x7f54000b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:21:59.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f53f5400640 1 --2- 172.21.15.32:0/600202382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54000b4c50 0x7f54000b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f53f5400640 1 -- 172.21.15.32:0/600202382 >> v1:172.21.15.171:6789/0 conn(0x7f540015a7c0 legacy=0x7f54000cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:59.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f53f5400640 1 -- 172.21.15.32:0/600202382 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54000cb950 con 0x7f54000cc680 2024-03-19T06:21:59.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f53fe800640 1 --2- 172.21.15.32:0/600202382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54000b4c50 0x7f54000b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:21:59.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f53f5400640 1 --2- 172.21.15.32:0/600202382 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54000cc680 0x7f540015ecf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009870 tx=0x7f53e801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a237ba4f68f19d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:59.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f53fd400640 1 -- 172.21.15.32:0/600202382 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e80a9610 con 0x7f54000cc680 2024-03-19T06:21:59.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f53fd400640 1 -- 172.21.15.32:0/600202382 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e80a97b0 con 0x7f54000cc680 2024-03-19T06:21:59.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f53fd400640 1 -- 172.21.15.32:0/600202382 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e80a9b80 con 0x7f54000cc680 2024-03-19T06:21:59.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f5405200640 1 -- 172.21.15.32:0/600202382 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54000cc680 msgr2=0x7f540015ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:59.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f5405200640 1 --2- 172.21.15.32:0/600202382 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54000cc680 0x7f540015ecf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009870 tx=0x7f53e801c530 comp rx=0 tx=0).stop 2024-03-19T06:21:59.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f5405200640 1 -- 172.21.15.32:0/600202382 shutdown_connections 2024-03-19T06:21:59.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f5405200640 1 --2- 172.21.15.32:0/600202382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54000b4c50 0x7f54000b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f5405200640 1 --2- 172.21.15.32:0/600202382 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54000cc680 0x7f540015ecf0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f5405200640 1 -- 172.21.15.32:0/600202382 >> 172.21.15.32:0/600202382 conn(0x7f54000b1280 msgr2=0x7f54000b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:59.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f5405200640 1 -- 172.21.15.32:0/600202382 shutdown_connections 2024-03-19T06:21:59.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.664+0000 7f5405200640 1 -- 172.21.15.32:0/600202382 wait complete. 2024-03-19T06:21:59.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f5405200640 1 Processor -- start 2024-03-19T06:21:59.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f5405200640 1 -- start start 2024-03-19T06:21:59.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f5405200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54000b4c50 0x7f540014b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:59.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f5405200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54000cc680 0x7f54000b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:59.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f5405200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540015a7c0 0x7f5400152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:59.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f5405200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54000cbdb0 con 0x7f540015a7c0 2024-03-19T06:21:59.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f5405200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54000cbc30 con 0x7f54000cc680 2024-03-19T06:21:59.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f5405200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5400071350 con 0x7f54000b4c50 2024-03-19T06:21:59.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f53fe800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540015a7c0 0x7f5400152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:59.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f53fe800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540015a7c0 0x7f5400152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47662/0 (socket says 172.21.15.32:47662) 2024-03-19T06:21:59.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f53fe800640 1 -- 172.21.15.32:0/3553788885 learned_addr learned my addr 172.21.15.32:0/3553788885 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:21:59.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f53f5400640 1 --2- 172.21.15.32:0/3553788885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54000cc680 0x7f54000b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:59.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f53fde00640 1 --2- 172.21.15.32:0/3553788885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54000b4c50 0x7f540014b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:59.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f53fe800640 1 -- 172.21.15.32:0/3553788885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54000b4c50 msgr2=0x7f540014b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:59.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f53fe800640 1 --2- 172.21.15.32:0/3553788885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54000b4c50 0x7f540014b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f53fe800640 1 -- 172.21.15.32:0/3553788885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54000cc680 msgr2=0x7f54000b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:59.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f53fe800640 1 --2- 172.21.15.32:0/3553788885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54000cc680 0x7f54000b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f53fe800640 1 -- 172.21.15.32:0/3553788885 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54000af5d0 con 0x7f540015a7c0 2024-03-19T06:21:59.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f53fde00640 1 --2- 172.21.15.32:0/3553788885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54000b4c50 0x7f540014b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:59.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f53f5400640 1 --2- 172.21.15.32:0/3553788885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54000cc680 0x7f54000b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:21:59.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f53fe800640 1 --2- 172.21.15.32:0/3553788885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540015a7c0 0x7f5400152160 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f53f800d990 tx=0x7f53f800de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:59.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f53f6a00640 1 -- 172.21.15.32:0/3553788885 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f800ab60 con 0x7f540015a7c0 2024-03-19T06:21:59.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f53f6a00640 1 -- 172.21.15.32:0/3553788885 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f800ad00 con 0x7f540015a7c0 2024-03-19T06:21:59.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f5405200640 1 -- 172.21.15.32:0/3553788885 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54000af8b0 con 0x7f540015a7c0 2024-03-19T06:21:59.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f53f6a00640 1 -- 172.21.15.32:0/3553788885 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f80106b0 con 0x7f540015a7c0 2024-03-19T06:21:59.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.668+0000 7f5405200640 1 -- 172.21.15.32:0/3553788885 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54000afe70 con 0x7f540015a7c0 2024-03-19T06:21:59.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.672+0000 7f5405200640 1 -- 172.21.15.32:0/3553788885 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540014b710 con 0x7f540015a7c0 2024-03-19T06:21:59.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.672+0000 7f53f6a00640 1 -- 172.21.15.32:0/3553788885 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f53f8010850 con 0x7f540015a7c0 2024-03-19T06:21:59.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.672+0000 7f53f6a00640 1 --2- 172.21.15.32:0/3553788885 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f53dc067660 0x7f53dc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:21:59.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.672+0000 7f53f6a00640 1 -- 172.21.15.32:0/3553788885 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f53f8085fe0 con 0x7f540015a7c0 2024-03-19T06:21:59.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.672+0000 7f53fde00640 1 --2- 172.21.15.32:0/3553788885 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f53dc067660 0x7f53dc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:21:59.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.676+0000 7f53fde00640 1 --2- 172.21.15.32:0/3553788885 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f53dc067660 0x7f53dc069b20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f53f0007fd0 tx=0x7f53f0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:21:59.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.676+0000 7f53f6a00640 1 -- 172.21.15.32:0/3553788885 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f53f8015030 con 0x7f540015a7c0 2024-03-19T06:21:59.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.872+0000 7f5405200640 1 -- 172.21.15.32:0/3553788885 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54000cc270 con 0x7f540015a7c0 2024-03-19T06:21:59.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.872+0000 7f53f6a00640 1 -- 172.21.15.32:0/3553788885 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4935 (secure 0 0 0) 0x7f53f8056b40 con 0x7f540015a7c0 2024-03-19T06:21:59.864 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:21:59.864 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/3555048948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3555048948},{"type":"v1","addr":"172.21.15.32:6834","nonce":3555048948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3484789829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3484789829},{"type":"v1","addr":"172.21.15.171:6836","nonce":3484789829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/851750022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":851750022},{"type":"v1","addr":"172.21.15.171:6837","nonce":851750022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:21:08.817580+0000","modified":"2024-03-19T06:21:11.829499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/1902889035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":1902889035},{"type":"v1","addr":"172.21.15.32:6835","nonce":1902889035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-19T06:21:59.864 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-03-19T06:21:59.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.872+0000 7f5405200640 1 -- 172.21.15.32:0/3553788885 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f53dc067660 msgr2=0x7f53dc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:59.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.872+0000 7f5405200640 1 --2- 172.21.15.32:0/3553788885 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f53dc067660 0x7f53dc069b20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f53f0007fd0 tx=0x7f53f0009040 comp rx=0 tx=0).stop 2024-03-19T06:21:59.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.872+0000 7f5405200640 1 -- 172.21.15.32:0/3553788885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540015a7c0 msgr2=0x7f5400152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:21:59.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.872+0000 7f5405200640 1 --2- 172.21.15.32:0/3553788885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540015a7c0 0x7f5400152160 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f53f800d990 tx=0x7f53f800de50 comp rx=0 tx=0).stop 2024-03-19T06:21:59.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.872+0000 7f5405200640 1 -- 172.21.15.32:0/3553788885 shutdown_connections 2024-03-19T06:21:59.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.872+0000 7f5405200640 1 --2- 172.21.15.32:0/3553788885 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f53dc067660 0x7f53dc069b20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.872+0000 7f5405200640 1 --2- 172.21.15.32:0/3553788885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540015a7c0 0x7f5400152160 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.872+0000 7f5405200640 1 --2- 172.21.15.32:0/3553788885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54000cc680 0x7f54000b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.872+0000 7f5405200640 1 --2- 172.21.15.32:0/3553788885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54000b4c50 0x7f540014b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:21:59.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.872+0000 7f5405200640 1 -- 172.21.15.32:0/3553788885 >> 172.21.15.32:0/3553788885 conn(0x7f54000b1280 msgr2=0x7f5400153d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:21:59.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.872+0000 7f5405200640 1 -- 172.21.15.32:0/3553788885 shutdown_connections 2024-03-19T06:21:59.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:21:59.872+0000 7f5405200640 1 -- 172.21.15.32:0/3553788885 wait complete. 2024-03-19T06:21:59.886 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:22:00.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.036+0000 7f3fa4800640 1 Processor -- start 2024-03-19T06:22:00.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.036+0000 7f3fa4800640 1 -- start start 2024-03-19T06:22:00.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.036+0000 7f3fa4800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f9c15dd70 0x7f3f9c09a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.036+0000 7f3fa4800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3f9c06be50 0x7f3f9c0d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.036+0000 7f3fa4800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9c0cfad0 con 0x7f3f9c06c480 2024-03-19T06:22:00.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.036+0000 7f3fa4800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9c0d0980 con 0x7f3f9c06be50 2024-03-19T06:22:00.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.036+0000 7f3fa4800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c15e150 con 0x7f3f9c15dd70 2024-03-19T06:22:00.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.036+0000 7f3fa1e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f9c15dd70 0x7f3f9c09a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.036+0000 7f3fa1e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f9c15dd70 0x7f3f9c09a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:48554/0 (socket says 172.21.15.32:48554) 2024-03-19T06:22:00.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.036+0000 7f3fa1e00640 1 -- 172.21.15.32:0/1797764319 learned_addr learned my addr 172.21.15.32:0/1797764319 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:00.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.036+0000 7f3fa1400640 1 --2- 172.21.15.32:0/1797764319 >> v2:172.21.15.171:3300/0 conn(0x7f3f9c06be50 0x7f3f9c0d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.036+0000 7f3fa1e00640 1 -- 172.21.15.32:0/1797764319 >> v2:172.21.15.171:3300/0 conn(0x7f3f9c06be50 msgr2=0x7f3f9c0d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:00.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.036+0000 7f3fa1e00640 1 --2- 172.21.15.32:0/1797764319 >> v2:172.21.15.171:3300/0 conn(0x7f3f9c06be50 0x7f3f9c0d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.036+0000 7f3fa1e00640 1 -- 172.21.15.32:0/1797764319 >> v1:172.21.15.171:6789/0 conn(0x7f3f9c06c480 legacy=0x7f3f9c0cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.036+0000 7f3fa1e00640 1 -- 172.21.15.32:0/1797764319 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c0cfd70 con 0x7f3f9c15dd70 2024-03-19T06:22:00.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.040+0000 7f3fa1e00640 1 --2- 172.21.15.32:0/1797764319 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f9c15dd70 0x7f3f9c09a480 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009870 tx=0x7f3f9001ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28f1255fbbd55966 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:00.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.040+0000 7f3fa0a00640 1 -- 172.21.15.32:0/1797764319 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f900b5070 con 0x7f3f9c15dd70 2024-03-19T06:22:00.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.040+0000 7f3fa0a00640 1 -- 172.21.15.32:0/1797764319 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f900a8a50 con 0x7f3f9c15dd70 2024-03-19T06:22:00.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.040+0000 7f3fa0a00640 1 -- 172.21.15.32:0/1797764319 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f900a8e20 con 0x7f3f9c15dd70 2024-03-19T06:22:00.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.040+0000 7f3fa4800640 1 -- 172.21.15.32:0/1797764319 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f9c15dd70 msgr2=0x7f3f9c09a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.040+0000 7f3fa4800640 1 --2- 172.21.15.32:0/1797764319 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f9c15dd70 0x7f3f9c09a480 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009870 tx=0x7f3f9001ed50 comp rx=0 tx=0).stop 2024-03-19T06:22:00.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.040+0000 7f3fa4800640 1 -- 172.21.15.32:0/1797764319 shutdown_connections 2024-03-19T06:22:00.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.040+0000 7f3fa4800640 1 --2- 172.21.15.32:0/1797764319 >> v2:172.21.15.171:3300/0 conn(0x7f3f9c06be50 0x7f3f9c0d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.040+0000 7f3fa4800640 1 --2- 172.21.15.32:0/1797764319 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f9c15dd70 0x7f3f9c09a480 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.040+0000 7f3fa4800640 1 -- 172.21.15.32:0/1797764319 >> 172.21.15.32:0/1797764319 conn(0x7f3f9c0d1890 msgr2=0x7f3f9c0d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:00.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.040+0000 7f3fa4800640 1 -- 172.21.15.32:0/1797764319 shutdown_connections 2024-03-19T06:22:00.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.040+0000 7f3fa4800640 1 -- 172.21.15.32:0/1797764319 wait complete. 2024-03-19T06:22:00.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa4800640 1 Processor -- start 2024-03-19T06:22:00.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa4800640 1 -- start start 2024-03-19T06:22:00.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa4800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f9c06be50 0x7f3f9c0cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa4800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f9c06c480 0x7f3f9c158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa4800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f9c15dd70 0x7f3f9c158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa4800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0d0610 con 0x7f3f9c15dd70 2024-03-19T06:22:00.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa4800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0d0330 con 0x7f3f9c06c480 2024-03-19T06:22:00.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa4800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0d1350 con 0x7f3f9c06be50 2024-03-19T06:22:00.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa2800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f9c15dd70 0x7f3f9c158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa2800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f9c15dd70 0x7f3f9c158a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47668/0 (socket says 172.21.15.32:47668) 2024-03-19T06:22:00.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa2800640 1 -- 172.21.15.32:0/2099205753 learned_addr learned my addr 172.21.15.32:0/2099205753 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:00.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa1400640 1 --2- 172.21.15.32:0/2099205753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f9c06c480 0x7f3f9c158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa1e00640 1 --2- 172.21.15.32:0/2099205753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f9c06be50 0x7f3f9c0cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa1e00640 1 -- 172.21.15.32:0/2099205753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f9c06c480 msgr2=0x7f3f9c158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa1e00640 1 --2- 172.21.15.32:0/2099205753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f9c06c480 0x7f3f9c158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa1e00640 1 -- 172.21.15.32:0/2099205753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f9c15dd70 msgr2=0x7f3f9c158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa1e00640 1 --2- 172.21.15.32:0/2099205753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f9c15dd70 0x7f3f9c158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa1e00640 1 -- 172.21.15.32:0/2099205753 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c1f7620 con 0x7f3f9c06be50 2024-03-19T06:22:00.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa2800640 1 --2- 172.21.15.32:0/2099205753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f9c15dd70 0x7f3f9c158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:22:00.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa1e00640 1 --2- 172.21.15.32:0/2099205753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f9c06be50 0x7f3f9c0cda40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3f900af000 tx=0x7f3f9001baf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:00.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3f96000640 1 -- 172.21.15.32:0/2099205753 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f900c0070 con 0x7f3f9c06be50 2024-03-19T06:22:00.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3f96000640 1 -- 172.21.15.32:0/2099205753 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f900ae550 con 0x7f3f9c06be50 2024-03-19T06:22:00.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3f96000640 1 -- 172.21.15.32:0/2099205753 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f900b5070 con 0x7f3f9c06be50 2024-03-19T06:22:00.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa4800640 1 -- 172.21.15.32:0/2099205753 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9c1f7920 con 0x7f3f9c06be50 2024-03-19T06:22:00.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa4800640 1 -- 172.21.15.32:0/2099205753 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9c1f8160 con 0x7f3f9c06be50 2024-03-19T06:22:00.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.044+0000 7f3fa4800640 1 -- 172.21.15.32:0/2099205753 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9c0749e0 con 0x7f3f9c06be50 2024-03-19T06:22:00.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.048+0000 7f3f96000640 1 -- 172.21.15.32:0/2099205753 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3f900c3070 con 0x7f3f9c06be50 2024-03-19T06:22:00.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.048+0000 7f3f96000640 1 --2- 172.21.15.32:0/2099205753 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3f80067660 0x7f3f80069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.048+0000 7f3f96000640 1 -- 172.21.15.32:0/2099205753 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3f90123070 con 0x7f3f9c06be50 2024-03-19T06:22:00.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.048+0000 7f3fa1400640 1 --2- 172.21.15.32:0/2099205753 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3f80067660 0x7f3f80069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.048+0000 7f3fa1400640 1 --2- 172.21.15.32:0/2099205753 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3f80067660 0x7f3f80069b20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c0ce830 tx=0x7f3f8c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:00.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.052+0000 7f3f96000640 1 -- 172.21.15.32:0/2099205753 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f3f9c1f7920 con 0x7f3f9c06be50 2024-03-19T06:22:00.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.216+0000 7f3fa4800640 1 -- 172.21.15.32:0/2099205753 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f9c09af20 con 0x7f3f9c06be50 2024-03-19T06:22:00.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.220+0000 7f3f96000640 1 -- 172.21.15.32:0/2099205753 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f3f900188b0 con 0x7f3f9c06be50 2024-03-19T06:22:00.212 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:00.212 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":24,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:51.568754+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:22:00.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.220+0000 7f3fa4800640 1 -- 172.21.15.32:0/2099205753 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3f80067660 msgr2=0x7f3f80069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.220+0000 7f3fa4800640 1 --2- 172.21.15.32:0/2099205753 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3f80067660 0x7f3f80069b20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c0ce830 tx=0x7f3f8c009190 comp rx=0 tx=0).stop 2024-03-19T06:22:00.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.220+0000 7f3fa4800640 1 -- 172.21.15.32:0/2099205753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f9c06be50 msgr2=0x7f3f9c0cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.220+0000 7f3fa4800640 1 --2- 172.21.15.32:0/2099205753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f9c06be50 0x7f3f9c0cda40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3f900af000 tx=0x7f3f9001baf0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.220+0000 7f3fa4800640 1 -- 172.21.15.32:0/2099205753 shutdown_connections 2024-03-19T06:22:00.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.220+0000 7f3fa4800640 1 --2- 172.21.15.32:0/2099205753 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3f80067660 0x7f3f80069b20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.220+0000 7f3fa4800640 1 --2- 172.21.15.32:0/2099205753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f9c15dd70 0x7f3f9c158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.220+0000 7f3fa4800640 1 --2- 172.21.15.32:0/2099205753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f9c06c480 0x7f3f9c158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.220+0000 7f3fa4800640 1 --2- 172.21.15.32:0/2099205753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f9c06be50 0x7f3f9c0cda40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.220+0000 7f3fa4800640 1 -- 172.21.15.32:0/2099205753 >> 172.21.15.32:0/2099205753 conn(0x7f3f9c0d1890 msgr2=0x7f3f9c15cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:00.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.220+0000 7f3fa4800640 1 -- 172.21.15.32:0/2099205753 shutdown_connections 2024-03-19T06:22:00.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.220+0000 7f3fa4800640 1 -- 172.21.15.32:0/2099205753 wait complete. 2024-03-19T06:22:00.234 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-19T06:22:00.234 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:22:00.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8ce5600640 1 Processor -- start 2024-03-19T06:22:00.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8ce5600640 1 -- start start 2024-03-19T06:22:00.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8ce5600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ce015dd70 0x7f8ce009a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8ce5600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8ce006c480 0x7f8ce006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8ce5600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce00cfad0 con 0x7f8ce006be50 2024-03-19T06:22:00.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8ce5600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce00d0980 con 0x7f8ce006c480 2024-03-19T06:22:00.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8ce5600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00d1520 con 0x7f8ce015dd70 2024-03-19T06:22:00.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8cdea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ce015dd70 0x7f8ce009a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8cd6000640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f8ce006be50 0x7f8ce00d0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:37070/0 (socket says 172.21.15.32:37070) 2024-03-19T06:22:00.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8cdea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ce015dd70 0x7f8ce009a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:48576/0 (socket says 172.21.15.32:48576) 2024-03-19T06:22:00.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8cd6000640 1 -- 172.21.15.32:0/3286705350 learned_addr learned my addr 172.21.15.32:0/3286705350 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:00.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8cdf400640 1 --2- 172.21.15.32:0/3286705350 >> v2:172.21.15.171:3300/0 conn(0x7f8ce006c480 0x7f8ce006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8cde000640 1 -- 172.21.15.32:0/3286705350 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140897951 0 0) 0x7f8ce00cfad0 con 0x7f8ce006be50 2024-03-19T06:22:00.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8cde000640 1 -- 172.21.15.32:0/3286705350 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cc4003530 con 0x7f8ce006be50 2024-03-19T06:22:00.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8cdea00640 1 -- 172.21.15.32:0/3286705350 >> v2:172.21.15.171:3300/0 conn(0x7f8ce006c480 msgr2=0x7f8ce006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:00.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8cdea00640 1 --2- 172.21.15.32:0/3286705350 >> v2:172.21.15.171:3300/0 conn(0x7f8ce006c480 0x7f8ce006c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8cdea00640 1 -- 172.21.15.32:0/3286705350 >> v1:172.21.15.171:6789/0 conn(0x7f8ce006be50 legacy=0x7f8ce00d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8cdea00640 1 -- 172.21.15.32:0/3286705350 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce015e150 con 0x7f8ce015dd70 2024-03-19T06:22:00.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.384+0000 7f8cdf400640 1 --2- 172.21.15.32:0/3286705350 >> v2:172.21.15.171:3300/0 conn(0x7f8ce006c480 0x7f8ce006c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:22:00.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.388+0000 7f8cdea00640 1 --2- 172.21.15.32:0/3286705350 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ce015dd70 0x7f8ce009a480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00097c0 tx=0x7f8cd001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=153cb42eb3c07a06 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:00.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.388+0000 7f8cde000640 1 -- 172.21.15.32:0/3286705350 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00b5070 con 0x7f8ce015dd70 2024-03-19T06:22:00.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.388+0000 7f8cde000640 1 -- 172.21.15.32:0/3286705350 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd00a8990 con 0x7f8ce015dd70 2024-03-19T06:22:00.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.388+0000 7f8cde000640 1 -- 172.21.15.32:0/3286705350 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00a8d60 con 0x7f8ce015dd70 2024-03-19T06:22:00.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.388+0000 7f8ce5600640 1 -- 172.21.15.32:0/3286705350 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ce015dd70 msgr2=0x7f8ce009a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.388+0000 7f8ce5600640 1 --2- 172.21.15.32:0/3286705350 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ce015dd70 0x7f8ce009a480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00097c0 tx=0x7f8cd001ec90 comp rx=0 tx=0).stop 2024-03-19T06:22:00.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.388+0000 7f8ce5600640 1 -- 172.21.15.32:0/3286705350 shutdown_connections 2024-03-19T06:22:00.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.388+0000 7f8ce5600640 1 --2- 172.21.15.32:0/3286705350 >> v2:172.21.15.171:3300/0 conn(0x7f8ce006c480 0x7f8ce006c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.388+0000 7f8ce5600640 1 --2- 172.21.15.32:0/3286705350 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ce015dd70 0x7f8ce009a480 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.388+0000 7f8ce5600640 1 -- 172.21.15.32:0/3286705350 >> 172.21.15.32:0/3286705350 conn(0x7f8ce00d1890 msgr2=0x7f8ce00d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:00.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.388+0000 7f8ce5600640 1 -- 172.21.15.32:0/3286705350 shutdown_connections 2024-03-19T06:22:00.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.388+0000 7f8ce5600640 1 -- 172.21.15.32:0/3286705350 wait complete. 2024-03-19T06:22:00.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8ce5600640 1 Processor -- start 2024-03-19T06:22:00.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8ce5600640 1 -- start start 2024-03-19T06:22:00.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8ce5600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ce006be50 0x7f8ce00c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8ce5600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ce006c480 0x7f8ce0156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8ce5600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ce015dd70 0x7f8ce009cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8ce5600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00d0330 con 0x7f8ce006be50 2024-03-19T06:22:00.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8ce5600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00d0050 con 0x7f8ce015dd70 2024-03-19T06:22:00.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8ce5600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00d0610 con 0x7f8ce006c480 2024-03-19T06:22:00.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8cdea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ce006be50 0x7f8ce00c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8cdea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ce006be50 0x7f8ce00c7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47670/0 (socket says 172.21.15.32:47670) 2024-03-19T06:22:00.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8cdea00640 1 -- 172.21.15.32:0/305423020 learned_addr learned my addr 172.21.15.32:0/305423020 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:00.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8cdf400640 1 --2- 172.21.15.32:0/305423020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ce015dd70 0x7f8ce009cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8cd6000640 1 --2- 172.21.15.32:0/305423020 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ce006c480 0x7f8ce0156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8cdea00640 1 -- 172.21.15.32:0/305423020 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ce006c480 msgr2=0x7f8ce0156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8cdea00640 1 --2- 172.21.15.32:0/305423020 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ce006c480 0x7f8ce0156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8cdea00640 1 -- 172.21.15.32:0/305423020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ce015dd70 msgr2=0x7f8ce009cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8cdea00640 1 --2- 172.21.15.32:0/305423020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ce015dd70 0x7f8ce009cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8cdea00640 1 -- 172.21.15.32:0/305423020 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce00c8350 con 0x7f8ce006be50 2024-03-19T06:22:00.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8cdea00640 1 --2- 172.21.15.32:0/305423020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ce006be50 0x7f8ce00c7e10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00b3040 tx=0x7f8cd001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:00.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8cd7400640 1 -- 172.21.15.32:0/305423020 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00bf070 con 0x7f8ce006be50 2024-03-19T06:22:00.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8cd7400640 1 -- 172.21.15.32:0/305423020 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd00b0640 con 0x7f8ce006be50 2024-03-19T06:22:00.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8cd7400640 1 -- 172.21.15.32:0/305423020 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00b5040 con 0x7f8ce006be50 2024-03-19T06:22:00.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8ce5600640 1 -- 172.21.15.32:0/305423020 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce0157000 con 0x7f8ce006be50 2024-03-19T06:22:00.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8ce5600640 1 -- 172.21.15.32:0/305423020 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce009bf90 con 0x7f8ce006be50 2024-03-19T06:22:00.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.392+0000 7f8ce5600640 1 -- 172.21.15.32:0/305423020 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce00749e0 con 0x7f8ce006be50 2024-03-19T06:22:00.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.396+0000 7f8cd7400640 1 -- 172.21.15.32:0/305423020 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8cd00c2070 con 0x7f8ce006be50 2024-03-19T06:22:00.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.396+0000 7f8cd7400640 1 --2- 172.21.15.32:0/305423020 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8cbc067660 0x7f8cbc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.396+0000 7f8cd7400640 1 -- 172.21.15.32:0/305423020 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8cd0121e80 con 0x7f8ce006be50 2024-03-19T06:22:00.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.396+0000 7f8cd6000640 1 --2- 172.21.15.32:0/305423020 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8cbc067660 0x7f8cbc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.396+0000 7f8cd6000640 1 --2- 172.21.15.32:0/305423020 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8cbc067660 0x7f8cbc069b20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8ce01578c0 tx=0x7f8cc8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:00.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.400+0000 7f8cd7400640 1 -- 172.21.15.32:0/305423020 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f8cd00187f0 con 0x7f8ce006be50 2024-03-19T06:22:00.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.600+0000 7f8ce5600640 1 -- 172.21.15.32:0/305423020 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ce009af20 con 0x7f8ce006be50 2024-03-19T06:22:00.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.600+0000 7f8cd7400640 1 -- 172.21.15.32:0/305423020 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4935 (secure 0 0 0) 0x7f8cd00f2af0 con 0x7f8ce006be50 2024-03-19T06:22:00.592 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:00.592 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/3555048948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3555048948},{"type":"v1","addr":"172.21.15.32:6834","nonce":3555048948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3484789829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3484789829},{"type":"v1","addr":"172.21.15.171:6836","nonce":3484789829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/851750022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":851750022},{"type":"v1","addr":"172.21.15.171:6837","nonce":851750022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:21:08.817580+0000","modified":"2024-03-19T06:21:11.829499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/1902889035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":1902889035},{"type":"v1","addr":"172.21.15.32:6835","nonce":1902889035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-19T06:22:00.592 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-03-19T06:22:00.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.600+0000 7f8ce5600640 1 -- 172.21.15.32:0/305423020 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8cbc067660 msgr2=0x7f8cbc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.600+0000 7f8ce5600640 1 --2- 172.21.15.32:0/305423020 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8cbc067660 0x7f8cbc069b20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8ce01578c0 tx=0x7f8cc8009040 comp rx=0 tx=0).stop 2024-03-19T06:22:00.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.600+0000 7f8ce5600640 1 -- 172.21.15.32:0/305423020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ce006be50 msgr2=0x7f8ce00c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.600+0000 7f8ce5600640 1 --2- 172.21.15.32:0/305423020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ce006be50 0x7f8ce00c7e10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00b3040 tx=0x7f8cd001ba30 comp rx=0 tx=0).stop 2024-03-19T06:22:00.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.600+0000 7f8ce5600640 1 -- 172.21.15.32:0/305423020 shutdown_connections 2024-03-19T06:22:00.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.600+0000 7f8ce5600640 1 --2- 172.21.15.32:0/305423020 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8cbc067660 0x7f8cbc069b20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.600+0000 7f8ce5600640 1 --2- 172.21.15.32:0/305423020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ce015dd70 0x7f8ce009cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.600+0000 7f8ce5600640 1 --2- 172.21.15.32:0/305423020 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ce006c480 0x7f8ce0156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.600+0000 7f8ce5600640 1 --2- 172.21.15.32:0/305423020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ce006be50 0x7f8ce00c7e10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.600+0000 7f8ce5600640 1 -- 172.21.15.32:0/305423020 >> 172.21.15.32:0/305423020 conn(0x7f8ce00d1890 msgr2=0x7f8ce00b6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:00.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.600+0000 7f8ce5600640 1 -- 172.21.15.32:0/305423020 shutdown_connections 2024-03-19T06:22:00.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.600+0000 7f8ce5600640 1 -- 172.21.15.32:0/305423020 wait complete. 2024-03-19T06:22:00.614 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:22:00.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.760+0000 7f3ed1000640 1 Processor -- start 2024-03-19T06:22:00.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.760+0000 7f3ed1000640 1 -- start start 2024-03-19T06:22:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.760+0000 7f3ed1000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3ecc0cc680 0x7f3ecc15ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.760+0000 7f3ed1000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3ecc0b4c50 0x7f3ecc0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.760+0000 7f3ed1000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc0cb670 con 0x7f3ecc15a7c0 2024-03-19T06:22:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.760+0000 7f3ed1000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ecc15e860 con 0x7f3ecc0cc680 2024-03-19T06:22:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.760+0000 7f3ed1000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ecc0b55c0 con 0x7f3ecc0b4c50 2024-03-19T06:22:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.760+0000 7f3ec3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3ecc0cc680 0x7f3ecc15ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.764+0000 7f3ec3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3ecc0cc680 0x7f3ecc15ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47676/0 (socket says 172.21.15.32:47676) 2024-03-19T06:22:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.764+0000 7f3ec3e00640 1 -- 172.21.15.32:0/4045292918 learned_addr learned my addr 172.21.15.32:0/4045292918 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.764+0000 7f3ec9e00640 1 --1- 172.21.15.32:0/4045292918 >> v1:172.21.15.32:6789/0 conn(0x7f3ecc15a7c0 0x7f3ecc0cae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47760/0 (socket says 172.21.15.32:47760) 2024-03-19T06:22:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.764+0000 7f3eca800640 1 --2- 172.21.15.32:0/4045292918 >> v2:172.21.15.171:3300/0 conn(0x7f3ecc0b4c50 0x7f3ecc0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.764+0000 7f3ec3e00640 1 -- 172.21.15.32:0/4045292918 >> v2:172.21.15.171:3300/0 conn(0x7f3ecc0b4c50 msgr2=0x7f3ecc0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.764+0000 7f3ec3e00640 1 --2- 172.21.15.32:0/4045292918 >> v2:172.21.15.171:3300/0 conn(0x7f3ecc0b4c50 0x7f3ecc0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.764+0000 7f3ec3e00640 1 -- 172.21.15.32:0/4045292918 >> v1:172.21.15.32:6789/0 conn(0x7f3ecc15a7c0 legacy=0x7f3ecc0cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.764+0000 7f3ec3e00640 1 -- 172.21.15.32:0/4045292918 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc0cb950 con 0x7f3ecc0cc680 2024-03-19T06:22:00.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.764+0000 7f3ec3e00640 1 --2- 172.21.15.32:0/4045292918 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ecc0cc680 0x7f3ecc15ecf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0c9b90 tx=0x7f3eb401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b3f6d3f5548b90 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:00.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.764+0000 7f3ec9400640 1 -- 172.21.15.32:0/4045292918 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb40aa670 con 0x7f3ecc0cc680 2024-03-19T06:22:00.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.764+0000 7f3ec9400640 1 -- 172.21.15.32:0/4045292918 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb40af070 con 0x7f3ecc0cc680 2024-03-19T06:22:00.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.764+0000 7f3ec9400640 1 -- 172.21.15.32:0/4045292918 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb40aaa30 con 0x7f3ecc0cc680 2024-03-19T06:22:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ed1000640 1 -- 172.21.15.32:0/4045292918 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ecc0cc680 msgr2=0x7f3ecc15ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ed1000640 1 --2- 172.21.15.32:0/4045292918 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ecc0cc680 0x7f3ecc15ecf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0c9b90 tx=0x7f3eb401c4f0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ed1000640 1 -- 172.21.15.32:0/4045292918 shutdown_connections 2024-03-19T06:22:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ed1000640 1 --2- 172.21.15.32:0/4045292918 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ecc0cc680 0x7f3ecc15ecf0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ed1000640 1 --2- 172.21.15.32:0/4045292918 >> v2:172.21.15.171:3300/0 conn(0x7f3ecc0b4c50 0x7f3ecc0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ed1000640 1 -- 172.21.15.32:0/4045292918 >> 172.21.15.32:0/4045292918 conn(0x7f3ecc0b1280 msgr2=0x7f3ecc0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ed1000640 1 -- 172.21.15.32:0/4045292918 shutdown_connections 2024-03-19T06:22:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ed1000640 1 -- 172.21.15.32:0/4045292918 wait complete. 2024-03-19T06:22:00.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ed1000640 1 Processor -- start 2024-03-19T06:22:00.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ed1000640 1 -- start start 2024-03-19T06:22:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ed1000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ecc0b4c50 0x7f3ecc15b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ed1000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ecc0cc680 0x7f3ecc14f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ed1000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ecc15a7c0 0x7f3ecc14b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ed1000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc0cbdb0 con 0x7f3ecc0b4c50 2024-03-19T06:22:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ed1000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc0cbc30 con 0x7f3ecc0cc680 2024-03-19T06:22:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ed1000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc1677f0 con 0x7f3ecc15a7c0 2024-03-19T06:22:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ec9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ecc0b4c50 0x7f3ecc15b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ec9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ecc0b4c50 0x7f3ecc15b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47686/0 (socket says 172.21.15.32:47686) 2024-03-19T06:22:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ec9e00640 1 -- 172.21.15.32:0/740014923 learned_addr learned my addr 172.21.15.32:0/740014923 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ec3e00640 1 --2- 172.21.15.32:0/740014923 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ecc0cc680 0x7f3ecc14f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3eca800640 1 --2- 172.21.15.32:0/740014923 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ecc15a7c0 0x7f3ecc14b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ec9e00640 1 -- 172.21.15.32:0/740014923 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ecc15a7c0 msgr2=0x7f3ecc14b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ec9e00640 1 --2- 172.21.15.32:0/740014923 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ecc15a7c0 0x7f3ecc14b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ec9e00640 1 -- 172.21.15.32:0/740014923 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ecc0cc680 msgr2=0x7f3ecc14f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ec9e00640 1 --2- 172.21.15.32:0/740014923 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ecc0cc680 0x7f3ecc14f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ec9e00640 1 -- 172.21.15.32:0/740014923 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc152470 con 0x7f3ecc0b4c50 2024-03-19T06:22:00.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ec9e00640 1 --2- 172.21.15.32:0/740014923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ecc0b4c50 0x7f3ecc15b2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00c370 tx=0x7f3ebc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:00.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.768+0000 7f3ec2000640 1 -- 172.21.15.32:0/740014923 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc0074e0 con 0x7f3ecc0b4c50 2024-03-19T06:22:00.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.772+0000 7f3ec2000640 1 -- 172.21.15.32:0/740014923 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc007680 con 0x7f3ecc0b4c50 2024-03-19T06:22:00.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.772+0000 7f3ec2000640 1 -- 172.21.15.32:0/740014923 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc004a30 con 0x7f3ecc0b4c50 2024-03-19T06:22:00.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.772+0000 7f3ed1000640 1 -- 172.21.15.32:0/740014923 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ecc14f5c0 con 0x7f3ecc0b4c50 2024-03-19T06:22:00.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.772+0000 7f3ed1000640 1 -- 172.21.15.32:0/740014923 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ecc14c5a0 con 0x7f3ecc0b4c50 2024-03-19T06:22:00.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.772+0000 7f3ed1000640 1 -- 172.21.15.32:0/740014923 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ecc0749e0 con 0x7f3ecc0b4c50 2024-03-19T06:22:00.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.772+0000 7f3ec2000640 1 -- 172.21.15.32:0/740014923 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3ebc01a020 con 0x7f3ecc0b4c50 2024-03-19T06:22:00.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.772+0000 7f3ec2000640 1 --2- 172.21.15.32:0/740014923 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3ea8067660 0x7f3ea8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:00.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.772+0000 7f3ec2000640 1 -- 172.21.15.32:0/740014923 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3ebc084fb0 con 0x7f3ecc0b4c50 2024-03-19T06:22:00.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.772+0000 7f3ec3e00640 1 --2- 172.21.15.32:0/740014923 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3ea8067660 0x7f3ea8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:00.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.776+0000 7f3ec3e00640 1 --2- 172.21.15.32:0/740014923 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3ea8067660 0x7f3ea8069b20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40ae000 tx=0x7f3eb40a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:00.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.776+0000 7f3ec2000640 1 -- 172.21.15.32:0/740014923 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f3ebc055560 con 0x7f3ecc0b4c50 2024-03-19T06:22:00.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.972+0000 7f3ed1000640 1 -- 172.21.15.32:0/740014923 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ecc152b30 con 0x7f3ecc0b4c50 2024-03-19T06:22:00.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.972+0000 7f3ec2000640 1 -- 172.21.15.32:0/740014923 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4935 (secure 0 0 0) 0x7f3ebc059600 con 0x7f3ecc0b4c50 2024-03-19T06:22:00.967 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:00.967 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6834/3555048948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6833","nonce":3555048948},{"type":"v1","addr":"172.21.15.32:6834","nonce":3555048948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3484789829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3484789829},{"type":"v1","addr":"172.21.15.171:6836","nonce":3484789829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/851750022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":851750022},{"type":"v1","addr":"172.21.15.171:6837","nonce":851750022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:21:08.817580+0000","modified":"2024-03-19T06:21:11.829499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/1902889035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":1902889035},{"type":"v1","addr":"172.21.15.32:6835","nonce":1902889035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-19T06:22:00.967 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2024-03-19T06:22:00.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.976+0000 7f3ed1000640 1 -- 172.21.15.32:0/740014923 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3ea8067660 msgr2=0x7f3ea8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.976+0000 7f3ed1000640 1 --2- 172.21.15.32:0/740014923 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3ea8067660 0x7f3ea8069b20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40ae000 tx=0x7f3eb40a7000 comp rx=0 tx=0).stop 2024-03-19T06:22:00.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.976+0000 7f3ed1000640 1 -- 172.21.15.32:0/740014923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ecc0b4c50 msgr2=0x7f3ecc15b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:00.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.976+0000 7f3ed1000640 1 --2- 172.21.15.32:0/740014923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ecc0b4c50 0x7f3ecc15b2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00c370 tx=0x7f3ebc00c830 comp rx=0 tx=0).stop 2024-03-19T06:22:00.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.976+0000 7f3ed1000640 1 -- 172.21.15.32:0/740014923 shutdown_connections 2024-03-19T06:22:00.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.976+0000 7f3ed1000640 1 --2- 172.21.15.32:0/740014923 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3ea8067660 0x7f3ea8069b20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.976+0000 7f3ed1000640 1 --2- 172.21.15.32:0/740014923 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ecc15a7c0 0x7f3ecc14b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.976+0000 7f3ed1000640 1 --2- 172.21.15.32:0/740014923 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ecc0cc680 0x7f3ecc14f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.976+0000 7f3ed1000640 1 --2- 172.21.15.32:0/740014923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ecc0b4c50 0x7f3ecc15b2f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:00.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.976+0000 7f3ed1000640 1 -- 172.21.15.32:0/740014923 >> 172.21.15.32:0/740014923 conn(0x7f3ecc0b1280 msgr2=0x7f3ecc0cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:00.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.976+0000 7f3ed1000640 1 -- 172.21.15.32:0/740014923 shutdown_connections 2024-03-19T06:22:00.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:00.976+0000 7f3ed1000640 1 -- 172.21.15.32:0/740014923 wait complete. 2024-03-19T06:22:00.988 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:22:01.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d9c600640 1 Processor -- start 2024-03-19T06:22:01.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d9c600640 1 -- start start 2024-03-19T06:22:01.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d9c600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d9415c010 0x7f9d9415f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d9c600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9d9406d6c0 0x7f9d9406db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d9c600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9415fe20 con 0x7f9d940aecf0 2024-03-19T06:22:01.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d9c600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9406e070 con 0x7f9d9406d6c0 2024-03-19T06:22:01.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d9c600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d941603e0 con 0x7f9d9415c010 2024-03-19T06:22:01.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d99c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9d940aecf0 0x7f9d940ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47766/0 (socket says 172.21.15.32:47766) 2024-03-19T06:22:01.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d99c00640 1 -- 172.21.15.32:0/2465295424 learned_addr learned my addr 172.21.15.32:0/2465295424 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:01.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d9a600640 1 --2- 172.21.15.32:0/2465295424 >> v2:172.21.15.32:3300/0 conn(0x7f9d9406d6c0 0x7f9d9406db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d99200640 1 --2- 172.21.15.32:0/2465295424 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d9415c010 0x7f9d9415f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d93e00640 1 -- 172.21.15.32:0/2465295424 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693688543 0 0) 0x7f9d9415fe20 con 0x7f9d940aecf0 2024-03-19T06:22:01.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d93e00640 1 -- 172.21.15.32:0/2465295424 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d7c003530 con 0x7f9d940aecf0 2024-03-19T06:22:01.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d9a600640 1 -- 172.21.15.32:0/2465295424 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d9415c010 msgr2=0x7f9d9415f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:01.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d9a600640 1 --2- 172.21.15.32:0/2465295424 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d9415c010 0x7f9d9415f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d9a600640 1 -- 172.21.15.32:0/2465295424 >> v1:172.21.15.32:6789/0 conn(0x7f9d940aecf0 legacy=0x7f9d940ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:01.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.136+0000 7f9d9a600640 1 -- 172.21.15.32:0/2465295424 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d94160100 con 0x7f9d9406d6c0 2024-03-19T06:22:01.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.140+0000 7f9d9a600640 1 --2- 172.21.15.32:0/2465295424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d9406d6c0 0x7f9d9406db30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c009d90 tx=0x7f9d8c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd067de5f650ec29 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:01.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.140+0000 7f9d93e00640 1 -- 172.21.15.32:0/2465295424 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0b2070 con 0x7f9d9406d6c0 2024-03-19T06:22:01.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.140+0000 7f9d93e00640 1 -- 172.21.15.32:0/2465295424 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c0a58b0 con 0x7f9d9406d6c0 2024-03-19T06:22:01.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.140+0000 7f9d93e00640 1 -- 172.21.15.32:0/2465295424 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0a5c80 con 0x7f9d9406d6c0 2024-03-19T06:22:01.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.140+0000 7f9d9c600640 1 -- 172.21.15.32:0/2465295424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d9406d6c0 msgr2=0x7f9d9406db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:01.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.140+0000 7f9d9c600640 1 --2- 172.21.15.32:0/2465295424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d9406d6c0 0x7f9d9406db30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c009d90 tx=0x7f9d8c01c8e0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.140+0000 7f9d9c600640 1 -- 172.21.15.32:0/2465295424 shutdown_connections 2024-03-19T06:22:01.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.140+0000 7f9d9c600640 1 --2- 172.21.15.32:0/2465295424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d9406d6c0 0x7f9d9406db30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.140+0000 7f9d9c600640 1 --2- 172.21.15.32:0/2465295424 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d9415c010 0x7f9d9415f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.140+0000 7f9d9c600640 1 -- 172.21.15.32:0/2465295424 >> 172.21.15.32:0/2465295424 conn(0x7f9d940b1280 msgr2=0x7f9d940b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:01.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.140+0000 7f9d9c600640 1 -- 172.21.15.32:0/2465295424 shutdown_connections 2024-03-19T06:22:01.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.140+0000 7f9d9c600640 1 -- 172.21.15.32:0/2465295424 wait complete. 2024-03-19T06:22:01.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d9c600640 1 Processor -- start 2024-03-19T06:22:01.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d9c600640 1 -- start start 2024-03-19T06:22:01.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d9c600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d9406d6c0 0x7f9d940b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d9c600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d940aecf0 0x7f9d940ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d9c600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d9415c010 0x7f9d941575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d9c600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d940cbde0 con 0x7f9d9406d6c0 2024-03-19T06:22:01.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d9c600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d940cbc60 con 0x7f9d9415c010 2024-03-19T06:22:01.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d9c600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d94168690 con 0x7f9d940aecf0 2024-03-19T06:22:01.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d99c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d9406d6c0 0x7f9d940b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d99c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d9406d6c0 0x7f9d940b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47706/0 (socket says 172.21.15.32:47706) 2024-03-19T06:22:01.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d99c00640 1 -- 172.21.15.32:0/1912645756 learned_addr learned my addr 172.21.15.32:0/1912645756 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:01.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d99200640 1 --2- 172.21.15.32:0/1912645756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d940aecf0 0x7f9d940ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d9a600640 1 --2- 172.21.15.32:0/1912645756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d9415c010 0x7f9d941575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d99c00640 1 -- 172.21.15.32:0/1912645756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d940aecf0 msgr2=0x7f9d940ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:01.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d99c00640 1 --2- 172.21.15.32:0/1912645756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d940aecf0 0x7f9d940ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d99c00640 1 -- 172.21.15.32:0/1912645756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d9415c010 msgr2=0x7f9d941575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:01.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d99c00640 1 --2- 172.21.15.32:0/1912645756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d9415c010 0x7f9d941575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d99c00640 1 -- 172.21.15.32:0/1912645756 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d94154f30 con 0x7f9d9406d6c0 2024-03-19T06:22:01.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d9a600640 1 --2- 172.21.15.32:0/1912645756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d9415c010 0x7f9d941575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:01.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d99c00640 1 --2- 172.21.15.32:0/1912645756 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d9406d6c0 0x7f9d940b0150 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800c450 tx=0x7f9d8800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:01.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d91600640 1 -- 172.21.15.32:0/1912645756 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88017070 con 0x7f9d9406d6c0 2024-03-19T06:22:01.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d91600640 1 -- 172.21.15.32:0/1912645756 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d88005cf0 con 0x7f9d9406d6c0 2024-03-19T06:22:01.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d9c600640 1 -- 172.21.15.32:0/1912645756 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d94156a90 con 0x7f9d9406d6c0 2024-03-19T06:22:01.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d91600640 1 -- 172.21.15.32:0/1912645756 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88007290 con 0x7f9d9406d6c0 2024-03-19T06:22:01.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.144+0000 7f9d9c600640 1 -- 172.21.15.32:0/1912645756 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d940af670 con 0x7f9d9406d6c0 2024-03-19T06:22:01.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.148+0000 7f9d9c600640 1 -- 172.21.15.32:0/1912645756 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d940749e0 con 0x7f9d9406d6c0 2024-03-19T06:22:01.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.148+0000 7f9d91600640 1 -- 172.21.15.32:0/1912645756 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9d8801a070 con 0x7f9d9406d6c0 2024-03-19T06:22:01.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.148+0000 7f9d91600640 1 --2- 172.21.15.32:0/1912645756 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9d74067660 0x7f9d74069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.148+0000 7f9d91600640 1 -- 172.21.15.32:0/1912645756 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9d88084c80 con 0x7f9d9406d6c0 2024-03-19T06:22:01.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.148+0000 7f9d99200640 1 --2- 172.21.15.32:0/1912645756 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9d74067660 0x7f9d74069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.148+0000 7f9d99200640 1 --2- 172.21.15.32:0/1912645756 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9d74067660 0x7f9d74069b20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9d941659b0 tx=0x7f9d80009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:01.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.152+0000 7f9d91600640 1 -- 172.21.15.32:0/1912645756 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f9d94154f30 con 0x7f9d9406d6c0 2024-03-19T06:22:01.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.316+0000 7f9d9c600640 1 -- 172.21.15.32:0/1912645756 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d940cf0e0 con 0x7f9d9406d6c0 2024-03-19T06:22:01.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.320+0000 7f9d91600640 1 -- 172.21.15.32:0/1912645756 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f9d88055220 con 0x7f9d9406d6c0 2024-03-19T06:22:01.311 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:01.311 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":24,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:21:51.568754+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:21:07.089673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:21:07.801319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:22:01.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.320+0000 7f9d9c600640 1 -- 172.21.15.32:0/1912645756 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9d74067660 msgr2=0x7f9d74069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:01.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.320+0000 7f9d9c600640 1 --2- 172.21.15.32:0/1912645756 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9d74067660 0x7f9d74069b20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9d941659b0 tx=0x7f9d80009190 comp rx=0 tx=0).stop 2024-03-19T06:22:01.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.320+0000 7f9d9c600640 1 -- 172.21.15.32:0/1912645756 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d9406d6c0 msgr2=0x7f9d940b0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:01.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.320+0000 7f9d9c600640 1 --2- 172.21.15.32:0/1912645756 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d9406d6c0 0x7f9d940b0150 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800c450 tx=0x7f9d8800c910 comp rx=0 tx=0).stop 2024-03-19T06:22:01.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.320+0000 7f9d9c600640 1 -- 172.21.15.32:0/1912645756 shutdown_connections 2024-03-19T06:22:01.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.320+0000 7f9d9c600640 1 --2- 172.21.15.32:0/1912645756 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9d74067660 0x7f9d74069b20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.320+0000 7f9d9c600640 1 --2- 172.21.15.32:0/1912645756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d9415c010 0x7f9d941575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.320+0000 7f9d9c600640 1 --2- 172.21.15.32:0/1912645756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d940aecf0 0x7f9d940ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.320+0000 7f9d9c600640 1 --2- 172.21.15.32:0/1912645756 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d9406d6c0 0x7f9d940b0150 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.320+0000 7f9d9c600640 1 -- 172.21.15.32:0/1912645756 >> 172.21.15.32:0/1912645756 conn(0x7f9d940b1280 msgr2=0x7f9d940ca840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:01.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.320+0000 7f9d9c600640 1 -- 172.21.15.32:0/1912645756 shutdown_connections 2024-03-19T06:22:01.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.320+0000 7f9d9c600640 1 -- 172.21.15.32:0/1912645756 wait complete. 2024-03-19T06:22:01.333 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-19T06:22:01.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.480+0000 7fd470200640 1 Processor -- start 2024-03-19T06:22:01.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.480+0000 7fd470200640 1 -- start start 2024-03-19T06:22:01.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.484+0000 7fd470200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd46815c010 0x7fd46815f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.484+0000 7fd470200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd46806d6c0 0x7fd46806db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.484+0000 7fd470200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46815fe20 con 0x7fd4680aecf0 2024-03-19T06:22:01.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.484+0000 7fd470200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46806e070 con 0x7fd46806d6c0 2024-03-19T06:22:01.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.484+0000 7fd470200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4681603e0 con 0x7fd46815c010 2024-03-19T06:22:01.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.484+0000 7fd46ce00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd46815c010 0x7fd46815f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.484+0000 7fd46e200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd46806d6c0 0x7fd46806db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.484+0000 7fd46ce00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd46815c010 0x7fd46815f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:48614/0 (socket says 172.21.15.32:48614) 2024-03-19T06:22:01.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.484+0000 7fd46ce00640 1 -- 172.21.15.32:0/3742872202 learned_addr learned my addr 172.21.15.32:0/3742872202 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:01.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.484+0000 7fd46d800640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fd4680aecf0 0x7fd4680ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:37086/0 (socket says 172.21.15.32:37086) 2024-03-19T06:22:01.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.484+0000 7fd46ce00640 1 -- 172.21.15.32:0/3742872202 >> v2:172.21.15.171:3300/0 conn(0x7fd46806d6c0 msgr2=0x7fd46806db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:01.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.484+0000 7fd46ce00640 1 --2- 172.21.15.32:0/3742872202 >> v2:172.21.15.171:3300/0 conn(0x7fd46806d6c0 0x7fd46806db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.484+0000 7fd46ce00640 1 -- 172.21.15.32:0/3742872202 >> v1:172.21.15.171:6789/0 conn(0x7fd4680aecf0 legacy=0x7fd4680ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:01.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.484+0000 7fd46ce00640 1 -- 172.21.15.32:0/3742872202 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd468160100 con 0x7fd46815c010 2024-03-19T06:22:01.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.488+0000 7fd46ce00640 1 --2- 172.21.15.32:0/3742872202 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd46815c010 0x7fd46815f520 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd454009870 tx=0x7fd45401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5e8321dc6c9a1e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:01.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.488+0000 7fd467e00640 1 -- 172.21.15.32:0/3742872202 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540b1070 con 0x7fd46815c010 2024-03-19T06:22:01.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.488+0000 7fd467e00640 1 -- 172.21.15.32:0/3742872202 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4540a8050 con 0x7fd46815c010 2024-03-19T06:22:01.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.488+0000 7fd467e00640 1 -- 172.21.15.32:0/3742872202 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540ac860 con 0x7fd46815c010 2024-03-19T06:22:01.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.488+0000 7fd470200640 1 -- 172.21.15.32:0/3742872202 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd46815c010 msgr2=0x7fd46815f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:01.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.488+0000 7fd470200640 1 --2- 172.21.15.32:0/3742872202 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd46815c010 0x7fd46815f520 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd454009870 tx=0x7fd45401c4d0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.488+0000 7fd470200640 1 -- 172.21.15.32:0/3742872202 shutdown_connections 2024-03-19T06:22:01.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.488+0000 7fd470200640 1 --2- 172.21.15.32:0/3742872202 >> v2:172.21.15.171:3300/0 conn(0x7fd46806d6c0 0x7fd46806db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.488+0000 7fd470200640 1 --2- 172.21.15.32:0/3742872202 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd46815c010 0x7fd46815f520 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.488+0000 7fd470200640 1 -- 172.21.15.32:0/3742872202 >> 172.21.15.32:0/3742872202 conn(0x7fd4680b1280 msgr2=0x7fd4680b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:01.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.488+0000 7fd470200640 1 -- 172.21.15.32:0/3742872202 shutdown_connections 2024-03-19T06:22:01.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.488+0000 7fd470200640 1 -- 172.21.15.32:0/3742872202 wait complete. 2024-03-19T06:22:01.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.488+0000 7fd470200640 1 Processor -- start 2024-03-19T06:22:01.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.488+0000 7fd470200640 1 -- start start 2024-03-19T06:22:01.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd470200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd46806d6c0 0x7fd468160630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd470200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4680aecf0 0x7fd468162c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd470200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd46815c010 0x7fd468147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd470200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4680cbde0 con 0x7fd46806d6c0 2024-03-19T06:22:01.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd470200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4680cbc60 con 0x7fd4680aecf0 2024-03-19T06:22:01.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd470200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd468168690 con 0x7fd46815c010 2024-03-19T06:22:01.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd46d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd46806d6c0 0x7fd468160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd46d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd46806d6c0 0x7fd468160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47708/0 (socket says 172.21.15.32:47708) 2024-03-19T06:22:01.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd46ce00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4680aecf0 0x7fd468162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd46d800640 1 -- 172.21.15.32:0/2275859418 learned_addr learned my addr 172.21.15.32:0/2275859418 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:01.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd46e200640 1 --2- 172.21.15.32:0/2275859418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd46815c010 0x7fd468147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd46d800640 1 -- 172.21.15.32:0/2275859418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd46815c010 msgr2=0x7fd468147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:01.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd46d800640 1 --2- 172.21.15.32:0/2275859418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd46815c010 0x7fd468147f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd46d800640 1 -- 172.21.15.32:0/2275859418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4680aecf0 msgr2=0x7fd468162c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:01.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd46d800640 1 --2- 172.21.15.32:0/2275859418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4680aecf0 0x7fd468162c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd46d800640 1 -- 172.21.15.32:0/2275859418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd468161520 con 0x7fd46806d6c0 2024-03-19T06:22:01.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd46d800640 1 --2- 172.21.15.32:0/2275859418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd46806d6c0 0x7fd468160630 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00c460 tx=0x7fd45c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:01.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd465600640 1 -- 172.21.15.32:0/2275859418 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0074e0 con 0x7fd46806d6c0 2024-03-19T06:22:01.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd465600640 1 -- 172.21.15.32:0/2275859418 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c007680 con 0x7fd46806d6c0 2024-03-19T06:22:01.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd470200640 1 -- 172.21.15.32:0/2275859418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4680b3590 con 0x7fd46806d6c0 2024-03-19T06:22:01.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd465600640 1 -- 172.21.15.32:0/2275859418 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c004a10 con 0x7fd46806d6c0 2024-03-19T06:22:01.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd470200640 1 -- 172.21.15.32:0/2275859418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4680b3b50 con 0x7fd46806d6c0 2024-03-19T06:22:01.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.492+0000 7fd470200640 1 -- 172.21.15.32:0/2275859418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4680749e0 con 0x7fd46806d6c0 2024-03-19T06:22:01.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.496+0000 7fd465600640 1 -- 172.21.15.32:0/2275859418 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd45c01a020 con 0x7fd46806d6c0 2024-03-19T06:22:01.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.496+0000 7fd465600640 1 --2- 172.21.15.32:0/2275859418 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd448067690 0x7fd448069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.496+0000 7fd465600640 1 -- 172.21.15.32:0/2275859418 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd45c084ff0 con 0x7fd46806d6c0 2024-03-19T06:22:01.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.496+0000 7fd46ce00640 1 --2- 172.21.15.32:0/2275859418 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd448067690 0x7fd448069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.496+0000 7fd46ce00640 1 --2- 172.21.15.32:0/2275859418 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd448067690 0x7fd448069b50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd4540ae000 tx=0x7fd4540a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:01.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.500+0000 7fd465600640 1 -- 172.21.15.32:0/2275859418 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fd45c055500 con 0x7fd46806d6c0 2024-03-19T06:22:01.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.696+0000 7fd470200640 1 -- 172.21.15.32:0/2275859418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd46815d4e0 con 0x7fd46806d6c0 2024-03-19T06:22:01.688 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-03-19T06:22:01.696+0000 7f6650800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-19T06:22:01.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.700+0000 7fd465600640 1 -- 172.21.15.32:0/2275859418 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd45c0595a0 con 0x7fd46806d6c0 2024-03-19T06:22:01.690 INFO:teuthology.orchestra.run.smithi032.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-19T06:22:01.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.700+0000 7fd470200640 1 -- 172.21.15.32:0/2275859418 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd448067690 msgr2=0x7fd448069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:01.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.700+0000 7fd470200640 1 --2- 172.21.15.32:0/2275859418 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd448067690 0x7fd448069b50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd4540ae000 tx=0x7fd4540a7000 comp rx=0 tx=0).stop 2024-03-19T06:22:01.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.700+0000 7fd470200640 1 -- 172.21.15.32:0/2275859418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd46806d6c0 msgr2=0x7fd468160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:01.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.700+0000 7fd470200640 1 --2- 172.21.15.32:0/2275859418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd46806d6c0 0x7fd468160630 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00c460 tx=0x7fd45c00c920 comp rx=0 tx=0).stop 2024-03-19T06:22:01.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.700+0000 7fd470200640 1 -- 172.21.15.32:0/2275859418 shutdown_connections 2024-03-19T06:22:01.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.700+0000 7fd470200640 1 --2- 172.21.15.32:0/2275859418 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd448067690 0x7fd448069b50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.700+0000 7fd470200640 1 --2- 172.21.15.32:0/2275859418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd46815c010 0x7fd468147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.700+0000 7fd470200640 1 --2- 172.21.15.32:0/2275859418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4680aecf0 0x7fd468162c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.700+0000 7fd470200640 1 --2- 172.21.15.32:0/2275859418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd46806d6c0 0x7fd468160630 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.700+0000 7fd470200640 1 -- 172.21.15.32:0/2275859418 >> 172.21.15.32:0/2275859418 conn(0x7fd4680b1280 msgr2=0x7fd4680cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:01.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.700+0000 7fd470200640 1 -- 172.21.15.32:0/2275859418 shutdown_connections 2024-03-19T06:22:01.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.700+0000 7fd470200640 1 -- 172.21.15.32:0/2275859418 wait complete. 2024-03-19T06:22:01.701 INFO:tasks.ceph.mds.c.smithi032.stderr: -3318> 2024-03-19T06:21:13.340+0000 7f0f03200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-19T06:22:01.714 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-19T06:22:01.751 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2024-03-19T06:22:01.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.864+0000 7f0c93600640 1 Processor -- start 2024-03-19T06:22:01.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.868+0000 7f0c93600640 1 -- start start 2024-03-19T06:22:01.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.868+0000 7f0c93600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0c8c15a840 0x7f0c8c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.868+0000 7f0c93600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c8c06b450 0x7f0c8c0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.868+0000 7f0c93600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8c0af2d0 con 0x7f0c8c0aea70 2024-03-19T06:22:01.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.868+0000 7f0c93600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8c0cdc20 con 0x7f0c8c15a840 2024-03-19T06:22:01.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.868+0000 7f0c93600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c15eea0 con 0x7f0c8c06b450 2024-03-19T06:22:01.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.868+0000 7f0c83e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0c8c0aea70 0x7f0c8c06ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47794/0 (socket says 172.21.15.32:47794) 2024-03-19T06:22:01.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.868+0000 7f0c83e00640 1 -- 172.21.15.32:0/753773580 learned_addr learned my addr 172.21.15.32:0/753773580 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:01.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.868+0000 7f0c90c00640 1 --2- 172.21.15.32:0/753773580 >> v2:172.21.15.171:3300/0 conn(0x7f0c8c15a840 0x7f0c8c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.868+0000 7f0c91600640 1 --2- 172.21.15.32:0/753773580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c8c06b450 0x7f0c8c0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.868+0000 7f0c8be00640 1 -- 172.21.15.32:0/753773580 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452594830 0 0) 0x7f0c8c0af2d0 con 0x7f0c8c0aea70 2024-03-19T06:22:01.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.868+0000 7f0c8be00640 1 -- 172.21.15.32:0/753773580 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c70003530 con 0x7f0c8c0aea70 2024-03-19T06:22:01.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.868+0000 7f0c90c00640 1 -- 172.21.15.32:0/753773580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c8c06b450 msgr2=0x7f0c8c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:01.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.868+0000 7f0c90c00640 1 --2- 172.21.15.32:0/753773580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c8c06b450 0x7f0c8c0ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.868+0000 7f0c90c00640 1 -- 172.21.15.32:0/753773580 >> v1:172.21.15.32:6789/0 conn(0x7f0c8c0aea70 legacy=0x7f0c8c06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:01.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.868+0000 7f0c90c00640 1 -- 172.21.15.32:0/753773580 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c15f180 con 0x7f0c8c15a840 2024-03-19T06:22:01.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.872+0000 7f0c90c00640 1 --2- 172.21.15.32:0/753773580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c8c15a840 0x7f0c8c06f040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0097c0 tx=0x7f0c7c01c340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4ed840537396ecf server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:01.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.872+0000 7f0c8be00640 1 -- 172.21.15.32:0/753773580 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0b1070 con 0x7f0c8c15a840 2024-03-19T06:22:01.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.872+0000 7f0c8be00640 1 -- 172.21.15.32:0/753773580 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c0ac600 con 0x7f0c8c15a840 2024-03-19T06:22:01.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.872+0000 7f0c8be00640 1 -- 172.21.15.32:0/753773580 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0ac9d0 con 0x7f0c8c15a840 2024-03-19T06:22:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.872+0000 7f0c93600640 1 -- 172.21.15.32:0/753773580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c8c15a840 msgr2=0x7f0c8c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.872+0000 7f0c93600640 1 --2- 172.21.15.32:0/753773580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c8c15a840 0x7f0c8c06f040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0097c0 tx=0x7f0c7c01c340 comp rx=0 tx=0).stop 2024-03-19T06:22:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.872+0000 7f0c93600640 1 -- 172.21.15.32:0/753773580 shutdown_connections 2024-03-19T06:22:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.872+0000 7f0c93600640 1 --2- 172.21.15.32:0/753773580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c8c06b450 0x7f0c8c0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.872+0000 7f0c93600640 1 --2- 172.21.15.32:0/753773580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c8c15a840 0x7f0c8c06f040 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.872+0000 7f0c93600640 1 -- 172.21.15.32:0/753773580 >> 172.21.15.32:0/753773580 conn(0x7f0c8c0b1590 msgr2=0x7f0c8c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.872+0000 7f0c93600640 1 -- 172.21.15.32:0/753773580 shutdown_connections 2024-03-19T06:22:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.872+0000 7f0c93600640 1 -- 172.21.15.32:0/753773580 wait complete. 2024-03-19T06:22:01.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.872+0000 7f0c93600640 1 Processor -- start 2024-03-19T06:22:01.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c93600640 1 -- start start 2024-03-19T06:22:01.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c93600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c8c06b450 0x7f0c8c0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c93600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c8c0aea70 0x7f0c8c1642f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c93600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c8c15a840 0x7f0c8c150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c93600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c0cef80 con 0x7f0c8c06b450 2024-03-19T06:22:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c93600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c0cee00 con 0x7f0c8c15a840 2024-03-19T06:22:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c93600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c0cf100 con 0x7f0c8c0aea70 2024-03-19T06:22:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c90c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c8c06b450 0x7f0c8c0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c90c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c8c06b450 0x7f0c8c0717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47720/0 (socket says 172.21.15.32:47720) 2024-03-19T06:22:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c90c00640 1 -- 172.21.15.32:0/48100057 learned_addr learned my addr 172.21.15.32:0/48100057 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c83e00640 1 --2- 172.21.15.32:0/48100057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c8c0aea70 0x7f0c8c1642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c91600640 1 --2- 172.21.15.32:0/48100057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c8c15a840 0x7f0c8c150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c90c00640 1 -- 172.21.15.32:0/48100057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c8c0aea70 msgr2=0x7f0c8c1642f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c90c00640 1 --2- 172.21.15.32:0/48100057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c8c0aea70 0x7f0c8c1642f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c90c00640 1 -- 172.21.15.32:0/48100057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c8c15a840 msgr2=0x7f0c8c150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c90c00640 1 --2- 172.21.15.32:0/48100057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c8c15a840 0x7f0c8c150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c90c00640 1 -- 172.21.15.32:0/48100057 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c151fa0 con 0x7f0c8c06b450 2024-03-19T06:22:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c91600640 1 --2- 172.21.15.32:0/48100057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c8c15a840 0x7f0c8c150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c83e00640 1 --2- 172.21.15.32:0/48100057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c8c0aea70 0x7f0c8c1642f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:01.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c90c00640 1 --2- 172.21.15.32:0/48100057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c8c06b450 0x7f0c8c0717b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c019f70 tx=0x7f0c7c01ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:01.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c89600640 1 -- 172.21.15.32:0/48100057 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0b1040 con 0x7f0c8c06b450 2024-03-19T06:22:01.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c89600640 1 -- 172.21.15.32:0/48100057 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c0bc070 con 0x7f0c8c06b450 2024-03-19T06:22:01.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c89600640 1 -- 172.21.15.32:0/48100057 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c006e20 con 0x7f0c8c06b450 2024-03-19T06:22:01.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c93600640 1 -- 172.21.15.32:0/48100057 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8c152280 con 0x7f0c8c06b450 2024-03-19T06:22:01.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c93600640 1 -- 172.21.15.32:0/48100057 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8c152840 con 0x7f0c8c06b450 2024-03-19T06:22:01.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.876+0000 7f0c93600640 1 -- 172.21.15.32:0/48100057 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8c1585d0 con 0x7f0c8c06b450 2024-03-19T06:22:01.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.880+0000 7f0c89600640 1 -- 172.21.15.32:0/48100057 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0c7c0b76b0 con 0x7f0c8c06b450 2024-03-19T06:22:01.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.880+0000 7f0c89600640 1 --2- 172.21.15.32:0/48100057 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0c68067660 0x7f0c68069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:01.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.880+0000 7f0c89600640 1 -- 172.21.15.32:0/48100057 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f0c7c11f930 con 0x7f0c8c06b450 2024-03-19T06:22:01.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.880+0000 7f0c83e00640 1 --2- 172.21.15.32:0/48100057 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0c68067660 0x7f0c68069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:01.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.880+0000 7f0c83e00640 1 --2- 172.21.15.32:0/48100057 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0c68067660 0x7f0c68069b20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c146c00 tx=0x7f0c74009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:01.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:01.884+0000 7f0c89600640 1 -- 172.21.15.32:0/48100057 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f0c7c016050 con 0x7f0c8c06b450 2024-03-19T06:22:02.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.080+0000 7f0c93600640 1 -- 172.21.15.32:0/48100057 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0c8c0749e0 con 0x7f0c8c06b450 2024-03-19T06:22:02.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.704+0000 7f0c89600640 1 -- 172.21.15.32:0/48100057 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0c7c0f0560 con 0x7f0c8c06b450 2024-03-19T06:22:02.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.704+0000 7f0c93600640 1 -- 172.21.15.32:0/48100057 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0c68067660 msgr2=0x7f0c68069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:02.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.704+0000 7f0c93600640 1 --2- 172.21.15.32:0/48100057 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0c68067660 0x7f0c68069b20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c146c00 tx=0x7f0c74009040 comp rx=0 tx=0).stop 2024-03-19T06:22:02.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.704+0000 7f0c93600640 1 -- 172.21.15.32:0/48100057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c8c06b450 msgr2=0x7f0c8c0717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:02.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.704+0000 7f0c93600640 1 --2- 172.21.15.32:0/48100057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c8c06b450 0x7f0c8c0717b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c019f70 tx=0x7f0c7c01ab80 comp rx=0 tx=0).stop 2024-03-19T06:22:02.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.704+0000 7f0c93600640 1 -- 172.21.15.32:0/48100057 shutdown_connections 2024-03-19T06:22:02.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.704+0000 7f0c93600640 1 --2- 172.21.15.32:0/48100057 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0c68067660 0x7f0c68069b20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:02.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.704+0000 7f0c93600640 1 --2- 172.21.15.32:0/48100057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c8c15a840 0x7f0c8c150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:02.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.704+0000 7f0c93600640 1 --2- 172.21.15.32:0/48100057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c8c0aea70 0x7f0c8c1642f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:02.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.704+0000 7f0c93600640 1 --2- 172.21.15.32:0/48100057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c8c06b450 0x7f0c8c0717b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:02.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.708+0000 7f0c93600640 1 -- 172.21.15.32:0/48100057 >> 172.21.15.32:0/48100057 conn(0x7f0c8c0b1590 msgr2=0x7f0c8c0b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:02.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.708+0000 7f0c93600640 1 -- 172.21.15.32:0/48100057 shutdown_connections 2024-03-19T06:22:02.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.708+0000 7f0c93600640 1 -- 172.21.15.32:0/48100057 wait complete. 2024-03-19T06:22:02.721 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-19T06:22:02.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.920+0000 7f9200a00640 1 Processor -- start 2024-03-19T06:22:02.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.920+0000 7f9200a00640 1 -- start start 2024-03-19T06:22:02.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.924+0000 7f9200a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91fc0aefd0 0x7f91fc15e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:02.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.924+0000 7f9200a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91fc0ae210 con 0x7f91fc15e8c0 2024-03-19T06:22:02.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.924+0000 7f9200a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91fc0ae4f0 con 0x7f91fc0713c0 2024-03-19T06:22:02.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.924+0000 7f9200a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0aeb40 con 0x7f91fc0aefd0 2024-03-19T06:22:02.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.924+0000 7f91fa800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f91fc15e8c0 0x7f91fc06d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47798/0 (socket says 172.21.15.32:47798) 2024-03-19T06:22:02.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.924+0000 7f91fa800640 1 -- 172.21.15.32:0/2620201572 learned_addr learned my addr 172.21.15.32:0/2620201572 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:02.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.924+0000 7f91f3e00640 1 --2- 172.21.15.32:0/2620201572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91fc0aefd0 0x7f91fc15e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:02.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.924+0000 7f91f9400640 1 -- 172.21.15.32:0/2620201572 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808084171 0 0) 0x7f91fc0ae210 con 0x7f91fc15e8c0 2024-03-19T06:22:02.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.924+0000 7f91f9400640 1 -- 172.21.15.32:0/2620201572 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91e0003530 con 0x7f91fc15e8c0 2024-03-19T06:22:02.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.924+0000 7f91f9400640 1 -- 172.21.15.32:0/2620201572 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006412418 0 0) 0x7f91fc0ae4f0 con 0x7f91fc0713c0 2024-03-19T06:22:02.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.924+0000 7f91f9400640 1 -- 172.21.15.32:0/2620201572 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91fc0ae210 con 0x7f91fc0713c0 2024-03-19T06:22:02.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.924+0000 7f91f9400640 1 -- 172.21.15.32:0/2620201572 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 383050095 0 0) 0x7f91e0003530 con 0x7f91fc15e8c0 2024-03-19T06:22:02.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.924+0000 7f91f3e00640 1 -- 172.21.15.32:0/2620201572 >> v1:172.21.15.171:6789/0 conn(0x7f91fc0713c0 legacy=0x7f91fc0717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:02.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.924+0000 7f91f3e00640 1 -- 172.21.15.32:0/2620201572 >> v1:172.21.15.32:6789/0 conn(0x7f91fc15e8c0 legacy=0x7f91fc06d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:02.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.924+0000 7f91f3e00640 1 -- 172.21.15.32:0/2620201572 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc0ae7d0 con 0x7f91fc0aefd0 2024-03-19T06:22:02.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.928+0000 7f91f3e00640 1 --2- 172.21.15.32:0/2620201572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91fc0aefd0 0x7f91fc15e380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f91e40097f0 tx=0x7f91e401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8093bdf044e906ce server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:02.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.928+0000 7f91f9400640 1 -- 172.21.15.32:0/2620201572 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e40b0070 con 0x7f91fc0aefd0 2024-03-19T06:22:02.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.928+0000 7f91f9400640 1 -- 172.21.15.32:0/2620201572 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e40ab400 con 0x7f91fc0aefd0 2024-03-19T06:22:02.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.928+0000 7f91f9400640 1 -- 172.21.15.32:0/2620201572 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f4001a00 con 0x7f91fc0aefd0 2024-03-19T06:22:02.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.928+0000 7f9200a00640 1 -- 172.21.15.32:0/2620201572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91fc0aefd0 msgr2=0x7f91fc15e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:02.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.928+0000 7f9200a00640 1 --2- 172.21.15.32:0/2620201572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91fc0aefd0 0x7f91fc15e380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f91e40097f0 tx=0x7f91e401c400 comp rx=0 tx=0).stop 2024-03-19T06:22:02.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.928+0000 7f9200a00640 1 -- 172.21.15.32:0/2620201572 shutdown_connections 2024-03-19T06:22:02.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.928+0000 7f9200a00640 1 --2- 172.21.15.32:0/2620201572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91fc0aefd0 0x7f91fc15e380 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:02.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.928+0000 7f9200a00640 1 -- 172.21.15.32:0/2620201572 >> 172.21.15.32:0/2620201572 conn(0x7f91fc0671f0 msgr2=0x7f91fc06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:02.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.928+0000 7f9200a00640 1 -- 172.21.15.32:0/2620201572 shutdown_connections 2024-03-19T06:22:02.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.928+0000 7f9200a00640 1 -- 172.21.15.32:0/2620201572 wait complete. 2024-03-19T06:22:02.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.928+0000 7f9200a00640 1 Processor -- start 2024-03-19T06:22:02.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.928+0000 7f9200a00640 1 -- start start 2024-03-19T06:22:02.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f9200a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91fc0713c0 0x7f91fc13a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:02.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f9200a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91fc0aefd0 0x7f91fc135970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:02.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f9200a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91fc15e8c0 0x7f91fc1388f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:02.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f9200a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc16b810 con 0x7f91fc0713c0 2024-03-19T06:22:02.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f9200a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc16b690 con 0x7f91fc15e8c0 2024-03-19T06:22:02.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f9200a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc16b990 con 0x7f91fc0aefd0 2024-03-19T06:22:02.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f91f9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91fc0713c0 0x7f91fc13a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:02.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f91f9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91fc0713c0 0x7f91fc13a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47728/0 (socket says 172.21.15.32:47728) 2024-03-19T06:22:02.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f91f9e00640 1 -- 172.21.15.32:0/1059483877 learned_addr learned my addr 172.21.15.32:0/1059483877 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:02.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f91fa800640 1 --2- 172.21.15.32:0/1059483877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91fc15e8c0 0x7f91fc1388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:02.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f91f3e00640 1 --2- 172.21.15.32:0/1059483877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91fc0aefd0 0x7f91fc135970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:02.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f91f9e00640 1 -- 172.21.15.32:0/1059483877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91fc0aefd0 msgr2=0x7f91fc135970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:02.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f91f9e00640 1 --2- 172.21.15.32:0/1059483877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91fc0aefd0 0x7f91fc135970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:02.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f91f9e00640 1 -- 172.21.15.32:0/1059483877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91fc15e8c0 msgr2=0x7f91fc1388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:02.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f91f9e00640 1 --2- 172.21.15.32:0/1059483877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91fc15e8c0 0x7f91fc1388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:02.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f91f9e00640 1 -- 172.21.15.32:0/1059483877 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc145a60 con 0x7f91fc0713c0 2024-03-19T06:22:02.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f91f9e00640 1 --2- 172.21.15.32:0/1059483877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91fc0713c0 0x7f91fc13a470 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00c490 tx=0x7f91ec00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:02.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f91f2000640 1 -- 172.21.15.32:0/1059483877 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec0052d0 con 0x7f91fc0713c0 2024-03-19T06:22:02.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f91f2000640 1 -- 172.21.15.32:0/1059483877 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec005470 con 0x7f91fc0713c0 2024-03-19T06:22:02.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f91f2000640 1 -- 172.21.15.32:0/1059483877 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec012870 con 0x7f91fc0713c0 2024-03-19T06:22:02.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f9200a00640 1 -- 172.21.15.32:0/1059483877 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91fc145d40 con 0x7f91fc0713c0 2024-03-19T06:22:02.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f9200a00640 1 -- 172.21.15.32:0/1059483877 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91fc138080 con 0x7f91fc0713c0 2024-03-19T06:22:02.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f9200a00640 1 -- 172.21.15.32:0/1059483877 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91fc0749e0 con 0x7f91fc0713c0 2024-03-19T06:22:02.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.932+0000 7f91f2000640 1 -- 172.21.15.32:0/1059483877 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f91ec012a10 con 0x7f91fc0713c0 2024-03-19T06:22:02.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.936+0000 7f91f2000640 1 --2- 172.21.15.32:0/1059483877 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f91d8067690 0x7f91d8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:02.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.936+0000 7f91f2000640 1 -- 172.21.15.32:0/1059483877 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f91ec0853d0 con 0x7f91fc0713c0 2024-03-19T06:22:02.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.936+0000 7f91f3e00640 1 --2- 172.21.15.32:0/1059483877 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f91d8067690 0x7f91d8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:02.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.936+0000 7f91f3e00640 1 --2- 172.21.15.32:0/1059483877 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f91d8067690 0x7f91d8069b50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f91e40ad000 tx=0x7f91e40a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:02.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:02.940+0000 7f91f2000640 1 -- 172.21.15.32:0/1059483877 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f91ec0559c0 con 0x7f91fc0713c0 2024-03-19T06:22:03.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.104+0000 7f9200a00640 1 -- 172.21.15.32:0/1059483877 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f91fc0ce9d0 con 0x7f91fc0713c0 2024-03-19T06:22:03.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.704+0000 7f91f2000640 1 -- 172.21.15.32:0/1059483877 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7f91ec059a60 con 0x7f91fc0713c0 2024-03-19T06:22:03.698 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' removed 2024-03-19T06:22:03.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.708+0000 7f9200a00640 1 -- 172.21.15.32:0/1059483877 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f91d8067690 msgr2=0x7f91d8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:03.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.708+0000 7f9200a00640 1 --2- 172.21.15.32:0/1059483877 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f91d8067690 0x7f91d8069b50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f91e40ad000 tx=0x7f91e40a6000 comp rx=0 tx=0).stop 2024-03-19T06:22:03.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.708+0000 7f9200a00640 1 -- 172.21.15.32:0/1059483877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91fc0713c0 msgr2=0x7f91fc13a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:03.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.708+0000 7f9200a00640 1 --2- 172.21.15.32:0/1059483877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91fc0713c0 0x7f91fc13a470 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00c490 tx=0x7f91ec00c950 comp rx=0 tx=0).stop 2024-03-19T06:22:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.708+0000 7f9200a00640 1 -- 172.21.15.32:0/1059483877 shutdown_connections 2024-03-19T06:22:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.708+0000 7f9200a00640 1 --2- 172.21.15.32:0/1059483877 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f91d8067690 0x7f91d8069b50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.708+0000 7f9200a00640 1 --2- 172.21.15.32:0/1059483877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91fc15e8c0 0x7f91fc1388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.708+0000 7f9200a00640 1 --2- 172.21.15.32:0/1059483877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91fc0aefd0 0x7f91fc135970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.708+0000 7f9200a00640 1 --2- 172.21.15.32:0/1059483877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91fc0713c0 0x7f91fc13a470 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.708+0000 7f9200a00640 1 -- 172.21.15.32:0/1059483877 >> 172.21.15.32:0/1059483877 conn(0x7f91fc0671f0 msgr2=0x7f91fc140530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.708+0000 7f9200a00640 1 -- 172.21.15.32:0/1059483877 shutdown_connections 2024-03-19T06:22:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.708+0000 7f9200a00640 1 -- 172.21.15.32:0/1059483877 wait complete. 2024-03-19T06:22:03.727 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-19T06:22:03.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.888+0000 7f2e40600640 1 Processor -- start 2024-03-19T06:22:03.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.888+0000 7f2e40600640 1 -- start start 2024-03-19T06:22:03.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.888+0000 7f2e40600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e38072290 0x7f2e3815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:03.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.888+0000 7f2e40600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2e380aed40 0x7f2e3806dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:03.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.888+0000 7f2e40600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e380ccaa0 con 0x7f2e38071eb0 2024-03-19T06:22:03.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.892+0000 7f2e40600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3815b460 con 0x7f2e380aed40 2024-03-19T06:22:03.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.892+0000 7f2e40600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e380af1d0 con 0x7f2e38072290 2024-03-19T06:22:03.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.892+0000 7f2e3e600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2e380aed40 0x7f2e3806dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:03.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.892+0000 7f2e3e600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2e380aed40 0x7f2e3806dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49124/0 (socket says 172.21.15.32:49124) 2024-03-19T06:22:03.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.892+0000 7f2e3e600640 1 -- 172.21.15.32:0/1141809334 learned_addr learned my addr 172.21.15.32:0/1141809334 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:03.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.892+0000 7f2e3d200640 1 --2- 172.21.15.32:0/1141809334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e38072290 0x7f2e3815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:03.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.892+0000 7f2e3e600640 1 -- 172.21.15.32:0/1141809334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e38072290 msgr2=0x7f2e3815a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:03.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.892+0000 7f2e3e600640 1 --2- 172.21.15.32:0/1141809334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e38072290 0x7f2e3815a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:03.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.892+0000 7f2e3e600640 1 -- 172.21.15.32:0/1141809334 >> v1:172.21.15.171:6789/0 conn(0x7f2e38071eb0 legacy=0x7f2e380cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:03.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.892+0000 7f2e3e600640 1 -- 172.21.15.32:0/1141809334 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3815abc0 con 0x7f2e380aed40 2024-03-19T06:22:03.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.892+0000 7f2e3e600640 1 --2- 172.21.15.32:0/1141809334 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e380aed40 0x7f2e3806dae0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009e50 tx=0x7f2e3001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf4e3be4f560893 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:03.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.892+0000 7f2e37e00640 1 -- 172.21.15.32:0/1141809334 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e300a5680 con 0x7f2e380aed40 2024-03-19T06:22:03.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.892+0000 7f2e37e00640 1 -- 172.21.15.32:0/1141809334 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e300a5820 con 0x7f2e380aed40 2024-03-19T06:22:03.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.892+0000 7f2e37e00640 1 -- 172.21.15.32:0/1141809334 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e300a5bf0 con 0x7f2e380aed40 2024-03-19T06:22:03.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e40600640 1 -- 172.21.15.32:0/1141809334 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e380aed40 msgr2=0x7f2e3806dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:03.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e40600640 1 --2- 172.21.15.32:0/1141809334 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e380aed40 0x7f2e3806dae0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009e50 tx=0x7f2e3001ca30 comp rx=0 tx=0).stop 2024-03-19T06:22:03.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e40600640 1 -- 172.21.15.32:0/1141809334 shutdown_connections 2024-03-19T06:22:03.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e40600640 1 --2- 172.21.15.32:0/1141809334 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e380aed40 0x7f2e3806dae0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:03.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e40600640 1 --2- 172.21.15.32:0/1141809334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e38072290 0x7f2e3815a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:03.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e40600640 1 -- 172.21.15.32:0/1141809334 >> 172.21.15.32:0/1141809334 conn(0x7f2e380671f0 msgr2=0x7f2e3806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:03.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e40600640 1 -- 172.21.15.32:0/1141809334 shutdown_connections 2024-03-19T06:22:03.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e40600640 1 -- 172.21.15.32:0/1141809334 wait complete. 2024-03-19T06:22:03.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e40600640 1 Processor -- start 2024-03-19T06:22:03.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e40600640 1 -- start start 2024-03-19T06:22:03.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e40600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e38071eb0 0x7f2e381f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:03.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e40600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e38072290 0x7f2e381505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:03.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e40600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e380aed40 0x7f2e381591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:03.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e40600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e380ce640 con 0x7f2e38071eb0 2024-03-19T06:22:03.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e40600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3806e430 con 0x7f2e38072290 2024-03-19T06:22:03.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e40600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e380ce7c0 con 0x7f2e380aed40 2024-03-19T06:22:03.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e3dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e38071eb0 0x7f2e381f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:03.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e3dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e38071eb0 0x7f2e381f6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49140/0 (socket says 172.21.15.32:49140) 2024-03-19T06:22:03.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e3dc00640 1 -- 172.21.15.32:0/2509837962 learned_addr learned my addr 172.21.15.32:0/2509837962 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:03.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e3e600640 1 --2- 172.21.15.32:0/2509837962 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e380aed40 0x7f2e381591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:03.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.896+0000 7f2e3d200640 1 --2- 172.21.15.32:0/2509837962 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e38072290 0x7f2e381505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:03.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.900+0000 7f2e3dc00640 1 -- 172.21.15.32:0/2509837962 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e380aed40 msgr2=0x7f2e381591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:03.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.900+0000 7f2e3dc00640 1 --2- 172.21.15.32:0/2509837962 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e380aed40 0x7f2e381591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:03.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.900+0000 7f2e3dc00640 1 -- 172.21.15.32:0/2509837962 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e38072290 msgr2=0x7f2e381505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:03.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.900+0000 7f2e3dc00640 1 --2- 172.21.15.32:0/2509837962 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e38072290 0x7f2e381505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:03.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.900+0000 7f2e3dc00640 1 -- 172.21.15.32:0/2509837962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e38150b30 con 0x7f2e38071eb0 2024-03-19T06:22:03.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.900+0000 7f2e3dc00640 1 --2- 172.21.15.32:0/2509837962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e38071eb0 0x7f2e381f6d70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00c420 tx=0x7f2e2c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:03.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.900+0000 7f2e35600640 1 -- 172.21.15.32:0/2509837962 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c0052d0 con 0x7f2e38071eb0 2024-03-19T06:22:03.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.900+0000 7f2e35600640 1 -- 172.21.15.32:0/2509837962 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2c005470 con 0x7f2e38071eb0 2024-03-19T06:22:03.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.900+0000 7f2e40600640 1 -- 172.21.15.32:0/2509837962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e381f73c0 con 0x7f2e38071eb0 2024-03-19T06:22:03.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.900+0000 7f2e35600640 1 -- 172.21.15.32:0/2509837962 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c007260 con 0x7f2e38071eb0 2024-03-19T06:22:03.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.900+0000 7f2e40600640 1 -- 172.21.15.32:0/2509837962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e381f7980 con 0x7f2e38071eb0 2024-03-19T06:22:03.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.900+0000 7f2e40600640 1 -- 172.21.15.32:0/2509837962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e380749e0 con 0x7f2e38071eb0 2024-03-19T06:22:03.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.900+0000 7f2e35600640 1 -- 172.21.15.32:0/2509837962 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2e2c007400 con 0x7f2e38071eb0 2024-03-19T06:22:03.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.900+0000 7f2e35600640 1 --2- 172.21.15.32:0/2509837962 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e18067660 0x7f2e18069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:03.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.900+0000 7f2e35600640 1 -- 172.21.15.32:0/2509837962 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f2e2c084cb0 con 0x7f2e38071eb0 2024-03-19T06:22:03.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.900+0000 7f2e3d200640 1 --2- 172.21.15.32:0/2509837962 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e18067660 0x7f2e18069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:03.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.904+0000 7f2e3d200640 1 --2- 172.21.15.32:0/2509837962 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e18067660 0x7f2e18069b20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2e38159b90 tx=0x7f2e24009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:03.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:03.904+0000 7f2e35600640 1 -- 172.21.15.32:0/2509837962 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2e2c055320 con 0x7f2e38071eb0 2024-03-19T06:22:04.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.068+0000 7f2e40600640 1 -- 172.21.15.32:0/2509837962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2e3806ae70 con 0x7f2e38071eb0 2024-03-19T06:22:04.319 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:22:04.322 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:22:04.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.712+0000 7f2e35600640 1 -- 172.21.15.32:0/2509837962 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2e2c0593c0 con 0x7f2e38071eb0 2024-03-19T06:22:04.704 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' removed 2024-03-19T06:22:04.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.716+0000 7f2e40600640 1 -- 172.21.15.32:0/2509837962 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e18067660 msgr2=0x7f2e18069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:04.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.716+0000 7f2e40600640 1 --2- 172.21.15.32:0/2509837962 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e18067660 0x7f2e18069b20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2e38159b90 tx=0x7f2e24009190 comp rx=0 tx=0).stop 2024-03-19T06:22:04.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.716+0000 7f2e40600640 1 -- 172.21.15.32:0/2509837962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e38071eb0 msgr2=0x7f2e381f6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:04.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.716+0000 7f2e40600640 1 --2- 172.21.15.32:0/2509837962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e38071eb0 0x7f2e381f6d70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00c420 tx=0x7f2e2c00c8e0 comp rx=0 tx=0).stop 2024-03-19T06:22:04.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.716+0000 7f2e40600640 1 -- 172.21.15.32:0/2509837962 shutdown_connections 2024-03-19T06:22:04.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.716+0000 7f2e40600640 1 --2- 172.21.15.32:0/2509837962 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e18067660 0x7f2e18069b20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:04.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.716+0000 7f2e40600640 1 --2- 172.21.15.32:0/2509837962 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e380aed40 0x7f2e381591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:04.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.716+0000 7f2e40600640 1 --2- 172.21.15.32:0/2509837962 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e38072290 0x7f2e381505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:04.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.716+0000 7f2e40600640 1 --2- 172.21.15.32:0/2509837962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e38071eb0 0x7f2e381f6d70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:04.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.716+0000 7f2e40600640 1 -- 172.21.15.32:0/2509837962 >> 172.21.15.32:0/2509837962 conn(0x7f2e380671f0 msgr2=0x7f2e3815e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:04.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.716+0000 7f2e40600640 1 -- 172.21.15.32:0/2509837962 shutdown_connections 2024-03-19T06:22:04.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.716+0000 7f2e40600640 1 -- 172.21.15.32:0/2509837962 wait complete. 2024-03-19T06:22:04.733 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-19T06:22:04.733 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-19T06:22:04.733 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-19T06:22:04.733 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:22:04.734 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-19T06:22:04.734 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-19T06:22:04.734 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-19T06:22:04.734 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:22:04.734 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-19T06:22:04.734 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-19T06:22:04.734 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-19T06:22:04.735 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:22:04.735 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-19T06:22:04.735 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-19T06:22:04.735 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-19T06:22:04.735 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:22:04.746 INFO:tasks.ceph.mds.a:Stopped 2024-03-19T06:22:04.747 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-19T06:22:04.747 INFO:tasks.ceph.mds.c:Stopped 2024-03-19T06:22:04.748 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-19T06:22:04.749 INFO:tasks.ceph.mds.b:Stopped 2024-03-19T06:22:04.749 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-19T06:22:04.749 INFO:tasks.ceph.mds.d:Stopped 2024-03-19T06:22:04.750 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-19T06:22:04.793 INFO:tasks.ceph.mds.a:Started 2024-03-19T06:22:04.793 DEBUG:teuthology.parallel:result is None 2024-03-19T06:22:04.794 INFO:tasks.ceph.mds.b:Started 2024-03-19T06:22:04.794 DEBUG:teuthology.parallel:result is None 2024-03-19T06:22:04.795 INFO:tasks.ceph.mds.c:Started 2024-03-19T06:22:04.795 DEBUG:teuthology.parallel:result is None 2024-03-19T06:22:04.796 INFO:tasks.ceph.mds.d:Started 2024-03-19T06:22:04.796 DEBUG:teuthology.parallel:result is None 2024-03-19T06:22:04.796 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-19T06:22:04.888 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-03-19T06:22:04.889 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-03-19T06:22:04.894 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2024-03-19T06:22:04.896 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2024-03-19T06:22:04.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26e4c00640 1 Processor -- start 2024-03-19T06:22:04.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26e4c00640 1 -- start start 2024-03-19T06:22:04.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26e4c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f26e00aecf0 0x7f26e00ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:04.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26e4c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f26e015c010 0x7f26e015f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:04.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26e4c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e015fe20 con 0x7f26e006d6c0 2024-03-19T06:22:04.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26e4c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e01603e0 con 0x7f26e015c010 2024-03-19T06:22:04.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26e4c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e0160100 con 0x7f26e00aecf0 2024-03-19T06:22:04.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26dd400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f26e015c010 0x7f26e015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:04.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26dd400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f26e015c010 0x7f26e015f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49204/0 (socket says 172.21.15.32:49204) 2024-03-19T06:22:04.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26de800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f26e006d6c0 0x7f26e00cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38318/0 (socket says 172.21.15.32:38318) 2024-03-19T06:22:04.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26dd400640 1 -- 172.21.15.32:0/429936399 learned_addr learned my addr 172.21.15.32:0/429936399 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:04.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26dde00640 1 --2- 172.21.15.32:0/429936399 >> v2:172.21.15.171:3300/0 conn(0x7f26e00aecf0 0x7f26e00ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:04.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26dd400640 1 -- 172.21.15.32:0/429936399 >> v2:172.21.15.171:3300/0 conn(0x7f26e00aecf0 msgr2=0x7f26e00ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:04.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26dd400640 1 --2- 172.21.15.32:0/429936399 >> v2:172.21.15.171:3300/0 conn(0x7f26e00aecf0 0x7f26e00ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:04.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26dd400640 1 -- 172.21.15.32:0/429936399 >> v1:172.21.15.32:6789/0 conn(0x7f26e006d6c0 legacy=0x7f26e00cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:04.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26dd400640 1 -- 172.21.15.32:0/429936399 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e00ca1f0 con 0x7f26e015c010 2024-03-19T06:22:04.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.964+0000 7f26dca00640 1 -- 172.21.15.32:0/429936399 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249321348 0 0) 0x7f26e015fe20 con 0x7f26e006d6c0 2024-03-19T06:22:04.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.968+0000 7f26dd400640 1 --2- 172.21.15.32:0/429936399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26e015c010 0x7f26e015f520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f26e0068870 tx=0x7f26cc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907c140ec223d916 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:04.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.968+0000 7f26dca00640 1 -- 172.21.15.32:0/429936399 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0b1070 con 0x7f26e015c010 2024-03-19T06:22:04.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.968+0000 7f26dca00640 1 -- 172.21.15.32:0/429936399 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc0ac600 con 0x7f26e015c010 2024-03-19T06:22:04.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.968+0000 7f26dca00640 1 -- 172.21.15.32:0/429936399 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0ac9d0 con 0x7f26e015c010 2024-03-19T06:22:04.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.968+0000 7f26e4c00640 1 -- 172.21.15.32:0/429936399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26e015c010 msgr2=0x7f26e015f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:04.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.968+0000 7f26e4c00640 1 --2- 172.21.15.32:0/429936399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26e015c010 0x7f26e015f520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f26e0068870 tx=0x7f26cc01c490 comp rx=0 tx=0).stop 2024-03-19T06:22:04.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.968+0000 7f26e4c00640 1 -- 172.21.15.32:0/429936399 shutdown_connections 2024-03-19T06:22:04.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.968+0000 7f26e4c00640 1 --2- 172.21.15.32:0/429936399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26e015c010 0x7f26e015f520 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:04.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.968+0000 7f26e4c00640 1 --2- 172.21.15.32:0/429936399 >> v2:172.21.15.171:3300/0 conn(0x7f26e00aecf0 0x7f26e00ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:04.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.968+0000 7f26e4c00640 1 -- 172.21.15.32:0/429936399 >> 172.21.15.32:0/429936399 conn(0x7f26e00b1280 msgr2=0x7f26e00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:04.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.968+0000 7f26e4c00640 1 -- 172.21.15.32:0/429936399 shutdown_connections 2024-03-19T06:22:04.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.968+0000 7f26e4c00640 1 -- 172.21.15.32:0/429936399 wait complete. 2024-03-19T06:22:04.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26e4c00640 1 Processor -- start 2024-03-19T06:22:04.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26e4c00640 1 -- start start 2024-03-19T06:22:04.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26e4c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26e006d6c0 0x7f26e014ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:04.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26e4c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26e00aecf0 0x7f26e0156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:04.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26e4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26e015c010 0x7f26e0154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:04.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26e4c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e015fbe0 con 0x7f26e00aecf0 2024-03-19T06:22:04.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26e4c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e015fa60 con 0x7f26e006d6c0 2024-03-19T06:22:04.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26e4c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e0168ea0 con 0x7f26e015c010 2024-03-19T06:22:04.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26dd400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26e00aecf0 0x7f26e0156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:04.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26dde00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26e006d6c0 0x7f26e014ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:04.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26dd400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26e00aecf0 0x7f26e0156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49210/0 (socket says 172.21.15.32:49210) 2024-03-19T06:22:04.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26dd400640 1 -- 172.21.15.32:0/1671937824 learned_addr learned my addr 172.21.15.32:0/1671937824 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:04.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26de800640 1 --2- 172.21.15.32:0/1671937824 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26e015c010 0x7f26e0154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:04.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26dd400640 1 -- 172.21.15.32:0/1671937824 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26e015c010 msgr2=0x7f26e0154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:04.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26dd400640 1 --2- 172.21.15.32:0/1671937824 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26e015c010 0x7f26e0154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:04.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26dd400640 1 -- 172.21.15.32:0/1671937824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26e006d6c0 msgr2=0x7f26e014ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:04.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26dd400640 1 --2- 172.21.15.32:0/1671937824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26e006d6c0 0x7f26e014ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:04.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26dd400640 1 -- 172.21.15.32:0/1671937824 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e01561d0 con 0x7f26e00aecf0 2024-03-19T06:22:04.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26dd400640 1 --2- 172.21.15.32:0/1671937824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26e00aecf0 0x7f26e0156d50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0190a0 tx=0x7f26cc01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:04.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26d6000640 1 -- 172.21.15.32:0/1671937824 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0bd070 con 0x7f26e00aecf0 2024-03-19T06:22:04.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26d6000640 1 -- 172.21.15.32:0/1671937824 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc004030 con 0x7f26e00aecf0 2024-03-19T06:22:04.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26d6000640 1 -- 172.21.15.32:0/1671937824 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0b1040 con 0x7f26e00aecf0 2024-03-19T06:22:04.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26e4c00640 1 -- 172.21.15.32:0/1671937824 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e01564b0 con 0x7f26e00aecf0 2024-03-19T06:22:04.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.972+0000 7f26e4c00640 1 -- 172.21.15.32:0/1671937824 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e0155e60 con 0x7f26e00aecf0 2024-03-19T06:22:04.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.976+0000 7f26e4c00640 1 -- 172.21.15.32:0/1671937824 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e0159b30 con 0x7f26e00aecf0 2024-03-19T06:22:04.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.976+0000 7f26d6000640 1 -- 172.21.15.32:0/1671937824 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f26cc003620 con 0x7f26e00aecf0 2024-03-19T06:22:04.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.976+0000 7f26d6000640 1 --2- 172.21.15.32:0/1671937824 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f26c0067660 0x7f26c0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:04.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.976+0000 7f26d6000640 1 -- 172.21.15.32:0/1671937824 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f26cc11ec00 con 0x7f26e00aecf0 2024-03-19T06:22:04.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.976+0000 7f26dde00640 1 --2- 172.21.15.32:0/1671937824 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f26c0067660 0x7f26c0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:04.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.976+0000 7f26dde00640 1 --2- 172.21.15.32:0/1671937824 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f26c0067660 0x7f26c0069b20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f26d0007a60 tx=0x7f26d0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:04.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:04.980+0000 7f26d6000640 1 -- 172.21.15.32:0/1671937824 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f26cc125080 con 0x7f26e00aecf0 2024-03-19T06:22:05.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.156+0000 7f26e4c00640 1 -- 172.21.15.32:0/1671937824 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f26e00749e0 con 0x7f26e00aecf0 2024-03-19T06:22:05.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.724+0000 7f26d6000640 1 -- 172.21.15.32:0/1671937824 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f26cc016110 con 0x7f26e00aecf0 2024-03-19T06:22:05.716 INFO:teuthology.orchestra.run.smithi032.stderr: removed all blocklist entries 2024-03-19T06:22:05.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.728+0000 7f26e4c00640 1 -- 172.21.15.32:0/1671937824 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f26c0067660 msgr2=0x7f26c0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:05.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.728+0000 7f26e4c00640 1 --2- 172.21.15.32:0/1671937824 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f26c0067660 0x7f26c0069b20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f26d0007a60 tx=0x7f26d0008040 comp rx=0 tx=0).stop 2024-03-19T06:22:05.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.728+0000 7f26e4c00640 1 -- 172.21.15.32:0/1671937824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26e00aecf0 msgr2=0x7f26e0156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:05.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.728+0000 7f26e4c00640 1 --2- 172.21.15.32:0/1671937824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26e00aecf0 0x7f26e0156d50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0190a0 tx=0x7f26cc01acd0 comp rx=0 tx=0).stop 2024-03-19T06:22:05.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.728+0000 7f26e4c00640 1 -- 172.21.15.32:0/1671937824 shutdown_connections 2024-03-19T06:22:05.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.728+0000 7f26e4c00640 1 --2- 172.21.15.32:0/1671937824 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f26c0067660 0x7f26c0069b20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:05.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.728+0000 7f26e4c00640 1 --2- 172.21.15.32:0/1671937824 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f26e015c010 0x7f26e0154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:05.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.728+0000 7f26e4c00640 1 --2- 172.21.15.32:0/1671937824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26e00aecf0 0x7f26e0156d50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:05.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.728+0000 7f26e4c00640 1 --2- 172.21.15.32:0/1671937824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26e006d6c0 0x7f26e014ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:05.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.728+0000 7f26e4c00640 1 -- 172.21.15.32:0/1671937824 >> 172.21.15.32:0/1671937824 conn(0x7f26e00b1280 msgr2=0x7f26e015db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:05.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.728+0000 7f26e4c00640 1 -- 172.21.15.32:0/1671937824 shutdown_connections 2024-03-19T06:22:05.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.728+0000 7f26e4c00640 1 -- 172.21.15.32:0/1671937824 wait complete. 2024-03-19T06:22:05.745 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-19T06:22:05.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.896+0000 7fb487400640 1 Processor -- start 2024-03-19T06:22:05.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.896+0000 7fb487400640 1 -- start start 2024-03-19T06:22:05.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.896+0000 7fb487400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb48015a7c0 0x7fb4800cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:05.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.896+0000 7fb487400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4800cb670 con 0x7fb4800cc680 2024-03-19T06:22:05.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.896+0000 7fb487400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4800cb950 con 0x7fb4800b4c50 2024-03-19T06:22:05.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.896+0000 7fb487400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48015f400 con 0x7fb48015a7c0 2024-03-19T06:22:05.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.896+0000 7fb484a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb48015a7c0 0x7fb4800cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:05.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.896+0000 7fb47fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb4800cc680 0x7fb48015ecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38328/0 (socket says 172.21.15.32:38328) 2024-03-19T06:22:05.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.896+0000 7fb47fe00640 1 -- 172.21.15.32:0/4263245197 learned_addr learned my addr 172.21.15.32:0/4263245197 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:05.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.896+0000 7fb47f400640 1 -- 172.21.15.32:0/4263245197 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597745569 0 0) 0x7fb4800cb670 con 0x7fb4800cc680 2024-03-19T06:22:05.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.896+0000 7fb47f400640 1 -- 172.21.15.32:0/4263245197 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb468003530 con 0x7fb4800cc680 2024-03-19T06:22:05.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.896+0000 7fb484a00640 1 -- 172.21.15.32:0/4263245197 >> v1:172.21.15.171:6789/0 conn(0x7fb4800b4c50 legacy=0x7fb4800cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:05.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.896+0000 7fb484a00640 1 -- 172.21.15.32:0/4263245197 >> v1:172.21.15.32:6789/0 conn(0x7fb4800cc680 legacy=0x7fb48015ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:05.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.896+0000 7fb484a00640 1 -- 172.21.15.32:0/4263245197 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48015e4f0 con 0x7fb48015a7c0 2024-03-19T06:22:05.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.900+0000 7fb484a00640 1 --2- 172.21.15.32:0/4263245197 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb48015a7c0 0x7fb4800cae20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb4740097c0 tx=0x7fb47401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b09ab5b837d2166 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:05.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.900+0000 7fb47f400640 1 -- 172.21.15.32:0/4263245197 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4740b1070 con 0x7fb48015a7c0 2024-03-19T06:22:05.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.900+0000 7fb47f400640 1 -- 172.21.15.32:0/4263245197 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4740ac410 con 0x7fb48015a7c0 2024-03-19T06:22:05.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.900+0000 7fb47f400640 1 -- 172.21.15.32:0/4263245197 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4740ac7e0 con 0x7fb48015a7c0 2024-03-19T06:22:05.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.900+0000 7fb487400640 1 -- 172.21.15.32:0/4263245197 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb48015a7c0 msgr2=0x7fb4800cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:05.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.900+0000 7fb487400640 1 --2- 172.21.15.32:0/4263245197 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb48015a7c0 0x7fb4800cae20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb4740097c0 tx=0x7fb47401c4a0 comp rx=0 tx=0).stop 2024-03-19T06:22:05.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.900+0000 7fb487400640 1 -- 172.21.15.32:0/4263245197 shutdown_connections 2024-03-19T06:22:05.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.900+0000 7fb487400640 1 --2- 172.21.15.32:0/4263245197 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb48015a7c0 0x7fb4800cae20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:05.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.900+0000 7fb487400640 1 -- 172.21.15.32:0/4263245197 >> 172.21.15.32:0/4263245197 conn(0x7fb4800b1280 msgr2=0x7fb4800b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:05.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.900+0000 7fb487400640 1 -- 172.21.15.32:0/4263245197 shutdown_connections 2024-03-19T06:22:05.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.900+0000 7fb487400640 1 -- 172.21.15.32:0/4263245197 wait complete. 2024-03-19T06:22:05.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb487400640 1 Processor -- start 2024-03-19T06:22:05.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb487400640 1 -- start start 2024-03-19T06:22:05.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb487400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4800b4c50 0x7fb4801f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:05.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb487400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4800cc680 0x7fb480142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:05.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb487400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb48015a7c0 0x7fb480150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:05.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb487400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800cbdb0 con 0x7fb4800cc680 2024-03-19T06:22:05.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb487400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800cbc30 con 0x7fb4800b4c50 2024-03-19T06:22:05.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb487400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb480169010 con 0x7fb48015a7c0 2024-03-19T06:22:05.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb47fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4800cc680 0x7fb480142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:05.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb47fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4800cc680 0x7fb480142720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49220/0 (socket says 172.21.15.32:49220) 2024-03-19T06:22:05.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb47fe00640 1 -- 172.21.15.32:0/733436693 learned_addr learned my addr 172.21.15.32:0/733436693 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:05.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb484a00640 1 --2- 172.21.15.32:0/733436693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4800b4c50 0x7fb4801f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:05.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb485400640 1 --2- 172.21.15.32:0/733436693 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb48015a7c0 0x7fb480150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:05.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb47fe00640 1 -- 172.21.15.32:0/733436693 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb48015a7c0 msgr2=0x7fb480150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:05.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb47fe00640 1 --2- 172.21.15.32:0/733436693 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb48015a7c0 0x7fb480150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:05.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb47fe00640 1 -- 172.21.15.32:0/733436693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4800b4c50 msgr2=0x7fb4801f7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:05.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb47fe00640 1 --2- 172.21.15.32:0/733436693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4800b4c50 0x7fb4801f7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:05.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb47fe00640 1 -- 172.21.15.32:0/733436693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb480143250 con 0x7fb4800cc680 2024-03-19T06:22:05.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb484a00640 1 --2- 172.21.15.32:0/733436693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4800b4c50 0x7fb4801f7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:05.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb47fe00640 1 --2- 172.21.15.32:0/733436693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4800cc680 0x7fb480142720 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00c420 tx=0x7fb46c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:05.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb47cc00640 1 -- 172.21.15.32:0/733436693 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c017070 con 0x7fb4800cc680 2024-03-19T06:22:05.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb47cc00640 1 -- 172.21.15.32:0/733436693 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c005cf0 con 0x7fb4800cc680 2024-03-19T06:22:05.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb47cc00640 1 -- 172.21.15.32:0/733436693 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0072d0 con 0x7fb4800cc680 2024-03-19T06:22:05.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb487400640 1 -- 172.21.15.32:0/733436693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb480153710 con 0x7fb4800cc680 2024-03-19T06:22:05.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.904+0000 7fb487400640 1 -- 172.21.15.32:0/733436693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb480153cd0 con 0x7fb4800cc680 2024-03-19T06:22:05.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.908+0000 7fb487400640 1 -- 172.21.15.32:0/733436693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4800749e0 con 0x7fb4800cc680 2024-03-19T06:22:05.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.908+0000 7fb47cc00640 1 -- 172.21.15.32:0/733436693 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb46c01a070 con 0x7fb4800cc680 2024-03-19T06:22:05.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.908+0000 7fb47cc00640 1 --2- 172.21.15.32:0/733436693 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb460067660 0x7fb460069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:05.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.908+0000 7fb47cc00640 1 -- 172.21.15.32:0/733436693 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb46c0848d0 con 0x7fb4800cc680 2024-03-19T06:22:05.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.908+0000 7fb484a00640 1 --2- 172.21.15.32:0/733436693 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb460067660 0x7fb460069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:05.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.908+0000 7fb484a00640 1 --2- 172.21.15.32:0/733436693 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb460067660 0x7fb460069b20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb4740ae000 tx=0x7fb474008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:05.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:05.912+0000 7fb47cc00640 1 -- 172.21.15.32:0/733436693 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fb46c0551b0 con 0x7fb4800cc680 2024-03-19T06:22:06.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.132+0000 7fb487400640 1 -- 172.21.15.32:0/733436693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb4800ce2d0 con 0x7fb4800cc680 2024-03-19T06:22:06.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.132+0000 7fb47cc00640 1 -- 172.21.15.32:0/733436693 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fb46c059250 con 0x7fb4800cc680 2024-03-19T06:22:06.124 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:06.124 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:22:06.125 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_dump": [ 2024-03-19T06:22:06.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.125 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.a", 2024-03-19T06:22:06.125 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCWLvlljLvFGxAAlds2Mvwa4/hC2skBcC2ceA==", 2024-03-19T06:22:06.125 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.125 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-03-19T06:22:06.125 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-03-19T06:22:06.125 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-03-19T06:22:06.125 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:22:06.125 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.125 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.b", 2024-03-19T06:22:06.126 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCWLvllqALDJxAAfoy/TWEOQH79VM3rc4wOJA==", 2024-03-19T06:22:06.126 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.126 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-03-19T06:22:06.126 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-03-19T06:22:06.126 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-03-19T06:22:06.126 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:22:06.126 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.126 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.c", 2024-03-19T06:22:06.126 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCWLvllWfL0IhAAbekYB7Oxo0Mkvhr9MfnTlQ==", 2024-03-19T06:22:06.126 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.126 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-03-19T06:22:06.127 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-03-19T06:22:06.127 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-03-19T06:22:06.127 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:22:06.127 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.127 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.d", 2024-03-19T06:22:06.127 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCWLvll/Ij7LhAA6Kje3GNOhtsqVtw2XxnzbA==", 2024-03-19T06:22:06.127 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.127 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-03-19T06:22:06.127 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-03-19T06:22:06.127 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-03-19T06:22:06.127 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:22:06.127 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.128 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.0", 2024-03-19T06:22:06.128 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCYLvllx+jFFhAAnkaZb1RSqgc++W4yccQSwQ==", 2024-03-19T06:22:06.128 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.128 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-03-19T06:22:06.128 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-03-19T06:22:06.128 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:22:06.128 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.128 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.1", 2024-03-19T06:22:06.128 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCbLvllpaOLHBAAUrnlxbToEpaUGPK64IPpcw==", 2024-03-19T06:22:06.128 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.128 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-03-19T06:22:06.128 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-03-19T06:22:06.129 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:22:06.129 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.129 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.2", 2024-03-19T06:22:06.129 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCeLvllF3C8IRAAdroKWih6nFV1qSYCoB/lmw==", 2024-03-19T06:22:06.129 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.129 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-03-19T06:22:06.129 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-03-19T06:22:06.129 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:22:06.129 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.129 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.3", 2024-03-19T06:22:06.130 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQChLvllvtbDJxAArLL+/yemOLsey+PM9dkWRg==", 2024-03-19T06:22:06.130 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.130 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-03-19T06:22:06.130 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-03-19T06:22:06.130 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:22:06.130 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.130 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.4", 2024-03-19T06:22:06.130 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCnLvllKeTFLhAA9mcJnZWoF4dg9uAiVbNCvQ==", 2024-03-19T06:22:06.130 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.130 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-03-19T06:22:06.130 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-03-19T06:22:06.131 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:22:06.131 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.131 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.5", 2024-03-19T06:22:06.131 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCqLvllMLEDNBAAOS5umMhq4ko7Xaq3EPfbGA==", 2024-03-19T06:22:06.131 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.131 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-03-19T06:22:06.131 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-03-19T06:22:06.131 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:22:06.131 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.131 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.6", 2024-03-19T06:22:06.132 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCtLvllAMULORAAkXGAk1fzYoe3aLCX3X7X/Q==", 2024-03-19T06:22:06.132 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.132 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-03-19T06:22:06.132 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-03-19T06:22:06.132 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:22:06.132 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.132 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.7", 2024-03-19T06:22:06.132 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCxLvllXLiCBBAAhLxVcFjGUC/9oUgvZeEhvA==", 2024-03-19T06:22:06.132 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.132 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-03-19T06:22:06.132 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-03-19T06:22:06.132 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:22:06.132 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.133 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.0", 2024-03-19T06:22:06.133 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCWLvll4jsFMxAAr4PzH6Djodh2O01vGYgxKA==", 2024-03-19T06:22:06.133 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.133 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-03-19T06:22:06.133 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2024-03-19T06:22:06.133 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2024-03-19T06:22:06.133 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2024-03-19T06:22:06.133 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.133 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.1", 2024-03-19T06:22:06.133 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCXLvll7wIgARAAaX65ntzvAhcJTgqzb0y1Ew==", 2024-03-19T06:22:06.133 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.133 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-03-19T06:22:06.134 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2024-03-19T06:22:06.134 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2024-03-19T06:22:06.134 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2024-03-19T06:22:06.134 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.134 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.2", 2024-03-19T06:22:06.134 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCWLvllYZFNORAALY1J92J5+349+Qeis5e7qA==", 2024-03-19T06:22:06.134 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.134 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-03-19T06:22:06.134 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2024-03-19T06:22:06.134 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2024-03-19T06:22:06.134 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2024-03-19T06:22:06.135 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.135 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.3", 2024-03-19T06:22:06.135 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCXLvllT1RXBxAAI6mJ94oohPbKmh4ItjkrBQ==", 2024-03-19T06:22:06.135 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.135 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-03-19T06:22:06.135 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2024-03-19T06:22:06.135 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2024-03-19T06:22:06.135 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2024-03-19T06:22:06.135 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.135 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.admin", 2024-03-19T06:22:06.135 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCVLvllGx/oOhAA13gLxJVMoUXzUlbvTMiZWw==", 2024-03-19T06:22:06.136 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.136 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-03-19T06:22:06.136 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-03-19T06:22:06.136 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-03-19T06:22:06.136 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:22:06.136 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.136 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-mds", 2024-03-19T06:22:06.136 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQC8LvlllybfARAAm/qhckfu9fgd7mtXZwg5+Q==", 2024-03-19T06:22:06.136 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.136 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-mds" 2024-03-19T06:22:06.136 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.137 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-mgr", 2024-03-19T06:22:06.137 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQC8Lvll1jDfARAA6QcQG6lDEnjm5+vDhsPHIQ==", 2024-03-19T06:22:06.137 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.137 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-19T06:22:06.137 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.137 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-osd", 2024-03-19T06:22:06.137 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQC8Lvll9znfARAAi2DGKx6YrLexFjUcYhD69w==", 2024-03-19T06:22:06.137 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.137 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-osd" 2024-03-19T06:22:06.137 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.138 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rbd", 2024-03-19T06:22:06.138 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQC8Lvll6ELfARAA6ZpdYF0kL/1i5Jns+5l0Cw==", 2024-03-19T06:22:06.138 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.138 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-19T06:22:06.138 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.138 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-19T06:22:06.138 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQC8LvllC0zfARAAXZD/WXFtoEMZoCCyYh4OGQ==", 2024-03-19T06:22:06.138 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.138 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-19T06:22:06.138 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.139 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rgw", 2024-03-19T06:22:06.139 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQC8LvllPlXfARAA0d0hVMvFRbwHRCX8IHlUvw==", 2024-03-19T06:22:06.139 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.139 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-19T06:22:06.139 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.139 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.x", 2024-03-19T06:22:06.139 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCWLvlluVExFxAAtRoYgLHd1QZXDoHoE7hcGQ==", 2024-03-19T06:22:06.139 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.139 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-03-19T06:22:06.139 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2024-03-19T06:22:06.139 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:22:06.139 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:06.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:06.140 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.y", 2024-03-19T06:22:06.140 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCWLvllS0JQExAA9gZOkTMS3zZfd6B3JtfXNw==", 2024-03-19T06:22:06.140 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:22:06.140 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-03-19T06:22:06.140 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2024-03-19T06:22:06.140 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:22:06.140 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.140 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:06.140 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-03-19T06:22:06.140 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:22:06.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.132+0000 7fb487400640 1 -- 172.21.15.32:0/733436693 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb460067660 msgr2=0x7fb460069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:06.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.132+0000 7fb487400640 1 --2- 172.21.15.32:0/733436693 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb460067660 0x7fb460069b20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb4740ae000 tx=0x7fb474008040 comp rx=0 tx=0).stop 2024-03-19T06:22:06.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.132+0000 7fb487400640 1 -- 172.21.15.32:0/733436693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4800cc680 msgr2=0x7fb480142720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:06.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.132+0000 7fb487400640 1 --2- 172.21.15.32:0/733436693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4800cc680 0x7fb480142720 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00c420 tx=0x7fb46c00c8e0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.132+0000 7fb487400640 1 -- 172.21.15.32:0/733436693 shutdown_connections 2024-03-19T06:22:06.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.132+0000 7fb487400640 1 --2- 172.21.15.32:0/733436693 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb460067660 0x7fb460069b20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.132+0000 7fb487400640 1 --2- 172.21.15.32:0/733436693 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb48015a7c0 0x7fb480150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.132+0000 7fb487400640 1 --2- 172.21.15.32:0/733436693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4800cc680 0x7fb480142720 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.132+0000 7fb487400640 1 --2- 172.21.15.32:0/733436693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4800b4c50 0x7fb4801f7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.132+0000 7fb487400640 1 -- 172.21.15.32:0/733436693 >> 172.21.15.32:0/733436693 conn(0x7fb4800b1280 msgr2=0x7fb4800ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:06.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.132+0000 7fb487400640 1 -- 172.21.15.32:0/733436693 shutdown_connections 2024-03-19T06:22:06.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.132+0000 7fb487400640 1 -- 172.21.15.32:0/733436693 wait complete. 2024-03-19T06:22:06.145 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-19T06:22:06.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5d1200640 1 Processor -- start 2024-03-19T06:22:06.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5d1200640 1 -- start start 2024-03-19T06:22:06.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5d1200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff5cc0aecf0 0x7ff5cc0ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:06.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5d1200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5cc15fe20 con 0x7ff5cc15c010 2024-03-19T06:22:06.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5d1200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5cc160100 con 0x7ff5cc06d6c0 2024-03-19T06:22:06.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5d1200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5cc1603e0 con 0x7ff5cc0aecf0 2024-03-19T06:22:06.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5c3e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff5cc15c010 0x7ff5cc15f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38342/0 (socket says 172.21.15.32:38342) 2024-03-19T06:22:06.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5c3e00640 1 -- 172.21.15.32:0/791262817 learned_addr learned my addr 172.21.15.32:0/791262817 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:06.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5c9e00640 1 --2- 172.21.15.32:0/791262817 >> v2:172.21.15.171:3300/0 conn(0x7ff5cc0aecf0 0x7ff5cc0ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:06.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5c9400640 1 -- 172.21.15.32:0/791262817 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104354944 0 0) 0x7ff5cc15fe20 con 0x7ff5cc15c010 2024-03-19T06:22:06.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5c9400640 1 -- 172.21.15.32:0/791262817 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5b0003530 con 0x7ff5cc15c010 2024-03-19T06:22:06.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5c9400640 1 -- 172.21.15.32:0/791262817 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806522879 0 0) 0x7ff5cc160100 con 0x7ff5cc06d6c0 2024-03-19T06:22:06.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5c9400640 1 -- 172.21.15.32:0/791262817 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5cc15fe20 con 0x7ff5cc06d6c0 2024-03-19T06:22:06.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5c9e00640 1 -- 172.21.15.32:0/791262817 >> v1:172.21.15.171:6789/0 conn(0x7ff5cc06d6c0 legacy=0x7ff5cc0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:06.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5c9e00640 1 -- 172.21.15.32:0/791262817 >> v1:172.21.15.32:6789/0 conn(0x7ff5cc15c010 legacy=0x7ff5cc15f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:06.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5c9400640 1 -- 172.21.15.32:0/791262817 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4076395245 0 0) 0x7ff5b0003530 con 0x7ff5cc15c010 2024-03-19T06:22:06.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.296+0000 7ff5c9e00640 1 -- 172.21.15.32:0/791262817 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc0ca1f0 con 0x7ff5cc0aecf0 2024-03-19T06:22:06.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.300+0000 7ff5c9e00640 1 --2- 172.21.15.32:0/791262817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5cc0aecf0 0x7ff5cc0ca9f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0097c0 tx=0x7ff5bc01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93b02d36d81299ef server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:06.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.300+0000 7ff5c9400640 1 -- 172.21.15.32:0/791262817 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0b0070 con 0x7ff5cc0aecf0 2024-03-19T06:22:06.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.300+0000 7ff5c9400640 1 -- 172.21.15.32:0/791262817 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc0a4e50 con 0x7ff5cc0aecf0 2024-03-19T06:22:06.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.300+0000 7ff5c9400640 1 -- 172.21.15.32:0/791262817 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4001680 con 0x7ff5cc0aecf0 2024-03-19T06:22:06.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.300+0000 7ff5d1200640 1 -- 172.21.15.32:0/791262817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5cc0aecf0 msgr2=0x7ff5cc0ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:06.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.300+0000 7ff5d1200640 1 --2- 172.21.15.32:0/791262817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5cc0aecf0 0x7ff5cc0ca9f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0097c0 tx=0x7ff5bc01c330 comp rx=0 tx=0).stop 2024-03-19T06:22:06.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.300+0000 7ff5d1200640 1 -- 172.21.15.32:0/791262817 shutdown_connections 2024-03-19T06:22:06.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.300+0000 7ff5d1200640 1 --2- 172.21.15.32:0/791262817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5cc0aecf0 0x7ff5cc0ca9f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.300+0000 7ff5d1200640 1 -- 172.21.15.32:0/791262817 >> 172.21.15.32:0/791262817 conn(0x7ff5cc0b1280 msgr2=0x7ff5cc0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:06.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.300+0000 7ff5d1200640 1 -- 172.21.15.32:0/791262817 shutdown_connections 2024-03-19T06:22:06.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.300+0000 7ff5d1200640 1 -- 172.21.15.32:0/791262817 wait complete. 2024-03-19T06:22:06.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5d1200640 1 Processor -- start 2024-03-19T06:22:06.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5d1200640 1 -- start start 2024-03-19T06:22:06.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5d1200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5cc06d6c0 0x7ff5cc0c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:06.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5d1200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5cc0aecf0 0x7ff5cc1517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:06.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5d1200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5cc15c010 0x7ff5cc151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:06.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5d1200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc16a030 con 0x7ff5cc15c010 2024-03-19T06:22:06.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5d1200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc169eb0 con 0x7ff5cc0aecf0 2024-03-19T06:22:06.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5d1200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc16a1b0 con 0x7ff5cc06d6c0 2024-03-19T06:22:06.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5ca800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5cc15c010 0x7ff5cc151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:06.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5ca800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5cc15c010 0x7ff5cc151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49224/0 (socket says 172.21.15.32:49224) 2024-03-19T06:22:06.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5ca800640 1 -- 172.21.15.32:0/529575240 learned_addr learned my addr 172.21.15.32:0/529575240 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:06.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5c3e00640 1 --2- 172.21.15.32:0/529575240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5cc0aecf0 0x7ff5cc1517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:06.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5c9e00640 1 --2- 172.21.15.32:0/529575240 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5cc06d6c0 0x7ff5cc0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:06.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5ca800640 1 -- 172.21.15.32:0/529575240 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5cc06d6c0 msgr2=0x7ff5cc0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:06.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5ca800640 1 --2- 172.21.15.32:0/529575240 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5cc06d6c0 0x7ff5cc0c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5ca800640 1 -- 172.21.15.32:0/529575240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5cc0aecf0 msgr2=0x7ff5cc1517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:06.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5ca800640 1 --2- 172.21.15.32:0/529575240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5cc0aecf0 0x7ff5cc1517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5ca800640 1 -- 172.21.15.32:0/529575240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc153c10 con 0x7ff5cc15c010 2024-03-19T06:22:06.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5ca800640 1 --2- 172.21.15.32:0/529575240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5cc15c010 0x7ff5cc151d30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400c730 tx=0x7ff5c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:06.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5c2000640 1 -- 172.21.15.32:0/529575240 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4003b80 con 0x7ff5cc15c010 2024-03-19T06:22:06.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5c2000640 1 -- 172.21.15.32:0/529575240 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c4003d20 con 0x7ff5cc15c010 2024-03-19T06:22:06.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5d1200640 1 -- 172.21.15.32:0/529575240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5cc153ef0 con 0x7ff5cc15c010 2024-03-19T06:22:06.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5c2000640 1 -- 172.21.15.32:0/529575240 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c400aa90 con 0x7ff5cc15c010 2024-03-19T06:22:06.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.304+0000 7ff5d1200640 1 -- 172.21.15.32:0/529575240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5cc1544b0 con 0x7ff5cc15c010 2024-03-19T06:22:06.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.308+0000 7ff5d1200640 1 -- 172.21.15.32:0/529575240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5cc0749e0 con 0x7ff5cc15c010 2024-03-19T06:22:06.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.308+0000 7ff5c2000640 1 -- 172.21.15.32:0/529575240 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff5c400ac30 con 0x7ff5cc15c010 2024-03-19T06:22:06.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.308+0000 7ff5c2000640 1 --2- 172.21.15.32:0/529575240 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff5a8067660 0x7ff5a8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:06.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.308+0000 7ff5c2000640 1 -- 172.21.15.32:0/529575240 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff5c4085320 con 0x7ff5cc15c010 2024-03-19T06:22:06.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.308+0000 7ff5c9e00640 1 --2- 172.21.15.32:0/529575240 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff5a8067660 0x7ff5a8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:06.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.308+0000 7ff5c9e00640 1 --2- 172.21.15.32:0/529575240 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff5a8067660 0x7ff5a8069b20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0ad000 tx=0x7ff5bc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:06.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.312+0000 7ff5c2000640 1 -- 172.21.15.32:0/529575240 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7ff5c4055ca0 con 0x7ff5cc15c010 2024-03-19T06:22:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.532+0000 7ff5d1200640 1 -- 172.21.15.32:0/529575240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ff5cc0b0650 con 0x7ff5cc15c010 2024-03-19T06:22:06.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.536+0000 7ff5c2000640 1 -- 172.21.15.32:0/529575240 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff5c4059d40 con 0x7ff5cc15c010 2024-03-19T06:22:06.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.536+0000 7ff5d1200640 1 -- 172.21.15.32:0/529575240 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff5a8067660 msgr2=0x7ff5a8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:06.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.536+0000 7ff5d1200640 1 --2- 172.21.15.32:0/529575240 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff5a8067660 0x7ff5a8069b20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0ad000 tx=0x7ff5bc008040 comp rx=0 tx=0).stop 2024-03-19T06:22:06.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.536+0000 7ff5d1200640 1 -- 172.21.15.32:0/529575240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5cc15c010 msgr2=0x7ff5cc151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:06.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.536+0000 7ff5d1200640 1 --2- 172.21.15.32:0/529575240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5cc15c010 0x7ff5cc151d30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400c730 tx=0x7ff5c400cbf0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.536+0000 7ff5d1200640 1 -- 172.21.15.32:0/529575240 shutdown_connections 2024-03-19T06:22:06.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.536+0000 7ff5d1200640 1 --2- 172.21.15.32:0/529575240 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff5a8067660 0x7ff5a8069b20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.536+0000 7ff5d1200640 1 --2- 172.21.15.32:0/529575240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5cc15c010 0x7ff5cc151d30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.536+0000 7ff5d1200640 1 --2- 172.21.15.32:0/529575240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5cc0aecf0 0x7ff5cc1517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.536+0000 7ff5d1200640 1 --2- 172.21.15.32:0/529575240 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5cc06d6c0 0x7ff5cc0c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.536+0000 7ff5d1200640 1 -- 172.21.15.32:0/529575240 >> 172.21.15.32:0/529575240 conn(0x7ff5cc0b1280 msgr2=0x7ff5cc0cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:06.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.536+0000 7ff5d1200640 1 -- 172.21.15.32:0/529575240 shutdown_connections 2024-03-19T06:22:06.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.536+0000 7ff5d1200640 1 -- 172.21.15.32:0/529575240 wait complete. 2024-03-19T06:22:06.549 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-19T06:22:06.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.700+0000 7f328da00640 1 Processor -- start 2024-03-19T06:22:06.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.700+0000 7f328da00640 1 -- start start 2024-03-19T06:22:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.700+0000 7f328da00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3288099a70 0x7f3288099e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.700+0000 7f328da00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32880700a0 0x7f3288070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:06.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.700+0000 7f328da00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328806fbe0 con 0x7f328806c060 2024-03-19T06:22:06.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.700+0000 7f328da00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328815e720 con 0x7f3288099a70 2024-03-19T06:22:06.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.700+0000 7f328da00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328809a390 con 0x7f32880700a0 2024-03-19T06:22:06.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.700+0000 7f3286a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3288099a70 0x7f3288099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:06.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.700+0000 7f3287400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32880700a0 0x7f3288070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:06.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.700+0000 7f3286a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3288099a70 0x7f3288099e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:38778/0 (socket says 172.21.15.32:38778) 2024-03-19T06:22:06.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.700+0000 7f3286a00640 1 -- 172.21.15.32:0/2625967169 learned_addr learned my addr 172.21.15.32:0/2625967169 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:06.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.704+0000 7f3287400640 1 -- 172.21.15.32:0/2625967169 >> v2:172.21.15.171:3300/0 conn(0x7f3288099a70 msgr2=0x7f3288099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:06.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.704+0000 7f3287400640 1 --2- 172.21.15.32:0/2625967169 >> v2:172.21.15.171:3300/0 conn(0x7f3288099a70 0x7f3288099e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.704+0000 7f3287400640 1 -- 172.21.15.32:0/2625967169 >> v1:172.21.15.171:6789/0 conn(0x7f328806c060 legacy=0x7f328815e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:06.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.704+0000 7f3287400640 1 -- 172.21.15.32:0/2625967169 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328815e940 con 0x7f32880700a0 2024-03-19T06:22:06.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.704+0000 7f3286a00640 1 --2- 172.21.15.32:0/2625967169 >> v2:172.21.15.171:3300/0 conn(0x7f3288099a70 0x7f3288099e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:22:06.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.704+0000 7f3287400640 1 --2- 172.21.15.32:0/2625967169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32880700a0 0x7f3288070510 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3280009d90 tx=0x7f328001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6579fd6b41f2b243 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:06.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.704+0000 7f3286000640 1 -- 172.21.15.32:0/2625967169 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800b2070 con 0x7f32880700a0 2024-03-19T06:22:06.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.704+0000 7f3286000640 1 -- 172.21.15.32:0/2625967169 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32800a5920 con 0x7f32880700a0 2024-03-19T06:22:06.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.704+0000 7f3286000640 1 -- 172.21.15.32:0/2625967169 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800a5cf0 con 0x7f32880700a0 2024-03-19T06:22:06.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f328da00640 1 -- 172.21.15.32:0/2625967169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32880700a0 msgr2=0x7f3288070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:06.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f328da00640 1 --2- 172.21.15.32:0/2625967169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32880700a0 0x7f3288070510 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3280009d90 tx=0x7f328001c970 comp rx=0 tx=0).stop 2024-03-19T06:22:06.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f328da00640 1 -- 172.21.15.32:0/2625967169 shutdown_connections 2024-03-19T06:22:06.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f328da00640 1 --2- 172.21.15.32:0/2625967169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32880700a0 0x7f3288070510 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f328da00640 1 --2- 172.21.15.32:0/2625967169 >> v2:172.21.15.171:3300/0 conn(0x7f3288099a70 0x7f3288099e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f328da00640 1 -- 172.21.15.32:0/2625967169 >> 172.21.15.32:0/2625967169 conn(0x7f32880b3300 msgr2=0x7f32880b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:06.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f328da00640 1 -- 172.21.15.32:0/2625967169 shutdown_connections 2024-03-19T06:22:06.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f328da00640 1 -- 172.21.15.32:0/2625967169 wait complete. 2024-03-19T06:22:06.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f328da00640 1 Processor -- start 2024-03-19T06:22:06.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f328da00640 1 -- start start 2024-03-19T06:22:06.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f328da00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f328806c060 0x7f32881520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:06.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f328da00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32880700a0 0x7f3288155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:06.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f328da00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3288099a70 0x7f32881f7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:06.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f328da00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328816ac00 con 0x7f32880700a0 2024-03-19T06:22:06.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f328da00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328809a760 con 0x7f3288099a70 2024-03-19T06:22:06.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f328da00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328816ad80 con 0x7f328806c060 2024-03-19T06:22:06.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f327e000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32880700a0 0x7f3288155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:06.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f327e000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32880700a0 0x7f3288155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49238/0 (socket says 172.21.15.32:49238) 2024-03-19T06:22:06.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f327e000640 1 -- 172.21.15.32:0/1013063464 learned_addr learned my addr 172.21.15.32:0/1013063464 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:06.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f3286a00640 1 --2- 172.21.15.32:0/1013063464 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f328806c060 0x7f32881520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:06.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f3287400640 1 --2- 172.21.15.32:0/1013063464 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3288099a70 0x7f32881f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:06.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f327e000640 1 -- 172.21.15.32:0/1013063464 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f328806c060 msgr2=0x7f32881520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:06.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f327e000640 1 --2- 172.21.15.32:0/1013063464 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f328806c060 0x7f32881520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f327e000640 1 -- 172.21.15.32:0/1013063464 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3288099a70 msgr2=0x7f32881f7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:06.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f327e000640 1 --2- 172.21.15.32:0/1013063464 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3288099a70 0x7f32881f7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f327e000640 1 -- 172.21.15.32:0/1013063464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32880b58e0 con 0x7f32880700a0 2024-03-19T06:22:06.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.708+0000 7f327e000640 1 --2- 172.21.15.32:0/1013063464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32880700a0 0x7f3288155c50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f327000c3a0 tx=0x7f327000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:06.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.712+0000 7f327f400640 1 -- 172.21.15.32:0/1013063464 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32700052d0 con 0x7f32880700a0 2024-03-19T06:22:06.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.712+0000 7f327f400640 1 -- 172.21.15.32:0/1013063464 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270005470 con 0x7f32880700a0 2024-03-19T06:22:06.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.712+0000 7f327f400640 1 -- 172.21.15.32:0/1013063464 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270007260 con 0x7f32880700a0 2024-03-19T06:22:06.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.712+0000 7f328da00640 1 -- 172.21.15.32:0/1013063464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32881f7f90 con 0x7f32880700a0 2024-03-19T06:22:06.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.712+0000 7f328da00640 1 -- 172.21.15.32:0/1013063464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32880b5b80 con 0x7f32880700a0 2024-03-19T06:22:06.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.712+0000 7f328da00640 1 -- 172.21.15.32:0/1013063464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32880749e0 con 0x7f32880700a0 2024-03-19T06:22:06.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.712+0000 7f327f400640 1 -- 172.21.15.32:0/1013063464 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3270007400 con 0x7f32880700a0 2024-03-19T06:22:06.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.712+0000 7f327f400640 1 --2- 172.21.15.32:0/1013063464 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3264067660 0x7f3264069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:06.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.712+0000 7f327f400640 1 -- 172.21.15.32:0/1013063464 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3270084950 con 0x7f32880700a0 2024-03-19T06:22:06.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.716+0000 7f3286a00640 1 --2- 172.21.15.32:0/1013063464 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3264067660 0x7f3264069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:06.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.716+0000 7f3286a00640 1 --2- 172.21.15.32:0/1013063464 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3264067660 0x7f3264069b20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3278009630 tx=0x7f3278009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:06.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.716+0000 7f327f400640 1 -- 172.21.15.32:0/1013063464 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f328806fbe0 con 0x7f32880700a0 2024-03-19T06:22:06.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.940+0000 7f328da00640 1 -- 172.21.15.32:0/1013063464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f32880b2c90 con 0x7f32880700a0 2024-03-19T06:22:06.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.944+0000 7f327f400640 1 -- 172.21.15.32:0/1013063464 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f32700552c0 con 0x7f32880700a0 2024-03-19T06:22:06.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.944+0000 7f328da00640 1 -- 172.21.15.32:0/1013063464 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3264067660 msgr2=0x7f3264069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:06.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.944+0000 7f328da00640 1 --2- 172.21.15.32:0/1013063464 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3264067660 0x7f3264069b20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3278009630 tx=0x7f3278009240 comp rx=0 tx=0).stop 2024-03-19T06:22:06.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.944+0000 7f328da00640 1 -- 172.21.15.32:0/1013063464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32880700a0 msgr2=0x7f3288155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:06.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.944+0000 7f328da00640 1 --2- 172.21.15.32:0/1013063464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32880700a0 0x7f3288155c50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f327000c3a0 tx=0x7f327000c860 comp rx=0 tx=0).stop 2024-03-19T06:22:06.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.944+0000 7f328da00640 1 -- 172.21.15.32:0/1013063464 shutdown_connections 2024-03-19T06:22:06.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.944+0000 7f328da00640 1 --2- 172.21.15.32:0/1013063464 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3264067660 0x7f3264069b20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.944+0000 7f328da00640 1 --2- 172.21.15.32:0/1013063464 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3288099a70 0x7f32881f7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.944+0000 7f328da00640 1 --2- 172.21.15.32:0/1013063464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32880700a0 0x7f3288155c50 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.944+0000 7f328da00640 1 --2- 172.21.15.32:0/1013063464 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f328806c060 0x7f32881520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:06.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.944+0000 7f328da00640 1 -- 172.21.15.32:0/1013063464 >> 172.21.15.32:0/1013063464 conn(0x7f32880b3300 msgr2=0x7f32880b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:06.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.944+0000 7f328da00640 1 -- 172.21.15.32:0/1013063464 shutdown_connections 2024-03-19T06:22:06.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:06.944+0000 7f328da00640 1 -- 172.21.15.32:0/1013063464 wait complete. 2024-03-19T06:22:06.956 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-19T06:22:07.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.104+0000 7f6094200640 1 Processor -- start 2024-03-19T06:22:07.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.104+0000 7f6094200640 1 -- start start 2024-03-19T06:22:07.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.108+0000 7f6094200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f608c15a7c0 0x7f608c0cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.108+0000 7f6094200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f608c0b4c50 0x7f608c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.108+0000 7f6094200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608c0cb670 con 0x7f608c0cc680 2024-03-19T06:22:07.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.108+0000 7f6094200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608c15f400 con 0x7f608c0b4c50 2024-03-19T06:22:07.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.108+0000 7f6094200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608c15e860 con 0x7f608c15a7c0 2024-03-19T06:22:07.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.108+0000 7f6092200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f608c0b4c50 0x7f608c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.108+0000 7f6092200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f608c0b4c50 0x7f608c0b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49244/0 (socket says 172.21.15.32:49244) 2024-03-19T06:22:07.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.108+0000 7f6092200640 1 -- 172.21.15.32:0/217135877 learned_addr learned my addr 172.21.15.32:0/217135877 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:07.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.108+0000 7f6091800640 1 --2- 172.21.15.32:0/217135877 >> v2:172.21.15.171:3300/0 conn(0x7f608c15a7c0 0x7f608c0cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.108+0000 7f6092200640 1 -- 172.21.15.32:0/217135877 >> v2:172.21.15.171:3300/0 conn(0x7f608c15a7c0 msgr2=0x7f608c0cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:07.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.108+0000 7f6092200640 1 --2- 172.21.15.32:0/217135877 >> v2:172.21.15.171:3300/0 conn(0x7f608c15a7c0 0x7f608c0cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.108+0000 7f6092200640 1 -- 172.21.15.32:0/217135877 >> v1:172.21.15.171:6789/0 conn(0x7f608c0cc680 legacy=0x7f608c15ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:07.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.108+0000 7f6092200640 1 -- 172.21.15.32:0/217135877 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0cb950 con 0x7f608c0b4c50 2024-03-19T06:22:07.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.112+0000 7f6092200640 1 --2- 172.21.15.32:0/217135877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f608c0b4c50 0x7f608c0b5080 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f608c0d06b0 tx=0x7f608401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd6cce900f64bd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:07.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.112+0000 7f608be00640 1 -- 172.21.15.32:0/217135877 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60840a5720 con 0x7f608c0b4c50 2024-03-19T06:22:07.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.112+0000 7f608be00640 1 -- 172.21.15.32:0/217135877 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60840a58c0 con 0x7f608c0b4c50 2024-03-19T06:22:07.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.112+0000 7f608be00640 1 -- 172.21.15.32:0/217135877 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60840a5c90 con 0x7f608c0b4c50 2024-03-19T06:22:07.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.112+0000 7f6094200640 1 -- 172.21.15.32:0/217135877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f608c0b4c50 msgr2=0x7f608c0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:07.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.112+0000 7f6094200640 1 --2- 172.21.15.32:0/217135877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f608c0b4c50 0x7f608c0b5080 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f608c0d06b0 tx=0x7f608401c9b0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.112+0000 7f6094200640 1 -- 172.21.15.32:0/217135877 shutdown_connections 2024-03-19T06:22:07.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.112+0000 7f6094200640 1 --2- 172.21.15.32:0/217135877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f608c0b4c50 0x7f608c0b5080 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.112+0000 7f6094200640 1 --2- 172.21.15.32:0/217135877 >> v2:172.21.15.171:3300/0 conn(0x7f608c15a7c0 0x7f608c0cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.112+0000 7f6094200640 1 -- 172.21.15.32:0/217135877 >> 172.21.15.32:0/217135877 conn(0x7f608c0b1280 msgr2=0x7f608c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:07.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.112+0000 7f6094200640 1 -- 172.21.15.32:0/217135877 shutdown_connections 2024-03-19T06:22:07.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.112+0000 7f6094200640 1 -- 172.21.15.32:0/217135877 wait complete. 2024-03-19T06:22:07.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.112+0000 7f6094200640 1 Processor -- start 2024-03-19T06:22:07.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.112+0000 7f6094200640 1 -- start start 2024-03-19T06:22:07.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6094200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f608c0b4c50 0x7f608c1542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6094200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f608c0cc680 0x7f608c14aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6094200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f608c15a7c0 0x7f608c157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6094200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c0cbdb0 con 0x7f608c0b4c50 2024-03-19T06:22:07.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6094200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c0cbc30 con 0x7f608c15a7c0 2024-03-19T06:22:07.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6094200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c071350 con 0x7f608c0cc680 2024-03-19T06:22:07.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6091800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f608c0b4c50 0x7f608c1542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6091800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f608c0b4c50 0x7f608c1542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49256/0 (socket says 172.21.15.32:49256) 2024-03-19T06:22:07.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6091800640 1 -- 172.21.15.32:0/1647236300 learned_addr learned my addr 172.21.15.32:0/1647236300 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:07.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6092200640 1 --2- 172.21.15.32:0/1647236300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f608c15a7c0 0x7f608c157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6090e00640 1 --2- 172.21.15.32:0/1647236300 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f608c0cc680 0x7f608c14aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6091800640 1 -- 172.21.15.32:0/1647236300 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f608c0cc680 msgr2=0x7f608c14aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:07.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6091800640 1 --2- 172.21.15.32:0/1647236300 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f608c0cc680 0x7f608c14aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6091800640 1 -- 172.21.15.32:0/1647236300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f608c15a7c0 msgr2=0x7f608c157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:07.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6091800640 1 --2- 172.21.15.32:0/1647236300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f608c15a7c0 0x7f608c157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6091800640 1 -- 172.21.15.32:0/1647236300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c14af40 con 0x7f608c0b4c50 2024-03-19T06:22:07.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6091800640 1 --2- 172.21.15.32:0/1647236300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f608c0b4c50 0x7f608c1542e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f608000d620 tx=0x7f608000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:07.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6089600640 1 -- 172.21.15.32:0/1647236300 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608000b620 con 0x7f608c0b4c50 2024-03-19T06:22:07.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6089600640 1 -- 172.21.15.32:0/1647236300 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6080019070 con 0x7f608c0b4c50 2024-03-19T06:22:07.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6094200640 1 -- 172.21.15.32:0/1647236300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608c15d4a0 con 0x7f608c0b4c50 2024-03-19T06:22:07.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6089600640 1 -- 172.21.15.32:0/1647236300 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608000b9e0 con 0x7f608c0b4c50 2024-03-19T06:22:07.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6094200640 1 -- 172.21.15.32:0/1647236300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608c15da60 con 0x7f608c0b4c50 2024-03-19T06:22:07.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6094200640 1 -- 172.21.15.32:0/1647236300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608c0749e0 con 0x7f608c0b4c50 2024-03-19T06:22:07.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.116+0000 7f6089600640 1 -- 172.21.15.32:0/1647236300 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f608000bb80 con 0x7f608c0b4c50 2024-03-19T06:22:07.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.120+0000 7f6089600640 1 --2- 172.21.15.32:0/1647236300 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f606c067660 0x7f606c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.120+0000 7f6089600640 1 -- 172.21.15.32:0/1647236300 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f60800858c0 con 0x7f608c0b4c50 2024-03-19T06:22:07.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.120+0000 7f6090e00640 1 --2- 172.21.15.32:0/1647236300 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f606c067660 0x7f606c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.120+0000 7f6090e00640 1 --2- 172.21.15.32:0/1647236300 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f606c067660 0x7f606c069b20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f608c1541a0 tx=0x7f6078007e40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:07.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.124+0000 7f6089600640 1 -- 172.21.15.32:0/1647236300 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f608c14af40 con 0x7f608c0b4c50 2024-03-19T06:22:07.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.340+0000 7f6094200640 1 -- 172.21.15.32:0/1647236300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f608c0cc270 con 0x7f608c0b4c50 2024-03-19T06:22:07.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.344+0000 7f6089600640 1 -- 172.21.15.32:0/1647236300 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f60800561a0 con 0x7f608c0b4c50 2024-03-19T06:22:07.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.344+0000 7f6094200640 1 -- 172.21.15.32:0/1647236300 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f606c067660 msgr2=0x7f606c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:07.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.344+0000 7f6094200640 1 --2- 172.21.15.32:0/1647236300 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f606c067660 0x7f606c069b20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f608c1541a0 tx=0x7f6078007e40 comp rx=0 tx=0).stop 2024-03-19T06:22:07.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.344+0000 7f6094200640 1 -- 172.21.15.32:0/1647236300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f608c0b4c50 msgr2=0x7f608c1542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:07.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.344+0000 7f6094200640 1 --2- 172.21.15.32:0/1647236300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f608c0b4c50 0x7f608c1542e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f608000d620 tx=0x7f608000dae0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.344+0000 7f6094200640 1 -- 172.21.15.32:0/1647236300 shutdown_connections 2024-03-19T06:22:07.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.344+0000 7f6094200640 1 --2- 172.21.15.32:0/1647236300 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f606c067660 0x7f606c069b20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.344+0000 7f6094200640 1 --2- 172.21.15.32:0/1647236300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f608c15a7c0 0x7f608c157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.344+0000 7f6094200640 1 --2- 172.21.15.32:0/1647236300 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f608c0cc680 0x7f608c14aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.344+0000 7f6094200640 1 --2- 172.21.15.32:0/1647236300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f608c0b4c50 0x7f608c1542e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.344+0000 7f6094200640 1 -- 172.21.15.32:0/1647236300 >> 172.21.15.32:0/1647236300 conn(0x7f608c0b1280 msgr2=0x7f608c156010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:07.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.344+0000 7f6094200640 1 -- 172.21.15.32:0/1647236300 shutdown_connections 2024-03-19T06:22:07.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.344+0000 7f6094200640 1 -- 172.21.15.32:0/1647236300 wait complete. 2024-03-19T06:22:07.357 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-19T06:22:07.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f227d800640 1 Processor -- start 2024-03-19T06:22:07.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f227d800640 1 -- start start 2024-03-19T06:22:07.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f227d800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2278161270 0x7f22780ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f227d800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22780cfa70 0x7f22780cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f227d800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227806ad40 con 0x7f22780cb2d0 2024-03-19T06:22:07.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f227d800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227806b020 con 0x7f2278161270 2024-03-19T06:22:07.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f227d800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227806b300 con 0x7f22780cfa70 2024-03-19T06:22:07.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f2277400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f22780cb2d0 0x7f22780cb760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38356/0 (socket says 172.21.15.32:38356) 2024-03-19T06:22:07.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f2277400640 1 -- 172.21.15.32:0/379510765 learned_addr learned my addr 172.21.15.32:0/379510765 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:07.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f226e000640 1 --2- 172.21.15.32:0/379510765 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22780cfa70 0x7f22780cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f2276a00640 1 --2- 172.21.15.32:0/379510765 >> v2:172.21.15.171:3300/0 conn(0x7f2278161270 0x7f22780ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f2276000640 1 -- 172.21.15.32:0/379510765 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546190102 0 0) 0x7f227806ad40 con 0x7f22780cb2d0 2024-03-19T06:22:07.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f2276000640 1 -- 172.21.15.32:0/379510765 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f225c003530 con 0x7f22780cb2d0 2024-03-19T06:22:07.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f226e000640 1 -- 172.21.15.32:0/379510765 >> v2:172.21.15.171:3300/0 conn(0x7f2278161270 msgr2=0x7f22780ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:07.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f226e000640 1 --2- 172.21.15.32:0/379510765 >> v2:172.21.15.171:3300/0 conn(0x7f2278161270 0x7f22780ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f226e000640 1 -- 172.21.15.32:0/379510765 >> v1:172.21.15.32:6789/0 conn(0x7f22780cb2d0 legacy=0x7f22780cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:07.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.508+0000 7f226e000640 1 -- 172.21.15.32:0/379510765 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227806b5e0 con 0x7f22780cfa70 2024-03-19T06:22:07.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.512+0000 7f226e000640 1 --2- 172.21.15.32:0/379510765 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22780cfa70 0x7f22780cfeb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f22600097c0 tx=0x7f226001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0a8f0e6841f5f1f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:07.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.512+0000 7f2276000640 1 -- 172.21.15.32:0/379510765 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22600b0070 con 0x7f22780cfa70 2024-03-19T06:22:07.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.512+0000 7f2276000640 1 -- 172.21.15.32:0/379510765 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22600ab600 con 0x7f22780cfa70 2024-03-19T06:22:07.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.512+0000 7f2276000640 1 -- 172.21.15.32:0/379510765 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22600ab9d0 con 0x7f22780cfa70 2024-03-19T06:22:07.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.512+0000 7f227d800640 1 -- 172.21.15.32:0/379510765 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22780cfa70 msgr2=0x7f22780cfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:07.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.512+0000 7f227d800640 1 --2- 172.21.15.32:0/379510765 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22780cfa70 0x7f22780cfeb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f22600097c0 tx=0x7f226001c4a0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.512+0000 7f227d800640 1 -- 172.21.15.32:0/379510765 shutdown_connections 2024-03-19T06:22:07.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.512+0000 7f227d800640 1 --2- 172.21.15.32:0/379510765 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22780cfa70 0x7f22780cfeb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.512+0000 7f227d800640 1 --2- 172.21.15.32:0/379510765 >> v2:172.21.15.171:3300/0 conn(0x7f2278161270 0x7f22780ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.512+0000 7f227d800640 1 -- 172.21.15.32:0/379510765 >> 172.21.15.32:0/379510765 conn(0x7f22780b2250 msgr2=0x7f22780b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:07.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.512+0000 7f227d800640 1 -- 172.21.15.32:0/379510765 shutdown_connections 2024-03-19T06:22:07.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.512+0000 7f227d800640 1 -- 172.21.15.32:0/379510765 wait complete. 2024-03-19T06:22:07.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f227d800640 1 Processor -- start 2024-03-19T06:22:07.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f227d800640 1 -- start start 2024-03-19T06:22:07.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f227d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cb2d0 0x7f22780b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f227d800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22780cfa70 0x7f22780c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f227d800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2278161270 0x7f227815b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f227d800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227816a9f0 con 0x7f22780cb2d0 2024-03-19T06:22:07.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f227d800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227816a870 con 0x7f2278161270 2024-03-19T06:22:07.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f227d800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227816ab70 con 0x7f22780cfa70 2024-03-19T06:22:07.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f2276a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cb2d0 0x7f22780b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f2276a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cb2d0 0x7f22780b5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49264/0 (socket says 172.21.15.32:49264) 2024-03-19T06:22:07.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f2276a00640 1 -- 172.21.15.32:0/661973262 learned_addr learned my addr 172.21.15.32:0/661973262 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:07.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f2277400640 1 --2- 172.21.15.32:0/661973262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2278161270 0x7f227815b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f226e000640 1 --2- 172.21.15.32:0/661973262 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22780cfa70 0x7f22780c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f2276a00640 1 -- 172.21.15.32:0/661973262 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22780cfa70 msgr2=0x7f22780c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:07.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f2276a00640 1 --2- 172.21.15.32:0/661973262 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22780cfa70 0x7f22780c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f2276a00640 1 -- 172.21.15.32:0/661973262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2278161270 msgr2=0x7f227815b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:07.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f2276a00640 1 --2- 172.21.15.32:0/661973262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2278161270 0x7f227815b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f2276a00640 1 -- 172.21.15.32:0/661973262 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22780b4be0 con 0x7f22780cb2d0 2024-03-19T06:22:07.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f226e000640 1 --2- 172.21.15.32:0/661973262 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22780cfa70 0x7f22780c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:07.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f2276a00640 1 --2- 172.21.15.32:0/661973262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cb2d0 0x7f22780b5c80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f226800e960 tx=0x7f226800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:07.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f226f400640 1 -- 172.21.15.32:0/661973262 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268017070 con 0x7f22780cb2d0 2024-03-19T06:22:07.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f226f400640 1 -- 172.21.15.32:0/661973262 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226800c9a0 con 0x7f22780cb2d0 2024-03-19T06:22:07.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f226f400640 1 -- 172.21.15.32:0/661973262 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226800cd50 con 0x7f22780cb2d0 2024-03-19T06:22:07.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f227d800640 1 -- 172.21.15.32:0/661973262 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22780b4ec0 con 0x7f22780cb2d0 2024-03-19T06:22:07.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f227d800640 1 -- 172.21.15.32:0/661973262 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22780b5480 con 0x7f22780cb2d0 2024-03-19T06:22:07.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.516+0000 7f227d800640 1 -- 172.21.15.32:0/661973262 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22780749e0 con 0x7f22780cb2d0 2024-03-19T06:22:07.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.520+0000 7f226f400640 1 -- 172.21.15.32:0/661973262 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f226801a070 con 0x7f22780cb2d0 2024-03-19T06:22:07.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.520+0000 7f226f400640 1 --2- 172.21.15.32:0/661973262 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2254067660 0x7f2254069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.520+0000 7f226f400640 1 -- 172.21.15.32:0/661973262 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2268085910 con 0x7f22780cb2d0 2024-03-19T06:22:07.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.520+0000 7f226e000640 1 --2- 172.21.15.32:0/661973262 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2254067660 0x7f2254069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.520+0000 7f226e000640 1 --2- 172.21.15.32:0/661973262 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2254067660 0x7f2254069b20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f22600ad000 tx=0x7f2260008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:07.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.524+0000 7f226f400640 1 -- 172.21.15.32:0/661973262 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f22680568e0 con 0x7f22780cb2d0 2024-03-19T06:22:07.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.744+0000 7f227d800640 1 -- 172.21.15.32:0/661973262 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f22780cbaa0 con 0x7f22780cb2d0 2024-03-19T06:22:07.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.748+0000 7f226f400640 1 -- 172.21.15.32:0/661973262 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f22680561e0 con 0x7f22780cb2d0 2024-03-19T06:22:07.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.748+0000 7f227d800640 1 -- 172.21.15.32:0/661973262 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2254067660 msgr2=0x7f2254069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:07.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.748+0000 7f227d800640 1 --2- 172.21.15.32:0/661973262 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2254067660 0x7f2254069b20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f22600ad000 tx=0x7f2260008040 comp rx=0 tx=0).stop 2024-03-19T06:22:07.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.748+0000 7f227d800640 1 -- 172.21.15.32:0/661973262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cb2d0 msgr2=0x7f22780b5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:07.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.748+0000 7f227d800640 1 --2- 172.21.15.32:0/661973262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cb2d0 0x7f22780b5c80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f226800e960 tx=0x7f226800ee20 comp rx=0 tx=0).stop 2024-03-19T06:22:07.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.748+0000 7f227d800640 1 -- 172.21.15.32:0/661973262 shutdown_connections 2024-03-19T06:22:07.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.748+0000 7f227d800640 1 --2- 172.21.15.32:0/661973262 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2254067660 0x7f2254069b20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.748+0000 7f227d800640 1 --2- 172.21.15.32:0/661973262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2278161270 0x7f227815b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.748+0000 7f227d800640 1 --2- 172.21.15.32:0/661973262 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22780cfa70 0x7f22780c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.748+0000 7f227d800640 1 --2- 172.21.15.32:0/661973262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cb2d0 0x7f22780b5c80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.748+0000 7f227d800640 1 -- 172.21.15.32:0/661973262 >> 172.21.15.32:0/661973262 conn(0x7f22780b2250 msgr2=0x7f227806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:07.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.748+0000 7f227d800640 1 -- 172.21.15.32:0/661973262 shutdown_connections 2024-03-19T06:22:07.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.748+0000 7f227d800640 1 -- 172.21.15.32:0/661973262 wait complete. 2024-03-19T06:22:07.762 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-19T06:22:07.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5abb200640 1 Processor -- start 2024-03-19T06:22:07.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5abb200640 1 -- start start 2024-03-19T06:22:07.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5abb200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5ab415bb20 0x7f5ab409a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5abb200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ab40cf460 0x7f5ab40c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5abb200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5ab40c5920 0x7f5ab40cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5abb200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab40cc3a0 con 0x7f5ab40c5920 2024-03-19T06:22:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5abb200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab40cfbb0 con 0x7f5ab415bb20 2024-03-19T06:22:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5abb200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab415bf00 con 0x7f5ab40cf460 2024-03-19T06:22:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5ab9200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5ab40c5920 0x7f5ab40cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5ab9200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5ab40c5920 0x7f5ab40cd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49268/0 (socket says 172.21.15.32:49268) 2024-03-19T06:22:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5ab9200640 1 -- 172.21.15.32:0/1604085514 learned_addr learned my addr 172.21.15.32:0/1604085514 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5ab3e00640 1 --2- 172.21.15.32:0/1604085514 >> v2:172.21.15.171:3300/0 conn(0x7f5ab415bb20 0x7f5ab409a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5aabe00640 1 --2- 172.21.15.32:0/1604085514 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ab40cf460 0x7f5ab40c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5ab9200640 1 -- 172.21.15.32:0/1604085514 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ab40cf460 msgr2=0x7f5ab40c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5ab9200640 1 --2- 172.21.15.32:0/1604085514 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ab40cf460 0x7f5ab40c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5ab9200640 1 -- 172.21.15.32:0/1604085514 >> v2:172.21.15.171:3300/0 conn(0x7f5ab415bb20 msgr2=0x7f5ab409a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:07.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5ab9200640 1 --2- 172.21.15.32:0/1604085514 >> v2:172.21.15.171:3300/0 conn(0x7f5ab415bb20 0x7f5ab409a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5ab9200640 1 -- 172.21.15.32:0/1604085514 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab40cc5d0 con 0x7f5ab40c5920 2024-03-19T06:22:07.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.912+0000 7f5ab3e00640 1 --2- 172.21.15.32:0/1604085514 >> v2:172.21.15.171:3300/0 conn(0x7f5ab415bb20 0x7f5ab409a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:07.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.916+0000 7f5ab9200640 1 --2- 172.21.15.32:0/1604085514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ab40c5920 0x7f5ab40cd390 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4072aa0 tx=0x7f5aac01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f021d120b9c062 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:07.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.916+0000 7f5ab3400640 1 -- 172.21.15.32:0/1604085514 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac0a5750 con 0x7f5ab40c5920 2024-03-19T06:22:07.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.916+0000 7f5ab3400640 1 -- 172.21.15.32:0/1604085514 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aac0a58f0 con 0x7f5ab40c5920 2024-03-19T06:22:07.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.916+0000 7f5ab3400640 1 -- 172.21.15.32:0/1604085514 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac0a5cc0 con 0x7f5ab40c5920 2024-03-19T06:22:07.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.916+0000 7f5abb200640 1 -- 172.21.15.32:0/1604085514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ab40c5920 msgr2=0x7f5ab40cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:07.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.916+0000 7f5abb200640 1 --2- 172.21.15.32:0/1604085514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ab40c5920 0x7f5ab40cd390 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4072aa0 tx=0x7f5aac01c9c0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.916+0000 7f5abb200640 1 -- 172.21.15.32:0/1604085514 shutdown_connections 2024-03-19T06:22:07.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.916+0000 7f5abb200640 1 --2- 172.21.15.32:0/1604085514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ab40c5920 0x7f5ab40cd390 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.916+0000 7f5abb200640 1 --2- 172.21.15.32:0/1604085514 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ab40cf460 0x7f5ab40c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.916+0000 7f5abb200640 1 --2- 172.21.15.32:0/1604085514 >> v2:172.21.15.171:3300/0 conn(0x7f5ab415bb20 0x7f5ab409a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.916+0000 7f5abb200640 1 -- 172.21.15.32:0/1604085514 >> 172.21.15.32:0/1604085514 conn(0x7f5ab40d1890 msgr2=0x7f5ab40d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:07.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.916+0000 7f5abb200640 1 -- 172.21.15.32:0/1604085514 shutdown_connections 2024-03-19T06:22:07.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.916+0000 7f5abb200640 1 -- 172.21.15.32:0/1604085514 wait complete. 2024-03-19T06:22:07.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5abb200640 1 Processor -- start 2024-03-19T06:22:07.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5abb200640 1 -- start start 2024-03-19T06:22:07.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5abb200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ab40c5920 0x7f5ab406be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5abb200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ab40cf460 0x7f5ab4153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5abb200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ab415bb20 0x7f5ab4155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5abb200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab415f600 con 0x7f5ab40cf460 2024-03-19T06:22:07.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5abb200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab40cf840 con 0x7f5ab40c5920 2024-03-19T06:22:07.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5abb200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab415f780 con 0x7f5ab415bb20 2024-03-19T06:22:07.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5aabe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ab40cf460 0x7f5ab4153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5aabe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ab40cf460 0x7f5ab4153f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49274/0 (socket says 172.21.15.32:49274) 2024-03-19T06:22:07.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5aabe00640 1 -- 172.21.15.32:0/4167590184 learned_addr learned my addr 172.21.15.32:0/4167590184 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:07.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5ab3e00640 1 --2- 172.21.15.32:0/4167590184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ab40c5920 0x7f5ab406be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5ab9200640 1 --2- 172.21.15.32:0/4167590184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ab415bb20 0x7f5ab4155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5aabe00640 1 -- 172.21.15.32:0/4167590184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ab415bb20 msgr2=0x7f5ab4155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:07.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5aabe00640 1 --2- 172.21.15.32:0/4167590184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ab415bb20 0x7f5ab4155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5aabe00640 1 -- 172.21.15.32:0/4167590184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ab40c5920 msgr2=0x7f5ab406be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:07.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5aabe00640 1 --2- 172.21.15.32:0/4167590184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ab40c5920 0x7f5ab406be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:07.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5aabe00640 1 -- 172.21.15.32:0/4167590184 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab406c4a0 con 0x7f5ab40cf460 2024-03-19T06:22:07.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5ab9200640 1 --2- 172.21.15.32:0/4167590184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ab415bb20 0x7f5ab4155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:07.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5aabe00640 1 --2- 172.21.15.32:0/4167590184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ab40cf460 0x7f5ab4153f00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00e9b0 tx=0x7f5a9c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:07.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5ab0c00640 1 -- 172.21.15.32:0/4167590184 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c017070 con 0x7f5ab40cf460 2024-03-19T06:22:07.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5ab0c00640 1 -- 172.21.15.32:0/4167590184 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c00c9a0 con 0x7f5ab40cf460 2024-03-19T06:22:07.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5ab0c00640 1 -- 172.21.15.32:0/4167590184 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c00cd70 con 0x7f5ab40cf460 2024-03-19T06:22:07.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5abb200640 1 -- 172.21.15.32:0/4167590184 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab406ca60 con 0x7f5ab40cf460 2024-03-19T06:22:07.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.920+0000 7f5abb200640 1 -- 172.21.15.32:0/4167590184 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab406d020 con 0x7f5ab40cf460 2024-03-19T06:22:07.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.924+0000 7f5abb200640 1 -- 172.21.15.32:0/4167590184 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab40749e0 con 0x7f5ab40cf460 2024-03-19T06:22:07.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.924+0000 7f5ab0c00640 1 -- 172.21.15.32:0/4167590184 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5a9c01a070 con 0x7f5ab40cf460 2024-03-19T06:22:07.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.924+0000 7f5ab0c00640 1 --2- 172.21.15.32:0/4167590184 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5a90067660 0x7f5a90069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:07.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.924+0000 7f5ab0c00640 1 -- 172.21.15.32:0/4167590184 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5a9c085a30 con 0x7f5ab40cf460 2024-03-19T06:22:07.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.924+0000 7f5ab3e00640 1 --2- 172.21.15.32:0/4167590184 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5a90067660 0x7f5a90069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:07.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.924+0000 7f5ab3e00640 1 --2- 172.21.15.32:0/4167590184 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5a90067660 0x7f5a90069b20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4006e90 tx=0x7f5aa4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:07.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:07.928+0000 7f5ab0c00640 1 -- 172.21.15.32:0/4167590184 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f5a9c056280 con 0x7f5ab40cf460 2024-03-19T06:22:08.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.148+0000 7f5abb200640 1 -- 172.21.15.32:0/4167590184 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f5ab40b7810 con 0x7f5ab40cf460 2024-03-19T06:22:08.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.152+0000 7f5ab0c00640 1 -- 172.21.15.32:0/4167590184 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5a9c05a320 con 0x7f5ab40cf460 2024-03-19T06:22:08.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.152+0000 7f5abb200640 1 -- 172.21.15.32:0/4167590184 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5a90067660 msgr2=0x7f5a90069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:08.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.152+0000 7f5abb200640 1 --2- 172.21.15.32:0/4167590184 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5a90067660 0x7f5a90069b20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4006e90 tx=0x7f5aa4008040 comp rx=0 tx=0).stop 2024-03-19T06:22:08.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.152+0000 7f5abb200640 1 -- 172.21.15.32:0/4167590184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ab40cf460 msgr2=0x7f5ab4153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:08.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.152+0000 7f5abb200640 1 --2- 172.21.15.32:0/4167590184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ab40cf460 0x7f5ab4153f00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00e9b0 tx=0x7f5a9c00ee70 comp rx=0 tx=0).stop 2024-03-19T06:22:08.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.152+0000 7f5abb200640 1 -- 172.21.15.32:0/4167590184 shutdown_connections 2024-03-19T06:22:08.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.152+0000 7f5abb200640 1 --2- 172.21.15.32:0/4167590184 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5a90067660 0x7f5a90069b20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.152+0000 7f5abb200640 1 --2- 172.21.15.32:0/4167590184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ab415bb20 0x7f5ab4155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.152+0000 7f5abb200640 1 --2- 172.21.15.32:0/4167590184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ab40cf460 0x7f5ab4153f00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.152+0000 7f5abb200640 1 --2- 172.21.15.32:0/4167590184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ab40c5920 0x7f5ab406be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.152+0000 7f5abb200640 1 -- 172.21.15.32:0/4167590184 >> 172.21.15.32:0/4167590184 conn(0x7f5ab40d1890 msgr2=0x7f5ab406f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:08.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.152+0000 7f5abb200640 1 -- 172.21.15.32:0/4167590184 shutdown_connections 2024-03-19T06:22:08.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.152+0000 7f5abb200640 1 -- 172.21.15.32:0/4167590184 wait complete. 2024-03-19T06:22:08.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-19T06:22:08.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7d6200640 1 Processor -- start 2024-03-19T06:22:08.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7d6200640 1 -- start start 2024-03-19T06:22:08.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7d6200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7d00cc680 0x7fb7d015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:08.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7d6200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb7d00b4c50 0x7fb7d00b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:08.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7d6200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d00cb670 con 0x7fb7d015a7c0 2024-03-19T06:22:08.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7d6200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d015e860 con 0x7fb7d00b4c50 2024-03-19T06:22:08.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7d6200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d00cb950 con 0x7fb7d00cc680 2024-03-19T06:22:08.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7cfe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb7d00b4c50 0x7fb7d00b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:08.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7cfe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb7d00b4c50 0x7fb7d00b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49290/0 (socket says 172.21.15.32:49290) 2024-03-19T06:22:08.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7cf400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb7d015a7c0 0x7fb7d00cae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38364/0 (socket says 172.21.15.32:38364) 2024-03-19T06:22:08.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7cfe00640 1 -- 172.21.15.32:0/3506610927 learned_addr learned my addr 172.21.15.32:0/3506610927 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:08.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7cea00640 1 --2- 172.21.15.32:0/3506610927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7d00cc680 0x7fb7d015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:08.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7cfe00640 1 -- 172.21.15.32:0/3506610927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7d00cc680 msgr2=0x7fb7d015ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:08.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7cfe00640 1 --2- 172.21.15.32:0/3506610927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7d00cc680 0x7fb7d015ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7cfe00640 1 -- 172.21.15.32:0/3506610927 >> v1:172.21.15.32:6789/0 conn(0x7fb7d015a7c0 legacy=0x7fb7d00cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:08.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7cfe00640 1 -- 172.21.15.32:0/3506610927 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d015e4f0 con 0x7fb7d00b4c50 2024-03-19T06:22:08.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.316+0000 7fb7ce000640 1 -- 172.21.15.32:0/3506610927 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945900824 0 0) 0x7fb7d00cb670 con 0x7fb7d015a7c0 2024-03-19T06:22:08.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.320+0000 7fb7cfe00640 1 --2- 172.21.15.32:0/3506610927 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7d00b4c50 0x7fb7d00b50e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb7c800d150 tx=0x7fb7c801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fcb9d70226ddf5a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:08.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.320+0000 7fb7ce000640 1 -- 172.21.15.32:0/3506610927 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c800b2d0 con 0x7fb7d00b4c50 2024-03-19T06:22:08.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.320+0000 7fb7ce000640 1 -- 172.21.15.32:0/3506610927 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c800b470 con 0x7fb7d00b4c50 2024-03-19T06:22:08.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.320+0000 7fb7ce000640 1 -- 172.21.15.32:0/3506610927 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c80a7ba0 con 0x7fb7d00b4c50 2024-03-19T06:22:08.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.320+0000 7fb7d6200640 1 -- 172.21.15.32:0/3506610927 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7d00b4c50 msgr2=0x7fb7d00b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:08.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.320+0000 7fb7d6200640 1 --2- 172.21.15.32:0/3506610927 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7d00b4c50 0x7fb7d00b50e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb7c800d150 tx=0x7fb7c801eba0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.320+0000 7fb7d6200640 1 -- 172.21.15.32:0/3506610927 shutdown_connections 2024-03-19T06:22:08.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.320+0000 7fb7d6200640 1 --2- 172.21.15.32:0/3506610927 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7d00b4c50 0x7fb7d00b50e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.320+0000 7fb7d6200640 1 --2- 172.21.15.32:0/3506610927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7d00cc680 0x7fb7d015ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.320+0000 7fb7d6200640 1 -- 172.21.15.32:0/3506610927 >> 172.21.15.32:0/3506610927 conn(0x7fb7d00b1280 msgr2=0x7fb7d00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:08.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.320+0000 7fb7d6200640 1 -- 172.21.15.32:0/3506610927 shutdown_connections 2024-03-19T06:22:08.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.320+0000 7fb7d6200640 1 -- 172.21.15.32:0/3506610927 wait complete. 2024-03-19T06:22:08.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7d6200640 1 Processor -- start 2024-03-19T06:22:08.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7d6200640 1 -- start start 2024-03-19T06:22:08.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7d6200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7d00b4c50 0x7fb7d01504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:08.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7d6200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7d00cc680 0x7fb7d00b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:08.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7d6200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7d015a7c0 0x7fb7d015d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:08.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7d6200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d0071350 con 0x7fb7d00b4c50 2024-03-19T06:22:08.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7d6200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d00cbe40 con 0x7fb7d015a7c0 2024-03-19T06:22:08.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7d6200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d00714d0 con 0x7fb7d00cc680 2024-03-19T06:22:08.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7cf400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7d00b4c50 0x7fb7d01504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:08.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7cf400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7d00b4c50 0x7fb7d01504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49300/0 (socket says 172.21.15.32:49300) 2024-03-19T06:22:08.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7cf400640 1 -- 172.21.15.32:0/2092463630 learned_addr learned my addr 172.21.15.32:0/2092463630 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:08.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7cf400640 1 -- 172.21.15.32:0/2092463630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7d00cc680 msgr2=0x7fb7d00b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:08.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7cf400640 1 --2- 172.21.15.32:0/2092463630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7d00cc680 0x7fb7d00b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7cf400640 1 -- 172.21.15.32:0/2092463630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7d015a7c0 msgr2=0x7fb7d015d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:08.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7cf400640 1 --2- 172.21.15.32:0/2092463630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7d015a7c0 0x7fb7d015d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7cf400640 1 -- 172.21.15.32:0/2092463630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d00b36f0 con 0x7fb7d00b4c50 2024-03-19T06:22:08.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7cf400640 1 --2- 172.21.15.32:0/2092463630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7d00b4c50 0x7fb7d01504f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000c480 tx=0x7fb7c000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:08.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7c7400640 1 -- 172.21.15.32:0/2092463630 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0018070 con 0x7fb7d00b4c50 2024-03-19T06:22:08.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7c7400640 1 -- 172.21.15.32:0/2092463630 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c0007500 con 0x7fb7d00b4c50 2024-03-19T06:22:08.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7c7400640 1 -- 172.21.15.32:0/2092463630 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0004a30 con 0x7fb7d00b4c50 2024-03-19T06:22:08.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7d6200640 1 -- 172.21.15.32:0/2092463630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d00b39d0 con 0x7fb7d00b4c50 2024-03-19T06:22:08.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7d6200640 1 -- 172.21.15.32:0/2092463630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d0154880 con 0x7fb7d00b4c50 2024-03-19T06:22:08.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.324+0000 7fb7d6200640 1 -- 172.21.15.32:0/2092463630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d00749e0 con 0x7fb7d00b4c50 2024-03-19T06:22:08.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.328+0000 7fb7c7400640 1 -- 172.21.15.32:0/2092463630 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb7c001b070 con 0x7fb7d00b4c50 2024-03-19T06:22:08.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.328+0000 7fb7c7400640 1 --2- 172.21.15.32:0/2092463630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb7b0067660 0x7fb7b0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:08.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.328+0000 7fb7c7400640 1 -- 172.21.15.32:0/2092463630 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb7c00848f0 con 0x7fb7d00b4c50 2024-03-19T06:22:08.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.328+0000 7fb7cea00640 1 --2- 172.21.15.32:0/2092463630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb7b0067660 0x7fb7b0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:08.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.328+0000 7fb7cea00640 1 --2- 172.21.15.32:0/2092463630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb7b0067660 0x7fb7b0069b20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc006aa0 tx=0x7fb7bc006a30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:08.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.332+0000 7fb7c7400640 1 -- 172.21.15.32:0/2092463630 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fb7c00558b0 con 0x7fb7d00b4c50 2024-03-19T06:22:08.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.548+0000 7fb7d6200640 1 -- 172.21.15.32:0/2092463630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fb7d00ce2d0 con 0x7fb7d00b4c50 2024-03-19T06:22:08.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.552+0000 7fb7c7400640 1 -- 172.21.15.32:0/2092463630 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb7c00551b0 con 0x7fb7d00b4c50 2024-03-19T06:22:08.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.556+0000 7fb7d6200640 1 -- 172.21.15.32:0/2092463630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb7b0067660 msgr2=0x7fb7b0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:08.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.556+0000 7fb7d6200640 1 --2- 172.21.15.32:0/2092463630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb7b0067660 0x7fb7b0069b20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc006aa0 tx=0x7fb7bc006a30 comp rx=0 tx=0).stop 2024-03-19T06:22:08.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.556+0000 7fb7d6200640 1 -- 172.21.15.32:0/2092463630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7d00b4c50 msgr2=0x7fb7d01504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:08.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.556+0000 7fb7d6200640 1 --2- 172.21.15.32:0/2092463630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7d00b4c50 0x7fb7d01504f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000c480 tx=0x7fb7c000c940 comp rx=0 tx=0).stop 2024-03-19T06:22:08.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.556+0000 7fb7d6200640 1 -- 172.21.15.32:0/2092463630 shutdown_connections 2024-03-19T06:22:08.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.556+0000 7fb7d6200640 1 --2- 172.21.15.32:0/2092463630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb7b0067660 0x7fb7b0069b20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.556+0000 7fb7d6200640 1 --2- 172.21.15.32:0/2092463630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7d015a7c0 0x7fb7d015d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.556+0000 7fb7d6200640 1 --2- 172.21.15.32:0/2092463630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7d00cc680 0x7fb7d00b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.556+0000 7fb7d6200640 1 --2- 172.21.15.32:0/2092463630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7d00b4c50 0x7fb7d01504f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.556+0000 7fb7d6200640 1 -- 172.21.15.32:0/2092463630 >> 172.21.15.32:0/2092463630 conn(0x7fb7d00b1280 msgr2=0x7fb7d0071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:08.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.556+0000 7fb7d6200640 1 -- 172.21.15.32:0/2092463630 shutdown_connections 2024-03-19T06:22:08.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.556+0000 7fb7d6200640 1 -- 172.21.15.32:0/2092463630 wait complete. 2024-03-19T06:22:08.565 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:22:08.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.716+0000 7f70c0400640 1 Processor -- start 2024-03-19T06:22:08.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.716+0000 7f70c0400640 1 -- start start 2024-03-19T06:22:08.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.716+0000 7f70c0400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f70b815bb20 0x7f70b809a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:08.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.716+0000 7f70c0400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f70b80cd390 0x7f70b80cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:08.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.716+0000 7f70c0400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b815bf00 con 0x7f70b80cf460 2024-03-19T06:22:08.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.716+0000 7f70c0400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b80cc3a0 con 0x7f70b815bb20 2024-03-19T06:22:08.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.716+0000 7f70c0400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80cfbb0 con 0x7f70b80cd390 2024-03-19T06:22:08.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.716+0000 7f70bda00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f70b815bb20 0x7f70b809a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:08.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.716+0000 7f70bda00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f70b815bb20 0x7f70b809a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49306/0 (socket says 172.21.15.32:49306) 2024-03-19T06:22:08.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.716+0000 7f70bda00640 1 -- 172.21.15.32:0/4122649535 learned_addr learned my addr 172.21.15.32:0/4122649535 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:08.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.716+0000 7f70be400640 1 --2- 172.21.15.32:0/4122649535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f70b80cd390 0x7f70b80cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:08.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.716+0000 7f70bda00640 1 -- 172.21.15.32:0/4122649535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f70b80cd390 msgr2=0x7f70b80cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:08.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.716+0000 7f70bda00640 1 --2- 172.21.15.32:0/4122649535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f70b80cd390 0x7f70b80cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.716+0000 7f70bda00640 1 -- 172.21.15.32:0/4122649535 >> v1:172.21.15.171:6789/0 conn(0x7f70b80cf460 legacy=0x7f70b80c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:08.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.716+0000 7f70bda00640 1 -- 172.21.15.32:0/4122649535 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b80cc5d0 con 0x7f70b815bb20 2024-03-19T06:22:08.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.716+0000 7f70be400640 1 --2- 172.21.15.32:0/4122649535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f70b80cd390 0x7f70b80cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:08.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.720+0000 7f70bda00640 1 --2- 172.21.15.32:0/4122649535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70b815bb20 0x7f70b809a480 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009870 tx=0x7f70ac01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a8561066b3aa23 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:08.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.720+0000 7f70b7e00640 1 -- 172.21.15.32:0/4122649535 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac0b1070 con 0x7f70b815bb20 2024-03-19T06:22:08.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.720+0000 7f70b7e00640 1 -- 172.21.15.32:0/4122649535 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac0ac630 con 0x7f70b815bb20 2024-03-19T06:22:08.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.720+0000 7f70b7e00640 1 -- 172.21.15.32:0/4122649535 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac0a8050 con 0x7f70b815bb20 2024-03-19T06:22:08.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.720+0000 7f70c0400640 1 -- 172.21.15.32:0/4122649535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70b815bb20 msgr2=0x7f70b809a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:08.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.720+0000 7f70c0400640 1 --2- 172.21.15.32:0/4122649535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70b815bb20 0x7f70b809a480 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009870 tx=0x7f70ac01c520 comp rx=0 tx=0).stop 2024-03-19T06:22:08.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.720+0000 7f70c0400640 1 -- 172.21.15.32:0/4122649535 shutdown_connections 2024-03-19T06:22:08.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.720+0000 7f70c0400640 1 --2- 172.21.15.32:0/4122649535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f70b80cd390 0x7f70b80cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.720+0000 7f70c0400640 1 --2- 172.21.15.32:0/4122649535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70b815bb20 0x7f70b809a480 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.720+0000 7f70c0400640 1 -- 172.21.15.32:0/4122649535 >> 172.21.15.32:0/4122649535 conn(0x7f70b80d1890 msgr2=0x7f70b80d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:08.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.720+0000 7f70c0400640 1 -- 172.21.15.32:0/4122649535 shutdown_connections 2024-03-19T06:22:08.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.720+0000 7f70c0400640 1 -- 172.21.15.32:0/4122649535 wait complete. 2024-03-19T06:22:08.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70c0400640 1 Processor -- start 2024-03-19T06:22:08.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70c0400640 1 -- start start 2024-03-19T06:22:08.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70c0400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f70b80cd390 0x7f70b809b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:08.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70c0400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f70b80cf460 0x7f70b815e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:08.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70c0400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70b815bb20 0x7f70b81453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:08.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70c0400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80c5af0 con 0x7f70b815bb20 2024-03-19T06:22:08.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70c0400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80cf8d0 con 0x7f70b80cd390 2024-03-19T06:22:08.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70c0400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8168940 con 0x7f70b80cf460 2024-03-19T06:22:08.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70be400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70b815bb20 0x7f70b81453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:08.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70be400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70b815bb20 0x7f70b81453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49320/0 (socket says 172.21.15.32:49320) 2024-03-19T06:22:08.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70be400640 1 -- 172.21.15.32:0/361760008 learned_addr learned my addr 172.21.15.32:0/361760008 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:08.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70bd000640 1 --2- 172.21.15.32:0/361760008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f70b80cf460 0x7f70b815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:08.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70bda00640 1 --2- 172.21.15.32:0/361760008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f70b80cd390 0x7f70b809b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:08.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70be400640 1 -- 172.21.15.32:0/361760008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f70b80cf460 msgr2=0x7f70b815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:08.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70be400640 1 --2- 172.21.15.32:0/361760008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f70b80cf460 0x7f70b815e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70be400640 1 -- 172.21.15.32:0/361760008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f70b80cd390 msgr2=0x7f70b809b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:08.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70be400640 1 --2- 172.21.15.32:0/361760008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f70b80cd390 0x7f70b809b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70be400640 1 -- 172.21.15.32:0/361760008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b809bc80 con 0x7f70b815bb20 2024-03-19T06:22:08.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70be400640 1 --2- 172.21.15.32:0/361760008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70b815bb20 0x7f70b81453f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f70b000cd50 tx=0x7f70b000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:08.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70b5600640 1 -- 172.21.15.32:0/361760008 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b000f680 con 0x7f70b815bb20 2024-03-19T06:22:08.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70b5600640 1 -- 172.21.15.32:0/361760008 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b000f840 con 0x7f70b815bb20 2024-03-19T06:22:08.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70b5600640 1 -- 172.21.15.32:0/361760008 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b000fc30 con 0x7f70b815bb20 2024-03-19T06:22:08.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70c0400640 1 -- 172.21.15.32:0/361760008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b809d420 con 0x7f70b815bb20 2024-03-19T06:22:08.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70c0400640 1 -- 172.21.15.32:0/361760008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b809d9e0 con 0x7f70b815bb20 2024-03-19T06:22:08.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.724+0000 7f70c0400640 1 -- 172.21.15.32:0/361760008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b80749e0 con 0x7f70b815bb20 2024-03-19T06:22:08.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.728+0000 7f70b5600640 1 -- 172.21.15.32:0/361760008 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f70b000e3e0 con 0x7f70b815bb20 2024-03-19T06:22:08.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.728+0000 7f70b5600640 1 --2- 172.21.15.32:0/361760008 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7098067660 0x7f7098069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:08.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.728+0000 7f70b5600640 1 -- 172.21.15.32:0/361760008 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f70b00860b0 con 0x7f70b815bb20 2024-03-19T06:22:08.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.728+0000 7f70bda00640 1 --2- 172.21.15.32:0/361760008 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7098067660 0x7f7098069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:08.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.728+0000 7f70bda00640 1 --2- 172.21.15.32:0/361760008 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7098067660 0x7f7098069b20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0ae000 tx=0x7f70ac008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:08.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.732+0000 7f70b5600640 1 -- 172.21.15.32:0/361760008 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f70b0014030 con 0x7f70b815bb20 2024-03-19T06:22:08.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.896+0000 7f70c0400640 1 -- 172.21.15.32:0/361760008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70b806fec0 con 0x7f70b815bb20 2024-03-19T06:22:08.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.896+0000 7f70b5600640 1 -- 172.21.15.32:0/361760008 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12903 (secure 0 0 0) 0x7f70b0056ac0 con 0x7f70b815bb20 2024-03-19T06:22:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:08.890 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":31,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:22:05.736452+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:22:08.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.900+0000 7f70c0400640 1 -- 172.21.15.32:0/361760008 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7098067660 msgr2=0x7f7098069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:08.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.900+0000 7f70c0400640 1 --2- 172.21.15.32:0/361760008 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7098067660 0x7f7098069b20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0ae000 tx=0x7f70ac008040 comp rx=0 tx=0).stop 2024-03-19T06:22:08.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.900+0000 7f70c0400640 1 -- 172.21.15.32:0/361760008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70b815bb20 msgr2=0x7f70b81453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:08.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.900+0000 7f70c0400640 1 --2- 172.21.15.32:0/361760008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70b815bb20 0x7f70b81453f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f70b000cd50 tx=0x7f70b000a650 comp rx=0 tx=0).stop 2024-03-19T06:22:08.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.900+0000 7f70c0400640 1 -- 172.21.15.32:0/361760008 shutdown_connections 2024-03-19T06:22:08.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.900+0000 7f70c0400640 1 --2- 172.21.15.32:0/361760008 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7098067660 0x7f7098069b20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.900+0000 7f70c0400640 1 --2- 172.21.15.32:0/361760008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70b815bb20 0x7f70b81453f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.900+0000 7f70c0400640 1 --2- 172.21.15.32:0/361760008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f70b80cf460 0x7f70b815e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.900+0000 7f70c0400640 1 --2- 172.21.15.32:0/361760008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f70b80cd390 0x7f70b809b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:08.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.900+0000 7f70c0400640 1 -- 172.21.15.32:0/361760008 >> 172.21.15.32:0/361760008 conn(0x7f70b80d1890 msgr2=0x7f70b80706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:08.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.900+0000 7f70c0400640 1 -- 172.21.15.32:0/361760008 shutdown_connections 2024-03-19T06:22:08.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:08.900+0000 7f70c0400640 1 -- 172.21.15.32:0/361760008 wait complete. 2024-03-19T06:22:08.912 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:22:08.912 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:22:09.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.064+0000 7f6feb000640 1 Processor -- start 2024-03-19T06:22:09.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.064+0000 7f6feb000640 1 -- start start 2024-03-19T06:22:09.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.064+0000 7f6feb000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6fe415dba0 0x7f6fe406ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.064+0000 7f6feb000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6fe406b280 0x7f6fe406fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.064+0000 7f6feb000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe40d16d0 con 0x7f6fe4070070 2024-03-19T06:22:09.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.064+0000 7f6feb000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe406b6e0 con 0x7f6fe415dba0 2024-03-19T06:22:09.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.064+0000 7f6feb000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40ccea0 con 0x7f6fe406b280 2024-03-19T06:22:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.064+0000 7f6fe3e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6fe415dba0 0x7f6fe406ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.064+0000 7f6fdb400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6fe406b280 0x7f6fe406fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.064+0000 7f6fdb400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6fe406b280 0x7f6fe406fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:35480/0 (socket says 172.21.15.32:35480) 2024-03-19T06:22:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.064+0000 7f6fdb400640 1 -- 172.21.15.32:0/3297898213 learned_addr learned my addr 172.21.15.32:0/3297898213 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.064+0000 7f6fe3e00640 1 --2- 172.21.15.32:0/3297898213 >> v2:172.21.15.171:3300/0 conn(0x7f6fe415dba0 0x7f6fe406ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:38890/0 (socket says 172.21.15.32:38890) 2024-03-19T06:22:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.064+0000 7f6fdb400640 1 -- 172.21.15.32:0/3297898213 >> v2:172.21.15.171:3300/0 conn(0x7f6fe415dba0 msgr2=0x7f6fe406ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.064+0000 7f6fdb400640 1 --2- 172.21.15.32:0/3297898213 >> v2:172.21.15.171:3300/0 conn(0x7f6fe415dba0 0x7f6fe406ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.064+0000 7f6fdb400640 1 -- 172.21.15.32:0/3297898213 >> v1:172.21.15.171:6789/0 conn(0x7f6fe4070070 legacy=0x7f6fe406e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.064+0000 7f6fdb400640 1 -- 172.21.15.32:0/3297898213 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe4070710 con 0x7f6fe406b280 2024-03-19T06:22:09.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.068+0000 7f6fdb400640 1 --2- 172.21.15.32:0/3297898213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6fe406b280 0x7f6fe406fb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009e50 tx=0x7f6fcc01c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cf84644abbb677 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:09.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.068+0000 7f6fe3400640 1 -- 172.21.15.32:0/3297898213 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0a5580 con 0x7f6fe406b280 2024-03-19T06:22:09.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.068+0000 7f6fe3400640 1 -- 172.21.15.32:0/3297898213 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc0a5720 con 0x7f6fe406b280 2024-03-19T06:22:09.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.068+0000 7f6fe3400640 1 -- 172.21.15.32:0/3297898213 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0a5af0 con 0x7f6fe406b280 2024-03-19T06:22:09.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.068+0000 7f6feb000640 1 -- 172.21.15.32:0/3297898213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6fe406b280 msgr2=0x7f6fe406fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.068+0000 7f6feb000640 1 --2- 172.21.15.32:0/3297898213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6fe406b280 0x7f6fe406fb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009e50 tx=0x7f6fcc01c9a0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.068+0000 7f6feb000640 1 -- 172.21.15.32:0/3297898213 shutdown_connections 2024-03-19T06:22:09.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.068+0000 7f6feb000640 1 --2- 172.21.15.32:0/3297898213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6fe406b280 0x7f6fe406fb30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.068+0000 7f6feb000640 1 --2- 172.21.15.32:0/3297898213 >> v2:172.21.15.171:3300/0 conn(0x7f6fe415dba0 0x7f6fe406ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.068+0000 7f6feb000640 1 -- 172.21.15.32:0/3297898213 >> 172.21.15.32:0/3297898213 conn(0x7f6fe4099a70 msgr2=0x7f6fe4099e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:09.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.068+0000 7f6feb000640 1 -- 172.21.15.32:0/3297898213 shutdown_connections 2024-03-19T06:22:09.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.068+0000 7f6feb000640 1 -- 172.21.15.32:0/3297898213 wait complete. 2024-03-19T06:22:09.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6feb000640 1 Processor -- start 2024-03-19T06:22:09.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6feb000640 1 -- start start 2024-03-19T06:22:09.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6feb000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6fe406b280 0x7f6fe406e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6feb000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6fe4070070 0x7f6fe415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6feb000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6fe415dba0 0x7f6fe409afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6feb000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe415df80 con 0x7f6fe406b280 2024-03-19T06:22:09.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6feb000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40ce0d0 con 0x7f6fe4070070 2024-03-19T06:22:09.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6feb000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe415e100 con 0x7f6fe415dba0 2024-03-19T06:22:09.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6fe3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6fe406b280 0x7f6fe406e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6fe3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6fe406b280 0x7f6fe406e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49336/0 (socket says 172.21.15.32:49336) 2024-03-19T06:22:09.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6fe3e00640 1 -- 172.21.15.32:0/3172196178 learned_addr learned my addr 172.21.15.32:0/3172196178 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:09.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6fdb400640 1 --2- 172.21.15.32:0/3172196178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6fe4070070 0x7f6fe415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6fe9000640 1 --2- 172.21.15.32:0/3172196178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6fe415dba0 0x7f6fe409afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6fe3e00640 1 -- 172.21.15.32:0/3172196178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6fe415dba0 msgr2=0x7f6fe409afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6fe3e00640 1 --2- 172.21.15.32:0/3172196178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6fe415dba0 0x7f6fe409afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6fe3e00640 1 -- 172.21.15.32:0/3172196178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6fe4070070 msgr2=0x7f6fe415c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6fe3e00640 1 --2- 172.21.15.32:0/3172196178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6fe4070070 0x7f6fe415c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6fe3e00640 1 -- 172.21.15.32:0/3172196178 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe409e420 con 0x7f6fe406b280 2024-03-19T06:22:09.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6fe3e00640 1 --2- 172.21.15.32:0/3172196178 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6fe406b280 0x7f6fe406e740 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400e960 tx=0x7f6fd400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:09.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6fe0c00640 1 -- 172.21.15.32:0/3172196178 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4017070 con 0x7f6fe406b280 2024-03-19T06:22:09.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6fe0c00640 1 -- 172.21.15.32:0/3172196178 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd400ca00 con 0x7f6fe406b280 2024-03-19T06:22:09.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6fe0c00640 1 -- 172.21.15.32:0/3172196178 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd400cdb0 con 0x7f6fe406b280 2024-03-19T06:22:09.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6feb000640 1 -- 172.21.15.32:0/3172196178 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe409e700 con 0x7f6fe406b280 2024-03-19T06:22:09.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.072+0000 7f6feb000640 1 -- 172.21.15.32:0/3172196178 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe409aaa0 con 0x7f6fe406b280 2024-03-19T06:22:09.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.076+0000 7f6feb000640 1 -- 172.21.15.32:0/3172196178 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe40749e0 con 0x7f6fe406b280 2024-03-19T06:22:09.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.076+0000 7f6fe0c00640 1 -- 172.21.15.32:0/3172196178 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6fd401a070 con 0x7f6fe406b280 2024-03-19T06:22:09.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.076+0000 7f6fe0c00640 1 --2- 172.21.15.32:0/3172196178 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6fc0067660 0x7f6fc0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.076+0000 7f6fe0c00640 1 -- 172.21.15.32:0/3172196178 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6fd4085980 con 0x7f6fe406b280 2024-03-19T06:22:09.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.076+0000 7f6fdb400640 1 --2- 172.21.15.32:0/3172196178 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6fc0067660 0x7f6fc0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.076+0000 7f6fdb400640 1 --2- 172.21.15.32:0/3172196178 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6fc0067660 0x7f6fc0069b20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0ae000 tx=0x7f6fcc0a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:09.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.080+0000 7f6fe0c00640 1 -- 172.21.15.32:0/3172196178 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f6fd4056940 con 0x7f6fe406b280 2024-03-19T06:22:09.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.244+0000 7f6feb000640 1 -- 172.21.15.32:0/3172196178 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6fe40d0130 con 0x7f6fe406b280 2024-03-19T06:22:09.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.244+0000 7f6fe0c00640 1 -- 172.21.15.32:0/3172196178 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fd4056240 con 0x7f6fe406b280 2024-03-19T06:22:09.236 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:22:09.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.244+0000 7f6feb000640 1 -- 172.21.15.32:0/3172196178 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6fc0067660 msgr2=0x7f6fc0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.244+0000 7f6feb000640 1 --2- 172.21.15.32:0/3172196178 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6fc0067660 0x7f6fc0069b20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0ae000 tx=0x7f6fcc0a7070 comp rx=0 tx=0).stop 2024-03-19T06:22:09.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.244+0000 7f6feb000640 1 -- 172.21.15.32:0/3172196178 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6fe406b280 msgr2=0x7f6fe406e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.244+0000 7f6feb000640 1 --2- 172.21.15.32:0/3172196178 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6fe406b280 0x7f6fe406e740 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400e960 tx=0x7f6fd400ee20 comp rx=0 tx=0).stop 2024-03-19T06:22:09.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.244+0000 7f6feb000640 1 -- 172.21.15.32:0/3172196178 shutdown_connections 2024-03-19T06:22:09.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.244+0000 7f6feb000640 1 --2- 172.21.15.32:0/3172196178 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6fc0067660 0x7f6fc0069b20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.244+0000 7f6feb000640 1 --2- 172.21.15.32:0/3172196178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6fe415dba0 0x7f6fe409afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.244+0000 7f6feb000640 1 --2- 172.21.15.32:0/3172196178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6fe4070070 0x7f6fe415c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.244+0000 7f6feb000640 1 --2- 172.21.15.32:0/3172196178 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6fe406b280 0x7f6fe406e740 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.244+0000 7f6feb000640 1 -- 172.21.15.32:0/3172196178 >> 172.21.15.32:0/3172196178 conn(0x7f6fe4099a70 msgr2=0x7f6fe415f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:09.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.244+0000 7f6feb000640 1 -- 172.21.15.32:0/3172196178 shutdown_connections 2024-03-19T06:22:09.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.244+0000 7f6feb000640 1 -- 172.21.15.32:0/3172196178 wait complete. 2024-03-19T06:22:09.257 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-19T06:22:09.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.404+0000 7f99da800640 1 Processor -- start 2024-03-19T06:22:09.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.404+0000 7f99da800640 1 -- start start 2024-03-19T06:22:09.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.408+0000 7f99da800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f99d415a2b0 0x7f99d40cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.408+0000 7f99da800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f99d40cdb40 0x7f99d4071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.408+0000 7f99da800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d40ce3e0 con 0x7f99d4159ed0 2024-03-19T06:22:09.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.408+0000 7f99da800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d40ca1d0 con 0x7f99d40cdb40 2024-03-19T06:22:09.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.408+0000 7f99da800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d40ca4b0 con 0x7f99d415a2b0 2024-03-19T06:22:09.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.408+0000 7f99d3400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f99d4159ed0 0x7f99d40caf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38368/0 (socket says 172.21.15.32:38368) 2024-03-19T06:22:09.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.408+0000 7f99d3400640 1 -- 172.21.15.32:0/2972045117 learned_addr learned my addr 172.21.15.32:0/2972045117 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:09.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.408+0000 7f99d3e00640 1 --2- 172.21.15.32:0/2972045117 >> v2:172.21.15.32:3300/0 conn(0x7f99d40cdb40 0x7f99d4071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.408+0000 7f99cbe00640 1 --2- 172.21.15.32:0/2972045117 >> v2:172.21.15.171:3300/0 conn(0x7f99d415a2b0 0x7f99d40cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.408+0000 7f99d2a00640 1 -- 172.21.15.32:0/2972045117 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194232362 0 0) 0x7f99d40ce3e0 con 0x7f99d4159ed0 2024-03-19T06:22:09.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.408+0000 7f99d2a00640 1 -- 172.21.15.32:0/2972045117 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99b8003530 con 0x7f99d4159ed0 2024-03-19T06:22:09.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.408+0000 7f99d3e00640 1 -- 172.21.15.32:0/2972045117 >> v2:172.21.15.171:3300/0 conn(0x7f99d415a2b0 msgr2=0x7f99d40cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:09.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.408+0000 7f99d3e00640 1 --2- 172.21.15.32:0/2972045117 >> v2:172.21.15.171:3300/0 conn(0x7f99d415a2b0 0x7f99d40cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.408+0000 7f99d3e00640 1 -- 172.21.15.32:0/2972045117 >> v1:172.21.15.32:6789/0 conn(0x7f99d4159ed0 legacy=0x7f99d40caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.408+0000 7f99d3e00640 1 -- 172.21.15.32:0/2972045117 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d40ca790 con 0x7f99d40cdb40 2024-03-19T06:22:09.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.408+0000 7f99cbe00640 1 --2- 172.21.15.32:0/2972045117 >> v2:172.21.15.171:3300/0 conn(0x7f99d415a2b0 0x7f99d40cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:09.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99d3e00640 1 --2- 172.21.15.32:0/2972045117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99d40cdb40 0x7f99d4071350 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f99d40cbfe0 tx=0x7f99cc01d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e22b9b2db4fee1 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:09.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99d2a00640 1 -- 172.21.15.32:0/2972045117 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0a6700 con 0x7f99d40cdb40 2024-03-19T06:22:09.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99d2a00640 1 -- 172.21.15.32:0/2972045117 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc0a68a0 con 0x7f99d40cdb40 2024-03-19T06:22:09.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99d2a00640 1 -- 172.21.15.32:0/2972045117 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0a6c70 con 0x7f99d40cdb40 2024-03-19T06:22:09.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99da800640 1 -- 172.21.15.32:0/2972045117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99d40cdb40 msgr2=0x7f99d4071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99da800640 1 --2- 172.21.15.32:0/2972045117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99d40cdb40 0x7f99d4071350 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f99d40cbfe0 tx=0x7f99cc01d990 comp rx=0 tx=0).stop 2024-03-19T06:22:09.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99da800640 1 -- 172.21.15.32:0/2972045117 shutdown_connections 2024-03-19T06:22:09.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99da800640 1 --2- 172.21.15.32:0/2972045117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99d40cdb40 0x7f99d4071350 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99da800640 1 --2- 172.21.15.32:0/2972045117 >> v2:172.21.15.171:3300/0 conn(0x7f99d415a2b0 0x7f99d40cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99da800640 1 -- 172.21.15.32:0/2972045117 >> 172.21.15.32:0/2972045117 conn(0x7f99d40b1280 msgr2=0x7f99d40b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:09.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99da800640 1 -- 172.21.15.32:0/2972045117 shutdown_connections 2024-03-19T06:22:09.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99da800640 1 -- 172.21.15.32:0/2972045117 wait complete. 2024-03-19T06:22:09.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99da800640 1 Processor -- start 2024-03-19T06:22:09.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99da800640 1 -- start start 2024-03-19T06:22:09.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99da800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99d40cdb40 0x7f99d41421d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99da800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99d4159ed0 0x7f99d4143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99da800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99d415a2b0 0x7f99d4141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99da800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d406e1c0 con 0x7f99d415a2b0 2024-03-19T06:22:09.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99da800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d406e040 con 0x7f99d4159ed0 2024-03-19T06:22:09.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99da800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d406e340 con 0x7f99d40cdb40 2024-03-19T06:22:09.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99d3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99d415a2b0 0x7f99d4141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99d3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99d415a2b0 0x7f99d4141710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49342/0 (socket says 172.21.15.32:49342) 2024-03-19T06:22:09.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.412+0000 7f99d3e00640 1 -- 172.21.15.32:0/2499923614 learned_addr learned my addr 172.21.15.32:0/2499923614 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:09.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99cbe00640 1 --2- 172.21.15.32:0/2499923614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99d4159ed0 0x7f99d4143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99d3400640 1 --2- 172.21.15.32:0/2499923614 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99d40cdb40 0x7f99d41421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99d3e00640 1 -- 172.21.15.32:0/2499923614 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99d40cdb40 msgr2=0x7f99d41421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99d3e00640 1 --2- 172.21.15.32:0/2499923614 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99d40cdb40 0x7f99d41421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99d3e00640 1 -- 172.21.15.32:0/2499923614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99d4159ed0 msgr2=0x7f99d4143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99d3e00640 1 --2- 172.21.15.32:0/2499923614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99d4159ed0 0x7f99d4143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99d3e00640 1 -- 172.21.15.32:0/2499923614 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d4142710 con 0x7f99d415a2b0 2024-03-19T06:22:09.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99d3e00640 1 --2- 172.21.15.32:0/2499923614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99d415a2b0 0x7f99d4141710 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0b0040 tx=0x7f99cc01a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:09.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99cb400640 1 -- 172.21.15.32:0/2499923614 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00a560 con 0x7f99d415a2b0 2024-03-19T06:22:09.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99cb400640 1 -- 172.21.15.32:0/2499923614 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc0bd070 con 0x7f99d415a2b0 2024-03-19T06:22:09.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99cb400640 1 -- 172.21.15.32:0/2499923614 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0b78e0 con 0x7f99d415a2b0 2024-03-19T06:22:09.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99da800640 1 -- 172.21.15.32:0/2499923614 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d4143fc0 con 0x7f99d415a2b0 2024-03-19T06:22:09.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99da800640 1 -- 172.21.15.32:0/2499923614 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d4142cc0 con 0x7f99d415a2b0 2024-03-19T06:22:09.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99da800640 1 -- 172.21.15.32:0/2499923614 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d40749e0 con 0x7f99d415a2b0 2024-03-19T06:22:09.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99cb400640 1 -- 172.21.15.32:0/2499923614 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f99cc0b7a80 con 0x7f99d415a2b0 2024-03-19T06:22:09.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99cb400640 1 --2- 172.21.15.32:0/2499923614 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f99b0067660 0x7f99b0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.416+0000 7f99cb400640 1 -- 172.21.15.32:0/2499923614 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f99cc1204b0 con 0x7f99d415a2b0 2024-03-19T06:22:09.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.420+0000 7f99d3400640 1 --2- 172.21.15.32:0/2499923614 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f99b0067660 0x7f99b0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.420+0000 7f99d3400640 1 --2- 172.21.15.32:0/2499923614 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f99b0067660 0x7f99b0069b20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f99c4001210 tx=0x7f99c4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:09.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.424+0000 7f99cb400640 1 -- 172.21.15.32:0/2499923614 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f99cc017640 con 0x7f99d415a2b0 2024-03-19T06:22:09.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.588+0000 7f99da800640 1 -- 172.21.15.32:0/2499923614 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f99d40ae980 con 0x7f99d415a2b0 2024-03-19T06:22:09.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.588+0000 7f99cb400640 1 -- 172.21.15.32:0/2499923614 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7f99cc0f13e0 con 0x7f99d415a2b0 2024-03-19T06:22:09.579 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:09.579 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2024-03-19T06:22:09.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:22:09.579 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2024-03-19T06:22:09.579 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2024-03-19T06:22:09.579 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:09.579 INFO:teuthology.orchestra.run.smithi032.stdout:] 2024-03-19T06:22:09.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.588+0000 7f99da800640 1 -- 172.21.15.32:0/2499923614 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f99b0067660 msgr2=0x7f99b0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.588+0000 7f99da800640 1 --2- 172.21.15.32:0/2499923614 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f99b0067660 0x7f99b0069b20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f99c4001210 tx=0x7f99c4009040 comp rx=0 tx=0).stop 2024-03-19T06:22:09.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.588+0000 7f99da800640 1 -- 172.21.15.32:0/2499923614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99d415a2b0 msgr2=0x7f99d4141710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.588+0000 7f99da800640 1 --2- 172.21.15.32:0/2499923614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99d415a2b0 0x7f99d4141710 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0b0040 tx=0x7f99cc01a730 comp rx=0 tx=0).stop 2024-03-19T06:22:09.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.588+0000 7f99da800640 1 -- 172.21.15.32:0/2499923614 shutdown_connections 2024-03-19T06:22:09.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.588+0000 7f99da800640 1 --2- 172.21.15.32:0/2499923614 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f99b0067660 0x7f99b0069b20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.588+0000 7f99da800640 1 --2- 172.21.15.32:0/2499923614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99d415a2b0 0x7f99d4141710 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.588+0000 7f99da800640 1 --2- 172.21.15.32:0/2499923614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99d4159ed0 0x7f99d4143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.588+0000 7f99da800640 1 --2- 172.21.15.32:0/2499923614 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99d40cdb40 0x7f99d41421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.588+0000 7f99da800640 1 -- 172.21.15.32:0/2499923614 >> 172.21.15.32:0/2499923614 conn(0x7f99d40b1280 msgr2=0x7f99d4158ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:09.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.588+0000 7f99da800640 1 -- 172.21.15.32:0/2499923614 shutdown_connections 2024-03-19T06:22:09.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.588+0000 7f99da800640 1 -- 172.21.15.32:0/2499923614 wait complete. 2024-03-19T06:22:09.600 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-19T06:22:09.600 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-19T06:22:09.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.752+0000 7f6f3de00640 1 Processor -- start 2024-03-19T06:22:09.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.752+0000 7f6f3de00640 1 -- start start 2024-03-19T06:22:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.756+0000 7f6f3de00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f380b2de0 0x7f6f380cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.756+0000 7f6f3de00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f380cf780 con 0x7f6f3815ef10 2024-03-19T06:22:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.756+0000 7f6f3de00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f380cc9d0 con 0x7f6f380d00b0 2024-03-19T06:22:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.756+0000 7f6f3de00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380cdfb0 con 0x7f6f380b2de0 2024-03-19T06:22:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.756+0000 7f6f36a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6f3815ef10 0x7f6f380cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38374/0 (socket says 172.21.15.32:38374) 2024-03-19T06:22:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.756+0000 7f6f36a00640 1 -- 172.21.15.32:0/3519797088 learned_addr learned my addr 172.21.15.32:0/3519797088 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.756+0000 7f6f37400640 1 --2- 172.21.15.32:0/3519797088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f380b2de0 0x7f6f380cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.756+0000 7f6f36000640 1 -- 172.21.15.32:0/3519797088 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704738965 0 0) 0x7f6f380cf780 con 0x7f6f3815ef10 2024-03-19T06:22:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.756+0000 7f6f36000640 1 -- 172.21.15.32:0/3519797088 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f1c003530 con 0x7f6f3815ef10 2024-03-19T06:22:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.756+0000 7f6f36000640 1 -- 172.21.15.32:0/3519797088 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326873793 0 0) 0x7f6f380cc9d0 con 0x7f6f380d00b0 2024-03-19T06:22:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.756+0000 7f6f36000640 1 -- 172.21.15.32:0/3519797088 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f380cf780 con 0x7f6f380d00b0 2024-03-19T06:22:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.756+0000 7f6f37400640 1 -- 172.21.15.32:0/3519797088 >> v1:172.21.15.171:6789/0 conn(0x7f6f380d00b0 legacy=0x7f6f380ad5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.756+0000 7f6f37400640 1 -- 172.21.15.32:0/3519797088 >> v1:172.21.15.32:6789/0 conn(0x7f6f3815ef10 legacy=0x7f6f380cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.756+0000 7f6f37400640 1 -- 172.21.15.32:0/3519797088 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f380cccb0 con 0x7f6f380b2de0 2024-03-19T06:22:09.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.760+0000 7f6f37400640 1 --2- 172.21.15.32:0/3519797088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f380b2de0 0x7f6f380cda70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009dc0 tx=0x7f6f3001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=935fb30d124bcb78 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:09.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.760+0000 7f6f36000640 1 -- 172.21.15.32:0/3519797088 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f300b2070 con 0x7f6f380b2de0 2024-03-19T06:22:09.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.760+0000 7f6f36000640 1 -- 172.21.15.32:0/3519797088 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f300a5940 con 0x7f6f380b2de0 2024-03-19T06:22:09.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.760+0000 7f6f36000640 1 -- 172.21.15.32:0/3519797088 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f300a5d10 con 0x7f6f380b2de0 2024-03-19T06:22:09.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.760+0000 7f6f3de00640 1 -- 172.21.15.32:0/3519797088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f380b2de0 msgr2=0x7f6f380cda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.760+0000 7f6f3de00640 1 --2- 172.21.15.32:0/3519797088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f380b2de0 0x7f6f380cda70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009dc0 tx=0x7f6f3001c990 comp rx=0 tx=0).stop 2024-03-19T06:22:09.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.760+0000 7f6f3de00640 1 -- 172.21.15.32:0/3519797088 shutdown_connections 2024-03-19T06:22:09.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.760+0000 7f6f3de00640 1 --2- 172.21.15.32:0/3519797088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f380b2de0 0x7f6f380cda70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.760+0000 7f6f3de00640 1 -- 172.21.15.32:0/3519797088 >> 172.21.15.32:0/3519797088 conn(0x7f6f380b22c0 msgr2=0x7f6f380b26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:09.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.760+0000 7f6f3de00640 1 -- 172.21.15.32:0/3519797088 shutdown_connections 2024-03-19T06:22:09.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.760+0000 7f6f3de00640 1 -- 172.21.15.32:0/3519797088 wait complete. 2024-03-19T06:22:09.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.760+0000 7f6f3de00640 1 Processor -- start 2024-03-19T06:22:09.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.760+0000 7f6f3de00640 1 -- start start 2024-03-19T06:22:09.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.760+0000 7f6f3de00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f380b2de0 0x7f6f380b3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.760+0000 7f6f3de00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f380d00b0 0x7f6f380c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f3de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3815ef10 0x7f6f3813f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f3de00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380ae0c0 con 0x7f6f3815ef10 2024-03-19T06:22:09.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f3de00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380cc670 con 0x7f6f380b2de0 2024-03-19T06:22:09.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f3de00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f38169d60 con 0x7f6f380d00b0 2024-03-19T06:22:09.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f37400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3815ef10 0x7f6f3813f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f37400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3815ef10 0x7f6f3813f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49352/0 (socket says 172.21.15.32:49352) 2024-03-19T06:22:09.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f37400640 1 -- 172.21.15.32:0/966673597 learned_addr learned my addr 172.21.15.32:0/966673597 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:09.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f36a00640 1 --2- 172.21.15.32:0/966673597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f380b2de0 0x7f6f380b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f2fe00640 1 --2- 172.21.15.32:0/966673597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f380d00b0 0x7f6f380c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f37400640 1 -- 172.21.15.32:0/966673597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f380d00b0 msgr2=0x7f6f380c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f37400640 1 --2- 172.21.15.32:0/966673597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f380d00b0 0x7f6f380c3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f37400640 1 -- 172.21.15.32:0/966673597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f380b2de0 msgr2=0x7f6f380b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:09.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f37400640 1 --2- 172.21.15.32:0/966673597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f380b2de0 0x7f6f380b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:09.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f37400640 1 -- 172.21.15.32:0/966673597 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3806efa0 con 0x7f6f3815ef10 2024-03-19T06:22:09.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f37400640 1 --2- 172.21.15.32:0/966673597 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3815ef10 0x7f6f3813f670 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6f3001a5c0 tx=0x7f6f30019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:09.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f2f400640 1 -- 172.21.15.32:0/966673597 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f300b2050 con 0x7f6f3815ef10 2024-03-19T06:22:09.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f2f400640 1 -- 172.21.15.32:0/966673597 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f300be070 con 0x7f6f3815ef10 2024-03-19T06:22:09.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f2f400640 1 -- 172.21.15.32:0/966673597 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f300ad890 con 0x7f6f3815ef10 2024-03-19T06:22:09.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f3de00640 1 -- 172.21.15.32:0/966673597 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f380b39d0 con 0x7f6f3815ef10 2024-03-19T06:22:09.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f3de00640 1 -- 172.21.15.32:0/966673597 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3806f520 con 0x7f6f3815ef10 2024-03-19T06:22:09.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f3de00640 1 -- 172.21.15.32:0/966673597 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f380749e0 con 0x7f6f3815ef10 2024-03-19T06:22:09.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.764+0000 7f6f2f400640 1 -- 172.21.15.32:0/966673597 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6f300ada30 con 0x7f6f3815ef10 2024-03-19T06:22:09.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.768+0000 7f6f2f400640 1 --2- 172.21.15.32:0/966673597 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6f14067690 0x7f6f14069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:09.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.768+0000 7f6f2f400640 1 -- 172.21.15.32:0/966673597 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6f3011fef0 con 0x7f6f3815ef10 2024-03-19T06:22:09.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.768+0000 7f6f36a00640 1 --2- 172.21.15.32:0/966673597 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6f14067690 0x7f6f14069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:09.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.768+0000 7f6f36a00640 1 --2- 172.21.15.32:0/966673597 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6f14067690 0x7f6f14069b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6f28007fd0 tx=0x7f6f28009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:09.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.772+0000 7f6f2f400640 1 -- 172.21.15.32:0/966673597 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f6f300c7020 con 0x7f6f3815ef10 2024-03-19T06:22:09.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:09.932+0000 7f6f3de00640 1 -- 172.21.15.32:0/966673597 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6f380ae3e0 con 0x7f6f3815ef10 2024-03-19T06:22:10.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.756+0000 7f6f2f400640 1 -- 172.21.15.32:0/966673597 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6f30016580 con 0x7f6f3815ef10 2024-03-19T06:22:10.749 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' created 2024-03-19T06:22:10.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.760+0000 7f6f3de00640 1 -- 172.21.15.32:0/966673597 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6f14067690 msgr2=0x7f6f14069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:10.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.760+0000 7f6f3de00640 1 --2- 172.21.15.32:0/966673597 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6f14067690 0x7f6f14069b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6f28007fd0 tx=0x7f6f28009040 comp rx=0 tx=0).stop 2024-03-19T06:22:10.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.760+0000 7f6f3de00640 1 -- 172.21.15.32:0/966673597 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3815ef10 msgr2=0x7f6f3813f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:10.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.760+0000 7f6f3de00640 1 --2- 172.21.15.32:0/966673597 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3815ef10 0x7f6f3813f670 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6f3001a5c0 tx=0x7f6f30019730 comp rx=0 tx=0).stop 2024-03-19T06:22:10.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.760+0000 7f6f3de00640 1 -- 172.21.15.32:0/966673597 shutdown_connections 2024-03-19T06:22:10.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.760+0000 7f6f3de00640 1 --2- 172.21.15.32:0/966673597 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6f14067690 0x7f6f14069b50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:10.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.760+0000 7f6f3de00640 1 --2- 172.21.15.32:0/966673597 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3815ef10 0x7f6f3813f670 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:10.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.760+0000 7f6f3de00640 1 --2- 172.21.15.32:0/966673597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f380d00b0 0x7f6f380c3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:10.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.760+0000 7f6f3de00640 1 --2- 172.21.15.32:0/966673597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f380b2de0 0x7f6f380b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:10.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.760+0000 7f6f3de00640 1 -- 172.21.15.32:0/966673597 >> 172.21.15.32:0/966673597 conn(0x7f6f380b22c0 msgr2=0x7f6f380ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:10.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.760+0000 7f6f3de00640 1 -- 172.21.15.32:0/966673597 shutdown_connections 2024-03-19T06:22:10.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.760+0000 7f6f3de00640 1 -- 172.21.15.32:0/966673597 wait complete. 2024-03-19T06:22:10.782 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-19T06:22:10.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.940+0000 7f1dd1600640 1 Processor -- start 2024-03-19T06:22:10.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.940+0000 7f1dd1600640 1 -- start start 2024-03-19T06:22:10.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dd1600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1dcc15a840 0x7f1dcc06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:10.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dd1600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1dcc06b450 0x7f1dcc0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:10.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dd1600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc0af2d0 con 0x7f1dcc0aea70 2024-03-19T06:22:10.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dd1600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc0cdc20 con 0x7f1dcc15a840 2024-03-19T06:22:10.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dd1600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc15eea0 con 0x7f1dcc06b450 2024-03-19T06:22:10.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dc3e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1dcc0aea70 0x7f1dcc06ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38386/0 (socket says 172.21.15.32:38386) 2024-03-19T06:22:10.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dc3e00640 1 -- 172.21.15.32:0/579878061 learned_addr learned my addr 172.21.15.32:0/579878061 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:10.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dcaa00640 1 --2- 172.21.15.32:0/579878061 >> v2:172.21.15.171:3300/0 conn(0x7f1dcc15a840 0x7f1dcc06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:10.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dcb400640 1 --2- 172.21.15.32:0/579878061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1dcc06b450 0x7f1dcc0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:10.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dca000640 1 -- 172.21.15.32:0/579878061 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809435596 0 0) 0x7f1dcc0af2d0 con 0x7f1dcc0aea70 2024-03-19T06:22:10.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dca000640 1 -- 172.21.15.32:0/579878061 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db0003530 con 0x7f1dcc0aea70 2024-03-19T06:22:10.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dca000640 1 -- 172.21.15.32:0/579878061 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3491242745 0 0) 0x7f1db0003530 con 0x7f1dcc0aea70 2024-03-19T06:22:10.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dca000640 1 -- 172.21.15.32:0/579878061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1dcc06b450 msgr2=0x7f1dcc0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:10.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dca000640 1 --2- 172.21.15.32:0/579878061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1dcc06b450 0x7f1dcc0ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:10.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dca000640 1 -- 172.21.15.32:0/579878061 >> v2:172.21.15.171:3300/0 conn(0x7f1dcc15a840 msgr2=0x7f1dcc06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:10.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dca000640 1 --2- 172.21.15.32:0/579878061 >> v2:172.21.15.171:3300/0 conn(0x7f1dcc15a840 0x7f1dcc06f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:10.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dca000640 1 -- 172.21.15.32:0/579878061 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc15f180 con 0x7f1dcc0aea70 2024-03-19T06:22:10.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dca000640 1 -- 172.21.15.32:0/579878061 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f1db4001680 con 0x7f1dcc0aea70 2024-03-19T06:22:10.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dcb400640 1 --2- 172.21.15.32:0/579878061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1dcc06b450 0x7f1dcc0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:22:10.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dcaa00640 1 --2- 172.21.15.32:0/579878061 >> v2:172.21.15.171:3300/0 conn(0x7f1dcc15a840 0x7f1dcc06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:22:10.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dca000640 1 -- 172.21.15.32:0/579878061 >> v1:172.21.15.32:6789/0 conn(0x7f1dcc0aea70 legacy=0x7f1dcc06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:10.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dca000640 1 --2- 172.21.15.32:0/579878061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1dcc06b450 0x7f1db00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:10.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dca000640 1 --2- 172.21.15.32:0/579878061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db0003f00 0x7f1db0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:10.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dca000640 1 --2- 172.21.15.32:0/579878061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1db0004d50 0x7f1db00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:10.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dca000640 1 -- 172.21.15.32:0/579878061 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0cdc20 con 0x7f1db0003f00 2024-03-19T06:22:10.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dca000640 1 -- 172.21.15.32:0/579878061 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc15eea0 con 0x7f1db0004d50 2024-03-19T06:22:10.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dca000640 1 -- 172.21.15.32:0/579878061 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db000ba80 con 0x7f1dcc06b450 2024-03-19T06:22:10.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dc3e00640 1 --2- 172.21.15.32:0/579878061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db0003f00 0x7f1db0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:10.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dcaa00640 1 --2- 172.21.15.32:0/579878061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1dcc06b450 0x7f1db00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:10.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dcb400640 1 --2- 172.21.15.32:0/579878061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1db0004d50 0x7f1db00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:10.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dc3e00640 1 -- 172.21.15.32:0/579878061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1dcc06b450 msgr2=0x7f1db00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:10.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dc3e00640 1 --2- 172.21.15.32:0/579878061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1dcc06b450 0x7f1db00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:10.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dc3e00640 1 -- 172.21.15.32:0/579878061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1db0004d50 msgr2=0x7f1db00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:10.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dc3e00640 1 --2- 172.21.15.32:0/579878061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1db0004d50 0x7f1db00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:10.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dc3e00640 1 -- 172.21.15.32:0/579878061 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db0003530 con 0x7f1db0003f00 2024-03-19T06:22:10.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.944+0000 7f1dcb400640 1 --2- 172.21.15.32:0/579878061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1db0004d50 0x7f1db00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:10.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.948+0000 7f1dc3e00640 1 --2- 172.21.15.32:0/579878061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db0003f00 0x7f1db0004810 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1db400c290 tx=0x7f1db401cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c98f22c885b0cc server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:10.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.948+0000 7f1dca000640 1 -- 172.21.15.32:0/579878061 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db4007d60 con 0x7f1db0003f00 2024-03-19T06:22:10.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.948+0000 7f1dca000640 1 -- 172.21.15.32:0/579878061 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db40a9020 con 0x7f1db0003f00 2024-03-19T06:22:10.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.948+0000 7f1dca000640 1 -- 172.21.15.32:0/579878061 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db40a5b90 con 0x7f1db0003f00 2024-03-19T06:22:10.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.948+0000 7f1dd1600640 1 -- 172.21.15.32:0/579878061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db0003f00 msgr2=0x7f1db0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:10.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.948+0000 7f1dd1600640 1 --2- 172.21.15.32:0/579878061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db0003f00 0x7f1db0004810 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1db400c290 tx=0x7f1db401cce0 comp rx=0 tx=0).stop 2024-03-19T06:22:10.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.948+0000 7f1dcb400640 1 -- 172.21.15.32:0/579878061 reap_dead start 2024-03-19T06:22:10.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.948+0000 7f1dd1600640 1 -- 172.21.15.32:0/579878061 shutdown_connections 2024-03-19T06:22:10.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.948+0000 7f1dd1600640 1 -- 172.21.15.32:0/579878061 >> 172.21.15.32:0/579878061 conn(0x7f1dcc0b1590 msgr2=0x7f1dcc0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:10.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.948+0000 7f1dd1600640 1 -- 172.21.15.32:0/579878061 shutdown_connections 2024-03-19T06:22:10.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.948+0000 7f1dd1600640 1 -- 172.21.15.32:0/579878061 wait complete. 2024-03-19T06:22:10.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.948+0000 7f1dd1600640 1 Processor -- start 2024-03-19T06:22:10.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.948+0000 7f1dd1600640 1 -- start start 2024-03-19T06:22:10.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dd1600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db0003f00 0x7f1dcc143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:10.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dd1600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1dcc160090 0x7f1dcc146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:10.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dd1600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1dcc0b3530 0x7f1dcc0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:10.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dd1600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0cea20 con 0x7f1db0003f00 2024-03-19T06:22:10.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dd1600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0ce8a0 con 0x7f1dcc0b3530 2024-03-19T06:22:10.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dd1600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0ceba0 con 0x7f1dcc160090 2024-03-19T06:22:10.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dcaa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db0003f00 0x7f1dcc143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:10.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dcaa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db0003f00 0x7f1dcc143790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49372/0 (socket says 172.21.15.32:49372) 2024-03-19T06:22:10.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dcaa00640 1 -- 172.21.15.32:0/2872709327 learned_addr learned my addr 172.21.15.32:0/2872709327 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:10.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dcb400640 1 --2- 172.21.15.32:0/2872709327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1dcc0b3530 0x7f1dcc0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:10.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dc3e00640 1 --2- 172.21.15.32:0/2872709327 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1dcc160090 0x7f1dcc146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:10.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dcaa00640 1 -- 172.21.15.32:0/2872709327 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1dcc160090 msgr2=0x7f1dcc146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:10.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dcaa00640 1 --2- 172.21.15.32:0/2872709327 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1dcc160090 0x7f1dcc146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:10.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dcaa00640 1 -- 172.21.15.32:0/2872709327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1dcc0b3530 msgr2=0x7f1dcc0b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:10.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dcaa00640 1 --2- 172.21.15.32:0/2872709327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1dcc0b3530 0x7f1dcc0b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:10.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dcaa00640 1 -- 172.21.15.32:0/2872709327 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc143cd0 con 0x7f1db0003f00 2024-03-19T06:22:10.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dcaa00640 1 --2- 172.21.15.32:0/2872709327 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db0003f00 0x7f1dcc143790 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc011cd0 tx=0x7f1dbc00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:10.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dc2a00640 1 -- 172.21.15.32:0/2872709327 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc011e80 con 0x7f1db0003f00 2024-03-19T06:22:10.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dc2a00640 1 -- 172.21.15.32:0/2872709327 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc004020 con 0x7f1db0003f00 2024-03-19T06:22:10.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dc2a00640 1 -- 172.21.15.32:0/2872709327 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0043d0 con 0x7f1db0003f00 2024-03-19T06:22:10.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dd1600640 1 -- 172.21.15.32:0/2872709327 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc146f80 con 0x7f1db0003f00 2024-03-19T06:22:10.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dd1600640 1 -- 172.21.15.32:0/2872709327 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc146ca0 con 0x7f1db0003f00 2024-03-19T06:22:10.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.952+0000 7f1dd1600640 1 -- 172.21.15.32:0/2872709327 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc0b3ef0 con 0x7f1db0003f00 2024-03-19T06:22:10.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.956+0000 7f1dc2a00640 1 -- 172.21.15.32:0/2872709327 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1dbc012040 con 0x7f1db0003f00 2024-03-19T06:22:10.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.956+0000 7f1dc2a00640 1 --2- 172.21.15.32:0/2872709327 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1da80676b0 0x7f1da8069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:10.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.956+0000 7f1dc2a00640 1 -- 172.21.15.32:0/2872709327 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1dbc085ca0 con 0x7f1db0003f00 2024-03-19T06:22:10.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.956+0000 7f1dc3e00640 1 --2- 172.21.15.32:0/2872709327 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1da80676b0 0x7f1da8069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:10.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.956+0000 7f1dc3e00640 1 --2- 172.21.15.32:0/2872709327 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1da80676b0 0x7f1da8069b70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1db40aa000 tx=0x7f1db4001a50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:10.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:10.960+0000 7f1dc2a00640 1 -- 172.21.15.32:0/2872709327 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f1dbc019030 con 0x7f1db0003f00 2024-03-19T06:22:11.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.120+0000 7f1dd1600640 1 -- 172.21.15.32:0/2872709327 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1dcc0749e0 con 0x7f1db0003f00 2024-03-19T06:22:11.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.760+0000 7f1dc2a00640 1 -- 172.21.15.32:0/2872709327 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1dbc056520 con 0x7f1db0003f00 2024-03-19T06:22:11.753 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' created 2024-03-19T06:22:11.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.764+0000 7f1dd1600640 1 -- 172.21.15.32:0/2872709327 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1da80676b0 msgr2=0x7f1da8069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:11.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.764+0000 7f1dd1600640 1 --2- 172.21.15.32:0/2872709327 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1da80676b0 0x7f1da8069b70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1db40aa000 tx=0x7f1db4001a50 comp rx=0 tx=0).stop 2024-03-19T06:22:11.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.764+0000 7f1dd1600640 1 -- 172.21.15.32:0/2872709327 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db0003f00 msgr2=0x7f1dcc143790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:11.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.764+0000 7f1dd1600640 1 --2- 172.21.15.32:0/2872709327 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db0003f00 0x7f1dcc143790 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc011cd0 tx=0x7f1dbc00f610 comp rx=0 tx=0).stop 2024-03-19T06:22:11.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.764+0000 7f1dd1600640 1 -- 172.21.15.32:0/2872709327 shutdown_connections 2024-03-19T06:22:11.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.764+0000 7f1dd1600640 1 --2- 172.21.15.32:0/2872709327 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1da80676b0 0x7f1da8069b70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:11.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.764+0000 7f1dd1600640 1 --2- 172.21.15.32:0/2872709327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1dcc0b3530 0x7f1dcc0b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:11.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.764+0000 7f1dd1600640 1 --2- 172.21.15.32:0/2872709327 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1dcc160090 0x7f1dcc146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:11.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.764+0000 7f1dd1600640 1 --2- 172.21.15.32:0/2872709327 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db0003f00 0x7f1dcc143790 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:11.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.764+0000 7f1dd1600640 1 -- 172.21.15.32:0/2872709327 >> 172.21.15.32:0/2872709327 conn(0x7f1dcc0b1590 msgr2=0x7f1dcc154db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:11.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.764+0000 7f1dd1600640 1 -- 172.21.15.32:0/2872709327 shutdown_connections 2024-03-19T06:22:11.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.764+0000 7f1dd1600640 1 -- 172.21.15.32:0/2872709327 wait complete. 2024-03-19T06:22:11.793 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-19T06:22:11.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.944+0000 7f294e800640 1 Processor -- start 2024-03-19T06:22:11.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.944+0000 7f294e800640 1 -- start start 2024-03-19T06:22:11.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.948+0000 7f294e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f294815dbe0 0x7f29480cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:11.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.948+0000 7f294e800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f29480b2960 0x7f29480cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:11.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.948+0000 7f294e800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294815dfc0 con 0x7f294806c550 2024-03-19T06:22:11.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.948+0000 7f294e800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29480b1220 con 0x7f294815dbe0 2024-03-19T06:22:11.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.948+0000 7f294e800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29480ce760 con 0x7f29480b2960 2024-03-19T06:22:11.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.948+0000 7f294d400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f294815dbe0 0x7f29480cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:11.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.948+0000 7f294d400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f294815dbe0 0x7f29480cdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49386/0 (socket says 172.21.15.32:49386) 2024-03-19T06:22:11.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.948+0000 7f294d400640 1 -- 172.21.15.32:0/1892226022 learned_addr learned my addr 172.21.15.32:0/1892226022 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:11.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.948+0000 7f294d400640 1 -- 172.21.15.32:0/1892226022 >> v2:172.21.15.171:3300/0 conn(0x7f29480b2960 msgr2=0x7f29480cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:11.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.948+0000 7f294ca00640 1 --2- 172.21.15.32:0/1892226022 >> v2:172.21.15.171:3300/0 conn(0x7f29480b2960 0x7f29480cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:11.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.948+0000 7f294d400640 1 --2- 172.21.15.32:0/1892226022 >> v2:172.21.15.171:3300/0 conn(0x7f29480b2960 0x7f29480cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:11.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.948+0000 7f294d400640 1 -- 172.21.15.32:0/1892226022 >> v1:172.21.15.171:6789/0 conn(0x7f294806c550 legacy=0x7f2948161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:11.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.948+0000 7f294d400640 1 -- 172.21.15.32:0/1892226022 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29480cea40 con 0x7f294815dbe0 2024-03-19T06:22:11.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.948+0000 7f294ca00640 1 --2- 172.21.15.32:0/1892226022 >> v2:172.21.15.171:3300/0 conn(0x7f29480b2960 0x7f29480cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:11.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294d400640 1 --2- 172.21.15.32:0/1892226022 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294815dbe0 0x7f29480cdf10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f29480b7740 tx=0x7f293c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3b1d57a91b4485 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:11.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f2947e00640 1 -- 172.21.15.32:0/1892226022 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c0b0070 con 0x7f294815dbe0 2024-03-19T06:22:11.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f2947e00640 1 -- 172.21.15.32:0/1892226022 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c0ab600 con 0x7f294815dbe0 2024-03-19T06:22:11.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f2947e00640 1 -- 172.21.15.32:0/1892226022 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c0ab9d0 con 0x7f294815dbe0 2024-03-19T06:22:11.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294e800640 1 -- 172.21.15.32:0/1892226022 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294815dbe0 msgr2=0x7f29480cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:11.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294e800640 1 --2- 172.21.15.32:0/1892226022 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294815dbe0 0x7f29480cdf10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f29480b7740 tx=0x7f293c01c450 comp rx=0 tx=0).stop 2024-03-19T06:22:11.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294e800640 1 -- 172.21.15.32:0/1892226022 shutdown_connections 2024-03-19T06:22:11.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294e800640 1 --2- 172.21.15.32:0/1892226022 >> v2:172.21.15.171:3300/0 conn(0x7f29480b2960 0x7f29480cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:11.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294e800640 1 --2- 172.21.15.32:0/1892226022 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294815dbe0 0x7f29480cdf10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:11.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294e800640 1 -- 172.21.15.32:0/1892226022 >> 172.21.15.32:0/1892226022 conn(0x7f294808b000 msgr2=0x7f294808b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:11.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294e800640 1 -- 172.21.15.32:0/1892226022 shutdown_connections 2024-03-19T06:22:11.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294e800640 1 -- 172.21.15.32:0/1892226022 wait complete. 2024-03-19T06:22:11.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294e800640 1 Processor -- start 2024-03-19T06:22:11.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294e800640 1 -- start start 2024-03-19T06:22:11.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294e800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294806c550 0x7f294814c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:11.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294e800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29480b2960 0x7f29480ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:11.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294815dbe0 0x7f29480aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:11.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294e800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294816ac00 con 0x7f294815dbe0 2024-03-19T06:22:11.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294e800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294816aa80 con 0x7f29480b2960 2024-03-19T06:22:11.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294e800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294816ad80 con 0x7f294806c550 2024-03-19T06:22:11.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.952+0000 7f294de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294815dbe0 0x7f29480aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:11.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f294de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294815dbe0 0x7f29480aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49396/0 (socket says 172.21.15.32:49396) 2024-03-19T06:22:11.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f294de00640 1 -- 172.21.15.32:0/3666779985 learned_addr learned my addr 172.21.15.32:0/3666779985 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:11.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f294d400640 1 --2- 172.21.15.32:0/3666779985 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294806c550 0x7f294814c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:11.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f294ca00640 1 --2- 172.21.15.32:0/3666779985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29480b2960 0x7f29480ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:11.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f294de00640 1 -- 172.21.15.32:0/3666779985 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294806c550 msgr2=0x7f294814c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:11.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f294de00640 1 --2- 172.21.15.32:0/3666779985 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294806c550 0x7f294814c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:11.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f294de00640 1 -- 172.21.15.32:0/3666779985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29480b2960 msgr2=0x7f29480ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:11.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f294de00640 1 --2- 172.21.15.32:0/3666779985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29480b2960 0x7f29480ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:11.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f294de00640 1 -- 172.21.15.32:0/3666779985 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294815afc0 con 0x7f294815dbe0 2024-03-19T06:22:11.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f294de00640 1 --2- 172.21.15.32:0/3666779985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294815dbe0 0x7f29480aea20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f294000b970 tx=0x7f294000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:11.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f2945600640 1 -- 172.21.15.32:0/3666779985 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940019070 con 0x7f294815dbe0 2024-03-19T06:22:11.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f2945600640 1 -- 172.21.15.32:0/3666779985 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294000cb40 con 0x7f294815dbe0 2024-03-19T06:22:11.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f2945600640 1 -- 172.21.15.32:0/3666779985 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940014440 con 0x7f294815dbe0 2024-03-19T06:22:11.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f294e800640 1 -- 172.21.15.32:0/3666779985 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294815b2a0 con 0x7f294815dbe0 2024-03-19T06:22:11.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f294e800640 1 -- 172.21.15.32:0/3666779985 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294815b860 con 0x7f294815dbe0 2024-03-19T06:22:11.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f294e800640 1 -- 172.21.15.32:0/3666779985 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2948075090 con 0x7f294815dbe0 2024-03-19T06:22:11.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f2945600640 1 -- 172.21.15.32:0/3666779985 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f294001c070 con 0x7f294815dbe0 2024-03-19T06:22:11.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.956+0000 7f2945600640 1 --2- 172.21.15.32:0/3666779985 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2928067660 0x7f2928069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:11.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.960+0000 7f2945600640 1 -- 172.21.15.32:0/3666779985 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2940085400 con 0x7f294815dbe0 2024-03-19T06:22:11.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.960+0000 7f294d400640 1 --2- 172.21.15.32:0/3666779985 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2928067660 0x7f2928069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:11.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.960+0000 7f294d400640 1 --2- 172.21.15.32:0/3666779985 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2928067660 0x7f2928069b20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f293c0ad000 tx=0x7f293c0a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:11.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:11.964+0000 7f2945600640 1 -- 172.21.15.32:0/3666779985 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2940055a90 con 0x7f294815dbe0 2024-03-19T06:22:12.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.160+0000 7f294e800640 1 -- 172.21.15.32:0/3666779985 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f29481571e0 con 0x7f294815dbe0 2024-03-19T06:22:12.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.788+0000 7f2945600640 1 -- 172.21.15.32:0/3666779985 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2940059b30 con 0x7f294815dbe0 2024-03-19T06:22:12.779 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 4 and data pool 5 2024-03-19T06:22:12.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.796+0000 7f294e800640 1 -- 172.21.15.32:0/3666779985 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2928067660 msgr2=0x7f2928069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:12.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.796+0000 7f294e800640 1 --2- 172.21.15.32:0/3666779985 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2928067660 0x7f2928069b20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f293c0ad000 tx=0x7f293c0a6000 comp rx=0 tx=0).stop 2024-03-19T06:22:12.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.796+0000 7f294e800640 1 -- 172.21.15.32:0/3666779985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294815dbe0 msgr2=0x7f29480aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:12.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.796+0000 7f294e800640 1 --2- 172.21.15.32:0/3666779985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294815dbe0 0x7f29480aea20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f294000b970 tx=0x7f294000be30 comp rx=0 tx=0).stop 2024-03-19T06:22:12.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.800+0000 7f294e800640 1 -- 172.21.15.32:0/3666779985 shutdown_connections 2024-03-19T06:22:12.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.800+0000 7f294e800640 1 --2- 172.21.15.32:0/3666779985 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2928067660 0x7f2928069b20 secure :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f293c0ad000 tx=0x7f293c0a6000 comp rx=0 tx=0).stop 2024-03-19T06:22:12.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.800+0000 7f294e800640 1 --2- 172.21.15.32:0/3666779985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294815dbe0 0x7f29480aea20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:12.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.800+0000 7f294e800640 1 --2- 172.21.15.32:0/3666779985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29480b2960 0x7f29480ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:12.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.800+0000 7f294e800640 1 --2- 172.21.15.32:0/3666779985 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294806c550 0x7f294814c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:12.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.800+0000 7f294e800640 1 -- 172.21.15.32:0/3666779985 >> 172.21.15.32:0/3666779985 conn(0x7f294808b000 msgr2=0x7f29480cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:12.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.808+0000 7f294e800640 1 -- 172.21.15.32:0/3666779985 shutdown_connections 2024-03-19T06:22:12.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.812+0000 7f294e800640 1 -- 172.21.15.32:0/3666779985 wait complete. 2024-03-19T06:22:12.830 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:22:12.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.980+0000 7f7819600640 1 Processor -- start 2024-03-19T06:22:12.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.980+0000 7f7819600640 1 -- start start 2024-03-19T06:22:12.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.980+0000 7f7819600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78140b4c50 0x7f78140b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:12.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.980+0000 7f7819600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78140cb670 con 0x7f781415a7c0 2024-03-19T06:22:12.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.980+0000 7f7819600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78140cb950 con 0x7f78140cc680 2024-03-19T06:22:12.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.980+0000 7f7819600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78140b5600 con 0x7f78140b4c50 2024-03-19T06:22:12.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.980+0000 7f7812a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f781415a7c0 0x7f78140cae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38398/0 (socket says 172.21.15.32:38398) 2024-03-19T06:22:12.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.980+0000 7f7812a00640 1 -- 172.21.15.32:0/605802007 learned_addr learned my addr 172.21.15.32:0/605802007 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:12.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.980+0000 7f7813400640 1 --2- 172.21.15.32:0/605802007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78140b4c50 0x7f78140b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:12.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.980+0000 7f7812000640 1 -- 172.21.15.32:0/605802007 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61888189 0 0) 0x7f78140cb670 con 0x7f781415a7c0 2024-03-19T06:22:12.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.980+0000 7f7812000640 1 -- 172.21.15.32:0/605802007 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f8005740 con 0x7f781415a7c0 2024-03-19T06:22:12.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.980+0000 7f7812000640 1 -- 172.21.15.32:0/605802007 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 313643979 0 0) 0x7f77f8005740 con 0x7f781415a7c0 2024-03-19T06:22:12.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.980+0000 7f7812000640 1 -- 172.21.15.32:0/605802007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78140b4c50 msgr2=0x7f78140b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:12.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.980+0000 7f7812000640 1 --2- 172.21.15.32:0/605802007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78140b4c50 0x7f78140b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:12.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.980+0000 7f7812000640 1 -- 172.21.15.32:0/605802007 >> v1:172.21.15.171:6789/0 conn(0x7f78140cc680 legacy=0x7f781415ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:12.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.980+0000 7f7812000640 1 -- 172.21.15.32:0/605802007 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781415e4f0 con 0x7f781415a7c0 2024-03-19T06:22:12.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812000640 1 -- 172.21.15.32:0/605802007 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f7804001680 con 0x7f781415a7c0 2024-03-19T06:22:12.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812000640 1 -- 172.21.15.32:0/605802007 >> v1:172.21.15.32:6789/0 conn(0x7f781415a7c0 legacy=0x7f78140cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:12.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812000640 1 --2- 172.21.15.32:0/605802007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77f8005c00 0x7f77f8005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:12.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812000640 1 --2- 172.21.15.32:0/605802007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77f80065b0 0x7f77f8006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:12.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812000640 1 --2- 172.21.15.32:0/605802007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78140b4c50 0x7f77f80072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:12.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812000640 1 -- 172.21.15.32:0/605802007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78140b5600 con 0x7f77f8005c00 2024-03-19T06:22:12.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812000640 1 -- 172.21.15.32:0/605802007 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f800dbe0 con 0x7f77f80065b0 2024-03-19T06:22:12.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812000640 1 -- 172.21.15.32:0/605802007 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f800dde0 con 0x7f78140b4c50 2024-03-19T06:22:12.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812a00640 1 --2- 172.21.15.32:0/605802007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77f8005c00 0x7f77f8005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:12.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f780a000640 1 --2- 172.21.15.32:0/605802007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77f80065b0 0x7f77f8006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:12.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7813400640 1 --2- 172.21.15.32:0/605802007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78140b4c50 0x7f77f80072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:12.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812a00640 1 -- 172.21.15.32:0/605802007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78140b4c50 msgr2=0x7f77f80072e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:12.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812a00640 1 --2- 172.21.15.32:0/605802007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78140b4c50 0x7f77f80072e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:12.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812a00640 1 -- 172.21.15.32:0/605802007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77f80065b0 msgr2=0x7f77f8006a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:12.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812a00640 1 --2- 172.21.15.32:0/605802007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77f80065b0 0x7f77f8006a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:12.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812a00640 1 -- 172.21.15.32:0/605802007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f8005740 con 0x7f77f8005c00 2024-03-19T06:22:12.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7813400640 1 --2- 172.21.15.32:0/605802007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78140b4c50 0x7f77f80072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:12.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812a00640 1 --2- 172.21.15.32:0/605802007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77f8005c00 0x7f77f8005fe0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f780400c2c0 tx=0x7f780401cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f1f3859b9112ac server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:12.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812000640 1 -- 172.21.15.32:0/605802007 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804007d60 con 0x7f77f8005c00 2024-03-19T06:22:12.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812000640 1 -- 172.21.15.32:0/605802007 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78040a9070 con 0x7f77f8005c00 2024-03-19T06:22:12.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.984+0000 7f7812000640 1 -- 172.21.15.32:0/605802007 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804005d40 con 0x7f77f8005c00 2024-03-19T06:22:12.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7819600640 1 -- 172.21.15.32:0/605802007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77f8005c00 msgr2=0x7f77f8005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:12.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7819600640 1 --2- 172.21.15.32:0/605802007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77f8005c00 0x7f77f8005fe0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f780400c2c0 tx=0x7f780401cd40 comp rx=0 tx=0).stop 2024-03-19T06:22:12.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7813400640 1 -- 172.21.15.32:0/605802007 reap_dead start 2024-03-19T06:22:12.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7819600640 1 -- 172.21.15.32:0/605802007 shutdown_connections 2024-03-19T06:22:12.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7819600640 1 -- 172.21.15.32:0/605802007 >> 172.21.15.32:0/605802007 conn(0x7f78140b1280 msgr2=0x7f78140b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:12.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7819600640 1 -- 172.21.15.32:0/605802007 shutdown_connections 2024-03-19T06:22:12.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7819600640 1 -- 172.21.15.32:0/605802007 wait complete. 2024-03-19T06:22:12.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7819600640 1 Processor -- start 2024-03-19T06:22:12.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7819600640 1 -- start start 2024-03-19T06:22:12.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7819600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77f8005c00 0x7f7814157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:12.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7819600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f781415c600 0x7f781415d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:12.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7819600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7814144f00 0x7f78141ec030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:12.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7819600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78140715a0 con 0x7f7814144f00 2024-03-19T06:22:12.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7819600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78140cbe40 con 0x7f77f8005c00 2024-03-19T06:22:12.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7819600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7814071720 con 0x7f781415c600 2024-03-19T06:22:12.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7813400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7814144f00 0x7f78141ec030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:12.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7813400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7814144f00 0x7f78141ec030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49422/0 (socket says 172.21.15.32:49422) 2024-03-19T06:22:12.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7813400640 1 -- 172.21.15.32:0/1918202113 learned_addr learned my addr 172.21.15.32:0/1918202113 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:12.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f780a000640 1 --2- 172.21.15.32:0/1918202113 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f781415c600 0x7f781415d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:12.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7812a00640 1 --2- 172.21.15.32:0/1918202113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77f8005c00 0x7f7814157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:12.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7813400640 1 -- 172.21.15.32:0/1918202113 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f781415c600 msgr2=0x7f781415d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:12.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7813400640 1 --2- 172.21.15.32:0/1918202113 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f781415c600 0x7f781415d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:12.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7813400640 1 -- 172.21.15.32:0/1918202113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77f8005c00 msgr2=0x7f7814157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:12.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7813400640 1 --2- 172.21.15.32:0/1918202113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77f8005c00 0x7f7814157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:12.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7813400640 1 -- 172.21.15.32:0/1918202113 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781415ca80 con 0x7f7814144f00 2024-03-19T06:22:12.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7812a00640 1 --2- 172.21.15.32:0/1918202113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77f8005c00 0x7f7814157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:12.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f780a000640 1 --2- 172.21.15.32:0/1918202113 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f781415c600 0x7f781415d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:12.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.988+0000 7f7813400640 1 --2- 172.21.15.32:0/1918202113 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7814144f00 0x7f78141ec030 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f78140688e0 tx=0x7f780c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:12.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.992+0000 7f780b400640 1 -- 172.21.15.32:0/1918202113 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c01a030 con 0x7f7814144f00 2024-03-19T06:22:12.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.992+0000 7f780b400640 1 -- 172.21.15.32:0/1918202113 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c010e50 con 0x7f7814144f00 2024-03-19T06:22:12.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.992+0000 7f7819600640 1 -- 172.21.15.32:0/1918202113 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781415ddf0 con 0x7f7814144f00 2024-03-19T06:22:12.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.992+0000 7f780b400640 1 -- 172.21.15.32:0/1918202113 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c003be0 con 0x7f7814144f00 2024-03-19T06:22:12.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.992+0000 7f7819600640 1 -- 172.21.15.32:0/1918202113 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7814158400 con 0x7f7814144f00 2024-03-19T06:22:12.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.992+0000 7f7819600640 1 -- 172.21.15.32:0/1918202113 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78140749e0 con 0x7f7814144f00 2024-03-19T06:22:12.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.992+0000 7f780b400640 1 -- 172.21.15.32:0/1918202113 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f780c01d070 con 0x7f7814144f00 2024-03-19T06:22:12.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.992+0000 7f780b400640 1 --2- 172.21.15.32:0/1918202113 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f77f0067660 0x7f77f0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:12.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.992+0000 7f780b400640 1 -- 172.21.15.32:0/1918202113 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f780c085f00 con 0x7f7814144f00 2024-03-19T06:22:12.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.992+0000 7f7812a00640 1 --2- 172.21.15.32:0/1918202113 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f77f0067660 0x7f77f0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:12.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:12.996+0000 7f7812a00640 1 --2- 172.21.15.32:0/1918202113 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f77f0067660 0x7f77f0069b20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f780400c2c0 tx=0x7f78040a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:12.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.000+0000 7f780b400640 1 -- 172.21.15.32:0/1918202113 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f780c025020 con 0x7f7814144f00 2024-03-19T06:22:13.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.164+0000 7f7819600640 1 -- 172.21.15.32:0/1918202113 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78140cc270 con 0x7f7814144f00 2024-03-19T06:22:13.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.164+0000 7f780b400640 1 -- 172.21.15.32:0/1918202113 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16694 (secure 0 0 0) 0x7f780c07de20 con 0x7f7814144f00 2024-03-19T06:22:13.158 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:13.158 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":34,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:22:12.166787+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:22:09.983589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-19T06:22:11.172289+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:22:13.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.168+0000 7f7819600640 1 -- 172.21.15.32:0/1918202113 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f77f0067660 msgr2=0x7f77f0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:13.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.168+0000 7f7819600640 1 --2- 172.21.15.32:0/1918202113 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f77f0067660 0x7f77f0069b20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f780400c2c0 tx=0x7f78040a7070 comp rx=0 tx=0).stop 2024-03-19T06:22:13.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.168+0000 7f7819600640 1 -- 172.21.15.32:0/1918202113 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7814144f00 msgr2=0x7f78141ec030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:13.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.168+0000 7f7819600640 1 --2- 172.21.15.32:0/1918202113 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7814144f00 0x7f78141ec030 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f78140688e0 tx=0x7f780c009f90 comp rx=0 tx=0).stop 2024-03-19T06:22:13.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.168+0000 7f7819600640 1 -- 172.21.15.32:0/1918202113 shutdown_connections 2024-03-19T06:22:13.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.168+0000 7f7819600640 1 --2- 172.21.15.32:0/1918202113 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f77f0067660 0x7f77f0069b20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:13.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.168+0000 7f7819600640 1 --2- 172.21.15.32:0/1918202113 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7814144f00 0x7f78141ec030 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:13.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.168+0000 7f7819600640 1 --2- 172.21.15.32:0/1918202113 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f781415c600 0x7f781415d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:13.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.168+0000 7f7819600640 1 --2- 172.21.15.32:0/1918202113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77f8005c00 0x7f7814157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:13.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.168+0000 7f7819600640 1 -- 172.21.15.32:0/1918202113 >> 172.21.15.32:0/1918202113 conn(0x7f78140b1280 msgr2=0x7f781406e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:13.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.168+0000 7f7819600640 1 -- 172.21.15.32:0/1918202113 shutdown_connections 2024-03-19T06:22:13.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.168+0000 7f7819600640 1 -- 172.21.15.32:0/1918202113 wait complete. 2024-03-19T06:22:13.178 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:22:13.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.328+0000 7f2952e00640 1 Processor -- start 2024-03-19T06:22:13.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.328+0000 7f2952e00640 1 -- start start 2024-03-19T06:22:13.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.328+0000 7f2952e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c0aecf0 0x7f294c0ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:13.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.328+0000 7f2952e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294c15fe20 con 0x7f294c15c010 2024-03-19T06:22:13.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.328+0000 7f2952e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294c160100 con 0x7f294c06d6c0 2024-03-19T06:22:13.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.328+0000 7f2952e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c1603e0 con 0x7f294c0aecf0 2024-03-19T06:22:13.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.328+0000 7f2943400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f294c15c010 0x7f294c15f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38412/0 (socket says 172.21.15.32:38412) 2024-03-19T06:22:13.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.328+0000 7f2943400640 1 -- 172.21.15.32:0/2841844972 learned_addr learned my addr 172.21.15.32:0/2841844972 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:13.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.328+0000 7f294be00640 1 --2- 172.21.15.32:0/2841844972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c0aecf0 0x7f294c0ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:13.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.328+0000 7f294b400640 1 -- 172.21.15.32:0/2841844972 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291900287 0 0) 0x7f294c15fe20 con 0x7f294c15c010 2024-03-19T06:22:13.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.328+0000 7f294b400640 1 -- 172.21.15.32:0/2841844972 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2930003530 con 0x7f294c15c010 2024-03-19T06:22:13.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.328+0000 7f294b400640 1 -- 172.21.15.32:0/2841844972 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13559005 0 0) 0x7f294c160100 con 0x7f294c06d6c0 2024-03-19T06:22:13.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.328+0000 7f294b400640 1 -- 172.21.15.32:0/2841844972 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f294c15fe20 con 0x7f294c06d6c0 2024-03-19T06:22:13.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.328+0000 7f294be00640 1 -- 172.21.15.32:0/2841844972 >> v1:172.21.15.171:6789/0 conn(0x7f294c06d6c0 legacy=0x7f294c0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:13.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.328+0000 7f294be00640 1 -- 172.21.15.32:0/2841844972 >> v1:172.21.15.32:6789/0 conn(0x7f294c15c010 legacy=0x7f294c15f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:13.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.328+0000 7f294be00640 1 -- 172.21.15.32:0/2841844972 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c0ca1f0 con 0x7f294c0aecf0 2024-03-19T06:22:13.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.332+0000 7f294be00640 1 --2- 172.21.15.32:0/2841844972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c0aecf0 0x7f294c0ca9f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f294c160560 tx=0x7f293c01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e9a50382faa3601 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:13.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.332+0000 7f294b400640 1 -- 172.21.15.32:0/2841844972 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c0b0070 con 0x7f294c0aecf0 2024-03-19T06:22:13.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.332+0000 7f294b400640 1 -- 172.21.15.32:0/2841844972 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c0ab600 con 0x7f294c0aecf0 2024-03-19T06:22:13.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.332+0000 7f294b400640 1 -- 172.21.15.32:0/2841844972 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c0ab9d0 con 0x7f294c0aecf0 2024-03-19T06:22:13.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.332+0000 7f2952e00640 1 -- 172.21.15.32:0/2841844972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c0aecf0 msgr2=0x7f294c0ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:13.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.332+0000 7f2952e00640 1 --2- 172.21.15.32:0/2841844972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c0aecf0 0x7f294c0ca9f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f294c160560 tx=0x7f293c01c430 comp rx=0 tx=0).stop 2024-03-19T06:22:13.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.332+0000 7f2952e00640 1 -- 172.21.15.32:0/2841844972 shutdown_connections 2024-03-19T06:22:13.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.332+0000 7f2952e00640 1 --2- 172.21.15.32:0/2841844972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c0aecf0 0x7f294c0ca9f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:13.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.332+0000 7f2952e00640 1 -- 172.21.15.32:0/2841844972 >> 172.21.15.32:0/2841844972 conn(0x7f294c0b1280 msgr2=0x7f294c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:13.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.332+0000 7f2952e00640 1 -- 172.21.15.32:0/2841844972 shutdown_connections 2024-03-19T06:22:13.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.332+0000 7f2952e00640 1 -- 172.21.15.32:0/2841844972 wait complete. 2024-03-19T06:22:13.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2952e00640 1 Processor -- start 2024-03-19T06:22:13.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2952e00640 1 -- start start 2024-03-19T06:22:13.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2952e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f294c06d6c0 0x7f294c0c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:13.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2952e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294c0aecf0 0x7f294c14aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:13.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2952e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c15c010 0x7f294c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:13.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2952e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c16a030 con 0x7f294c0aecf0 2024-03-19T06:22:13.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2952e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c169eb0 con 0x7f294c06d6c0 2024-03-19T06:22:13.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2952e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c16a1b0 con 0x7f294c15c010 2024-03-19T06:22:13.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2943400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294c0aecf0 0x7f294c14aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:13.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2943400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294c0aecf0 0x7f294c14aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49434/0 (socket says 172.21.15.32:49434) 2024-03-19T06:22:13.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2943400640 1 -- 172.21.15.32:0/2497015068 learned_addr learned my addr 172.21.15.32:0/2497015068 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:13.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2950e00640 1 --2- 172.21.15.32:0/2497015068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c15c010 0x7f294c0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:13.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f294be00640 1 --2- 172.21.15.32:0/2497015068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f294c06d6c0 0x7f294c0c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:13.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2943400640 1 -- 172.21.15.32:0/2497015068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c15c010 msgr2=0x7f294c0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:13.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2943400640 1 --2- 172.21.15.32:0/2497015068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c15c010 0x7f294c0cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:13.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2943400640 1 -- 172.21.15.32:0/2497015068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f294c06d6c0 msgr2=0x7f294c0c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:13.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2943400640 1 --2- 172.21.15.32:0/2497015068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f294c06d6c0 0x7f294c0c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:13.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2943400640 1 -- 172.21.15.32:0/2497015068 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c136d70 con 0x7f294c0aecf0 2024-03-19T06:22:13.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2950e00640 1 --2- 172.21.15.32:0/2497015068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c15c010 0x7f294c0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:13.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2943400640 1 --2- 172.21.15.32:0/2497015068 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294c0aecf0 0x7f294c14aff0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2934005890 tx=0x7f293400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:13.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2948c00640 1 -- 172.21.15.32:0/2497015068 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934017070 con 0x7f294c0aecf0 2024-03-19T06:22:13.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2948c00640 1 -- 172.21.15.32:0/2497015068 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2934005cf0 con 0x7f294c0aecf0 2024-03-19T06:22:13.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2948c00640 1 -- 172.21.15.32:0/2497015068 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29340072b0 con 0x7f294c0aecf0 2024-03-19T06:22:13.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2952e00640 1 -- 172.21.15.32:0/2497015068 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294c137050 con 0x7f294c0aecf0 2024-03-19T06:22:13.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2952e00640 1 -- 172.21.15.32:0/2497015068 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294c137610 con 0x7f294c0aecf0 2024-03-19T06:22:13.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.336+0000 7f2952e00640 1 -- 172.21.15.32:0/2497015068 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294c0749e0 con 0x7f294c0aecf0 2024-03-19T06:22:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.340+0000 7f2948c00640 1 -- 172.21.15.32:0/2497015068 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f293401a070 con 0x7f294c0aecf0 2024-03-19T06:22:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.340+0000 7f2948c00640 1 --2- 172.21.15.32:0/2497015068 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2928067690 0x7f2928069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:13.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.340+0000 7f2948c00640 1 -- 172.21.15.32:0/2497015068 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2934084c20 con 0x7f294c0aecf0 2024-03-19T06:22:13.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.340+0000 7f294be00640 1 --2- 172.21.15.32:0/2497015068 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2928067690 0x7f2928069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:13.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.340+0000 7f294be00640 1 --2- 172.21.15.32:0/2497015068 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2928067690 0x7f2928069b50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f294c0cf450 tx=0x7f293c0a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:13.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.344+0000 7f2948c00640 1 -- 172.21.15.32:0/2497015068 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2934055890 con 0x7f294c0aecf0 2024-03-19T06:22:13.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.508+0000 7f2952e00640 1 -- 172.21.15.32:0/2497015068 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f294c166ec0 con 0x7f294c0aecf0 2024-03-19T06:22:13.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.508+0000 7f2948c00640 1 -- 172.21.15.32:0/2497015068 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16694 (secure 0 0 0) 0x7f2934055190 con 0x7f294c0aecf0 2024-03-19T06:22:13.500 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:13.500 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":34,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:22:12.166787+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:22:09.983589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-19T06:22:11.172289+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:22:13.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.508+0000 7f2952e00640 1 -- 172.21.15.32:0/2497015068 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2928067690 msgr2=0x7f2928069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:13.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.508+0000 7f2952e00640 1 --2- 172.21.15.32:0/2497015068 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2928067690 0x7f2928069b50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f294c0cf450 tx=0x7f293c0a6000 comp rx=0 tx=0).stop 2024-03-19T06:22:13.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.508+0000 7f2952e00640 1 -- 172.21.15.32:0/2497015068 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294c0aecf0 msgr2=0x7f294c14aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:13.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.508+0000 7f2952e00640 1 --2- 172.21.15.32:0/2497015068 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294c0aecf0 0x7f294c14aff0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2934005890 tx=0x7f293400c960 comp rx=0 tx=0).stop 2024-03-19T06:22:13.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.508+0000 7f2952e00640 1 -- 172.21.15.32:0/2497015068 shutdown_connections 2024-03-19T06:22:13.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.508+0000 7f2952e00640 1 --2- 172.21.15.32:0/2497015068 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2928067690 0x7f2928069b50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:13.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.508+0000 7f2952e00640 1 --2- 172.21.15.32:0/2497015068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c15c010 0x7f294c0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:13.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.508+0000 7f2952e00640 1 --2- 172.21.15.32:0/2497015068 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f294c0aecf0 0x7f294c14aff0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:13.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.508+0000 7f2952e00640 1 --2- 172.21.15.32:0/2497015068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f294c06d6c0 0x7f294c0c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:13.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.508+0000 7f2952e00640 1 -- 172.21.15.32:0/2497015068 >> 172.21.15.32:0/2497015068 conn(0x7f294c0b1280 msgr2=0x7f294c0c9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:13.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.508+0000 7f2952e00640 1 -- 172.21.15.32:0/2497015068 shutdown_connections 2024-03-19T06:22:13.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.508+0000 7f2952e00640 1 -- 172.21.15.32:0/2497015068 wait complete. 2024-03-19T06:22:13.522 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-19T06:22:13.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.672+0000 7f2e41000640 1 Processor -- start 2024-03-19T06:22:13.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.672+0000 7f2e41000640 1 -- start start 2024-03-19T06:22:13.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.672+0000 7f2e41000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3c06b450 0x7f2e3c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:13.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.672+0000 7f2e41000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3c0af2d0 con 0x7f2e3c0aea70 2024-03-19T06:22:13.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.672+0000 7f2e41000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3c15eea0 con 0x7f2e3c15a840 2024-03-19T06:22:13.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.672+0000 7f2e41000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c0cdc20 con 0x7f2e3c06b450 2024-03-19T06:22:13.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.676+0000 7f2e3a800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2e3c0aea70 0x7f2e3c0ce0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60884/0 (socket says 172.21.15.32:60884) 2024-03-19T06:22:13.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.676+0000 7f2e3a800640 1 -- 172.21.15.32:0/2644415329 learned_addr learned my addr 172.21.15.32:0/2644415329 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:13.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.676+0000 7f2e33e00640 1 --2- 172.21.15.32:0/2644415329 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3c06b450 0x7f2e3c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:13.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.676+0000 7f2e39400640 1 -- 172.21.15.32:0/2644415329 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108229135 0 0) 0x7f2e3c0af2d0 con 0x7f2e3c0aea70 2024-03-19T06:22:13.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.676+0000 7f2e39400640 1 -- 172.21.15.32:0/2644415329 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e20003530 con 0x7f2e3c0aea70 2024-03-19T06:22:13.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.676+0000 7f2e39400640 1 -- 172.21.15.32:0/2644415329 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102565958 0 0) 0x7f2e3c15eea0 con 0x7f2e3c15a840 2024-03-19T06:22:13.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.676+0000 7f2e39400640 1 -- 172.21.15.32:0/2644415329 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e3c0af2d0 con 0x7f2e3c15a840 2024-03-19T06:22:13.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.676+0000 7f2e33e00640 1 -- 172.21.15.32:0/2644415329 >> v1:172.21.15.171:6789/0 conn(0x7f2e3c15a840 legacy=0x7f2e3c06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:13.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.676+0000 7f2e33e00640 1 -- 172.21.15.32:0/2644415329 >> v1:172.21.15.32:6789/0 conn(0x7f2e3c0aea70 legacy=0x7f2e3c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:13.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.676+0000 7f2e33e00640 1 -- 172.21.15.32:0/2644415329 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c15f180 con 0x7f2e3c06b450 2024-03-19T06:22:13.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.676+0000 7f2e33e00640 1 --2- 172.21.15.32:0/2644415329 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3c06b450 0x7f2e3c06f040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e240097f0 tx=0x7f2e2401c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7e608037e9b790c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:13.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.676+0000 7f2e39400640 1 -- 172.21.15.32:0/2644415329 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e240b1070 con 0x7f2e3c06b450 2024-03-19T06:22:13.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.676+0000 7f2e39400640 1 -- 172.21.15.32:0/2644415329 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e240a8050 con 0x7f2e3c06b450 2024-03-19T06:22:13.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.676+0000 7f2e39400640 1 -- 172.21.15.32:0/2644415329 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e240ac860 con 0x7f2e3c06b450 2024-03-19T06:22:13.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e41000640 1 -- 172.21.15.32:0/2644415329 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3c06b450 msgr2=0x7f2e3c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:13.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e41000640 1 --2- 172.21.15.32:0/2644415329 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3c06b450 0x7f2e3c06f040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e240097f0 tx=0x7f2e2401c380 comp rx=0 tx=0).stop 2024-03-19T06:22:13.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e41000640 1 -- 172.21.15.32:0/2644415329 shutdown_connections 2024-03-19T06:22:13.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e41000640 1 --2- 172.21.15.32:0/2644415329 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3c06b450 0x7f2e3c06f040 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:13.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e41000640 1 -- 172.21.15.32:0/2644415329 >> 172.21.15.32:0/2644415329 conn(0x7f2e3c0b1590 msgr2=0x7f2e3c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:13.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e41000640 1 -- 172.21.15.32:0/2644415329 shutdown_connections 2024-03-19T06:22:13.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e41000640 1 -- 172.21.15.32:0/2644415329 wait complete. 2024-03-19T06:22:13.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e41000640 1 Processor -- start 2024-03-19T06:22:13.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e41000640 1 -- start start 2024-03-19T06:22:13.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e41000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3c06b450 0x7f2e3c157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:13.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e41000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e3c0aea70 0x7f2e3c156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:13.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e41000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e3c15a840 0x7f2e3c144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:13.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e41000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c0cf150 con 0x7f2e3c15a840 2024-03-19T06:22:13.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e41000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c0cefd0 con 0x7f2e3c0aea70 2024-03-19T06:22:13.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e41000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c0cf2d0 con 0x7f2e3c06b450 2024-03-19T06:22:13.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e3a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e3c15a840 0x7f2e3c144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:13.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e3a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e3c15a840 0x7f2e3c144120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56584/0 (socket says 172.21.15.32:56584) 2024-03-19T06:22:13.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e3a800640 1 -- 172.21.15.32:0/2475829305 learned_addr learned my addr 172.21.15.32:0/2475829305 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:13.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e33e00640 1 --2- 172.21.15.32:0/2475829305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e3c0aea70 0x7f2e3c156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:13.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.680+0000 7f2e39e00640 1 --2- 172.21.15.32:0/2475829305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3c06b450 0x7f2e3c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.684+0000 7f2e3a800640 1 -- 172.21.15.32:0/2475829305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3c06b450 msgr2=0x7f2e3c157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.684+0000 7f2e3a800640 1 --2- 172.21.15.32:0/2475829305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3c06b450 0x7f2e3c157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.684+0000 7f2e3a800640 1 -- 172.21.15.32:0/2475829305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e3c0aea70 msgr2=0x7f2e3c156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.684+0000 7f2e3a800640 1 --2- 172.21.15.32:0/2475829305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e3c0aea70 0x7f2e3c156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.684+0000 7f2e3a800640 1 -- 172.21.15.32:0/2475829305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c1514b0 con 0x7f2e3c15a840 2024-03-19T06:22:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.684+0000 7f2e3a800640 1 --2- 172.21.15.32:0/2475829305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e3c15a840 0x7f2e3c144120 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400cb40 tx=0x7f2e3400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.684+0000 7f2e32000640 1 -- 172.21.15.32:0/2475829305 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34017070 con 0x7f2e3c15a840 2024-03-19T06:22:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.684+0000 7f2e32000640 1 -- 172.21.15.32:0/2475829305 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3400aca0 con 0x7f2e3c15a840 2024-03-19T06:22:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.684+0000 7f2e41000640 1 -- 172.21.15.32:0/2475829305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3c15c050 con 0x7f2e3c15a840 2024-03-19T06:22:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.684+0000 7f2e32000640 1 -- 172.21.15.32:0/2475829305 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34012620 con 0x7f2e3c15a840 2024-03-19T06:22:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.684+0000 7f2e41000640 1 -- 172.21.15.32:0/2475829305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3c15bd70 con 0x7f2e3c15a840 2024-03-19T06:22:13.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.684+0000 7f2e41000640 1 -- 172.21.15.32:0/2475829305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3c0749e0 con 0x7f2e3c15a840 2024-03-19T06:22:13.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.684+0000 7f2e32000640 1 -- 172.21.15.32:0/2475829305 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2e3401a070 con 0x7f2e3c15a840 2024-03-19T06:22:13.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.684+0000 7f2e32000640 1 --2- 172.21.15.32:0/2475829305 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e18067660 0x7f2e18069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:13.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.684+0000 7f2e32000640 1 -- 172.21.15.32:0/2475829305 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e34085660 con 0x7f2e3c15a840 2024-03-19T06:22:13.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.684+0000 7f2e39e00640 1 --2- 172.21.15.32:0/2475829305 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e18067660 0x7f2e18069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:13.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.688+0000 7f2e39e00640 1 --2- 172.21.15.32:0/2475829305 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e18067660 0x7f2e18069b20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0011f0 tx=0x7f2e2c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:13.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.688+0000 7f2e32000640 1 -- 172.21.15.32:0/2475829305 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2e3c15c050 con 0x7f2e3c15a840 2024-03-19T06:22:13.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:13.892+0000 7f2e41000640 1 -- 172.21.15.32:0/2475829305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2e3c0cf510 con 0x7f2e3c15a840 2024-03-19T06:22:14.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.796+0000 7f2e32000640 1 -- 172.21.15.32:0/2475829305 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2e34055bf0 con 0x7f2e3c15a840 2024-03-19T06:22:14.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.800+0000 7f2e41000640 1 -- 172.21.15.32:0/2475829305 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e18067660 msgr2=0x7f2e18069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:14.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.800+0000 7f2e41000640 1 --2- 172.21.15.32:0/2475829305 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e18067660 0x7f2e18069b20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0011f0 tx=0x7f2e2c009040 comp rx=0 tx=0).stop 2024-03-19T06:22:14.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.800+0000 7f2e41000640 1 -- 172.21.15.32:0/2475829305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e3c15a840 msgr2=0x7f2e3c144120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:14.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.800+0000 7f2e41000640 1 --2- 172.21.15.32:0/2475829305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e3c15a840 0x7f2e3c144120 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400cb40 tx=0x7f2e3400a060 comp rx=0 tx=0).stop 2024-03-19T06:22:14.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.800+0000 7f2e41000640 1 -- 172.21.15.32:0/2475829305 shutdown_connections 2024-03-19T06:22:14.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.800+0000 7f2e41000640 1 --2- 172.21.15.32:0/2475829305 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e18067660 0x7f2e18069b20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:14.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.800+0000 7f2e41000640 1 --2- 172.21.15.32:0/2475829305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e3c15a840 0x7f2e3c144120 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:14.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.800+0000 7f2e41000640 1 --2- 172.21.15.32:0/2475829305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e3c0aea70 0x7f2e3c156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:14.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.800+0000 7f2e41000640 1 --2- 172.21.15.32:0/2475829305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e3c06b450 0x7f2e3c157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:14.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.800+0000 7f2e41000640 1 -- 172.21.15.32:0/2475829305 >> 172.21.15.32:0/2475829305 conn(0x7f2e3c0b1590 msgr2=0x7f2e3c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:14.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.800+0000 7f2e41000640 1 -- 172.21.15.32:0/2475829305 shutdown_connections 2024-03-19T06:22:14.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.800+0000 7f2e41000640 1 -- 172.21.15.32:0/2475829305 wait complete. 2024-03-19T06:22:14.816 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-19T06:22:14.816 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-19T06:22:14.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.972+0000 7f07f8a00640 1 Processor -- start 2024-03-19T06:22:14.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.972+0000 7f07f8a00640 1 -- start start 2024-03-19T06:22:14.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.972+0000 7f07f8a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f07f406b450 0x7f07f406f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:14.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.972+0000 7f07f8a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f40af2d0 con 0x7f07f40aea70 2024-03-19T06:22:14.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.972+0000 7f07f8a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f415eea0 con 0x7f07f415a840 2024-03-19T06:22:14.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.972+0000 7f07f8a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f40cdc20 con 0x7f07f406b450 2024-03-19T06:22:14.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.972+0000 7f07f2800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f07f40aea70 0x7f07f40ce0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60894/0 (socket says 172.21.15.32:60894) 2024-03-19T06:22:14.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.972+0000 7f07f2800640 1 -- 172.21.15.32:0/2568445731 learned_addr learned my addr 172.21.15.32:0/2568445731 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:14.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.972+0000 7f07e9400640 1 --2- 172.21.15.32:0/2568445731 >> v2:172.21.15.171:3300/0 conn(0x7f07f406b450 0x7f07f406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:14.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.976+0000 7f07f1400640 1 -- 172.21.15.32:0/2568445731 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570783821 0 0) 0x7f07f40af2d0 con 0x7f07f40aea70 2024-03-19T06:22:14.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.976+0000 7f07f1400640 1 -- 172.21.15.32:0/2568445731 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07d8003530 con 0x7f07f40aea70 2024-03-19T06:22:14.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.976+0000 7f07e9400640 1 -- 172.21.15.32:0/2568445731 >> v1:172.21.15.171:6789/0 conn(0x7f07f415a840 legacy=0x7f07f406ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:14.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.976+0000 7f07e9400640 1 -- 172.21.15.32:0/2568445731 >> v1:172.21.15.32:6789/0 conn(0x7f07f40aea70 legacy=0x7f07f40ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:14.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.976+0000 7f07e9400640 1 -- 172.21.15.32:0/2568445731 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f415f180 con 0x7f07f406b450 2024-03-19T06:22:14.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.976+0000 7f07e9400640 1 --2- 172.21.15.32:0/2568445731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07f406b450 0x7f07f406f040 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0097c0 tx=0x7f07dc01c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55fbe07cbeb039ee server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:14.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.976+0000 7f07f1400640 1 -- 172.21.15.32:0/2568445731 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc0ab430 con 0x7f07f406b450 2024-03-19T06:22:14.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.976+0000 7f07f1400640 1 -- 172.21.15.32:0/2568445731 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc0b0070 con 0x7f07f406b450 2024-03-19T06:22:14.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.976+0000 7f07f1400640 1 -- 172.21.15.32:0/2568445731 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc0ab7d0 con 0x7f07f406b450 2024-03-19T06:22:14.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f8a00640 1 -- 172.21.15.32:0/2568445731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07f406b450 msgr2=0x7f07f406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:14.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f8a00640 1 --2- 172.21.15.32:0/2568445731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07f406b450 0x7f07f406f040 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0097c0 tx=0x7f07dc01c3d0 comp rx=0 tx=0).stop 2024-03-19T06:22:14.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f8a00640 1 -- 172.21.15.32:0/2568445731 shutdown_connections 2024-03-19T06:22:14.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f8a00640 1 --2- 172.21.15.32:0/2568445731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07f406b450 0x7f07f406f040 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:14.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f8a00640 1 -- 172.21.15.32:0/2568445731 >> 172.21.15.32:0/2568445731 conn(0x7f07f40b1590 msgr2=0x7f07f40b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:14.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f8a00640 1 -- 172.21.15.32:0/2568445731 shutdown_connections 2024-03-19T06:22:14.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f8a00640 1 -- 172.21.15.32:0/2568445731 wait complete. 2024-03-19T06:22:14.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f8a00640 1 Processor -- start 2024-03-19T06:22:14.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f8a00640 1 -- start start 2024-03-19T06:22:14.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f8a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f406b450 0x7f07f41524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:14.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f8a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07f40aea70 0x7f07f415b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:14.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f8a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07f415a840 0x7f07f415f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:14.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f8a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f40cf150 con 0x7f07f406b450 2024-03-19T06:22:14.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f8a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f40cefd0 con 0x7f07f415a840 2024-03-19T06:22:14.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f8a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f40cf2d0 con 0x7f07f40aea70 2024-03-19T06:22:14.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f1e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f406b450 0x7f07f41524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:14.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f1e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f406b450 0x7f07f41524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56596/0 (socket says 172.21.15.32:56596) 2024-03-19T06:22:14.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f1e00640 1 -- 172.21.15.32:0/1195417010 learned_addr learned my addr 172.21.15.32:0/1195417010 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:14.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f2800640 1 --2- 172.21.15.32:0/1195417010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07f415a840 0x7f07f415f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:14.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07e9400640 1 --2- 172.21.15.32:0/1195417010 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07f40aea70 0x7f07f415b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:14.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f1e00640 1 -- 172.21.15.32:0/1195417010 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07f40aea70 msgr2=0x7f07f415b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:14.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f1e00640 1 --2- 172.21.15.32:0/1195417010 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07f40aea70 0x7f07f415b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:14.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f1e00640 1 -- 172.21.15.32:0/1195417010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07f415a840 msgr2=0x7f07f415f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:14.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f1e00640 1 --2- 172.21.15.32:0/1195417010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07f415a840 0x7f07f415f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:14.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f1e00640 1 -- 172.21.15.32:0/1195417010 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f41566d0 con 0x7f07f406b450 2024-03-19T06:22:14.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07e9400640 1 --2- 172.21.15.32:0/1195417010 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07f40aea70 0x7f07f415b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:14.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.980+0000 7f07f2800640 1 --2- 172.21.15.32:0/1195417010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07f415a840 0x7f07f415f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:14.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.984+0000 7f07f1e00640 1 --2- 172.21.15.32:0/1195417010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f406b450 0x7f07f41524a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f07e400c7f0 tx=0x7f07e400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:14.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.984+0000 7f07eaa00640 1 -- 172.21.15.32:0/1195417010 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e4003b80 con 0x7f07f406b450 2024-03-19T06:22:14.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.984+0000 7f07eaa00640 1 -- 172.21.15.32:0/1195417010 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e4003d20 con 0x7f07f406b450 2024-03-19T06:22:14.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.984+0000 7f07eaa00640 1 -- 172.21.15.32:0/1195417010 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e400aa90 con 0x7f07f406b450 2024-03-19T06:22:14.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.984+0000 7f07f8a00640 1 -- 172.21.15.32:0/1195417010 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f41569b0 con 0x7f07f406b450 2024-03-19T06:22:14.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.984+0000 7f07f8a00640 1 -- 172.21.15.32:0/1195417010 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f4156f70 con 0x7f07f406b450 2024-03-19T06:22:14.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.984+0000 7f07f8a00640 1 -- 172.21.15.32:0/1195417010 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f40749e0 con 0x7f07f406b450 2024-03-19T06:22:14.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.984+0000 7f07eaa00640 1 -- 172.21.15.32:0/1195417010 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f07e400ac30 con 0x7f07f406b450 2024-03-19T06:22:14.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.984+0000 7f07eaa00640 1 --2- 172.21.15.32:0/1195417010 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f07d0067660 0x7f07d0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:14.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.984+0000 7f07eaa00640 1 -- 172.21.15.32:0/1195417010 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07e4085850 con 0x7f07f406b450 2024-03-19T06:22:14.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.984+0000 7f07e9400640 1 --2- 172.21.15.32:0/1195417010 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f07d0067660 0x7f07d0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:14.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.988+0000 7f07e9400640 1 --2- 172.21.15.32:0/1195417010 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f07d0067660 0x7f07d0069b20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0af000 tx=0x7f07dc0a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:14.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:14.988+0000 7f07eaa00640 1 -- 172.21.15.32:0/1195417010 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f07e40564c0 con 0x7f07f406b450 2024-03-19T06:22:15.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.184+0000 7f07f8a00640 1 -- 172.21.15.32:0/1195417010 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f07f406e6c0 con 0x7f07f406b450 2024-03-19T06:22:15.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.800+0000 7f07eaa00640 1 -- 172.21.15.32:0/1195417010 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f07e4055dc0 con 0x7f07f406b450 2024-03-19T06:22:15.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.800+0000 7f07f8a00640 1 -- 172.21.15.32:0/1195417010 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f07d0067660 msgr2=0x7f07d0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:15.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.800+0000 7f07f8a00640 1 --2- 172.21.15.32:0/1195417010 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f07d0067660 0x7f07d0069b20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0af000 tx=0x7f07dc0a7000 comp rx=0 tx=0).stop 2024-03-19T06:22:15.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.800+0000 7f07f8a00640 1 -- 172.21.15.32:0/1195417010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f406b450 msgr2=0x7f07f41524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:15.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.800+0000 7f07f8a00640 1 --2- 172.21.15.32:0/1195417010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f406b450 0x7f07f41524a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f07e400c7f0 tx=0x7f07e400ccb0 comp rx=0 tx=0).stop 2024-03-19T06:22:15.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.800+0000 7f07f8a00640 1 -- 172.21.15.32:0/1195417010 shutdown_connections 2024-03-19T06:22:15.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.800+0000 7f07f8a00640 1 --2- 172.21.15.32:0/1195417010 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f07d0067660 0x7f07d0069b20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:15.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.800+0000 7f07f8a00640 1 --2- 172.21.15.32:0/1195417010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07f415a840 0x7f07f415f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:15.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.800+0000 7f07f8a00640 1 --2- 172.21.15.32:0/1195417010 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07f40aea70 0x7f07f415b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:15.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.800+0000 7f07f8a00640 1 --2- 172.21.15.32:0/1195417010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f406b450 0x7f07f41524a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:15.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.800+0000 7f07f8a00640 1 -- 172.21.15.32:0/1195417010 >> 172.21.15.32:0/1195417010 conn(0x7f07f40b1590 msgr2=0x7f07f40afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:15.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.800+0000 7f07f8a00640 1 -- 172.21.15.32:0/1195417010 shutdown_connections 2024-03-19T06:22:15.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.800+0000 7f07f8a00640 1 -- 172.21.15.32:0/1195417010 wait complete. 2024-03-19T06:22:15.817 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-19T06:22:15.817 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:22:15.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.968+0000 7f6556400640 1 Processor -- start 2024-03-19T06:22:15.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.968+0000 7f6556400640 1 -- start start 2024-03-19T06:22:15.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.972+0000 7f6556400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f65500cc680 0x7f655015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:15.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.972+0000 7f6556400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65500cb670 con 0x7f65500b4c50 2024-03-19T06:22:15.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.972+0000 7f6556400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65500cb950 con 0x7f655015a7c0 2024-03-19T06:22:15.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.972+0000 7f6556400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655015e860 con 0x7f65500cc680 2024-03-19T06:22:15.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.972+0000 7f6547e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f65500cc680 0x7f655015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:15.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.972+0000 7f6547e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f65500cc680 0x7f655015ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56610/0 (socket says 172.21.15.32:56610) 2024-03-19T06:22:15.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.972+0000 7f6547e00640 1 -- 172.21.15.32:0/2877187989 learned_addr learned my addr 172.21.15.32:0/2877187989 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:15.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.972+0000 7f6547e00640 1 -- 172.21.15.32:0/2877187989 >> v1:172.21.15.171:6789/0 conn(0x7f655015a7c0 legacy=0x7f65500cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:15.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.972+0000 7f6547e00640 1 -- 172.21.15.32:0/2877187989 >> v1:172.21.15.32:6789/0 conn(0x7f65500b4c50 legacy=0x7f65500cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:15.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.972+0000 7f6547e00640 1 -- 172.21.15.32:0/2877187989 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655015e4f0 con 0x7f65500cc680 2024-03-19T06:22:15.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.976+0000 7f6547e00640 1 --2- 172.21.15.32:0/2877187989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500cc680 0x7f655015ecf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6538009870 tx=0x7f653801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbdcd828f07e06a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:15.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.976+0000 7f654ea00640 1 -- 172.21.15.32:0/2877187989 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380a9400 con 0x7f65500cc680 2024-03-19T06:22:15.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.976+0000 7f654ea00640 1 -- 172.21.15.32:0/2877187989 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65380a95a0 con 0x7f65500cc680 2024-03-19T06:22:15.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.976+0000 7f654ea00640 1 -- 172.21.15.32:0/2877187989 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380a9970 con 0x7f65500cc680 2024-03-19T06:22:15.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.976+0000 7f6556400640 1 -- 172.21.15.32:0/2877187989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500cc680 msgr2=0x7f655015ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:15.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.976+0000 7f6556400640 1 --2- 172.21.15.32:0/2877187989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500cc680 0x7f655015ecf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6538009870 tx=0x7f653801c520 comp rx=0 tx=0).stop 2024-03-19T06:22:15.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.976+0000 7f6556400640 1 -- 172.21.15.32:0/2877187989 shutdown_connections 2024-03-19T06:22:15.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.976+0000 7f6556400640 1 --2- 172.21.15.32:0/2877187989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500cc680 0x7f655015ecf0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:15.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.976+0000 7f6556400640 1 -- 172.21.15.32:0/2877187989 >> 172.21.15.32:0/2877187989 conn(0x7f65500b1280 msgr2=0x7f65500b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:15.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.976+0000 7f6556400640 1 -- 172.21.15.32:0/2877187989 shutdown_connections 2024-03-19T06:22:15.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.976+0000 7f6556400640 1 -- 172.21.15.32:0/2877187989 wait complete. 2024-03-19T06:22:15.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.976+0000 7f6556400640 1 Processor -- start 2024-03-19T06:22:15.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.976+0000 7f6556400640 1 -- start start 2024-03-19T06:22:15.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f6556400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500b4c50 0x7f655014d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:15.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f6556400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65500cc680 0x7f65500c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:15.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f6556400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f655015a7c0 0x7f65500c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:15.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f6556400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65500cbdb0 con 0x7f65500b4c50 2024-03-19T06:22:15.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f6556400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65500cbc30 con 0x7f65500cc680 2024-03-19T06:22:15.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f6556400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6550169010 con 0x7f655015a7c0 2024-03-19T06:22:15.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f654f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500b4c50 0x7f655014d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:15.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f654f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500b4c50 0x7f655014d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56618/0 (socket says 172.21.15.32:56618) 2024-03-19T06:22:15.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f654f400640 1 -- 172.21.15.32:0/1955053630 learned_addr learned my addr 172.21.15.32:0/1955053630 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:15.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f6547e00640 1 --2- 172.21.15.32:0/1955053630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65500cc680 0x7f65500c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:15.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f654fe00640 1 --2- 172.21.15.32:0/1955053630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f655015a7c0 0x7f65500c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:15.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f654f400640 1 -- 172.21.15.32:0/1955053630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f655015a7c0 msgr2=0x7f65500c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:15.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f654f400640 1 --2- 172.21.15.32:0/1955053630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f655015a7c0 0x7f65500c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:15.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f654f400640 1 -- 172.21.15.32:0/1955053630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65500cc680 msgr2=0x7f65500c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:15.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f654f400640 1 --2- 172.21.15.32:0/1955053630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65500cc680 0x7f65500c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:15.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f654f400640 1 -- 172.21.15.32:0/1955053630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655013a5c0 con 0x7f65500b4c50 2024-03-19T06:22:15.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f654fe00640 1 --2- 172.21.15.32:0/1955053630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f655015a7c0 0x7f65500c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:15.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f654f400640 1 --2- 172.21.15.32:0/1955053630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500b4c50 0x7f655014d1b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f654000c450 tx=0x7f654000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:15.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f6547400640 1 -- 172.21.15.32:0/1955053630 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540012830 con 0x7f65500b4c50 2024-03-19T06:22:15.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f6547400640 1 -- 172.21.15.32:0/1955053630 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6540017070 con 0x7f65500b4c50 2024-03-19T06:22:15.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f6556400640 1 -- 172.21.15.32:0/1955053630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655013a8a0 con 0x7f65500b4c50 2024-03-19T06:22:15.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f6547400640 1 -- 172.21.15.32:0/1955053630 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540012c30 con 0x7f65500b4c50 2024-03-19T06:22:15.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f6556400640 1 -- 172.21.15.32:0/1955053630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655013ae60 con 0x7f65500b4c50 2024-03-19T06:22:15.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f6556400640 1 -- 172.21.15.32:0/1955053630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65500749e0 con 0x7f65500b4c50 2024-03-19T06:22:15.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.980+0000 7f6547400640 1 -- 172.21.15.32:0/1955053630 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f654001c460 con 0x7f65500b4c50 2024-03-19T06:22:15.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.984+0000 7f6547400640 1 --2- 172.21.15.32:0/1955053630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f652c067690 0x7f652c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:15.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.984+0000 7f6547400640 1 -- 172.21.15.32:0/1955053630 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6540085570 con 0x7f65500b4c50 2024-03-19T06:22:15.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.984+0000 7f6547e00640 1 --2- 172.21.15.32:0/1955053630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f652c067690 0x7f652c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:15.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.984+0000 7f6547e00640 1 --2- 172.21.15.32:0/1955053630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f652c067690 0x7f652c069b50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f65380ae000 tx=0x7f65380b3040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:15.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:15.988+0000 7f6547400640 1 -- 172.21.15.32:0/1955053630 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f65400561e0 con 0x7f65500b4c50 2024-03-19T06:22:16.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.188+0000 7f6556400640 1 -- 172.21.15.32:0/1955053630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65500cc270 con 0x7f65500b4c50 2024-03-19T06:22:16.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.188+0000 7f6547400640 1 -- 172.21.15.32:0/1955053630 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f6540083e20 con 0x7f65500b4c50 2024-03-19T06:22:16.180 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:16.180 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3394778234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3394778234},{"type":"v1","addr":"172.21.15.171:6836","nonce":3394778234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2000291327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2000291327},{"type":"v1","addr":"172.21.15.171:6837","nonce":2000291327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/4039299860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":4039299860},{"type":"v1","addr":"172.21.15.32:6833","nonce":4039299860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:22:12.167128+0000","modified":"2024-03-19T06:22:15.191629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/2680502611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":2680502611},{"type":"v1","addr":"172.21.15.32:6835","nonce":2680502611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-19T06:22:16.180 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 17 2024-03-19T06:22:16.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.188+0000 7f6556400640 1 -- 172.21.15.32:0/1955053630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f652c067690 msgr2=0x7f652c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:16.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.188+0000 7f6556400640 1 --2- 172.21.15.32:0/1955053630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f652c067690 0x7f652c069b50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f65380ae000 tx=0x7f65380b3040 comp rx=0 tx=0).stop 2024-03-19T06:22:16.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.188+0000 7f6556400640 1 -- 172.21.15.32:0/1955053630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500b4c50 msgr2=0x7f655014d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:16.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.188+0000 7f6556400640 1 --2- 172.21.15.32:0/1955053630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500b4c50 0x7f655014d1b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f654000c450 tx=0x7f654000c910 comp rx=0 tx=0).stop 2024-03-19T06:22:16.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.188+0000 7f6556400640 1 -- 172.21.15.32:0/1955053630 shutdown_connections 2024-03-19T06:22:16.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.188+0000 7f6556400640 1 --2- 172.21.15.32:0/1955053630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f652c067690 0x7f652c069b50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.188+0000 7f6556400640 1 --2- 172.21.15.32:0/1955053630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f655015a7c0 0x7f65500c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.188+0000 7f6556400640 1 --2- 172.21.15.32:0/1955053630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65500cc680 0x7f65500c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.188+0000 7f6556400640 1 --2- 172.21.15.32:0/1955053630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65500b4c50 0x7f655014d1b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.188+0000 7f6556400640 1 -- 172.21.15.32:0/1955053630 >> 172.21.15.32:0/1955053630 conn(0x7f65500b1280 msgr2=0x7f65500caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:16.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.188+0000 7f6556400640 1 -- 172.21.15.32:0/1955053630 shutdown_connections 2024-03-19T06:22:16.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.188+0000 7f6556400640 1 -- 172.21.15.32:0/1955053630 wait complete. 2024-03-19T06:22:16.201 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:22:16.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.348+0000 7ff9bc400640 1 Processor -- start 2024-03-19T06:22:16.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.348+0000 7ff9bc400640 1 -- start start 2024-03-19T06:22:16.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.352+0000 7ff9bc400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9b4161270 0x7ff9b40ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:16.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.352+0000 7ff9bc400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff9b40cc2e0 0x7ff9b40cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:16.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.352+0000 7ff9bc400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b406ad40 con 0x7ff9b40cfa70 2024-03-19T06:22:16.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.352+0000 7ff9bc400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b406b020 con 0x7ff9b40cc2e0 2024-03-19T06:22:16.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.352+0000 7ff9bc400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b406b300 con 0x7ff9b4161270 2024-03-19T06:22:16.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.352+0000 7ff9ba400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff9b40cc2e0 0x7ff9b40cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:16.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.352+0000 7ff9ba400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff9b40cc2e0 0x7ff9b40cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56628/0 (socket says 172.21.15.32:56628) 2024-03-19T06:22:16.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.352+0000 7ff9ba400640 1 -- 172.21.15.32:0/2810281584 learned_addr learned my addr 172.21.15.32:0/2810281584 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:16.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.352+0000 7ff9b9a00640 1 --2- 172.21.15.32:0/2810281584 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9b4161270 0x7ff9b40ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:16.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.352+0000 7ff9ba400640 1 -- 172.21.15.32:0/2810281584 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9b4161270 msgr2=0x7ff9b40ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:16.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.352+0000 7ff9ba400640 1 --2- 172.21.15.32:0/2810281584 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9b4161270 0x7ff9b40ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.352+0000 7ff9ba400640 1 -- 172.21.15.32:0/2810281584 >> v1:172.21.15.171:6789/0 conn(0x7ff9b40cfa70 legacy=0x7ff9b40cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:16.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.352+0000 7ff9ba400640 1 -- 172.21.15.32:0/2810281584 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b406b5e0 con 0x7ff9b40cc2e0 2024-03-19T06:22:16.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.356+0000 7ff9ba400640 1 --2- 172.21.15.32:0/2810281584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40cc2e0 0x7ff9b40cc950 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009e50 tx=0x7ff9ac01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b450ea51874e3635 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:16.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.356+0000 7ff9b3e00640 1 -- 172.21.15.32:0/2810281584 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0a5810 con 0x7ff9b40cc2e0 2024-03-19T06:22:16.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.356+0000 7ff9b3e00640 1 -- 172.21.15.32:0/2810281584 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac0a59b0 con 0x7ff9b40cc2e0 2024-03-19T06:22:16.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.356+0000 7ff9b3e00640 1 -- 172.21.15.32:0/2810281584 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0a5d80 con 0x7ff9b40cc2e0 2024-03-19T06:22:16.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.356+0000 7ff9bc400640 1 -- 172.21.15.32:0/2810281584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40cc2e0 msgr2=0x7ff9b40cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:16.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.356+0000 7ff9bc400640 1 --2- 172.21.15.32:0/2810281584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40cc2e0 0x7ff9b40cc950 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009e50 tx=0x7ff9ac01ca30 comp rx=0 tx=0).stop 2024-03-19T06:22:16.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.356+0000 7ff9bc400640 1 -- 172.21.15.32:0/2810281584 shutdown_connections 2024-03-19T06:22:16.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.356+0000 7ff9bc400640 1 --2- 172.21.15.32:0/2810281584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40cc2e0 0x7ff9b40cc950 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.356+0000 7ff9bc400640 1 --2- 172.21.15.32:0/2810281584 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9b4161270 0x7ff9b40ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.356+0000 7ff9bc400640 1 -- 172.21.15.32:0/2810281584 >> 172.21.15.32:0/2810281584 conn(0x7ff9b40b2250 msgr2=0x7ff9b40b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:16.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.356+0000 7ff9bc400640 1 -- 172.21.15.32:0/2810281584 shutdown_connections 2024-03-19T06:22:16.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.356+0000 7ff9bc400640 1 -- 172.21.15.32:0/2810281584 wait complete. 2024-03-19T06:22:16.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.356+0000 7ff9bc400640 1 Processor -- start 2024-03-19T06:22:16.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.356+0000 7ff9bc400640 1 -- start start 2024-03-19T06:22:16.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9bc400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9b40cc2e0 0x7ff9b40c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9bc400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40cfa70 0x7ff9b40c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9bc400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9b4161270 0x7ff9b4152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9bc400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b40cda30 con 0x7ff9b40cfa70 2024-03-19T06:22:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9bc400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b40cd8b0 con 0x7ff9b4161270 2024-03-19T06:22:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9bc400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b40cdbb0 con 0x7ff9b40cc2e0 2024-03-19T06:22:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9b9000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40cfa70 0x7ff9b40c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9b9000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40cfa70 0x7ff9b40c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56638/0 (socket says 172.21.15.32:56638) 2024-03-19T06:22:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9b9a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9b40cc2e0 0x7ff9b40c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9b9000640 1 -- 172.21.15.32:0/3682219451 learned_addr learned my addr 172.21.15.32:0/3682219451 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9ba400640 1 --2- 172.21.15.32:0/3682219451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9b4161270 0x7ff9b4152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:16.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9b9000640 1 -- 172.21.15.32:0/3682219451 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9b40cc2e0 msgr2=0x7ff9b40c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:16.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9b9000640 1 --2- 172.21.15.32:0/3682219451 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9b40cc2e0 0x7ff9b40c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9b9000640 1 -- 172.21.15.32:0/3682219451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9b4161270 msgr2=0x7ff9b4152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:16.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9b9000640 1 --2- 172.21.15.32:0/3682219451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9b4161270 0x7ff9b4152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9b9000640 1 -- 172.21.15.32:0/3682219451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b40b3700 con 0x7ff9b40cfa70 2024-03-19T06:22:16.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9b9000640 1 --2- 172.21.15.32:0/3682219451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40cfa70 0x7ff9b40c7790 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000c500 tx=0x7ff9a000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:16.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9b1600640 1 -- 172.21.15.32:0/3682219451 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0016020 con 0x7ff9b40cfa70 2024-03-19T06:22:16.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9b1600640 1 -- 172.21.15.32:0/3682219451 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a0005220 con 0x7ff9b40cfa70 2024-03-19T06:22:16.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9bc400640 1 -- 172.21.15.32:0/3682219451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b4157c80 con 0x7ff9b40cfa70 2024-03-19T06:22:16.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9b1600640 1 -- 172.21.15.32:0/3682219451 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0007030 con 0x7ff9b40cfa70 2024-03-19T06:22:16.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9bc400640 1 -- 172.21.15.32:0/3682219451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b4158240 con 0x7ff9b40cfa70 2024-03-19T06:22:16.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9bc400640 1 -- 172.21.15.32:0/3682219451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b40749e0 con 0x7ff9b40cfa70 2024-03-19T06:22:16.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.360+0000 7ff9b1600640 1 -- 172.21.15.32:0/3682219451 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff9a00071d0 con 0x7ff9b40cfa70 2024-03-19T06:22:16.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.364+0000 7ff9b1600640 1 --2- 172.21.15.32:0/3682219451 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff994067660 0x7ff994069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:16.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.364+0000 7ff9b1600640 1 -- 172.21.15.32:0/3682219451 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9a0085210 con 0x7ff9b40cfa70 2024-03-19T06:22:16.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.364+0000 7ff9b9a00640 1 --2- 172.21.15.32:0/3682219451 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff994067660 0x7ff994069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:16.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.364+0000 7ff9b9a00640 1 --2- 172.21.15.32:0/3682219451 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff994067660 0x7ff994069b20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009b60 tx=0x7ff9a8009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:16.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.368+0000 7ff9b1600640 1 -- 172.21.15.32:0/3682219451 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7ff9a0020020 con 0x7ff9b40cfa70 2024-03-19T06:22:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.528+0000 7ff9bc400640 1 -- 172.21.15.32:0/3682219451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9b415f950 con 0x7ff9b40cfa70 2024-03-19T06:22:16.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.532+0000 7ff9b1600640 1 -- 172.21.15.32:0/3682219451 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16681 (secure 0 0 0) 0x7ff9a00074c0 con 0x7ff9b40cfa70 2024-03-19T06:22:16.523 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:16.523 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":35,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:22:13.777956+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:22:09.983589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-19T06:22:11.172289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:22:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.532+0000 7ff9bc400640 1 -- 172.21.15.32:0/3682219451 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff994067660 msgr2=0x7ff994069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.532+0000 7ff9bc400640 1 --2- 172.21.15.32:0/3682219451 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff994067660 0x7ff994069b20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009b60 tx=0x7ff9a8009190 comp rx=0 tx=0).stop 2024-03-19T06:22:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.532+0000 7ff9bc400640 1 -- 172.21.15.32:0/3682219451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40cfa70 msgr2=0x7ff9b40c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.532+0000 7ff9bc400640 1 --2- 172.21.15.32:0/3682219451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40cfa70 0x7ff9b40c7790 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000c500 tx=0x7ff9a000c9c0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.532+0000 7ff9bc400640 1 -- 172.21.15.32:0/3682219451 shutdown_connections 2024-03-19T06:22:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.532+0000 7ff9bc400640 1 --2- 172.21.15.32:0/3682219451 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff994067660 0x7ff994069b20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.532+0000 7ff9bc400640 1 --2- 172.21.15.32:0/3682219451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9b4161270 0x7ff9b4152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.532+0000 7ff9bc400640 1 --2- 172.21.15.32:0/3682219451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40cfa70 0x7ff9b40c7790 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.532+0000 7ff9bc400640 1 --2- 172.21.15.32:0/3682219451 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9b40cc2e0 0x7ff9b40c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.532+0000 7ff9bc400640 1 -- 172.21.15.32:0/3682219451 >> 172.21.15.32:0/3682219451 conn(0x7ff9b40b2250 msgr2=0x7ff9b406f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.532+0000 7ff9bc400640 1 -- 172.21.15.32:0/3682219451 shutdown_connections 2024-03-19T06:22:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.532+0000 7ff9bc400640 1 -- 172.21.15.32:0/3682219451 wait complete. 2024-03-19T06:22:16.544 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-19T06:22:16.544 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:22:16.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.692+0000 7fcbbf000640 1 Processor -- start 2024-03-19T06:22:16.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.692+0000 7fcbbf000640 1 -- start start 2024-03-19T06:22:16.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.692+0000 7fcbbf000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb80cc600 0x7fcbb80ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:16.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.692+0000 7fcbbf000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb8162520 con 0x7fcbb80cc220 2024-03-19T06:22:16.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.692+0000 7fcbbf000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb8071ee0 con 0x7fcbb80717b0 2024-03-19T06:22:16.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.692+0000 7fcbbf000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb81616a0 con 0x7fcbb80cc600 2024-03-19T06:22:16.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.692+0000 7fcbb7e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcbb80cc220 0x7fcbb8161e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60906/0 (socket says 172.21.15.32:60906) 2024-03-19T06:22:16.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.692+0000 7fcbb7e00640 1 -- 172.21.15.32:0/2806841118 learned_addr learned my addr 172.21.15.32:0/2806841118 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:16.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.696+0000 7fcbafe00640 1 --2- 172.21.15.32:0/2806841118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb80cc600 0x7fcbb80ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:16.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.696+0000 7fcbb7400640 1 -- 172.21.15.32:0/2806841118 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866945108 0 0) 0x7fcbb8162520 con 0x7fcbb80cc220 2024-03-19T06:22:16.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.696+0000 7fcbb7400640 1 -- 172.21.15.32:0/2806841118 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb9c003530 con 0x7fcbb80cc220 2024-03-19T06:22:16.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.696+0000 7fcbb7400640 1 -- 172.21.15.32:0/2806841118 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718180911 0 0) 0x7fcbb8071ee0 con 0x7fcbb80717b0 2024-03-19T06:22:16.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.696+0000 7fcbb7400640 1 -- 172.21.15.32:0/2806841118 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbb8162520 con 0x7fcbb80717b0 2024-03-19T06:22:16.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.696+0000 7fcbb7400640 1 -- 172.21.15.32:0/2806841118 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 632562518 0 0) 0x7fcb9c003530 con 0x7fcbb80cc220 2024-03-19T06:22:16.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.696+0000 7fcbafe00640 1 -- 172.21.15.32:0/2806841118 >> v1:172.21.15.171:6789/0 conn(0x7fcbb80717b0 legacy=0x7fcbb80cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:16.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.696+0000 7fcbafe00640 1 -- 172.21.15.32:0/2806841118 >> v1:172.21.15.32:6789/0 conn(0x7fcbb80cc220 legacy=0x7fcbb8161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:16.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.696+0000 7fcbafe00640 1 -- 172.21.15.32:0/2806841118 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb80721c0 con 0x7fcbb80cc600 2024-03-19T06:22:16.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.696+0000 7fcbafe00640 1 --2- 172.21.15.32:0/2806841118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb80cc600 0x7fcbb80ceff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcba00097f0 tx=0x7fcba001c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eed336611e01992 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:16.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.696+0000 7fcbb7400640 1 -- 172.21.15.32:0/2806841118 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba00b0070 con 0x7fcbb80cc600 2024-03-19T06:22:16.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.696+0000 7fcbb7400640 1 -- 172.21.15.32:0/2806841118 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba00ab400 con 0x7fcbb80cc600 2024-03-19T06:22:16.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.696+0000 7fcbb7400640 1 -- 172.21.15.32:0/2806841118 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba8001680 con 0x7fcbb80cc600 2024-03-19T06:22:16.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbf000640 1 -- 172.21.15.32:0/2806841118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb80cc600 msgr2=0x7fcbb80ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:16.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbf000640 1 --2- 172.21.15.32:0/2806841118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb80cc600 0x7fcbb80ceff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcba00097f0 tx=0x7fcba001c340 comp rx=0 tx=0).stop 2024-03-19T06:22:16.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbf000640 1 -- 172.21.15.32:0/2806841118 shutdown_connections 2024-03-19T06:22:16.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbf000640 1 --2- 172.21.15.32:0/2806841118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb80cc600 0x7fcbb80ceff0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbf000640 1 -- 172.21.15.32:0/2806841118 >> 172.21.15.32:0/2806841118 conn(0x7fcbb80b1280 msgr2=0x7fcbb80b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:16.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbf000640 1 -- 172.21.15.32:0/2806841118 shutdown_connections 2024-03-19T06:22:16.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbf000640 1 -- 172.21.15.32:0/2806841118 wait complete. 2024-03-19T06:22:16.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbf000640 1 Processor -- start 2024-03-19T06:22:16.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbf000640 1 -- start start 2024-03-19T06:22:16.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbf000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbb80717b0 0x7fcbb813d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:16.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbf000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb80cc220 0x7fcbb81442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:16.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbf000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cc600 0x7fcbb813e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:16.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbf000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb80cda10 con 0x7fcbb80cc600 2024-03-19T06:22:16.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbf000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb80cd890 con 0x7fcbb80717b0 2024-03-19T06:22:16.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbf000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb816ba50 con 0x7fcbb80cc220 2024-03-19T06:22:16.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbd000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cc600 0x7fcbb813e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:16.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbd000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cc600 0x7fcbb813e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56650/0 (socket says 172.21.15.32:56650) 2024-03-19T06:22:16.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbd000640 1 -- 172.21.15.32:0/204313871 learned_addr learned my addr 172.21.15.32:0/204313871 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:16.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbb7e00640 1 --2- 172.21.15.32:0/204313871 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbb80717b0 0x7fcbb813d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:16.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbafe00640 1 --2- 172.21.15.32:0/204313871 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb80cc220 0x7fcbb81442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:16.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbd000640 1 -- 172.21.15.32:0/204313871 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb80cc220 msgr2=0x7fcbb81442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:16.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbd000640 1 --2- 172.21.15.32:0/204313871 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb80cc220 0x7fcbb81442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbd000640 1 -- 172.21.15.32:0/204313871 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbb80717b0 msgr2=0x7fcbb813d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:16.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbd000640 1 --2- 172.21.15.32:0/204313871 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbb80717b0 0x7fcbb813d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.700+0000 7fcbbd000640 1 -- 172.21.15.32:0/204313871 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb815fe10 con 0x7fcbb80cc600 2024-03-19T06:22:16.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.704+0000 7fcbbd000640 1 --2- 172.21.15.32:0/204313871 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cc600 0x7fcbb813e840 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000c760 tx=0x7fcbb000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:16.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.704+0000 7fcbb4c00640 1 -- 172.21.15.32:0/204313871 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0003b80 con 0x7fcbb80cc600 2024-03-19T06:22:16.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.704+0000 7fcbb4c00640 1 -- 172.21.15.32:0/204313871 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb0003d20 con 0x7fcbb80cc600 2024-03-19T06:22:16.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.704+0000 7fcbb4c00640 1 -- 172.21.15.32:0/204313871 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb000aa90 con 0x7fcbb80cc600 2024-03-19T06:22:16.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.704+0000 7fcbbf000640 1 -- 172.21.15.32:0/204313871 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb81600f0 con 0x7fcbb80cc600 2024-03-19T06:22:16.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.704+0000 7fcbbf000640 1 -- 172.21.15.32:0/204313871 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb81606b0 con 0x7fcbb80cc600 2024-03-19T06:22:16.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.704+0000 7fcbbf000640 1 -- 172.21.15.32:0/204313871 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb80749e0 con 0x7fcbb80cc600 2024-03-19T06:22:16.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.704+0000 7fcbb4c00640 1 -- 172.21.15.32:0/204313871 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fcbb000ac30 con 0x7fcbb80cc600 2024-03-19T06:22:16.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.704+0000 7fcbb4c00640 1 --2- 172.21.15.32:0/204313871 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcb94067660 0x7fcb94069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:16.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.704+0000 7fcbb4c00640 1 -- 172.21.15.32:0/204313871 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbb00857e0 con 0x7fcbb80cc600 2024-03-19T06:22:16.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.704+0000 7fcbb7e00640 1 --2- 172.21.15.32:0/204313871 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcb94067660 0x7fcb94069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:16.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.708+0000 7fcbb7e00640 1 --2- 172.21.15.32:0/204313871 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcb94067660 0x7fcb94069b20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcba80011f0 tx=0x7fcba8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:16.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.708+0000 7fcbb4c00640 1 -- 172.21.15.32:0/204313871 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fcbb0056450 con 0x7fcbb80cc600 2024-03-19T06:22:16.723 INFO:tasks.ceph.mds.c.smithi032.stderr:2024-03-19T06:22:16.732+0000 7f1fdfe00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-19T06:22:16.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.876+0000 7fcbbf000640 1 -- 172.21.15.32:0/204313871 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbb8161410 con 0x7fcb94067660 2024-03-19T06:22:16.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.884+0000 7fcbb4c00640 1 -- 172.21.15.32:0/204313871 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243736 (secure 0 0 0) 0x7fcbb8161410 con 0x7fcb94067660 2024-03-19T06:22:16.879 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:16.880 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:22:16.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.888+0000 7fcbbf000640 1 -- 172.21.15.32:0/204313871 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcb94067660 msgr2=0x7fcb94069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:16.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.888+0000 7fcbbf000640 1 --2- 172.21.15.32:0/204313871 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcb94067660 0x7fcb94069b20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcba80011f0 tx=0x7fcba8009040 comp rx=0 tx=0).stop 2024-03-19T06:22:16.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.888+0000 7fcbbf000640 1 -- 172.21.15.32:0/204313871 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cc600 msgr2=0x7fcbb813e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:16.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.888+0000 7fcbbf000640 1 --2- 172.21.15.32:0/204313871 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cc600 0x7fcbb813e840 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000c760 tx=0x7fcbb000cc20 comp rx=0 tx=0).stop 2024-03-19T06:22:16.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.888+0000 7fcbbf000640 1 -- 172.21.15.32:0/204313871 shutdown_connections 2024-03-19T06:22:16.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.888+0000 7fcbbf000640 1 --2- 172.21.15.32:0/204313871 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcb94067660 0x7fcb94069b20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.888+0000 7fcbbf000640 1 --2- 172.21.15.32:0/204313871 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cc600 0x7fcbb813e840 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.888+0000 7fcbbf000640 1 --2- 172.21.15.32:0/204313871 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb80cc220 0x7fcbb81442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.888+0000 7fcbbf000640 1 --2- 172.21.15.32:0/204313871 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbb80717b0 0x7fcbb813d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:16.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.888+0000 7fcbbf000640 1 -- 172.21.15.32:0/204313871 >> 172.21.15.32:0/204313871 conn(0x7fcbb80b1280 msgr2=0x7fcbb80b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:16.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.888+0000 7fcbbf000640 1 -- 172.21.15.32:0/204313871 shutdown_connections 2024-03-19T06:22:16.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:16.888+0000 7fcbbf000640 1 -- 172.21.15.32:0/204313871 wait complete. 2024-03-19T06:22:16.899 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-03-19T06:22:15.935625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592084,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236812,"kb_used_data":3960,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737908,"statfs":{"total":773094113280,"available":772851617792,"internally_reserved":0,"allocated":4055040,"data_stored":2263410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1716,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.170008"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782830+0000","last_change":"2024-03-19T06:22:12.813377+0000","last_active":"2024-03-19T06:22:13.782830+0000","last_peered":"2024-03-19T06:22:13.782830+0000","last_clean":"2024-03-19T06:22:13.782830+0000","last_became_active":"2024-03-19T06:22:12.810137+0000","last_became_peered":"2024-03-19T06:22:12.810137+0000","last_unstale":"2024-03-19T06:22:13.782830+0000","last_undegraded":"2024-03-19T06:22:13.782830+0000","last_fullsized":"2024-03-19T06:22:13.782830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:54:53.123082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782288+0000","last_change":"2024-03-19T06:22:12.802790+0000","last_active":"2024-03-19T06:22:13.782288+0000","last_peered":"2024-03-19T06:22:13.782288+0000","last_clean":"2024-03-19T06:22:13.782288+0000","last_became_active":"2024-03-19T06:22:12.800768+0000","last_became_peered":"2024-03-19T06:22:12.800768+0000","last_unstale":"2024-03-19T06:22:13.782288+0000","last_undegraded":"2024-03-19T06:22:13.782288+0000","last_fullsized":"2024-03-19T06:22:13.782288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:53:16.147110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950048+0000","last_change":"2024-03-19T06:22:12.819459+0000","last_active":"2024-03-19T06:22:13.950048+0000","last_peered":"2024-03-19T06:22:13.950048+0000","last_clean":"2024-03-19T06:22:13.950048+0000","last_became_active":"2024-03-19T06:22:12.819097+0000","last_became_peered":"2024-03-19T06:22:12.819097+0000","last_unstale":"2024-03-19T06:22:13.950048+0000","last_undegraded":"2024-03-19T06:22:13.950048+0000","last_fullsized":"2024-03-19T06:22:13.950048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:28:58.380767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782427+0000","last_change":"2024-03-19T06:22:12.799728+0000","last_active":"2024-03-19T06:22:13.782427+0000","last_peered":"2024-03-19T06:22:13.782427+0000","last_clean":"2024-03-19T06:22:13.782427+0000","last_became_active":"2024-03-19T06:22:12.799510+0000","last_became_peered":"2024-03-19T06:22:12.799510+0000","last_unstale":"2024-03-19T06:22:13.782427+0000","last_undegraded":"2024-03-19T06:22:13.782427+0000","last_fullsized":"2024-03-19T06:22:13.782427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:49:46.460288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782823+0000","last_change":"2024-03-19T06:22:12.801364+0000","last_active":"2024-03-19T06:22:13.782823+0000","last_peered":"2024-03-19T06:22:13.782823+0000","last_clean":"2024-03-19T06:22:13.782823+0000","last_became_active":"2024-03-19T06:22:12.801016+0000","last_became_peered":"2024-03-19T06:22:12.801016+0000","last_unstale":"2024-03-19T06:22:13.782823+0000","last_undegraded":"2024-03-19T06:22:13.782823+0000","last_fullsized":"2024-03-19T06:22:13.782823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:36:02.560779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782657+0000","last_change":"2024-03-19T06:22:12.799453+0000","last_active":"2024-03-19T06:22:13.782657+0000","last_peered":"2024-03-19T06:22:13.782657+0000","last_clean":"2024-03-19T06:22:13.782657+0000","last_became_active":"2024-03-19T06:22:12.799175+0000","last_became_peered":"2024-03-19T06:22:12.799175+0000","last_unstale":"2024-03-19T06:22:13.782657+0000","last_undegraded":"2024-03-19T06:22:13.782657+0000","last_fullsized":"2024-03-19T06:22:13.782657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:19:47.036468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949442+0000","last_change":"2024-03-19T06:22:12.811038+0000","last_active":"2024-03-19T06:22:13.949442+0000","last_peered":"2024-03-19T06:22:13.949442+0000","last_clean":"2024-03-19T06:22:13.949442+0000","last_became_active":"2024-03-19T06:22:12.810750+0000","last_became_peered":"2024-03-19T06:22:12.810750+0000","last_unstale":"2024-03-19T06:22:13.949442+0000","last_undegraded":"2024-03-19T06:22:13.949442+0000","last_fullsized":"2024-03-19T06:22:13.949442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:15:49.184635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949569+0000","last_change":"2024-03-19T06:22:12.808465+0000","last_active":"2024-03-19T06:22:13.949569+0000","last_peered":"2024-03-19T06:22:13.949569+0000","last_clean":"2024-03-19T06:22:13.949569+0000","last_became_active":"2024-03-19T06:22:12.808155+0000","last_became_peered":"2024-03-19T06:22:12.808155+0000","last_unstale":"2024-03-19T06:22:13.949569+0000","last_undegraded":"2024-03-19T06:22:13.949569+0000","last_fullsized":"2024-03-19T06:22:13.949569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:07:58.346504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782901+0000","last_change":"2024-03-19T06:22:12.813107+0000","last_active":"2024-03-19T06:22:13.782901+0000","last_peered":"2024-03-19T06:22:13.782901+0000","last_clean":"2024-03-19T06:22:13.782901+0000","last_became_active":"2024-03-19T06:22:12.812747+0000","last_became_peered":"2024-03-19T06:22:12.812747+0000","last_unstale":"2024-03-19T06:22:13.782901+0000","last_undegraded":"2024-03-19T06:22:13.782901+0000","last_fullsized":"2024-03-19T06:22:13.782901+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:32.790613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949639+0000","last_change":"2024-03-19T06:22:12.807735+0000","last_active":"2024-03-19T06:22:13.949639+0000","last_peered":"2024-03-19T06:22:13.949639+0000","last_clean":"2024-03-19T06:22:13.949639+0000","last_became_active":"2024-03-19T06:22:12.807440+0000","last_became_peered":"2024-03-19T06:22:12.807440+0000","last_unstale":"2024-03-19T06:22:13.949639+0000","last_undegraded":"2024-03-19T06:22:13.949639+0000","last_fullsized":"2024-03-19T06:22:13.949639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:36:33.458254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.771812+0000","last_change":"2024-03-19T06:22:10.771812+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.771812+0000","last_undegraded":"2024-03-19T06:22:10.771812+0000","last_fullsized":"2024-03-19T06:22:10.771812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.767905+0000","last_change":"2024-03-19T06:22:10.767905+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.767905+0000","last_undegraded":"2024-03-19T06:22:10.767905+0000","last_fullsized":"2024-03-19T06:22:10.767905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950121+0000","last_change":"2024-03-19T06:22:12.806044+0000","last_active":"2024-03-19T06:22:13.950121+0000","last_peered":"2024-03-19T06:22:13.950121+0000","last_clean":"2024-03-19T06:22:13.950121+0000","last_became_active":"2024-03-19T06:22:12.805753+0000","last_became_peered":"2024-03-19T06:22:12.805753+0000","last_unstale":"2024-03-19T06:22:13.950121+0000","last_undegraded":"2024-03-19T06:22:13.950121+0000","last_fullsized":"2024-03-19T06:22:13.950121+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:45:02.480430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782617+0000","last_change":"2024-03-19T06:22:11.782865+0000","last_active":"2024-03-19T06:22:13.782617+0000","last_peered":"2024-03-19T06:22:13.782617+0000","last_clean":"2024-03-19T06:22:13.782617+0000","last_became_active":"2024-03-19T06:22:11.781430+0000","last_became_peered":"2024-03-19T06:22:11.781430+0000","last_unstale":"2024-03-19T06:22:13.782617+0000","last_undegraded":"2024-03-19T06:22:13.782617+0000","last_fullsized":"2024-03-19T06:22:13.782617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:23:11.347650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.770372+0000","last_change":"2024-03-19T06:22:10.770372+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.770372+0000","last_undegraded":"2024-03-19T06:22:10.770372+0000","last_fullsized":"2024-03-19T06:22:10.770372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949778+0000","last_change":"2024-03-19T06:22:11.792783+0000","last_active":"2024-03-19T06:22:13.949778+0000","last_peered":"2024-03-19T06:22:13.949778+0000","last_clean":"2024-03-19T06:22:13.949778+0000","last_became_active":"2024-03-19T06:22:11.791824+0000","last_became_peered":"2024-03-19T06:22:11.791824+0000","last_unstale":"2024-03-19T06:22:13.949778+0000","last_undegraded":"2024-03-19T06:22:13.949778+0000","last_fullsized":"2024-03-19T06:22:13.949778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:23:23.700595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949696+0000","last_change":"2024-03-19T06:22:11.796432+0000","last_active":"2024-03-19T06:22:13.949696+0000","last_peered":"2024-03-19T06:22:13.949696+0000","last_clean":"2024-03-19T06:22:13.949696+0000","last_became_active":"2024-03-19T06:22:11.794614+0000","last_became_peered":"2024-03-19T06:22:11.794614+0000","last_unstale":"2024-03-19T06:22:13.949696+0000","last_undegraded":"2024-03-19T06:22:13.949696+0000","last_fullsized":"2024-03-19T06:22:13.949696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:15:41.175621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949428+0000","last_change":"2024-03-19T06:22:12.804385+0000","last_active":"2024-03-19T06:22:13.949428+0000","last_peered":"2024-03-19T06:22:13.949428+0000","last_clean":"2024-03-19T06:22:13.949428+0000","last_became_active":"2024-03-19T06:22:12.804022+0000","last_became_peered":"2024-03-19T06:22:12.804022+0000","last_unstale":"2024-03-19T06:22:13.949428+0000","last_undegraded":"2024-03-19T06:22:13.949428+0000","last_fullsized":"2024-03-19T06:22:13.949428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:41:28.053793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782068+0000","last_change":"2024-03-19T06:22:11.785078+0000","last_active":"2024-03-19T06:22:13.782068+0000","last_peered":"2024-03-19T06:22:13.782068+0000","last_clean":"2024-03-19T06:22:13.782068+0000","last_became_active":"2024-03-19T06:22:11.783561+0000","last_became_peered":"2024-03-19T06:22:11.783561+0000","last_unstale":"2024-03-19T06:22:13.782068+0000","last_undegraded":"2024-03-19T06:22:13.782068+0000","last_fullsized":"2024-03-19T06:22:13.782068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:38:39.623722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949201+0000","last_change":"2024-03-19T06:22:11.796210+0000","last_active":"2024-03-19T06:22:13.949201+0000","last_peered":"2024-03-19T06:22:13.949201+0000","last_clean":"2024-03-19T06:22:13.949201+0000","last_became_active":"2024-03-19T06:22:11.795816+0000","last_became_peered":"2024-03-19T06:22:11.795816+0000","last_unstale":"2024-03-19T06:22:13.949201+0000","last_undegraded":"2024-03-19T06:22:13.949201+0000","last_fullsized":"2024-03-19T06:22:13.949201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:26:41.154332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782834+0000","last_change":"2024-03-19T06:22:11.797779+0000","last_active":"2024-03-19T06:22:13.782834+0000","last_peered":"2024-03-19T06:22:13.782834+0000","last_clean":"2024-03-19T06:22:13.782834+0000","last_became_active":"2024-03-19T06:22:11.797477+0000","last_became_peered":"2024-03-19T06:22:11.797477+0000","last_unstale":"2024-03-19T06:22:13.782834+0000","last_undegraded":"2024-03-19T06:22:13.782834+0000","last_fullsized":"2024-03-19T06:22:13.782834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:58:59.662492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782810+0000","last_change":"2024-03-19T06:22:12.801487+0000","last_active":"2024-03-19T06:22:13.782810+0000","last_peered":"2024-03-19T06:22:13.782810+0000","last_clean":"2024-03-19T06:22:13.782810+0000","last_became_active":"2024-03-19T06:22:12.801196+0000","last_became_peered":"2024-03-19T06:22:12.801196+0000","last_unstale":"2024-03-19T06:22:13.782810+0000","last_undegraded":"2024-03-19T06:22:13.782810+0000","last_fullsized":"2024-03-19T06:22:13.782810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:37:25.965590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.767410+0000","last_change":"2024-03-19T06:22:10.767410+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.767410+0000","last_undegraded":"2024-03-19T06:22:10.767410+0000","last_fullsized":"2024-03-19T06:22:10.767410+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782617+0000","last_change":"2024-03-19T06:22:12.814392+0000","last_active":"2024-03-19T06:22:13.782617+0000","last_peered":"2024-03-19T06:22:13.782617+0000","last_clean":"2024-03-19T06:22:13.782617+0000","last_became_active":"2024-03-19T06:22:12.813815+0000","last_became_peered":"2024-03-19T06:22:12.813815+0000","last_unstale":"2024-03-19T06:22:13.782617+0000","last_undegraded":"2024-03-19T06:22:13.782617+0000","last_fullsized":"2024-03-19T06:22:13.782617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:54:29.091078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.768049+0000","last_change":"2024-03-19T06:22:10.768049+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.768049+0000","last_undegraded":"2024-03-19T06:22:10.768049+0000","last_fullsized":"2024-03-19T06:22:10.768049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782699+0000","last_change":"2024-03-19T06:22:11.791858+0000","last_active":"2024-03-19T06:22:13.782699+0000","last_peered":"2024-03-19T06:22:13.782699+0000","last_clean":"2024-03-19T06:22:13.782699+0000","last_became_active":"2024-03-19T06:22:11.791423+0000","last_became_peered":"2024-03-19T06:22:11.791423+0000","last_unstale":"2024-03-19T06:22:13.782699+0000","last_undegraded":"2024-03-19T06:22:13.782699+0000","last_fullsized":"2024-03-19T06:22:13.782699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:15:48.178564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949920+0000","last_change":"2024-03-19T06:22:11.796046+0000","last_active":"2024-03-19T06:22:13.949920+0000","last_peered":"2024-03-19T06:22:13.949920+0000","last_clean":"2024-03-19T06:22:13.949920+0000","last_became_active":"2024-03-19T06:22:11.794808+0000","last_became_peered":"2024-03-19T06:22:11.794808+0000","last_unstale":"2024-03-19T06:22:13.949920+0000","last_undegraded":"2024-03-19T06:22:13.949920+0000","last_fullsized":"2024-03-19T06:22:13.949920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:52:11.332786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782532+0000","last_change":"2024-03-19T06:22:12.807613+0000","last_active":"2024-03-19T06:22:13.782532+0000","last_peered":"2024-03-19T06:22:13.782532+0000","last_clean":"2024-03-19T06:22:13.782532+0000","last_became_active":"2024-03-19T06:22:12.807323+0000","last_became_peered":"2024-03-19T06:22:12.807323+0000","last_unstale":"2024-03-19T06:22:13.782532+0000","last_undegraded":"2024-03-19T06:22:13.782532+0000","last_fullsized":"2024-03-19T06:22:13.782532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:34:23.250483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.770913+0000","last_change":"2024-03-19T06:22:10.770913+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.770913+0000","last_undegraded":"2024-03-19T06:22:10.770913+0000","last_fullsized":"2024-03-19T06:22:10.770913+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782082+0000","last_change":"2024-03-19T06:22:11.792957+0000","last_active":"2024-03-19T06:22:13.782082+0000","last_peered":"2024-03-19T06:22:13.782082+0000","last_clean":"2024-03-19T06:22:13.782082+0000","last_became_active":"2024-03-19T06:22:11.792682+0000","last_became_peered":"2024-03-19T06:22:11.792682+0000","last_unstale":"2024-03-19T06:22:13.782082+0000","last_undegraded":"2024-03-19T06:22:13.782082+0000","last_fullsized":"2024-03-19T06:22:13.782082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:24.575297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782011+0000","last_change":"2024-03-19T06:22:11.782315+0000","last_active":"2024-03-19T06:22:13.782011+0000","last_peered":"2024-03-19T06:22:13.782011+0000","last_clean":"2024-03-19T06:22:13.782011+0000","last_became_active":"2024-03-19T06:22:11.782022+0000","last_became_peered":"2024-03-19T06:22:11.782022+0000","last_unstale":"2024-03-19T06:22:13.782011+0000","last_undegraded":"2024-03-19T06:22:13.782011+0000","last_fullsized":"2024-03-19T06:22:13.782011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:59:59.683815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949806+0000","last_change":"2024-03-19T06:22:12.807959+0000","last_active":"2024-03-19T06:22:13.949806+0000","last_peered":"2024-03-19T06:22:13.949806+0000","last_clean":"2024-03-19T06:22:13.949806+0000","last_became_active":"2024-03-19T06:22:12.807622+0000","last_became_peered":"2024-03-19T06:22:12.807622+0000","last_unstale":"2024-03-19T06:22:13.949806+0000","last_undegraded":"2024-03-19T06:22:13.949806+0000","last_fullsized":"2024-03-19T06:22:13.949806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:59:00.668563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.771355+0000","last_change":"2024-03-19T06:22:10.771355+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.771355+0000","last_undegraded":"2024-03-19T06:22:10.771355+0000","last_fullsized":"2024-03-19T06:22:10.771355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949947+0000","last_change":"2024-03-19T06:22:11.789922+0000","last_active":"2024-03-19T06:22:13.949947+0000","last_peered":"2024-03-19T06:22:13.949947+0000","last_clean":"2024-03-19T06:22:13.949947+0000","last_became_active":"2024-03-19T06:22:11.789318+0000","last_became_peered":"2024-03-19T06:22:11.789318+0000","last_unstale":"2024-03-19T06:22:13.949947+0000","last_undegraded":"2024-03-19T06:22:13.949947+0000","last_fullsized":"2024-03-19T06:22:13.949947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:57:16.843221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950093+0000","last_change":"2024-03-19T06:22:11.792226+0000","last_active":"2024-03-19T06:22:13.950093+0000","last_peered":"2024-03-19T06:22:13.950093+0000","last_clean":"2024-03-19T06:22:13.950093+0000","last_became_active":"2024-03-19T06:22:11.791854+0000","last_became_peered":"2024-03-19T06:22:11.791854+0000","last_unstale":"2024-03-19T06:22:13.950093+0000","last_undegraded":"2024-03-19T06:22:13.950093+0000","last_fullsized":"2024-03-19T06:22:13.950093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:25:13.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949809+0000","last_change":"2024-03-19T06:22:11.792381+0000","last_active":"2024-03-19T06:22:13.949809+0000","last_peered":"2024-03-19T06:22:13.949809+0000","last_clean":"2024-03-19T06:22:13.949809+0000","last_became_active":"2024-03-19T06:22:11.792047+0000","last_became_peered":"2024-03-19T06:22:11.792047+0000","last_unstale":"2024-03-19T06:22:13.949809+0000","last_undegraded":"2024-03-19T06:22:13.949809+0000","last_fullsized":"2024-03-19T06:22:13.949809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:03:44.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.767402+0000","last_change":"2024-03-19T06:22:10.767402+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.767402+0000","last_undegraded":"2024-03-19T06:22:10.767402+0000","last_fullsized":"2024-03-19T06:22:10.767402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.771798+0000","last_change":"2024-03-19T06:22:10.771798+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.771798+0000","last_undegraded":"2024-03-19T06:22:10.771798+0000","last_fullsized":"2024-03-19T06:22:10.771798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949359+0000","last_change":"2024-03-19T06:22:11.794192+0000","last_active":"2024-03-19T06:22:13.949359+0000","last_peered":"2024-03-19T06:22:13.949359+0000","last_clean":"2024-03-19T06:22:13.949359+0000","last_became_active":"2024-03-19T06:22:11.793919+0000","last_became_peered":"2024-03-19T06:22:11.793919+0000","last_unstale":"2024-03-19T06:22:13.949359+0000","last_undegraded":"2024-03-19T06:22:13.949359+0000","last_fullsized":"2024-03-19T06:22:13.949359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:12:38.916099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.768039+0000","last_change":"2024-03-19T06:22:10.768039+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.768039+0000","last_undegraded":"2024-03-19T06:22:10.768039+0000","last_fullsized":"2024-03-19T06:22:10.768039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.770186+0000","last_change":"2024-03-19T06:22:10.770186+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.770186+0000","last_undegraded":"2024-03-19T06:22:10.770186+0000","last_fullsized":"2024-03-19T06:22:10.770186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.766840+0000","last_change":"2024-03-19T06:22:10.766840+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.766840+0000","last_undegraded":"2024-03-19T06:22:10.766840+0000","last_fullsized":"2024-03-19T06:22:10.766840+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.769623+0000","last_change":"2024-03-19T06:22:10.769623+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.769623+0000","last_undegraded":"2024-03-19T06:22:10.769623+0000","last_fullsized":"2024-03-19T06:22:10.769623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.766857+0000","last_change":"2024-03-19T06:22:10.766857+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.766857+0000","last_undegraded":"2024-03-19T06:22:10.766857+0000","last_fullsized":"2024-03-19T06:22:10.766857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.770464+0000","last_change":"2024-03-19T06:22:10.770464+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.770464+0000","last_undegraded":"2024-03-19T06:22:10.770464+0000","last_fullsized":"2024-03-19T06:22:10.770464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.781975+0000","last_change":"2024-03-19T06:22:12.798059+0000","last_active":"2024-03-19T06:22:13.781975+0000","last_peered":"2024-03-19T06:22:13.781975+0000","last_clean":"2024-03-19T06:22:13.781975+0000","last_became_active":"2024-03-19T06:22:12.797589+0000","last_became_peered":"2024-03-19T06:22:12.797589+0000","last_unstale":"2024-03-19T06:22:13.781975+0000","last_undegraded":"2024-03-19T06:22:13.781975+0000","last_fullsized":"2024-03-19T06:22:13.781975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:38.121363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949473+0000","last_change":"2024-03-19T06:22:11.781136+0000","last_active":"2024-03-19T06:22:13.949473+0000","last_peered":"2024-03-19T06:22:13.949473+0000","last_clean":"2024-03-19T06:22:13.949473+0000","last_became_active":"2024-03-19T06:22:11.780619+0000","last_became_peered":"2024-03-19T06:22:11.780619+0000","last_unstale":"2024-03-19T06:22:13.949473+0000","last_undegraded":"2024-03-19T06:22:13.949473+0000","last_fullsized":"2024-03-19T06:22:13.949473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:08:55.885727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949388+0000","last_change":"2024-03-19T06:22:12.800198+0000","last_active":"2024-03-19T06:22:13.949388+0000","last_peered":"2024-03-19T06:22:13.949388+0000","last_clean":"2024-03-19T06:22:13.949388+0000","last_became_active":"2024-03-19T06:22:12.799781+0000","last_became_peered":"2024-03-19T06:22:12.799781+0000","last_unstale":"2024-03-19T06:22:13.949388+0000","last_undegraded":"2024-03-19T06:22:13.949388+0000","last_fullsized":"2024-03-19T06:22:13.949388+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:14.509578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782072+0000","last_change":"2024-03-19T06:22:11.797400+0000","last_active":"2024-03-19T06:22:13.782072+0000","last_peered":"2024-03-19T06:22:13.782072+0000","last_clean":"2024-03-19T06:22:13.782072+0000","last_became_active":"2024-03-19T06:22:11.797126+0000","last_became_peered":"2024-03-19T06:22:11.797126+0000","last_unstale":"2024-03-19T06:22:13.782072+0000","last_undegraded":"2024-03-19T06:22:13.782072+0000","last_fullsized":"2024-03-19T06:22:13.782072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:13.503507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.772176+0000","last_change":"2024-03-19T06:22:10.772176+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.772176+0000","last_undegraded":"2024-03-19T06:22:10.772176+0000","last_fullsized":"2024-03-19T06:22:10.772176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:22:10.772060+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:22:10.772060+0000","last_peered":"2024-03-19T06:22:10.772060+0000","last_clean":"2024-03-19T06:22:10.772060+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:22:10.772060+0000","last_undegraded":"2024-03-19T06:22:10.772060+0000","last_fullsized":"2024-03-19T06:22:10.772060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1716,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":717741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":127373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":339968,"data_stored":127373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":133190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":133190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":933888,"data_stored":717741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":152636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":405504,"data_stored":154166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:22:16.904 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:22:17.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.088+0000 7f8c80800640 1 Processor -- start 2024-03-19T06:22:17.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.088+0000 7f8c80800640 1 -- start start 2024-03-19T06:22:17.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c80800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c780aecf0 0x7f8c780ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c80800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8c7806d6c0 0x7f8c7806db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c80800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7815fe20 con 0x7f8c7815c010 2024-03-19T06:22:17.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c80800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7806e070 con 0x7f8c7806d6c0 2024-03-19T06:22:17.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c80800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c781603e0 con 0x7f8c780aecf0 2024-03-19T06:22:17.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7d400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8c7815c010 0x7f8c7815f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60912/0 (socket says 172.21.15.32:60912) 2024-03-19T06:22:17.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7d400640 1 -- 172.21.15.32:0/2933548230 learned_addr learned my addr 172.21.15.32:0/2933548230 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:17.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7de00640 1 --2- 172.21.15.32:0/2933548230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c780aecf0 0x7f8c780ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7e800640 1 --2- 172.21.15.32:0/2933548230 >> v2:172.21.15.171:3300/0 conn(0x7f8c7806d6c0 0x7f8c7806db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7ca00640 1 -- 172.21.15.32:0/2933548230 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3040752277 0 0) 0x7f8c7815fe20 con 0x7f8c7815c010 2024-03-19T06:22:17.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7ca00640 1 -- 172.21.15.32:0/2933548230 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c60003530 con 0x7f8c7815c010 2024-03-19T06:22:17.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7ca00640 1 -- 172.21.15.32:0/2933548230 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1222154721 0 0) 0x7f8c60003530 con 0x7f8c7815c010 2024-03-19T06:22:17.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7ca00640 1 -- 172.21.15.32:0/2933548230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c780aecf0 msgr2=0x7f8c780ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:17.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7ca00640 1 --2- 172.21.15.32:0/2933548230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c780aecf0 0x7f8c780ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7ca00640 1 -- 172.21.15.32:0/2933548230 >> v2:172.21.15.171:3300/0 conn(0x7f8c7806d6c0 msgr2=0x7f8c7806db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:17.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7ca00640 1 --2- 172.21.15.32:0/2933548230 >> v2:172.21.15.171:3300/0 conn(0x7f8c7806d6c0 0x7f8c7806db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7ca00640 1 -- 172.21.15.32:0/2933548230 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c78160100 con 0x7f8c7815c010 2024-03-19T06:22:17.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7ca00640 1 -- 172.21.15.32:0/2933548230 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f8c68001680 con 0x7f8c7815c010 2024-03-19T06:22:17.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7ca00640 1 -- 172.21.15.32:0/2933548230 >> v1:172.21.15.32:6789/0 conn(0x7f8c7815c010 legacy=0x7f8c7815f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:17.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7ca00640 1 --2- 172.21.15.32:0/2933548230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c780aecf0 0x7f8c600039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7ca00640 1 --2- 172.21.15.32:0/2933548230 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c60003f40 0x7f8c60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7ca00640 1 --2- 172.21.15.32:0/2933548230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c60004d50 0x7f8c600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7ca00640 1 -- 172.21.15.32:0/2933548230 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7806e070 con 0x7f8c60003f40 2024-03-19T06:22:17.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7ca00640 1 -- 172.21.15.32:0/2933548230 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c781603e0 con 0x7f8c60004d50 2024-03-19T06:22:17.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7ca00640 1 -- 172.21.15.32:0/2933548230 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6000ba20 con 0x7f8c780aecf0 2024-03-19T06:22:17.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7d400640 1 --2- 172.21.15.32:0/2933548230 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c60003f40 0x7f8c60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7de00640 1 --2- 172.21.15.32:0/2933548230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c780aecf0 0x7f8c600039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7e800640 1 --2- 172.21.15.32:0/2933548230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c60004d50 0x7f8c600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7d400640 1 -- 172.21.15.32:0/2933548230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c780aecf0 msgr2=0x7f8c600039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:17.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7d400640 1 --2- 172.21.15.32:0/2933548230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c780aecf0 0x7f8c600039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7d400640 1 -- 172.21.15.32:0/2933548230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c60004d50 msgr2=0x7f8c600051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:17.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7d400640 1 --2- 172.21.15.32:0/2933548230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c60004d50 0x7f8c600051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.092+0000 7f8c7d400640 1 -- 172.21.15.32:0/2933548230 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c60003530 con 0x7f8c60003f40 2024-03-19T06:22:17.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.096+0000 7f8c7d400640 1 --2- 172.21.15.32:0/2933548230 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c60003f40 0x7f8c60004810 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800c240 tx=0x7f8c6801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c162f4e189ed848a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:17.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.096+0000 7f8c7ca00640 1 -- 172.21.15.32:0/2933548230 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68007d40 con 0x7f8c60003f40 2024-03-19T06:22:17.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.096+0000 7f8c7ca00640 1 -- 172.21.15.32:0/2933548230 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c680a9020 con 0x7f8c60003f40 2024-03-19T06:22:17.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.096+0000 7f8c7ca00640 1 -- 172.21.15.32:0/2933548230 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68005ae0 con 0x7f8c60003f40 2024-03-19T06:22:17.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.096+0000 7f8c80800640 1 -- 172.21.15.32:0/2933548230 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c60003f40 msgr2=0x7f8c60004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:17.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.096+0000 7f8c80800640 1 --2- 172.21.15.32:0/2933548230 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c60003f40 0x7f8c60004810 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800c240 tx=0x7f8c6801cc20 comp rx=0 tx=0).stop 2024-03-19T06:22:17.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.096+0000 7f8c7e800640 1 -- 172.21.15.32:0/2933548230 reap_dead start 2024-03-19T06:22:17.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.096+0000 7f8c80800640 1 -- 172.21.15.32:0/2933548230 shutdown_connections 2024-03-19T06:22:17.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.096+0000 7f8c80800640 1 -- 172.21.15.32:0/2933548230 >> 172.21.15.32:0/2933548230 conn(0x7f8c780b1280 msgr2=0x7f8c780b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:17.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.096+0000 7f8c80800640 1 -- 172.21.15.32:0/2933548230 shutdown_connections 2024-03-19T06:22:17.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.096+0000 7f8c80800640 1 -- 172.21.15.32:0/2933548230 wait complete. 2024-03-19T06:22:17.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c80800640 1 Processor -- start 2024-03-19T06:22:17.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c80800640 1 -- start start 2024-03-19T06:22:17.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c80800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c60003f40 0x7f8c780ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c80800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c78149e70 0x7f8c780a8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c80800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c780a8ec0 0x7f8c780c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c80800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780cb7e0 con 0x7f8c60003f40 2024-03-19T06:22:17.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c80800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780cb660 con 0x7f8c780a8ec0 2024-03-19T06:22:17.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c80800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780cb960 con 0x7f8c78149e70 2024-03-19T06:22:17.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c7de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c60003f40 0x7f8c780ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c7de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c60003f40 0x7f8c780ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56674/0 (socket says 172.21.15.32:56674) 2024-03-19T06:22:17.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c7de00640 1 -- 172.21.15.32:0/2560146032 learned_addr learned my addr 172.21.15.32:0/2560146032 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:17.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c7d400640 1 --2- 172.21.15.32:0/2560146032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c78149e70 0x7f8c780a8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c7e800640 1 --2- 172.21.15.32:0/2560146032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c780a8ec0 0x7f8c780c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c7de00640 1 -- 172.21.15.32:0/2560146032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c78149e70 msgr2=0x7f8c780a8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:17.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c7de00640 1 --2- 172.21.15.32:0/2560146032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c78149e70 0x7f8c780a8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c7de00640 1 -- 172.21.15.32:0/2560146032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c780a8ec0 msgr2=0x7f8c780c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:17.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c7de00640 1 --2- 172.21.15.32:0/2560146032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c780a8ec0 0x7f8c780c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c7de00640 1 -- 172.21.15.32:0/2560146032 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c781f9f50 con 0x7f8c60003f40 2024-03-19T06:22:17.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c7de00640 1 --2- 172.21.15.32:0/2560146032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c60003f40 0x7f8c780ade40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0115e0 tx=0x7f8c6c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:17.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c72000640 1 -- 172.21.15.32:0/2560146032 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00f8f0 con 0x7f8c60003f40 2024-03-19T06:22:17.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c72000640 1 -- 172.21.15.32:0/2560146032 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c00fa90 con 0x7f8c60003f40 2024-03-19T06:22:17.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c72000640 1 -- 172.21.15.32:0/2560146032 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00fe40 con 0x7f8c60003f40 2024-03-19T06:22:17.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c80800640 1 -- 172.21.15.32:0/2560146032 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c781fa230 con 0x7f8c60003f40 2024-03-19T06:22:17.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c80800640 1 -- 172.21.15.32:0/2560146032 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c781fa7f0 con 0x7f8c60003f40 2024-03-19T06:22:17.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.100+0000 7f8c80800640 1 -- 172.21.15.32:0/2560146032 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c780749e0 con 0x7f8c60003f40 2024-03-19T06:22:17.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.104+0000 7f8c72000640 1 -- 172.21.15.32:0/2560146032 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8c6c015460 con 0x7f8c60003f40 2024-03-19T06:22:17.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.104+0000 7f8c72000640 1 --2- 172.21.15.32:0/2560146032 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8c5c0676e0 0x7f8c5c069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.104+0000 7f8c72000640 1 -- 172.21.15.32:0/2560146032 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c6c085f80 con 0x7f8c60003f40 2024-03-19T06:22:17.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.104+0000 7f8c7d400640 1 --2- 172.21.15.32:0/2560146032 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8c5c0676e0 0x7f8c5c069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.104+0000 7f8c7d400640 1 --2- 172.21.15.32:0/2560146032 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8c5c0676e0 0x7f8c5c069ba0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8c680aa000 tx=0x7f8c7815fff0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:17.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.108+0000 7f8c72000640 1 -- 172.21.15.32:0/2560146032 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f8c6c019030 con 0x7f8c60003f40 2024-03-19T06:22:17.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.268+0000 7f8c80800640 1 -- 172.21.15.32:0/2560146032 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c780b5380 con 0x7f8c5c0676e0 2024-03-19T06:22:17.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.276+0000 7f8c72000640 1 -- 172.21.15.32:0/2560146032 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243736 (secure 0 0 0) 0x7f8c780b5380 con 0x7f8c5c0676e0 2024-03-19T06:22:17.271 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:17.273 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:22:17.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.280+0000 7f8c80800640 1 -- 172.21.15.32:0/2560146032 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8c5c0676e0 msgr2=0x7f8c5c069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:17.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.280+0000 7f8c80800640 1 --2- 172.21.15.32:0/2560146032 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8c5c0676e0 0x7f8c5c069ba0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8c680aa000 tx=0x7f8c7815fff0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.280+0000 7f8c80800640 1 -- 172.21.15.32:0/2560146032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c60003f40 msgr2=0x7f8c780ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:17.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.280+0000 7f8c80800640 1 --2- 172.21.15.32:0/2560146032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c60003f40 0x7f8c780ade40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0115e0 tx=0x7f8c6c011aa0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.280+0000 7f8c80800640 1 -- 172.21.15.32:0/2560146032 shutdown_connections 2024-03-19T06:22:17.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.280+0000 7f8c80800640 1 --2- 172.21.15.32:0/2560146032 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8c5c0676e0 0x7f8c5c069ba0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.280+0000 7f8c80800640 1 --2- 172.21.15.32:0/2560146032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c780a8ec0 0x7f8c780c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.280+0000 7f8c80800640 1 --2- 172.21.15.32:0/2560146032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c78149e70 0x7f8c780a8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.280+0000 7f8c80800640 1 --2- 172.21.15.32:0/2560146032 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c60003f40 0x7f8c780ade40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.280+0000 7f8c80800640 1 -- 172.21.15.32:0/2560146032 >> 172.21.15.32:0/2560146032 conn(0x7f8c780b1280 msgr2=0x7f8c7815b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:17.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.280+0000 7f8c80800640 1 -- 172.21.15.32:0/2560146032 shutdown_connections 2024-03-19T06:22:17.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.280+0000 7f8c80800640 1 -- 172.21.15.32:0/2560146032 wait complete. 2024-03-19T06:22:17.291 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-03-19T06:22:15.935625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592084,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236812,"kb_used_data":3960,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737908,"statfs":{"total":773094113280,"available":772851617792,"internally_reserved":0,"allocated":4055040,"data_stored":2263410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1716,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.170008"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782830+0000","last_change":"2024-03-19T06:22:12.813377+0000","last_active":"2024-03-19T06:22:13.782830+0000","last_peered":"2024-03-19T06:22:13.782830+0000","last_clean":"2024-03-19T06:22:13.782830+0000","last_became_active":"2024-03-19T06:22:12.810137+0000","last_became_peered":"2024-03-19T06:22:12.810137+0000","last_unstale":"2024-03-19T06:22:13.782830+0000","last_undegraded":"2024-03-19T06:22:13.782830+0000","last_fullsized":"2024-03-19T06:22:13.782830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:54:53.123082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782288+0000","last_change":"2024-03-19T06:22:12.802790+0000","last_active":"2024-03-19T06:22:13.782288+0000","last_peered":"2024-03-19T06:22:13.782288+0000","last_clean":"2024-03-19T06:22:13.782288+0000","last_became_active":"2024-03-19T06:22:12.800768+0000","last_became_peered":"2024-03-19T06:22:12.800768+0000","last_unstale":"2024-03-19T06:22:13.782288+0000","last_undegraded":"2024-03-19T06:22:13.782288+0000","last_fullsized":"2024-03-19T06:22:13.782288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:53:16.147110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950048+0000","last_change":"2024-03-19T06:22:12.819459+0000","last_active":"2024-03-19T06:22:13.950048+0000","last_peered":"2024-03-19T06:22:13.950048+0000","last_clean":"2024-03-19T06:22:13.950048+0000","last_became_active":"2024-03-19T06:22:12.819097+0000","last_became_peered":"2024-03-19T06:22:12.819097+0000","last_unstale":"2024-03-19T06:22:13.950048+0000","last_undegraded":"2024-03-19T06:22:13.950048+0000","last_fullsized":"2024-03-19T06:22:13.950048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:28:58.380767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782427+0000","last_change":"2024-03-19T06:22:12.799728+0000","last_active":"2024-03-19T06:22:13.782427+0000","last_peered":"2024-03-19T06:22:13.782427+0000","last_clean":"2024-03-19T06:22:13.782427+0000","last_became_active":"2024-03-19T06:22:12.799510+0000","last_became_peered":"2024-03-19T06:22:12.799510+0000","last_unstale":"2024-03-19T06:22:13.782427+0000","last_undegraded":"2024-03-19T06:22:13.782427+0000","last_fullsized":"2024-03-19T06:22:13.782427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:49:46.460288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782823+0000","last_change":"2024-03-19T06:22:12.801364+0000","last_active":"2024-03-19T06:22:13.782823+0000","last_peered":"2024-03-19T06:22:13.782823+0000","last_clean":"2024-03-19T06:22:13.782823+0000","last_became_active":"2024-03-19T06:22:12.801016+0000","last_became_peered":"2024-03-19T06:22:12.801016+0000","last_unstale":"2024-03-19T06:22:13.782823+0000","last_undegraded":"2024-03-19T06:22:13.782823+0000","last_fullsized":"2024-03-19T06:22:13.782823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:36:02.560779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782657+0000","last_change":"2024-03-19T06:22:12.799453+0000","last_active":"2024-03-19T06:22:13.782657+0000","last_peered":"2024-03-19T06:22:13.782657+0000","last_clean":"2024-03-19T06:22:13.782657+0000","last_became_active":"2024-03-19T06:22:12.799175+0000","last_became_peered":"2024-03-19T06:22:12.799175+0000","last_unstale":"2024-03-19T06:22:13.782657+0000","last_undegraded":"2024-03-19T06:22:13.782657+0000","last_fullsized":"2024-03-19T06:22:13.782657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:19:47.036468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949442+0000","last_change":"2024-03-19T06:22:12.811038+0000","last_active":"2024-03-19T06:22:13.949442+0000","last_peered":"2024-03-19T06:22:13.949442+0000","last_clean":"2024-03-19T06:22:13.949442+0000","last_became_active":"2024-03-19T06:22:12.810750+0000","last_became_peered":"2024-03-19T06:22:12.810750+0000","last_unstale":"2024-03-19T06:22:13.949442+0000","last_undegraded":"2024-03-19T06:22:13.949442+0000","last_fullsized":"2024-03-19T06:22:13.949442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:15:49.184635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949569+0000","last_change":"2024-03-19T06:22:12.808465+0000","last_active":"2024-03-19T06:22:13.949569+0000","last_peered":"2024-03-19T06:22:13.949569+0000","last_clean":"2024-03-19T06:22:13.949569+0000","last_became_active":"2024-03-19T06:22:12.808155+0000","last_became_peered":"2024-03-19T06:22:12.808155+0000","last_unstale":"2024-03-19T06:22:13.949569+0000","last_undegraded":"2024-03-19T06:22:13.949569+0000","last_fullsized":"2024-03-19T06:22:13.949569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:07:58.346504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782901+0000","last_change":"2024-03-19T06:22:12.813107+0000","last_active":"2024-03-19T06:22:13.782901+0000","last_peered":"2024-03-19T06:22:13.782901+0000","last_clean":"2024-03-19T06:22:13.782901+0000","last_became_active":"2024-03-19T06:22:12.812747+0000","last_became_peered":"2024-03-19T06:22:12.812747+0000","last_unstale":"2024-03-19T06:22:13.782901+0000","last_undegraded":"2024-03-19T06:22:13.782901+0000","last_fullsized":"2024-03-19T06:22:13.782901+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:32.790613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949639+0000","last_change":"2024-03-19T06:22:12.807735+0000","last_active":"2024-03-19T06:22:13.949639+0000","last_peered":"2024-03-19T06:22:13.949639+0000","last_clean":"2024-03-19T06:22:13.949639+0000","last_became_active":"2024-03-19T06:22:12.807440+0000","last_became_peered":"2024-03-19T06:22:12.807440+0000","last_unstale":"2024-03-19T06:22:13.949639+0000","last_undegraded":"2024-03-19T06:22:13.949639+0000","last_fullsized":"2024-03-19T06:22:13.949639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:36:33.458254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.771812+0000","last_change":"2024-03-19T06:22:10.771812+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.771812+0000","last_undegraded":"2024-03-19T06:22:10.771812+0000","last_fullsized":"2024-03-19T06:22:10.771812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.767905+0000","last_change":"2024-03-19T06:22:10.767905+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.767905+0000","last_undegraded":"2024-03-19T06:22:10.767905+0000","last_fullsized":"2024-03-19T06:22:10.767905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950121+0000","last_change":"2024-03-19T06:22:12.806044+0000","last_active":"2024-03-19T06:22:13.950121+0000","last_peered":"2024-03-19T06:22:13.950121+0000","last_clean":"2024-03-19T06:22:13.950121+0000","last_became_active":"2024-03-19T06:22:12.805753+0000","last_became_peered":"2024-03-19T06:22:12.805753+0000","last_unstale":"2024-03-19T06:22:13.950121+0000","last_undegraded":"2024-03-19T06:22:13.950121+0000","last_fullsized":"2024-03-19T06:22:13.950121+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:45:02.480430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782617+0000","last_change":"2024-03-19T06:22:11.782865+0000","last_active":"2024-03-19T06:22:13.782617+0000","last_peered":"2024-03-19T06:22:13.782617+0000","last_clean":"2024-03-19T06:22:13.782617+0000","last_became_active":"2024-03-19T06:22:11.781430+0000","last_became_peered":"2024-03-19T06:22:11.781430+0000","last_unstale":"2024-03-19T06:22:13.782617+0000","last_undegraded":"2024-03-19T06:22:13.782617+0000","last_fullsized":"2024-03-19T06:22:13.782617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:23:11.347650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.770372+0000","last_change":"2024-03-19T06:22:10.770372+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.770372+0000","last_undegraded":"2024-03-19T06:22:10.770372+0000","last_fullsized":"2024-03-19T06:22:10.770372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949778+0000","last_change":"2024-03-19T06:22:11.792783+0000","last_active":"2024-03-19T06:22:13.949778+0000","last_peered":"2024-03-19T06:22:13.949778+0000","last_clean":"2024-03-19T06:22:13.949778+0000","last_became_active":"2024-03-19T06:22:11.791824+0000","last_became_peered":"2024-03-19T06:22:11.791824+0000","last_unstale":"2024-03-19T06:22:13.949778+0000","last_undegraded":"2024-03-19T06:22:13.949778+0000","last_fullsized":"2024-03-19T06:22:13.949778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:23:23.700595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949696+0000","last_change":"2024-03-19T06:22:11.796432+0000","last_active":"2024-03-19T06:22:13.949696+0000","last_peered":"2024-03-19T06:22:13.949696+0000","last_clean":"2024-03-19T06:22:13.949696+0000","last_became_active":"2024-03-19T06:22:11.794614+0000","last_became_peered":"2024-03-19T06:22:11.794614+0000","last_unstale":"2024-03-19T06:22:13.949696+0000","last_undegraded":"2024-03-19T06:22:13.949696+0000","last_fullsized":"2024-03-19T06:22:13.949696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:15:41.175621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949428+0000","last_change":"2024-03-19T06:22:12.804385+0000","last_active":"2024-03-19T06:22:13.949428+0000","last_peered":"2024-03-19T06:22:13.949428+0000","last_clean":"2024-03-19T06:22:13.949428+0000","last_became_active":"2024-03-19T06:22:12.804022+0000","last_became_peered":"2024-03-19T06:22:12.804022+0000","last_unstale":"2024-03-19T06:22:13.949428+0000","last_undegraded":"2024-03-19T06:22:13.949428+0000","last_fullsized":"2024-03-19T06:22:13.949428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:41:28.053793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782068+0000","last_change":"2024-03-19T06:22:11.785078+0000","last_active":"2024-03-19T06:22:13.782068+0000","last_peered":"2024-03-19T06:22:13.782068+0000","last_clean":"2024-03-19T06:22:13.782068+0000","last_became_active":"2024-03-19T06:22:11.783561+0000","last_became_peered":"2024-03-19T06:22:11.783561+0000","last_unstale":"2024-03-19T06:22:13.782068+0000","last_undegraded":"2024-03-19T06:22:13.782068+0000","last_fullsized":"2024-03-19T06:22:13.782068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:38:39.623722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949201+0000","last_change":"2024-03-19T06:22:11.796210+0000","last_active":"2024-03-19T06:22:13.949201+0000","last_peered":"2024-03-19T06:22:13.949201+0000","last_clean":"2024-03-19T06:22:13.949201+0000","last_became_active":"2024-03-19T06:22:11.795816+0000","last_became_peered":"2024-03-19T06:22:11.795816+0000","last_unstale":"2024-03-19T06:22:13.949201+0000","last_undegraded":"2024-03-19T06:22:13.949201+0000","last_fullsized":"2024-03-19T06:22:13.949201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:26:41.154332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782834+0000","last_change":"2024-03-19T06:22:11.797779+0000","last_active":"2024-03-19T06:22:13.782834+0000","last_peered":"2024-03-19T06:22:13.782834+0000","last_clean":"2024-03-19T06:22:13.782834+0000","last_became_active":"2024-03-19T06:22:11.797477+0000","last_became_peered":"2024-03-19T06:22:11.797477+0000","last_unstale":"2024-03-19T06:22:13.782834+0000","last_undegraded":"2024-03-19T06:22:13.782834+0000","last_fullsized":"2024-03-19T06:22:13.782834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:58:59.662492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782810+0000","last_change":"2024-03-19T06:22:12.801487+0000","last_active":"2024-03-19T06:22:13.782810+0000","last_peered":"2024-03-19T06:22:13.782810+0000","last_clean":"2024-03-19T06:22:13.782810+0000","last_became_active":"2024-03-19T06:22:12.801196+0000","last_became_peered":"2024-03-19T06:22:12.801196+0000","last_unstale":"2024-03-19T06:22:13.782810+0000","last_undegraded":"2024-03-19T06:22:13.782810+0000","last_fullsized":"2024-03-19T06:22:13.782810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:37:25.965590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.767410+0000","last_change":"2024-03-19T06:22:10.767410+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.767410+0000","last_undegraded":"2024-03-19T06:22:10.767410+0000","last_fullsized":"2024-03-19T06:22:10.767410+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782617+0000","last_change":"2024-03-19T06:22:12.814392+0000","last_active":"2024-03-19T06:22:13.782617+0000","last_peered":"2024-03-19T06:22:13.782617+0000","last_clean":"2024-03-19T06:22:13.782617+0000","last_became_active":"2024-03-19T06:22:12.813815+0000","last_became_peered":"2024-03-19T06:22:12.813815+0000","last_unstale":"2024-03-19T06:22:13.782617+0000","last_undegraded":"2024-03-19T06:22:13.782617+0000","last_fullsized":"2024-03-19T06:22:13.782617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:54:29.091078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.768049+0000","last_change":"2024-03-19T06:22:10.768049+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.768049+0000","last_undegraded":"2024-03-19T06:22:10.768049+0000","last_fullsized":"2024-03-19T06:22:10.768049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782699+0000","last_change":"2024-03-19T06:22:11.791858+0000","last_active":"2024-03-19T06:22:13.782699+0000","last_peered":"2024-03-19T06:22:13.782699+0000","last_clean":"2024-03-19T06:22:13.782699+0000","last_became_active":"2024-03-19T06:22:11.791423+0000","last_became_peered":"2024-03-19T06:22:11.791423+0000","last_unstale":"2024-03-19T06:22:13.782699+0000","last_undegraded":"2024-03-19T06:22:13.782699+0000","last_fullsized":"2024-03-19T06:22:13.782699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:15:48.178564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949920+0000","last_change":"2024-03-19T06:22:11.796046+0000","last_active":"2024-03-19T06:22:13.949920+0000","last_peered":"2024-03-19T06:22:13.949920+0000","last_clean":"2024-03-19T06:22:13.949920+0000","last_became_active":"2024-03-19T06:22:11.794808+0000","last_became_peered":"2024-03-19T06:22:11.794808+0000","last_unstale":"2024-03-19T06:22:13.949920+0000","last_undegraded":"2024-03-19T06:22:13.949920+0000","last_fullsized":"2024-03-19T06:22:13.949920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:52:11.332786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782532+0000","last_change":"2024-03-19T06:22:12.807613+0000","last_active":"2024-03-19T06:22:13.782532+0000","last_peered":"2024-03-19T06:22:13.782532+0000","last_clean":"2024-03-19T06:22:13.782532+0000","last_became_active":"2024-03-19T06:22:12.807323+0000","last_became_peered":"2024-03-19T06:22:12.807323+0000","last_unstale":"2024-03-19T06:22:13.782532+0000","last_undegraded":"2024-03-19T06:22:13.782532+0000","last_fullsized":"2024-03-19T06:22:13.782532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:34:23.250483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.770913+0000","last_change":"2024-03-19T06:22:10.770913+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.770913+0000","last_undegraded":"2024-03-19T06:22:10.770913+0000","last_fullsized":"2024-03-19T06:22:10.770913+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782082+0000","last_change":"2024-03-19T06:22:11.792957+0000","last_active":"2024-03-19T06:22:13.782082+0000","last_peered":"2024-03-19T06:22:13.782082+0000","last_clean":"2024-03-19T06:22:13.782082+0000","last_became_active":"2024-03-19T06:22:11.792682+0000","last_became_peered":"2024-03-19T06:22:11.792682+0000","last_unstale":"2024-03-19T06:22:13.782082+0000","last_undegraded":"2024-03-19T06:22:13.782082+0000","last_fullsized":"2024-03-19T06:22:13.782082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:24.575297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782011+0000","last_change":"2024-03-19T06:22:11.782315+0000","last_active":"2024-03-19T06:22:13.782011+0000","last_peered":"2024-03-19T06:22:13.782011+0000","last_clean":"2024-03-19T06:22:13.782011+0000","last_became_active":"2024-03-19T06:22:11.782022+0000","last_became_peered":"2024-03-19T06:22:11.782022+0000","last_unstale":"2024-03-19T06:22:13.782011+0000","last_undegraded":"2024-03-19T06:22:13.782011+0000","last_fullsized":"2024-03-19T06:22:13.782011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:59:59.683815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949806+0000","last_change":"2024-03-19T06:22:12.807959+0000","last_active":"2024-03-19T06:22:13.949806+0000","last_peered":"2024-03-19T06:22:13.949806+0000","last_clean":"2024-03-19T06:22:13.949806+0000","last_became_active":"2024-03-19T06:22:12.807622+0000","last_became_peered":"2024-03-19T06:22:12.807622+0000","last_unstale":"2024-03-19T06:22:13.949806+0000","last_undegraded":"2024-03-19T06:22:13.949806+0000","last_fullsized":"2024-03-19T06:22:13.949806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:59:00.668563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.771355+0000","last_change":"2024-03-19T06:22:10.771355+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.771355+0000","last_undegraded":"2024-03-19T06:22:10.771355+0000","last_fullsized":"2024-03-19T06:22:10.771355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949947+0000","last_change":"2024-03-19T06:22:11.789922+0000","last_active":"2024-03-19T06:22:13.949947+0000","last_peered":"2024-03-19T06:22:13.949947+0000","last_clean":"2024-03-19T06:22:13.949947+0000","last_became_active":"2024-03-19T06:22:11.789318+0000","last_became_peered":"2024-03-19T06:22:11.789318+0000","last_unstale":"2024-03-19T06:22:13.949947+0000","last_undegraded":"2024-03-19T06:22:13.949947+0000","last_fullsized":"2024-03-19T06:22:13.949947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:57:16.843221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950093+0000","last_change":"2024-03-19T06:22:11.792226+0000","last_active":"2024-03-19T06:22:13.950093+0000","last_peered":"2024-03-19T06:22:13.950093+0000","last_clean":"2024-03-19T06:22:13.950093+0000","last_became_active":"2024-03-19T06:22:11.791854+0000","last_became_peered":"2024-03-19T06:22:11.791854+0000","last_unstale":"2024-03-19T06:22:13.950093+0000","last_undegraded":"2024-03-19T06:22:13.950093+0000","last_fullsized":"2024-03-19T06:22:13.950093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:25:13.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949809+0000","last_change":"2024-03-19T06:22:11.792381+0000","last_active":"2024-03-19T06:22:13.949809+0000","last_peered":"2024-03-19T06:22:13.949809+0000","last_clean":"2024-03-19T06:22:13.949809+0000","last_became_active":"2024-03-19T06:22:11.792047+0000","last_became_peered":"2024-03-19T06:22:11.792047+0000","last_unstale":"2024-03-19T06:22:13.949809+0000","last_undegraded":"2024-03-19T06:22:13.949809+0000","last_fullsized":"2024-03-19T06:22:13.949809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:03:44.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.767402+0000","last_change":"2024-03-19T06:22:10.767402+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.767402+0000","last_undegraded":"2024-03-19T06:22:10.767402+0000","last_fullsized":"2024-03-19T06:22:10.767402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.771798+0000","last_change":"2024-03-19T06:22:10.771798+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.771798+0000","last_undegraded":"2024-03-19T06:22:10.771798+0000","last_fullsized":"2024-03-19T06:22:10.771798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949359+0000","last_change":"2024-03-19T06:22:11.794192+0000","last_active":"2024-03-19T06:22:13.949359+0000","last_peered":"2024-03-19T06:22:13.949359+0000","last_clean":"2024-03-19T06:22:13.949359+0000","last_became_active":"2024-03-19T06:22:11.793919+0000","last_became_peered":"2024-03-19T06:22:11.793919+0000","last_unstale":"2024-03-19T06:22:13.949359+0000","last_undegraded":"2024-03-19T06:22:13.949359+0000","last_fullsized":"2024-03-19T06:22:13.949359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:12:38.916099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.768039+0000","last_change":"2024-03-19T06:22:10.768039+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.768039+0000","last_undegraded":"2024-03-19T06:22:10.768039+0000","last_fullsized":"2024-03-19T06:22:10.768039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.770186+0000","last_change":"2024-03-19T06:22:10.770186+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.770186+0000","last_undegraded":"2024-03-19T06:22:10.770186+0000","last_fullsized":"2024-03-19T06:22:10.770186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.766840+0000","last_change":"2024-03-19T06:22:10.766840+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.766840+0000","last_undegraded":"2024-03-19T06:22:10.766840+0000","last_fullsized":"2024-03-19T06:22:10.766840+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.769623+0000","last_change":"2024-03-19T06:22:10.769623+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.769623+0000","last_undegraded":"2024-03-19T06:22:10.769623+0000","last_fullsized":"2024-03-19T06:22:10.769623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.766857+0000","last_change":"2024-03-19T06:22:10.766857+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.766857+0000","last_undegraded":"2024-03-19T06:22:10.766857+0000","last_fullsized":"2024-03-19T06:22:10.766857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.770464+0000","last_change":"2024-03-19T06:22:10.770464+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.770464+0000","last_undegraded":"2024-03-19T06:22:10.770464+0000","last_fullsized":"2024-03-19T06:22:10.770464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.781975+0000","last_change":"2024-03-19T06:22:12.798059+0000","last_active":"2024-03-19T06:22:13.781975+0000","last_peered":"2024-03-19T06:22:13.781975+0000","last_clean":"2024-03-19T06:22:13.781975+0000","last_became_active":"2024-03-19T06:22:12.797589+0000","last_became_peered":"2024-03-19T06:22:12.797589+0000","last_unstale":"2024-03-19T06:22:13.781975+0000","last_undegraded":"2024-03-19T06:22:13.781975+0000","last_fullsized":"2024-03-19T06:22:13.781975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:38.121363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949473+0000","last_change":"2024-03-19T06:22:11.781136+0000","last_active":"2024-03-19T06:22:13.949473+0000","last_peered":"2024-03-19T06:22:13.949473+0000","last_clean":"2024-03-19T06:22:13.949473+0000","last_became_active":"2024-03-19T06:22:11.780619+0000","last_became_peered":"2024-03-19T06:22:11.780619+0000","last_unstale":"2024-03-19T06:22:13.949473+0000","last_undegraded":"2024-03-19T06:22:13.949473+0000","last_fullsized":"2024-03-19T06:22:13.949473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:08:55.885727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949388+0000","last_change":"2024-03-19T06:22:12.800198+0000","last_active":"2024-03-19T06:22:13.949388+0000","last_peered":"2024-03-19T06:22:13.949388+0000","last_clean":"2024-03-19T06:22:13.949388+0000","last_became_active":"2024-03-19T06:22:12.799781+0000","last_became_peered":"2024-03-19T06:22:12.799781+0000","last_unstale":"2024-03-19T06:22:13.949388+0000","last_undegraded":"2024-03-19T06:22:13.949388+0000","last_fullsized":"2024-03-19T06:22:13.949388+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:14.509578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782072+0000","last_change":"2024-03-19T06:22:11.797400+0000","last_active":"2024-03-19T06:22:13.782072+0000","last_peered":"2024-03-19T06:22:13.782072+0000","last_clean":"2024-03-19T06:22:13.782072+0000","last_became_active":"2024-03-19T06:22:11.797126+0000","last_became_peered":"2024-03-19T06:22:11.797126+0000","last_unstale":"2024-03-19T06:22:13.782072+0000","last_undegraded":"2024-03-19T06:22:13.782072+0000","last_fullsized":"2024-03-19T06:22:13.782072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:13.503507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.772176+0000","last_change":"2024-03-19T06:22:10.772176+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.772176+0000","last_undegraded":"2024-03-19T06:22:10.772176+0000","last_fullsized":"2024-03-19T06:22:10.772176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:22:10.772060+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:22:10.772060+0000","last_peered":"2024-03-19T06:22:10.772060+0000","last_clean":"2024-03-19T06:22:10.772060+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:22:10.772060+0000","last_undegraded":"2024-03-19T06:22:10.772060+0000","last_fullsized":"2024-03-19T06:22:10.772060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1716,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":717741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":127373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":339968,"data_stored":127373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":133190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":133190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":933888,"data_stored":717741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":152636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":405504,"data_stored":154166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:22:17.295 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:22:17.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8189800640 1 Processor -- start 2024-03-19T06:22:17.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8189800640 1 -- start start 2024-03-19T06:22:17.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8189800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f81840aecf0 0x7f81840ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8189800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f818415c010 0x7f818415f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8189800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f818406d6c0 0x7f818406dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8189800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81841603e0 con 0x7f81840aecf0 2024-03-19T06:22:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8189800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818406e000 con 0x7f818415c010 2024-03-19T06:22:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8189800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818415fe20 con 0x7f818406d6c0 2024-03-19T06:22:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8182a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f81840aecf0 0x7f81840ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8182a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f81840aecf0 0x7f81840ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56676/0 (socket says 172.21.15.32:56676) 2024-03-19T06:22:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8182a00640 1 -- 172.21.15.32:0/2678617859 learned_addr learned my addr 172.21.15.32:0/2678617859 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8182000640 1 --2- 172.21.15.32:0/2678617859 >> v2:172.21.15.171:3300/0 conn(0x7f818415c010 0x7f818415f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8183400640 1 --2- 172.21.15.32:0/2678617859 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f818406d6c0 0x7f818406dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8182a00640 1 -- 172.21.15.32:0/2678617859 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f818406d6c0 msgr2=0x7f818406dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8182a00640 1 --2- 172.21.15.32:0/2678617859 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f818406d6c0 0x7f818406dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8182a00640 1 -- 172.21.15.32:0/2678617859 >> v2:172.21.15.171:3300/0 conn(0x7f818415c010 msgr2=0x7f818415f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8182a00640 1 --2- 172.21.15.32:0/2678617859 >> v2:172.21.15.171:3300/0 conn(0x7f818415c010 0x7f818415f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8182a00640 1 -- 172.21.15.32:0/2678617859 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8184160100 con 0x7f81840aecf0 2024-03-19T06:22:17.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.484+0000 7f8182000640 1 --2- 172.21.15.32:0/2678617859 >> v2:172.21.15.171:3300/0 conn(0x7f818415c010 0x7f818415f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:17.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.488+0000 7f8182a00640 1 --2- 172.21.15.32:0/2678617859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81840aecf0 0x7f81840ca9f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8184068930 tx=0x7f817401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd9da6087b9e635 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:17.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.488+0000 7f8181600640 1 -- 172.21.15.32:0/2678617859 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81740b2070 con 0x7f81840aecf0 2024-03-19T06:22:17.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.488+0000 7f8181600640 1 -- 172.21.15.32:0/2678617859 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81740a9070 con 0x7f81840aecf0 2024-03-19T06:22:17.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.488+0000 7f8181600640 1 -- 172.21.15.32:0/2678617859 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81740ad880 con 0x7f81840aecf0 2024-03-19T06:22:17.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.488+0000 7f8189800640 1 -- 172.21.15.32:0/2678617859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81840aecf0 msgr2=0x7f81840ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:17.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.488+0000 7f8189800640 1 --2- 172.21.15.32:0/2678617859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81840aecf0 0x7f81840ca9f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8184068930 tx=0x7f817401c490 comp rx=0 tx=0).stop 2024-03-19T06:22:17.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.488+0000 7f8189800640 1 -- 172.21.15.32:0/2678617859 shutdown_connections 2024-03-19T06:22:17.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.488+0000 7f8189800640 1 --2- 172.21.15.32:0/2678617859 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f818406d6c0 0x7f818406dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.488+0000 7f8189800640 1 --2- 172.21.15.32:0/2678617859 >> v2:172.21.15.171:3300/0 conn(0x7f818415c010 0x7f818415f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.488+0000 7f8189800640 1 --2- 172.21.15.32:0/2678617859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f81840aecf0 0x7f81840ca9f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.488+0000 7f8189800640 1 -- 172.21.15.32:0/2678617859 >> 172.21.15.32:0/2678617859 conn(0x7f81840b1280 msgr2=0x7f81840b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:17.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.488+0000 7f8189800640 1 -- 172.21.15.32:0/2678617859 shutdown_connections 2024-03-19T06:22:17.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.488+0000 7f8189800640 1 -- 172.21.15.32:0/2678617859 wait complete. 2024-03-19T06:22:17.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.488+0000 7f8189800640 1 Processor -- start 2024-03-19T06:22:17.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8189800640 1 -- start start 2024-03-19T06:22:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8189800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f818406d6c0 0x7f8184149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8189800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81840aecf0 0x7f818415d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8189800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f818415c010 0x7f818415d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8189800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818415fbe0 con 0x7f818406d6c0 2024-03-19T06:22:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8189800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818415fa60 con 0x7f818415c010 2024-03-19T06:22:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8189800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81840cbc60 con 0x7f81840aecf0 2024-03-19T06:22:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8182a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f818406d6c0 0x7f8184149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8182a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f818406d6c0 0x7f8184149260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56682/0 (socket says 172.21.15.32:56682) 2024-03-19T06:22:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8182a00640 1 -- 172.21.15.32:0/4028366748 learned_addr learned my addr 172.21.15.32:0/4028366748 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8182000640 1 --2- 172.21.15.32:0/4028366748 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81840aecf0 0x7f818415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8183400640 1 --2- 172.21.15.32:0/4028366748 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f818415c010 0x7f818415d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8182a00640 1 -- 172.21.15.32:0/4028366748 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81840aecf0 msgr2=0x7f818415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:17.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8182a00640 1 --2- 172.21.15.32:0/4028366748 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81840aecf0 0x7f818415d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8182a00640 1 -- 172.21.15.32:0/4028366748 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f818415c010 msgr2=0x7f818415d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:17.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8182a00640 1 --2- 172.21.15.32:0/4028366748 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f818415c010 0x7f818415d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8182a00640 1 -- 172.21.15.32:0/4028366748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840b3440 con 0x7f818406d6c0 2024-03-19T06:22:17.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8183400640 1 --2- 172.21.15.32:0/4028366748 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f818415c010 0x7f818415d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:17.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8182a00640 1 --2- 172.21.15.32:0/4028366748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f818406d6c0 0x7f8184149260 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f817401ab40 tx=0x7f8174019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:17.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f817aa00640 1 -- 172.21.15.32:0/4028366748 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81740bb070 con 0x7f818406d6c0 2024-03-19T06:22:17.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f817aa00640 1 -- 172.21.15.32:0/4028366748 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81740addd0 con 0x7f818406d6c0 2024-03-19T06:22:17.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f817aa00640 1 -- 172.21.15.32:0/4028366748 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81740b2040 con 0x7f818406d6c0 2024-03-19T06:22:17.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8189800640 1 -- 172.21.15.32:0/4028366748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81840cdd60 con 0x7f818406d6c0 2024-03-19T06:22:17.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8189800640 1 -- 172.21.15.32:0/4028366748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81840ce320 con 0x7f818406d6c0 2024-03-19T06:22:17.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.492+0000 7f8189800640 1 -- 172.21.15.32:0/4028366748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81840749e0 con 0x7f818406d6c0 2024-03-19T06:22:17.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.496+0000 7f817aa00640 1 -- 172.21.15.32:0/4028366748 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f81740be070 con 0x7f818406d6c0 2024-03-19T06:22:17.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.496+0000 7f817aa00640 1 --2- 172.21.15.32:0/4028366748 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8164067690 0x7f8164069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.496+0000 7f817aa00640 1 -- 172.21.15.32:0/4028366748 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f817411eb80 con 0x7f818406d6c0 2024-03-19T06:22:17.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.496+0000 7f8182000640 1 --2- 172.21.15.32:0/4028366748 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8164067690 0x7f8164069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.496+0000 7f8182000640 1 --2- 172.21.15.32:0/4028366748 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8164067690 0x7f8164069b50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8184156cf0 tx=0x7f8170008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:17.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.500+0000 7f817aa00640 1 -- 172.21.15.32:0/4028366748 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f8174016110 con 0x7f818406d6c0 2024-03-19T06:22:17.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.656+0000 7f8189800640 1 -- 172.21.15.32:0/4028366748 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81840b0330 con 0x7f8164067690 2024-03-19T06:22:17.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.664+0000 7f817aa00640 1 -- 172.21.15.32:0/4028366748 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243736 (secure 0 0 0) 0x7f81840b0330 con 0x7f8164067690 2024-03-19T06:22:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:17.660 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:22:17.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.668+0000 7f8189800640 1 -- 172.21.15.32:0/4028366748 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8164067690 msgr2=0x7f8164069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:17.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.668+0000 7f8189800640 1 --2- 172.21.15.32:0/4028366748 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8164067690 0x7f8164069b50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8184156cf0 tx=0x7f8170008040 comp rx=0 tx=0).stop 2024-03-19T06:22:17.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.668+0000 7f8189800640 1 -- 172.21.15.32:0/4028366748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f818406d6c0 msgr2=0x7f8184149260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:17.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.668+0000 7f8189800640 1 --2- 172.21.15.32:0/4028366748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f818406d6c0 0x7f8184149260 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f817401ab40 tx=0x7f8174019230 comp rx=0 tx=0).stop 2024-03-19T06:22:17.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.668+0000 7f8189800640 1 -- 172.21.15.32:0/4028366748 shutdown_connections 2024-03-19T06:22:17.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.668+0000 7f8189800640 1 --2- 172.21.15.32:0/4028366748 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8164067690 0x7f8164069b50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.668+0000 7f8189800640 1 --2- 172.21.15.32:0/4028366748 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f818415c010 0x7f818415d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.668+0000 7f8189800640 1 --2- 172.21.15.32:0/4028366748 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81840aecf0 0x7f818415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.668+0000 7f8189800640 1 --2- 172.21.15.32:0/4028366748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f818406d6c0 0x7f8184149260 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.668+0000 7f8189800640 1 -- 172.21.15.32:0/4028366748 >> 172.21.15.32:0/4028366748 conn(0x7f81840b1280 msgr2=0x7f818415e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:17.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.668+0000 7f8189800640 1 -- 172.21.15.32:0/4028366748 shutdown_connections 2024-03-19T06:22:17.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.668+0000 7f8189800640 1 -- 172.21.15.32:0/4028366748 wait complete. 2024-03-19T06:22:17.679 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-03-19T06:22:15.935625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592084,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236812,"kb_used_data":3960,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737908,"statfs":{"total":773094113280,"available":772851617792,"internally_reserved":0,"allocated":4055040,"data_stored":2263410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1716,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.170008"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782830+0000","last_change":"2024-03-19T06:22:12.813377+0000","last_active":"2024-03-19T06:22:13.782830+0000","last_peered":"2024-03-19T06:22:13.782830+0000","last_clean":"2024-03-19T06:22:13.782830+0000","last_became_active":"2024-03-19T06:22:12.810137+0000","last_became_peered":"2024-03-19T06:22:12.810137+0000","last_unstale":"2024-03-19T06:22:13.782830+0000","last_undegraded":"2024-03-19T06:22:13.782830+0000","last_fullsized":"2024-03-19T06:22:13.782830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:54:53.123082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782288+0000","last_change":"2024-03-19T06:22:12.802790+0000","last_active":"2024-03-19T06:22:13.782288+0000","last_peered":"2024-03-19T06:22:13.782288+0000","last_clean":"2024-03-19T06:22:13.782288+0000","last_became_active":"2024-03-19T06:22:12.800768+0000","last_became_peered":"2024-03-19T06:22:12.800768+0000","last_unstale":"2024-03-19T06:22:13.782288+0000","last_undegraded":"2024-03-19T06:22:13.782288+0000","last_fullsized":"2024-03-19T06:22:13.782288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:53:16.147110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950048+0000","last_change":"2024-03-19T06:22:12.819459+0000","last_active":"2024-03-19T06:22:13.950048+0000","last_peered":"2024-03-19T06:22:13.950048+0000","last_clean":"2024-03-19T06:22:13.950048+0000","last_became_active":"2024-03-19T06:22:12.819097+0000","last_became_peered":"2024-03-19T06:22:12.819097+0000","last_unstale":"2024-03-19T06:22:13.950048+0000","last_undegraded":"2024-03-19T06:22:13.950048+0000","last_fullsized":"2024-03-19T06:22:13.950048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:28:58.380767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782427+0000","last_change":"2024-03-19T06:22:12.799728+0000","last_active":"2024-03-19T06:22:13.782427+0000","last_peered":"2024-03-19T06:22:13.782427+0000","last_clean":"2024-03-19T06:22:13.782427+0000","last_became_active":"2024-03-19T06:22:12.799510+0000","last_became_peered":"2024-03-19T06:22:12.799510+0000","last_unstale":"2024-03-19T06:22:13.782427+0000","last_undegraded":"2024-03-19T06:22:13.782427+0000","last_fullsized":"2024-03-19T06:22:13.782427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:49:46.460288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782823+0000","last_change":"2024-03-19T06:22:12.801364+0000","last_active":"2024-03-19T06:22:13.782823+0000","last_peered":"2024-03-19T06:22:13.782823+0000","last_clean":"2024-03-19T06:22:13.782823+0000","last_became_active":"2024-03-19T06:22:12.801016+0000","last_became_peered":"2024-03-19T06:22:12.801016+0000","last_unstale":"2024-03-19T06:22:13.782823+0000","last_undegraded":"2024-03-19T06:22:13.782823+0000","last_fullsized":"2024-03-19T06:22:13.782823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:36:02.560779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782657+0000","last_change":"2024-03-19T06:22:12.799453+0000","last_active":"2024-03-19T06:22:13.782657+0000","last_peered":"2024-03-19T06:22:13.782657+0000","last_clean":"2024-03-19T06:22:13.782657+0000","last_became_active":"2024-03-19T06:22:12.799175+0000","last_became_peered":"2024-03-19T06:22:12.799175+0000","last_unstale":"2024-03-19T06:22:13.782657+0000","last_undegraded":"2024-03-19T06:22:13.782657+0000","last_fullsized":"2024-03-19T06:22:13.782657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:19:47.036468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949442+0000","last_change":"2024-03-19T06:22:12.811038+0000","last_active":"2024-03-19T06:22:13.949442+0000","last_peered":"2024-03-19T06:22:13.949442+0000","last_clean":"2024-03-19T06:22:13.949442+0000","last_became_active":"2024-03-19T06:22:12.810750+0000","last_became_peered":"2024-03-19T06:22:12.810750+0000","last_unstale":"2024-03-19T06:22:13.949442+0000","last_undegraded":"2024-03-19T06:22:13.949442+0000","last_fullsized":"2024-03-19T06:22:13.949442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:15:49.184635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949569+0000","last_change":"2024-03-19T06:22:12.808465+0000","last_active":"2024-03-19T06:22:13.949569+0000","last_peered":"2024-03-19T06:22:13.949569+0000","last_clean":"2024-03-19T06:22:13.949569+0000","last_became_active":"2024-03-19T06:22:12.808155+0000","last_became_peered":"2024-03-19T06:22:12.808155+0000","last_unstale":"2024-03-19T06:22:13.949569+0000","last_undegraded":"2024-03-19T06:22:13.949569+0000","last_fullsized":"2024-03-19T06:22:13.949569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:07:58.346504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782901+0000","last_change":"2024-03-19T06:22:12.813107+0000","last_active":"2024-03-19T06:22:13.782901+0000","last_peered":"2024-03-19T06:22:13.782901+0000","last_clean":"2024-03-19T06:22:13.782901+0000","last_became_active":"2024-03-19T06:22:12.812747+0000","last_became_peered":"2024-03-19T06:22:12.812747+0000","last_unstale":"2024-03-19T06:22:13.782901+0000","last_undegraded":"2024-03-19T06:22:13.782901+0000","last_fullsized":"2024-03-19T06:22:13.782901+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:32.790613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949639+0000","last_change":"2024-03-19T06:22:12.807735+0000","last_active":"2024-03-19T06:22:13.949639+0000","last_peered":"2024-03-19T06:22:13.949639+0000","last_clean":"2024-03-19T06:22:13.949639+0000","last_became_active":"2024-03-19T06:22:12.807440+0000","last_became_peered":"2024-03-19T06:22:12.807440+0000","last_unstale":"2024-03-19T06:22:13.949639+0000","last_undegraded":"2024-03-19T06:22:13.949639+0000","last_fullsized":"2024-03-19T06:22:13.949639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:36:33.458254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.771812+0000","last_change":"2024-03-19T06:22:10.771812+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.771812+0000","last_undegraded":"2024-03-19T06:22:10.771812+0000","last_fullsized":"2024-03-19T06:22:10.771812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.767905+0000","last_change":"2024-03-19T06:22:10.767905+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.767905+0000","last_undegraded":"2024-03-19T06:22:10.767905+0000","last_fullsized":"2024-03-19T06:22:10.767905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950121+0000","last_change":"2024-03-19T06:22:12.806044+0000","last_active":"2024-03-19T06:22:13.950121+0000","last_peered":"2024-03-19T06:22:13.950121+0000","last_clean":"2024-03-19T06:22:13.950121+0000","last_became_active":"2024-03-19T06:22:12.805753+0000","last_became_peered":"2024-03-19T06:22:12.805753+0000","last_unstale":"2024-03-19T06:22:13.950121+0000","last_undegraded":"2024-03-19T06:22:13.950121+0000","last_fullsized":"2024-03-19T06:22:13.950121+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:45:02.480430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782617+0000","last_change":"2024-03-19T06:22:11.782865+0000","last_active":"2024-03-19T06:22:13.782617+0000","last_peered":"2024-03-19T06:22:13.782617+0000","last_clean":"2024-03-19T06:22:13.782617+0000","last_became_active":"2024-03-19T06:22:11.781430+0000","last_became_peered":"2024-03-19T06:22:11.781430+0000","last_unstale":"2024-03-19T06:22:13.782617+0000","last_undegraded":"2024-03-19T06:22:13.782617+0000","last_fullsized":"2024-03-19T06:22:13.782617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:23:11.347650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.770372+0000","last_change":"2024-03-19T06:22:10.770372+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.770372+0000","last_undegraded":"2024-03-19T06:22:10.770372+0000","last_fullsized":"2024-03-19T06:22:10.770372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949778+0000","last_change":"2024-03-19T06:22:11.792783+0000","last_active":"2024-03-19T06:22:13.949778+0000","last_peered":"2024-03-19T06:22:13.949778+0000","last_clean":"2024-03-19T06:22:13.949778+0000","last_became_active":"2024-03-19T06:22:11.791824+0000","last_became_peered":"2024-03-19T06:22:11.791824+0000","last_unstale":"2024-03-19T06:22:13.949778+0000","last_undegraded":"2024-03-19T06:22:13.949778+0000","last_fullsized":"2024-03-19T06:22:13.949778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:23:23.700595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949696+0000","last_change":"2024-03-19T06:22:11.796432+0000","last_active":"2024-03-19T06:22:13.949696+0000","last_peered":"2024-03-19T06:22:13.949696+0000","last_clean":"2024-03-19T06:22:13.949696+0000","last_became_active":"2024-03-19T06:22:11.794614+0000","last_became_peered":"2024-03-19T06:22:11.794614+0000","last_unstale":"2024-03-19T06:22:13.949696+0000","last_undegraded":"2024-03-19T06:22:13.949696+0000","last_fullsized":"2024-03-19T06:22:13.949696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:15:41.175621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949428+0000","last_change":"2024-03-19T06:22:12.804385+0000","last_active":"2024-03-19T06:22:13.949428+0000","last_peered":"2024-03-19T06:22:13.949428+0000","last_clean":"2024-03-19T06:22:13.949428+0000","last_became_active":"2024-03-19T06:22:12.804022+0000","last_became_peered":"2024-03-19T06:22:12.804022+0000","last_unstale":"2024-03-19T06:22:13.949428+0000","last_undegraded":"2024-03-19T06:22:13.949428+0000","last_fullsized":"2024-03-19T06:22:13.949428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:41:28.053793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782068+0000","last_change":"2024-03-19T06:22:11.785078+0000","last_active":"2024-03-19T06:22:13.782068+0000","last_peered":"2024-03-19T06:22:13.782068+0000","last_clean":"2024-03-19T06:22:13.782068+0000","last_became_active":"2024-03-19T06:22:11.783561+0000","last_became_peered":"2024-03-19T06:22:11.783561+0000","last_unstale":"2024-03-19T06:22:13.782068+0000","last_undegraded":"2024-03-19T06:22:13.782068+0000","last_fullsized":"2024-03-19T06:22:13.782068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:38:39.623722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949201+0000","last_change":"2024-03-19T06:22:11.796210+0000","last_active":"2024-03-19T06:22:13.949201+0000","last_peered":"2024-03-19T06:22:13.949201+0000","last_clean":"2024-03-19T06:22:13.949201+0000","last_became_active":"2024-03-19T06:22:11.795816+0000","last_became_peered":"2024-03-19T06:22:11.795816+0000","last_unstale":"2024-03-19T06:22:13.949201+0000","last_undegraded":"2024-03-19T06:22:13.949201+0000","last_fullsized":"2024-03-19T06:22:13.949201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:26:41.154332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782834+0000","last_change":"2024-03-19T06:22:11.797779+0000","last_active":"2024-03-19T06:22:13.782834+0000","last_peered":"2024-03-19T06:22:13.782834+0000","last_clean":"2024-03-19T06:22:13.782834+0000","last_became_active":"2024-03-19T06:22:11.797477+0000","last_became_peered":"2024-03-19T06:22:11.797477+0000","last_unstale":"2024-03-19T06:22:13.782834+0000","last_undegraded":"2024-03-19T06:22:13.782834+0000","last_fullsized":"2024-03-19T06:22:13.782834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:58:59.662492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782810+0000","last_change":"2024-03-19T06:22:12.801487+0000","last_active":"2024-03-19T06:22:13.782810+0000","last_peered":"2024-03-19T06:22:13.782810+0000","last_clean":"2024-03-19T06:22:13.782810+0000","last_became_active":"2024-03-19T06:22:12.801196+0000","last_became_peered":"2024-03-19T06:22:12.801196+0000","last_unstale":"2024-03-19T06:22:13.782810+0000","last_undegraded":"2024-03-19T06:22:13.782810+0000","last_fullsized":"2024-03-19T06:22:13.782810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:37:25.965590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.767410+0000","last_change":"2024-03-19T06:22:10.767410+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.767410+0000","last_undegraded":"2024-03-19T06:22:10.767410+0000","last_fullsized":"2024-03-19T06:22:10.767410+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782617+0000","last_change":"2024-03-19T06:22:12.814392+0000","last_active":"2024-03-19T06:22:13.782617+0000","last_peered":"2024-03-19T06:22:13.782617+0000","last_clean":"2024-03-19T06:22:13.782617+0000","last_became_active":"2024-03-19T06:22:12.813815+0000","last_became_peered":"2024-03-19T06:22:12.813815+0000","last_unstale":"2024-03-19T06:22:13.782617+0000","last_undegraded":"2024-03-19T06:22:13.782617+0000","last_fullsized":"2024-03-19T06:22:13.782617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:54:29.091078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.768049+0000","last_change":"2024-03-19T06:22:10.768049+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.768049+0000","last_undegraded":"2024-03-19T06:22:10.768049+0000","last_fullsized":"2024-03-19T06:22:10.768049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782699+0000","last_change":"2024-03-19T06:22:11.791858+0000","last_active":"2024-03-19T06:22:13.782699+0000","last_peered":"2024-03-19T06:22:13.782699+0000","last_clean":"2024-03-19T06:22:13.782699+0000","last_became_active":"2024-03-19T06:22:11.791423+0000","last_became_peered":"2024-03-19T06:22:11.791423+0000","last_unstale":"2024-03-19T06:22:13.782699+0000","last_undegraded":"2024-03-19T06:22:13.782699+0000","last_fullsized":"2024-03-19T06:22:13.782699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:15:48.178564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949920+0000","last_change":"2024-03-19T06:22:11.796046+0000","last_active":"2024-03-19T06:22:13.949920+0000","last_peered":"2024-03-19T06:22:13.949920+0000","last_clean":"2024-03-19T06:22:13.949920+0000","last_became_active":"2024-03-19T06:22:11.794808+0000","last_became_peered":"2024-03-19T06:22:11.794808+0000","last_unstale":"2024-03-19T06:22:13.949920+0000","last_undegraded":"2024-03-19T06:22:13.949920+0000","last_fullsized":"2024-03-19T06:22:13.949920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:52:11.332786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782532+0000","last_change":"2024-03-19T06:22:12.807613+0000","last_active":"2024-03-19T06:22:13.782532+0000","last_peered":"2024-03-19T06:22:13.782532+0000","last_clean":"2024-03-19T06:22:13.782532+0000","last_became_active":"2024-03-19T06:22:12.807323+0000","last_became_peered":"2024-03-19T06:22:12.807323+0000","last_unstale":"2024-03-19T06:22:13.782532+0000","last_undegraded":"2024-03-19T06:22:13.782532+0000","last_fullsized":"2024-03-19T06:22:13.782532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:34:23.250483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.770913+0000","last_change":"2024-03-19T06:22:10.770913+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.770913+0000","last_undegraded":"2024-03-19T06:22:10.770913+0000","last_fullsized":"2024-03-19T06:22:10.770913+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782082+0000","last_change":"2024-03-19T06:22:11.792957+0000","last_active":"2024-03-19T06:22:13.782082+0000","last_peered":"2024-03-19T06:22:13.782082+0000","last_clean":"2024-03-19T06:22:13.782082+0000","last_became_active":"2024-03-19T06:22:11.792682+0000","last_became_peered":"2024-03-19T06:22:11.792682+0000","last_unstale":"2024-03-19T06:22:13.782082+0000","last_undegraded":"2024-03-19T06:22:13.782082+0000","last_fullsized":"2024-03-19T06:22:13.782082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:24.575297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782011+0000","last_change":"2024-03-19T06:22:11.782315+0000","last_active":"2024-03-19T06:22:13.782011+0000","last_peered":"2024-03-19T06:22:13.782011+0000","last_clean":"2024-03-19T06:22:13.782011+0000","last_became_active":"2024-03-19T06:22:11.782022+0000","last_became_peered":"2024-03-19T06:22:11.782022+0000","last_unstale":"2024-03-19T06:22:13.782011+0000","last_undegraded":"2024-03-19T06:22:13.782011+0000","last_fullsized":"2024-03-19T06:22:13.782011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:59:59.683815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949806+0000","last_change":"2024-03-19T06:22:12.807959+0000","last_active":"2024-03-19T06:22:13.949806+0000","last_peered":"2024-03-19T06:22:13.949806+0000","last_clean":"2024-03-19T06:22:13.949806+0000","last_became_active":"2024-03-19T06:22:12.807622+0000","last_became_peered":"2024-03-19T06:22:12.807622+0000","last_unstale":"2024-03-19T06:22:13.949806+0000","last_undegraded":"2024-03-19T06:22:13.949806+0000","last_fullsized":"2024-03-19T06:22:13.949806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:59:00.668563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.771355+0000","last_change":"2024-03-19T06:22:10.771355+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.771355+0000","last_undegraded":"2024-03-19T06:22:10.771355+0000","last_fullsized":"2024-03-19T06:22:10.771355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949947+0000","last_change":"2024-03-19T06:22:11.789922+0000","last_active":"2024-03-19T06:22:13.949947+0000","last_peered":"2024-03-19T06:22:13.949947+0000","last_clean":"2024-03-19T06:22:13.949947+0000","last_became_active":"2024-03-19T06:22:11.789318+0000","last_became_peered":"2024-03-19T06:22:11.789318+0000","last_unstale":"2024-03-19T06:22:13.949947+0000","last_undegraded":"2024-03-19T06:22:13.949947+0000","last_fullsized":"2024-03-19T06:22:13.949947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:57:16.843221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950093+0000","last_change":"2024-03-19T06:22:11.792226+0000","last_active":"2024-03-19T06:22:13.950093+0000","last_peered":"2024-03-19T06:22:13.950093+0000","last_clean":"2024-03-19T06:22:13.950093+0000","last_became_active":"2024-03-19T06:22:11.791854+0000","last_became_peered":"2024-03-19T06:22:11.791854+0000","last_unstale":"2024-03-19T06:22:13.950093+0000","last_undegraded":"2024-03-19T06:22:13.950093+0000","last_fullsized":"2024-03-19T06:22:13.950093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:25:13.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949809+0000","last_change":"2024-03-19T06:22:11.792381+0000","last_active":"2024-03-19T06:22:13.949809+0000","last_peered":"2024-03-19T06:22:13.949809+0000","last_clean":"2024-03-19T06:22:13.949809+0000","last_became_active":"2024-03-19T06:22:11.792047+0000","last_became_peered":"2024-03-19T06:22:11.792047+0000","last_unstale":"2024-03-19T06:22:13.949809+0000","last_undegraded":"2024-03-19T06:22:13.949809+0000","last_fullsized":"2024-03-19T06:22:13.949809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:03:44.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.767402+0000","last_change":"2024-03-19T06:22:10.767402+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.767402+0000","last_undegraded":"2024-03-19T06:22:10.767402+0000","last_fullsized":"2024-03-19T06:22:10.767402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.771798+0000","last_change":"2024-03-19T06:22:10.771798+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.771798+0000","last_undegraded":"2024-03-19T06:22:10.771798+0000","last_fullsized":"2024-03-19T06:22:10.771798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949359+0000","last_change":"2024-03-19T06:22:11.794192+0000","last_active":"2024-03-19T06:22:13.949359+0000","last_peered":"2024-03-19T06:22:13.949359+0000","last_clean":"2024-03-19T06:22:13.949359+0000","last_became_active":"2024-03-19T06:22:11.793919+0000","last_became_peered":"2024-03-19T06:22:11.793919+0000","last_unstale":"2024-03-19T06:22:13.949359+0000","last_undegraded":"2024-03-19T06:22:13.949359+0000","last_fullsized":"2024-03-19T06:22:13.949359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:12:38.916099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.768039+0000","last_change":"2024-03-19T06:22:10.768039+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.768039+0000","last_undegraded":"2024-03-19T06:22:10.768039+0000","last_fullsized":"2024-03-19T06:22:10.768039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.770186+0000","last_change":"2024-03-19T06:22:10.770186+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.770186+0000","last_undegraded":"2024-03-19T06:22:10.770186+0000","last_fullsized":"2024-03-19T06:22:10.770186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.766840+0000","last_change":"2024-03-19T06:22:10.766840+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.766840+0000","last_undegraded":"2024-03-19T06:22:10.766840+0000","last_fullsized":"2024-03-19T06:22:10.766840+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.769623+0000","last_change":"2024-03-19T06:22:10.769623+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.769623+0000","last_undegraded":"2024-03-19T06:22:10.769623+0000","last_fullsized":"2024-03-19T06:22:10.769623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.766857+0000","last_change":"2024-03-19T06:22:10.766857+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.766857+0000","last_undegraded":"2024-03-19T06:22:10.766857+0000","last_fullsized":"2024-03-19T06:22:10.766857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.770464+0000","last_change":"2024-03-19T06:22:10.770464+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.770464+0000","last_undegraded":"2024-03-19T06:22:10.770464+0000","last_fullsized":"2024-03-19T06:22:10.770464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.781975+0000","last_change":"2024-03-19T06:22:12.798059+0000","last_active":"2024-03-19T06:22:13.781975+0000","last_peered":"2024-03-19T06:22:13.781975+0000","last_clean":"2024-03-19T06:22:13.781975+0000","last_became_active":"2024-03-19T06:22:12.797589+0000","last_became_peered":"2024-03-19T06:22:12.797589+0000","last_unstale":"2024-03-19T06:22:13.781975+0000","last_undegraded":"2024-03-19T06:22:13.781975+0000","last_fullsized":"2024-03-19T06:22:13.781975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:38.121363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949473+0000","last_change":"2024-03-19T06:22:11.781136+0000","last_active":"2024-03-19T06:22:13.949473+0000","last_peered":"2024-03-19T06:22:13.949473+0000","last_clean":"2024-03-19T06:22:13.949473+0000","last_became_active":"2024-03-19T06:22:11.780619+0000","last_became_peered":"2024-03-19T06:22:11.780619+0000","last_unstale":"2024-03-19T06:22:13.949473+0000","last_undegraded":"2024-03-19T06:22:13.949473+0000","last_fullsized":"2024-03-19T06:22:13.949473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:08:55.885727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949388+0000","last_change":"2024-03-19T06:22:12.800198+0000","last_active":"2024-03-19T06:22:13.949388+0000","last_peered":"2024-03-19T06:22:13.949388+0000","last_clean":"2024-03-19T06:22:13.949388+0000","last_became_active":"2024-03-19T06:22:12.799781+0000","last_became_peered":"2024-03-19T06:22:12.799781+0000","last_unstale":"2024-03-19T06:22:13.949388+0000","last_undegraded":"2024-03-19T06:22:13.949388+0000","last_fullsized":"2024-03-19T06:22:13.949388+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:14.509578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782072+0000","last_change":"2024-03-19T06:22:11.797400+0000","last_active":"2024-03-19T06:22:13.782072+0000","last_peered":"2024-03-19T06:22:13.782072+0000","last_clean":"2024-03-19T06:22:13.782072+0000","last_became_active":"2024-03-19T06:22:11.797126+0000","last_became_peered":"2024-03-19T06:22:11.797126+0000","last_unstale":"2024-03-19T06:22:13.782072+0000","last_undegraded":"2024-03-19T06:22:13.782072+0000","last_fullsized":"2024-03-19T06:22:13.782072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:13.503507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:22:11.762678+0000","last_change":"2024-03-19T06:22:11.762678+0000","last_active":"2024-03-19T06:22:11.762678+0000","last_peered":"2024-03-19T06:22:11.762678+0000","last_clean":"2024-03-19T06:22:11.762678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:11.762678+0000","last_undegraded":"2024-03-19T06:22:11.762678+0000","last_fullsized":"2024-03-19T06:22:11.762678+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-03-19T06:22:10.772176+0000","last_change":"2024-03-19T06:22:10.772176+0000","last_active":"2024-03-19T06:22:10.756607+0000","last_peered":"2024-03-19T06:22:10.756607+0000","last_clean":"2024-03-19T06:22:10.756607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:22:10.772176+0000","last_undegraded":"2024-03-19T06:22:10.772176+0000","last_fullsized":"2024-03-19T06:22:10.772176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:22:10.772060+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:22:10.772060+0000","last_peered":"2024-03-19T06:22:10.772060+0000","last_clean":"2024-03-19T06:22:10.772060+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:22:10.772060+0000","last_undegraded":"2024-03-19T06:22:10.772060+0000","last_fullsized":"2024-03-19T06:22:10.772060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1716,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":717741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":127373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":339968,"data_stored":127373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":133190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":133190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":933888,"data_stored":717741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":152636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":405504,"data_stored":154166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:22:17.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-03-19T06:22:17.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-03-19T06:22:17.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-03-19T06:22:17.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-03-19T06:22:17.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-03-19T06:22:17.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-03-19T06:22:17.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-03-19T06:22:17.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-03-19T06:22:17.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-03-19T06:22:17.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-03-19T06:22:17.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-03-19T06:22:17.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-03-19T06:22:17.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-03-19T06:22:17.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-03-19T06:22:17.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-03-19T06:22:17.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-03-19T06:22:17.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-03-19T06:22:17.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-03-19T06:22:17.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-03-19T06:22:17.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-03-19T06:22:17.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-03-19T06:22:17.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-03-19T06:22:17.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-03-19T06:22:17.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-03-19T06:22:17.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:22:10.771812+0000', 'last_change': '2024-03-19T06:22:10.771812+0000', 'last_active': '2024-03-19T06:22:10.756607+0000', 'last_peered': '2024-03-19T06:22:10.756607+0000', 'last_clean': '2024-03-19T06:22:10.756607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:10.771812+0000', 'last_undegraded': '2024-03-19T06:22:10.771812+0000', 'last_fullsized': '2024-03-19T06:22:10.771812+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-19T06:22:17.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-03-19T06:22:17.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-03-19T06:22:17.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:22:10.767905+0000', 'last_change': '2024-03-19T06:22:10.767905+0000', 'last_active': '2024-03-19T06:22:10.756607+0000', 'last_peered': '2024-03-19T06:22:10.756607+0000', 'last_clean': '2024-03-19T06:22:10.756607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:10.767905+0000', 'last_undegraded': '2024-03-19T06:22:10.767905+0000', 'last_fullsized': '2024-03-19T06:22:10.767905+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-19T06:22:17.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-03-19T06:22:17.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-03-19T06:22:17.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:22:10.770372+0000', 'last_change': '2024-03-19T06:22:10.770372+0000', 'last_active': '2024-03-19T06:22:10.756607+0000', 'last_peered': '2024-03-19T06:22:10.756607+0000', 'last_clean': '2024-03-19T06:22:10.756607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:10.770372+0000', 'last_undegraded': '2024-03-19T06:22:10.770372+0000', 'last_fullsized': '2024-03-19T06:22:10.770372+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-19T06:22:17.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-03-19T06:22:17.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-03-19T06:22:17.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-03-19T06:22:17.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-03-19T06:22:17.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-03-19T06:22:17.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:22:10.767410+0000', 'last_change': '2024-03-19T06:22:10.767410+0000', 'last_active': '2024-03-19T06:22:10.756607+0000', 'last_peered': '2024-03-19T06:22:10.756607+0000', 'last_clean': '2024-03-19T06:22:10.756607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:10.767410+0000', 'last_undegraded': '2024-03-19T06:22:10.767410+0000', 'last_fullsized': '2024-03-19T06:22:10.767410+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-19T06:22:17.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-03-19T06:22:17.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:22:10.768049+0000', 'last_change': '2024-03-19T06:22:10.768049+0000', 'last_active': '2024-03-19T06:22:10.756607+0000', 'last_peered': '2024-03-19T06:22:10.756607+0000', 'last_clean': '2024-03-19T06:22:10.756607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:10.768049+0000', 'last_undegraded': '2024-03-19T06:22:10.768049+0000', 'last_fullsized': '2024-03-19T06:22:10.768049+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-19T06:22:17.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-03-19T06:22:17.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-03-19T06:22:17.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-03-19T06:22:17.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:22:10.770913+0000', 'last_change': '2024-03-19T06:22:10.770913+0000', 'last_active': '2024-03-19T06:22:10.756607+0000', 'last_peered': '2024-03-19T06:22:10.756607+0000', 'last_clean': '2024-03-19T06:22:10.756607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:10.770913+0000', 'last_undegraded': '2024-03-19T06:22:10.770913+0000', 'last_fullsized': '2024-03-19T06:22:10.770913+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-19T06:22:17.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-03-19T06:22:17.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-03-19T06:22:17.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-03-19T06:22:17.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:22:10.771355+0000', 'last_change': '2024-03-19T06:22:10.771355+0000', 'last_active': '2024-03-19T06:22:10.756607+0000', 'last_peered': '2024-03-19T06:22:10.756607+0000', 'last_clean': '2024-03-19T06:22:10.756607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:10.771355+0000', 'last_undegraded': '2024-03-19T06:22:10.771355+0000', 'last_fullsized': '2024-03-19T06:22:10.771355+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-19T06:22:17.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-03-19T06:22:17.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-03-19T06:22:17.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-03-19T06:22:17.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-03-19T06:22:17.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-03-19T06:22:17.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:22:10.767402+0000', 'last_change': '2024-03-19T06:22:10.767402+0000', 'last_active': '2024-03-19T06:22:10.756607+0000', 'last_peered': '2024-03-19T06:22:10.756607+0000', 'last_clean': '2024-03-19T06:22:10.756607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:10.767402+0000', 'last_undegraded': '2024-03-19T06:22:10.767402+0000', 'last_fullsized': '2024-03-19T06:22:10.767402+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-19T06:22:17.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-03-19T06:22:17.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-03-19T06:22:17.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:22:10.771798+0000', 'last_change': '2024-03-19T06:22:10.771798+0000', 'last_active': '2024-03-19T06:22:10.756607+0000', 'last_peered': '2024-03-19T06:22:10.756607+0000', 'last_clean': '2024-03-19T06:22:10.756607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:10.771798+0000', 'last_undegraded': '2024-03-19T06:22:10.771798+0000', 'last_fullsized': '2024-03-19T06:22:10.771798+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-19T06:22:17.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-03-19T06:22:17.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-03-19T06:22:17.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-03-19T06:22:17.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:22:10.768039+0000', 'last_change': '2024-03-19T06:22:10.768039+0000', 'last_active': '2024-03-19T06:22:10.756607+0000', 'last_peered': '2024-03-19T06:22:10.756607+0000', 'last_clean': '2024-03-19T06:22:10.756607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:10.768039+0000', 'last_undegraded': '2024-03-19T06:22:10.768039+0000', 'last_fullsized': '2024-03-19T06:22:10.768039+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-19T06:22:17.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-03-19T06:22:17.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-03-19T06:22:17.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:22:10.770186+0000', 'last_change': '2024-03-19T06:22:10.770186+0000', 'last_active': '2024-03-19T06:22:10.756607+0000', 'last_peered': '2024-03-19T06:22:10.756607+0000', 'last_clean': '2024-03-19T06:22:10.756607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:10.770186+0000', 'last_undegraded': '2024-03-19T06:22:10.770186+0000', 'last_fullsized': '2024-03-19T06:22:10.770186+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-19T06:22:17.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-03-19T06:22:17.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-03-19T06:22:17.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:22:10.766840+0000', 'last_change': '2024-03-19T06:22:10.766840+0000', 'last_active': '2024-03-19T06:22:10.756607+0000', 'last_peered': '2024-03-19T06:22:10.756607+0000', 'last_clean': '2024-03-19T06:22:10.756607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:10.766840+0000', 'last_undegraded': '2024-03-19T06:22:10.766840+0000', 'last_fullsized': '2024-03-19T06:22:10.766840+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-19T06:22:17.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-03-19T06:22:17.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-03-19T06:22:17.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:22:10.769623+0000', 'last_change': '2024-03-19T06:22:10.769623+0000', 'last_active': '2024-03-19T06:22:10.756607+0000', 'last_peered': '2024-03-19T06:22:10.756607+0000', 'last_clean': '2024-03-19T06:22:10.756607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:10.769623+0000', 'last_undegraded': '2024-03-19T06:22:10.769623+0000', 'last_fullsized': '2024-03-19T06:22:10.769623+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-19T06:22:17.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-03-19T06:22:17.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-03-19T06:22:17.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:22:10.766857+0000', 'last_change': '2024-03-19T06:22:10.766857+0000', 'last_active': '2024-03-19T06:22:10.756607+0000', 'last_peered': '2024-03-19T06:22:10.756607+0000', 'last_clean': '2024-03-19T06:22:10.756607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:10.766857+0000', 'last_undegraded': '2024-03-19T06:22:10.766857+0000', 'last_fullsized': '2024-03-19T06:22:10.766857+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-19T06:22:17.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-03-19T06:22:17.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-03-19T06:22:17.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:22:10.770464+0000', 'last_change': '2024-03-19T06:22:10.770464+0000', 'last_active': '2024-03-19T06:22:10.756607+0000', 'last_peered': '2024-03-19T06:22:10.756607+0000', 'last_clean': '2024-03-19T06:22:10.756607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:10.770464+0000', 'last_undegraded': '2024-03-19T06:22:10.770464+0000', 'last_fullsized': '2024-03-19T06:22:10.770464+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-19T06:22:17.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-03-19T06:22:17.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:22:11.762678+0000', 'last_change': '2024-03-19T06:22:11.762678+0000', 'last_active': '2024-03-19T06:22:11.762678+0000', 'last_peered': '2024-03-19T06:22:11.762678+0000', 'last_clean': '2024-03-19T06:22:11.762678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:11.762678+0000', 'last_undegraded': '2024-03-19T06:22:11.762678+0000', 'last_fullsized': '2024-03-19T06:22:11.762678+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:11.762678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:22:17.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-03-19T06:22:17.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:22:10.772176+0000', 'last_change': '2024-03-19T06:22:10.772176+0000', 'last_active': '2024-03-19T06:22:10.756607+0000', 'last_peered': '2024-03-19T06:22:10.756607+0000', 'last_clean': '2024-03-19T06:22:10.756607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:22:10.772176+0000', 'last_undegraded': '2024-03-19T06:22:10.772176+0000', 'last_fullsized': '2024-03-19T06:22:10.772176+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'last_clean_scrub_stamp': '2024-03-19T06:22:10.756607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-19T06:22:17.694 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-19T06:22:17.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.872+0000 7f2ed0800640 1 Processor -- start 2024-03-19T06:22:17.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.872+0000 7f2ed0800640 1 -- start start 2024-03-19T06:22:17.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.872+0000 7f2ed0800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ec8099a70 0x7f2ec8099e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.872+0000 7f2ed0800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2ec806c060 0x7f2ec815e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.872+0000 7f2ed0800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec806fbe0 con 0x7f2ec8161860 2024-03-19T06:22:17.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.872+0000 7f2ed0800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec809a390 con 0x7f2ec806c060 2024-03-19T06:22:17.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.872+0000 7f2ed0800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec815e940 con 0x7f2ec8099a70 2024-03-19T06:22:17.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.872+0000 7f2ecd400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2ec806c060 0x7f2ec815e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.872+0000 7f2ecd400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2ec806c060 0x7f2ec815e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56694/0 (socket says 172.21.15.32:56694) 2024-03-19T06:22:17.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.872+0000 7f2ecd400640 1 -- 172.21.15.32:0/1182311919 learned_addr learned my addr 172.21.15.32:0/1182311919 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:17.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.872+0000 7f2ecde00640 1 --2- 172.21.15.32:0/1182311919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ec8099a70 0x7f2ec8099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.872+0000 7f2ecd400640 1 -- 172.21.15.32:0/1182311919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ec8099a70 msgr2=0x7f2ec8099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:17.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.872+0000 7f2ecd400640 1 --2- 172.21.15.32:0/1182311919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ec8099a70 0x7f2ec8099e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.872+0000 7f2ecd400640 1 -- 172.21.15.32:0/1182311919 >> v1:172.21.15.171:6789/0 conn(0x7f2ec8161860 legacy=0x7f2ec8161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:17.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.872+0000 7f2ecd400640 1 -- 172.21.15.32:0/1182311919 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec815ec20 con 0x7f2ec806c060 2024-03-19T06:22:17.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.876+0000 7f2ecd400640 1 --2- 172.21.15.32:0/1182311919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ec806c060 0x7f2ec815e010 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8009870 tx=0x7f2eb801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9643be881a5f21 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:17.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.876+0000 7f2ecca00640 1 -- 172.21.15.32:0/1182311919 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb80b0070 con 0x7f2ec806c060 2024-03-19T06:22:17.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.876+0000 7f2ecca00640 1 -- 172.21.15.32:0/1182311919 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb80ab600 con 0x7f2ec806c060 2024-03-19T06:22:17.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.876+0000 7f2ecca00640 1 -- 172.21.15.32:0/1182311919 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb80ab9d0 con 0x7f2ec806c060 2024-03-19T06:22:17.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.876+0000 7f2ed0800640 1 -- 172.21.15.32:0/1182311919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ec806c060 msgr2=0x7f2ec815e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:17.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.876+0000 7f2ed0800640 1 --2- 172.21.15.32:0/1182311919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ec806c060 0x7f2ec815e010 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8009870 tx=0x7f2eb801c340 comp rx=0 tx=0).stop 2024-03-19T06:22:17.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.876+0000 7f2ed0800640 1 -- 172.21.15.32:0/1182311919 shutdown_connections 2024-03-19T06:22:17.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.876+0000 7f2ed0800640 1 --2- 172.21.15.32:0/1182311919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ec806c060 0x7f2ec815e010 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.876+0000 7f2ed0800640 1 --2- 172.21.15.32:0/1182311919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ec8099a70 0x7f2ec8099e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.876+0000 7f2ed0800640 1 -- 172.21.15.32:0/1182311919 >> 172.21.15.32:0/1182311919 conn(0x7f2ec80b3300 msgr2=0x7f2ec80b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:17.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.876+0000 7f2ed0800640 1 -- 172.21.15.32:0/1182311919 shutdown_connections 2024-03-19T06:22:17.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.876+0000 7f2ed0800640 1 -- 172.21.15.32:0/1182311919 wait complete. 2024-03-19T06:22:17.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.876+0000 7f2ed0800640 1 Processor -- start 2024-03-19T06:22:17.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.876+0000 7f2ed0800640 1 -- start start 2024-03-19T06:22:17.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ed0800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ec806c060 0x7f2ec815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ed0800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ec8099a70 0x7f2ec80cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ed0800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ec8161860 0x7f2ec80b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ed0800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec815e6d0 con 0x7f2ec8161860 2024-03-19T06:22:17.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ed0800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec815e550 con 0x7f2ec8099a70 2024-03-19T06:22:17.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ed0800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec816b410 con 0x7f2ec806c060 2024-03-19T06:22:17.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ece800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ec8161860 0x7f2ec80b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ece800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ec8161860 0x7f2ec80b1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56704/0 (socket says 172.21.15.32:56704) 2024-03-19T06:22:17.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ece800640 1 -- 172.21.15.32:0/3678631806 learned_addr learned my addr 172.21.15.32:0/3678631806 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:17.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ecd400640 1 --2- 172.21.15.32:0/3678631806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ec8099a70 0x7f2ec80cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ecde00640 1 --2- 172.21.15.32:0/3678631806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ec806c060 0x7f2ec815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ece800640 1 -- 172.21.15.32:0/3678631806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ec806c060 msgr2=0x7f2ec815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:17.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ece800640 1 --2- 172.21.15.32:0/3678631806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ec806c060 0x7f2ec815aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ece800640 1 -- 172.21.15.32:0/3678631806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ec8099a70 msgr2=0x7f2ec80cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:17.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ece800640 1 --2- 172.21.15.32:0/3678631806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ec8099a70 0x7f2ec80cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:17.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ece800640 1 -- 172.21.15.32:0/3678631806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec80cd080 con 0x7f2ec8161860 2024-03-19T06:22:17.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ece800640 1 --2- 172.21.15.32:0/3678631806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ec8161860 0x7f2ec80b1270 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400c7b0 tx=0x7f2ec400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:17.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ec2000640 1 -- 172.21.15.32:0/3678631806 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4004b70 con 0x7f2ec8161860 2024-03-19T06:22:17.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ec2000640 1 -- 172.21.15.32:0/3678631806 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec4004d10 con 0x7f2ec8161860 2024-03-19T06:22:17.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ec2000640 1 -- 172.21.15.32:0/3678631806 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec400aa90 con 0x7f2ec8161860 2024-03-19T06:22:17.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ed0800640 1 -- 172.21.15.32:0/3678631806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec80cd360 con 0x7f2ec8161860 2024-03-19T06:22:17.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ed0800640 1 -- 172.21.15.32:0/3678631806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec80c8bc0 con 0x7f2ec8161860 2024-03-19T06:22:17.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ed0800640 1 -- 172.21.15.32:0/3678631806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec80749e0 con 0x7f2ec8161860 2024-03-19T06:22:17.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.880+0000 7f2ec2000640 1 -- 172.21.15.32:0/3678631806 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2ec400ac30 con 0x7f2ec8161860 2024-03-19T06:22:17.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.884+0000 7f2ec2000640 1 --2- 172.21.15.32:0/3678631806 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2eac067660 0x7f2eac069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:17.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.884+0000 7f2ec2000640 1 -- 172.21.15.32:0/3678631806 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ec4085990 con 0x7f2ec8161860 2024-03-19T06:22:17.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.884+0000 7f2ecde00640 1 --2- 172.21.15.32:0/3678631806 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2eac067660 0x7f2eac069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:17.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.884+0000 7f2ecde00640 1 --2- 172.21.15.32:0/3678631806 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2eac067660 0x7f2eac069b20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80cc760 tx=0x7f2ebc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:17.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:17.888+0000 7f2ec2000640 1 -- 172.21.15.32:0/3678631806 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2ec4020070 con 0x7f2ec8161860 2024-03-19T06:22:18.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.108+0000 7f2ed0800640 1 -- 172.21.15.32:0/3678631806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2ec80b30e0 con 0x7f2ec8161860 2024-03-19T06:22:18.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.112+0000 7f2ec2000640 1 -- 172.21.15.32:0/3678631806 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1335 (secure 0 0 0) 0x7f2ec4056030 con 0x7f2ec8161860 2024-03-19T06:22:18.103 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:18.103 INFO:teuthology.orchestra.run.smithi032.stdout:{"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":94,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1710829255,"num_in_osds":8,"osd_in_since":1710829246,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":46},{"state_name":"active+clean","count":35},{"state_name":"creating+peering","count":16}],"num_pgs":97,"num_pools":3,"num_objects":15,"data_bytes":592084,"bytes_used":242495488,"bytes_avail":772851617792,"bytes_total":773094113280,"unknown_pgs_ratio":0.47422680258750916,"inactive_pgs_ratio":0.16494844853878021,"write_bytes_sec":2178,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5229}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-03-19T06:22:03.933524+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-03-19T06:22:18.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.112+0000 7f2ed0800640 1 -- 172.21.15.32:0/3678631806 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2eac067660 msgr2=0x7f2eac069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:18.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.112+0000 7f2ed0800640 1 --2- 172.21.15.32:0/3678631806 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2eac067660 0x7f2eac069b20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80cc760 tx=0x7f2ebc008040 comp rx=0 tx=0).stop 2024-03-19T06:22:18.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.112+0000 7f2ed0800640 1 -- 172.21.15.32:0/3678631806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ec8161860 msgr2=0x7f2ec80b1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:18.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.112+0000 7f2ed0800640 1 --2- 172.21.15.32:0/3678631806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ec8161860 0x7f2ec80b1270 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400c7b0 tx=0x7f2ec400cc70 comp rx=0 tx=0).stop 2024-03-19T06:22:18.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.112+0000 7f2ed0800640 1 -- 172.21.15.32:0/3678631806 shutdown_connections 2024-03-19T06:22:18.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.112+0000 7f2ed0800640 1 --2- 172.21.15.32:0/3678631806 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2eac067660 0x7f2eac069b20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:18.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.112+0000 7f2ed0800640 1 --2- 172.21.15.32:0/3678631806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ec8161860 0x7f2ec80b1270 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:18.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.112+0000 7f2ed0800640 1 --2- 172.21.15.32:0/3678631806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ec8099a70 0x7f2ec80cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:18.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.112+0000 7f2ed0800640 1 --2- 172.21.15.32:0/3678631806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ec806c060 0x7f2ec815aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:18.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.112+0000 7f2ed0800640 1 -- 172.21.15.32:0/3678631806 >> 172.21.15.32:0/3678631806 conn(0x7f2ec80b3300 msgr2=0x7f2ec80d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:18.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.112+0000 7f2ed0800640 1 -- 172.21.15.32:0/3678631806 shutdown_connections 2024-03-19T06:22:18.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.112+0000 7f2ed0800640 1 -- 172.21.15.32:0/3678631806 wait complete. 2024-03-19T06:22:18.123 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-19T06:22:18.123 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:22:18.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.272+0000 7f335c000640 1 Processor -- start 2024-03-19T06:22:18.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.272+0000 7f335c000640 1 -- start start 2024-03-19T06:22:18.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.272+0000 7f335c000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f33540cc6a0 0x7f33541660d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:18.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.272+0000 7f335c000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33540cdcf0 con 0x7f335406d590 2024-03-19T06:22:18.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.272+0000 7f335c000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33540cdfd0 con 0x7f3354162050 2024-03-19T06:22:18.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.272+0000 7f335c000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33540ca310 con 0x7f33540cc6a0 2024-03-19T06:22:18.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.272+0000 7f3358c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f335406d590 0x7f33540cbf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60916/0 (socket says 172.21.15.32:60916) 2024-03-19T06:22:18.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.272+0000 7f3358c00640 1 -- 172.21.15.32:0/849306589 learned_addr learned my addr 172.21.15.32:0/849306589 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:18.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.272+0000 7f335a000640 1 --2- 172.21.15.32:0/849306589 >> v2:172.21.15.32:3300/0 conn(0x7f33540cc6a0 0x7f33541660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:18.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.272+0000 7f3353e00640 1 -- 172.21.15.32:0/849306589 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679979137 0 0) 0x7f33540cdcf0 con 0x7f335406d590 2024-03-19T06:22:18.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.272+0000 7f335a000640 1 -- 172.21.15.32:0/849306589 >> v1:172.21.15.171:6789/0 conn(0x7f3354162050 legacy=0x7f33540c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:18.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.272+0000 7f335a000640 1 -- 172.21.15.32:0/849306589 >> v1:172.21.15.32:6789/0 conn(0x7f335406d590 legacy=0x7f33540cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:18.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.272+0000 7f335a000640 1 -- 172.21.15.32:0/849306589 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33540ce2b0 con 0x7f33540cc6a0 2024-03-19T06:22:18.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.276+0000 7f335a000640 1 --2- 172.21.15.32:0/849306589 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33540cc6a0 0x7f33541660d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f334c009d90 tx=0x7f334c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fa99e159304bcf server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:18.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.276+0000 7f3353e00640 1 -- 172.21.15.32:0/849306589 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c0b2070 con 0x7f33540cc6a0 2024-03-19T06:22:18.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.276+0000 7f3353e00640 1 -- 172.21.15.32:0/849306589 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c0a57f0 con 0x7f33540cc6a0 2024-03-19T06:22:18.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.276+0000 7f3353e00640 1 -- 172.21.15.32:0/849306589 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c0a5bc0 con 0x7f33540cc6a0 2024-03-19T06:22:18.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.276+0000 7f335c000640 1 -- 172.21.15.32:0/849306589 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33540cc6a0 msgr2=0x7f33541660d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:18.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.276+0000 7f335c000640 1 --2- 172.21.15.32:0/849306589 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33540cc6a0 0x7f33541660d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f334c009d90 tx=0x7f334c01c930 comp rx=0 tx=0).stop 2024-03-19T06:22:18.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.276+0000 7f335c000640 1 -- 172.21.15.32:0/849306589 shutdown_connections 2024-03-19T06:22:18.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.276+0000 7f335c000640 1 --2- 172.21.15.32:0/849306589 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33540cc6a0 0x7f33541660d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:18.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.276+0000 7f335c000640 1 -- 172.21.15.32:0/849306589 >> 172.21.15.32:0/849306589 conn(0x7f33540b1280 msgr2=0x7f33540b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:18.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.276+0000 7f335c000640 1 -- 172.21.15.32:0/849306589 shutdown_connections 2024-03-19T06:22:18.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.276+0000 7f335c000640 1 -- 172.21.15.32:0/849306589 wait complete. 2024-03-19T06:22:18.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f335c000640 1 Processor -- start 2024-03-19T06:22:18.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f335c000640 1 -- start start 2024-03-19T06:22:18.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f335c000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f335406d590 0x7f335414a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:18.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f335c000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33540cc6a0 0x7f33541626c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:18.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f335c000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3354162050 0x7f3354164140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:18.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f335c000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33540cd910 con 0x7f335406d590 2024-03-19T06:22:18.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f335c000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3354165c40 con 0x7f3354162050 2024-03-19T06:22:18.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f335c000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33540cda90 con 0x7f33540cc6a0 2024-03-19T06:22:18.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f3359600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f335406d590 0x7f335414a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:18.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f3359600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f335406d590 0x7f335414a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56716/0 (socket says 172.21.15.32:56716) 2024-03-19T06:22:18.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f3359600640 1 -- 172.21.15.32:0/3886537935 learned_addr learned my addr 172.21.15.32:0/3886537935 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:18.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f335a000640 1 --2- 172.21.15.32:0/3886537935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3354162050 0x7f3354164140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:18.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f3358c00640 1 --2- 172.21.15.32:0/3886537935 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33540cc6a0 0x7f33541626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:18.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f3359600640 1 -- 172.21.15.32:0/3886537935 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33540cc6a0 msgr2=0x7f33541626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:18.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f3359600640 1 --2- 172.21.15.32:0/3886537935 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33540cc6a0 0x7f33541626c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:18.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f3359600640 1 -- 172.21.15.32:0/3886537935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3354162050 msgr2=0x7f3354164140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:18.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f3359600640 1 --2- 172.21.15.32:0/3886537935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3354162050 0x7f3354164140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:18.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f3359600640 1 -- 172.21.15.32:0/3886537935 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33540cceb0 con 0x7f335406d590 2024-03-19T06:22:18.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f3359600640 1 --2- 172.21.15.32:0/3886537935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f335406d590 0x7f335414a440 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f334800b440 tx=0x7f334800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:18.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f3351600640 1 -- 172.21.15.32:0/3886537935 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348015020 con 0x7f335406d590 2024-03-19T06:22:18.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f3351600640 1 -- 172.21.15.32:0/3886537935 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3348011890 con 0x7f335406d590 2024-03-19T06:22:18.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f3351600640 1 -- 172.21.15.32:0/3886537935 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348011c80 con 0x7f335406d590 2024-03-19T06:22:18.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f335c000640 1 -- 172.21.15.32:0/3886537935 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33541630a0 con 0x7f335406d590 2024-03-19T06:22:18.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.280+0000 7f335c000640 1 -- 172.21.15.32:0/3886537935 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3354163660 con 0x7f335406d590 2024-03-19T06:22:18.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.284+0000 7f335c000640 1 -- 172.21.15.32:0/3886537935 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33540749e0 con 0x7f335406d590 2024-03-19T06:22:18.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.284+0000 7f3351600640 1 -- 172.21.15.32:0/3886537935 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3348018020 con 0x7f335406d590 2024-03-19T06:22:18.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.284+0000 7f3351600640 1 --2- 172.21.15.32:0/3886537935 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3334067660 0x7f3334069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:18.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.284+0000 7f3351600640 1 -- 172.21.15.32:0/3886537935 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3348085770 con 0x7f335406d590 2024-03-19T06:22:18.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.284+0000 7f3358c00640 1 --2- 172.21.15.32:0/3886537935 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3334067660 0x7f3334069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:18.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.284+0000 7f3358c00640 1 --2- 172.21.15.32:0/3886537935 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3334067660 0x7f3334069b20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f33540b50e0 tx=0x7f3340007b60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:18.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.288+0000 7f3351600640 1 -- 172.21.15.32:0/3886537935 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f334801f030 con 0x7f335406d590 2024-03-19T06:22:18.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.448+0000 7f335c000640 1 -- 172.21.15.32:0/3886537935 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33540cd1e0 con 0x7f3334067660 2024-03-19T06:22:18.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.456+0000 7f3351600640 1 -- 172.21.15.32:0/3886537935 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251950 (secure 0 0 0) 0x7f33540cd1e0 con 0x7f3334067660 2024-03-19T06:22:18.450 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:22:18.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.460+0000 7f335c000640 1 -- 172.21.15.32:0/3886537935 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3334067660 msgr2=0x7f3334069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:18.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.460+0000 7f335c000640 1 --2- 172.21.15.32:0/3886537935 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3334067660 0x7f3334069b20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f33540b50e0 tx=0x7f3340007b60 comp rx=0 tx=0).stop 2024-03-19T06:22:18.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.460+0000 7f335c000640 1 -- 172.21.15.32:0/3886537935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f335406d590 msgr2=0x7f335414a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.460+0000 7f335c000640 1 --2- 172.21.15.32:0/3886537935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f335406d590 0x7f335414a440 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f334800b440 tx=0x7f334800b900 comp rx=0 tx=0).stop 2024-03-19T06:22:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.460+0000 7f335c000640 1 -- 172.21.15.32:0/3886537935 shutdown_connections 2024-03-19T06:22:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.460+0000 7f335c000640 1 --2- 172.21.15.32:0/3886537935 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3334067660 0x7f3334069b20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.460+0000 7f335c000640 1 --2- 172.21.15.32:0/3886537935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3354162050 0x7f3354164140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.460+0000 7f335c000640 1 --2- 172.21.15.32:0/3886537935 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33540cc6a0 0x7f33541626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.460+0000 7f335c000640 1 --2- 172.21.15.32:0/3886537935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f335406d590 0x7f335414a440 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.460+0000 7f335c000640 1 -- 172.21.15.32:0/3886537935 >> 172.21.15.32:0/3886537935 conn(0x7f33540b1280 msgr2=0x7f3354157260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.460+0000 7f335c000640 1 -- 172.21.15.32:0/3886537935 shutdown_connections 2024-03-19T06:22:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:18.460+0000 7f335c000640 1 -- 172.21.15.32:0/3886537935 wait complete. 2024-03-19T06:22:18.470 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-03-19T06:22:17.935987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237108,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737612,"statfs":{"total":773094113280,"available":772851314688,"internally_reserved":0,"allocated":4366336,"data_stored":2405812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.165480"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950021+0000","last_change":"2024-03-19T06:22:12.804041+0000","last_active":"2024-03-19T06:22:13.950021+0000","last_peered":"2024-03-19T06:22:13.950021+0000","last_clean":"2024-03-19T06:22:13.950021+0000","last_became_active":"2024-03-19T06:22:12.803746+0000","last_became_peered":"2024-03-19T06:22:12.803746+0000","last_unstale":"2024-03-19T06:22:13.950021+0000","last_undegraded":"2024-03-19T06:22:13.950021+0000","last_fullsized":"2024-03-19T06:22:13.950021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:35:58.675849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782830+0000","last_change":"2024-03-19T06:22:12.813377+0000","last_active":"2024-03-19T06:22:13.782830+0000","last_peered":"2024-03-19T06:22:13.782830+0000","last_clean":"2024-03-19T06:22:13.782830+0000","last_became_active":"2024-03-19T06:22:12.810137+0000","last_became_peered":"2024-03-19T06:22:12.810137+0000","last_unstale":"2024-03-19T06:22:13.782830+0000","last_undegraded":"2024-03-19T06:22:13.782830+0000","last_fullsized":"2024-03-19T06:22:13.782830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:54:53.123082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786060+0000","last_change":"2024-03-19T06:22:12.798420+0000","last_active":"2024-03-19T06:22:13.786060+0000","last_peered":"2024-03-19T06:22:13.786060+0000","last_clean":"2024-03-19T06:22:13.786060+0000","last_became_active":"2024-03-19T06:22:12.798093+0000","last_became_peered":"2024-03-19T06:22:12.798093+0000","last_unstale":"2024-03-19T06:22:13.786060+0000","last_undegraded":"2024-03-19T06:22:13.786060+0000","last_fullsized":"2024-03-19T06:22:13.786060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:34:44.044955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806572+0000","last_change":"2024-03-19T06:22:12.800334+0000","last_active":"2024-03-19T06:22:13.806572+0000","last_peered":"2024-03-19T06:22:13.806572+0000","last_clean":"2024-03-19T06:22:13.806572+0000","last_became_active":"2024-03-19T06:22:12.799898+0000","last_became_peered":"2024-03-19T06:22:12.799898+0000","last_unstale":"2024-03-19T06:22:13.806572+0000","last_undegraded":"2024-03-19T06:22:13.806572+0000","last_fullsized":"2024-03-19T06:22:13.806572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:28:51.922537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946624+0000","last_change":"2024-03-19T06:22:12.806664+0000","last_active":"2024-03-19T06:22:13.946624+0000","last_peered":"2024-03-19T06:22:13.946624+0000","last_clean":"2024-03-19T06:22:13.946624+0000","last_became_active":"2024-03-19T06:22:12.806330+0000","last_became_peered":"2024-03-19T06:22:12.806330+0000","last_unstale":"2024-03-19T06:22:13.946624+0000","last_undegraded":"2024-03-19T06:22:13.946624+0000","last_fullsized":"2024-03-19T06:22:13.946624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:00:13.377355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782288+0000","last_change":"2024-03-19T06:22:12.802790+0000","last_active":"2024-03-19T06:22:13.782288+0000","last_peered":"2024-03-19T06:22:13.782288+0000","last_clean":"2024-03-19T06:22:13.782288+0000","last_became_active":"2024-03-19T06:22:12.800768+0000","last_became_peered":"2024-03-19T06:22:12.800768+0000","last_unstale":"2024-03-19T06:22:13.782288+0000","last_undegraded":"2024-03-19T06:22:13.782288+0000","last_fullsized":"2024-03-19T06:22:13.782288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:53:16.147110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786065+0000","last_change":"2024-03-19T06:22:12.815224+0000","last_active":"2024-03-19T06:22:13.786065+0000","last_peered":"2024-03-19T06:22:13.786065+0000","last_clean":"2024-03-19T06:22:13.786065+0000","last_became_active":"2024-03-19T06:22:12.814923+0000","last_became_peered":"2024-03-19T06:22:12.814923+0000","last_unstale":"2024-03-19T06:22:13.786065+0000","last_undegraded":"2024-03-19T06:22:13.786065+0000","last_fullsized":"2024-03-19T06:22:13.786065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:45:25.838474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785848+0000","last_change":"2024-03-19T06:22:12.809758+0000","last_active":"2024-03-19T06:22:13.785848+0000","last_peered":"2024-03-19T06:22:13.785848+0000","last_clean":"2024-03-19T06:22:13.785848+0000","last_became_active":"2024-03-19T06:22:12.809318+0000","last_became_peered":"2024-03-19T06:22:12.809318+0000","last_unstale":"2024-03-19T06:22:13.785848+0000","last_undegraded":"2024-03-19T06:22:13.785848+0000","last_fullsized":"2024-03-19T06:22:13.785848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:51:48.402769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950048+0000","last_change":"2024-03-19T06:22:12.819459+0000","last_active":"2024-03-19T06:22:13.950048+0000","last_peered":"2024-03-19T06:22:13.950048+0000","last_clean":"2024-03-19T06:22:13.950048+0000","last_became_active":"2024-03-19T06:22:12.819097+0000","last_became_peered":"2024-03-19T06:22:12.819097+0000","last_unstale":"2024-03-19T06:22:13.950048+0000","last_undegraded":"2024-03-19T06:22:13.950048+0000","last_fullsized":"2024-03-19T06:22:13.950048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:28:58.380767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806838+0000","last_change":"2024-03-19T06:22:12.809831+0000","last_active":"2024-03-19T06:22:13.806838+0000","last_peered":"2024-03-19T06:22:13.806838+0000","last_clean":"2024-03-19T06:22:13.806838+0000","last_became_active":"2024-03-19T06:22:12.809572+0000","last_became_peered":"2024-03-19T06:22:12.809572+0000","last_unstale":"2024-03-19T06:22:13.806838+0000","last_undegraded":"2024-03-19T06:22:13.806838+0000","last_fullsized":"2024-03-19T06:22:13.806838+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:17:24.870587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786583+0000","last_change":"2024-03-19T06:22:12.822521+0000","last_active":"2024-03-19T06:22:13.786583+0000","last_peered":"2024-03-19T06:22:13.786583+0000","last_clean":"2024-03-19T06:22:13.786583+0000","last_became_active":"2024-03-19T06:22:12.822227+0000","last_became_peered":"2024-03-19T06:22:12.822227+0000","last_unstale":"2024-03-19T06:22:13.786583+0000","last_undegraded":"2024-03-19T06:22:13.786583+0000","last_fullsized":"2024-03-19T06:22:13.786583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:34:44.044955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785307+0000","last_change":"2024-03-19T06:22:12.805492+0000","last_active":"2024-03-19T06:22:13.785307+0000","last_peered":"2024-03-19T06:22:13.785307+0000","last_clean":"2024-03-19T06:22:13.785307+0000","last_became_active":"2024-03-19T06:22:12.805224+0000","last_became_peered":"2024-03-19T06:22:12.805224+0000","last_unstale":"2024-03-19T06:22:13.785307+0000","last_undegraded":"2024-03-19T06:22:13.785307+0000","last_fullsized":"2024-03-19T06:22:13.785307+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:45:25.838474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946771+0000","last_change":"2024-03-19T06:22:12.791057+0000","last_active":"2024-03-19T06:22:13.946771+0000","last_peered":"2024-03-19T06:22:13.946771+0000","last_clean":"2024-03-19T06:22:13.946771+0000","last_became_active":"2024-03-19T06:22:12.790791+0000","last_became_peered":"2024-03-19T06:22:12.790791+0000","last_unstale":"2024-03-19T06:22:13.946771+0000","last_undegraded":"2024-03-19T06:22:13.946771+0000","last_fullsized":"2024-03-19T06:22:13.946771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:19:02.634410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782427+0000","last_change":"2024-03-19T06:22:12.799728+0000","last_active":"2024-03-19T06:22:13.782427+0000","last_peered":"2024-03-19T06:22:13.782427+0000","last_clean":"2024-03-19T06:22:13.782427+0000","last_became_active":"2024-03-19T06:22:12.799510+0000","last_became_peered":"2024-03-19T06:22:12.799510+0000","last_unstale":"2024-03-19T06:22:13.782427+0000","last_undegraded":"2024-03-19T06:22:13.782427+0000","last_fullsized":"2024-03-19T06:22:13.782427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:49:46.460288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785442+0000","last_change":"2024-03-19T06:22:12.802286+0000","last_active":"2024-03-19T06:22:13.785442+0000","last_peered":"2024-03-19T06:22:13.785442+0000","last_clean":"2024-03-19T06:22:13.785442+0000","last_became_active":"2024-03-19T06:22:12.801976+0000","last_became_peered":"2024-03-19T06:22:12.801976+0000","last_unstale":"2024-03-19T06:22:13.785442+0000","last_undegraded":"2024-03-19T06:22:13.785442+0000","last_fullsized":"2024-03-19T06:22:13.785442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:04:56.906112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786705+0000","last_change":"2024-03-19T06:22:12.816928+0000","last_active":"2024-03-19T06:22:13.786705+0000","last_peered":"2024-03-19T06:22:13.786705+0000","last_clean":"2024-03-19T06:22:13.786705+0000","last_became_active":"2024-03-19T06:22:12.816556+0000","last_became_peered":"2024-03-19T06:22:12.816556+0000","last_unstale":"2024-03-19T06:22:13.786705+0000","last_undegraded":"2024-03-19T06:22:13.786705+0000","last_fullsized":"2024-03-19T06:22:13.786705+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:43:04.048468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786304+0000","last_change":"2024-03-19T06:22:12.818369+0000","last_active":"2024-03-19T06:22:13.786304+0000","last_peered":"2024-03-19T06:22:13.786304+0000","last_clean":"2024-03-19T06:22:13.786304+0000","last_became_active":"2024-03-19T06:22:12.816969+0000","last_became_peered":"2024-03-19T06:22:12.816969+0000","last_unstale":"2024-03-19T06:22:13.786304+0000","last_undegraded":"2024-03-19T06:22:13.786304+0000","last_fullsized":"2024-03-19T06:22:13.786304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:03:37.412574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782823+0000","last_change":"2024-03-19T06:22:12.801364+0000","last_active":"2024-03-19T06:22:13.782823+0000","last_peered":"2024-03-19T06:22:13.782823+0000","last_clean":"2024-03-19T06:22:13.782823+0000","last_became_active":"2024-03-19T06:22:12.801016+0000","last_became_peered":"2024-03-19T06:22:12.801016+0000","last_unstale":"2024-03-19T06:22:13.782823+0000","last_undegraded":"2024-03-19T06:22:13.782823+0000","last_fullsized":"2024-03-19T06:22:13.782823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:36:02.560779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782657+0000","last_change":"2024-03-19T06:22:12.799453+0000","last_active":"2024-03-19T06:22:13.782657+0000","last_peered":"2024-03-19T06:22:13.782657+0000","last_clean":"2024-03-19T06:22:13.782657+0000","last_became_active":"2024-03-19T06:22:12.799175+0000","last_became_peered":"2024-03-19T06:22:12.799175+0000","last_unstale":"2024-03-19T06:22:13.782657+0000","last_undegraded":"2024-03-19T06:22:13.782657+0000","last_fullsized":"2024-03-19T06:22:13.782657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:19:47.036468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946765+0000","last_change":"2024-03-19T06:22:12.797998+0000","last_active":"2024-03-19T06:22:13.946765+0000","last_peered":"2024-03-19T06:22:13.946765+0000","last_clean":"2024-03-19T06:22:13.946765+0000","last_became_active":"2024-03-19T06:22:12.797691+0000","last_became_peered":"2024-03-19T06:22:12.797691+0000","last_unstale":"2024-03-19T06:22:13.946765+0000","last_undegraded":"2024-03-19T06:22:13.946765+0000","last_fullsized":"2024-03-19T06:22:13.946765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:20:26.431808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949442+0000","last_change":"2024-03-19T06:22:12.811038+0000","last_active":"2024-03-19T06:22:13.949442+0000","last_peered":"2024-03-19T06:22:13.949442+0000","last_clean":"2024-03-19T06:22:13.949442+0000","last_became_active":"2024-03-19T06:22:12.810750+0000","last_became_peered":"2024-03-19T06:22:12.810750+0000","last_unstale":"2024-03-19T06:22:13.949442+0000","last_undegraded":"2024-03-19T06:22:13.949442+0000","last_fullsized":"2024-03-19T06:22:13.949442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:15:49.184635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949569+0000","last_change":"2024-03-19T06:22:12.808465+0000","last_active":"2024-03-19T06:22:13.949569+0000","last_peered":"2024-03-19T06:22:13.949569+0000","last_clean":"2024-03-19T06:22:13.949569+0000","last_became_active":"2024-03-19T06:22:12.808155+0000","last_became_peered":"2024-03-19T06:22:12.808155+0000","last_unstale":"2024-03-19T06:22:13.949569+0000","last_undegraded":"2024-03-19T06:22:13.949569+0000","last_fullsized":"2024-03-19T06:22:13.949569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:07:58.346504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804010+0000","last_change":"2024-03-19T06:22:12.806362+0000","last_active":"2024-03-19T06:22:13.804010+0000","last_peered":"2024-03-19T06:22:13.804010+0000","last_clean":"2024-03-19T06:22:13.804010+0000","last_became_active":"2024-03-19T06:22:12.805434+0000","last_became_peered":"2024-03-19T06:22:12.805434+0000","last_unstale":"2024-03-19T06:22:13.804010+0000","last_undegraded":"2024-03-19T06:22:13.804010+0000","last_fullsized":"2024-03-19T06:22:13.804010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:02:11.073512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785153+0000","last_change":"2024-03-19T06:22:12.808697+0000","last_active":"2024-03-19T06:22:13.785153+0000","last_peered":"2024-03-19T06:22:13.785153+0000","last_clean":"2024-03-19T06:22:13.785153+0000","last_became_active":"2024-03-19T06:22:12.808406+0000","last_became_peered":"2024-03-19T06:22:12.808406+0000","last_unstale":"2024-03-19T06:22:13.785153+0000","last_undegraded":"2024-03-19T06:22:13.785153+0000","last_fullsized":"2024-03-19T06:22:13.785153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:20:25.981378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.807007+0000","last_change":"2024-03-19T06:22:12.814424+0000","last_active":"2024-03-19T06:22:13.807007+0000","last_peered":"2024-03-19T06:22:13.807007+0000","last_clean":"2024-03-19T06:22:13.807007+0000","last_became_active":"2024-03-19T06:22:12.814175+0000","last_became_peered":"2024-03-19T06:22:12.814175+0000","last_unstale":"2024-03-19T06:22:13.807007+0000","last_undegraded":"2024-03-19T06:22:13.807007+0000","last_fullsized":"2024-03-19T06:22:13.807007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:03:03.253970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782901+0000","last_change":"2024-03-19T06:22:12.813107+0000","last_active":"2024-03-19T06:22:13.782901+0000","last_peered":"2024-03-19T06:22:13.782901+0000","last_clean":"2024-03-19T06:22:13.782901+0000","last_became_active":"2024-03-19T06:22:12.812747+0000","last_became_peered":"2024-03-19T06:22:12.812747+0000","last_unstale":"2024-03-19T06:22:13.782901+0000","last_undegraded":"2024-03-19T06:22:13.782901+0000","last_fullsized":"2024-03-19T06:22:13.782901+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:32.790613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806852+0000","last_change":"2024-03-19T06:22:12.807727+0000","last_active":"2024-03-19T06:22:13.806852+0000","last_peered":"2024-03-19T06:22:13.806852+0000","last_clean":"2024-03-19T06:22:13.806852+0000","last_became_active":"2024-03-19T06:22:12.803732+0000","last_became_peered":"2024-03-19T06:22:12.803732+0000","last_unstale":"2024-03-19T06:22:13.806852+0000","last_undegraded":"2024-03-19T06:22:13.806852+0000","last_fullsized":"2024-03-19T06:22:13.806852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:24:25.721736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785651+0000","last_change":"2024-03-19T06:22:12.808029+0000","last_active":"2024-03-19T06:22:13.785651+0000","last_peered":"2024-03-19T06:22:13.785651+0000","last_clean":"2024-03-19T06:22:13.785651+0000","last_became_active":"2024-03-19T06:22:12.806666+0000","last_became_peered":"2024-03-19T06:22:12.806666+0000","last_unstale":"2024-03-19T06:22:13.785651+0000","last_undegraded":"2024-03-19T06:22:13.785651+0000","last_fullsized":"2024-03-19T06:22:13.785651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:03:37.412574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949639+0000","last_change":"2024-03-19T06:22:12.807735+0000","last_active":"2024-03-19T06:22:13.949639+0000","last_peered":"2024-03-19T06:22:13.949639+0000","last_clean":"2024-03-19T06:22:13.949639+0000","last_became_active":"2024-03-19T06:22:12.807440+0000","last_became_peered":"2024-03-19T06:22:12.807440+0000","last_unstale":"2024-03-19T06:22:13.949639+0000","last_undegraded":"2024-03-19T06:22:13.949639+0000","last_fullsized":"2024-03-19T06:22:13.949639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:36:33.458254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786452+0000","last_change":"2024-03-19T06:22:12.818815+0000","last_active":"2024-03-19T06:22:13.786452+0000","last_peered":"2024-03-19T06:22:13.786452+0000","last_clean":"2024-03-19T06:22:13.786452+0000","last_became_active":"2024-03-19T06:22:12.818580+0000","last_became_peered":"2024-03-19T06:22:12.818580+0000","last_unstale":"2024-03-19T06:22:13.786452+0000","last_undegraded":"2024-03-19T06:22:13.786452+0000","last_fullsized":"2024-03-19T06:22:13.786452+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:56:54.973880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949190+0000","last_change":"2024-03-19T06:22:12.800990+0000","last_active":"2024-03-19T06:22:13.949190+0000","last_peered":"2024-03-19T06:22:13.949190+0000","last_clean":"2024-03-19T06:22:13.949190+0000","last_became_active":"2024-03-19T06:22:12.800638+0000","last_became_peered":"2024-03-19T06:22:12.800638+0000","last_unstale":"2024-03-19T06:22:13.949190+0000","last_undegraded":"2024-03-19T06:22:13.949190+0000","last_fullsized":"2024-03-19T06:22:13.949190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:23:53.303775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786498+0000","last_change":"2024-03-19T06:22:12.809519+0000","last_active":"2024-03-19T06:22:13.786498+0000","last_peered":"2024-03-19T06:22:13.786498+0000","last_clean":"2024-03-19T06:22:13.786498+0000","last_became_active":"2024-03-19T06:22:12.808783+0000","last_became_peered":"2024-03-19T06:22:12.808783+0000","last_unstale":"2024-03-19T06:22:13.786498+0000","last_undegraded":"2024-03-19T06:22:13.786498+0000","last_fullsized":"2024-03-19T06:22:13.786498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:41:39.027232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804218+0000","last_change":"2024-03-19T06:22:12.811207+0000","last_active":"2024-03-19T06:22:13.804218+0000","last_peered":"2024-03-19T06:22:13.804218+0000","last_clean":"2024-03-19T06:22:13.804218+0000","last_became_active":"2024-03-19T06:22:12.810928+0000","last_became_peered":"2024-03-19T06:22:12.810928+0000","last_unstale":"2024-03-19T06:22:13.804218+0000","last_undegraded":"2024-03-19T06:22:13.804218+0000","last_fullsized":"2024-03-19T06:22:13.804218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:59:18.790179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950170+0000","last_change":"2024-03-19T06:22:11.790374+0000","last_active":"2024-03-19T06:22:13.950170+0000","last_peered":"2024-03-19T06:22:13.950170+0000","last_clean":"2024-03-19T06:22:13.950170+0000","last_became_active":"2024-03-19T06:22:11.790015+0000","last_became_peered":"2024-03-19T06:22:11.790015+0000","last_unstale":"2024-03-19T06:22:13.950170+0000","last_undegraded":"2024-03-19T06:22:13.950170+0000","last_fullsized":"2024-03-19T06:22:13.950170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:21:19.744542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950178+0000","last_change":"2024-03-19T06:22:12.807939+0000","last_active":"2024-03-19T06:22:13.950178+0000","last_peered":"2024-03-19T06:22:13.950178+0000","last_clean":"2024-03-19T06:22:13.950178+0000","last_became_active":"2024-03-19T06:22:12.807658+0000","last_became_peered":"2024-03-19T06:22:12.807658+0000","last_unstale":"2024-03-19T06:22:13.950178+0000","last_undegraded":"2024-03-19T06:22:13.950178+0000","last_fullsized":"2024-03-19T06:22:13.950178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:57:38.347495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804203+0000","last_change":"2024-03-19T06:22:11.795057+0000","last_active":"2024-03-19T06:22:13.804203+0000","last_peered":"2024-03-19T06:22:13.804203+0000","last_clean":"2024-03-19T06:22:13.804203+0000","last_became_active":"2024-03-19T06:22:11.794668+0000","last_became_peered":"2024-03-19T06:22:11.794668+0000","last_unstale":"2024-03-19T06:22:13.804203+0000","last_undegraded":"2024-03-19T06:22:13.804203+0000","last_fullsized":"2024-03-19T06:22:13.804203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:33:37.895511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950121+0000","last_change":"2024-03-19T06:22:12.806044+0000","last_active":"2024-03-19T06:22:13.950121+0000","last_peered":"2024-03-19T06:22:13.950121+0000","last_clean":"2024-03-19T06:22:13.950121+0000","last_became_active":"2024-03-19T06:22:12.805753+0000","last_became_peered":"2024-03-19T06:22:12.805753+0000","last_unstale":"2024-03-19T06:22:13.950121+0000","last_undegraded":"2024-03-19T06:22:13.950121+0000","last_fullsized":"2024-03-19T06:22:13.950121+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:45:02.480430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782617+0000","last_change":"2024-03-19T06:22:11.782865+0000","last_active":"2024-03-19T06:22:13.782617+0000","last_peered":"2024-03-19T06:22:13.782617+0000","last_clean":"2024-03-19T06:22:13.782617+0000","last_became_active":"2024-03-19T06:22:11.781430+0000","last_became_peered":"2024-03-19T06:22:11.781430+0000","last_unstale":"2024-03-19T06:22:13.782617+0000","last_undegraded":"2024-03-19T06:22:13.782617+0000","last_fullsized":"2024-03-19T06:22:13.782617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:23:11.347650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806879+0000","last_change":"2024-03-19T06:22:12.805021+0000","last_active":"2024-03-19T06:22:13.806879+0000","last_peered":"2024-03-19T06:22:13.806879+0000","last_clean":"2024-03-19T06:22:13.806879+0000","last_became_active":"2024-03-19T06:22:12.803153+0000","last_became_peered":"2024-03-19T06:22:12.803153+0000","last_unstale":"2024-03-19T06:22:13.806879+0000","last_undegraded":"2024-03-19T06:22:13.806879+0000","last_fullsized":"2024-03-19T06:22:13.806879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:30:29.466312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946832+0000","last_change":"2024-03-19T06:22:11.797785+0000","last_active":"2024-03-19T06:22:13.946832+0000","last_peered":"2024-03-19T06:22:13.946832+0000","last_clean":"2024-03-19T06:22:13.946832+0000","last_became_active":"2024-03-19T06:22:11.797465+0000","last_became_peered":"2024-03-19T06:22:11.797465+0000","last_unstale":"2024-03-19T06:22:13.946832+0000","last_undegraded":"2024-03-19T06:22:13.946832+0000","last_fullsized":"2024-03-19T06:22:13.946832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:07:49.139990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786293+0000","last_change":"2024-03-19T06:22:12.813971+0000","last_active":"2024-03-19T06:22:13.786293+0000","last_peered":"2024-03-19T06:22:13.786293+0000","last_clean":"2024-03-19T06:22:13.786293+0000","last_became_active":"2024-03-19T06:22:12.813643+0000","last_became_peered":"2024-03-19T06:22:12.813643+0000","last_unstale":"2024-03-19T06:22:13.786293+0000","last_undegraded":"2024-03-19T06:22:13.786293+0000","last_fullsized":"2024-03-19T06:22:13.786293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:04:56.906112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949778+0000","last_change":"2024-03-19T06:22:11.792783+0000","last_active":"2024-03-19T06:22:13.949778+0000","last_peered":"2024-03-19T06:22:13.949778+0000","last_clean":"2024-03-19T06:22:13.949778+0000","last_became_active":"2024-03-19T06:22:11.791824+0000","last_became_peered":"2024-03-19T06:22:11.791824+0000","last_unstale":"2024-03-19T06:22:13.949778+0000","last_undegraded":"2024-03-19T06:22:13.949778+0000","last_fullsized":"2024-03-19T06:22:13.949778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:23:23.700595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785307+0000","last_change":"2024-03-19T06:22:12.798709+0000","last_active":"2024-03-19T06:22:13.785307+0000","last_peered":"2024-03-19T06:22:13.785307+0000","last_clean":"2024-03-19T06:22:13.785307+0000","last_became_active":"2024-03-19T06:22:12.798302+0000","last_became_peered":"2024-03-19T06:22:12.798302+0000","last_unstale":"2024-03-19T06:22:13.785307+0000","last_undegraded":"2024-03-19T06:22:13.785307+0000","last_fullsized":"2024-03-19T06:22:13.785307+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:59:58.435424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949696+0000","last_change":"2024-03-19T06:22:11.796432+0000","last_active":"2024-03-19T06:22:13.949696+0000","last_peered":"2024-03-19T06:22:13.949696+0000","last_clean":"2024-03-19T06:22:13.949696+0000","last_became_active":"2024-03-19T06:22:11.794614+0000","last_became_peered":"2024-03-19T06:22:11.794614+0000","last_unstale":"2024-03-19T06:22:13.949696+0000","last_undegraded":"2024-03-19T06:22:13.949696+0000","last_fullsized":"2024-03-19T06:22:13.949696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:15:41.175621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949428+0000","last_change":"2024-03-19T06:22:12.804385+0000","last_active":"2024-03-19T06:22:13.949428+0000","last_peered":"2024-03-19T06:22:13.949428+0000","last_clean":"2024-03-19T06:22:13.949428+0000","last_became_active":"2024-03-19T06:22:12.804022+0000","last_became_peered":"2024-03-19T06:22:12.804022+0000","last_unstale":"2024-03-19T06:22:13.949428+0000","last_undegraded":"2024-03-19T06:22:13.949428+0000","last_fullsized":"2024-03-19T06:22:13.949428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:41:28.053793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782068+0000","last_change":"2024-03-19T06:22:11.785078+0000","last_active":"2024-03-19T06:22:13.782068+0000","last_peered":"2024-03-19T06:22:13.782068+0000","last_clean":"2024-03-19T06:22:13.782068+0000","last_became_active":"2024-03-19T06:22:11.783561+0000","last_became_peered":"2024-03-19T06:22:11.783561+0000","last_unstale":"2024-03-19T06:22:13.782068+0000","last_undegraded":"2024-03-19T06:22:13.782068+0000","last_fullsized":"2024-03-19T06:22:13.782068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:38:39.623722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806482+0000","last_change":"2024-03-19T06:22:12.791613+0000","last_active":"2024-03-19T06:22:13.806482+0000","last_peered":"2024-03-19T06:22:13.806482+0000","last_clean":"2024-03-19T06:22:13.806482+0000","last_became_active":"2024-03-19T06:22:12.791348+0000","last_became_peered":"2024-03-19T06:22:12.791348+0000","last_unstale":"2024-03-19T06:22:13.806482+0000","last_undegraded":"2024-03-19T06:22:13.806482+0000","last_fullsized":"2024-03-19T06:22:13.806482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:23:34.295704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949201+0000","last_change":"2024-03-19T06:22:11.796210+0000","last_active":"2024-03-19T06:22:13.949201+0000","last_peered":"2024-03-19T06:22:13.949201+0000","last_clean":"2024-03-19T06:22:13.949201+0000","last_became_active":"2024-03-19T06:22:11.795816+0000","last_became_peered":"2024-03-19T06:22:11.795816+0000","last_unstale":"2024-03-19T06:22:13.949201+0000","last_undegraded":"2024-03-19T06:22:13.949201+0000","last_fullsized":"2024-03-19T06:22:13.949201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:26:41.154332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785806+0000","last_change":"2024-03-19T06:22:12.811822+0000","last_active":"2024-03-19T06:22:13.785806+0000","last_peered":"2024-03-19T06:22:13.785806+0000","last_clean":"2024-03-19T06:22:13.785806+0000","last_became_active":"2024-03-19T06:22:12.811547+0000","last_became_peered":"2024-03-19T06:22:12.811547+0000","last_unstale":"2024-03-19T06:22:13.785806+0000","last_undegraded":"2024-03-19T06:22:13.785806+0000","last_fullsized":"2024-03-19T06:22:13.785806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:35:35.057020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782834+0000","last_change":"2024-03-19T06:22:11.797779+0000","last_active":"2024-03-19T06:22:13.782834+0000","last_peered":"2024-03-19T06:22:13.782834+0000","last_clean":"2024-03-19T06:22:13.782834+0000","last_became_active":"2024-03-19T06:22:11.797477+0000","last_became_peered":"2024-03-19T06:22:11.797477+0000","last_unstale":"2024-03-19T06:22:13.782834+0000","last_undegraded":"2024-03-19T06:22:13.782834+0000","last_fullsized":"2024-03-19T06:22:13.782834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:58:59.662492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782810+0000","last_change":"2024-03-19T06:22:12.801487+0000","last_active":"2024-03-19T06:22:13.782810+0000","last_peered":"2024-03-19T06:22:13.782810+0000","last_clean":"2024-03-19T06:22:13.782810+0000","last_became_active":"2024-03-19T06:22:12.801196+0000","last_became_peered":"2024-03-19T06:22:12.801196+0000","last_unstale":"2024-03-19T06:22:13.782810+0000","last_undegraded":"2024-03-19T06:22:13.782810+0000","last_fullsized":"2024-03-19T06:22:13.782810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:37:25.965590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804250+0000","last_change":"2024-03-19T06:22:11.792727+0000","last_active":"2024-03-19T06:22:13.804250+0000","last_peered":"2024-03-19T06:22:13.804250+0000","last_clean":"2024-03-19T06:22:13.804250+0000","last_became_active":"2024-03-19T06:22:11.792399+0000","last_became_peered":"2024-03-19T06:22:11.792399+0000","last_unstale":"2024-03-19T06:22:13.804250+0000","last_undegraded":"2024-03-19T06:22:13.804250+0000","last_fullsized":"2024-03-19T06:22:13.804250+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:20:25.425737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782617+0000","last_change":"2024-03-19T06:22:12.814392+0000","last_active":"2024-03-19T06:22:13.782617+0000","last_peered":"2024-03-19T06:22:13.782617+0000","last_clean":"2024-03-19T06:22:13.782617+0000","last_became_active":"2024-03-19T06:22:12.813815+0000","last_became_peered":"2024-03-19T06:22:12.813815+0000","last_unstale":"2024-03-19T06:22:13.782617+0000","last_undegraded":"2024-03-19T06:22:13.782617+0000","last_fullsized":"2024-03-19T06:22:13.782617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:54:29.091078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786099+0000","last_change":"2024-03-19T06:22:11.798009+0000","last_active":"2024-03-19T06:22:13.786099+0000","last_peered":"2024-03-19T06:22:13.786099+0000","last_clean":"2024-03-19T06:22:13.786099+0000","last_became_active":"2024-03-19T06:22:11.797604+0000","last_became_peered":"2024-03-19T06:22:11.797604+0000","last_unstale":"2024-03-19T06:22:13.786099+0000","last_undegraded":"2024-03-19T06:22:13.786099+0000","last_fullsized":"2024-03-19T06:22:13.786099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:02:10.067441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786262+0000","last_change":"2024-03-19T06:22:12.799327+0000","last_active":"2024-03-19T06:22:13.786262+0000","last_peered":"2024-03-19T06:22:13.786262+0000","last_clean":"2024-03-19T06:22:13.786262+0000","last_became_active":"2024-03-19T06:22:12.799022+0000","last_became_peered":"2024-03-19T06:22:12.799022+0000","last_unstale":"2024-03-19T06:22:13.786262+0000","last_undegraded":"2024-03-19T06:22:13.786262+0000","last_fullsized":"2024-03-19T06:22:13.786262+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:43:04.048468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782699+0000","last_change":"2024-03-19T06:22:11.791858+0000","last_active":"2024-03-19T06:22:13.782699+0000","last_peered":"2024-03-19T06:22:13.782699+0000","last_clean":"2024-03-19T06:22:13.782699+0000","last_became_active":"2024-03-19T06:22:11.791423+0000","last_became_peered":"2024-03-19T06:22:11.791423+0000","last_unstale":"2024-03-19T06:22:13.782699+0000","last_undegraded":"2024-03-19T06:22:13.782699+0000","last_fullsized":"2024-03-19T06:22:13.782699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:15:48.178564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806423+0000","last_change":"2024-03-19T06:22:12.789952+0000","last_active":"2024-03-19T06:22:13.806423+0000","last_peered":"2024-03-19T06:22:13.806423+0000","last_clean":"2024-03-19T06:22:13.806423+0000","last_became_active":"2024-03-19T06:22:12.789667+0000","last_became_peered":"2024-03-19T06:22:12.789667+0000","last_unstale":"2024-03-19T06:22:13.806423+0000","last_undegraded":"2024-03-19T06:22:13.806423+0000","last_fullsized":"2024-03-19T06:22:13.806423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:59:18.790179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949920+0000","last_change":"2024-03-19T06:22:11.796046+0000","last_active":"2024-03-19T06:22:13.949920+0000","last_peered":"2024-03-19T06:22:13.949920+0000","last_clean":"2024-03-19T06:22:13.949920+0000","last_became_active":"2024-03-19T06:22:11.794808+0000","last_became_peered":"2024-03-19T06:22:11.794808+0000","last_unstale":"2024-03-19T06:22:13.949920+0000","last_undegraded":"2024-03-19T06:22:13.949920+0000","last_fullsized":"2024-03-19T06:22:13.949920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:52:11.332786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782532+0000","last_change":"2024-03-19T06:22:12.807613+0000","last_active":"2024-03-19T06:22:13.782532+0000","last_peered":"2024-03-19T06:22:13.782532+0000","last_clean":"2024-03-19T06:22:13.782532+0000","last_became_active":"2024-03-19T06:22:12.807323+0000","last_became_peered":"2024-03-19T06:22:12.807323+0000","last_unstale":"2024-03-19T06:22:13.782532+0000","last_undegraded":"2024-03-19T06:22:13.782532+0000","last_fullsized":"2024-03-19T06:22:13.782532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:34:23.250483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806370+0000","last_change":"2024-03-19T06:22:11.790444+0000","last_active":"2024-03-19T06:22:13.806370+0000","last_peered":"2024-03-19T06:22:13.806370+0000","last_clean":"2024-03-19T06:22:13.806370+0000","last_became_active":"2024-03-19T06:22:11.790132+0000","last_became_peered":"2024-03-19T06:22:11.790132+0000","last_unstale":"2024-03-19T06:22:13.806370+0000","last_undegraded":"2024-03-19T06:22:13.806370+0000","last_fullsized":"2024-03-19T06:22:13.806370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:33:37.895511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786450+0000","last_change":"2024-03-19T06:22:12.809636+0000","last_active":"2024-03-19T06:22:13.786450+0000","last_peered":"2024-03-19T06:22:13.786450+0000","last_clean":"2024-03-19T06:22:13.786450+0000","last_became_active":"2024-03-19T06:22:12.809214+0000","last_became_peered":"2024-03-19T06:22:12.809214+0000","last_unstale":"2024-03-19T06:22:13.786450+0000","last_undegraded":"2024-03-19T06:22:13.786450+0000","last_fullsized":"2024-03-19T06:22:13.786450+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:35:35.057020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782082+0000","last_change":"2024-03-19T06:22:11.792957+0000","last_active":"2024-03-19T06:22:13.782082+0000","last_peered":"2024-03-19T06:22:13.782082+0000","last_clean":"2024-03-19T06:22:13.782082+0000","last_became_active":"2024-03-19T06:22:11.792682+0000","last_became_peered":"2024-03-19T06:22:11.792682+0000","last_unstale":"2024-03-19T06:22:13.782082+0000","last_undegraded":"2024-03-19T06:22:13.782082+0000","last_fullsized":"2024-03-19T06:22:13.782082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:24.575297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949181+0000","last_change":"2024-03-19T06:22:12.806001+0000","last_active":"2024-03-19T06:22:13.949181+0000","last_peered":"2024-03-19T06:22:13.949181+0000","last_clean":"2024-03-19T06:22:13.949181+0000","last_became_active":"2024-03-19T06:22:12.805584+0000","last_became_peered":"2024-03-19T06:22:12.805584+0000","last_unstale":"2024-03-19T06:22:13.949181+0000","last_undegraded":"2024-03-19T06:22:13.949181+0000","last_fullsized":"2024-03-19T06:22:13.949181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:46:28.083952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782011+0000","last_change":"2024-03-19T06:22:11.782315+0000","last_active":"2024-03-19T06:22:13.782011+0000","last_peered":"2024-03-19T06:22:13.782011+0000","last_clean":"2024-03-19T06:22:13.782011+0000","last_became_active":"2024-03-19T06:22:11.782022+0000","last_became_peered":"2024-03-19T06:22:11.782022+0000","last_unstale":"2024-03-19T06:22:13.782011+0000","last_undegraded":"2024-03-19T06:22:13.782011+0000","last_fullsized":"2024-03-19T06:22:13.782011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:59:59.683815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949806+0000","last_change":"2024-03-19T06:22:12.807959+0000","last_active":"2024-03-19T06:22:13.949806+0000","last_peered":"2024-03-19T06:22:13.949806+0000","last_clean":"2024-03-19T06:22:13.949806+0000","last_became_active":"2024-03-19T06:22:12.807622+0000","last_became_peered":"2024-03-19T06:22:12.807622+0000","last_unstale":"2024-03-19T06:22:13.949806+0000","last_undegraded":"2024-03-19T06:22:13.949806+0000","last_fullsized":"2024-03-19T06:22:13.949806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:59:00.668563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.807019+0000","last_change":"2024-03-19T06:22:11.798797+0000","last_active":"2024-03-19T06:22:13.807019+0000","last_peered":"2024-03-19T06:22:13.807019+0000","last_clean":"2024-03-19T06:22:13.807019+0000","last_became_active":"2024-03-19T06:22:11.796493+0000","last_became_peered":"2024-03-19T06:22:11.796493+0000","last_unstale":"2024-03-19T06:22:13.807019+0000","last_undegraded":"2024-03-19T06:22:13.807019+0000","last_fullsized":"2024-03-19T06:22:13.807019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:21:19.744542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786029+0000","last_change":"2024-03-19T06:22:12.803257+0000","last_active":"2024-03-19T06:22:13.786029+0000","last_peered":"2024-03-19T06:22:13.786029+0000","last_clean":"2024-03-19T06:22:13.786029+0000","last_became_active":"2024-03-19T06:22:12.802894+0000","last_became_peered":"2024-03-19T06:22:12.802894+0000","last_unstale":"2024-03-19T06:22:13.786029+0000","last_undegraded":"2024-03-19T06:22:13.786029+0000","last_fullsized":"2024-03-19T06:22:13.786029+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:56:54.973880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949947+0000","last_change":"2024-03-19T06:22:11.789922+0000","last_active":"2024-03-19T06:22:13.949947+0000","last_peered":"2024-03-19T06:22:13.949947+0000","last_clean":"2024-03-19T06:22:13.949947+0000","last_became_active":"2024-03-19T06:22:11.789318+0000","last_became_peered":"2024-03-19T06:22:11.789318+0000","last_unstale":"2024-03-19T06:22:13.949947+0000","last_undegraded":"2024-03-19T06:22:13.949947+0000","last_fullsized":"2024-03-19T06:22:13.949947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:57:16.843221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806688+0000","last_change":"2024-03-19T06:22:12.800142+0000","last_active":"2024-03-19T06:22:13.806688+0000","last_peered":"2024-03-19T06:22:13.806688+0000","last_clean":"2024-03-19T06:22:13.806688+0000","last_became_active":"2024-03-19T06:22:12.799521+0000","last_became_peered":"2024-03-19T06:22:12.799521+0000","last_unstale":"2024-03-19T06:22:13.806688+0000","last_undegraded":"2024-03-19T06:22:13.806688+0000","last_fullsized":"2024-03-19T06:22:13.806688+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:18:02.614576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950093+0000","last_change":"2024-03-19T06:22:11.792226+0000","last_active":"2024-03-19T06:22:13.950093+0000","last_peered":"2024-03-19T06:22:13.950093+0000","last_clean":"2024-03-19T06:22:13.950093+0000","last_became_active":"2024-03-19T06:22:11.791854+0000","last_became_peered":"2024-03-19T06:22:11.791854+0000","last_unstale":"2024-03-19T06:22:13.950093+0000","last_undegraded":"2024-03-19T06:22:13.950093+0000","last_fullsized":"2024-03-19T06:22:13.950093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:25:13.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946714+0000","last_change":"2024-03-19T06:22:12.809432+0000","last_active":"2024-03-19T06:22:13.946714+0000","last_peered":"2024-03-19T06:22:13.946714+0000","last_clean":"2024-03-19T06:22:13.946714+0000","last_became_active":"2024-03-19T06:22:12.808442+0000","last_became_peered":"2024-03-19T06:22:12.808442+0000","last_unstale":"2024-03-19T06:22:13.946714+0000","last_undegraded":"2024-03-19T06:22:13.946714+0000","last_fullsized":"2024-03-19T06:22:13.946714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:33:38.901582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949809+0000","last_change":"2024-03-19T06:22:11.792381+0000","last_active":"2024-03-19T06:22:13.949809+0000","last_peered":"2024-03-19T06:22:13.949809+0000","last_clean":"2024-03-19T06:22:13.949809+0000","last_became_active":"2024-03-19T06:22:11.792047+0000","last_became_peered":"2024-03-19T06:22:11.792047+0000","last_unstale":"2024-03-19T06:22:13.949809+0000","last_undegraded":"2024-03-19T06:22:13.949809+0000","last_fullsized":"2024-03-19T06:22:13.949809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:03:44.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946629+0000","last_change":"2024-03-19T06:22:12.801387+0000","last_active":"2024-03-19T06:22:13.946629+0000","last_peered":"2024-03-19T06:22:13.946629+0000","last_clean":"2024-03-19T06:22:13.946629+0000","last_became_active":"2024-03-19T06:22:12.801113+0000","last_became_peered":"2024-03-19T06:22:12.801113+0000","last_unstale":"2024-03-19T06:22:13.946629+0000","last_undegraded":"2024-03-19T06:22:13.946629+0000","last_fullsized":"2024-03-19T06:22:13.946629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:08:20.837266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804167+0000","last_change":"2024-03-19T06:22:11.799020+0000","last_active":"2024-03-19T06:22:13.804167+0000","last_peered":"2024-03-19T06:22:13.804167+0000","last_clean":"2024-03-19T06:22:13.804167+0000","last_became_active":"2024-03-19T06:22:11.797204+0000","last_became_peered":"2024-03-19T06:22:11.797204+0000","last_unstale":"2024-03-19T06:22:13.804167+0000","last_undegraded":"2024-03-19T06:22:13.804167+0000","last_fullsized":"2024-03-19T06:22:13.804167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:08:19.831195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946770+0000","last_change":"2024-03-19T06:22:12.789679+0000","last_active":"2024-03-19T06:22:13.946770+0000","last_peered":"2024-03-19T06:22:13.946770+0000","last_clean":"2024-03-19T06:22:13.946770+0000","last_became_active":"2024-03-19T06:22:12.789420+0000","last_became_peered":"2024-03-19T06:22:12.789420+0000","last_unstale":"2024-03-19T06:22:13.946770+0000","last_undegraded":"2024-03-19T06:22:13.946770+0000","last_fullsized":"2024-03-19T06:22:13.946770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:43:26.311098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949306+0000","last_change":"2024-03-19T06:22:11.792722+0000","last_active":"2024-03-19T06:22:13.949306+0000","last_peered":"2024-03-19T06:22:13.949306+0000","last_clean":"2024-03-19T06:22:13.949306+0000","last_became_active":"2024-03-19T06:22:11.792333+0000","last_became_peered":"2024-03-19T06:22:11.792333+0000","last_unstale":"2024-03-19T06:22:13.949306+0000","last_undegraded":"2024-03-19T06:22:13.949306+0000","last_fullsized":"2024-03-19T06:22:13.949306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:14:08.824375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946629+0000","last_change":"2024-03-19T06:22:12.789004+0000","last_active":"2024-03-19T06:22:13.946629+0000","last_peered":"2024-03-19T06:22:13.946629+0000","last_clean":"2024-03-19T06:22:13.946629+0000","last_became_active":"2024-03-19T06:22:12.788692+0000","last_became_peered":"2024-03-19T06:22:12.788692+0000","last_unstale":"2024-03-19T06:22:13.946629+0000","last_undegraded":"2024-03-19T06:22:13.946629+0000","last_fullsized":"2024-03-19T06:22:13.946629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:21:20.750613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949359+0000","last_change":"2024-03-19T06:22:11.794192+0000","last_active":"2024-03-19T06:22:13.949359+0000","last_peered":"2024-03-19T06:22:13.949359+0000","last_clean":"2024-03-19T06:22:13.949359+0000","last_became_active":"2024-03-19T06:22:11.793919+0000","last_became_peered":"2024-03-19T06:22:11.793919+0000","last_unstale":"2024-03-19T06:22:13.949359+0000","last_undegraded":"2024-03-19T06:22:13.949359+0000","last_fullsized":"2024-03-19T06:22:13.949359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:12:38.916099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785904+0000","last_change":"2024-03-19T06:22:12.814238+0000","last_active":"2024-03-19T06:22:13.785904+0000","last_peered":"2024-03-19T06:22:13.785904+0000","last_clean":"2024-03-19T06:22:13.785904+0000","last_became_active":"2024-03-19T06:22:12.813658+0000","last_became_peered":"2024-03-19T06:22:12.813658+0000","last_unstale":"2024-03-19T06:22:13.785904+0000","last_undegraded":"2024-03-19T06:22:13.785904+0000","last_fullsized":"2024-03-19T06:22:13.785904+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:20:25.981378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.784985+0000","last_change":"2024-03-19T06:22:11.796982+0000","last_active":"2024-03-19T06:22:13.784985+0000","last_peered":"2024-03-19T06:22:13.784985+0000","last_clean":"2024-03-19T06:22:13.784985+0000","last_became_active":"2024-03-19T06:22:11.796659+0000","last_became_peered":"2024-03-19T06:22:11.796659+0000","last_unstale":"2024-03-19T06:22:13.784985+0000","last_undegraded":"2024-03-19T06:22:13.784985+0000","last_fullsized":"2024-03-19T06:22:13.784985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:59:09.836531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946790+0000","last_change":"2024-03-19T06:22:12.804459+0000","last_active":"2024-03-19T06:22:13.946790+0000","last_peered":"2024-03-19T06:22:13.946790+0000","last_clean":"2024-03-19T06:22:13.946790+0000","last_became_active":"2024-03-19T06:22:12.804206+0000","last_became_peered":"2024-03-19T06:22:12.804206+0000","last_unstale":"2024-03-19T06:22:13.946790+0000","last_undegraded":"2024-03-19T06:22:13.946790+0000","last_fullsized":"2024-03-19T06:22:13.946790+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:46:28.083952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.807039+0000","last_change":"2024-03-19T06:22:11.793140+0000","last_active":"2024-03-19T06:22:13.807039+0000","last_peered":"2024-03-19T06:22:13.807039+0000","last_clean":"2024-03-19T06:22:13.807039+0000","last_became_active":"2024-03-19T06:22:11.792759+0000","last_became_peered":"2024-03-19T06:22:11.792759+0000","last_unstale":"2024-03-19T06:22:13.807039+0000","last_undegraded":"2024-03-19T06:22:13.807039+0000","last_fullsized":"2024-03-19T06:22:13.807039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:08:19.831195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786038+0000","last_change":"2024-03-19T06:22:12.800750+0000","last_active":"2024-03-19T06:22:13.786038+0000","last_peered":"2024-03-19T06:22:13.786038+0000","last_clean":"2024-03-19T06:22:13.786038+0000","last_became_active":"2024-03-19T06:22:12.800443+0000","last_became_peered":"2024-03-19T06:22:12.800443+0000","last_unstale":"2024-03-19T06:22:13.786038+0000","last_undegraded":"2024-03-19T06:22:13.786038+0000","last_fullsized":"2024-03-19T06:22:13.786038+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:41:39.027232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804300+0000","last_change":"2024-03-19T06:22:11.799755+0000","last_active":"2024-03-19T06:22:13.804300+0000","last_peered":"2024-03-19T06:22:13.804300+0000","last_clean":"2024-03-19T06:22:13.804300+0000","last_became_active":"2024-03-19T06:22:11.799522+0000","last_became_peered":"2024-03-19T06:22:11.799522+0000","last_unstale":"2024-03-19T06:22:13.804300+0000","last_undegraded":"2024-03-19T06:22:13.804300+0000","last_fullsized":"2024-03-19T06:22:13.804300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:43:25.305027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804151+0000","last_change":"2024-03-19T06:22:12.786688+0000","last_active":"2024-03-19T06:22:13.804151+0000","last_peered":"2024-03-19T06:22:13.804151+0000","last_clean":"2024-03-19T06:22:13.804151+0000","last_became_active":"2024-03-19T06:22:12.786351+0000","last_became_peered":"2024-03-19T06:22:12.786351+0000","last_unstale":"2024-03-19T06:22:13.804151+0000","last_undegraded":"2024-03-19T06:22:13.804151+0000","last_fullsized":"2024-03-19T06:22:13.804151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:41:53.120939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806674+0000","last_change":"2024-03-19T06:22:11.790421+0000","last_active":"2024-03-19T06:22:13.806674+0000","last_peered":"2024-03-19T06:22:13.806674+0000","last_clean":"2024-03-19T06:22:13.806674+0000","last_became_active":"2024-03-19T06:22:11.790068+0000","last_became_peered":"2024-03-19T06:22:11.790068+0000","last_unstale":"2024-03-19T06:22:13.806674+0000","last_undegraded":"2024-03-19T06:22:13.806674+0000","last_fullsized":"2024-03-19T06:22:13.806674+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:20:25.425737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949252+0000","last_change":"2024-03-19T06:22:12.812345+0000","last_active":"2024-03-19T06:22:13.949252+0000","last_peered":"2024-03-19T06:22:13.949252+0000","last_clean":"2024-03-19T06:22:13.949252+0000","last_became_active":"2024-03-19T06:22:12.812053+0000","last_became_peered":"2024-03-19T06:22:12.812053+0000","last_unstale":"2024-03-19T06:22:13.949252+0000","last_undegraded":"2024-03-19T06:22:13.949252+0000","last_fullsized":"2024-03-19T06:22:13.949252+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:50:23.948221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804327+0000","last_change":"2024-03-19T06:22:11.788623+0000","last_active":"2024-03-19T06:22:13.804327+0000","last_peered":"2024-03-19T06:22:13.804327+0000","last_clean":"2024-03-19T06:22:13.804327+0000","last_became_active":"2024-03-19T06:22:11.785335+0000","last_became_peered":"2024-03-19T06:22:11.785335+0000","last_unstale":"2024-03-19T06:22:13.804327+0000","last_undegraded":"2024-03-19T06:22:13.804327+0000","last_fullsized":"2024-03-19T06:22:13.804327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:19:01.628339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804267+0000","last_change":"2024-03-19T06:22:12.802389+0000","last_active":"2024-03-19T06:22:13.804267+0000","last_peered":"2024-03-19T06:22:13.804267+0000","last_clean":"2024-03-19T06:22:13.804267+0000","last_became_active":"2024-03-19T06:22:12.801899+0000","last_became_peered":"2024-03-19T06:22:12.801899+0000","last_unstale":"2024-03-19T06:22:13.804267+0000","last_undegraded":"2024-03-19T06:22:13.804267+0000","last_fullsized":"2024-03-19T06:22:13.804267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:23:34.295704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806481+0000","last_change":"2024-03-19T06:22:11.790470+0000","last_active":"2024-03-19T06:22:13.806481+0000","last_peered":"2024-03-19T06:22:13.806481+0000","last_clean":"2024-03-19T06:22:13.806481+0000","last_became_active":"2024-03-19T06:22:11.790207+0000","last_became_peered":"2024-03-19T06:22:11.790207+0000","last_unstale":"2024-03-19T06:22:13.806481+0000","last_undegraded":"2024-03-19T06:22:13.806481+0000","last_fullsized":"2024-03-19T06:22:13.806481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:19:01.628339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.781975+0000","last_change":"2024-03-19T06:22:12.798059+0000","last_active":"2024-03-19T06:22:13.781975+0000","last_peered":"2024-03-19T06:22:13.781975+0000","last_clean":"2024-03-19T06:22:13.781975+0000","last_became_active":"2024-03-19T06:22:12.797589+0000","last_became_peered":"2024-03-19T06:22:12.797589+0000","last_unstale":"2024-03-19T06:22:13.781975+0000","last_undegraded":"2024-03-19T06:22:13.781975+0000","last_fullsized":"2024-03-19T06:22:13.781975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:38.121363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949473+0000","last_change":"2024-03-19T06:22:11.781136+0000","last_active":"2024-03-19T06:22:13.949473+0000","last_peered":"2024-03-19T06:22:13.949473+0000","last_clean":"2024-03-19T06:22:13.949473+0000","last_became_active":"2024-03-19T06:22:11.780619+0000","last_became_peered":"2024-03-19T06:22:11.780619+0000","last_unstale":"2024-03-19T06:22:13.949473+0000","last_undegraded":"2024-03-19T06:22:13.949473+0000","last_fullsized":"2024-03-19T06:22:13.949473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:08:55.885727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949388+0000","last_change":"2024-03-19T06:22:12.800198+0000","last_active":"2024-03-19T06:22:13.949388+0000","last_peered":"2024-03-19T06:22:13.949388+0000","last_clean":"2024-03-19T06:22:13.949388+0000","last_became_active":"2024-03-19T06:22:12.799781+0000","last_became_peered":"2024-03-19T06:22:12.799781+0000","last_unstale":"2024-03-19T06:22:13.949388+0000","last_undegraded":"2024-03-19T06:22:13.949388+0000","last_fullsized":"2024-03-19T06:22:13.949388+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:14.509578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782072+0000","last_change":"2024-03-19T06:22:11.797400+0000","last_active":"2024-03-19T06:22:13.782072+0000","last_peered":"2024-03-19T06:22:13.782072+0000","last_clean":"2024-03-19T06:22:13.782072+0000","last_became_active":"2024-03-19T06:22:11.797126+0000","last_became_peered":"2024-03-19T06:22:11.797126+0000","last_unstale":"2024-03-19T06:22:13.782072+0000","last_undegraded":"2024-03-19T06:22:13.782072+0000","last_fullsized":"2024-03-19T06:22:13.782072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:13.503507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785993+0000","last_change":"2024-03-19T06:22:12.818375+0000","last_active":"2024-03-19T06:22:13.785993+0000","last_peered":"2024-03-19T06:22:13.785993+0000","last_clean":"2024-03-19T06:22:13.785993+0000","last_became_active":"2024-03-19T06:22:12.817421+0000","last_became_peered":"2024-03-19T06:22:12.817421+0000","last_unstale":"2024-03-19T06:22:13.785993+0000","last_undegraded":"2024-03-19T06:22:13.785993+0000","last_fullsized":"2024-03-19T06:22:13.785993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:59:58.435424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949400+0000","last_change":"2024-03-19T06:22:11.795751+0000","last_active":"2024-03-19T06:22:13.949400+0000","last_peered":"2024-03-19T06:22:13.949400+0000","last_clean":"2024-03-19T06:22:13.949400+0000","last_became_active":"2024-03-19T06:22:11.795376+0000","last_became_peered":"2024-03-19T06:22:11.795376+0000","last_unstale":"2024-03-19T06:22:13.949400+0000","last_undegraded":"2024-03-19T06:22:13.949400+0000","last_fullsized":"2024-03-19T06:22:13.949400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:00:12.371284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":194,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786663+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:22:13.786663+0000","last_peered":"2024-03-19T06:22:13.786663+0000","last_clean":"2024-03-19T06:22:13.786663+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:22:13.786663+0000","last_undegraded":"2024-03-19T06:22:13.786663+0000","last_fullsized":"2024-03-19T06:22:13.786663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":987136,"data_stored":742990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":153148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":153204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":152602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":405504,"data_stored":154166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":742900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":152636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":405504,"data_stored":154166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:22:21.475 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:22:21.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.636+0000 7fc582000640 1 Processor -- start 2024-03-19T06:22:21.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.636+0000 7fc582000640 1 -- start start 2024-03-19T06:22:21.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.636+0000 7fc582000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc57c0b0900 0x7fc57c0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:21.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.636+0000 7fc582000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc57c06bb90 0x7fc57c0cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:21.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.636+0000 7fc582000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57c0cfc60 con 0x7fc57c0d0440 2024-03-19T06:22:21.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.636+0000 7fc582000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c0d08b0 con 0x7fc57c0b0900 2024-03-19T06:22:21.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.636+0000 7fc582000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c06f200 con 0x7fc57c06bb90 2024-03-19T06:22:21.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.636+0000 7fc580c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc57c0b0900 0x7fc57c0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:21.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.636+0000 7fc581600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc57c0d0440 0x7fc57c070580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60920/0 (socket says 172.21.15.32:60920) 2024-03-19T06:22:21.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.636+0000 7fc581600640 1 -- 172.21.15.32:0/1906004756 learned_addr learned my addr 172.21.15.32:0/1906004756 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:21.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.636+0000 7fc57be00640 1 --2- 172.21.15.32:0/1906004756 >> v2:172.21.15.171:3300/0 conn(0x7fc57c06bb90 0x7fc57c0cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:21.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.636+0000 7fc580c00640 1 -- 172.21.15.32:0/1906004756 >> v2:172.21.15.171:3300/0 conn(0x7fc57c06bb90 msgr2=0x7fc57c0cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:21.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.636+0000 7fc580c00640 1 --2- 172.21.15.32:0/1906004756 >> v2:172.21.15.171:3300/0 conn(0x7fc57c06bb90 0x7fc57c0cff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:21.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.636+0000 7fc580c00640 1 -- 172.21.15.32:0/1906004756 >> v1:172.21.15.32:6789/0 conn(0x7fc57c0d0440 legacy=0x7fc57c070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:21.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.636+0000 7fc580c00640 1 -- 172.21.15.32:0/1906004756 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c06f4e0 con 0x7fc57c0b0900 2024-03-19T06:22:21.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.640+0000 7fc580c00640 1 --2- 172.21.15.32:0/1906004756 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc57c0b0900 0x7fc57c0cf720 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc57c072820 tx=0x7fc57001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2477fab7f036451 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:21.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.640+0000 7fc57b400640 1 -- 172.21.15.32:0/1906004756 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5700b5070 con 0x7fc57c0b0900 2024-03-19T06:22:21.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.640+0000 7fc57b400640 1 -- 172.21.15.32:0/1906004756 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5700a8970 con 0x7fc57c0b0900 2024-03-19T06:22:21.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.640+0000 7fc57b400640 1 -- 172.21.15.32:0/1906004756 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5700a8d40 con 0x7fc57c0b0900 2024-03-19T06:22:21.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.640+0000 7fc582000640 1 -- 172.21.15.32:0/1906004756 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc57c0b0900 msgr2=0x7fc57c0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:21.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.640+0000 7fc582000640 1 --2- 172.21.15.32:0/1906004756 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc57c0b0900 0x7fc57c0cf720 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc57c072820 tx=0x7fc57001ec70 comp rx=0 tx=0).stop 2024-03-19T06:22:21.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.640+0000 7fc582000640 1 -- 172.21.15.32:0/1906004756 shutdown_connections 2024-03-19T06:22:21.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.640+0000 7fc582000640 1 --2- 172.21.15.32:0/1906004756 >> v2:172.21.15.171:3300/0 conn(0x7fc57c06bb90 0x7fc57c0cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:21.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.640+0000 7fc582000640 1 --2- 172.21.15.32:0/1906004756 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc57c0b0900 0x7fc57c0cf720 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:21.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.640+0000 7fc582000640 1 -- 172.21.15.32:0/1906004756 >> 172.21.15.32:0/1906004756 conn(0x7fc57c0d1610 msgr2=0x7fc57c0d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:21.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.640+0000 7fc582000640 1 -- 172.21.15.32:0/1906004756 shutdown_connections 2024-03-19T06:22:21.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.640+0000 7fc582000640 1 -- 172.21.15.32:0/1906004756 wait complete. 2024-03-19T06:22:21.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.640+0000 7fc582000640 1 Processor -- start 2024-03-19T06:22:21.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.640+0000 7fc582000640 1 -- start start 2024-03-19T06:22:21.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc582000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc57c06bb90 0x7fc57c0b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:21.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc582000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc57c0b0900 0x7fc57c0b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:21.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc582000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc57c0d0440 0x7fc57c0b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:21.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc582000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c06fd80 con 0x7fc57c0b0900 2024-03-19T06:22:21.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc582000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c06faa0 con 0x7fc57c06bb90 2024-03-19T06:22:21.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc582000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c070060 con 0x7fc57c0d0440 2024-03-19T06:22:21.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc57be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc57c0b0900 0x7fc57c0b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:21.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc57be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc57c0b0900 0x7fc57c0b41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56724/0 (socket says 172.21.15.32:56724) 2024-03-19T06:22:21.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc57be00640 1 -- 172.21.15.32:0/491803300 learned_addr learned my addr 172.21.15.32:0/491803300 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:21.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc580c00640 1 --2- 172.21.15.32:0/491803300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc57c06bb90 0x7fc57c0b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:21.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc581600640 1 --2- 172.21.15.32:0/491803300 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc57c0d0440 0x7fc57c0b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:21.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc57be00640 1 -- 172.21.15.32:0/491803300 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc57c0d0440 msgr2=0x7fc57c0b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:21.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc57be00640 1 --2- 172.21.15.32:0/491803300 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc57c0d0440 0x7fc57c0b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:21.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc57be00640 1 -- 172.21.15.32:0/491803300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc57c06bb90 msgr2=0x7fc57c0b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:21.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc57be00640 1 --2- 172.21.15.32:0/491803300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc57c06bb90 0x7fc57c0b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:21.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc57be00640 1 -- 172.21.15.32:0/491803300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c0b1650 con 0x7fc57c0b0900 2024-03-19T06:22:21.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc581600640 1 --2- 172.21.15.32:0/491803300 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc57c0d0440 0x7fc57c0b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:21.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc57be00640 1 --2- 172.21.15.32:0/491803300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc57c0b0900 0x7fc57c0b41f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc56800d800 tx=0x7fc56800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:21.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc578c00640 1 -- 172.21.15.32:0/491803300 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56800b6c0 con 0x7fc57c0b0900 2024-03-19T06:22:21.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc578c00640 1 -- 172.21.15.32:0/491803300 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc568019070 con 0x7fc57c0b0900 2024-03-19T06:22:21.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc578c00640 1 -- 172.21.15.32:0/491803300 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56800ba60 con 0x7fc57c0b0900 2024-03-19T06:22:21.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc582000640 1 -- 172.21.15.32:0/491803300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57c0b1930 con 0x7fc57c0b0900 2024-03-19T06:22:21.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc582000640 1 -- 172.21.15.32:0/491803300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c0b1ef0 con 0x7fc57c0b0900 2024-03-19T06:22:21.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.644+0000 7fc582000640 1 -- 172.21.15.32:0/491803300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57c075090 con 0x7fc57c0b0900 2024-03-19T06:22:21.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.648+0000 7fc578c00640 1 -- 172.21.15.32:0/491803300 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc56800bc00 con 0x7fc57c0b0900 2024-03-19T06:22:21.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.648+0000 7fc578c00640 1 --2- 172.21.15.32:0/491803300 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc55c067660 0x7fc55c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:21.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.648+0000 7fc578c00640 1 -- 172.21.15.32:0/491803300 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc568085e10 con 0x7fc57c0b0900 2024-03-19T06:22:21.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.648+0000 7fc580c00640 1 --2- 172.21.15.32:0/491803300 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc55c067660 0x7fc55c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:21.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.648+0000 7fc580c00640 1 --2- 172.21.15.32:0/491803300 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc55c067660 0x7fc55c069b20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc5700b2000 tx=0x7fc570008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:21.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.652+0000 7fc578c00640 1 -- 172.21.15.32:0/491803300 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fc568089030 con 0x7fc57c0b0900 2024-03-19T06:22:21.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.812+0000 7fc582000640 1 -- 172.21.15.32:0/491803300 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc57c15e370 con 0x7fc55c067660 2024-03-19T06:22:21.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.820+0000 7fc578c00640 1 -- 172.21.15.32:0/491803300 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251950 (secure 0 0 0) 0x7fc57c15e370 con 0x7fc55c067660 2024-03-19T06:22:21.814 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:21.816 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:22:21.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.824+0000 7fc582000640 1 -- 172.21.15.32:0/491803300 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc55c067660 msgr2=0x7fc55c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:21.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.824+0000 7fc582000640 1 --2- 172.21.15.32:0/491803300 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc55c067660 0x7fc55c069b20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc5700b2000 tx=0x7fc570008040 comp rx=0 tx=0).stop 2024-03-19T06:22:21.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.824+0000 7fc582000640 1 -- 172.21.15.32:0/491803300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc57c0b0900 msgr2=0x7fc57c0b41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:21.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.824+0000 7fc582000640 1 --2- 172.21.15.32:0/491803300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc57c0b0900 0x7fc57c0b41f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc56800d800 tx=0x7fc56800dcc0 comp rx=0 tx=0).stop 2024-03-19T06:22:21.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.824+0000 7fc582000640 1 -- 172.21.15.32:0/491803300 shutdown_connections 2024-03-19T06:22:21.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.824+0000 7fc582000640 1 --2- 172.21.15.32:0/491803300 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc55c067660 0x7fc55c069b20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:21.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.824+0000 7fc582000640 1 --2- 172.21.15.32:0/491803300 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc57c0d0440 0x7fc57c0b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:21.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.824+0000 7fc582000640 1 --2- 172.21.15.32:0/491803300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc57c0b0900 0x7fc57c0b41f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:21.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.824+0000 7fc582000640 1 --2- 172.21.15.32:0/491803300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc57c06bb90 0x7fc57c0b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:21.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.824+0000 7fc582000640 1 -- 172.21.15.32:0/491803300 >> 172.21.15.32:0/491803300 conn(0x7fc57c0d1610 msgr2=0x7fc57c0ae2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:21.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.824+0000 7fc582000640 1 -- 172.21.15.32:0/491803300 shutdown_connections 2024-03-19T06:22:21.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:21.824+0000 7fc582000640 1 -- 172.21.15.32:0/491803300 wait complete. 2024-03-19T06:22:21.835 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-03-19T06:22:19.936427+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237108,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737612,"statfs":{"total":773094113280,"available":772851314688,"internally_reserved":0,"allocated":4366336,"data_stored":2405812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001483"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950021+0000","last_change":"2024-03-19T06:22:12.804041+0000","last_active":"2024-03-19T06:22:13.950021+0000","last_peered":"2024-03-19T06:22:13.950021+0000","last_clean":"2024-03-19T06:22:13.950021+0000","last_became_active":"2024-03-19T06:22:12.803746+0000","last_became_peered":"2024-03-19T06:22:12.803746+0000","last_unstale":"2024-03-19T06:22:13.950021+0000","last_undegraded":"2024-03-19T06:22:13.950021+0000","last_fullsized":"2024-03-19T06:22:13.950021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:35:58.675849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782830+0000","last_change":"2024-03-19T06:22:12.813377+0000","last_active":"2024-03-19T06:22:13.782830+0000","last_peered":"2024-03-19T06:22:13.782830+0000","last_clean":"2024-03-19T06:22:13.782830+0000","last_became_active":"2024-03-19T06:22:12.810137+0000","last_became_peered":"2024-03-19T06:22:12.810137+0000","last_unstale":"2024-03-19T06:22:13.782830+0000","last_undegraded":"2024-03-19T06:22:13.782830+0000","last_fullsized":"2024-03-19T06:22:13.782830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:54:53.123082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786060+0000","last_change":"2024-03-19T06:22:12.798420+0000","last_active":"2024-03-19T06:22:13.786060+0000","last_peered":"2024-03-19T06:22:13.786060+0000","last_clean":"2024-03-19T06:22:13.786060+0000","last_became_active":"2024-03-19T06:22:12.798093+0000","last_became_peered":"2024-03-19T06:22:12.798093+0000","last_unstale":"2024-03-19T06:22:13.786060+0000","last_undegraded":"2024-03-19T06:22:13.786060+0000","last_fullsized":"2024-03-19T06:22:13.786060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:34:44.044955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806572+0000","last_change":"2024-03-19T06:22:12.800334+0000","last_active":"2024-03-19T06:22:13.806572+0000","last_peered":"2024-03-19T06:22:13.806572+0000","last_clean":"2024-03-19T06:22:13.806572+0000","last_became_active":"2024-03-19T06:22:12.799898+0000","last_became_peered":"2024-03-19T06:22:12.799898+0000","last_unstale":"2024-03-19T06:22:13.806572+0000","last_undegraded":"2024-03-19T06:22:13.806572+0000","last_fullsized":"2024-03-19T06:22:13.806572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:28:51.922537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946624+0000","last_change":"2024-03-19T06:22:12.806664+0000","last_active":"2024-03-19T06:22:13.946624+0000","last_peered":"2024-03-19T06:22:13.946624+0000","last_clean":"2024-03-19T06:22:13.946624+0000","last_became_active":"2024-03-19T06:22:12.806330+0000","last_became_peered":"2024-03-19T06:22:12.806330+0000","last_unstale":"2024-03-19T06:22:13.946624+0000","last_undegraded":"2024-03-19T06:22:13.946624+0000","last_fullsized":"2024-03-19T06:22:13.946624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:00:13.377355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782288+0000","last_change":"2024-03-19T06:22:12.802790+0000","last_active":"2024-03-19T06:22:13.782288+0000","last_peered":"2024-03-19T06:22:13.782288+0000","last_clean":"2024-03-19T06:22:13.782288+0000","last_became_active":"2024-03-19T06:22:12.800768+0000","last_became_peered":"2024-03-19T06:22:12.800768+0000","last_unstale":"2024-03-19T06:22:13.782288+0000","last_undegraded":"2024-03-19T06:22:13.782288+0000","last_fullsized":"2024-03-19T06:22:13.782288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:53:16.147110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786065+0000","last_change":"2024-03-19T06:22:12.815224+0000","last_active":"2024-03-19T06:22:13.786065+0000","last_peered":"2024-03-19T06:22:13.786065+0000","last_clean":"2024-03-19T06:22:13.786065+0000","last_became_active":"2024-03-19T06:22:12.814923+0000","last_became_peered":"2024-03-19T06:22:12.814923+0000","last_unstale":"2024-03-19T06:22:13.786065+0000","last_undegraded":"2024-03-19T06:22:13.786065+0000","last_fullsized":"2024-03-19T06:22:13.786065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:45:25.838474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785848+0000","last_change":"2024-03-19T06:22:12.809758+0000","last_active":"2024-03-19T06:22:13.785848+0000","last_peered":"2024-03-19T06:22:13.785848+0000","last_clean":"2024-03-19T06:22:13.785848+0000","last_became_active":"2024-03-19T06:22:12.809318+0000","last_became_peered":"2024-03-19T06:22:12.809318+0000","last_unstale":"2024-03-19T06:22:13.785848+0000","last_undegraded":"2024-03-19T06:22:13.785848+0000","last_fullsized":"2024-03-19T06:22:13.785848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:51:48.402769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950048+0000","last_change":"2024-03-19T06:22:12.819459+0000","last_active":"2024-03-19T06:22:13.950048+0000","last_peered":"2024-03-19T06:22:13.950048+0000","last_clean":"2024-03-19T06:22:13.950048+0000","last_became_active":"2024-03-19T06:22:12.819097+0000","last_became_peered":"2024-03-19T06:22:12.819097+0000","last_unstale":"2024-03-19T06:22:13.950048+0000","last_undegraded":"2024-03-19T06:22:13.950048+0000","last_fullsized":"2024-03-19T06:22:13.950048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:28:58.380767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806838+0000","last_change":"2024-03-19T06:22:12.809831+0000","last_active":"2024-03-19T06:22:13.806838+0000","last_peered":"2024-03-19T06:22:13.806838+0000","last_clean":"2024-03-19T06:22:13.806838+0000","last_became_active":"2024-03-19T06:22:12.809572+0000","last_became_peered":"2024-03-19T06:22:12.809572+0000","last_unstale":"2024-03-19T06:22:13.806838+0000","last_undegraded":"2024-03-19T06:22:13.806838+0000","last_fullsized":"2024-03-19T06:22:13.806838+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:17:24.870587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786583+0000","last_change":"2024-03-19T06:22:12.822521+0000","last_active":"2024-03-19T06:22:13.786583+0000","last_peered":"2024-03-19T06:22:13.786583+0000","last_clean":"2024-03-19T06:22:13.786583+0000","last_became_active":"2024-03-19T06:22:12.822227+0000","last_became_peered":"2024-03-19T06:22:12.822227+0000","last_unstale":"2024-03-19T06:22:13.786583+0000","last_undegraded":"2024-03-19T06:22:13.786583+0000","last_fullsized":"2024-03-19T06:22:13.786583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:34:44.044955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785307+0000","last_change":"2024-03-19T06:22:12.805492+0000","last_active":"2024-03-19T06:22:13.785307+0000","last_peered":"2024-03-19T06:22:13.785307+0000","last_clean":"2024-03-19T06:22:13.785307+0000","last_became_active":"2024-03-19T06:22:12.805224+0000","last_became_peered":"2024-03-19T06:22:12.805224+0000","last_unstale":"2024-03-19T06:22:13.785307+0000","last_undegraded":"2024-03-19T06:22:13.785307+0000","last_fullsized":"2024-03-19T06:22:13.785307+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:45:25.838474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946771+0000","last_change":"2024-03-19T06:22:12.791057+0000","last_active":"2024-03-19T06:22:13.946771+0000","last_peered":"2024-03-19T06:22:13.946771+0000","last_clean":"2024-03-19T06:22:13.946771+0000","last_became_active":"2024-03-19T06:22:12.790791+0000","last_became_peered":"2024-03-19T06:22:12.790791+0000","last_unstale":"2024-03-19T06:22:13.946771+0000","last_undegraded":"2024-03-19T06:22:13.946771+0000","last_fullsized":"2024-03-19T06:22:13.946771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:19:02.634410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782427+0000","last_change":"2024-03-19T06:22:12.799728+0000","last_active":"2024-03-19T06:22:13.782427+0000","last_peered":"2024-03-19T06:22:13.782427+0000","last_clean":"2024-03-19T06:22:13.782427+0000","last_became_active":"2024-03-19T06:22:12.799510+0000","last_became_peered":"2024-03-19T06:22:12.799510+0000","last_unstale":"2024-03-19T06:22:13.782427+0000","last_undegraded":"2024-03-19T06:22:13.782427+0000","last_fullsized":"2024-03-19T06:22:13.782427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:49:46.460288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785442+0000","last_change":"2024-03-19T06:22:12.802286+0000","last_active":"2024-03-19T06:22:13.785442+0000","last_peered":"2024-03-19T06:22:13.785442+0000","last_clean":"2024-03-19T06:22:13.785442+0000","last_became_active":"2024-03-19T06:22:12.801976+0000","last_became_peered":"2024-03-19T06:22:12.801976+0000","last_unstale":"2024-03-19T06:22:13.785442+0000","last_undegraded":"2024-03-19T06:22:13.785442+0000","last_fullsized":"2024-03-19T06:22:13.785442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:04:56.906112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786705+0000","last_change":"2024-03-19T06:22:12.816928+0000","last_active":"2024-03-19T06:22:13.786705+0000","last_peered":"2024-03-19T06:22:13.786705+0000","last_clean":"2024-03-19T06:22:13.786705+0000","last_became_active":"2024-03-19T06:22:12.816556+0000","last_became_peered":"2024-03-19T06:22:12.816556+0000","last_unstale":"2024-03-19T06:22:13.786705+0000","last_undegraded":"2024-03-19T06:22:13.786705+0000","last_fullsized":"2024-03-19T06:22:13.786705+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:43:04.048468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786304+0000","last_change":"2024-03-19T06:22:12.818369+0000","last_active":"2024-03-19T06:22:13.786304+0000","last_peered":"2024-03-19T06:22:13.786304+0000","last_clean":"2024-03-19T06:22:13.786304+0000","last_became_active":"2024-03-19T06:22:12.816969+0000","last_became_peered":"2024-03-19T06:22:12.816969+0000","last_unstale":"2024-03-19T06:22:13.786304+0000","last_undegraded":"2024-03-19T06:22:13.786304+0000","last_fullsized":"2024-03-19T06:22:13.786304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:03:37.412574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782823+0000","last_change":"2024-03-19T06:22:12.801364+0000","last_active":"2024-03-19T06:22:13.782823+0000","last_peered":"2024-03-19T06:22:13.782823+0000","last_clean":"2024-03-19T06:22:13.782823+0000","last_became_active":"2024-03-19T06:22:12.801016+0000","last_became_peered":"2024-03-19T06:22:12.801016+0000","last_unstale":"2024-03-19T06:22:13.782823+0000","last_undegraded":"2024-03-19T06:22:13.782823+0000","last_fullsized":"2024-03-19T06:22:13.782823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:36:02.560779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782657+0000","last_change":"2024-03-19T06:22:12.799453+0000","last_active":"2024-03-19T06:22:13.782657+0000","last_peered":"2024-03-19T06:22:13.782657+0000","last_clean":"2024-03-19T06:22:13.782657+0000","last_became_active":"2024-03-19T06:22:12.799175+0000","last_became_peered":"2024-03-19T06:22:12.799175+0000","last_unstale":"2024-03-19T06:22:13.782657+0000","last_undegraded":"2024-03-19T06:22:13.782657+0000","last_fullsized":"2024-03-19T06:22:13.782657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:19:47.036468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946765+0000","last_change":"2024-03-19T06:22:12.797998+0000","last_active":"2024-03-19T06:22:13.946765+0000","last_peered":"2024-03-19T06:22:13.946765+0000","last_clean":"2024-03-19T06:22:13.946765+0000","last_became_active":"2024-03-19T06:22:12.797691+0000","last_became_peered":"2024-03-19T06:22:12.797691+0000","last_unstale":"2024-03-19T06:22:13.946765+0000","last_undegraded":"2024-03-19T06:22:13.946765+0000","last_fullsized":"2024-03-19T06:22:13.946765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:20:26.431808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949442+0000","last_change":"2024-03-19T06:22:12.811038+0000","last_active":"2024-03-19T06:22:13.949442+0000","last_peered":"2024-03-19T06:22:13.949442+0000","last_clean":"2024-03-19T06:22:13.949442+0000","last_became_active":"2024-03-19T06:22:12.810750+0000","last_became_peered":"2024-03-19T06:22:12.810750+0000","last_unstale":"2024-03-19T06:22:13.949442+0000","last_undegraded":"2024-03-19T06:22:13.949442+0000","last_fullsized":"2024-03-19T06:22:13.949442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:15:49.184635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949569+0000","last_change":"2024-03-19T06:22:12.808465+0000","last_active":"2024-03-19T06:22:13.949569+0000","last_peered":"2024-03-19T06:22:13.949569+0000","last_clean":"2024-03-19T06:22:13.949569+0000","last_became_active":"2024-03-19T06:22:12.808155+0000","last_became_peered":"2024-03-19T06:22:12.808155+0000","last_unstale":"2024-03-19T06:22:13.949569+0000","last_undegraded":"2024-03-19T06:22:13.949569+0000","last_fullsized":"2024-03-19T06:22:13.949569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:07:58.346504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804010+0000","last_change":"2024-03-19T06:22:12.806362+0000","last_active":"2024-03-19T06:22:13.804010+0000","last_peered":"2024-03-19T06:22:13.804010+0000","last_clean":"2024-03-19T06:22:13.804010+0000","last_became_active":"2024-03-19T06:22:12.805434+0000","last_became_peered":"2024-03-19T06:22:12.805434+0000","last_unstale":"2024-03-19T06:22:13.804010+0000","last_undegraded":"2024-03-19T06:22:13.804010+0000","last_fullsized":"2024-03-19T06:22:13.804010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:02:11.073512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785153+0000","last_change":"2024-03-19T06:22:12.808697+0000","last_active":"2024-03-19T06:22:13.785153+0000","last_peered":"2024-03-19T06:22:13.785153+0000","last_clean":"2024-03-19T06:22:13.785153+0000","last_became_active":"2024-03-19T06:22:12.808406+0000","last_became_peered":"2024-03-19T06:22:12.808406+0000","last_unstale":"2024-03-19T06:22:13.785153+0000","last_undegraded":"2024-03-19T06:22:13.785153+0000","last_fullsized":"2024-03-19T06:22:13.785153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:20:25.981378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.807007+0000","last_change":"2024-03-19T06:22:12.814424+0000","last_active":"2024-03-19T06:22:13.807007+0000","last_peered":"2024-03-19T06:22:13.807007+0000","last_clean":"2024-03-19T06:22:13.807007+0000","last_became_active":"2024-03-19T06:22:12.814175+0000","last_became_peered":"2024-03-19T06:22:12.814175+0000","last_unstale":"2024-03-19T06:22:13.807007+0000","last_undegraded":"2024-03-19T06:22:13.807007+0000","last_fullsized":"2024-03-19T06:22:13.807007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:03:03.253970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782901+0000","last_change":"2024-03-19T06:22:12.813107+0000","last_active":"2024-03-19T06:22:13.782901+0000","last_peered":"2024-03-19T06:22:13.782901+0000","last_clean":"2024-03-19T06:22:13.782901+0000","last_became_active":"2024-03-19T06:22:12.812747+0000","last_became_peered":"2024-03-19T06:22:12.812747+0000","last_unstale":"2024-03-19T06:22:13.782901+0000","last_undegraded":"2024-03-19T06:22:13.782901+0000","last_fullsized":"2024-03-19T06:22:13.782901+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:32.790613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806852+0000","last_change":"2024-03-19T06:22:12.807727+0000","last_active":"2024-03-19T06:22:13.806852+0000","last_peered":"2024-03-19T06:22:13.806852+0000","last_clean":"2024-03-19T06:22:13.806852+0000","last_became_active":"2024-03-19T06:22:12.803732+0000","last_became_peered":"2024-03-19T06:22:12.803732+0000","last_unstale":"2024-03-19T06:22:13.806852+0000","last_undegraded":"2024-03-19T06:22:13.806852+0000","last_fullsized":"2024-03-19T06:22:13.806852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:24:25.721736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785651+0000","last_change":"2024-03-19T06:22:12.808029+0000","last_active":"2024-03-19T06:22:13.785651+0000","last_peered":"2024-03-19T06:22:13.785651+0000","last_clean":"2024-03-19T06:22:13.785651+0000","last_became_active":"2024-03-19T06:22:12.806666+0000","last_became_peered":"2024-03-19T06:22:12.806666+0000","last_unstale":"2024-03-19T06:22:13.785651+0000","last_undegraded":"2024-03-19T06:22:13.785651+0000","last_fullsized":"2024-03-19T06:22:13.785651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:03:37.412574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949639+0000","last_change":"2024-03-19T06:22:12.807735+0000","last_active":"2024-03-19T06:22:13.949639+0000","last_peered":"2024-03-19T06:22:13.949639+0000","last_clean":"2024-03-19T06:22:13.949639+0000","last_became_active":"2024-03-19T06:22:12.807440+0000","last_became_peered":"2024-03-19T06:22:12.807440+0000","last_unstale":"2024-03-19T06:22:13.949639+0000","last_undegraded":"2024-03-19T06:22:13.949639+0000","last_fullsized":"2024-03-19T06:22:13.949639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:36:33.458254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786452+0000","last_change":"2024-03-19T06:22:12.818815+0000","last_active":"2024-03-19T06:22:13.786452+0000","last_peered":"2024-03-19T06:22:13.786452+0000","last_clean":"2024-03-19T06:22:13.786452+0000","last_became_active":"2024-03-19T06:22:12.818580+0000","last_became_peered":"2024-03-19T06:22:12.818580+0000","last_unstale":"2024-03-19T06:22:13.786452+0000","last_undegraded":"2024-03-19T06:22:13.786452+0000","last_fullsized":"2024-03-19T06:22:13.786452+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:56:54.973880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949190+0000","last_change":"2024-03-19T06:22:12.800990+0000","last_active":"2024-03-19T06:22:13.949190+0000","last_peered":"2024-03-19T06:22:13.949190+0000","last_clean":"2024-03-19T06:22:13.949190+0000","last_became_active":"2024-03-19T06:22:12.800638+0000","last_became_peered":"2024-03-19T06:22:12.800638+0000","last_unstale":"2024-03-19T06:22:13.949190+0000","last_undegraded":"2024-03-19T06:22:13.949190+0000","last_fullsized":"2024-03-19T06:22:13.949190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:23:53.303775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786498+0000","last_change":"2024-03-19T06:22:12.809519+0000","last_active":"2024-03-19T06:22:13.786498+0000","last_peered":"2024-03-19T06:22:13.786498+0000","last_clean":"2024-03-19T06:22:13.786498+0000","last_became_active":"2024-03-19T06:22:12.808783+0000","last_became_peered":"2024-03-19T06:22:12.808783+0000","last_unstale":"2024-03-19T06:22:13.786498+0000","last_undegraded":"2024-03-19T06:22:13.786498+0000","last_fullsized":"2024-03-19T06:22:13.786498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:41:39.027232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804218+0000","last_change":"2024-03-19T06:22:12.811207+0000","last_active":"2024-03-19T06:22:13.804218+0000","last_peered":"2024-03-19T06:22:13.804218+0000","last_clean":"2024-03-19T06:22:13.804218+0000","last_became_active":"2024-03-19T06:22:12.810928+0000","last_became_peered":"2024-03-19T06:22:12.810928+0000","last_unstale":"2024-03-19T06:22:13.804218+0000","last_undegraded":"2024-03-19T06:22:13.804218+0000","last_fullsized":"2024-03-19T06:22:13.804218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:59:18.790179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950170+0000","last_change":"2024-03-19T06:22:11.790374+0000","last_active":"2024-03-19T06:22:13.950170+0000","last_peered":"2024-03-19T06:22:13.950170+0000","last_clean":"2024-03-19T06:22:13.950170+0000","last_became_active":"2024-03-19T06:22:11.790015+0000","last_became_peered":"2024-03-19T06:22:11.790015+0000","last_unstale":"2024-03-19T06:22:13.950170+0000","last_undegraded":"2024-03-19T06:22:13.950170+0000","last_fullsized":"2024-03-19T06:22:13.950170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:21:19.744542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950178+0000","last_change":"2024-03-19T06:22:12.807939+0000","last_active":"2024-03-19T06:22:13.950178+0000","last_peered":"2024-03-19T06:22:13.950178+0000","last_clean":"2024-03-19T06:22:13.950178+0000","last_became_active":"2024-03-19T06:22:12.807658+0000","last_became_peered":"2024-03-19T06:22:12.807658+0000","last_unstale":"2024-03-19T06:22:13.950178+0000","last_undegraded":"2024-03-19T06:22:13.950178+0000","last_fullsized":"2024-03-19T06:22:13.950178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:57:38.347495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804203+0000","last_change":"2024-03-19T06:22:11.795057+0000","last_active":"2024-03-19T06:22:13.804203+0000","last_peered":"2024-03-19T06:22:13.804203+0000","last_clean":"2024-03-19T06:22:13.804203+0000","last_became_active":"2024-03-19T06:22:11.794668+0000","last_became_peered":"2024-03-19T06:22:11.794668+0000","last_unstale":"2024-03-19T06:22:13.804203+0000","last_undegraded":"2024-03-19T06:22:13.804203+0000","last_fullsized":"2024-03-19T06:22:13.804203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:33:37.895511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950121+0000","last_change":"2024-03-19T06:22:12.806044+0000","last_active":"2024-03-19T06:22:13.950121+0000","last_peered":"2024-03-19T06:22:13.950121+0000","last_clean":"2024-03-19T06:22:13.950121+0000","last_became_active":"2024-03-19T06:22:12.805753+0000","last_became_peered":"2024-03-19T06:22:12.805753+0000","last_unstale":"2024-03-19T06:22:13.950121+0000","last_undegraded":"2024-03-19T06:22:13.950121+0000","last_fullsized":"2024-03-19T06:22:13.950121+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:45:02.480430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782617+0000","last_change":"2024-03-19T06:22:11.782865+0000","last_active":"2024-03-19T06:22:13.782617+0000","last_peered":"2024-03-19T06:22:13.782617+0000","last_clean":"2024-03-19T06:22:13.782617+0000","last_became_active":"2024-03-19T06:22:11.781430+0000","last_became_peered":"2024-03-19T06:22:11.781430+0000","last_unstale":"2024-03-19T06:22:13.782617+0000","last_undegraded":"2024-03-19T06:22:13.782617+0000","last_fullsized":"2024-03-19T06:22:13.782617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:23:11.347650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806879+0000","last_change":"2024-03-19T06:22:12.805021+0000","last_active":"2024-03-19T06:22:13.806879+0000","last_peered":"2024-03-19T06:22:13.806879+0000","last_clean":"2024-03-19T06:22:13.806879+0000","last_became_active":"2024-03-19T06:22:12.803153+0000","last_became_peered":"2024-03-19T06:22:12.803153+0000","last_unstale":"2024-03-19T06:22:13.806879+0000","last_undegraded":"2024-03-19T06:22:13.806879+0000","last_fullsized":"2024-03-19T06:22:13.806879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:30:29.466312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946832+0000","last_change":"2024-03-19T06:22:11.797785+0000","last_active":"2024-03-19T06:22:13.946832+0000","last_peered":"2024-03-19T06:22:13.946832+0000","last_clean":"2024-03-19T06:22:13.946832+0000","last_became_active":"2024-03-19T06:22:11.797465+0000","last_became_peered":"2024-03-19T06:22:11.797465+0000","last_unstale":"2024-03-19T06:22:13.946832+0000","last_undegraded":"2024-03-19T06:22:13.946832+0000","last_fullsized":"2024-03-19T06:22:13.946832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:07:49.139990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786293+0000","last_change":"2024-03-19T06:22:12.813971+0000","last_active":"2024-03-19T06:22:13.786293+0000","last_peered":"2024-03-19T06:22:13.786293+0000","last_clean":"2024-03-19T06:22:13.786293+0000","last_became_active":"2024-03-19T06:22:12.813643+0000","last_became_peered":"2024-03-19T06:22:12.813643+0000","last_unstale":"2024-03-19T06:22:13.786293+0000","last_undegraded":"2024-03-19T06:22:13.786293+0000","last_fullsized":"2024-03-19T06:22:13.786293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:04:56.906112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949778+0000","last_change":"2024-03-19T06:22:11.792783+0000","last_active":"2024-03-19T06:22:13.949778+0000","last_peered":"2024-03-19T06:22:13.949778+0000","last_clean":"2024-03-19T06:22:13.949778+0000","last_became_active":"2024-03-19T06:22:11.791824+0000","last_became_peered":"2024-03-19T06:22:11.791824+0000","last_unstale":"2024-03-19T06:22:13.949778+0000","last_undegraded":"2024-03-19T06:22:13.949778+0000","last_fullsized":"2024-03-19T06:22:13.949778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:23:23.700595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785307+0000","last_change":"2024-03-19T06:22:12.798709+0000","last_active":"2024-03-19T06:22:13.785307+0000","last_peered":"2024-03-19T06:22:13.785307+0000","last_clean":"2024-03-19T06:22:13.785307+0000","last_became_active":"2024-03-19T06:22:12.798302+0000","last_became_peered":"2024-03-19T06:22:12.798302+0000","last_unstale":"2024-03-19T06:22:13.785307+0000","last_undegraded":"2024-03-19T06:22:13.785307+0000","last_fullsized":"2024-03-19T06:22:13.785307+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:59:58.435424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949696+0000","last_change":"2024-03-19T06:22:11.796432+0000","last_active":"2024-03-19T06:22:13.949696+0000","last_peered":"2024-03-19T06:22:13.949696+0000","last_clean":"2024-03-19T06:22:13.949696+0000","last_became_active":"2024-03-19T06:22:11.794614+0000","last_became_peered":"2024-03-19T06:22:11.794614+0000","last_unstale":"2024-03-19T06:22:13.949696+0000","last_undegraded":"2024-03-19T06:22:13.949696+0000","last_fullsized":"2024-03-19T06:22:13.949696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:15:41.175621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949428+0000","last_change":"2024-03-19T06:22:12.804385+0000","last_active":"2024-03-19T06:22:13.949428+0000","last_peered":"2024-03-19T06:22:13.949428+0000","last_clean":"2024-03-19T06:22:13.949428+0000","last_became_active":"2024-03-19T06:22:12.804022+0000","last_became_peered":"2024-03-19T06:22:12.804022+0000","last_unstale":"2024-03-19T06:22:13.949428+0000","last_undegraded":"2024-03-19T06:22:13.949428+0000","last_fullsized":"2024-03-19T06:22:13.949428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:41:28.053793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782068+0000","last_change":"2024-03-19T06:22:11.785078+0000","last_active":"2024-03-19T06:22:13.782068+0000","last_peered":"2024-03-19T06:22:13.782068+0000","last_clean":"2024-03-19T06:22:13.782068+0000","last_became_active":"2024-03-19T06:22:11.783561+0000","last_became_peered":"2024-03-19T06:22:11.783561+0000","last_unstale":"2024-03-19T06:22:13.782068+0000","last_undegraded":"2024-03-19T06:22:13.782068+0000","last_fullsized":"2024-03-19T06:22:13.782068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:38:39.623722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806482+0000","last_change":"2024-03-19T06:22:12.791613+0000","last_active":"2024-03-19T06:22:13.806482+0000","last_peered":"2024-03-19T06:22:13.806482+0000","last_clean":"2024-03-19T06:22:13.806482+0000","last_became_active":"2024-03-19T06:22:12.791348+0000","last_became_peered":"2024-03-19T06:22:12.791348+0000","last_unstale":"2024-03-19T06:22:13.806482+0000","last_undegraded":"2024-03-19T06:22:13.806482+0000","last_fullsized":"2024-03-19T06:22:13.806482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:23:34.295704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949201+0000","last_change":"2024-03-19T06:22:11.796210+0000","last_active":"2024-03-19T06:22:13.949201+0000","last_peered":"2024-03-19T06:22:13.949201+0000","last_clean":"2024-03-19T06:22:13.949201+0000","last_became_active":"2024-03-19T06:22:11.795816+0000","last_became_peered":"2024-03-19T06:22:11.795816+0000","last_unstale":"2024-03-19T06:22:13.949201+0000","last_undegraded":"2024-03-19T06:22:13.949201+0000","last_fullsized":"2024-03-19T06:22:13.949201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:26:41.154332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785806+0000","last_change":"2024-03-19T06:22:12.811822+0000","last_active":"2024-03-19T06:22:13.785806+0000","last_peered":"2024-03-19T06:22:13.785806+0000","last_clean":"2024-03-19T06:22:13.785806+0000","last_became_active":"2024-03-19T06:22:12.811547+0000","last_became_peered":"2024-03-19T06:22:12.811547+0000","last_unstale":"2024-03-19T06:22:13.785806+0000","last_undegraded":"2024-03-19T06:22:13.785806+0000","last_fullsized":"2024-03-19T06:22:13.785806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:35:35.057020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782834+0000","last_change":"2024-03-19T06:22:11.797779+0000","last_active":"2024-03-19T06:22:13.782834+0000","last_peered":"2024-03-19T06:22:13.782834+0000","last_clean":"2024-03-19T06:22:13.782834+0000","last_became_active":"2024-03-19T06:22:11.797477+0000","last_became_peered":"2024-03-19T06:22:11.797477+0000","last_unstale":"2024-03-19T06:22:13.782834+0000","last_undegraded":"2024-03-19T06:22:13.782834+0000","last_fullsized":"2024-03-19T06:22:13.782834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:58:59.662492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782810+0000","last_change":"2024-03-19T06:22:12.801487+0000","last_active":"2024-03-19T06:22:13.782810+0000","last_peered":"2024-03-19T06:22:13.782810+0000","last_clean":"2024-03-19T06:22:13.782810+0000","last_became_active":"2024-03-19T06:22:12.801196+0000","last_became_peered":"2024-03-19T06:22:12.801196+0000","last_unstale":"2024-03-19T06:22:13.782810+0000","last_undegraded":"2024-03-19T06:22:13.782810+0000","last_fullsized":"2024-03-19T06:22:13.782810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:37:25.965590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804250+0000","last_change":"2024-03-19T06:22:11.792727+0000","last_active":"2024-03-19T06:22:13.804250+0000","last_peered":"2024-03-19T06:22:13.804250+0000","last_clean":"2024-03-19T06:22:13.804250+0000","last_became_active":"2024-03-19T06:22:11.792399+0000","last_became_peered":"2024-03-19T06:22:11.792399+0000","last_unstale":"2024-03-19T06:22:13.804250+0000","last_undegraded":"2024-03-19T06:22:13.804250+0000","last_fullsized":"2024-03-19T06:22:13.804250+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:20:25.425737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782617+0000","last_change":"2024-03-19T06:22:12.814392+0000","last_active":"2024-03-19T06:22:13.782617+0000","last_peered":"2024-03-19T06:22:13.782617+0000","last_clean":"2024-03-19T06:22:13.782617+0000","last_became_active":"2024-03-19T06:22:12.813815+0000","last_became_peered":"2024-03-19T06:22:12.813815+0000","last_unstale":"2024-03-19T06:22:13.782617+0000","last_undegraded":"2024-03-19T06:22:13.782617+0000","last_fullsized":"2024-03-19T06:22:13.782617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:54:29.091078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786099+0000","last_change":"2024-03-19T06:22:11.798009+0000","last_active":"2024-03-19T06:22:13.786099+0000","last_peered":"2024-03-19T06:22:13.786099+0000","last_clean":"2024-03-19T06:22:13.786099+0000","last_became_active":"2024-03-19T06:22:11.797604+0000","last_became_peered":"2024-03-19T06:22:11.797604+0000","last_unstale":"2024-03-19T06:22:13.786099+0000","last_undegraded":"2024-03-19T06:22:13.786099+0000","last_fullsized":"2024-03-19T06:22:13.786099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:02:10.067441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786262+0000","last_change":"2024-03-19T06:22:12.799327+0000","last_active":"2024-03-19T06:22:13.786262+0000","last_peered":"2024-03-19T06:22:13.786262+0000","last_clean":"2024-03-19T06:22:13.786262+0000","last_became_active":"2024-03-19T06:22:12.799022+0000","last_became_peered":"2024-03-19T06:22:12.799022+0000","last_unstale":"2024-03-19T06:22:13.786262+0000","last_undegraded":"2024-03-19T06:22:13.786262+0000","last_fullsized":"2024-03-19T06:22:13.786262+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:43:04.048468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782699+0000","last_change":"2024-03-19T06:22:11.791858+0000","last_active":"2024-03-19T06:22:13.782699+0000","last_peered":"2024-03-19T06:22:13.782699+0000","last_clean":"2024-03-19T06:22:13.782699+0000","last_became_active":"2024-03-19T06:22:11.791423+0000","last_became_peered":"2024-03-19T06:22:11.791423+0000","last_unstale":"2024-03-19T06:22:13.782699+0000","last_undegraded":"2024-03-19T06:22:13.782699+0000","last_fullsized":"2024-03-19T06:22:13.782699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:15:48.178564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806423+0000","last_change":"2024-03-19T06:22:12.789952+0000","last_active":"2024-03-19T06:22:13.806423+0000","last_peered":"2024-03-19T06:22:13.806423+0000","last_clean":"2024-03-19T06:22:13.806423+0000","last_became_active":"2024-03-19T06:22:12.789667+0000","last_became_peered":"2024-03-19T06:22:12.789667+0000","last_unstale":"2024-03-19T06:22:13.806423+0000","last_undegraded":"2024-03-19T06:22:13.806423+0000","last_fullsized":"2024-03-19T06:22:13.806423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:59:18.790179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949920+0000","last_change":"2024-03-19T06:22:11.796046+0000","last_active":"2024-03-19T06:22:13.949920+0000","last_peered":"2024-03-19T06:22:13.949920+0000","last_clean":"2024-03-19T06:22:13.949920+0000","last_became_active":"2024-03-19T06:22:11.794808+0000","last_became_peered":"2024-03-19T06:22:11.794808+0000","last_unstale":"2024-03-19T06:22:13.949920+0000","last_undegraded":"2024-03-19T06:22:13.949920+0000","last_fullsized":"2024-03-19T06:22:13.949920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:52:11.332786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782532+0000","last_change":"2024-03-19T06:22:12.807613+0000","last_active":"2024-03-19T06:22:13.782532+0000","last_peered":"2024-03-19T06:22:13.782532+0000","last_clean":"2024-03-19T06:22:13.782532+0000","last_became_active":"2024-03-19T06:22:12.807323+0000","last_became_peered":"2024-03-19T06:22:12.807323+0000","last_unstale":"2024-03-19T06:22:13.782532+0000","last_undegraded":"2024-03-19T06:22:13.782532+0000","last_fullsized":"2024-03-19T06:22:13.782532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:34:23.250483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806370+0000","last_change":"2024-03-19T06:22:11.790444+0000","last_active":"2024-03-19T06:22:13.806370+0000","last_peered":"2024-03-19T06:22:13.806370+0000","last_clean":"2024-03-19T06:22:13.806370+0000","last_became_active":"2024-03-19T06:22:11.790132+0000","last_became_peered":"2024-03-19T06:22:11.790132+0000","last_unstale":"2024-03-19T06:22:13.806370+0000","last_undegraded":"2024-03-19T06:22:13.806370+0000","last_fullsized":"2024-03-19T06:22:13.806370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:33:37.895511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786450+0000","last_change":"2024-03-19T06:22:12.809636+0000","last_active":"2024-03-19T06:22:13.786450+0000","last_peered":"2024-03-19T06:22:13.786450+0000","last_clean":"2024-03-19T06:22:13.786450+0000","last_became_active":"2024-03-19T06:22:12.809214+0000","last_became_peered":"2024-03-19T06:22:12.809214+0000","last_unstale":"2024-03-19T06:22:13.786450+0000","last_undegraded":"2024-03-19T06:22:13.786450+0000","last_fullsized":"2024-03-19T06:22:13.786450+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:35:35.057020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782082+0000","last_change":"2024-03-19T06:22:11.792957+0000","last_active":"2024-03-19T06:22:13.782082+0000","last_peered":"2024-03-19T06:22:13.782082+0000","last_clean":"2024-03-19T06:22:13.782082+0000","last_became_active":"2024-03-19T06:22:11.792682+0000","last_became_peered":"2024-03-19T06:22:11.792682+0000","last_unstale":"2024-03-19T06:22:13.782082+0000","last_undegraded":"2024-03-19T06:22:13.782082+0000","last_fullsized":"2024-03-19T06:22:13.782082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:24.575297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949181+0000","last_change":"2024-03-19T06:22:12.806001+0000","last_active":"2024-03-19T06:22:13.949181+0000","last_peered":"2024-03-19T06:22:13.949181+0000","last_clean":"2024-03-19T06:22:13.949181+0000","last_became_active":"2024-03-19T06:22:12.805584+0000","last_became_peered":"2024-03-19T06:22:12.805584+0000","last_unstale":"2024-03-19T06:22:13.949181+0000","last_undegraded":"2024-03-19T06:22:13.949181+0000","last_fullsized":"2024-03-19T06:22:13.949181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:46:28.083952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782011+0000","last_change":"2024-03-19T06:22:11.782315+0000","last_active":"2024-03-19T06:22:13.782011+0000","last_peered":"2024-03-19T06:22:13.782011+0000","last_clean":"2024-03-19T06:22:13.782011+0000","last_became_active":"2024-03-19T06:22:11.782022+0000","last_became_peered":"2024-03-19T06:22:11.782022+0000","last_unstale":"2024-03-19T06:22:13.782011+0000","last_undegraded":"2024-03-19T06:22:13.782011+0000","last_fullsized":"2024-03-19T06:22:13.782011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:59:59.683815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949806+0000","last_change":"2024-03-19T06:22:12.807959+0000","last_active":"2024-03-19T06:22:13.949806+0000","last_peered":"2024-03-19T06:22:13.949806+0000","last_clean":"2024-03-19T06:22:13.949806+0000","last_became_active":"2024-03-19T06:22:12.807622+0000","last_became_peered":"2024-03-19T06:22:12.807622+0000","last_unstale":"2024-03-19T06:22:13.949806+0000","last_undegraded":"2024-03-19T06:22:13.949806+0000","last_fullsized":"2024-03-19T06:22:13.949806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:59:00.668563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.807019+0000","last_change":"2024-03-19T06:22:11.798797+0000","last_active":"2024-03-19T06:22:13.807019+0000","last_peered":"2024-03-19T06:22:13.807019+0000","last_clean":"2024-03-19T06:22:13.807019+0000","last_became_active":"2024-03-19T06:22:11.796493+0000","last_became_peered":"2024-03-19T06:22:11.796493+0000","last_unstale":"2024-03-19T06:22:13.807019+0000","last_undegraded":"2024-03-19T06:22:13.807019+0000","last_fullsized":"2024-03-19T06:22:13.807019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:21:19.744542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786029+0000","last_change":"2024-03-19T06:22:12.803257+0000","last_active":"2024-03-19T06:22:13.786029+0000","last_peered":"2024-03-19T06:22:13.786029+0000","last_clean":"2024-03-19T06:22:13.786029+0000","last_became_active":"2024-03-19T06:22:12.802894+0000","last_became_peered":"2024-03-19T06:22:12.802894+0000","last_unstale":"2024-03-19T06:22:13.786029+0000","last_undegraded":"2024-03-19T06:22:13.786029+0000","last_fullsized":"2024-03-19T06:22:13.786029+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:56:54.973880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949947+0000","last_change":"2024-03-19T06:22:11.789922+0000","last_active":"2024-03-19T06:22:13.949947+0000","last_peered":"2024-03-19T06:22:13.949947+0000","last_clean":"2024-03-19T06:22:13.949947+0000","last_became_active":"2024-03-19T06:22:11.789318+0000","last_became_peered":"2024-03-19T06:22:11.789318+0000","last_unstale":"2024-03-19T06:22:13.949947+0000","last_undegraded":"2024-03-19T06:22:13.949947+0000","last_fullsized":"2024-03-19T06:22:13.949947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:57:16.843221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806688+0000","last_change":"2024-03-19T06:22:12.800142+0000","last_active":"2024-03-19T06:22:13.806688+0000","last_peered":"2024-03-19T06:22:13.806688+0000","last_clean":"2024-03-19T06:22:13.806688+0000","last_became_active":"2024-03-19T06:22:12.799521+0000","last_became_peered":"2024-03-19T06:22:12.799521+0000","last_unstale":"2024-03-19T06:22:13.806688+0000","last_undegraded":"2024-03-19T06:22:13.806688+0000","last_fullsized":"2024-03-19T06:22:13.806688+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:18:02.614576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.950093+0000","last_change":"2024-03-19T06:22:11.792226+0000","last_active":"2024-03-19T06:22:13.950093+0000","last_peered":"2024-03-19T06:22:13.950093+0000","last_clean":"2024-03-19T06:22:13.950093+0000","last_became_active":"2024-03-19T06:22:11.791854+0000","last_became_peered":"2024-03-19T06:22:11.791854+0000","last_unstale":"2024-03-19T06:22:13.950093+0000","last_undegraded":"2024-03-19T06:22:13.950093+0000","last_fullsized":"2024-03-19T06:22:13.950093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:25:13.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946714+0000","last_change":"2024-03-19T06:22:12.809432+0000","last_active":"2024-03-19T06:22:13.946714+0000","last_peered":"2024-03-19T06:22:13.946714+0000","last_clean":"2024-03-19T06:22:13.946714+0000","last_became_active":"2024-03-19T06:22:12.808442+0000","last_became_peered":"2024-03-19T06:22:12.808442+0000","last_unstale":"2024-03-19T06:22:13.946714+0000","last_undegraded":"2024-03-19T06:22:13.946714+0000","last_fullsized":"2024-03-19T06:22:13.946714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:33:38.901582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949809+0000","last_change":"2024-03-19T06:22:11.792381+0000","last_active":"2024-03-19T06:22:13.949809+0000","last_peered":"2024-03-19T06:22:13.949809+0000","last_clean":"2024-03-19T06:22:13.949809+0000","last_became_active":"2024-03-19T06:22:11.792047+0000","last_became_peered":"2024-03-19T06:22:11.792047+0000","last_unstale":"2024-03-19T06:22:13.949809+0000","last_undegraded":"2024-03-19T06:22:13.949809+0000","last_fullsized":"2024-03-19T06:22:13.949809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:03:44.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946629+0000","last_change":"2024-03-19T06:22:12.801387+0000","last_active":"2024-03-19T06:22:13.946629+0000","last_peered":"2024-03-19T06:22:13.946629+0000","last_clean":"2024-03-19T06:22:13.946629+0000","last_became_active":"2024-03-19T06:22:12.801113+0000","last_became_peered":"2024-03-19T06:22:12.801113+0000","last_unstale":"2024-03-19T06:22:13.946629+0000","last_undegraded":"2024-03-19T06:22:13.946629+0000","last_fullsized":"2024-03-19T06:22:13.946629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:08:20.837266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804167+0000","last_change":"2024-03-19T06:22:11.799020+0000","last_active":"2024-03-19T06:22:13.804167+0000","last_peered":"2024-03-19T06:22:13.804167+0000","last_clean":"2024-03-19T06:22:13.804167+0000","last_became_active":"2024-03-19T06:22:11.797204+0000","last_became_peered":"2024-03-19T06:22:11.797204+0000","last_unstale":"2024-03-19T06:22:13.804167+0000","last_undegraded":"2024-03-19T06:22:13.804167+0000","last_fullsized":"2024-03-19T06:22:13.804167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:08:19.831195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946770+0000","last_change":"2024-03-19T06:22:12.789679+0000","last_active":"2024-03-19T06:22:13.946770+0000","last_peered":"2024-03-19T06:22:13.946770+0000","last_clean":"2024-03-19T06:22:13.946770+0000","last_became_active":"2024-03-19T06:22:12.789420+0000","last_became_peered":"2024-03-19T06:22:12.789420+0000","last_unstale":"2024-03-19T06:22:13.946770+0000","last_undegraded":"2024-03-19T06:22:13.946770+0000","last_fullsized":"2024-03-19T06:22:13.946770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:43:26.311098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949306+0000","last_change":"2024-03-19T06:22:11.792722+0000","last_active":"2024-03-19T06:22:13.949306+0000","last_peered":"2024-03-19T06:22:13.949306+0000","last_clean":"2024-03-19T06:22:13.949306+0000","last_became_active":"2024-03-19T06:22:11.792333+0000","last_became_peered":"2024-03-19T06:22:11.792333+0000","last_unstale":"2024-03-19T06:22:13.949306+0000","last_undegraded":"2024-03-19T06:22:13.949306+0000","last_fullsized":"2024-03-19T06:22:13.949306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:14:08.824375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946629+0000","last_change":"2024-03-19T06:22:12.789004+0000","last_active":"2024-03-19T06:22:13.946629+0000","last_peered":"2024-03-19T06:22:13.946629+0000","last_clean":"2024-03-19T06:22:13.946629+0000","last_became_active":"2024-03-19T06:22:12.788692+0000","last_became_peered":"2024-03-19T06:22:12.788692+0000","last_unstale":"2024-03-19T06:22:13.946629+0000","last_undegraded":"2024-03-19T06:22:13.946629+0000","last_fullsized":"2024-03-19T06:22:13.946629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:21:20.750613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949359+0000","last_change":"2024-03-19T06:22:11.794192+0000","last_active":"2024-03-19T06:22:13.949359+0000","last_peered":"2024-03-19T06:22:13.949359+0000","last_clean":"2024-03-19T06:22:13.949359+0000","last_became_active":"2024-03-19T06:22:11.793919+0000","last_became_peered":"2024-03-19T06:22:11.793919+0000","last_unstale":"2024-03-19T06:22:13.949359+0000","last_undegraded":"2024-03-19T06:22:13.949359+0000","last_fullsized":"2024-03-19T06:22:13.949359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:12:38.916099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785904+0000","last_change":"2024-03-19T06:22:12.814238+0000","last_active":"2024-03-19T06:22:13.785904+0000","last_peered":"2024-03-19T06:22:13.785904+0000","last_clean":"2024-03-19T06:22:13.785904+0000","last_became_active":"2024-03-19T06:22:12.813658+0000","last_became_peered":"2024-03-19T06:22:12.813658+0000","last_unstale":"2024-03-19T06:22:13.785904+0000","last_undegraded":"2024-03-19T06:22:13.785904+0000","last_fullsized":"2024-03-19T06:22:13.785904+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:20:25.981378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.784985+0000","last_change":"2024-03-19T06:22:11.796982+0000","last_active":"2024-03-19T06:22:13.784985+0000","last_peered":"2024-03-19T06:22:13.784985+0000","last_clean":"2024-03-19T06:22:13.784985+0000","last_became_active":"2024-03-19T06:22:11.796659+0000","last_became_peered":"2024-03-19T06:22:11.796659+0000","last_unstale":"2024-03-19T06:22:13.784985+0000","last_undegraded":"2024-03-19T06:22:13.784985+0000","last_fullsized":"2024-03-19T06:22:13.784985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:59:09.836531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.946790+0000","last_change":"2024-03-19T06:22:12.804459+0000","last_active":"2024-03-19T06:22:13.946790+0000","last_peered":"2024-03-19T06:22:13.946790+0000","last_clean":"2024-03-19T06:22:13.946790+0000","last_became_active":"2024-03-19T06:22:12.804206+0000","last_became_peered":"2024-03-19T06:22:12.804206+0000","last_unstale":"2024-03-19T06:22:13.946790+0000","last_undegraded":"2024-03-19T06:22:13.946790+0000","last_fullsized":"2024-03-19T06:22:13.946790+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:46:28.083952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.807039+0000","last_change":"2024-03-19T06:22:11.793140+0000","last_active":"2024-03-19T06:22:13.807039+0000","last_peered":"2024-03-19T06:22:13.807039+0000","last_clean":"2024-03-19T06:22:13.807039+0000","last_became_active":"2024-03-19T06:22:11.792759+0000","last_became_peered":"2024-03-19T06:22:11.792759+0000","last_unstale":"2024-03-19T06:22:13.807039+0000","last_undegraded":"2024-03-19T06:22:13.807039+0000","last_fullsized":"2024-03-19T06:22:13.807039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:08:19.831195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786038+0000","last_change":"2024-03-19T06:22:12.800750+0000","last_active":"2024-03-19T06:22:13.786038+0000","last_peered":"2024-03-19T06:22:13.786038+0000","last_clean":"2024-03-19T06:22:13.786038+0000","last_became_active":"2024-03-19T06:22:12.800443+0000","last_became_peered":"2024-03-19T06:22:12.800443+0000","last_unstale":"2024-03-19T06:22:13.786038+0000","last_undegraded":"2024-03-19T06:22:13.786038+0000","last_fullsized":"2024-03-19T06:22:13.786038+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:41:39.027232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804300+0000","last_change":"2024-03-19T06:22:11.799755+0000","last_active":"2024-03-19T06:22:13.804300+0000","last_peered":"2024-03-19T06:22:13.804300+0000","last_clean":"2024-03-19T06:22:13.804300+0000","last_became_active":"2024-03-19T06:22:11.799522+0000","last_became_peered":"2024-03-19T06:22:11.799522+0000","last_unstale":"2024-03-19T06:22:13.804300+0000","last_undegraded":"2024-03-19T06:22:13.804300+0000","last_fullsized":"2024-03-19T06:22:13.804300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:43:25.305027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804151+0000","last_change":"2024-03-19T06:22:12.786688+0000","last_active":"2024-03-19T06:22:13.804151+0000","last_peered":"2024-03-19T06:22:13.804151+0000","last_clean":"2024-03-19T06:22:13.804151+0000","last_became_active":"2024-03-19T06:22:12.786351+0000","last_became_peered":"2024-03-19T06:22:12.786351+0000","last_unstale":"2024-03-19T06:22:13.804151+0000","last_undegraded":"2024-03-19T06:22:13.804151+0000","last_fullsized":"2024-03-19T06:22:13.804151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:41:53.120939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806674+0000","last_change":"2024-03-19T06:22:11.790421+0000","last_active":"2024-03-19T06:22:13.806674+0000","last_peered":"2024-03-19T06:22:13.806674+0000","last_clean":"2024-03-19T06:22:13.806674+0000","last_became_active":"2024-03-19T06:22:11.790068+0000","last_became_peered":"2024-03-19T06:22:11.790068+0000","last_unstale":"2024-03-19T06:22:13.806674+0000","last_undegraded":"2024-03-19T06:22:13.806674+0000","last_fullsized":"2024-03-19T06:22:13.806674+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:20:25.425737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949252+0000","last_change":"2024-03-19T06:22:12.812345+0000","last_active":"2024-03-19T06:22:13.949252+0000","last_peered":"2024-03-19T06:22:13.949252+0000","last_clean":"2024-03-19T06:22:13.949252+0000","last_became_active":"2024-03-19T06:22:12.812053+0000","last_became_peered":"2024-03-19T06:22:12.812053+0000","last_unstale":"2024-03-19T06:22:13.949252+0000","last_undegraded":"2024-03-19T06:22:13.949252+0000","last_fullsized":"2024-03-19T06:22:13.949252+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:50:23.948221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804327+0000","last_change":"2024-03-19T06:22:11.788623+0000","last_active":"2024-03-19T06:22:13.804327+0000","last_peered":"2024-03-19T06:22:13.804327+0000","last_clean":"2024-03-19T06:22:13.804327+0000","last_became_active":"2024-03-19T06:22:11.785335+0000","last_became_peered":"2024-03-19T06:22:11.785335+0000","last_unstale":"2024-03-19T06:22:13.804327+0000","last_undegraded":"2024-03-19T06:22:13.804327+0000","last_fullsized":"2024-03-19T06:22:13.804327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:19:01.628339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.804267+0000","last_change":"2024-03-19T06:22:12.802389+0000","last_active":"2024-03-19T06:22:13.804267+0000","last_peered":"2024-03-19T06:22:13.804267+0000","last_clean":"2024-03-19T06:22:13.804267+0000","last_became_active":"2024-03-19T06:22:12.801899+0000","last_became_peered":"2024-03-19T06:22:12.801899+0000","last_unstale":"2024-03-19T06:22:13.804267+0000","last_undegraded":"2024-03-19T06:22:13.804267+0000","last_fullsized":"2024-03-19T06:22:13.804267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:23:34.295704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.806481+0000","last_change":"2024-03-19T06:22:11.790470+0000","last_active":"2024-03-19T06:22:13.806481+0000","last_peered":"2024-03-19T06:22:13.806481+0000","last_clean":"2024-03-19T06:22:13.806481+0000","last_became_active":"2024-03-19T06:22:11.790207+0000","last_became_peered":"2024-03-19T06:22:11.790207+0000","last_unstale":"2024-03-19T06:22:13.806481+0000","last_undegraded":"2024-03-19T06:22:13.806481+0000","last_fullsized":"2024-03-19T06:22:13.806481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:19:01.628339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.781975+0000","last_change":"2024-03-19T06:22:12.798059+0000","last_active":"2024-03-19T06:22:13.781975+0000","last_peered":"2024-03-19T06:22:13.781975+0000","last_clean":"2024-03-19T06:22:13.781975+0000","last_became_active":"2024-03-19T06:22:12.797589+0000","last_became_peered":"2024-03-19T06:22:12.797589+0000","last_unstale":"2024-03-19T06:22:13.781975+0000","last_undegraded":"2024-03-19T06:22:13.781975+0000","last_fullsized":"2024-03-19T06:22:13.781975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:47:38.121363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949473+0000","last_change":"2024-03-19T06:22:11.781136+0000","last_active":"2024-03-19T06:22:13.949473+0000","last_peered":"2024-03-19T06:22:13.949473+0000","last_clean":"2024-03-19T06:22:13.949473+0000","last_became_active":"2024-03-19T06:22:11.780619+0000","last_became_peered":"2024-03-19T06:22:11.780619+0000","last_unstale":"2024-03-19T06:22:13.949473+0000","last_undegraded":"2024-03-19T06:22:13.949473+0000","last_fullsized":"2024-03-19T06:22:13.949473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:08:55.885727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949388+0000","last_change":"2024-03-19T06:22:12.800198+0000","last_active":"2024-03-19T06:22:13.949388+0000","last_peered":"2024-03-19T06:22:13.949388+0000","last_clean":"2024-03-19T06:22:13.949388+0000","last_became_active":"2024-03-19T06:22:12.799781+0000","last_became_peered":"2024-03-19T06:22:12.799781+0000","last_unstale":"2024-03-19T06:22:13.949388+0000","last_undegraded":"2024-03-19T06:22:13.949388+0000","last_fullsized":"2024-03-19T06:22:13.949388+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:14.509578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.782072+0000","last_change":"2024-03-19T06:22:11.797400+0000","last_active":"2024-03-19T06:22:13.782072+0000","last_peered":"2024-03-19T06:22:13.782072+0000","last_clean":"2024-03-19T06:22:13.782072+0000","last_became_active":"2024-03-19T06:22:11.797126+0000","last_became_peered":"2024-03-19T06:22:11.797126+0000","last_unstale":"2024-03-19T06:22:13.782072+0000","last_undegraded":"2024-03-19T06:22:13.782072+0000","last_fullsized":"2024-03-19T06:22:13.782072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:13.503507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.785993+0000","last_change":"2024-03-19T06:22:12.818375+0000","last_active":"2024-03-19T06:22:13.785993+0000","last_peered":"2024-03-19T06:22:13.785993+0000","last_clean":"2024-03-19T06:22:13.785993+0000","last_became_active":"2024-03-19T06:22:12.817421+0000","last_became_peered":"2024-03-19T06:22:12.817421+0000","last_unstale":"2024-03-19T06:22:13.785993+0000","last_undegraded":"2024-03-19T06:22:13.785993+0000","last_fullsized":"2024-03-19T06:22:13.785993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:11.762678+0000","last_clean_scrub_stamp":"2024-03-19T06:22:11.762678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:59:58.435424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.949400+0000","last_change":"2024-03-19T06:22:11.795751+0000","last_active":"2024-03-19T06:22:13.949400+0000","last_peered":"2024-03-19T06:22:13.949400+0000","last_clean":"2024-03-19T06:22:13.949400+0000","last_became_active":"2024-03-19T06:22:11.795376+0000","last_became_peered":"2024-03-19T06:22:11.795376+0000","last_unstale":"2024-03-19T06:22:13.949400+0000","last_undegraded":"2024-03-19T06:22:13.949400+0000","last_fullsized":"2024-03-19T06:22:13.949400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:22:10.756607+0000","last_clean_scrub_stamp":"2024-03-19T06:22:10.756607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:00:12.371284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":194,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-19T06:22:13.786663+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:22:13.786663+0000","last_peered":"2024-03-19T06:22:13.786663+0000","last_clean":"2024-03-19T06:22:13.786663+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:22:13.786663+0000","last_undegraded":"2024-03-19T06:22:13.786663+0000","last_fullsized":"2024-03-19T06:22:13.786663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":987136,"data_stored":742990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":153148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":153204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":152602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":405504,"data_stored":154166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":742900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":152636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":405504,"data_stored":154166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:22:21.839 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-19T06:22:21.840 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-19T06:22:22.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.036+0000 7fb84aa00640 1 Processor -- start 2024-03-19T06:22:22.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.036+0000 7fb84aa00640 1 -- start start 2024-03-19T06:22:22.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.036+0000 7fb84aa00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb84415a840 0x7fb84406f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:22.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.036+0000 7fb84aa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb84406b450 0x7fb8440ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:22.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.036+0000 7fb84aa00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8440af2d0 con 0x7fb8440aea70 2024-03-19T06:22:22.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.036+0000 7fb84aa00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8440cdc20 con 0x7fb84406b450 2024-03-19T06:22:22.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.036+0000 7fb84aa00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84415eea0 con 0x7fb84415a840 2024-03-19T06:22:22.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.036+0000 7fb848a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb84406b450 0x7fb8440ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:22.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.036+0000 7fb83b400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb8440aea70 0x7fb84406ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60930/0 (socket says 172.21.15.32:60930) 2024-03-19T06:22:22.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.036+0000 7fb83b400640 1 -- 172.21.15.32:0/2456909260 learned_addr learned my addr 172.21.15.32:0/2456909260 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:22.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.036+0000 7fb848a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb84406b450 0x7fb8440ce0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56728/0 (socket says 172.21.15.32:56728) 2024-03-19T06:22:22.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.040+0000 7fb843e00640 1 --2- 172.21.15.32:0/2456909260 >> v2:172.21.15.171:3300/0 conn(0x7fb84415a840 0x7fb84406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:22.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.040+0000 7fb848a00640 1 -- 172.21.15.32:0/2456909260 >> v2:172.21.15.171:3300/0 conn(0x7fb84415a840 msgr2=0x7fb84406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:22.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.040+0000 7fb848a00640 1 --2- 172.21.15.32:0/2456909260 >> v2:172.21.15.171:3300/0 conn(0x7fb84415a840 0x7fb84406f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.040+0000 7fb848a00640 1 -- 172.21.15.32:0/2456909260 >> v1:172.21.15.32:6789/0 conn(0x7fb8440aea70 legacy=0x7fb84406ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:22.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.040+0000 7fb848a00640 1 -- 172.21.15.32:0/2456909260 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84415f180 con 0x7fb84406b450 2024-03-19T06:22:22.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.040+0000 7fb843400640 1 -- 172.21.15.32:0/2456909260 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542835814 0 0) 0x7fb8440af2d0 con 0x7fb8440aea70 2024-03-19T06:22:22.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.040+0000 7fb848a00640 1 --2- 172.21.15.32:0/2456909260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb84406b450 0x7fb8440ce0b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb8440cdda0 tx=0x7fb83c01c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f178d9e8a474c088 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:22.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.040+0000 7fb843400640 1 -- 172.21.15.32:0/2456909260 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c0b2070 con 0x7fb84406b450 2024-03-19T06:22:22.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.040+0000 7fb843400640 1 -- 172.21.15.32:0/2456909260 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c0a5980 con 0x7fb84406b450 2024-03-19T06:22:22.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.040+0000 7fb843400640 1 -- 172.21.15.32:0/2456909260 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c0a5d50 con 0x7fb84406b450 2024-03-19T06:22:22.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.040+0000 7fb84aa00640 1 -- 172.21.15.32:0/2456909260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb84406b450 msgr2=0x7fb8440ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:22.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.040+0000 7fb84aa00640 1 --2- 172.21.15.32:0/2456909260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb84406b450 0x7fb8440ce0b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb8440cdda0 tx=0x7fb83c01c860 comp rx=0 tx=0).stop 2024-03-19T06:22:22.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb84aa00640 1 -- 172.21.15.32:0/2456909260 shutdown_connections 2024-03-19T06:22:22.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb84aa00640 1 --2- 172.21.15.32:0/2456909260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb84406b450 0x7fb8440ce0b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb84aa00640 1 --2- 172.21.15.32:0/2456909260 >> v2:172.21.15.171:3300/0 conn(0x7fb84415a840 0x7fb84406f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb84aa00640 1 -- 172.21.15.32:0/2456909260 >> 172.21.15.32:0/2456909260 conn(0x7fb8440b1590 msgr2=0x7fb8440b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:22.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb84aa00640 1 -- 172.21.15.32:0/2456909260 shutdown_connections 2024-03-19T06:22:22.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb84aa00640 1 -- 172.21.15.32:0/2456909260 wait complete. 2024-03-19T06:22:22.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb84aa00640 1 Processor -- start 2024-03-19T06:22:22.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb84aa00640 1 -- start start 2024-03-19T06:22:22.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb84aa00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb84406b450 0x7fb84415beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:22.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb84aa00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8440aea70 0x7fb84415e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:22.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb84aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb84415a840 0x7fb8441403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:22.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb84aa00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440cef80 con 0x7fb84415a840 2024-03-19T06:22:22.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb84aa00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440cee00 con 0x7fb8440aea70 2024-03-19T06:22:22.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb84aa00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440cf100 con 0x7fb84406b450 2024-03-19T06:22:22.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb848a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb84415a840 0x7fb8441403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:22.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb848a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb84415a840 0x7fb8441403c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56730/0 (socket says 172.21.15.32:56730) 2024-03-19T06:22:22.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb848a00640 1 -- 172.21.15.32:0/3210595470 learned_addr learned my addr 172.21.15.32:0/3210595470 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:22.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb843e00640 1 --2- 172.21.15.32:0/3210595470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb84406b450 0x7fb84415beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:22.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb83b400640 1 --2- 172.21.15.32:0/3210595470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8440aea70 0x7fb84415e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:22.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb848a00640 1 -- 172.21.15.32:0/3210595470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb84406b450 msgr2=0x7fb84415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:22.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb848a00640 1 --2- 172.21.15.32:0/3210595470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb84406b450 0x7fb84415beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb848a00640 1 -- 172.21.15.32:0/3210595470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8440aea70 msgr2=0x7fb84415e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:22.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb848a00640 1 --2- 172.21.15.32:0/3210595470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8440aea70 0x7fb84415e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb848a00640 1 -- 172.21.15.32:0/3210595470 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8440b2a70 con 0x7fb84415a840 2024-03-19T06:22:22.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb843e00640 1 --2- 172.21.15.32:0/3210595470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb84406b450 0x7fb84415beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:22.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb848a00640 1 --2- 172.21.15.32:0/3210595470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb84415a840 0x7fb8441403c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb83c01a490 tx=0x7fb83c019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:22.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb840c00640 1 -- 172.21.15.32:0/3210595470 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c0b2050 con 0x7fb84415a840 2024-03-19T06:22:22.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb840c00640 1 -- 172.21.15.32:0/3210595470 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c0be070 con 0x7fb84415a840 2024-03-19T06:22:22.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb84aa00640 1 -- 172.21.15.32:0/3210595470 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8440b2d50 con 0x7fb84415a840 2024-03-19T06:22:22.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.044+0000 7fb840c00640 1 -- 172.21.15.32:0/3210595470 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c0adb10 con 0x7fb84415a840 2024-03-19T06:22:22.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.048+0000 7fb84aa00640 1 -- 172.21.15.32:0/3210595470 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb844140900 con 0x7fb84415a840 2024-03-19T06:22:22.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.048+0000 7fb84aa00640 1 -- 172.21.15.32:0/3210595470 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8440749e0 con 0x7fb84415a840 2024-03-19T06:22:22.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.048+0000 7fb840c00640 1 -- 172.21.15.32:0/3210595470 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb83c0adcb0 con 0x7fb84415a840 2024-03-19T06:22:22.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.048+0000 7fb840c00640 1 --2- 172.21.15.32:0/3210595470 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb820067660 0x7fb820069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:22.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.048+0000 7fb840c00640 1 -- 172.21.15.32:0/3210595470 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb83c120bd0 con 0x7fb84415a840 2024-03-19T06:22:22.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.048+0000 7fb843e00640 1 --2- 172.21.15.32:0/3210595470 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb820067660 0x7fb820069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:22.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.048+0000 7fb843e00640 1 --2- 172.21.15.32:0/3210595470 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb820067660 0x7fb820069b20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb83400b9f0 tx=0x7fb834008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:22.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.052+0000 7fb840c00640 1 -- 172.21.15.32:0/3210595470 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fb83c0164e0 con 0x7fb84415a840 2024-03-19T06:22:22.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.272+0000 7fb84aa00640 1 -- 172.21.15.32:0/3210595470 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb84406e6c0 con 0x7fb84415a840 2024-03-19T06:22:22.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.272+0000 7fb840c00640 1 -- 172.21.15.32:0/3210595470 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb83c0ab340 con 0x7fb84415a840 2024-03-19T06:22:22.266 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-03-19T06:22:22.266 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCWLvll4jsFMxAAr4PzH6Djodh2O01vGYgxKA== 2024-03-19T06:22:22.267 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow" 2024-03-19T06:22:22.267 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2024-03-19T06:22:22.267 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-19T06:22:22.267 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.0 2024-03-19T06:22:22.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.276+0000 7fb84aa00640 1 -- 172.21.15.32:0/3210595470 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb820067660 msgr2=0x7fb820069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:22.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.276+0000 7fb84aa00640 1 --2- 172.21.15.32:0/3210595470 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb820067660 0x7fb820069b20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb83400b9f0 tx=0x7fb834008040 comp rx=0 tx=0).stop 2024-03-19T06:22:22.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.276+0000 7fb84aa00640 1 -- 172.21.15.32:0/3210595470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb84415a840 msgr2=0x7fb8441403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:22.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.276+0000 7fb84aa00640 1 --2- 172.21.15.32:0/3210595470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb84415a840 0x7fb8441403c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb83c01a490 tx=0x7fb83c019600 comp rx=0 tx=0).stop 2024-03-19T06:22:22.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.276+0000 7fb84aa00640 1 -- 172.21.15.32:0/3210595470 shutdown_connections 2024-03-19T06:22:22.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.276+0000 7fb84aa00640 1 --2- 172.21.15.32:0/3210595470 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb820067660 0x7fb820069b20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.276+0000 7fb84aa00640 1 --2- 172.21.15.32:0/3210595470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb84415a840 0x7fb8441403c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.276+0000 7fb84aa00640 1 --2- 172.21.15.32:0/3210595470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8440aea70 0x7fb84415e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.276+0000 7fb84aa00640 1 --2- 172.21.15.32:0/3210595470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb84406b450 0x7fb84415beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.276+0000 7fb84aa00640 1 -- 172.21.15.32:0/3210595470 >> 172.21.15.32:0/3210595470 conn(0x7fb8440b1590 msgr2=0x7fb8440adfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:22.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.276+0000 7fb84aa00640 1 -- 172.21.15.32:0/3210595470 shutdown_connections 2024-03-19T06:22:22.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.276+0000 7fb84aa00640 1 -- 172.21.15.32:0/3210595470 wait complete. 2024-03-19T06:22:22.289 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:22:22.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.436+0000 7fb82d400640 1 Processor -- start 2024-03-19T06:22:22.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.436+0000 7fb82d400640 1 -- start start 2024-03-19T06:22:22.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.440+0000 7fb82d400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb82815a7c0 0x7fb8280cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:22.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.440+0000 7fb82d400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb8280b4c50 0x7fb8280b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:22.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.440+0000 7fb82d400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8280cb670 con 0x7fb8280cc680 2024-03-19T06:22:22.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.440+0000 7fb82d400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82815f400 con 0x7fb82815a7c0 2024-03-19T06:22:22.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.440+0000 7fb82d400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82815e860 con 0x7fb8280b4c50 2024-03-19T06:22:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.440+0000 7fb826800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb82815a7c0 0x7fb8280cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.440+0000 7fb826800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb82815a7c0 0x7fb8280cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56732/0 (socket says 172.21.15.32:56732) 2024-03-19T06:22:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.440+0000 7fb826800640 1 -- 172.21.15.32:0/263333983 learned_addr learned my addr 172.21.15.32:0/263333983 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.440+0000 7fb827200640 1 --2- 172.21.15.32:0/263333983 >> v2:172.21.15.171:3300/0 conn(0x7fb8280b4c50 0x7fb8280b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.440+0000 7fb826800640 1 -- 172.21.15.32:0/263333983 >> v2:172.21.15.171:3300/0 conn(0x7fb8280b4c50 msgr2=0x7fb8280b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.440+0000 7fb826800640 1 --2- 172.21.15.32:0/263333983 >> v2:172.21.15.171:3300/0 conn(0x7fb8280b4c50 0x7fb8280b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.440+0000 7fb826800640 1 -- 172.21.15.32:0/263333983 >> v1:172.21.15.171:6789/0 conn(0x7fb8280cc680 legacy=0x7fb82815ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:22.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.440+0000 7fb826800640 1 -- 172.21.15.32:0/263333983 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8280cb950 con 0x7fb82815a7c0 2024-03-19T06:22:22.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.440+0000 7fb827200640 1 --2- 172.21.15.32:0/263333983 >> v2:172.21.15.171:3300/0 conn(0x7fb8280b4c50 0x7fb8280b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.444+0000 7fb826800640 1 --2- 172.21.15.32:0/263333983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb82815a7c0 0x7fb8280cae20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb8280c9b90 tx=0x7fb81801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ae5b62c72c79b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:22.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.444+0000 7fb825e00640 1 -- 172.21.15.32:0/263333983 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8180a5720 con 0x7fb82815a7c0 2024-03-19T06:22:22.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.444+0000 7fb825e00640 1 -- 172.21.15.32:0/263333983 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8180a58c0 con 0x7fb82815a7c0 2024-03-19T06:22:22.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.444+0000 7fb825e00640 1 -- 172.21.15.32:0/263333983 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8180a5c90 con 0x7fb82815a7c0 2024-03-19T06:22:22.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.444+0000 7fb82d400640 1 -- 172.21.15.32:0/263333983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb82815a7c0 msgr2=0x7fb8280cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:22.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.444+0000 7fb82d400640 1 --2- 172.21.15.32:0/263333983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb82815a7c0 0x7fb8280cae20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb8280c9b90 tx=0x7fb81801c9b0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.444+0000 7fb82d400640 1 -- 172.21.15.32:0/263333983 shutdown_connections 2024-03-19T06:22:22.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.444+0000 7fb82d400640 1 --2- 172.21.15.32:0/263333983 >> v2:172.21.15.171:3300/0 conn(0x7fb8280b4c50 0x7fb8280b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.444+0000 7fb82d400640 1 --2- 172.21.15.32:0/263333983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb82815a7c0 0x7fb8280cae20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.444+0000 7fb82d400640 1 -- 172.21.15.32:0/263333983 >> 172.21.15.32:0/263333983 conn(0x7fb8280b1280 msgr2=0x7fb8280b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:22.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.444+0000 7fb82d400640 1 -- 172.21.15.32:0/263333983 shutdown_connections 2024-03-19T06:22:22.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.444+0000 7fb82d400640 1 -- 172.21.15.32:0/263333983 wait complete. 2024-03-19T06:22:22.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.444+0000 7fb82d400640 1 Processor -- start 2024-03-19T06:22:22.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.444+0000 7fb82d400640 1 -- start start 2024-03-19T06:22:22.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb82d400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8280b4c50 0x7fb8281f85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:22.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb82d400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8280cc680 0x7fb82815bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:22.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb82d400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb82815a7c0 0x7fb8280b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:22.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb82d400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8280cbdb0 con 0x7fb82815a7c0 2024-03-19T06:22:22.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb82d400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8280cbc30 con 0x7fb8280cc680 2024-03-19T06:22:22.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb82d400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8281677f0 con 0x7fb8280b4c50 2024-03-19T06:22:22.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb827200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb82815a7c0 0x7fb8280b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:22.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb827200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb82815a7c0 0x7fb8280b02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56736/0 (socket says 172.21.15.32:56736) 2024-03-19T06:22:22.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb827200640 1 -- 172.21.15.32:0/1627702108 learned_addr learned my addr 172.21.15.32:0/1627702108 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:22.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb826800640 1 --2- 172.21.15.32:0/1627702108 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8280b4c50 0x7fb8281f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:22.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb81de00640 1 --2- 172.21.15.32:0/1627702108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8280cc680 0x7fb82815bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:22.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb827200640 1 -- 172.21.15.32:0/1627702108 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8280b4c50 msgr2=0x7fb8281f85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:22.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb827200640 1 --2- 172.21.15.32:0/1627702108 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8280b4c50 0x7fb8281f85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb827200640 1 -- 172.21.15.32:0/1627702108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8280cc680 msgr2=0x7fb82815bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:22.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb827200640 1 --2- 172.21.15.32:0/1627702108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8280cc680 0x7fb82815bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb827200640 1 -- 172.21.15.32:0/1627702108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8281fa780 con 0x7fb82815a7c0 2024-03-19T06:22:22.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb827200640 1 --2- 172.21.15.32:0/1627702108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb82815a7c0 0x7fb8280b02e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb82000c7f0 tx=0x7fb82000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:22.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb81f400640 1 -- 172.21.15.32:0/1627702108 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820015070 con 0x7fb82815a7c0 2024-03-19T06:22:22.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb81f400640 1 -- 172.21.15.32:0/1627702108 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb820007860 con 0x7fb82815a7c0 2024-03-19T06:22:22.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb82d400640 1 -- 172.21.15.32:0/1627702108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8281faa60 con 0x7fb82815a7c0 2024-03-19T06:22:22.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb81f400640 1 -- 172.21.15.32:0/1627702108 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820007c50 con 0x7fb82815a7c0 2024-03-19T06:22:22.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb82d400640 1 -- 172.21.15.32:0/1627702108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8281fb020 con 0x7fb82815a7c0 2024-03-19T06:22:22.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb82d400640 1 -- 172.21.15.32:0/1627702108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8280749e0 con 0x7fb82815a7c0 2024-03-19T06:22:22.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.448+0000 7fb81f400640 1 -- 172.21.15.32:0/1627702108 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb820018070 con 0x7fb82815a7c0 2024-03-19T06:22:22.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.452+0000 7fb81f400640 1 --2- 172.21.15.32:0/1627702108 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb804067660 0x7fb804069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:22.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.452+0000 7fb81f400640 1 -- 172.21.15.32:0/1627702108 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb820085a80 con 0x7fb82815a7c0 2024-03-19T06:22:22.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.452+0000 7fb826800640 1 --2- 172.21.15.32:0/1627702108 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb804067660 0x7fb804069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:22.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.452+0000 7fb826800640 1 --2- 172.21.15.32:0/1627702108 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb804067660 0x7fb804069b20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb8180ae000 tx=0x7fb8180a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:22.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.456+0000 7fb81f400640 1 -- 172.21.15.32:0/1627702108 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fb820087e20 con 0x7fb82815a7c0 2024-03-19T06:22:22.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.660+0000 7fb82d400640 1 -- 172.21.15.32:0/1627702108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8280ce2d0 con 0x7fb82815a7c0 2024-03-19T06:22:22.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.660+0000 7fb81f400640 1 -- 172.21.15.32:0/1627702108 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fb820056010 con 0x7fb82815a7c0 2024-03-19T06:22:22.652 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:22.652 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3394778234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3394778234},{"type":"v1","addr":"172.21.15.171:6836","nonce":3394778234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2000291327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2000291327},{"type":"v1","addr":"172.21.15.171:6837","nonce":2000291327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/4039299860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":4039299860},{"type":"v1","addr":"172.21.15.32:6833","nonce":4039299860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:22:12.167128+0000","modified":"2024-03-19T06:22:15.191629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/2680502611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":2680502611},{"type":"v1","addr":"172.21.15.32:6835","nonce":2680502611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-19T06:22:22.652 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 17 2024-03-19T06:22:22.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.660+0000 7fb82d400640 1 -- 172.21.15.32:0/1627702108 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb804067660 msgr2=0x7fb804069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:22.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.660+0000 7fb82d400640 1 --2- 172.21.15.32:0/1627702108 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb804067660 0x7fb804069b20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb8180ae000 tx=0x7fb8180a7070 comp rx=0 tx=0).stop 2024-03-19T06:22:22.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.660+0000 7fb82d400640 1 -- 172.21.15.32:0/1627702108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb82815a7c0 msgr2=0x7fb8280b02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:22.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.660+0000 7fb82d400640 1 --2- 172.21.15.32:0/1627702108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb82815a7c0 0x7fb8280b02e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb82000c7f0 tx=0x7fb82000ccb0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.660+0000 7fb82d400640 1 -- 172.21.15.32:0/1627702108 shutdown_connections 2024-03-19T06:22:22.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.660+0000 7fb82d400640 1 --2- 172.21.15.32:0/1627702108 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb804067660 0x7fb804069b20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.660+0000 7fb82d400640 1 --2- 172.21.15.32:0/1627702108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb82815a7c0 0x7fb8280b02e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.660+0000 7fb82d400640 1 --2- 172.21.15.32:0/1627702108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8280cc680 0x7fb82815bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.660+0000 7fb82d400640 1 --2- 172.21.15.32:0/1627702108 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8280b4c50 0x7fb8281f85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:22.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.660+0000 7fb82d400640 1 -- 172.21.15.32:0/1627702108 >> 172.21.15.32:0/1627702108 conn(0x7fb8280b1280 msgr2=0x7fb82815ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:22.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.660+0000 7fb82d400640 1 -- 172.21.15.32:0/1627702108 shutdown_connections 2024-03-19T06:22:22.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:22.660+0000 7fb82d400640 1 -- 172.21.15.32:0/1627702108 wait complete. 2024-03-19T06:22:23.075 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-19T06:22:12.167128+0000', 'modified': '2024-03-19T06:22:15.191629+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5229}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5229': {'gid': 5229, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.32:6835/2680502611', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6834', 'nonce': 2680502611}, {'type': 'v1', 'addr': '172.21.15.32:6835', 'nonce': 2680502611}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-19T06:22:23.075 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-19T06:22:23.075 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-19T06:22:23.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f021b200640 1 Processor -- start 2024-03-19T06:22:23.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f021b200640 1 -- start start 2024-03-19T06:22:23.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f021b200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f021c0b0900 0x7f021c0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f021b200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f021c06bb90 0x7f021c0cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f021b200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f021c0d0440 0x7f021c070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f021b200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c0cfc60 con 0x7f021c0b0900 2024-03-19T06:22:23.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f021b200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c06f200 con 0x7f021c0d0440 2024-03-19T06:22:23.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f021b200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c06f4e0 con 0x7f021c06bb90 2024-03-19T06:22:23.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f0219e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f021c0b0900 0x7f021c0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f0219e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f021c0b0900 0x7f021c0cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56748/0 (socket says 172.21.15.32:56748) 2024-03-19T06:22:23.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f0219e00640 1 -- 172.21.15.32:0/3594552387 learned_addr learned my addr 172.21.15.32:0/3594552387 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:23.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f021a800640 1 --2- 172.21.15.32:0/3594552387 >> v2:172.21.15.171:3300/0 conn(0x7f021c0d0440 0x7f021c070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f0219400640 1 --2- 172.21.15.32:0/3594552387 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f021c06bb90 0x7f021c0cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f0219e00640 1 -- 172.21.15.32:0/3594552387 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f021c06bb90 msgr2=0x7f021c0cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:23.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f0219e00640 1 --2- 172.21.15.32:0/3594552387 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f021c06bb90 0x7f021c0cff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f0219e00640 1 -- 172.21.15.32:0/3594552387 >> v2:172.21.15.171:3300/0 conn(0x7f021c0d0440 msgr2=0x7f021c070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:23.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f0219e00640 1 --2- 172.21.15.32:0/3594552387 >> v2:172.21.15.171:3300/0 conn(0x7f021c0d0440 0x7f021c070580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.228+0000 7f0219e00640 1 -- 172.21.15.32:0/3594552387 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c06f7c0 con 0x7f021c0b0900 2024-03-19T06:22:23.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.232+0000 7f0219e00640 1 --2- 172.21.15.32:0/3594552387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f021c0b0900 0x7f021c0cf720 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f020c009870 tx=0x7f020c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2167d9becc721221 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:23.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.232+0000 7f0218a00640 1 -- 172.21.15.32:0/3594552387 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c0b5070 con 0x7f021c0b0900 2024-03-19T06:22:23.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.232+0000 7f0218a00640 1 -- 172.21.15.32:0/3594552387 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c0a89d0 con 0x7f021c0b0900 2024-03-19T06:22:23.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.232+0000 7f0218a00640 1 -- 172.21.15.32:0/3594552387 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c0a8da0 con 0x7f021c0b0900 2024-03-19T06:22:23.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.232+0000 7f021b200640 1 -- 172.21.15.32:0/3594552387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f021c0b0900 msgr2=0x7f021c0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:23.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.232+0000 7f021b200640 1 --2- 172.21.15.32:0/3594552387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f021c0b0900 0x7f021c0cf720 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f020c009870 tx=0x7f020c01ed10 comp rx=0 tx=0).stop 2024-03-19T06:22:23.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.232+0000 7f021b200640 1 -- 172.21.15.32:0/3594552387 shutdown_connections 2024-03-19T06:22:23.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.232+0000 7f021b200640 1 --2- 172.21.15.32:0/3594552387 >> v2:172.21.15.171:3300/0 conn(0x7f021c0d0440 0x7f021c070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.232+0000 7f021b200640 1 --2- 172.21.15.32:0/3594552387 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f021c06bb90 0x7f021c0cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.232+0000 7f021b200640 1 --2- 172.21.15.32:0/3594552387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f021c0b0900 0x7f021c0cf720 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.232+0000 7f021b200640 1 -- 172.21.15.32:0/3594552387 >> 172.21.15.32:0/3594552387 conn(0x7f021c0d1610 msgr2=0x7f021c0d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:23.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.232+0000 7f021b200640 1 -- 172.21.15.32:0/3594552387 shutdown_connections 2024-03-19T06:22:23.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.232+0000 7f021b200640 1 -- 172.21.15.32:0/3594552387 wait complete. 2024-03-19T06:22:23.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.232+0000 7f021b200640 1 Processor -- start 2024-03-19T06:22:23.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.232+0000 7f021b200640 1 -- start start 2024-03-19T06:22:23.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f021b200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f021c06bb90 0x7f021c157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f021b200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f021c0b0900 0x7f021c15fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f021b200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f021c0d0440 0x7f021c160110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f021b200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c070060 con 0x7f021c06bb90 2024-03-19T06:22:23.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f021b200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c06fd80 con 0x7f021c0b0900 2024-03-19T06:22:23.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f021b200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0cd7a0 con 0x7f021c0d0440 2024-03-19T06:22:23.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f0219e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f021c06bb90 0x7f021c157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f0219e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f021c06bb90 0x7f021c157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56750/0 (socket says 172.21.15.32:56750) 2024-03-19T06:22:23.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f0219e00640 1 -- 172.21.15.32:0/3229041200 learned_addr learned my addr 172.21.15.32:0/3229041200 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:23.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f021a800640 1 --2- 172.21.15.32:0/3229041200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f021c0d0440 0x7f021c160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f0219400640 1 --2- 172.21.15.32:0/3229041200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f021c0b0900 0x7f021c15fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f0219e00640 1 -- 172.21.15.32:0/3229041200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f021c0d0440 msgr2=0x7f021c160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:23.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f0219e00640 1 --2- 172.21.15.32:0/3229041200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f021c0d0440 0x7f021c160110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f0219e00640 1 -- 172.21.15.32:0/3229041200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f021c0b0900 msgr2=0x7f021c15fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:23.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f0219e00640 1 --2- 172.21.15.32:0/3229041200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f021c0b0900 0x7f021c15fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f0219e00640 1 -- 172.21.15.32:0/3229041200 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0c5430 con 0x7f021c06bb90 2024-03-19T06:22:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f0219e00640 1 --2- 172.21.15.32:0/3229041200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f021c06bb90 0x7f021c157d90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f020c0b3040 tx=0x7f020c01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f0212000640 1 -- 172.21.15.32:0/3229041200 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c0b5070 con 0x7f021c06bb90 2024-03-19T06:22:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f0212000640 1 -- 172.21.15.32:0/3229041200 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c0b0a70 con 0x7f021c06bb90 2024-03-19T06:22:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f0212000640 1 -- 172.21.15.32:0/3229041200 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c0b0e60 con 0x7f021c06bb90 2024-03-19T06:22:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f021b200640 1 -- 172.21.15.32:0/3229041200 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c0c78a0 con 0x7f021c06bb90 2024-03-19T06:22:23.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f021b200640 1 -- 172.21.15.32:0/3229041200 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c0c8810 con 0x7f021c06bb90 2024-03-19T06:22:23.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.236+0000 7f0212000640 1 -- 172.21.15.32:0/3229041200 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f020c0c2060 con 0x7f021c06bb90 2024-03-19T06:22:23.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f0212000640 1 --2- 172.21.15.32:0/3229041200 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f01fc0676b0 0x7f01fc069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f0212000640 1 -- 172.21.15.32:0/3229041200 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f020c122b20 con 0x7f021c06bb90 2024-03-19T06:22:23.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f0219400640 1 --2- 172.21.15.32:0/3229041200 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f01fc0676b0 0x7f01fc069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f022439f000 1 Processor -- start 2024-03-19T06:22:23.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f022439f000 1 -- start start 2024-03-19T06:22:23.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f0219400640 1 --2- 172.21.15.32:0/3229041200 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f01fc0676b0 0x7f01fc069b70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f021c0b40e0 tx=0x7f0208008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:23.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f022439f000 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c89022d60 0x559c89023140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f022439f000 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c89023680 0x559c88fd8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f022439f000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c88fd8f90 0x559c88fd9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f022439f000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c88ec0420 con 0x559c88fd8f90 2024-03-19T06:22:23.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f022439f000 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c88e27fa0 con 0x559c89022d60 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f022439f000 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c88dafe00 con 0x559c89023680 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f021a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c88fd8f90 0x559c88fd9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f021a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c88fd8f90 0x559c88fd9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56766/0 (socket says 172.21.15.32:56766) 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f021a800640 1 -- 172.21.15.32:0/2888819138 learned_addr learned my addr 172.21.15.32:0/2888819138 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f0219e00640 1 --2- 172.21.15.32:0/2888819138 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c89022d60 0x559c89023140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f0219400640 1 --2- 172.21.15.32:0/2888819138 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c89023680 0x559c88fd8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f021a800640 1 -- 172.21.15.32:0/2888819138 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c89023680 msgr2=0x559c88fd8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f021a800640 1 --2- 172.21.15.32:0/2888819138 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c89023680 0x559c88fd8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f021a800640 1 -- 172.21.15.32:0/2888819138 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c89022d60 msgr2=0x559c89023140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f021a800640 1 --2- 172.21.15.32:0/2888819138 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c89022d60 0x559c89023140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f021a800640 1 -- 172.21.15.32:0/2888819138 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c88db3cc0 con 0x559c88fd8f90 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f021a800640 1 --2- 172.21.15.32:0/2888819138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c88fd8f90 0x559c88fd9370 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0214009fc0 tx=0x7f02140077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56bd4991ef98d1a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f0206a00640 1 -- 172.21.15.32:0/2888819138 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02140147e0 con 0x559c88fd8f90 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f0206a00640 1 -- 172.21.15.32:0/2888819138 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021401a070 con 0x559c88fd8f90 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.240+0000 7f0206a00640 1 -- 172.21.15.32:0/2888819138 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214014b80 con 0x559c88fd8f90 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 -- 172.21.15.32:0/2888819138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c88fd8f90 msgr2=0x559c88fd9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:23.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 --2- 172.21.15.32:0/2888819138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c88fd8f90 0x559c88fd9370 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0214009fc0 tx=0x7f02140077c0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 -- 172.21.15.32:0/2888819138 shutdown_connections 2024-03-19T06:22:23.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 --2- 172.21.15.32:0/2888819138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c88fd8f90 0x559c88fd9370 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 --2- 172.21.15.32:0/2888819138 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c89023680 0x559c88fd8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 --2- 172.21.15.32:0/2888819138 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c89022d60 0x559c89023140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 -- 172.21.15.32:0/2888819138 >> 172.21.15.32:0/2888819138 conn(0x559c88fd0310 msgr2=0x559c88fd7330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:23.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 -- 172.21.15.32:0/2888819138 shutdown_connections 2024-03-19T06:22:23.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 -- 172.21.15.32:0/2888819138 wait complete. 2024-03-19T06:22:23.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 -- start start 2024-03-19T06:22:23.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 Processor -- start 2024-03-19T06:22:23.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c88fd8f90 0x559c88fe4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c89022d60 0x559c88fe4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c89023680 0x559c88fe4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c88de2b00 con 0x559c88fd8f90 2024-03-19T06:22:23.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c88e24040 con 0x559c89023680 2024-03-19T06:22:23.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c88e2c5d0 con 0x559c89022d60 2024-03-19T06:22:23.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 10 client.0 _ll_register_callbacks cb 0x559c88dc9ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:22:23.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f0219e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c88fd8f90 0x559c88fe4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f0219e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c88fd8f90 0x559c88fe4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56768/0 (socket says 172.21.15.32:56768) 2024-03-19T06:22:23.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f0219e00640 1 -- 172.21.15.32:0/2012970277 learned_addr learned my addr 172.21.15.32:0/2012970277 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:23.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f021a800640 1 --2- 172.21.15.32:0/2012970277 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c89023680 0x559c88fe4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f0219400640 1 --2- 172.21.15.32:0/2012970277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c89022d60 0x559c88fe4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f0219e00640 1 -- 172.21.15.32:0/2012970277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c89022d60 msgr2=0x559c88fe4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:23.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f0219e00640 1 --2- 172.21.15.32:0/2012970277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c89022d60 0x559c88fe4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f0219e00640 1 -- 172.21.15.32:0/2012970277 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c89023680 msgr2=0x559c88fe4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:23.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f0219e00640 1 --2- 172.21.15.32:0/2012970277 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c89023680 0x559c88fe4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f0219e00640 1 -- 172.21.15.32:0/2012970277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c88dec380 con 0x559c88fd8f90 2024-03-19T06:22:23.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f0219400640 1 --2- 172.21.15.32:0/2012970277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c89022d60 0x559c88fe4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:23.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f0219e00640 1 --2- 172.21.15.32:0/2012970277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c88fd8f90 0x559c88fe4110 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f020c1210c0 tx=0x7f020c0f3810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef2eaa1e04b7979 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:23.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f01fb400640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-03-19T06:22:23.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f01fb400640 1 -- 172.21.15.32:0/2012970277 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c0f3570 con 0x559c88fd8f90 2024-03-19T06:22:23.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f01fb400640 1 -- 172.21.15.32:0/2012970277 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f020c0fb390 con 0x559c88fd8f90 2024-03-19T06:22:23.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 -- 172.21.15.32:0/2012970277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f021401a070 con 0x559c88fd8f90 2024-03-19T06:22:23.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f01fb400640 1 -- 172.21.15.32:0/2012970277 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f020c0f3110 con 0x559c88fd8f90 2024-03-19T06:22:23.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 10 client.5427 fetch_fsmap learned FSMap version 17 2024-03-19T06:22:23.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 1 -- 172.21.15.32:0/2012970277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x559c88dfb830 con 0x559c88fd8f90 2024-03-19T06:22:23.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f01fb400640 1 -- 172.21.15.32:0/2012970277 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021401a070 con 0x559c88fd8f90 2024-03-19T06:22:23.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f01fb400640 1 -- 172.21.15.32:0/2012970277 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f020c0f2560 con 0x559c88fd8f90 2024-03-19T06:22:23.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 10 client.5427 fetch_fsmap finished waiting for FSMap version 17 2024-03-19T06:22:23.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 10 client.5427 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-19T06:22:23.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.244+0000 7f022439f000 20 client.5427 populate_metadata read hostname 'smithi032' 2024-03-19T06:22:23.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f022439f000 1 --2- 172.21.15.32:0/2012970277 >> [v2:172.21.15.32:6834/2680502611,v1:172.21.15.32:6835/2680502611] conn(0x559c88fe5460 0x559c890344e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f022439f000 4 client.5427 mds_command: new command op to 5229 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-19T06:22:23.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f022439f000 1 -- 172.21.15.32:0/2012970277 --> [v2:172.21.15.32:6834/2680502611,v1:172.21.15.32:6835/2680502611] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c88dc3b60 con 0x559c88fe5460 2024-03-19T06:22:23.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f0219400640 1 --2- 172.21.15.32:0/2012970277 >> [v2:172.21.15.32:6834/2680502611,v1:172.21.15.32:6835/2680502611] conn(0x559c88fe5460 0x559c890344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f0219400640 1 --2- 172.21.15.32:0/2012970277 >> [v2:172.21.15.32:6834/2680502611,v1:172.21.15.32:6835/2680502611] conn(0x559c88fe5460 0x559c890344e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de1d27091f6b5e9 server_cookie=e3b3b18445cb97db in_seq=0 out_seq=0 2024-03-19T06:22:23.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f01fb400640 10 client.5427 ms_handle_connect on v2:172.21.15.32:6834/2680502611 2024-03-19T06:22:23.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f01fb400640 1 -- 172.21.15.32:0/2012970277 <== mds.0 v2:172.21.15.32:6834/2680502611 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559c88dc3b60 con 0x559c88fe5460 2024-03-19T06:22:23.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f01fb400640 10 client.5427 handle_command_reply: tid=0 2024-03-19T06:22:23.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f022439f000 1 client.5427 shutdown 2024-03-19T06:22:23.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f022439f000 1 -- 172.21.15.32:0/2012970277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c88fd8f90 msgr2=0x559c88fe4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:23.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f022439f000 1 --2- 172.21.15.32:0/2012970277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c88fd8f90 0x559c88fe4110 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f020c1210c0 tx=0x7f020c0f3810 comp rx=0 tx=0).stop 2024-03-19T06:22:23.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f022439f000 1 -- 172.21.15.32:0/2012970277 shutdown_connections 2024-03-19T06:22:23.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f022439f000 1 --2- 172.21.15.32:0/2012970277 >> [v2:172.21.15.32:6834/2680502611,v1:172.21.15.32:6835/2680502611] conn(0x559c88fe5460 0x559c890344e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f022439f000 1 --2- 172.21.15.32:0/2012970277 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c89023680 0x559c88fe4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f022439f000 1 --2- 172.21.15.32:0/2012970277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c89022d60 0x559c88fe4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f01fb400640 0 client.5427 ms_handle_reset on v2:172.21.15.32:6834/2680502611 2024-03-19T06:22:23.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f022439f000 1 --2- 172.21.15.32:0/2012970277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c88fd8f90 0x559c88fe4110 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f022439f000 1 -- 172.21.15.32:0/2012970277 >> 172.21.15.32:0/2012970277 conn(0x559c88fd0310 msgr2=0x559c88fd7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:23.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f022439f000 1 -- 172.21.15.32:0/2012970277 shutdown_connections 2024-03-19T06:22:23.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f022439f000 1 -- 172.21.15.32:0/2012970277 wait complete. 2024-03-19T06:22:23.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.248+0000 7f022439f000 20 client.5427 trim_cache size 0 max 16384 2024-03-19T06:22:23.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f022439f000 1 Processor -- start 2024-03-19T06:22:23.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f022439f000 1 -- start start 2024-03-19T06:22:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f022439f000 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c88fd0310 0x559c8907f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f022439f000 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c88fd8f90 0x559c8907fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f022439f000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c89022d60 0x559c89080210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f022439f000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c1fee20 con 0x559c89022d60 2024-03-19T06:22:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f022439f000 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0c9900 con 0x559c88fd0310 2024-03-19T06:22:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f022439f000 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0c9f00 con 0x559c88fd8f90 2024-03-19T06:22:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f021a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c89022d60 0x559c89080210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f021a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c89022d60 0x559c89080210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56780/0 (socket says 172.21.15.32:56780) 2024-03-19T06:22:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f021a800640 1 -- 172.21.15.32:0/305858936 learned_addr learned my addr 172.21.15.32:0/305858936 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f0219e00640 1 --2- 172.21.15.32:0/305858936 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c88fd0310 0x559c8907f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f0219400640 1 --2- 172.21.15.32:0/305858936 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c88fd8f90 0x559c8907fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f021a800640 1 -- 172.21.15.32:0/305858936 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c88fd8f90 msgr2=0x559c8907fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:23.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f021a800640 1 --2- 172.21.15.32:0/305858936 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c88fd8f90 0x559c8907fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f021a800640 1 -- 172.21.15.32:0/305858936 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c88fd0310 msgr2=0x559c8907f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:23.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f021a800640 1 --2- 172.21.15.32:0/305858936 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c88fd0310 0x559c8907f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f021a800640 1 -- 172.21.15.32:0/305858936 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c88df5fb0 con 0x559c89022d60 2024-03-19T06:22:23.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f021a800640 1 --2- 172.21.15.32:0/305858936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c89022d60 0x559c89080210 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0214016000 tx=0x7f0214014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be0dec501018ef8 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:23.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f0206000640 1 -- 172.21.15.32:0/305858936 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021402e070 con 0x559c89022d60 2024-03-19T06:22:23.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f0206000640 1 -- 172.21.15.32:0/305858936 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021401a040 con 0x559c89022d60 2024-03-19T06:22:23.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.264+0000 7f0206000640 1 -- 172.21.15.32:0/305858936 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02140149e0 con 0x559c89022d60 2024-03-19T06:22:23.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 -- 172.21.15.32:0/305858936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c89022d60 msgr2=0x559c89080210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:23.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 --2- 172.21.15.32:0/305858936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c89022d60 0x559c89080210 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0214016000 tx=0x7f0214014000 comp rx=0 tx=0).stop 2024-03-19T06:22:23.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 -- 172.21.15.32:0/305858936 shutdown_connections 2024-03-19T06:22:23.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 --2- 172.21.15.32:0/305858936 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c89022d60 0x559c89080210 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 --2- 172.21.15.32:0/305858936 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c88fd8f90 0x559c8907fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 --2- 172.21.15.32:0/305858936 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c88fd0310 0x559c8907f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 -- 172.21.15.32:0/305858936 >> 172.21.15.32:0/305858936 conn(0x559c890221f0 msgr2=0x559c88fdea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 -- 172.21.15.32:0/305858936 shutdown_connections 2024-03-19T06:22:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 -- 172.21.15.32:0/305858936 wait complete. 2024-03-19T06:22:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 -- start start 2024-03-19T06:22:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 Processor -- start 2024-03-19T06:22:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c88fd0310 0x559c89036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c88fd8f90 0x559c8903efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c89022d60 0x559c8903f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c88de2b00 con 0x559c89022d60 2024-03-19T06:22:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c88fe24e0 con 0x559c88fd0310 2024-03-19T06:22:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c88e24040 con 0x559c88fd8f90 2024-03-19T06:22:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 10 client.0 _ll_register_callbacks cb 0x7f0214009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:22:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f021a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c89022d60 0x559c8903f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f021a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c89022d60 0x559c8903f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56796/0 (socket says 172.21.15.32:56796) 2024-03-19T06:22:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f021a800640 1 -- 172.21.15.32:0/2503540407 learned_addr learned my addr 172.21.15.32:0/2503540407 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f0219e00640 1 --2- 172.21.15.32:0/2503540407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c88fd0310 0x559c89036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f0219400640 1 --2- 172.21.15.32:0/2503540407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c88fd8f90 0x559c8903efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f021a800640 1 -- 172.21.15.32:0/2503540407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c88fd8f90 msgr2=0x559c8903efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f021a800640 1 --2- 172.21.15.32:0/2503540407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c88fd8f90 0x559c8903efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f021a800640 1 -- 172.21.15.32:0/2503540407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c88fd0310 msgr2=0x559c89036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f021a800640 1 --2- 172.21.15.32:0/2503540407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c88fd0310 0x559c89036770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f021a800640 1 -- 172.21.15.32:0/2503540407 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c88ea92e0 con 0x559c89022d60 2024-03-19T06:22:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f021a800640 1 --2- 172.21.15.32:0/2503540407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c89022d60 0x559c8903f4f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0214000f90 tx=0x7f0214012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7441f854dd270711 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f01fb400640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-03-19T06:22:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f01fb400640 1 -- 172.21.15.32:0/2503540407 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214037060 con 0x559c89022d60 2024-03-19T06:22:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f01fb400640 1 -- 172.21.15.32:0/2503540407 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0214014b90 con 0x559c89022d60 2024-03-19T06:22:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 -- 172.21.15.32:0/2503540407 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f021401a040 con 0x559c89022d60 2024-03-19T06:22:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f01fb400640 1 -- 172.21.15.32:0/2503540407 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f021403d050 con 0x559c89022d60 2024-03-19T06:22:23.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 10 client.5433 fetch_fsmap learned FSMap version 17 2024-03-19T06:22:23.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f022439f000 1 -- 172.21.15.32:0/2503540407 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x559c88dcf0a0 con 0x559c89022d60 2024-03-19T06:22:23.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.268+0000 7f01fb400640 1 -- 172.21.15.32:0/2503540407 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021401a040 con 0x559c89022d60 2024-03-19T06:22:23.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f01fb400640 1 -- 172.21.15.32:0/2503540407 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0214040020 con 0x559c89022d60 2024-03-19T06:22:23.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 10 client.5433 fetch_fsmap finished waiting for FSMap version 17 2024-03-19T06:22:23.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 10 client.5433 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-19T06:22:23.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 20 client.5433 populate_metadata read hostname 'smithi032' 2024-03-19T06:22:23.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 1 --2- 172.21.15.32:0/2503540407 >> [v2:172.21.15.32:6834/2680502611,v1:172.21.15.32:6835/2680502611] conn(0x559c89023680 0x559c890837a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 4 client.5433 mds_command: new command op to 5229 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-19T06:22:23.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 1 -- 172.21.15.32:0/2503540407 --> [v2:172.21.15.32:6834/2680502611,v1:172.21.15.32:6835/2680502611] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559c88e354e0 con 0x559c89023680 2024-03-19T06:22:23.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f0219e00640 1 --2- 172.21.15.32:0/2503540407 >> [v2:172.21.15.32:6834/2680502611,v1:172.21.15.32:6835/2680502611] conn(0x559c89023680 0x559c890837a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f01fb400640 10 client.5433 ms_handle_connect on v2:172.21.15.32:6834/2680502611 2024-03-19T06:22:23.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f0219e00640 1 --2- 172.21.15.32:0/2503540407 >> [v2:172.21.15.32:6834/2680502611,v1:172.21.15.32:6835/2680502611] conn(0x559c89023680 0x559c890837a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19117adbb0ec72f6 server_cookie=e3f1e3122b219527 in_seq=0 out_seq=0 2024-03-19T06:22:23.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f01fb400640 1 -- 172.21.15.32:0/2503540407 <== mds.0 v2:172.21.15.32:6834/2680502611 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x559c88e354e0 con 0x559c89023680 2024-03-19T06:22:23.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f01fb400640 10 client.5433 handle_command_reply: tid=0 2024-03-19T06:22:23.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 1 client.5433 shutdown 2024-03-19T06:22:23.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 1 -- 172.21.15.32:0/2503540407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c89022d60 msgr2=0x559c8903f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:23.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 1 --2- 172.21.15.32:0/2503540407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c89022d60 0x559c8903f4f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0214000f90 tx=0x7f0214012000 comp rx=0 tx=0).stop 2024-03-19T06:22:23.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 1 -- 172.21.15.32:0/2503540407 shutdown_connections 2024-03-19T06:22:23.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 1 --2- 172.21.15.32:0/2503540407 >> [v2:172.21.15.32:6834/2680502611,v1:172.21.15.32:6835/2680502611] conn(0x559c89023680 0x559c890837a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 1 --2- 172.21.15.32:0/2503540407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x559c89022d60 0x559c8903f4f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 1 --2- 172.21.15.32:0/2503540407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559c88fd8f90 0x559c8903efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 1 --2- 172.21.15.32:0/2503540407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c88fd0310 0x559c89036770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f01fb400640 0 client.5433 ms_handle_reset on v2:172.21.15.32:6834/2680502611 2024-03-19T06:22:23.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 1 -- 172.21.15.32:0/2503540407 >> 172.21.15.32:0/2503540407 conn(0x559c890221f0 msgr2=0x559c890324d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:23.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 1 -- 172.21.15.32:0/2503540407 shutdown_connections 2024-03-19T06:22:23.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 1 -- 172.21.15.32:0/2503540407 wait complete. 2024-03-19T06:22:23.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f022439f000 20 client.5433 trim_cache size 0 max 16384 2024-03-19T06:22:23.268 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:22:23.268 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "5b96820f-940f-489f-8b00-afd5c905fd95", 2024-03-19T06:22:23.268 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2024-03-19T06:22:23.268 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 5229, 2024-03-19T06:22:23.268 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2024-03-19T06:22:23.268 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2024-03-19T06:22:23.268 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2024-03-19T06:22:23.268 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 10.484433492999999, 2024-03-19T06:22:23.268 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 17, 2024-03-19T06:22:23.268 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 35, 2024-03-19T06:22:23.268 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 35, 2024-03-19T06:22:23.269 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 18.363140705999999 2024-03-19T06:22:23.269 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:22:23.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f021b200640 1 -- 172.21.15.32:0/3229041200 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f01fc0676b0 msgr2=0x7f01fc069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:23.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f021b200640 1 --2- 172.21.15.32:0/3229041200 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f01fc0676b0 0x7f01fc069b70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f021c0b40e0 tx=0x7f0208008040 comp rx=0 tx=0).stop 2024-03-19T06:22:23.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f021b200640 1 -- 172.21.15.32:0/3229041200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f021c06bb90 msgr2=0x7f021c157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:23.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f021b200640 1 --2- 172.21.15.32:0/3229041200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f021c06bb90 0x7f021c157d90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f020c0b3040 tx=0x7f020c01bab0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f021b200640 1 -- 172.21.15.32:0/3229041200 shutdown_connections 2024-03-19T06:22:23.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f021b200640 1 --2- 172.21.15.32:0/3229041200 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f01fc0676b0 0x7f01fc069b70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f021b200640 1 --2- 172.21.15.32:0/3229041200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f021c0d0440 0x7f021c160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f021b200640 1 --2- 172.21.15.32:0/3229041200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f021c0b0900 0x7f021c15fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f021b200640 1 --2- 172.21.15.32:0/3229041200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f021c06bb90 0x7f021c157d90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f021b200640 1 -- 172.21.15.32:0/3229041200 >> 172.21.15.32:0/3229041200 conn(0x7f021c0d1610 msgr2=0x7f021c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:23.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f021b200640 1 -- 172.21.15.32:0/3229041200 shutdown_connections 2024-03-19T06:22:23.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.272+0000 7f021b200640 1 -- 172.21.15.32:0/3229041200 wait complete. 2024-03-19T06:22:23.284 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-19T06:22:23.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.432+0000 7f668ea00640 1 Processor -- start 2024-03-19T06:22:23.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.432+0000 7f668ea00640 1 -- start start 2024-03-19T06:22:23.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.432+0000 7f668ea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f668806c460 0x7f6688164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.432+0000 7f668ea00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66880acdb0 con 0x7f6688159d80 2024-03-19T06:22:23.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.432+0000 7f668ea00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66880ad070 con 0x7f668806ffd0 2024-03-19T06:22:23.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.432+0000 7f668ea00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66880b4c60 con 0x7f668806c460 2024-03-19T06:22:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.432+0000 7f6687e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6688159d80 0x7f66880b4550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60940/0 (socket says 172.21.15.32:60940) 2024-03-19T06:22:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.432+0000 7f6687e00640 1 -- 172.21.15.32:0/3483206170 learned_addr learned my addr 172.21.15.32:0/3483206170 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.432+0000 7f668ca00640 1 --2- 172.21.15.32:0/3483206170 >> v2:172.21.15.32:3300/0 conn(0x7f668806c460 0x7f6688164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.432+0000 7f6687400640 1 -- 172.21.15.32:0/3483206170 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055072141 0 0) 0x7f66880acdb0 con 0x7f6688159d80 2024-03-19T06:22:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.432+0000 7f6687400640 1 -- 172.21.15.32:0/3483206170 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f666c003530 con 0x7f6688159d80 2024-03-19T06:22:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.432+0000 7f668ca00640 1 -- 172.21.15.32:0/3483206170 >> v1:172.21.15.171:6789/0 conn(0x7f668806ffd0 legacy=0x7f668806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.432+0000 7f668ca00640 1 -- 172.21.15.32:0/3483206170 >> v1:172.21.15.32:6789/0 conn(0x7f6688159d80 legacy=0x7f66880b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.432+0000 7f668ca00640 1 -- 172.21.15.32:0/3483206170 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880ad350 con 0x7f668806c460 2024-03-19T06:22:23.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.436+0000 7f668ca00640 1 --2- 172.21.15.32:0/3483206170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f668806c460 0x7f6688164cb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f668000aea0 tx=0x7f668001da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5366c91bb4de5de server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:23.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.436+0000 7f6687400640 1 -- 172.21.15.32:0/3483206170 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800a67e0 con 0x7f668806c460 2024-03-19T06:22:23.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.436+0000 7f6687400640 1 -- 172.21.15.32:0/3483206170 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66800a6980 con 0x7f668806c460 2024-03-19T06:22:23.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.436+0000 7f6687400640 1 -- 172.21.15.32:0/3483206170 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800a6d50 con 0x7f668806c460 2024-03-19T06:22:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.436+0000 7f668ea00640 1 -- 172.21.15.32:0/3483206170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f668806c460 msgr2=0x7f6688164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.436+0000 7f668ea00640 1 --2- 172.21.15.32:0/3483206170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f668806c460 0x7f6688164cb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f668000aea0 tx=0x7f668001da70 comp rx=0 tx=0).stop 2024-03-19T06:22:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.436+0000 7f668ea00640 1 -- 172.21.15.32:0/3483206170 shutdown_connections 2024-03-19T06:22:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.436+0000 7f668ea00640 1 --2- 172.21.15.32:0/3483206170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f668806c460 0x7f6688164cb0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.436+0000 7f668ea00640 1 -- 172.21.15.32:0/3483206170 >> 172.21.15.32:0/3483206170 conn(0x7f6688071c50 msgr2=0x7f6688072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.436+0000 7f668ea00640 1 -- 172.21.15.32:0/3483206170 shutdown_connections 2024-03-19T06:22:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.436+0000 7f668ea00640 1 -- 172.21.15.32:0/3483206170 wait complete. 2024-03-19T06:22:23.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f668ea00640 1 Processor -- start 2024-03-19T06:22:23.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f668ea00640 1 -- start start 2024-03-19T06:22:23.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f668ea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f668806c460 0x7f668815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f668ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f668806ffd0 0x7f668815b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f668ea00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6688159d80 0x7f6688146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f668ea00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6688167590 con 0x7f668806ffd0 2024-03-19T06:22:23.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f668ea00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6688167410 con 0x7f6688159d80 2024-03-19T06:22:23.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f668ea00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6688167710 con 0x7f668806c460 2024-03-19T06:22:23.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f667fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f668806ffd0 0x7f668815b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f667fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f668806ffd0 0x7f668815b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56812/0 (socket says 172.21.15.32:56812) 2024-03-19T06:22:23.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f667fe00640 1 -- 172.21.15.32:0/2191502454 learned_addr learned my addr 172.21.15.32:0/2191502454 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:23.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f668ca00640 1 --2- 172.21.15.32:0/2191502454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6688159d80 0x7f6688146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f6687e00640 1 --2- 172.21.15.32:0/2191502454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f668806c460 0x7f668815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f667fe00640 1 -- 172.21.15.32:0/2191502454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f668806c460 msgr2=0x7f668815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:23.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f667fe00640 1 --2- 172.21.15.32:0/2191502454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f668806c460 0x7f668815d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f667fe00640 1 -- 172.21.15.32:0/2191502454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6688159d80 msgr2=0x7f6688146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:23.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f667fe00640 1 --2- 172.21.15.32:0/2191502454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6688159d80 0x7f6688146d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f667fe00640 1 -- 172.21.15.32:0/2191502454 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668815bb70 con 0x7f668806ffd0 2024-03-19T06:22:23.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f668ca00640 1 --2- 172.21.15.32:0/2191502454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6688159d80 0x7f6688146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:23.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f667fe00640 1 --2- 172.21.15.32:0/2191502454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f668806ffd0 0x7f668815b630 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f667000c420 tx=0x7f667000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:23.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f6684c00640 1 -- 172.21.15.32:0/2191502454 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66700052d0 con 0x7f668806ffd0 2024-03-19T06:22:23.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f6684c00640 1 -- 172.21.15.32:0/2191502454 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6670005470 con 0x7f668806ffd0 2024-03-19T06:22:23.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f668ea00640 1 -- 172.21.15.32:0/2191502454 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668815be10 con 0x7f668806ffd0 2024-03-19T06:22:23.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f6684c00640 1 -- 172.21.15.32:0/2191502454 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6670007260 con 0x7f668806ffd0 2024-03-19T06:22:23.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.440+0000 7f668ea00640 1 -- 172.21.15.32:0/2191502454 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668815c3d0 con 0x7f668806ffd0 2024-03-19T06:22:23.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.444+0000 7f668ea00640 1 -- 172.21.15.32:0/2191502454 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66880b4a40 con 0x7f668806ffd0 2024-03-19T06:22:23.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.444+0000 7f6684c00640 1 -- 172.21.15.32:0/2191502454 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6670007400 con 0x7f668806ffd0 2024-03-19T06:22:23.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.444+0000 7f6684c00640 1 --2- 172.21.15.32:0/2191502454 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6664067690 0x7f6664069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:23.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.444+0000 7f6684c00640 1 -- 172.21.15.32:0/2191502454 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6670084d60 con 0x7f668806ffd0 2024-03-19T06:22:23.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.444+0000 7f6687e00640 1 --2- 172.21.15.32:0/2191502454 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6664067690 0x7f6664069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:23.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.444+0000 7f6687e00640 1 --2- 172.21.15.32:0/2191502454 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6664067690 0x7f6664069b50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f66780011f0 tx=0x7f6678009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:23.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.448+0000 7f6684c00640 1 -- 172.21.15.32:0/2191502454 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f66700559d0 con 0x7f668806ffd0 2024-03-19T06:22:23.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.644+0000 7f668ea00640 1 -- 172.21.15.32:0/2191502454 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f66881472c0 con 0x7f668806ffd0 2024-03-19T06:22:23.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.644+0000 7f6684c00640 1 -- 172.21.15.32:0/2191502454 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f66700552d0 con 0x7f668806ffd0 2024-03-19T06:22:23.637 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-19T06:22:23.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.648+0000 7f668ea00640 1 -- 172.21.15.32:0/2191502454 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6664067690 msgr2=0x7f6664069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:23.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.648+0000 7f668ea00640 1 --2- 172.21.15.32:0/2191502454 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6664067690 0x7f6664069b50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f66780011f0 tx=0x7f6678009040 comp rx=0 tx=0).stop 2024-03-19T06:22:23.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.648+0000 7f668ea00640 1 -- 172.21.15.32:0/2191502454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f668806ffd0 msgr2=0x7f668815b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:23.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.648+0000 7f668ea00640 1 --2- 172.21.15.32:0/2191502454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f668806ffd0 0x7f668815b630 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f667000c420 tx=0x7f667000c8e0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.648+0000 7f668ea00640 1 -- 172.21.15.32:0/2191502454 shutdown_connections 2024-03-19T06:22:23.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.648+0000 7f668ea00640 1 --2- 172.21.15.32:0/2191502454 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6664067690 0x7f6664069b50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.648+0000 7f668ea00640 1 --2- 172.21.15.32:0/2191502454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6688159d80 0x7f6688146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.648+0000 7f668ea00640 1 --2- 172.21.15.32:0/2191502454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f668806ffd0 0x7f668815b630 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.648+0000 7f668ea00640 1 --2- 172.21.15.32:0/2191502454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f668806c460 0x7f668815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:23.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.648+0000 7f668ea00640 1 -- 172.21.15.32:0/2191502454 >> 172.21.15.32:0/2191502454 conn(0x7f6688071c50 msgr2=0x7f668806bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:23.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.648+0000 7f668ea00640 1 -- 172.21.15.32:0/2191502454 shutdown_connections 2024-03-19T06:22:23.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:23.648+0000 7f668ea00640 1 -- 172.21.15.32:0/2191502454 wait complete. 2024-03-19T06:22:23.659 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-19T06:22:23.659 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-19T06:22:23.659 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-03-19T06:22:23.659 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-19T06:22:23.659 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:23.659 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-19T06:22:23.660 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-19T06:22:23.660 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-19T06:22:23.660 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:22:23.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:23.660 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-03-19T06:22:23.670 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:22:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:22:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:22:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-03-19T06:22:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:23.670 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:22:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-03-19T06:22:23.670 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:22:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-03-19T06:22:23.671 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-19T06:22:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-03-19T06:22:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-03-19T06:22:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42354sec preferred_lft 42354sec 2024-03-19T06:22:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-03-19T06:22:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:23.671 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:22:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-03-19T06:22:23.671 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-19T06:22:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:f5:94:d0:dd brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-19T06:22:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:23.672 INFO:teuthology.orchestra.run.smithi032.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-19T06:22:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-19T06:22:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-03-19T06:22:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:23.672 INFO:teuthology.orchestra.run.smithi032.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-19T06:22:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:22:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-03-19T06:22:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:23.672 INFO:teuthology.orchestra.run.smithi032.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-19T06:22:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:22:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-03-19T06:22:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:23.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:23.673 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-19T06:22:23.731 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-03-19T06:22:23.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:23.733 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-03-19T06:22:23.783 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-03-19T06:22:23.784 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-19T06:22:23.784 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-03-19T06:22:23.784 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-19T06:22:23.784 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-03-19T06:22:23.784 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-19T06:22:23.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:23.784 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-03-19T06:22:23.784 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-03-19T06:22:23.784 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-19T06:22:23.784 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-19T06:22:23.784 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-19T06:22:23.784 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-03-19T06:22:23.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:23.876 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-03-19T06:22:23.885 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-19T06:22:23.885 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-19T06:22:23.885 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:22:23.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:23.885 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-03-19T06:22:23.950 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-19T06:22:23.950 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:22:23.950 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:23.998 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:22:23.998 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:22:23.998 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:24.049 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:22:24.110 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:22:24.163 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:22:24.163 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:22:24.163 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:22:24.163 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:22:24.163 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:22:24.163 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:22:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:22:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:22:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:22:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:22:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:22:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:22:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:22:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:22:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:22:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:22:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:22:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:22:24.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:24.166 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:22:24.221 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-19T06:22:24.222 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-19T06:22:24.268 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:22:24.289 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:22:24.343 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:22:24.343 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:22:24.343 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:22:24.343 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:22:24.343 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:22:24.343 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:22:24.344 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:22:24.344 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:22:24.344 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:22:24.344 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:22:24.344 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:22:24.344 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:22:24.344 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:22:24.344 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:22:24.344 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:22:24.344 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:22:24.344 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:22:24.344 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:22:24.344 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:22:24.345 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:22:24.345 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:22:24.345 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:22:24.345 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:22:24.345 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:22:24.345 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:22:24.345 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:22:24.345 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:22:24.345 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:22:24.345 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:22:24.345 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:22:24.345 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:22:24.345 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:22:24.346 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:22:24.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:24.347 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:22:24.364 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:2024-03-19T06:22:24.372+0000 7f7c71e48580 -1 init, newargv = 0x55b114f30000 newargc=15 2024-03-19T06:22:24.364 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[36402]: starting ceph client 2024-03-19T06:22:24.371 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[36402]: starting fuse 2024-03-19T06:22:24.373 INFO:teuthology.orchestra.run.smithi032.stdout:43 2024-03-19T06:22:24.373 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-03-19T06:22:24.373 DEBUG:teuthology.orchestra.run.smithi032:> sudo stdin-killer -- python3 -c ' 2024-03-19T06:22:24.373 DEBUG:teuthology.orchestra.run.smithi032:> import glob 2024-03-19T06:22:24.373 DEBUG:teuthology.orchestra.run.smithi032:> import re 2024-03-19T06:22:24.373 DEBUG:teuthology.orchestra.run.smithi032:> import os 2024-03-19T06:22:24.373 DEBUG:teuthology.orchestra.run.smithi032:> import subprocess 2024-03-19T06:22:24.373 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:22:24.373 DEBUG:teuthology.orchestra.run.smithi032:> def _find_admin_socket(client_name): 2024-03-19T06:22:24.373 DEBUG:teuthology.orchestra.run.smithi032:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> files = glob.glob(asok_path) 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> # Given a non-glob path, it better be there 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> if "*" not in asok_path: 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> assert(len(files) == 1) 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> return files[0] 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> for f in files: 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> contents = proc_f.read() 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> if mountpoint in contents: 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> return f 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:22:24.374 DEBUG:teuthology.orchestra.run.smithi032:> print(_find_admin_socket("client.0")) 2024-03-19T06:22:24.375 DEBUG:teuthology.orchestra.run.smithi032:> ' 2024-03-19T06:22:24.496 INFO:teuthology.orchestra.run.smithi032.stdout:/var/run/ceph/ceph-client.0.36402.asok 2024-03-19T06:22:24.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-19T06:22:24.508 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.36402.asok 2024-03-19T06:22:24.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:24.508 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.36402.asok status 2024-03-19T06:22:24.685 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:22:24.686 INFO:teuthology.orchestra.run.smithi032.stdout: "metadata": { 2024-03-19T06:22:24.686 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_sha1": "b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", 2024-03-19T06:22:24.686 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_version": "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)", 2024-03-19T06:22:24.686 INFO:teuthology.orchestra.run.smithi032.stdout: "entity_id": "0", 2024-03-19T06:22:24.686 INFO:teuthology.orchestra.run.smithi032.stdout: "hostname": "smithi032", 2024-03-19T06:22:24.686 INFO:teuthology.orchestra.run.smithi032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-19T06:22:24.686 INFO:teuthology.orchestra.run.smithi032.stdout: "pid": "36402", 2024-03-19T06:22:24.686 INFO:teuthology.orchestra.run.smithi032.stdout: "root": "/" 2024-03-19T06:22:24.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:24.686 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_count": 0, 2024-03-19T06:22:24.686 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_pinned_count": 0, 2024-03-19T06:22:24.686 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 5448, 2024-03-19T06:22:24.686 INFO:teuthology.orchestra.run.smithi032.stdout: "inst": { 2024-03-19T06:22:24.687 INFO:teuthology.orchestra.run.smithi032.stdout: "name": { 2024-03-19T06:22:24.687 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "client", 2024-03-19T06:22:24.687 INFO:teuthology.orchestra.run.smithi032.stdout: "num": 5448 2024-03-19T06:22:24.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:24.687 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-03-19T06:22:24.687 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-03-19T06:22:24.687 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:22:24.687 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1055716811 2024-03-19T06:22:24.687 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:24.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:24.687 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-03-19T06:22:24.687 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-03-19T06:22:24.687 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:22:24.687 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1055716811 2024-03-19T06:22:24.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:24.688 INFO:teuthology.orchestra.run.smithi032.stdout: "inst_str": "client.5448 192.168.0.1:0/1055716811", 2024-03-19T06:22:24.688 INFO:teuthology.orchestra.run.smithi032.stdout: "addr_str": "192.168.0.1:0/1055716811", 2024-03-19T06:22:24.688 INFO:teuthology.orchestra.run.smithi032.stdout: "inode_count": 1, 2024-03-19T06:22:24.688 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_epoch": 17, 2024-03-19T06:22:24.688 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch": 35, 2024-03-19T06:22:24.688 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch_barrier": 0, 2024-03-19T06:22:24.688 INFO:teuthology.orchestra.run.smithi032.stdout: "blocklisted": false, 2024-03-19T06:22:24.688 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs" 2024-03-19T06:22:24.688 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:22:24.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:24.701 DEBUG:teuthology.orchestra.run.smithi032:> stat --file-system '--printf=%T 2024-03-19T06:22:24.701 DEBUG:teuthology.orchestra.run.smithi032:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:24.710 INFO:teuthology.orchestra.run.smithi032.stdout:fuseblk 2024-03-19T06:22:24.710 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:24.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:24.711 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:24.774 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2024-03-19T06:22:24.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.972+0000 7f6ef5000640 1 Processor -- start 2024-03-19T06:22:24.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.972+0000 7f6ef5000640 1 -- start start 2024-03-19T06:22:24.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.972+0000 7f6ef5000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ef009a180 0x7f6ef00ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:24.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.972+0000 7f6ef5000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6ef00cd420 0x7f6ef006c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:24.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.972+0000 7f6ef5000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef00b0a10 con 0x7f6ef0161070 2024-03-19T06:22:24.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.972+0000 7f6ef5000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef006bb90 con 0x7f6ef00cd420 2024-03-19T06:22:24.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.972+0000 7f6ef5000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef00cdbd0 con 0x7f6ef009a180 2024-03-19T06:22:24.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.972+0000 7f6eef400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6ef0161070 0x7f6ef0099a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58832/0 (socket says 172.21.15.32:58832) 2024-03-19T06:22:24.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.972+0000 7f6eef400640 1 -- 172.21.15.32:0/1715159942 learned_addr learned my addr 172.21.15.32:0/1715159942 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:24.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.972+0000 7f6eefe00640 1 --2- 172.21.15.32:0/1715159942 >> v2:172.21.15.32:3300/0 conn(0x7f6ef00cd420 0x7f6ef006c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:24.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.972+0000 7f6ee7e00640 1 --2- 172.21.15.32:0/1715159942 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ef009a180 0x7f6ef00ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:24.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.972+0000 7f6eefe00640 1 -- 172.21.15.32:0/1715159942 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ef009a180 msgr2=0x7f6ef00ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:24.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.972+0000 7f6eefe00640 1 --2- 172.21.15.32:0/1715159942 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ef009a180 0x7f6ef00ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:24.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.972+0000 7f6eefe00640 1 -- 172.21.15.32:0/1715159942 >> v1:172.21.15.32:6789/0 conn(0x7f6ef0161070 legacy=0x7f6ef0099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:24.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.972+0000 7f6eefe00640 1 -- 172.21.15.32:0/1715159942 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef006bde0 con 0x7f6ef00cd420 2024-03-19T06:22:24.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.972+0000 7f6eeea00640 1 -- 172.21.15.32:0/1715159942 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531332253 0 0) 0x7f6ee0001120 con 0x7f6ef0161070 2024-03-19T06:22:24.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.976+0000 7f6eefe00640 1 --2- 172.21.15.32:0/1715159942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef00cd420 0x7f6ef006c8c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009d90 tx=0x7f6ee801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d70f6ff510c8435 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:24.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.976+0000 7f6eeea00640 1 -- 172.21.15.32:0/1715159942 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80b2070 con 0x7f6ef00cd420 2024-03-19T06:22:24.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.976+0000 7f6eeea00640 1 -- 172.21.15.32:0/1715159942 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee80a5710 con 0x7f6ef00cd420 2024-03-19T06:22:24.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.976+0000 7f6eeea00640 1 -- 172.21.15.32:0/1715159942 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80a5ae0 con 0x7f6ef00cd420 2024-03-19T06:22:24.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.976+0000 7f6ef5000640 1 -- 172.21.15.32:0/1715159942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef00cd420 msgr2=0x7f6ef006c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:24.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.976+0000 7f6ef5000640 1 --2- 172.21.15.32:0/1715159942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef00cd420 0x7f6ef006c8c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009d90 tx=0x7f6ee801c850 comp rx=0 tx=0).stop 2024-03-19T06:22:24.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.976+0000 7f6ef5000640 1 -- 172.21.15.32:0/1715159942 shutdown_connections 2024-03-19T06:22:24.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.976+0000 7f6ef5000640 1 --2- 172.21.15.32:0/1715159942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef00cd420 0x7f6ef006c8c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:24.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.976+0000 7f6ef5000640 1 --2- 172.21.15.32:0/1715159942 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ef009a180 0x7f6ef00ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:24.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.976+0000 7f6ef5000640 1 -- 172.21.15.32:0/1715159942 >> 172.21.15.32:0/1715159942 conn(0x7f6ef00b3100 msgr2=0x7f6ef00b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:24.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.976+0000 7f6ef5000640 1 -- 172.21.15.32:0/1715159942 shutdown_connections 2024-03-19T06:22:24.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.976+0000 7f6ef5000640 1 -- 172.21.15.32:0/1715159942 wait complete. 2024-03-19T06:22:24.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ef5000640 1 Processor -- start 2024-03-19T06:22:24.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ef5000640 1 -- start start 2024-03-19T06:22:24.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ef5000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ef009a180 0x7f6ef0153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:24.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ef5000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef00cd420 0x7f6ef00cf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:24.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ef5000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ef0161070 0x7f6ef00cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:24.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ef5000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef006d790 con 0x7f6ef00cd420 2024-03-19T06:22:24.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ef5000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef006d610 con 0x7f6ef009a180 2024-03-19T06:22:24.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ef5000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef006d910 con 0x7f6ef0161070 2024-03-19T06:22:24.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ee7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef00cd420 0x7f6ef00cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:24.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ee7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef00cd420 0x7f6ef00cf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59864/0 (socket says 172.21.15.32:59864) 2024-03-19T06:22:24.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ee7e00640 1 -- 172.21.15.32:0/647868431 learned_addr learned my addr 172.21.15.32:0/647868431 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:24.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6eefe00640 1 --2- 172.21.15.32:0/647868431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ef0161070 0x7f6ef00cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:24.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6eef400640 1 --2- 172.21.15.32:0/647868431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ef009a180 0x7f6ef0153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:24.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ee7e00640 1 -- 172.21.15.32:0/647868431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ef0161070 msgr2=0x7f6ef00cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:24.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ee7e00640 1 --2- 172.21.15.32:0/647868431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ef0161070 0x7f6ef00cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:24.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ee7e00640 1 -- 172.21.15.32:0/647868431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ef009a180 msgr2=0x7f6ef0153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:24.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ee7e00640 1 --2- 172.21.15.32:0/647868431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ef009a180 0x7f6ef0153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:24.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ee7e00640 1 -- 172.21.15.32:0/647868431 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef00b1810 con 0x7f6ef00cd420 2024-03-19T06:22:24.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6eefe00640 1 --2- 172.21.15.32:0/647868431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ef0161070 0x7f6ef00cf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:24.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ee7e00640 1 --2- 172.21.15.32:0/647868431 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef00cd420 0x7f6ef00cf380 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800d620 tx=0x7f6ed800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:24.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ee7400640 1 -- 172.21.15.32:0/647868431 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800b620 con 0x7f6ef00cd420 2024-03-19T06:22:24.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ee7400640 1 -- 172.21.15.32:0/647868431 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed8019070 con 0x7f6ef00cd420 2024-03-19T06:22:24.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ee7400640 1 -- 172.21.15.32:0/647868431 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800b9e0 con 0x7f6ef00cd420 2024-03-19T06:22:24.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ef5000640 1 -- 172.21.15.32:0/647868431 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef00b1af0 con 0x7f6ef00cd420 2024-03-19T06:22:24.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.980+0000 7f6ef5000640 1 -- 172.21.15.32:0/647868431 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef00b20b0 con 0x7f6ef00cd420 2024-03-19T06:22:24.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.984+0000 7f6ef5000640 1 -- 172.21.15.32:0/647868431 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef00c90c0 con 0x7f6ef00cd420 2024-03-19T06:22:24.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.984+0000 7f6ee7400640 1 -- 172.21.15.32:0/647868431 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6ed800bb80 con 0x7f6ef00cd420 2024-03-19T06:22:24.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.984+0000 7f6ee7400640 1 --2- 172.21.15.32:0/647868431 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6ecc067660 0x7f6ecc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:24.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.984+0000 7f6ee7400640 1 -- 172.21.15.32:0/647868431 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ed8085cc0 con 0x7f6ef00cd420 2024-03-19T06:22:24.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.984+0000 7f6eef400640 1 --2- 172.21.15.32:0/647868431 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6ecc067660 0x7f6ecc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:24.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.984+0000 7f6eef400640 1 --2- 172.21.15.32:0/647868431 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6ecc067660 0x7f6ecc069b20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0000f70 tx=0x7f6ee0007c10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:24.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:24.988+0000 7f6ee7400640 1 -- 172.21.15.32:0/647868431 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f6ef00c90c0 con 0x7f6ef00cd420 2024-03-19T06:22:25.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:25.156+0000 7f6ef5000640 1 -- 172.21.15.32:0/647868431 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) v1 -- 0x7f6ef0075090 con 0x7f6ef00cd420 2024-03-19T06:22:25.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:25.836+0000 7f6ee7400640 1 -- 172.21.15.32:0/647868431 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v36) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6ed8056940 con 0x7f6ef00cd420 2024-03-19T06:22:25.830 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'data_new' created 2024-03-19T06:22:25.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:25.840+0000 7f6ef5000640 1 -- 172.21.15.32:0/647868431 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6ecc067660 msgr2=0x7f6ecc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:25.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:25.840+0000 7f6ef5000640 1 --2- 172.21.15.32:0/647868431 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6ecc067660 0x7f6ecc069b20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0000f70 tx=0x7f6ee0007c10 comp rx=0 tx=0).stop 2024-03-19T06:22:25.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:25.840+0000 7f6ef5000640 1 -- 172.21.15.32:0/647868431 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef00cd420 msgr2=0x7f6ef00cf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:25.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:25.840+0000 7f6ef5000640 1 --2- 172.21.15.32:0/647868431 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef00cd420 0x7f6ef00cf380 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800d620 tx=0x7f6ed800dae0 comp rx=0 tx=0).stop 2024-03-19T06:22:25.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:25.840+0000 7f6ef5000640 1 -- 172.21.15.32:0/647868431 shutdown_connections 2024-03-19T06:22:25.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:25.840+0000 7f6ef5000640 1 --2- 172.21.15.32:0/647868431 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6ecc067660 0x7f6ecc069b20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:25.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:25.840+0000 7f6ef5000640 1 --2- 172.21.15.32:0/647868431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ef0161070 0x7f6ef00cf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:25.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:25.840+0000 7f6ef5000640 1 --2- 172.21.15.32:0/647868431 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef00cd420 0x7f6ef00cf380 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:25.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:25.840+0000 7f6ef5000640 1 --2- 172.21.15.32:0/647868431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ef009a180 0x7f6ef0153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:25.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:25.840+0000 7f6ef5000640 1 -- 172.21.15.32:0/647868431 >> 172.21.15.32:0/647868431 conn(0x7f6ef00b3100 msgr2=0x7f6ef015d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:25.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:25.840+0000 7f6ef5000640 1 -- 172.21.15.32:0/647868431 shutdown_connections 2024-03-19T06:22:25.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:25.840+0000 7f6ef5000640 1 -- 172.21.15.32:0/647868431 wait complete. 2024-03-19T06:22:25.861 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2024-03-19T06:22:26.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd622600640 1 Processor -- start 2024-03-19T06:22:26.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd622600640 1 -- start start 2024-03-19T06:22:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd622600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd61c06ad40 0x7fd61c06b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd622600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61c06b660 con 0x7fd61c06eed0 2024-03-19T06:22:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd622600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61c0cc290 con 0x7fd61c06e320 2024-03-19T06:22:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd622600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61c0cd420 con 0x7fd61c06ad40 2024-03-19T06:22:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd613e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd61c06eed0 0x7fd61c0ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58834/0 (socket says 172.21.15.32:58834) 2024-03-19T06:22:26.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd613e00640 1 -- 172.21.15.32:0/3134812975 learned_addr learned my addr 172.21.15.32:0/3134812975 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:26.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd61b400640 1 --2- 172.21.15.32:0/3134812975 >> v2:172.21.15.171:3300/0 conn(0x7fd61c06ad40 0x7fd61c06b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:26.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd61aa00640 1 -- 172.21.15.32:0/3134812975 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815676233 0 0) 0x7fd61c06b660 con 0x7fd61c06eed0 2024-03-19T06:22:26.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd61aa00640 1 -- 172.21.15.32:0/3134812975 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd600003530 con 0x7fd61c06eed0 2024-03-19T06:22:26.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd61aa00640 1 -- 172.21.15.32:0/3134812975 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236570658 0 0) 0x7fd61c0cc290 con 0x7fd61c06e320 2024-03-19T06:22:26.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd61aa00640 1 -- 172.21.15.32:0/3134812975 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd61c06b660 con 0x7fd61c06e320 2024-03-19T06:22:26.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd61b400640 1 -- 172.21.15.32:0/3134812975 >> v1:172.21.15.171:6789/0 conn(0x7fd61c06e320 legacy=0x7fd61c15bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:26.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd61aa00640 1 -- 172.21.15.32:0/3134812975 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1897112244 0 0) 0x7fd600003530 con 0x7fd61c06eed0 2024-03-19T06:22:26.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd61b400640 1 -- 172.21.15.32:0/3134812975 >> v1:172.21.15.32:6789/0 conn(0x7fd61c06eed0 legacy=0x7fd61c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:26.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd61b400640 1 -- 172.21.15.32:0/3134812975 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c0cc570 con 0x7fd61c06ad40 2024-03-19T06:22:26.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd61b400640 1 --2- 172.21.15.32:0/3134812975 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd61c06ad40 0x7fd61c06b120 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0097c0 tx=0x7fd60c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26784b8e2d702bce server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:26.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd61aa00640 1 -- 172.21.15.32:0/3134812975 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0b0070 con 0x7fd61c06ad40 2024-03-19T06:22:26.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd61aa00640 1 -- 172.21.15.32:0/3134812975 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c0ab600 con 0x7fd61c06ad40 2024-03-19T06:22:26.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.020+0000 7fd61aa00640 1 -- 172.21.15.32:0/3134812975 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0ab9d0 con 0x7fd61c06ad40 2024-03-19T06:22:26.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 -- 172.21.15.32:0/3134812975 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd61c06ad40 msgr2=0x7fd61c06b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:26.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 --2- 172.21.15.32:0/3134812975 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd61c06ad40 0x7fd61c06b120 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0097c0 tx=0x7fd60c01c410 comp rx=0 tx=0).stop 2024-03-19T06:22:26.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 -- 172.21.15.32:0/3134812975 shutdown_connections 2024-03-19T06:22:26.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 --2- 172.21.15.32:0/3134812975 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd61c06ad40 0x7fd61c06b120 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:26.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 -- 172.21.15.32:0/3134812975 >> 172.21.15.32:0/3134812975 conn(0x7fd61c0b1590 msgr2=0x7fd61c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:26.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 -- 172.21.15.32:0/3134812975 shutdown_connections 2024-03-19T06:22:26.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 -- 172.21.15.32:0/3134812975 wait complete. 2024-03-19T06:22:26.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 Processor -- start 2024-03-19T06:22:26.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 -- start start 2024-03-19T06:22:26.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd61c06ad40 0x7fd61c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:26.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd61c06e320 0x7fd61c0ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:26.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd61c06eed0 0x7fd61c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:26.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c169d30 con 0x7fd61c06e320 2024-03-19T06:22:26.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c15c980 con 0x7fd61c06ad40 2024-03-19T06:22:26.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c169eb0 con 0x7fd61c06eed0 2024-03-19T06:22:26.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd613e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd61c06e320 0x7fd61c0ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:26.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd613e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd61c06e320 0x7fd61c0ae600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59874/0 (socket says 172.21.15.32:59874) 2024-03-19T06:22:26.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd613e00640 1 -- 172.21.15.32:0/3044210836 learned_addr learned my addr 172.21.15.32:0/3044210836 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:26.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd61b400640 1 --2- 172.21.15.32:0/3044210836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd61c06ad40 0x7fd61c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:26.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd61be00640 1 --2- 172.21.15.32:0/3044210836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd61c06eed0 0x7fd61c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:26.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd613e00640 1 -- 172.21.15.32:0/3044210836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd61c06eed0 msgr2=0x7fd61c1555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:26.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd613e00640 1 --2- 172.21.15.32:0/3044210836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd61c06eed0 0x7fd61c1555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:26.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd613e00640 1 -- 172.21.15.32:0/3044210836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd61c06ad40 msgr2=0x7fd61c15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:26.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd613e00640 1 --2- 172.21.15.32:0/3044210836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd61c06ad40 0x7fd61c15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:26.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd613e00640 1 -- 172.21.15.32:0/3044210836 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c15a800 con 0x7fd61c06e320 2024-03-19T06:22:26.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd61b400640 1 --2- 172.21.15.32:0/3044210836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd61c06ad40 0x7fd61c15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:26.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd613e00640 1 --2- 172.21.15.32:0/3044210836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd61c06e320 0x7fd61c0ae600 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c450 tx=0x7fd60400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:26.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd613400640 1 -- 172.21.15.32:0/3044210836 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd604017070 con 0x7fd61c06e320 2024-03-19T06:22:26.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd613400640 1 -- 172.21.15.32:0/3044210836 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd604005cf0 con 0x7fd61c06e320 2024-03-19T06:22:26.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd613400640 1 -- 172.21.15.32:0/3044210836 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6040072b0 con 0x7fd61c06e320 2024-03-19T06:22:26.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 -- 172.21.15.32:0/3044210836 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61c139ee0 con 0x7fd61c06e320 2024-03-19T06:22:26.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 -- 172.21.15.32:0/3044210836 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61c13a4a0 con 0x7fd61c06e320 2024-03-19T06:22:26.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd622600640 1 -- 172.21.15.32:0/3044210836 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61c0749e0 con 0x7fd61c06e320 2024-03-19T06:22:26.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd613400640 1 -- 172.21.15.32:0/3044210836 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd60401a070 con 0x7fd61c06e320 2024-03-19T06:22:26.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd613400640 1 --2- 172.21.15.32:0/3044210836 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd5f8067660 0x7fd5f8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:26.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd613400640 1 -- 172.21.15.32:0/3044210836 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6072+0+0 (secure 0 0 0) 0x7fd604084eb0 con 0x7fd61c06e320 2024-03-19T06:22:26.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.028+0000 7fd61b400640 1 --2- 172.21.15.32:0/3044210836 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd5f8067660 0x7fd5f8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:26.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.032+0000 7fd61b400640 1 --2- 172.21.15.32:0/3044210836 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd5f8067660 0x7fd5f8069b20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0ad000 tx=0x7fd60c0a4f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:26.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.036+0000 7fd613400640 1 -- 172.21.15.32:0/3044210836 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fd604055920 con 0x7fd61c06e320 2024-03-19T06:22:26.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.232+0000 7fd622600640 1 -- 172.21.15.32:0/3044210836 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) v1 -- 0x7fd61c071940 con 0x7fd61c06e320 2024-03-19T06:22:26.841 INFO:teuthology.orchestra.run.smithi032.stderr:added data pool 6 to fsmap 2024-03-19T06:22:26.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.848+0000 7fd613400640 1 -- 172.21.15.32:0/3044210836 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 6 to fsmap v18) v1 ==== 131+0+0 (secure 0 0 0) 0x7fd604055220 con 0x7fd61c06e320 2024-03-19T06:22:26.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.852+0000 7fd622600640 1 -- 172.21.15.32:0/3044210836 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd5f8067660 msgr2=0x7fd5f8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:26.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.852+0000 7fd622600640 1 --2- 172.21.15.32:0/3044210836 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd5f8067660 0x7fd5f8069b20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0ad000 tx=0x7fd60c0a4f90 comp rx=0 tx=0).stop 2024-03-19T06:22:26.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.852+0000 7fd622600640 1 -- 172.21.15.32:0/3044210836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd61c06e320 msgr2=0x7fd61c0ae600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:26.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.852+0000 7fd622600640 1 --2- 172.21.15.32:0/3044210836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd61c06e320 0x7fd61c0ae600 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c450 tx=0x7fd60400c910 comp rx=0 tx=0).stop 2024-03-19T06:22:26.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.856+0000 7fd622600640 1 -- 172.21.15.32:0/3044210836 shutdown_connections 2024-03-19T06:22:26.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.856+0000 7fd622600640 1 --2- 172.21.15.32:0/3044210836 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd5f8067660 0x7fd5f8069b20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:26.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.856+0000 7fd622600640 1 --2- 172.21.15.32:0/3044210836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd61c06eed0 0x7fd61c1555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:26.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.856+0000 7fd622600640 1 --2- 172.21.15.32:0/3044210836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd61c06e320 0x7fd61c0ae600 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:26.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.856+0000 7fd622600640 1 --2- 172.21.15.32:0/3044210836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd61c06ad40 0x7fd61c15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:26.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.856+0000 7fd622600640 1 -- 172.21.15.32:0/3044210836 >> 172.21.15.32:0/3044210836 conn(0x7fd61c0b1590 msgr2=0x7fd61c0cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:26.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.856+0000 7fd622600640 1 -- 172.21.15.32:0/3044210836 shutdown_connections 2024-03-19T06:22:26.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:26.856+0000 7fd622600640 1 -- 172.21.15.32:0/3044210836 wait complete. 2024-03-19T06:22:26.873 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:22:27.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd96b600640 1 Processor -- start 2024-03-19T06:22:27.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd96b600640 1 -- start start 2024-03-19T06:22:27.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd96b600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9640cf1c0 0x7fd96415ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd96b600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9640cf650 con 0x7fd9640ced40 2024-03-19T06:22:27.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd96b600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9640cc140 con 0x7fd96415a980 2024-03-19T06:22:27.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd96b600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9640ce2f0 con 0x7fd9640cf1c0 2024-03-19T06:22:27.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd95be00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd9640ced40 0x7fd96415e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58844/0 (socket says 172.21.15.32:58844) 2024-03-19T06:22:27.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd95be00640 1 -- 172.21.15.32:0/1974445676 learned_addr learned my addr 172.21.15.32:0/1974445676 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:27.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd969600640 1 --2- 172.21.15.32:0/1974445676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9640cf1c0 0x7fd96415ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd963e00640 1 -- 172.21.15.32:0/1974445676 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639435436 0 0) 0x7fd9640cf650 con 0x7fd9640ced40 2024-03-19T06:22:27.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd963e00640 1 -- 172.21.15.32:0/1974445676 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd948005740 con 0x7fd9640ced40 2024-03-19T06:22:27.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd963e00640 1 -- 172.21.15.32:0/1974445676 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482917852 0 0) 0x7fd9640cc140 con 0x7fd96415a980 2024-03-19T06:22:27.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd963e00640 1 -- 172.21.15.32:0/1974445676 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9640cf650 con 0x7fd96415a980 2024-03-19T06:22:27.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd969600640 1 -- 172.21.15.32:0/1974445676 >> v1:172.21.15.171:6789/0 conn(0x7fd96415a980 legacy=0x7fd96406e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd969600640 1 -- 172.21.15.32:0/1974445676 >> v1:172.21.15.32:6789/0 conn(0x7fd9640ced40 legacy=0x7fd96415e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd969600640 1 -- 172.21.15.32:0/1974445676 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9640cc420 con 0x7fd9640cf1c0 2024-03-19T06:22:27.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd969600640 1 --2- 172.21.15.32:0/1974445676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9640cf1c0 0x7fd96415ec10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009dc0 tx=0x7fd95c01c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f42cc706fecde99f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:27.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd963e00640 1 -- 172.21.15.32:0/1974445676 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c0b2070 con 0x7fd9640cf1c0 2024-03-19T06:22:27.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd963e00640 1 -- 172.21.15.32:0/1974445676 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c0a5890 con 0x7fd9640cf1c0 2024-03-19T06:22:27.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd963e00640 1 -- 172.21.15.32:0/1974445676 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c0a5c60 con 0x7fd9640cf1c0 2024-03-19T06:22:27.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd96b600640 1 -- 172.21.15.32:0/1974445676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9640cf1c0 msgr2=0x7fd96415ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd96b600640 1 --2- 172.21.15.32:0/1974445676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9640cf1c0 0x7fd96415ec10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009dc0 tx=0x7fd95c01c8d0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd96b600640 1 -- 172.21.15.32:0/1974445676 shutdown_connections 2024-03-19T06:22:27.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd96b600640 1 --2- 172.21.15.32:0/1974445676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9640cf1c0 0x7fd96415ec10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd96b600640 1 -- 172.21.15.32:0/1974445676 >> 172.21.15.32:0/1974445676 conn(0x7fd9640b2250 msgr2=0x7fd9640b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:27.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd96b600640 1 -- 172.21.15.32:0/1974445676 shutdown_connections 2024-03-19T06:22:27.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.028+0000 7fd96b600640 1 -- 172.21.15.32:0/1974445676 wait complete. 2024-03-19T06:22:27.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd96b600640 1 Processor -- start 2024-03-19T06:22:27.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd96b600640 1 -- start start 2024-03-19T06:22:27.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd96b600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9640ced40 0x7fd964158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd96b600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9640cf1c0 0x7fd964157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd96b600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd96415a980 0x7fd9641560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd96b600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9640b30b0 con 0x7fd96415a980 2024-03-19T06:22:27.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd96b600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9640b2f30 con 0x7fd9640ced40 2024-03-19T06:22:27.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd96b600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96406ec10 con 0x7fd9640cf1c0 2024-03-19T06:22:27.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd969600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd96415a980 0x7fd9641560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd969600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd96415a980 0x7fd9641560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59882/0 (socket says 172.21.15.32:59882) 2024-03-19T06:22:27.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd969600640 1 -- 172.21.15.32:0/3467148786 learned_addr learned my addr 172.21.15.32:0/3467148786 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:27.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd95be00640 1 --2- 172.21.15.32:0/3467148786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9640cf1c0 0x7fd964157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd968c00640 1 --2- 172.21.15.32:0/3467148786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9640ced40 0x7fd964158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd969600640 1 -- 172.21.15.32:0/3467148786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9640cf1c0 msgr2=0x7fd964157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd969600640 1 --2- 172.21.15.32:0/3467148786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9640cf1c0 0x7fd964157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd969600640 1 -- 172.21.15.32:0/3467148786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9640ced40 msgr2=0x7fd964158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd969600640 1 --2- 172.21.15.32:0/3467148786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9640ced40 0x7fd964158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd969600640 1 -- 172.21.15.32:0/3467148786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9640c4230 con 0x7fd96415a980 2024-03-19T06:22:27.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd968c00640 1 --2- 172.21.15.32:0/3467148786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9640ced40 0x7fd964158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:27.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd969600640 1 --2- 172.21.15.32:0/3467148786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd96415a980 0x7fd9641560e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0b0040 tx=0x7fd95c019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:27.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd961600640 1 -- 172.21.15.32:0/3467148786 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c0b2050 con 0x7fd96415a980 2024-03-19T06:22:27.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd961600640 1 -- 172.21.15.32:0/3467148786 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c0be070 con 0x7fd96415a980 2024-03-19T06:22:27.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd96b600640 1 -- 172.21.15.32:0/3467148786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9640c4510 con 0x7fd96415a980 2024-03-19T06:22:27.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd961600640 1 -- 172.21.15.32:0/3467148786 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c0ad870 con 0x7fd96415a980 2024-03-19T06:22:27.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd96b600640 1 -- 172.21.15.32:0/3467148786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9640c4ad0 con 0x7fd96415a980 2024-03-19T06:22:27.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd96b600640 1 -- 172.21.15.32:0/3467148786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9640749e0 con 0x7fd96415a980 2024-03-19T06:22:27.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd961600640 1 -- 172.21.15.32:0/3467148786 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd95c0ada10 con 0x7fd96415a980 2024-03-19T06:22:27.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd961600640 1 --2- 172.21.15.32:0/3467148786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd940067690 0x7fd940069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd961600640 1 -- 172.21.15.32:0/3467148786 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fd95c120b40 con 0x7fd96415a980 2024-03-19T06:22:27.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd968c00640 1 --2- 172.21.15.32:0/3467148786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd940067690 0x7fd940069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.036+0000 7fd968c00640 1 --2- 172.21.15.32:0/3467148786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd940067690 0x7fd940069b50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd9540011f0 tx=0x7fd954009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:27.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.040+0000 7fd961600640 1 -- 172.21.15.32:0/3467148786 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fd95c016580 con 0x7fd96415a980 2024-03-19T06:22:27.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.244+0000 7fd96b600640 1 -- 172.21.15.32:0/3467148786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9640b66a0 con 0x7fd96415a980 2024-03-19T06:22:27.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.244+0000 7fd961600640 1 -- 172.21.15.32:0/3467148786 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fd95c0f16b0 con 0x7fd96415a980 2024-03-19T06:22:27.231 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:27.231 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3394778234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3394778234},{"type":"v1","addr":"172.21.15.171:6836","nonce":3394778234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2000291327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2000291327},{"type":"v1","addr":"172.21.15.171:6837","nonce":2000291327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/4039299860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":4039299860},{"type":"v1","addr":"172.21.15.32:6833","nonce":4039299860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:22:12.167128+0000","modified":"2024-03-19T06:22:26.236754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/2680502611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":2680502611},{"type":"v1","addr":"172.21.15.32:6835","nonce":2680502611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-19T06:22:27.232 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 18 2024-03-19T06:22:27.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.244+0000 7fd96b600640 1 -- 172.21.15.32:0/3467148786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd940067690 msgr2=0x7fd940069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.244+0000 7fd96b600640 1 --2- 172.21.15.32:0/3467148786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd940067690 0x7fd940069b50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd9540011f0 tx=0x7fd954009040 comp rx=0 tx=0).stop 2024-03-19T06:22:27.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.244+0000 7fd96b600640 1 -- 172.21.15.32:0/3467148786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd96415a980 msgr2=0x7fd9641560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.244+0000 7fd96b600640 1 --2- 172.21.15.32:0/3467148786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd96415a980 0x7fd9641560e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0b0040 tx=0x7fd95c019670 comp rx=0 tx=0).stop 2024-03-19T06:22:27.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.244+0000 7fd96b600640 1 -- 172.21.15.32:0/3467148786 shutdown_connections 2024-03-19T06:22:27.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.244+0000 7fd96b600640 1 --2- 172.21.15.32:0/3467148786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd940067690 0x7fd940069b50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.244+0000 7fd96b600640 1 --2- 172.21.15.32:0/3467148786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd96415a980 0x7fd9641560e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.244+0000 7fd96b600640 1 --2- 172.21.15.32:0/3467148786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9640cf1c0 0x7fd964157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.244+0000 7fd96b600640 1 --2- 172.21.15.32:0/3467148786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9640ced40 0x7fd964158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.244+0000 7fd96b600640 1 -- 172.21.15.32:0/3467148786 >> 172.21.15.32:0/3467148786 conn(0x7fd9640b2250 msgr2=0x7fd9640cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:27.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.244+0000 7fd96b600640 1 -- 172.21.15.32:0/3467148786 shutdown_connections 2024-03-19T06:22:27.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.244+0000 7fd96b600640 1 -- 172.21.15.32:0/3467148786 wait complete. 2024-03-19T06:22:27.252 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:22:27.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.404+0000 7f9f13e00640 1 Processor -- start 2024-03-19T06:22:27.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.404+0000 7f9f13e00640 1 -- start start 2024-03-19T06:22:27.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f13e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9f0c0ae0b0 0x7f9f0c0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f13e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f0c15dff0 0x7f9f0c06bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f13e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9f0c06c290 0x7f9f0c154130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f13e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0c15f1b0 con 0x7f9f0c0ae0b0 2024-03-19T06:22:27.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f13e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0c15e520 con 0x7f9f0c06c290 2024-03-19T06:22:27.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f13e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c15e800 con 0x7f9f0c15dff0 2024-03-19T06:22:27.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f11400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9f0c0ae0b0 0x7f9f0c0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f11400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9f0c0ae0b0 0x7f9f0c0acdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59894/0 (socket says 172.21.15.32:59894) 2024-03-19T06:22:27.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f11400640 1 -- 172.21.15.32:0/2832091572 learned_addr learned my addr 172.21.15.32:0/2832091572 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:27.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f11e00640 1 --2- 172.21.15.32:0/2832091572 >> v2:172.21.15.171:3300/0 conn(0x7f9f0c06c290 0x7f9f0c154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f10a00640 1 --2- 172.21.15.32:0/2832091572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f0c15dff0 0x7f9f0c06bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f11400640 1 -- 172.21.15.32:0/2832091572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f0c15dff0 msgr2=0x7f9f0c06bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:27.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f11400640 1 --2- 172.21.15.32:0/2832091572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f0c15dff0 0x7f9f0c06bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f11400640 1 -- 172.21.15.32:0/2832091572 >> v2:172.21.15.171:3300/0 conn(0x7f9f0c06c290 msgr2=0x7f9f0c154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:27.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f11400640 1 --2- 172.21.15.32:0/2832091572 >> v2:172.21.15.171:3300/0 conn(0x7f9f0c06c290 0x7f9f0c154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f11400640 1 -- 172.21.15.32:0/2832091572 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c15eae0 con 0x7f9f0c0ae0b0 2024-03-19T06:22:27.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f11e00640 1 --2- 172.21.15.32:0/2832091572 >> v2:172.21.15.171:3300/0 conn(0x7f9f0c06c290 0x7f9f0c154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:27.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.408+0000 7f9f10a00640 1 --2- 172.21.15.32:0/2832091572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f0c15dff0 0x7f9f0c06bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:27.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.412+0000 7f9f11400640 1 --2- 172.21.15.32:0/2832091572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f0c0ae0b0 0x7f9f0c0acdb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c15e430 tx=0x7f9f0001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1e53741b7a83b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:27.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.412+0000 7f9f0be00640 1 -- 172.21.15.32:0/2832091572 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f000b0070 con 0x7f9f0c0ae0b0 2024-03-19T06:22:27.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.412+0000 7f9f0be00640 1 -- 172.21.15.32:0/2832091572 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f000ab600 con 0x7f9f0c0ae0b0 2024-03-19T06:22:27.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.412+0000 7f9f0be00640 1 -- 172.21.15.32:0/2832091572 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f000ab9d0 con 0x7f9f0c0ae0b0 2024-03-19T06:22:27.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.412+0000 7f9f13e00640 1 -- 172.21.15.32:0/2832091572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f0c0ae0b0 msgr2=0x7f9f0c0acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.412+0000 7f9f13e00640 1 --2- 172.21.15.32:0/2832091572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f0c0ae0b0 0x7f9f0c0acdb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c15e430 tx=0x7f9f0001c520 comp rx=0 tx=0).stop 2024-03-19T06:22:27.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.412+0000 7f9f13e00640 1 -- 172.21.15.32:0/2832091572 shutdown_connections 2024-03-19T06:22:27.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.412+0000 7f9f13e00640 1 --2- 172.21.15.32:0/2832091572 >> v2:172.21.15.171:3300/0 conn(0x7f9f0c06c290 0x7f9f0c154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.412+0000 7f9f13e00640 1 --2- 172.21.15.32:0/2832091572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f0c15dff0 0x7f9f0c06bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.412+0000 7f9f13e00640 1 --2- 172.21.15.32:0/2832091572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f0c0ae0b0 0x7f9f0c0acdb0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.412+0000 7f9f13e00640 1 -- 172.21.15.32:0/2832091572 >> 172.21.15.32:0/2832091572 conn(0x7f9f0c071c50 msgr2=0x7f9f0c072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:27.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.412+0000 7f9f13e00640 1 -- 172.21.15.32:0/2832091572 shutdown_connections 2024-03-19T06:22:27.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.412+0000 7f9f13e00640 1 -- 172.21.15.32:0/2832091572 wait complete. 2024-03-19T06:22:27.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.412+0000 7f9f13e00640 1 Processor -- start 2024-03-19T06:22:27.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.412+0000 7f9f13e00640 1 -- start start 2024-03-19T06:22:27.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f13e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f0c06c290 0x7f9f0c14b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f13e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f0c0ae0b0 0x7f9f0c14bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f13e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f0c15dff0 0x7f9f0c151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f13e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c1615e0 con 0x7f9f0c06c290 2024-03-19T06:22:27.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f13e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c06c6a0 con 0x7f9f0c0ae0b0 2024-03-19T06:22:27.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f13e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c161760 con 0x7f9f0c15dff0 2024-03-19T06:22:27.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f11400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f0c06c290 0x7f9f0c14b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f11400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f0c06c290 0x7f9f0c14b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59902/0 (socket says 172.21.15.32:59902) 2024-03-19T06:22:27.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f11400640 1 -- 172.21.15.32:0/506135050 learned_addr learned my addr 172.21.15.32:0/506135050 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:27.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f11e00640 1 --2- 172.21.15.32:0/506135050 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f0c15dff0 0x7f9f0c151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f10a00640 1 --2- 172.21.15.32:0/506135050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f0c0ae0b0 0x7f9f0c14bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f11400640 1 -- 172.21.15.32:0/506135050 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f0c15dff0 msgr2=0x7f9f0c151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f11400640 1 --2- 172.21.15.32:0/506135050 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f0c15dff0 0x7f9f0c151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f11400640 1 -- 172.21.15.32:0/506135050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f0c0ae0b0 msgr2=0x7f9f0c14bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f11400640 1 --2- 172.21.15.32:0/506135050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f0c0ae0b0 0x7f9f0c14bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f11400640 1 -- 172.21.15.32:0/506135050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c153490 con 0x7f9f0c06c290 2024-03-19T06:22:27.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f11400640 1 --2- 172.21.15.32:0/506135050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f0c06c290 0x7f9f0c14b5a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9f000ae040 tx=0x7f9f0001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:27.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f09600640 1 -- 172.21.15.32:0/506135050 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f000ba020 con 0x7f9f0c06c290 2024-03-19T06:22:27.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f09600640 1 -- 172.21.15.32:0/506135050 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f000b6640 con 0x7f9f0c06c290 2024-03-19T06:22:27.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f09600640 1 -- 172.21.15.32:0/506135050 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f000b0040 con 0x7f9f0c06c290 2024-03-19T06:22:27.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f13e00640 1 -- 172.21.15.32:0/506135050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c153770 con 0x7f9f0c06c290 2024-03-19T06:22:27.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f13e00640 1 -- 172.21.15.32:0/506135050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c153140 con 0x7f9f0c06c290 2024-03-19T06:22:27.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f13e00640 1 -- 172.21.15.32:0/506135050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0c0749e0 con 0x7f9f0c06c290 2024-03-19T06:22:27.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.416+0000 7f9f09600640 1 -- 172.21.15.32:0/506135050 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9f000bd020 con 0x7f9f0c06c290 2024-03-19T06:22:27.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.420+0000 7f9f09600640 1 --2- 172.21.15.32:0/506135050 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9eec067660 0x7f9eec069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.420+0000 7f9f09600640 1 -- 172.21.15.32:0/506135050 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f9f0011fcd0 con 0x7f9f0c06c290 2024-03-19T06:22:27.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.420+0000 7f9f10a00640 1 --2- 172.21.15.32:0/506135050 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9eec067660 0x7f9eec069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.420+0000 7f9f10a00640 1 --2- 172.21.15.32:0/506135050 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9eec067660 0x7f9eec069b20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c133c50 tx=0x7f9ef8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:27.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.424+0000 7f9f09600640 1 -- 172.21.15.32:0/506135050 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f9f000c4030 con 0x7f9f0c06c290 2024-03-19T06:22:27.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.584+0000 7f9f13e00640 1 -- 172.21.15.32:0/506135050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f0c0b4570 con 0x7f9f0c06c290 2024-03-19T06:22:27.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.588+0000 7f9f09600640 1 -- 172.21.15.32:0/506135050 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18506 (secure 0 0 0) 0x7f9f00016110 con 0x7f9f0c06c290 2024-03-19T06:22:27.575 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:27.575 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":37,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:22:26.236535+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:22:09.983589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-19T06:22:11.172289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-19T06:22:25.205334+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:22:27.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.588+0000 7f9f13e00640 1 -- 172.21.15.32:0/506135050 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9eec067660 msgr2=0x7f9eec069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.588+0000 7f9f13e00640 1 --2- 172.21.15.32:0/506135050 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9eec067660 0x7f9eec069b20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c133c50 tx=0x7f9ef8008040 comp rx=0 tx=0).stop 2024-03-19T06:22:27.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.588+0000 7f9f13e00640 1 -- 172.21.15.32:0/506135050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f0c06c290 msgr2=0x7f9f0c14b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.588+0000 7f9f13e00640 1 --2- 172.21.15.32:0/506135050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f0c06c290 0x7f9f0c14b5a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9f000ae040 tx=0x7f9f0001ad60 comp rx=0 tx=0).stop 2024-03-19T06:22:27.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.588+0000 7f9f13e00640 1 -- 172.21.15.32:0/506135050 shutdown_connections 2024-03-19T06:22:27.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.588+0000 7f9f13e00640 1 --2- 172.21.15.32:0/506135050 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9eec067660 0x7f9eec069b20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.588+0000 7f9f13e00640 1 --2- 172.21.15.32:0/506135050 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f0c15dff0 0x7f9f0c151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.588+0000 7f9f13e00640 1 --2- 172.21.15.32:0/506135050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f0c0ae0b0 0x7f9f0c14bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.588+0000 7f9f13e00640 1 --2- 172.21.15.32:0/506135050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f0c06c290 0x7f9f0c14b5a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.588+0000 7f9f13e00640 1 -- 172.21.15.32:0/506135050 >> 172.21.15.32:0/506135050 conn(0x7f9f0c071c50 msgr2=0x7f9f0c14d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:27.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.588+0000 7f9f13e00640 1 -- 172.21.15.32:0/506135050 shutdown_connections 2024-03-19T06:22:27.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.588+0000 7f9f13e00640 1 -- 172.21.15.32:0/506135050 wait complete. 2024-03-19T06:22:27.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:27.597 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch layoutfile) 2024-03-19T06:22:27.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:27.612 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir layoutdir) 2024-03-19T06:22:27.666 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2024-03-19T06:22:27.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.872+0000 7f25bfe00640 1 Processor -- start 2024-03-19T06:22:27.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.872+0000 7f25bfe00640 1 -- start start 2024-03-19T06:22:27.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.876+0000 7f25bfe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b80aea70 0x7f25b806f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.876+0000 7f25bfe00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b80af2d0 con 0x7f25b815a840 2024-03-19T06:22:27.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.876+0000 7f25bfe00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b815eea0 con 0x7f25b806b450 2024-03-19T06:22:27.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.876+0000 7f25bfe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80cdc20 con 0x7f25b80aea70 2024-03-19T06:22:27.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.876+0000 7f25bd400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f25b815a840 0x7f25b806ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58860/0 (socket says 172.21.15.32:58860) 2024-03-19T06:22:27.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.876+0000 7f25bd400640 1 -- 172.21.15.32:0/1214490832 learned_addr learned my addr 172.21.15.32:0/1214490832 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:27.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.876+0000 7f25bde00640 1 --2- 172.21.15.32:0/1214490832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b80aea70 0x7f25b806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.876+0000 7f25b7e00640 1 -- 172.21.15.32:0/1214490832 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031063229 0 0) 0x7f25b80af2d0 con 0x7f25b815a840 2024-03-19T06:22:27.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.876+0000 7f25b7e00640 1 -- 172.21.15.32:0/1214490832 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25a0003530 con 0x7f25b815a840 2024-03-19T06:22:27.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.876+0000 7f25bde00640 1 -- 172.21.15.32:0/1214490832 >> v1:172.21.15.171:6789/0 conn(0x7f25b806b450 legacy=0x7f25b80ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.876+0000 7f25bde00640 1 -- 172.21.15.32:0/1214490832 >> v1:172.21.15.32:6789/0 conn(0x7f25b815a840 legacy=0x7f25b806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.876+0000 7f25bde00640 1 -- 172.21.15.32:0/1214490832 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b815f180 con 0x7f25b80aea70 2024-03-19T06:22:27.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.880+0000 7f25bde00640 1 --2- 172.21.15.32:0/1214490832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b80aea70 0x7f25b806f040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009dc0 tx=0x7f25b001c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40b7e9665199f277 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:27.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.880+0000 7f25b7e00640 1 -- 172.21.15.32:0/1214490832 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b00b2070 con 0x7f25b80aea70 2024-03-19T06:22:27.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.880+0000 7f25b7e00640 1 -- 172.21.15.32:0/1214490832 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b00a5950 con 0x7f25b80aea70 2024-03-19T06:22:27.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.880+0000 7f25b7e00640 1 -- 172.21.15.32:0/1214490832 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b00a5d20 con 0x7f25b80aea70 2024-03-19T06:22:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.880+0000 7f25bfe00640 1 -- 172.21.15.32:0/1214490832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b80aea70 msgr2=0x7f25b806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.880+0000 7f25bfe00640 1 --2- 172.21.15.32:0/1214490832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b80aea70 0x7f25b806f040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009dc0 tx=0x7f25b001c830 comp rx=0 tx=0).stop 2024-03-19T06:22:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.880+0000 7f25bfe00640 1 -- 172.21.15.32:0/1214490832 shutdown_connections 2024-03-19T06:22:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.880+0000 7f25bfe00640 1 --2- 172.21.15.32:0/1214490832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b80aea70 0x7f25b806f040 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.880+0000 7f25bfe00640 1 -- 172.21.15.32:0/1214490832 >> 172.21.15.32:0/1214490832 conn(0x7f25b80b1590 msgr2=0x7f25b80b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:27.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.880+0000 7f25bfe00640 1 -- 172.21.15.32:0/1214490832 shutdown_connections 2024-03-19T06:22:27.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.880+0000 7f25bfe00640 1 -- 172.21.15.32:0/1214490832 wait complete. 2024-03-19T06:22:27.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bfe00640 1 Processor -- start 2024-03-19T06:22:27.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bfe00640 1 -- start start 2024-03-19T06:22:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bfe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b806b450 0x7f25b8151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b80aea70 0x7f25b80ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bfe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25b815a840 0x7f25b80adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bfe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80cf150 con 0x7f25b80aea70 2024-03-19T06:22:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bfe00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80cefd0 con 0x7f25b815a840 2024-03-19T06:22:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bfe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80cf2d0 con 0x7f25b806b450 2024-03-19T06:22:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bca00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b80aea70 0x7f25b80ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bca00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b80aea70 0x7f25b80ad6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59916/0 (socket says 172.21.15.32:59916) 2024-03-19T06:22:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bca00640 1 -- 172.21.15.32:0/3566258776 learned_addr learned my addr 172.21.15.32:0/3566258776 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bde00640 1 --2- 172.21.15.32:0/3566258776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25b815a840 0x7f25b80adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bd400640 1 --2- 172.21.15.32:0/3566258776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b806b450 0x7f25b8151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bca00640 1 -- 172.21.15.32:0/3566258776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b806b450 msgr2=0x7f25b8151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bca00640 1 --2- 172.21.15.32:0/3566258776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b806b450 0x7f25b8151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bca00640 1 -- 172.21.15.32:0/3566258776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25b815a840 msgr2=0x7f25b80adbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bca00640 1 --2- 172.21.15.32:0/3566258776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25b815a840 0x7f25b80adbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bca00640 1 -- 172.21.15.32:0/3566258776 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b8147550 con 0x7f25b80aea70 2024-03-19T06:22:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bd400640 1 --2- 172.21.15.32:0/3566258776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b806b450 0x7f25b8151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bca00640 1 --2- 172.21.15.32:0/3566258776 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b80aea70 0x7f25b80ad6b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f25a400c3a0 tx=0x7f25a400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25b5600640 1 -- 172.21.15.32:0/3566258776 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40052d0 con 0x7f25b80aea70 2024-03-19T06:22:27.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25b5600640 1 -- 172.21.15.32:0/3566258776 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a4005470 con 0x7f25b80aea70 2024-03-19T06:22:27.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bfe00640 1 -- 172.21.15.32:0/3566258776 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b8147830 con 0x7f25b80aea70 2024-03-19T06:22:27.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25b5600640 1 -- 172.21.15.32:0/3566258776 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a4007260 con 0x7f25b80aea70 2024-03-19T06:22:27.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.884+0000 7f25bfe00640 1 -- 172.21.15.32:0/3566258776 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b8147df0 con 0x7f25b80aea70 2024-03-19T06:22:27.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.888+0000 7f25bfe00640 1 -- 172.21.15.32:0/3566258776 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b80749e0 con 0x7f25b80aea70 2024-03-19T06:22:27.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.888+0000 7f25b5600640 1 -- 172.21.15.32:0/3566258776 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f25a4007400 con 0x7f25b80aea70 2024-03-19T06:22:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.888+0000 7f25b5600640 1 --2- 172.21.15.32:0/3566258776 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2598067690 0x7f2598069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.888+0000 7f25b5600640 1 -- 172.21.15.32:0/3566258776 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f25a4084ec0 con 0x7f25b80aea70 2024-03-19T06:22:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.888+0000 7f25bd400640 1 --2- 172.21.15.32:0/3566258776 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2598067690 0x7f2598069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:27.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.888+0000 7f25bd400640 1 --2- 172.21.15.32:0/3566258776 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2598067690 0x7f2598069b50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0011f0 tx=0x7f25ac009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:27.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:27.892+0000 7f25b5600640 1 -- 172.21.15.32:0/3566258776 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f25a40552c0 con 0x7f25b80aea70 2024-03-19T06:22:28.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.116+0000 7f25bfe00640 1 -- 172.21.15.32:0/3566258776 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f25b80cd100 con 0x7f25b80aea70 2024-03-19T06:22:28.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.116+0000 7f25b5600640 1 -- 172.21.15.32:0/3566258776 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v12) v1 ==== 210+0+167 (secure 0 0 0) 0x7f25a4059360 con 0x7f25b80aea70 2024-03-19T06:22:28.105 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-03-19T06:22:28.106 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCWLvll4jsFMxAAr4PzH6Djodh2O01vGYgxKA== 2024-03-19T06:22:28.106 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow rw" 2024-03-19T06:22:28.106 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2024-03-19T06:22:28.106 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2024-03-19T06:22:28.106 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.0 2024-03-19T06:22:28.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.120+0000 7f25bfe00640 1 -- 172.21.15.32:0/3566258776 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2598067690 msgr2=0x7f2598069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:28.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.120+0000 7f25bfe00640 1 --2- 172.21.15.32:0/3566258776 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2598067690 0x7f2598069b50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0011f0 tx=0x7f25ac009040 comp rx=0 tx=0).stop 2024-03-19T06:22:28.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.120+0000 7f25bfe00640 1 -- 172.21.15.32:0/3566258776 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b80aea70 msgr2=0x7f25b80ad6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:28.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.120+0000 7f25bfe00640 1 --2- 172.21.15.32:0/3566258776 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b80aea70 0x7f25b80ad6b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f25a400c3a0 tx=0x7f25a400c860 comp rx=0 tx=0).stop 2024-03-19T06:22:28.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.120+0000 7f25bfe00640 1 -- 172.21.15.32:0/3566258776 shutdown_connections 2024-03-19T06:22:28.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.120+0000 7f25bfe00640 1 --2- 172.21.15.32:0/3566258776 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2598067690 0x7f2598069b50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.120+0000 7f25bfe00640 1 --2- 172.21.15.32:0/3566258776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25b815a840 0x7f25b80adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.120+0000 7f25bfe00640 1 --2- 172.21.15.32:0/3566258776 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b80aea70 0x7f25b80ad6b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.120+0000 7f25bfe00640 1 --2- 172.21.15.32:0/3566258776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b806b450 0x7f25b8151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.120+0000 7f25bfe00640 1 -- 172.21.15.32:0/3566258776 >> 172.21.15.32:0/3566258776 conn(0x7f25b80b1590 msgr2=0x7f25b80b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:28.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.120+0000 7f25bfe00640 1 -- 172.21.15.32:0/3566258776 shutdown_connections 2024-03-19T06:22:28.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.120+0000 7f25bfe00640 1 -- 172.21.15.32:0/3566258776 wait complete. 2024-03-19T06:22:28.127 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:22:28.127 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:22:28.137 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:22:28.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98cf200640 1 Processor -- start 2024-03-19T06:22:28.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98cf200640 1 -- start start 2024-03-19T06:22:28.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98cf200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98c815bb20 0x7f98c809a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:28.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98cf200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c815bf00 con 0x7f98c80cf460 2024-03-19T06:22:28.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98cf200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c80cc5d0 con 0x7f98c80cd390 2024-03-19T06:22:28.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98cf200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c80cc3a0 con 0x7f98c815bb20 2024-03-19T06:22:28.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98bfe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f98c80cf460 0x7f98c80c53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58876/0 (socket says 172.21.15.32:58876) 2024-03-19T06:22:28.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98bfe00640 1 -- 172.21.15.32:0/1446034365 learned_addr learned my addr 172.21.15.32:0/1446034365 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:28.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7e00640 1 --2- 172.21.15.32:0/1446034365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98c815bb20 0x7f98c809a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:28.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7400640 1 -- 172.21.15.32:0/1446034365 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002650003 0 0) 0x7f98c815bf00 con 0x7f98c80cf460 2024-03-19T06:22:28.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7400640 1 -- 172.21.15.32:0/1446034365 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98ac003530 con 0x7f98c80cf460 2024-03-19T06:22:28.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7400640 1 -- 172.21.15.32:0/1446034365 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2172314 0 0) 0x7f98ac003530 con 0x7f98c80cf460 2024-03-19T06:22:28.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7400640 1 -- 172.21.15.32:0/1446034365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98c815bb20 msgr2=0x7f98c809a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:28.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7400640 1 --2- 172.21.15.32:0/1446034365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98c815bb20 0x7f98c809a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7400640 1 -- 172.21.15.32:0/1446034365 >> v1:172.21.15.171:6789/0 conn(0x7f98c80cd390 legacy=0x7f98c80cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:28.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7400640 1 -- 172.21.15.32:0/1446034365 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c80cc8b0 con 0x7f98c80cf460 2024-03-19T06:22:28.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7400640 1 -- 172.21.15.32:0/1446034365 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f98b0001680 con 0x7f98c80cf460 2024-03-19T06:22:28.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7400640 1 -- 172.21.15.32:0/1446034365 >> v1:172.21.15.32:6789/0 conn(0x7f98c80cf460 legacy=0x7f98c80c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:28.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7400640 1 --2- 172.21.15.32:0/1446034365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98ac0039f0 0x7f98ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:28.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7400640 1 --2- 172.21.15.32:0/1446034365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98ac0043a0 0x7f98ac004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:28.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7400640 1 --2- 172.21.15.32:0/1446034365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98c815bb20 0x7f98ac0050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:28.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7400640 1 -- 172.21.15.32:0/1446034365 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac00b9d0 con 0x7f98ac0043a0 2024-03-19T06:22:28.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7400640 1 -- 172.21.15.32:0/1446034365 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac00bb50 con 0x7f98ac0039f0 2024-03-19T06:22:28.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7400640 1 -- 172.21.15.32:0/1446034365 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac00bd50 con 0x7f98c815bb20 2024-03-19T06:22:28.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98bfe00640 1 --2- 172.21.15.32:0/1446034365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98ac0043a0 0x7f98ac004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:28.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98c7e00640 1 --2- 172.21.15.32:0/1446034365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98ac0039f0 0x7f98ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:28.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98cd200640 1 --2- 172.21.15.32:0/1446034365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98c815bb20 0x7f98ac0050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:28.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98bfe00640 1 -- 172.21.15.32:0/1446034365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98c815bb20 msgr2=0x7f98ac0050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:28.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98bfe00640 1 --2- 172.21.15.32:0/1446034365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98c815bb20 0x7f98ac0050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98bfe00640 1 -- 172.21.15.32:0/1446034365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98ac0039f0 msgr2=0x7f98ac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:28.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98bfe00640 1 --2- 172.21.15.32:0/1446034365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98ac0039f0 0x7f98ac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.332+0000 7f98bfe00640 1 -- 172.21.15.32:0/1446034365 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac003530 con 0x7f98ac0043a0 2024-03-19T06:22:28.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.336+0000 7f98bfe00640 1 --2- 172.21.15.32:0/1446034365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98ac0043a0 0x7f98ac004870 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f98b000c190 tx=0x7f98b001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b1ace28ed74fbc server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:28.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.336+0000 7f98c7400640 1 -- 172.21.15.32:0/1446034365 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b0007cd0 con 0x7f98ac0043a0 2024-03-19T06:22:28.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.336+0000 7f98c7400640 1 -- 172.21.15.32:0/1446034365 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b00a9070 con 0x7f98ac0043a0 2024-03-19T06:22:28.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.336+0000 7f98c7400640 1 -- 172.21.15.32:0/1446034365 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b0005d20 con 0x7f98ac0043a0 2024-03-19T06:22:28.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.336+0000 7f98cf200640 1 -- 172.21.15.32:0/1446034365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98ac0043a0 msgr2=0x7f98ac004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:28.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.336+0000 7f98cf200640 1 --2- 172.21.15.32:0/1446034365 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98ac0043a0 0x7f98ac004870 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f98b000c190 tx=0x7f98b001cc20 comp rx=0 tx=0).stop 2024-03-19T06:22:28.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.336+0000 7f98cd200640 1 -- 172.21.15.32:0/1446034365 reap_dead start 2024-03-19T06:22:28.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.336+0000 7f98cf200640 1 -- 172.21.15.32:0/1446034365 shutdown_connections 2024-03-19T06:22:28.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.336+0000 7f98cf200640 1 -- 172.21.15.32:0/1446034365 >> 172.21.15.32:0/1446034365 conn(0x7f98c80d1890 msgr2=0x7f98c80d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:28.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.336+0000 7f98cf200640 1 -- 172.21.15.32:0/1446034365 shutdown_connections 2024-03-19T06:22:28.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.336+0000 7f98cf200640 1 -- 172.21.15.32:0/1446034365 wait complete. 2024-03-19T06:22:28.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98cf200640 1 Processor -- start 2024-03-19T06:22:28.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98cf200640 1 -- start start 2024-03-19T06:22:28.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98cf200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98ac0043a0 0x7f98c806d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:28.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98cf200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98c8158c20 0x7f98c80b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:28.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98cf200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98c80b5840 0x7f98c8156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:28.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98cf200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c80d0580 con 0x7f98ac0043a0 2024-03-19T06:22:28.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98cf200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c80cf860 con 0x7f98c8158c20 2024-03-19T06:22:28.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98cf200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c80d0700 con 0x7f98c80b5840 2024-03-19T06:22:28.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98c7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98ac0043a0 0x7f98c806d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:28.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98c7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98ac0043a0 0x7f98c806d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59948/0 (socket says 172.21.15.32:59948) 2024-03-19T06:22:28.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98c7e00640 1 -- 172.21.15.32:0/3730787583 learned_addr learned my addr 172.21.15.32:0/3730787583 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:28.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98c7e00640 1 -- 172.21.15.32:0/3730787583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98c80b5840 msgr2=0x7f98c8156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:28.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98cd200640 1 --2- 172.21.15.32:0/3730787583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98c80b5840 0x7f98c8156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:28.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98bfe00640 1 --2- 172.21.15.32:0/3730787583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98c8158c20 0x7f98c80b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:28.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98c7e00640 1 --2- 172.21.15.32:0/3730787583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98c80b5840 0x7f98c8156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98c7e00640 1 -- 172.21.15.32:0/3730787583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98c8158c20 msgr2=0x7f98c80b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:28.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98c7e00640 1 --2- 172.21.15.32:0/3730787583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98c8158c20 0x7f98c80b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98c7e00640 1 -- 172.21.15.32:0/3730787583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c806ca70 con 0x7f98ac0043a0 2024-03-19T06:22:28.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98cd200640 1 --2- 172.21.15.32:0/3730787583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98c80b5840 0x7f98c8156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:28.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98bfe00640 1 --2- 172.21.15.32:0/3730787583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98c8158c20 0x7f98c80b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:28.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98c7e00640 1 --2- 172.21.15.32:0/3730787583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98ac0043a0 0x7f98c806d830 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f98b80119d0 tx=0x7f98b8011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:28.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98c4c00640 1 -- 172.21.15.32:0/3730787583 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b800fb50 con 0x7f98ac0043a0 2024-03-19T06:22:28.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98c4c00640 1 -- 172.21.15.32:0/3730787583 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b800fcf0 con 0x7f98ac0043a0 2024-03-19T06:22:28.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98cf200640 1 -- 172.21.15.32:0/3730787583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c806cd50 con 0x7f98ac0043a0 2024-03-19T06:22:28.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98c4c00640 1 -- 172.21.15.32:0/3730787583 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b800fea0 con 0x7f98ac0043a0 2024-03-19T06:22:28.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.340+0000 7f98cf200640 1 -- 172.21.15.32:0/3730787583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c806d310 con 0x7f98ac0043a0 2024-03-19T06:22:28.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.344+0000 7f98cf200640 1 -- 172.21.15.32:0/3730787583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c80749e0 con 0x7f98ac0043a0 2024-03-19T06:22:28.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.344+0000 7f98c4c00640 1 -- 172.21.15.32:0/3730787583 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f98b8012040 con 0x7f98ac0043a0 2024-03-19T06:22:28.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.344+0000 7f98c4c00640 1 --2- 172.21.15.32:0/3730787583 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f98a4067660 0x7f98a4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:28.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.344+0000 7f98c4c00640 1 -- 172.21.15.32:0/3730787583 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f98b80861e0 con 0x7f98ac0043a0 2024-03-19T06:22:28.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.344+0000 7f98bfe00640 1 --2- 172.21.15.32:0/3730787583 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f98a4067660 0x7f98a4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:28.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.344+0000 7f98bfe00640 1 --2- 172.21.15.32:0/3730787583 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f98a4067660 0x7f98a4069b20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f98b000c190 tx=0x7f98b00a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:28.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.348+0000 7f98c4c00640 1 -- 172.21.15.32:0/3730787583 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f98b8019030 con 0x7f98ac0043a0 2024-03-19T06:22:28.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.512+0000 7f98cf200640 1 -- 172.21.15.32:0/3730787583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98c80b5c20 con 0x7f98ac0043a0 2024-03-19T06:22:28.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.516+0000 7f98c4c00640 1 -- 172.21.15.32:0/3730787583 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18493 (secure 0 0 0) 0x7f98b8056cf0 con 0x7f98ac0043a0 2024-03-19T06:22:28.503 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:28.503 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":38,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:22:27.853859+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:22:09.983589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-19T06:22:11.172289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-19T06:22:25.205334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:22:28.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.516+0000 7f98cf200640 1 -- 172.21.15.32:0/3730787583 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f98a4067660 msgr2=0x7f98a4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:28.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.516+0000 7f98cf200640 1 --2- 172.21.15.32:0/3730787583 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f98a4067660 0x7f98a4069b20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f98b000c190 tx=0x7f98b00a7070 comp rx=0 tx=0).stop 2024-03-19T06:22:28.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.516+0000 7f98cf200640 1 -- 172.21.15.32:0/3730787583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98ac0043a0 msgr2=0x7f98c806d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:28.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.516+0000 7f98cf200640 1 --2- 172.21.15.32:0/3730787583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98ac0043a0 0x7f98c806d830 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f98b80119d0 tx=0x7f98b8011e90 comp rx=0 tx=0).stop 2024-03-19T06:22:28.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.516+0000 7f98cf200640 1 -- 172.21.15.32:0/3730787583 shutdown_connections 2024-03-19T06:22:28.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.516+0000 7f98cf200640 1 --2- 172.21.15.32:0/3730787583 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f98a4067660 0x7f98a4069b20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.516+0000 7f98cf200640 1 --2- 172.21.15.32:0/3730787583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98c80b5840 0x7f98c8156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.516+0000 7f98cf200640 1 --2- 172.21.15.32:0/3730787583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98c8158c20 0x7f98c80b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.516+0000 7f98cf200640 1 --2- 172.21.15.32:0/3730787583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98ac0043a0 0x7f98c806d830 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.516+0000 7f98cf200640 1 -- 172.21.15.32:0/3730787583 >> 172.21.15.32:0/3730787583 conn(0x7f98c80d1890 msgr2=0x7f98c80d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:28.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.516+0000 7f98cf200640 1 -- 172.21.15.32:0/3730787583 shutdown_connections 2024-03-19T06:22:28.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.516+0000 7f98cf200640 1 -- 172.21.15.32:0/3730787583 wait complete. 2024-03-19T06:22:28.524 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:22:09.983589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:22:11.172289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2024-03-19T06:22:25.205334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:22:28.525 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:22:28.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.680+0000 7f1806200640 1 Processor -- start 2024-03-19T06:22:28.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.680+0000 7f1806200640 1 -- start start 2024-03-19T06:22:28.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.680+0000 7f1806200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f180006ad40 0x7f180006b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:28.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.680+0000 7f1806200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180006e320 0x7f180015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:28.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.680+0000 7f1806200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180006b660 con 0x7f180006eed0 2024-03-19T06:22:28.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.680+0000 7f1806200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000cd420 con 0x7f180006ad40 2024-03-19T06:22:28.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.680+0000 7f1806200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180006dbb0 con 0x7f180006e320 2024-03-19T06:22:28.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.680+0000 7f17ff400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f180006ad40 0x7f180006b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:28.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.680+0000 7f17ff400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f180006ad40 0x7f180006b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59962/0 (socket says 172.21.15.32:59962) 2024-03-19T06:22:28.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.680+0000 7f17ff400640 1 -- 172.21.15.32:0/20325063 learned_addr learned my addr 172.21.15.32:0/20325063 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:28.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.680+0000 7f17ffe00640 1 --2- 172.21.15.32:0/20325063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180006e320 0x7f180015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:28.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f17ff400640 1 -- 172.21.15.32:0/20325063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180006e320 msgr2=0x7f180015bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:28.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f17ff400640 1 --2- 172.21.15.32:0/20325063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180006e320 0x7f180015bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f17fea00640 1 -- 172.21.15.32:0/20325063 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463082178 0 0) 0x7f180006b660 con 0x7f180006eed0 2024-03-19T06:22:28.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f17ff400640 1 -- 172.21.15.32:0/20325063 >> v1:172.21.15.32:6789/0 conn(0x7f180006eed0 legacy=0x7f18000ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:28.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f17ff400640 1 -- 172.21.15.32:0/20325063 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000cc290 con 0x7f180006ad40 2024-03-19T06:22:28.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f17ffe00640 1 --2- 172.21.15.32:0/20325063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180006e320 0x7f180015bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:28.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f17ff400640 1 --2- 172.21.15.32:0/20325063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f180006ad40 0x7f180006b120 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009870 tx=0x7f17f001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebda663eef8acaf server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:28.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f17fea00640 1 -- 172.21.15.32:0/20325063 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00aa600 con 0x7f180006ad40 2024-03-19T06:22:28.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f17fea00640 1 -- 172.21.15.32:0/20325063 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f00af070 con 0x7f180006ad40 2024-03-19T06:22:28.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f17fea00640 1 -- 172.21.15.32:0/20325063 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00aa9c0 con 0x7f180006ad40 2024-03-19T06:22:28.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f1806200640 1 -- 172.21.15.32:0/20325063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f180006ad40 msgr2=0x7f180006b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:28.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f1806200640 1 --2- 172.21.15.32:0/20325063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f180006ad40 0x7f180006b120 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009870 tx=0x7f17f001c4a0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f1806200640 1 -- 172.21.15.32:0/20325063 shutdown_connections 2024-03-19T06:22:28.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f1806200640 1 --2- 172.21.15.32:0/20325063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180006e320 0x7f180015bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f1806200640 1 --2- 172.21.15.32:0/20325063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f180006ad40 0x7f180006b120 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f1806200640 1 -- 172.21.15.32:0/20325063 >> 172.21.15.32:0/20325063 conn(0x7f18000b1590 msgr2=0x7f18000b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:28.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f1806200640 1 -- 172.21.15.32:0/20325063 shutdown_connections 2024-03-19T06:22:28.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.684+0000 7f1806200640 1 -- 172.21.15.32:0/20325063 wait complete. 2024-03-19T06:22:28.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f1806200640 1 Processor -- start 2024-03-19T06:22:28.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f1806200640 1 -- start start 2024-03-19T06:22:28.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f1806200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f180006ad40 0x7f180014fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:28.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f1806200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f180006e320 0x7f18000a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:28.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f1806200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180006eed0 0x7f1800150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:28.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f1806200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1800168690 con 0x7f180006e320 2024-03-19T06:22:28.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f1806200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1800168510 con 0x7f180006ad40 2024-03-19T06:22:28.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f1806200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1800168810 con 0x7f180006eed0 2024-03-19T06:22:28.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f17f7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f180006e320 0x7f18000a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:28.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f17f7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f180006e320 0x7f18000a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59964/0 (socket says 172.21.15.32:59964) 2024-03-19T06:22:28.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f17f7e00640 1 -- 172.21.15.32:0/425791973 learned_addr learned my addr 172.21.15.32:0/425791973 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:28.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f17ff400640 1 --2- 172.21.15.32:0/425791973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f180006ad40 0x7f180014fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:28.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f17ffe00640 1 --2- 172.21.15.32:0/425791973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180006eed0 0x7f1800150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:28.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f17f7e00640 1 -- 172.21.15.32:0/425791973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180006eed0 msgr2=0x7f1800150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:28.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f17f7e00640 1 --2- 172.21.15.32:0/425791973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180006eed0 0x7f1800150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f17f7e00640 1 -- 172.21.15.32:0/425791973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f180006ad40 msgr2=0x7f180014fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:28.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f17f7e00640 1 --2- 172.21.15.32:0/425791973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f180006ad40 0x7f180014fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f17f7e00640 1 -- 172.21.15.32:0/425791973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000a8a10 con 0x7f180006e320 2024-03-19T06:22:28.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f17f7e00640 1 --2- 172.21.15.32:0/425791973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f180006e320 0x7f18000a84d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f17e8001ec0 tx=0x7f17e800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:28.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f17f7400640 1 -- 172.21.15.32:0/425791973 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8017070 con 0x7f180006e320 2024-03-19T06:22:28.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f17f7400640 1 -- 172.21.15.32:0/425791973 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e8003600 con 0x7f180006e320 2024-03-19T06:22:28.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f1806200640 1 -- 172.21.15.32:0/425791973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18000a9070 con 0x7f180006e320 2024-03-19T06:22:28.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f17f7400640 1 -- 172.21.15.32:0/425791973 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80039f0 con 0x7f180006e320 2024-03-19T06:22:28.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.688+0000 7f1806200640 1 -- 172.21.15.32:0/425791973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1800150ec0 con 0x7f180006e320 2024-03-19T06:22:28.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.692+0000 7f1806200640 1 -- 172.21.15.32:0/425791973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18000749e0 con 0x7f180006e320 2024-03-19T06:22:28.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.692+0000 7f17f7400640 1 -- 172.21.15.32:0/425791973 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f17e801a070 con 0x7f180006e320 2024-03-19T06:22:28.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.692+0000 7f17f7400640 1 --2- 172.21.15.32:0/425791973 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f17dc067660 0x7f17dc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:28.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.692+0000 7f17f7400640 1 -- 172.21.15.32:0/425791973 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f17e8084e50 con 0x7f180006e320 2024-03-19T06:22:28.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.692+0000 7f17ff400640 1 --2- 172.21.15.32:0/425791973 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f17dc067660 0x7f17dc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:28.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.696+0000 7f17ff400640 1 --2- 172.21.15.32:0/425791973 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f17dc067660 0x7f17dc069b20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f17f00ae000 tx=0x7f17f00a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:28.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.696+0000 7f17f7400640 1 -- 172.21.15.32:0/425791973 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f17e8055250 con 0x7f180006e320 2024-03-19T06:22:28.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.868+0000 7f1806200640 1 -- 172.21.15.32:0/425791973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1800074400 con 0x7f180006e320 2024-03-19T06:22:28.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.868+0000 7f17f7400640 1 -- 172.21.15.32:0/425791973 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17e80592f0 con 0x7f180006e320 2024-03-19T06:22:28.855 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:22:28.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.868+0000 7f1806200640 1 -- 172.21.15.32:0/425791973 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f17dc067660 msgr2=0x7f17dc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:28.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.868+0000 7f1806200640 1 --2- 172.21.15.32:0/425791973 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f17dc067660 0x7f17dc069b20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f17f00ae000 tx=0x7f17f00a7000 comp rx=0 tx=0).stop 2024-03-19T06:22:28.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.868+0000 7f1806200640 1 -- 172.21.15.32:0/425791973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f180006e320 msgr2=0x7f18000a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:28.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.868+0000 7f1806200640 1 --2- 172.21.15.32:0/425791973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f180006e320 0x7f18000a84d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f17e8001ec0 tx=0x7f17e800c8e0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.868+0000 7f1806200640 1 -- 172.21.15.32:0/425791973 shutdown_connections 2024-03-19T06:22:28.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.868+0000 7f1806200640 1 --2- 172.21.15.32:0/425791973 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f17dc067660 0x7f17dc069b20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.868+0000 7f1806200640 1 --2- 172.21.15.32:0/425791973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f180006eed0 0x7f1800150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.868+0000 7f1806200640 1 --2- 172.21.15.32:0/425791973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f180006e320 0x7f18000a84d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.868+0000 7f1806200640 1 --2- 172.21.15.32:0/425791973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f180006ad40 0x7f180014fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:28.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.868+0000 7f1806200640 1 -- 172.21.15.32:0/425791973 >> 172.21.15.32:0/425791973 conn(0x7f18000b1590 msgr2=0x7f180015ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:28.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.868+0000 7f1806200640 1 -- 172.21.15.32:0/425791973 shutdown_connections 2024-03-19T06:22:28.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:28.868+0000 7f1806200640 1 -- 172.21.15.32:0/425791973 wait complete. 2024-03-19T06:22:28.876 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:22:29.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.032+0000 7f23e4000640 1 Processor -- start 2024-03-19T06:22:29.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.032+0000 7f23e4000640 1 -- start start 2024-03-19T06:22:29.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.032+0000 7f23e4000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f23dc06b450 0x7f23dc06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.032+0000 7f23e4000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f23dc0aea70 0x7f23dc0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.032+0000 7f23e4000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23dc0af2d0 con 0x7f23dc15a840 2024-03-19T06:22:29.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.032+0000 7f23e4000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23dc0cdc20 con 0x7f23dc06b450 2024-03-19T06:22:29.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.032+0000 7f23e4000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23dc15eea0 con 0x7f23dc0aea70 2024-03-19T06:22:29.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.036+0000 7f23e0c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f23dc06b450 0x7f23dc06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.036+0000 7f23e0c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f23dc06b450 0x7f23dc06f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59976/0 (socket says 172.21.15.32:59976) 2024-03-19T06:22:29.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.036+0000 7f23e0c00640 1 -- 172.21.15.32:0/3879282147 learned_addr learned my addr 172.21.15.32:0/3879282147 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:29.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.036+0000 7f23e2000640 1 --2- 172.21.15.32:0/3879282147 >> v2:172.21.15.171:3300/0 conn(0x7f23dc0aea70 0x7f23dc0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.036+0000 7f23e0c00640 1 -- 172.21.15.32:0/3879282147 >> v2:172.21.15.171:3300/0 conn(0x7f23dc0aea70 msgr2=0x7f23dc0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:29.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.036+0000 7f23e0c00640 1 --2- 172.21.15.32:0/3879282147 >> v2:172.21.15.171:3300/0 conn(0x7f23dc0aea70 0x7f23dc0ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.036+0000 7f23e0c00640 1 -- 172.21.15.32:0/3879282147 >> v1:172.21.15.171:6789/0 conn(0x7f23dc15a840 legacy=0x7f23dc06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.036+0000 7f23e0c00640 1 -- 172.21.15.32:0/3879282147 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc15f180 con 0x7f23dc06b450 2024-03-19T06:22:29.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.036+0000 7f23e0c00640 1 --2- 172.21.15.32:0/3879282147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23dc06b450 0x7f23dc06f040 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f23dc06bcb0 tx=0x7f23c801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e4709423a5f891 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:29.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.036+0000 7f23dbe00640 1 -- 172.21.15.32:0/3879282147 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c80aa610 con 0x7f23dc06b450 2024-03-19T06:22:29.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.036+0000 7f23dbe00640 1 -- 172.21.15.32:0/3879282147 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c80af070 con 0x7f23dc06b450 2024-03-19T06:22:29.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.036+0000 7f23dbe00640 1 -- 172.21.15.32:0/3879282147 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c80aa9d0 con 0x7f23dc06b450 2024-03-19T06:22:29.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e4000640 1 -- 172.21.15.32:0/3879282147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23dc06b450 msgr2=0x7f23dc06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e4000640 1 --2- 172.21.15.32:0/3879282147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23dc06b450 0x7f23dc06f040 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f23dc06bcb0 tx=0x7f23c801c450 comp rx=0 tx=0).stop 2024-03-19T06:22:29.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e4000640 1 -- 172.21.15.32:0/3879282147 shutdown_connections 2024-03-19T06:22:29.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e4000640 1 --2- 172.21.15.32:0/3879282147 >> v2:172.21.15.171:3300/0 conn(0x7f23dc0aea70 0x7f23dc0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e4000640 1 --2- 172.21.15.32:0/3879282147 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23dc06b450 0x7f23dc06f040 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e4000640 1 -- 172.21.15.32:0/3879282147 >> 172.21.15.32:0/3879282147 conn(0x7f23dc0b1590 msgr2=0x7f23dc0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:29.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e4000640 1 -- 172.21.15.32:0/3879282147 shutdown_connections 2024-03-19T06:22:29.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e4000640 1 -- 172.21.15.32:0/3879282147 wait complete. 2024-03-19T06:22:29.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e4000640 1 Processor -- start 2024-03-19T06:22:29.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e4000640 1 -- start start 2024-03-19T06:22:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e4000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23dc06b450 0x7f23dc147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e4000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23dc0aea70 0x7f23dc152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e4000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23dc15a840 0x7f23dc152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e4000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0cef80 con 0x7f23dc06b450 2024-03-19T06:22:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e4000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0cee00 con 0x7f23dc0aea70 2024-03-19T06:22:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e4000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0cf100 con 0x7f23dc15a840 2024-03-19T06:22:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e1600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23dc06b450 0x7f23dc147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e1600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23dc06b450 0x7f23dc147620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59980/0 (socket says 172.21.15.32:59980) 2024-03-19T06:22:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e1600640 1 -- 172.21.15.32:0/1030126637 learned_addr learned my addr 172.21.15.32:0/1030126637 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e0c00640 1 --2- 172.21.15.32:0/1030126637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23dc0aea70 0x7f23dc152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e2000640 1 --2- 172.21.15.32:0/1030126637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23dc15a840 0x7f23dc152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e1600640 1 -- 172.21.15.32:0/1030126637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23dc15a840 msgr2=0x7f23dc152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e1600640 1 --2- 172.21.15.32:0/1030126637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23dc15a840 0x7f23dc152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e1600640 1 -- 172.21.15.32:0/1030126637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23dc0aea70 msgr2=0x7f23dc152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e1600640 1 --2- 172.21.15.32:0/1030126637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23dc0aea70 0x7f23dc152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e1600640 1 -- 172.21.15.32:0/1030126637 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc153480 con 0x7f23dc06b450 2024-03-19T06:22:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e0c00640 1 --2- 172.21.15.32:0/1030126637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23dc0aea70 0x7f23dc152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.040+0000 7f23e2000640 1 --2- 172.21.15.32:0/1030126637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23dc15a840 0x7f23dc152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.044+0000 7f23e1600640 1 --2- 172.21.15.32:0/1030126637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23dc06b450 0x7f23dc147620 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f23d000c370 tx=0x7f23d000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.044+0000 7f23d9600640 1 -- 172.21.15.32:0/1030126637 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d00052d0 con 0x7f23dc06b450 2024-03-19T06:22:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.044+0000 7f23d9600640 1 -- 172.21.15.32:0/1030126637 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d0005470 con 0x7f23dc06b450 2024-03-19T06:22:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.044+0000 7f23d9600640 1 -- 172.21.15.32:0/1030126637 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d0007260 con 0x7f23dc06b450 2024-03-19T06:22:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.044+0000 7f23e4000640 1 -- 172.21.15.32:0/1030126637 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23dc0b3500 con 0x7f23dc06b450 2024-03-19T06:22:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.044+0000 7f23e4000640 1 -- 172.21.15.32:0/1030126637 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23dc0b3ac0 con 0x7f23dc06b450 2024-03-19T06:22:29.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.044+0000 7f23e4000640 1 -- 172.21.15.32:0/1030126637 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23dc0749e0 con 0x7f23dc06b450 2024-03-19T06:22:29.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.044+0000 7f23d9600640 1 -- 172.21.15.32:0/1030126637 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f23d0007400 con 0x7f23dc06b450 2024-03-19T06:22:29.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.044+0000 7f23d9600640 1 --2- 172.21.15.32:0/1030126637 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f23bc067660 0x7f23bc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.048+0000 7f23d9600640 1 -- 172.21.15.32:0/1030126637 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f23d0084f90 con 0x7f23dc06b450 2024-03-19T06:22:29.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.048+0000 7f23e0c00640 1 --2- 172.21.15.32:0/1030126637 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f23bc067660 0x7f23bc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.048+0000 7f23e0c00640 1 --2- 172.21.15.32:0/1030126637 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f23bc067660 0x7f23bc069b20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f23c80ae000 tx=0x7f23c8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:29.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.052+0000 7f23d9600640 1 -- 172.21.15.32:0/1030126637 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f23d0055a70 con 0x7f23dc06b450 2024-03-19T06:22:29.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.216+0000 7f23e4000640 1 -- 172.21.15.32:0/1030126637 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f23dc06e6c0 con 0x7f23dc06b450 2024-03-19T06:22:29.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.216+0000 7f23d9600640 1 -- 172.21.15.32:0/1030126637 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f23d0055370 con 0x7f23dc06b450 2024-03-19T06:22:29.203 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:22:29.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.216+0000 7f23e4000640 1 -- 172.21.15.32:0/1030126637 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f23bc067660 msgr2=0x7f23bc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.216+0000 7f23e4000640 1 --2- 172.21.15.32:0/1030126637 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f23bc067660 0x7f23bc069b20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f23c80ae000 tx=0x7f23c8008040 comp rx=0 tx=0).stop 2024-03-19T06:22:29.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.216+0000 7f23e4000640 1 -- 172.21.15.32:0/1030126637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23dc06b450 msgr2=0x7f23dc147620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.216+0000 7f23e4000640 1 --2- 172.21.15.32:0/1030126637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23dc06b450 0x7f23dc147620 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f23d000c370 tx=0x7f23d000c830 comp rx=0 tx=0).stop 2024-03-19T06:22:29.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.216+0000 7f23e4000640 1 -- 172.21.15.32:0/1030126637 shutdown_connections 2024-03-19T06:22:29.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.216+0000 7f23e4000640 1 --2- 172.21.15.32:0/1030126637 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f23bc067660 0x7f23bc069b20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.216+0000 7f23e4000640 1 --2- 172.21.15.32:0/1030126637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23dc15a840 0x7f23dc152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.216+0000 7f23e4000640 1 --2- 172.21.15.32:0/1030126637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23dc0aea70 0x7f23dc152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.216+0000 7f23e4000640 1 --2- 172.21.15.32:0/1030126637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f23dc06b450 0x7f23dc147620 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.216+0000 7f23e4000640 1 -- 172.21.15.32:0/1030126637 >> 172.21.15.32:0/1030126637 conn(0x7f23dc0b1590 msgr2=0x7f23dc071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:29.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.216+0000 7f23e4000640 1 -- 172.21.15.32:0/1030126637 shutdown_connections 2024-03-19T06:22:29.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.216+0000 7f23e4000640 1 -- 172.21.15.32:0/1030126637 wait complete. 2024-03-19T06:22:29.225 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:22:29.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.380+0000 7f7421a00640 1 Processor -- start 2024-03-19T06:22:29.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.380+0000 7f7421a00640 1 -- start start 2024-03-19T06:22:29.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.384+0000 7f7421a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f741c06b450 0x7f741c06fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.384+0000 7f7421a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f741c070070 0x7f741c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.384+0000 7f7421a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c0d16d0 con 0x7f741c15dba0 2024-03-19T06:22:29.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.384+0000 7f7421a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741c0704c0 con 0x7f741c06b450 2024-03-19T06:22:29.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.384+0000 7f7421a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741c0ccea0 con 0x7f741c070070 2024-03-19T06:22:29.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.384+0000 7f7412000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f741c06b450 0x7f741c06fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.384+0000 7f7412000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f741c06b450 0x7f741c06fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59994/0 (socket says 172.21.15.32:59994) 2024-03-19T06:22:29.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.384+0000 7f7412000640 1 -- 172.21.15.32:0/3069083149 learned_addr learned my addr 172.21.15.32:0/3069083149 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:29.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.384+0000 7f741b400640 1 --2- 172.21.15.32:0/3069083149 >> v2:172.21.15.171:3300/0 conn(0x7f741c070070 0x7f741c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.384+0000 7f7412000640 1 -- 172.21.15.32:0/3069083149 >> v2:172.21.15.171:3300/0 conn(0x7f741c070070 msgr2=0x7f741c0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:29.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.384+0000 7f7412000640 1 --2- 172.21.15.32:0/3069083149 >> v2:172.21.15.171:3300/0 conn(0x7f741c070070 0x7f741c0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.384+0000 7f7412000640 1 -- 172.21.15.32:0/3069083149 >> v1:172.21.15.171:6789/0 conn(0x7f741c15dba0 legacy=0x7f741c06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.384+0000 7f7412000640 1 -- 172.21.15.32:0/3069083149 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c070710 con 0x7f741c06b450 2024-03-19T06:22:29.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.384+0000 7f741b400640 1 --2- 172.21.15.32:0/3069083149 >> v2:172.21.15.171:3300/0 conn(0x7f741c070070 0x7f741c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:29.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7412000640 1 --2- 172.21.15.32:0/3069083149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c06b450 0x7f741c06fb30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f741c0d0840 tx=0x7f740401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91cd336ea6a4ca8a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:29.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f741a000640 1 -- 172.21.15.32:0/3069083149 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74040b2070 con 0x7f741c06b450 2024-03-19T06:22:29.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f741a000640 1 -- 172.21.15.32:0/3069083149 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74040ad680 con 0x7f741c06b450 2024-03-19T06:22:29.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f741a000640 1 -- 172.21.15.32:0/3069083149 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74040ada50 con 0x7f741c06b450 2024-03-19T06:22:29.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7421a00640 1 -- 172.21.15.32:0/3069083149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c06b450 msgr2=0x7f741c06fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7421a00640 1 --2- 172.21.15.32:0/3069083149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c06b450 0x7f741c06fb30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f741c0d0840 tx=0x7f740401c490 comp rx=0 tx=0).stop 2024-03-19T06:22:29.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7421a00640 1 -- 172.21.15.32:0/3069083149 shutdown_connections 2024-03-19T06:22:29.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7421a00640 1 --2- 172.21.15.32:0/3069083149 >> v2:172.21.15.171:3300/0 conn(0x7f741c070070 0x7f741c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7421a00640 1 --2- 172.21.15.32:0/3069083149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c06b450 0x7f741c06fb30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7421a00640 1 -- 172.21.15.32:0/3069083149 >> 172.21.15.32:0/3069083149 conn(0x7f741c099a70 msgr2=0x7f741c099e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:29.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7421a00640 1 -- 172.21.15.32:0/3069083149 shutdown_connections 2024-03-19T06:22:29.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7421a00640 1 -- 172.21.15.32:0/3069083149 wait complete. 2024-03-19T06:22:29.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7421a00640 1 Processor -- start 2024-03-19T06:22:29.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7421a00640 1 -- start start 2024-03-19T06:22:29.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7421a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f741c06b450 0x7f741c0b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7421a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f741c070070 0x7f741c156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7421a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c15dba0 0x7f741c1557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7421a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c15e100 con 0x7f741c15dba0 2024-03-19T06:22:29.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7421a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c15df80 con 0x7f741c06b450 2024-03-19T06:22:29.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f7421a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0cde10 con 0x7f741c070070 2024-03-19T06:22:29.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f741b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c15dba0 0x7f741c1557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f741b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c15dba0 0x7f741c1557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60010/0 (socket says 172.21.15.32:60010) 2024-03-19T06:22:29.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f741b400640 1 -- 172.21.15.32:0/712607296 learned_addr learned my addr 172.21.15.32:0/712607296 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:29.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.388+0000 7f741aa00640 1 --2- 172.21.15.32:0/712607296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f741c06b450 0x7f741c0b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.392+0000 7f7412000640 1 --2- 172.21.15.32:0/712607296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f741c070070 0x7f741c156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.392+0000 7f741b400640 1 -- 172.21.15.32:0/712607296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f741c070070 msgr2=0x7f741c156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.392+0000 7f741b400640 1 --2- 172.21.15.32:0/712607296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f741c070070 0x7f741c156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.392+0000 7f741b400640 1 -- 172.21.15.32:0/712607296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f741c06b450 msgr2=0x7f741c0b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.392+0000 7f741b400640 1 --2- 172.21.15.32:0/712607296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f741c06b450 0x7f741c0b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.392+0000 7f741b400640 1 -- 172.21.15.32:0/712607296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c1565d0 con 0x7f741c15dba0 2024-03-19T06:22:29.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.392+0000 7f741b400640 1 --2- 172.21.15.32:0/712607296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c15dba0 0x7f741c1557c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f741400e810 tx=0x7f741400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:29.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.392+0000 7f7413400640 1 -- 172.21.15.32:0/712607296 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414017070 con 0x7f741c15dba0 2024-03-19T06:22:29.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.392+0000 7f7413400640 1 -- 172.21.15.32:0/712607296 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741400c6d0 con 0x7f741c15dba0 2024-03-19T06:22:29.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.392+0000 7f7413400640 1 -- 172.21.15.32:0/712607296 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741400f040 con 0x7f741c15dba0 2024-03-19T06:22:29.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.392+0000 7f7421a00640 1 -- 172.21.15.32:0/712607296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c156870 con 0x7f741c15dba0 2024-03-19T06:22:29.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.392+0000 7f7421a00640 1 -- 172.21.15.32:0/712607296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c156e30 con 0x7f741c15dba0 2024-03-19T06:22:29.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.392+0000 7f7421a00640 1 -- 172.21.15.32:0/712607296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c0749e0 con 0x7f741c15dba0 2024-03-19T06:22:29.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.392+0000 7f7413400640 1 -- 172.21.15.32:0/712607296 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f741401a070 con 0x7f741c15dba0 2024-03-19T06:22:29.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.392+0000 7f7413400640 1 --2- 172.21.15.32:0/712607296 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f73f8067690 0x7f73f8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.392+0000 7f7413400640 1 -- 172.21.15.32:0/712607296 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f7414085570 con 0x7f741c15dba0 2024-03-19T06:22:29.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.396+0000 7f741aa00640 1 --2- 172.21.15.32:0/712607296 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f73f8067690 0x7f73f8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.396+0000 7f741aa00640 1 --2- 172.21.15.32:0/712607296 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f73f8067690 0x7f73f8069b50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f740c001e00 tx=0x7f740c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:29.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.396+0000 7f7413400640 1 -- 172.21.15.32:0/712607296 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f7414055a00 con 0x7f741c15dba0 2024-03-19T06:22:29.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.568+0000 7f7421a00640 1 -- 172.21.15.32:0/712607296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f741c0cc7b0 con 0x7f741c15dba0 2024-03-19T06:22:29.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.568+0000 7f7413400640 1 -- 172.21.15.32:0/712607296 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7414059aa0 con 0x7f741c15dba0 2024-03-19T06:22:29.555 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:22:29.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.568+0000 7f7421a00640 1 -- 172.21.15.32:0/712607296 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f73f8067690 msgr2=0x7f73f8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.568+0000 7f7421a00640 1 --2- 172.21.15.32:0/712607296 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f73f8067690 0x7f73f8069b50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f740c001e00 tx=0x7f740c009040 comp rx=0 tx=0).stop 2024-03-19T06:22:29.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.568+0000 7f7421a00640 1 -- 172.21.15.32:0/712607296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c15dba0 msgr2=0x7f741c1557c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.568+0000 7f7421a00640 1 --2- 172.21.15.32:0/712607296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c15dba0 0x7f741c1557c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f741400e810 tx=0x7f741400ecd0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.568+0000 7f7421a00640 1 -- 172.21.15.32:0/712607296 shutdown_connections 2024-03-19T06:22:29.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.568+0000 7f7421a00640 1 --2- 172.21.15.32:0/712607296 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f73f8067690 0x7f73f8069b50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.568+0000 7f7421a00640 1 --2- 172.21.15.32:0/712607296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f741c15dba0 0x7f741c1557c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.568+0000 7f7421a00640 1 --2- 172.21.15.32:0/712607296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f741c070070 0x7f741c156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.568+0000 7f7421a00640 1 --2- 172.21.15.32:0/712607296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f741c06b450 0x7f741c0b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.568+0000 7f7421a00640 1 -- 172.21.15.32:0/712607296 >> 172.21.15.32:0/712607296 conn(0x7f741c099a70 msgr2=0x7f741c15e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:29.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.568+0000 7f7421a00640 1 -- 172.21.15.32:0/712607296 shutdown_connections 2024-03-19T06:22:29.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.568+0000 7f7421a00640 1 -- 172.21.15.32:0/712607296 wait complete. 2024-03-19T06:22:29.578 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-03-19T06:22:29.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.732+0000 7fa10e400640 1 Processor -- start 2024-03-19T06:22:29.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.732+0000 7fa10e400640 1 -- start start 2024-03-19T06:22:29.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.732+0000 7fa10e400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa10806ad40 0x7fa10806b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.732+0000 7fa10e400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa10806eed0 0x7fa1080ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.732+0000 7fa10e400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa10806b660 con 0x7fa10806e320 2024-03-19T06:22:29.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.732+0000 7fa10e400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10806dbb0 con 0x7fa10806eed0 2024-03-19T06:22:29.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.732+0000 7fa10e400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1080cc290 con 0x7fa10806ad40 2024-03-19T06:22:29.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.736+0000 7fa0fea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa10806eed0 0x7fa1080ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.736+0000 7fa0fea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa10806eed0 0x7fa1080ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60018/0 (socket says 172.21.15.32:60018) 2024-03-19T06:22:29.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.736+0000 7fa0fea00640 1 -- 172.21.15.32:0/1458358066 learned_addr learned my addr 172.21.15.32:0/1458358066 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:29.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.736+0000 7fa107400640 1 --2- 172.21.15.32:0/1458358066 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa10806ad40 0x7fa10806b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.736+0000 7fa0fea00640 1 -- 172.21.15.32:0/1458358066 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa10806ad40 msgr2=0x7fa10806b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:29.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.736+0000 7fa0fea00640 1 --2- 172.21.15.32:0/1458358066 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa10806ad40 0x7fa10806b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.736+0000 7fa0fea00640 1 -- 172.21.15.32:0/1458358066 >> v1:172.21.15.171:6789/0 conn(0x7fa10806e320 legacy=0x7fa10815bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:29.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.736+0000 7fa0fea00640 1 -- 172.21.15.32:0/1458358066 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1080cc570 con 0x7fa10806eed0 2024-03-19T06:22:29.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.736+0000 7fa0fea00640 1 --2- 172.21.15.32:0/1458358066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10806eed0 0x7fa1080ccd10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009870 tx=0x7fa0f001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c357696c325544d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:29.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.736+0000 7fa106a00640 1 -- 172.21.15.32:0/1458358066 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00ab620 con 0x7fa10806eed0 2024-03-19T06:22:29.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.736+0000 7fa106a00640 1 -- 172.21.15.32:0/1458358066 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f00b0070 con 0x7fa10806eed0 2024-03-19T06:22:29.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.736+0000 7fa106a00640 1 -- 172.21.15.32:0/1458358066 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00ab9e0 con 0x7fa10806eed0 2024-03-19T06:22:29.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa10e400640 1 -- 172.21.15.32:0/1458358066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10806eed0 msgr2=0x7fa1080ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa10e400640 1 --2- 172.21.15.32:0/1458358066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10806eed0 0x7fa1080ccd10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009870 tx=0x7fa0f001c460 comp rx=0 tx=0).stop 2024-03-19T06:22:29.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa10e400640 1 -- 172.21.15.32:0/1458358066 shutdown_connections 2024-03-19T06:22:29.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa10e400640 1 --2- 172.21.15.32:0/1458358066 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10806eed0 0x7fa1080ccd10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa10e400640 1 --2- 172.21.15.32:0/1458358066 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa10806ad40 0x7fa10806b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa10e400640 1 -- 172.21.15.32:0/1458358066 >> 172.21.15.32:0/1458358066 conn(0x7fa1080b1590 msgr2=0x7fa1080b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:29.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa10e400640 1 -- 172.21.15.32:0/1458358066 shutdown_connections 2024-03-19T06:22:29.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa10e400640 1 -- 172.21.15.32:0/1458358066 wait complete. 2024-03-19T06:22:29.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa10e400640 1 Processor -- start 2024-03-19T06:22:29.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa10e400640 1 -- start start 2024-03-19T06:22:29.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa10e400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10806ad40 0x7fa108149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa10e400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa10806e320 0x7fa1080af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa10e400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa10806eed0 0x7fa10814ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa10e400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10815c8f0 con 0x7fa10806ad40 2024-03-19T06:22:29.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa10e400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10815c770 con 0x7fa10806eed0 2024-03-19T06:22:29.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa10e400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa108168d20 con 0x7fa10806e320 2024-03-19T06:22:29.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa107400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10806ad40 0x7fa108149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa107400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10806ad40 0x7fa108149010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60024/0 (socket says 172.21.15.32:60024) 2024-03-19T06:22:29.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa107400640 1 -- 172.21.15.32:0/3773517512 learned_addr learned my addr 172.21.15.32:0/3773517512 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:29.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa0fea00640 1 --2- 172.21.15.32:0/3773517512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa10806e320 0x7fa1080af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa107e00640 1 --2- 172.21.15.32:0/3773517512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa10806eed0 0x7fa10814ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa107400640 1 -- 172.21.15.32:0/3773517512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa10806e320 msgr2=0x7fa1080af160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa107400640 1 --2- 172.21.15.32:0/3773517512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa10806e320 0x7fa1080af160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa107400640 1 -- 172.21.15.32:0/3773517512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa10806eed0 msgr2=0x7fa10814ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa107400640 1 --2- 172.21.15.32:0/3773517512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa10806eed0 0x7fa10814ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa107400640 1 -- 172.21.15.32:0/3773517512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1080b2f50 con 0x7fa10806ad40 2024-03-19T06:22:29.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.740+0000 7fa107e00640 1 --2- 172.21.15.32:0/3773517512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa10806eed0 0x7fa10814ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:29.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.744+0000 7fa107400640 1 --2- 172.21.15.32:0/3773517512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10806ad40 0x7fa108149010 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800d800 tx=0x7fa0f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:29.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.744+0000 7fa0ffe00640 1 -- 172.21.15.32:0/3773517512 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f800b6c0 con 0x7fa10806ad40 2024-03-19T06:22:29.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.744+0000 7fa0ffe00640 1 -- 172.21.15.32:0/3773517512 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f8019070 con 0x7fa10806ad40 2024-03-19T06:22:29.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.744+0000 7fa0ffe00640 1 -- 172.21.15.32:0/3773517512 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f800ba60 con 0x7fa10806ad40 2024-03-19T06:22:29.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.744+0000 7fa10e400640 1 -- 172.21.15.32:0/3773517512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1080b3230 con 0x7fa10806ad40 2024-03-19T06:22:29.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.744+0000 7fa10e400640 1 -- 172.21.15.32:0/3773517512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1080b3ad0 con 0x7fa10806ad40 2024-03-19T06:22:29.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.744+0000 7fa10e400640 1 -- 172.21.15.32:0/3773517512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1080b3620 con 0x7fa10806ad40 2024-03-19T06:22:29.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.744+0000 7fa0ffe00640 1 -- 172.21.15.32:0/3773517512 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa0f800bc00 con 0x7fa10806ad40 2024-03-19T06:22:29.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.744+0000 7fa0ffe00640 1 --2- 172.21.15.32:0/3773517512 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa0e4067660 0x7fa0e4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:29.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.744+0000 7fa0ffe00640 1 -- 172.21.15.32:0/3773517512 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fa0f8085f30 con 0x7fa10806ad40 2024-03-19T06:22:29.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.748+0000 7fa0fea00640 1 --2- 172.21.15.32:0/3773517512 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa0e4067660 0x7fa0e4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:29.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.748+0000 7fa0fea00640 1 --2- 172.21.15.32:0/3773517512 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa0e4067660 0x7fa0e4069b20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa0f00af000 tx=0x7fa0f00a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:29.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.748+0000 7fa0ffe00640 1 -- 172.21.15.32:0/3773517512 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fa0f8056900 con 0x7fa10806ad40 2024-03-19T06:22:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.912+0000 7fa10e400640 1 -- 172.21.15.32:0/3773517512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fa1080749e0 con 0x7fa10806ad40 2024-03-19T06:22:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.912+0000 7fa0ffe00640 1 -- 172.21.15.32:0/3773517512 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v38) v1 ==== 97+0+11 (secure 0 0 0) 0x7fa0f8056200 con 0x7fa10806ad40 2024-03-19T06:22:29.899 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:22:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.912+0000 7fa10e400640 1 -- 172.21.15.32:0/3773517512 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa0e4067660 msgr2=0x7fa0e4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.912+0000 7fa10e400640 1 --2- 172.21.15.32:0/3773517512 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa0e4067660 0x7fa0e4069b20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa0f00af000 tx=0x7fa0f00a7000 comp rx=0 tx=0).stop 2024-03-19T06:22:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.912+0000 7fa10e400640 1 -- 172.21.15.32:0/3773517512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10806ad40 msgr2=0x7fa108149010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.912+0000 7fa10e400640 1 --2- 172.21.15.32:0/3773517512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10806ad40 0x7fa108149010 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800d800 tx=0x7fa0f800dcc0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.912+0000 7fa10e400640 1 -- 172.21.15.32:0/3773517512 shutdown_connections 2024-03-19T06:22:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.912+0000 7fa10e400640 1 --2- 172.21.15.32:0/3773517512 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa0e4067660 0x7fa0e4069b20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.912+0000 7fa10e400640 1 --2- 172.21.15.32:0/3773517512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa10806eed0 0x7fa10814ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.912+0000 7fa10e400640 1 --2- 172.21.15.32:0/3773517512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa10806e320 0x7fa1080af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.912+0000 7fa10e400640 1 --2- 172.21.15.32:0/3773517512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10806ad40 0x7fa108149010 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:29.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.912+0000 7fa10e400640 1 -- 172.21.15.32:0/3773517512 >> 172.21.15.32:0/3773517512 conn(0x7fa1080b1590 msgr2=0x7fa1080cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:29.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.912+0000 7fa10e400640 1 -- 172.21.15.32:0/3773517512 shutdown_connections 2024-03-19T06:22:29.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:29.912+0000 7fa10e400640 1 -- 172.21.15.32:0/3773517512 wait complete. 2024-03-19T06:22:29.922 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:22:30.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2647200640 1 Processor -- start 2024-03-19T06:22:30.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2647200640 1 -- start start 2024-03-19T06:22:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2647200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f264815ef90 0x7f26480cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2647200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f26480b0650 0x7f26480cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2647200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f26480cff90 0x7f26480ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2647200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26480cce80 con 0x7f26480cff90 2024-03-19T06:22:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2647200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26480cd160 con 0x7f26480b0650 2024-03-19T06:22:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2647200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26480cd440 con 0x7f264815ef90 2024-03-19T06:22:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2646800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f26480cff90 0x7f26480ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2646800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f26480cff90 0x7f26480ce000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60040/0 (socket says 172.21.15.32:60040) 2024-03-19T06:22:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2646800640 1 -- 172.21.15.32:0/3497238460 learned_addr learned my addr 172.21.15.32:0/3497238460 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2645e00640 1 --2- 172.21.15.32:0/3497238460 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f264815ef90 0x7f26480cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f263d400640 1 --2- 172.21.15.32:0/3497238460 >> v2:172.21.15.171:3300/0 conn(0x7f26480b0650 0x7f26480cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2646800640 1 -- 172.21.15.32:0/3497238460 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f264815ef90 msgr2=0x7f26480cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2646800640 1 --2- 172.21.15.32:0/3497238460 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f264815ef90 0x7f26480cf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2646800640 1 -- 172.21.15.32:0/3497238460 >> v2:172.21.15.171:3300/0 conn(0x7f26480b0650 msgr2=0x7f26480cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2646800640 1 --2- 172.21.15.32:0/3497238460 >> v2:172.21.15.171:3300/0 conn(0x7f26480b0650 0x7f26480cfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.076+0000 7f2646800640 1 -- 172.21.15.32:0/3497238460 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26480d24a0 con 0x7f26480cff90 2024-03-19T06:22:30.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.080+0000 7f2646800640 1 --2- 172.21.15.32:0/3497238460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26480cff90 0x7f26480ce000 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f264808bbc0 tx=0x7f264001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964d7dbf99c1bd92 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.080+0000 7f2645400640 1 -- 172.21.15.32:0/3497238460 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26400b0070 con 0x7f26480cff90 2024-03-19T06:22:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.080+0000 7f2645400640 1 -- 172.21.15.32:0/3497238460 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26400ab600 con 0x7f26480cff90 2024-03-19T06:22:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.080+0000 7f2645400640 1 -- 172.21.15.32:0/3497238460 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26400ab9d0 con 0x7f26480cff90 2024-03-19T06:22:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.080+0000 7f2647200640 1 -- 172.21.15.32:0/3497238460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26480cff90 msgr2=0x7f26480ce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.080+0000 7f2647200640 1 --2- 172.21.15.32:0/3497238460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26480cff90 0x7f26480ce000 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f264808bbc0 tx=0x7f264001c490 comp rx=0 tx=0).stop 2024-03-19T06:22:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.080+0000 7f2647200640 1 -- 172.21.15.32:0/3497238460 shutdown_connections 2024-03-19T06:22:30.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.080+0000 7f2647200640 1 --2- 172.21.15.32:0/3497238460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26480cff90 0x7f26480ce000 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.080+0000 7f2647200640 1 --2- 172.21.15.32:0/3497238460 >> v2:172.21.15.171:3300/0 conn(0x7f26480b0650 0x7f26480cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.080+0000 7f2647200640 1 --2- 172.21.15.32:0/3497238460 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f264815ef90 0x7f26480cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.080+0000 7f2647200640 1 -- 172.21.15.32:0/3497238460 >> 172.21.15.32:0/3497238460 conn(0x7f26480d1610 msgr2=0x7f26480d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:30.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.080+0000 7f2647200640 1 -- 172.21.15.32:0/3497238460 shutdown_connections 2024-03-19T06:22:30.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.080+0000 7f2647200640 1 -- 172.21.15.32:0/3497238460 wait complete. 2024-03-19T06:22:30.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f2647200640 1 Processor -- start 2024-03-19T06:22:30.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f2647200640 1 -- start start 2024-03-19T06:22:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f2647200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26480b0650 0x7f26480c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f2647200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26480cff90 0x7f26480c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f2647200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f264815ef90 0x7f264815c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f2647200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264806f7d0 con 0x7f26480cff90 2024-03-19T06:22:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f2647200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264806f650 con 0x7f26480b0650 2024-03-19T06:22:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f2647200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264806f950 con 0x7f264815ef90 2024-03-19T06:22:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f263d400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26480cff90 0x7f26480c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f263d400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26480cff90 0x7f26480c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60056/0 (socket says 172.21.15.32:60056) 2024-03-19T06:22:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f263d400640 1 -- 172.21.15.32:0/202606193 learned_addr learned my addr 172.21.15.32:0/202606193 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f2646800640 1 --2- 172.21.15.32:0/202606193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f264815ef90 0x7f264815c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f2645e00640 1 --2- 172.21.15.32:0/202606193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26480b0650 0x7f26480c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f263d400640 1 -- 172.21.15.32:0/202606193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f264815ef90 msgr2=0x7f264815c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f263d400640 1 --2- 172.21.15.32:0/202606193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f264815ef90 0x7f264815c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f263d400640 1 -- 172.21.15.32:0/202606193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26480b0650 msgr2=0x7f26480c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f263d400640 1 --2- 172.21.15.32:0/202606193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26480b0650 0x7f26480c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f263d400640 1 -- 172.21.15.32:0/202606193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26480c7e60 con 0x7f26480cff90 2024-03-19T06:22:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f2645e00640 1 --2- 172.21.15.32:0/202606193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26480b0650 0x7f26480c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f263d400640 1 --2- 172.21.15.32:0/202606193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26480cff90 0x7f26480c86e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f263000ef00 tx=0x7f263000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f263ea00640 1 -- 172.21.15.32:0/202606193 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2630018020 con 0x7f26480cff90 2024-03-19T06:22:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f263ea00640 1 -- 172.21.15.32:0/202606193 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2630009e40 con 0x7f26480cff90 2024-03-19T06:22:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f263ea00640 1 -- 172.21.15.32:0/202606193 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2630014620 con 0x7f26480cff90 2024-03-19T06:22:30.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f2647200640 1 -- 172.21.15.32:0/202606193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26480b5690 con 0x7f26480cff90 2024-03-19T06:22:30.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f2647200640 1 -- 172.21.15.32:0/202606193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26480b5c50 con 0x7f26480cff90 2024-03-19T06:22:30.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.084+0000 7f2647200640 1 -- 172.21.15.32:0/202606193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2648075090 con 0x7f26480cff90 2024-03-19T06:22:30.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.088+0000 7f263ea00640 1 -- 172.21.15.32:0/202606193 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f263001b020 con 0x7f26480cff90 2024-03-19T06:22:30.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.088+0000 7f263ea00640 1 --2- 172.21.15.32:0/202606193 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2624067660 0x7f2624069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.088+0000 7f263ea00640 1 -- 172.21.15.32:0/202606193 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f2630086400 con 0x7f26480cff90 2024-03-19T06:22:30.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.088+0000 7f2645e00640 1 --2- 172.21.15.32:0/202606193 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2624067660 0x7f2624069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.088+0000 7f2645e00640 1 --2- 172.21.15.32:0/202606193 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2624067660 0x7f2624069b20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2638009b10 tx=0x7f2638008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:30.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.092+0000 7f263ea00640 1 -- 172.21.15.32:0/202606193 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2630022030 con 0x7f26480cff90 2024-03-19T06:22:30.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.271+0000 7f2647200640 1 -- 172.21.15.32:0/202606193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f26480b6050 con 0x7f26480cff90 2024-03-19T06:22:30.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.271+0000 7f263ea00640 1 -- 172.21.15.32:0/202606193 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2630056e50 con 0x7f26480cff90 2024-03-19T06:22:30.260 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:22:30.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.271+0000 7f2647200640 1 -- 172.21.15.32:0/202606193 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2624067660 msgr2=0x7f2624069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:30.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.271+0000 7f2647200640 1 --2- 172.21.15.32:0/202606193 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2624067660 0x7f2624069b20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2638009b10 tx=0x7f2638008040 comp rx=0 tx=0).stop 2024-03-19T06:22:30.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.271+0000 7f2647200640 1 -- 172.21.15.32:0/202606193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26480cff90 msgr2=0x7f26480c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:30.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.271+0000 7f2647200640 1 --2- 172.21.15.32:0/202606193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26480cff90 0x7f26480c86e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f263000ef00 tx=0x7f263000b480 comp rx=0 tx=0).stop 2024-03-19T06:22:30.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.275+0000 7f2647200640 1 -- 172.21.15.32:0/202606193 shutdown_connections 2024-03-19T06:22:30.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.275+0000 7f2647200640 1 --2- 172.21.15.32:0/202606193 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2624067660 0x7f2624069b20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.275+0000 7f2647200640 1 --2- 172.21.15.32:0/202606193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f264815ef90 0x7f264815c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.275+0000 7f2647200640 1 --2- 172.21.15.32:0/202606193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26480cff90 0x7f26480c86e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.275+0000 7f2647200640 1 --2- 172.21.15.32:0/202606193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26480b0650 0x7f26480c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.275+0000 7f2647200640 1 -- 172.21.15.32:0/202606193 >> 172.21.15.32:0/202606193 conn(0x7f26480d1610 msgr2=0x7f26480b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:30.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.275+0000 7f2647200640 1 -- 172.21.15.32:0/202606193 shutdown_connections 2024-03-19T06:22:30.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.275+0000 7f2647200640 1 -- 172.21.15.32:0/202606193 wait complete. 2024-03-19T06:22:30.281 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:22:30.281 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:22:30.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:22:30.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.483+0000 7f030b600640 1 Processor -- start 2024-03-19T06:22:30.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.483+0000 7f030b600640 1 -- start start 2024-03-19T06:22:30.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.487+0000 7f030b600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f030415a7c0 0x7f03040cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.487+0000 7f030b600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f03040cc680 0x7f030415ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.487+0000 7f030b600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03040cb670 con 0x7f03040b4c50 2024-03-19T06:22:30.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.487+0000 7f030b600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030415e860 con 0x7f030415a7c0 2024-03-19T06:22:30.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.487+0000 7f030b600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03040cb950 con 0x7f03040cc680 2024-03-19T06:22:30.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.487+0000 7f0308c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f030415a7c0 0x7f03040cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.487+0000 7f0309600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f03040b4c50 0x7f03040cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58896/0 (socket says 172.21.15.32:58896) 2024-03-19T06:22:30.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.487+0000 7f0308c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f030415a7c0 0x7f03040cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60060/0 (socket says 172.21.15.32:60060) 2024-03-19T06:22:30.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.487+0000 7f0309600640 1 -- 172.21.15.32:0/3305294054 learned_addr learned my addr 172.21.15.32:0/3305294054 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:30.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.487+0000 7f0303e00640 1 --2- 172.21.15.32:0/3305294054 >> v2:172.21.15.171:3300/0 conn(0x7f03040cc680 0x7f030415ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.487+0000 7f0308c00640 1 -- 172.21.15.32:0/3305294054 >> v2:172.21.15.171:3300/0 conn(0x7f03040cc680 msgr2=0x7f030415ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:30.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.487+0000 7f0308c00640 1 --2- 172.21.15.32:0/3305294054 >> v2:172.21.15.171:3300/0 conn(0x7f03040cc680 0x7f030415ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.487+0000 7f0308c00640 1 -- 172.21.15.32:0/3305294054 >> v1:172.21.15.32:6789/0 conn(0x7f03040b4c50 legacy=0x7f03040cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:30.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.487+0000 7f0303400640 1 -- 172.21.15.32:0/3305294054 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745789661 0 0) 0x7f03040cb670 con 0x7f03040b4c50 2024-03-19T06:22:30.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.487+0000 7f0308c00640 1 -- 172.21.15.32:0/3305294054 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030415e4f0 con 0x7f030415a7c0 2024-03-19T06:22:30.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.487+0000 7f0308c00640 1 --2- 172.21.15.32:0/3305294054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f030415a7c0 0x7f03040cae20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f03040ccfa0 tx=0x7f02f801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8943dc6c676b9535 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:30.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f0303400640 1 -- 172.21.15.32:0/3305294054 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f80ab640 con 0x7f030415a7c0 2024-03-19T06:22:30.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f0303400640 1 -- 172.21.15.32:0/3305294054 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f80b0070 con 0x7f030415a7c0 2024-03-19T06:22:30.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f0303400640 1 -- 172.21.15.32:0/3305294054 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f80aba00 con 0x7f030415a7c0 2024-03-19T06:22:30.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f030b600640 1 -- 172.21.15.32:0/3305294054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f030415a7c0 msgr2=0x7f03040cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:30.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f030b600640 1 --2- 172.21.15.32:0/3305294054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f030415a7c0 0x7f03040cae20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f03040ccfa0 tx=0x7f02f801c420 comp rx=0 tx=0).stop 2024-03-19T06:22:30.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f030b600640 1 -- 172.21.15.32:0/3305294054 shutdown_connections 2024-03-19T06:22:30.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f030b600640 1 --2- 172.21.15.32:0/3305294054 >> v2:172.21.15.171:3300/0 conn(0x7f03040cc680 0x7f030415ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f030b600640 1 --2- 172.21.15.32:0/3305294054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f030415a7c0 0x7f03040cae20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f030b600640 1 -- 172.21.15.32:0/3305294054 >> 172.21.15.32:0/3305294054 conn(0x7f03040b1280 msgr2=0x7f03040b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:30.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f030b600640 1 -- 172.21.15.32:0/3305294054 shutdown_connections 2024-03-19T06:22:30.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f030b600640 1 -- 172.21.15.32:0/3305294054 wait complete. 2024-03-19T06:22:30.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f030b600640 1 Processor -- start 2024-03-19T06:22:30.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f030b600640 1 -- start start 2024-03-19T06:22:30.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f030b600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03040b4c50 0x7f03041390f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f030b600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03040cc680 0x7f0304149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f030b600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f030415a7c0 0x7f03040716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f030b600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030415f3b0 con 0x7f03040b4c50 2024-03-19T06:22:30.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f030b600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030415f230 con 0x7f03040cc680 2024-03-19T06:22:30.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f030b600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03040cbc30 con 0x7f030415a7c0 2024-03-19T06:22:30.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f0308c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03040b4c50 0x7f03041390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f0308c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03040b4c50 0x7f03041390f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60062/0 (socket says 172.21.15.32:60062) 2024-03-19T06:22:30.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f0308c00640 1 -- 172.21.15.32:0/266308723 learned_addr learned my addr 172.21.15.32:0/266308723 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:30.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f0303e00640 1 --2- 172.21.15.32:0/266308723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03040cc680 0x7f0304149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.491+0000 7f0309600640 1 --2- 172.21.15.32:0/266308723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f030415a7c0 0x7f03040716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.495+0000 7f0308c00640 1 -- 172.21.15.32:0/266308723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f030415a7c0 msgr2=0x7f03040716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:30.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.495+0000 7f0308c00640 1 --2- 172.21.15.32:0/266308723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f030415a7c0 0x7f03040716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.495+0000 7f0308c00640 1 -- 172.21.15.32:0/266308723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03040cc680 msgr2=0x7f0304149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:30.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.495+0000 7f0308c00640 1 --2- 172.21.15.32:0/266308723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03040cc680 0x7f0304149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.495+0000 7f0308c00640 1 -- 172.21.15.32:0/266308723 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030414a890 con 0x7f03040b4c50 2024-03-19T06:22:30.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.495+0000 7f0308c00640 1 --2- 172.21.15.32:0/266308723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03040b4c50 0x7f03041390f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f02f80ad040 tx=0x7f02f801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:30.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.495+0000 7f0300c00640 1 -- 172.21.15.32:0/266308723 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f80bf410 con 0x7f03040b4c50 2024-03-19T06:22:30.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.495+0000 7f0300c00640 1 -- 172.21.15.32:0/266308723 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f80bf5b0 con 0x7f03040b4c50 2024-03-19T06:22:30.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.495+0000 7f0300c00640 1 -- 172.21.15.32:0/266308723 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f80bf980 con 0x7f03040b4c50 2024-03-19T06:22:30.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.495+0000 7f030b600640 1 -- 172.21.15.32:0/266308723 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030414ab70 con 0x7f03040b4c50 2024-03-19T06:22:30.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.495+0000 7f030b600640 1 -- 172.21.15.32:0/266308723 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03041471d0 con 0x7f03040b4c50 2024-03-19T06:22:30.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.495+0000 7f030b600640 1 -- 172.21.15.32:0/266308723 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03040749e0 con 0x7f03040b4c50 2024-03-19T06:22:30.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.495+0000 7f0300c00640 1 -- 172.21.15.32:0/266308723 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f02f80bd020 con 0x7f03040b4c50 2024-03-19T06:22:30.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.499+0000 7f0300c00640 1 --2- 172.21.15.32:0/266308723 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f02e4067690 0x7f02e4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.499+0000 7f0300c00640 1 -- 172.21.15.32:0/266308723 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f02f811f720 con 0x7f03040b4c50 2024-03-19T06:22:30.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.499+0000 7f0303e00640 1 --2- 172.21.15.32:0/266308723 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f02e4067690 0x7f02e4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.499+0000 7f0303e00640 1 --2- 172.21.15.32:0/266308723 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f02e4067690 0x7f02e4069b50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f03040b0e80 tx=0x7f02f0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:30.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.503+0000 7f0300c00640 1 -- 172.21.15.32:0/266308723 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f02f80c6070 con 0x7f03040b4c50 2024-03-19T06:22:30.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.667+0000 7f030b600640 1 -- 172.21.15.32:0/266308723 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03040cc270 con 0x7f03040b4c50 2024-03-19T06:22:30.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.667+0000 7f0300c00640 1 -- 172.21.15.32:0/266308723 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18493 (secure 0 0 0) 0x7f02f8016070 con 0x7f03040b4c50 2024-03-19T06:22:30.656 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:30.656 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":38,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:22:27.853859+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:22:09.983589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-19T06:22:11.172289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-19T06:22:25.205334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:22:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.667+0000 7f030b600640 1 -- 172.21.15.32:0/266308723 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f02e4067690 msgr2=0x7f02e4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.667+0000 7f030b600640 1 --2- 172.21.15.32:0/266308723 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f02e4067690 0x7f02e4069b50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f03040b0e80 tx=0x7f02f0008040 comp rx=0 tx=0).stop 2024-03-19T06:22:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.667+0000 7f030b600640 1 -- 172.21.15.32:0/266308723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03040b4c50 msgr2=0x7f03041390f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.667+0000 7f030b600640 1 --2- 172.21.15.32:0/266308723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03040b4c50 0x7f03041390f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f02f80ad040 tx=0x7f02f801acc0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.667+0000 7f030b600640 1 -- 172.21.15.32:0/266308723 shutdown_connections 2024-03-19T06:22:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.667+0000 7f030b600640 1 --2- 172.21.15.32:0/266308723 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f02e4067690 0x7f02e4069b50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.667+0000 7f030b600640 1 --2- 172.21.15.32:0/266308723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f030415a7c0 0x7f03040716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.667+0000 7f030b600640 1 --2- 172.21.15.32:0/266308723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03040cc680 0x7f0304149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.667+0000 7f030b600640 1 --2- 172.21.15.32:0/266308723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03040b4c50 0x7f03041390f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.667+0000 7f030b600640 1 -- 172.21.15.32:0/266308723 >> 172.21.15.32:0/266308723 conn(0x7f03040b1280 msgr2=0x7f0304150ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.667+0000 7f030b600640 1 -- 172.21.15.32:0/266308723 shutdown_connections 2024-03-19T06:22:30.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.667+0000 7f030b600640 1 -- 172.21.15.32:0/266308723 wait complete. 2024-03-19T06:22:30.676 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:22:09.983589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:22:11.172289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2024-03-19T06:22:25.205334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:22:30.677 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:22:30.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.831+0000 7fb667200640 1 Processor -- start 2024-03-19T06:22:30.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.831+0000 7fb667200640 1 -- start start 2024-03-19T06:22:30.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.831+0000 7fb667200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb66015dbb0 0x7fb66006c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.831+0000 7fb667200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb66006c5a0 0x7fb6600b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.831+0000 7fb667200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6600cbf00 con 0x7fb6600b3b60 2024-03-19T06:22:30.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.831+0000 7fb667200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6600b3f40 con 0x7fb66006c5a0 2024-03-19T06:22:30.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.831+0000 7fb667200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66006cb20 con 0x7fb66015dbb0 2024-03-19T06:22:30.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.835+0000 7fb657e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb66006c5a0 0x7fb6600b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.835+0000 7fb657e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb66006c5a0 0x7fb6600b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60072/0 (socket says 172.21.15.32:60072) 2024-03-19T06:22:30.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.835+0000 7fb657e00640 1 -- 172.21.15.32:0/1545061682 learned_addr learned my addr 172.21.15.32:0/1545061682 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:30.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.835+0000 7fb65fe00640 1 --2- 172.21.15.32:0/1545061682 >> v2:172.21.15.171:3300/0 conn(0x7fb66015dbb0 0x7fb66006c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.835+0000 7fb657e00640 1 -- 172.21.15.32:0/1545061682 >> v2:172.21.15.171:3300/0 conn(0x7fb66015dbb0 msgr2=0x7fb66006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:30.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.835+0000 7fb657e00640 1 --2- 172.21.15.32:0/1545061682 >> v2:172.21.15.171:3300/0 conn(0x7fb66015dbb0 0x7fb66006c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.835+0000 7fb657e00640 1 -- 172.21.15.32:0/1545061682 >> v1:172.21.15.171:6789/0 conn(0x7fb6600b3b60 legacy=0x7fb6600d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:30.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.835+0000 7fb657e00640 1 -- 172.21.15.32:0/1545061682 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66006ce00 con 0x7fb66006c5a0 2024-03-19T06:22:30.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.835+0000 7fb657e00640 1 --2- 172.21.15.32:0/1545061682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb66006c5a0 0x7fb6600b3620 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb660072f00 tx=0x7fb64801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da50b2a066c1833 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:30.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.835+0000 7fb65f400640 1 -- 172.21.15.32:0/1545061682 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6480b5070 con 0x7fb66006c5a0 2024-03-19T06:22:30.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.835+0000 7fb65f400640 1 -- 172.21.15.32:0/1545061682 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6480a8a10 con 0x7fb66006c5a0 2024-03-19T06:22:30.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.835+0000 7fb65f400640 1 -- 172.21.15.32:0/1545061682 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6480a8de0 con 0x7fb66006c5a0 2024-03-19T06:22:30.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb667200640 1 -- 172.21.15.32:0/1545061682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb66006c5a0 msgr2=0x7fb6600b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:30.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb667200640 1 --2- 172.21.15.32:0/1545061682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb66006c5a0 0x7fb6600b3620 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb660072f00 tx=0x7fb64801ed10 comp rx=0 tx=0).stop 2024-03-19T06:22:30.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb667200640 1 -- 172.21.15.32:0/1545061682 shutdown_connections 2024-03-19T06:22:30.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb667200640 1 --2- 172.21.15.32:0/1545061682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb66006c5a0 0x7fb6600b3620 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb667200640 1 --2- 172.21.15.32:0/1545061682 >> v2:172.21.15.171:3300/0 conn(0x7fb66015dbb0 0x7fb66006c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb667200640 1 -- 172.21.15.32:0/1545061682 >> 172.21.15.32:0/1545061682 conn(0x7fb660066ca0 msgr2=0x7fb6600670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:30.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb667200640 1 -- 172.21.15.32:0/1545061682 shutdown_connections 2024-03-19T06:22:30.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb667200640 1 -- 172.21.15.32:0/1545061682 wait complete. 2024-03-19T06:22:30.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb667200640 1 Processor -- start 2024-03-19T06:22:30.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb667200640 1 -- start start 2024-03-19T06:22:30.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb667200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb66006c5a0 0x7fb66015a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb667200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6600b3b60 0x7fb6600b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb667200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb66015dbb0 0x7fb6600b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb667200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66006d910 con 0x7fb66006c5a0 2024-03-19T06:22:30.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb667200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600cc1a0 con 0x7fb6600b3b60 2024-03-19T06:22:30.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb667200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66015df90 con 0x7fb66015dbb0 2024-03-19T06:22:30.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb65fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb66006c5a0 0x7fb66015a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb65fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb66006c5a0 0x7fb66015a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60084/0 (socket says 172.21.15.32:60084) 2024-03-19T06:22:30.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb65fe00640 1 -- 172.21.15.32:0/1657844499 learned_addr learned my addr 172.21.15.32:0/1657844499 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:30.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb65fe00640 1 -- 172.21.15.32:0/1657844499 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb66015dbb0 msgr2=0x7fb6600b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:30.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb65fe00640 1 --2- 172.21.15.32:0/1657844499 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb66015dbb0 0x7fb6600b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb65fe00640 1 -- 172.21.15.32:0/1657844499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6600b3b60 msgr2=0x7fb6600b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:30.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb65fe00640 1 --2- 172.21.15.32:0/1657844499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6600b3b60 0x7fb6600b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:30.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb65fe00640 1 -- 172.21.15.32:0/1657844499 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6600b4400 con 0x7fb66006c5a0 2024-03-19T06:22:30.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.839+0000 7fb65fe00640 1 --2- 172.21.15.32:0/1657844499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb66006c5a0 0x7fb66015a110 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb65000e930 tx=0x7fb65000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:30.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.843+0000 7fb65cc00640 1 -- 172.21.15.32:0/1657844499 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650017070 con 0x7fb66006c5a0 2024-03-19T06:22:30.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.843+0000 7fb65cc00640 1 -- 172.21.15.32:0/1657844499 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65000ca00 con 0x7fb66006c5a0 2024-03-19T06:22:30.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.843+0000 7fb65cc00640 1 -- 172.21.15.32:0/1657844499 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65000cdb0 con 0x7fb66006c5a0 2024-03-19T06:22:30.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.843+0000 7fb667200640 1 -- 172.21.15.32:0/1657844499 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6600b46e0 con 0x7fb66006c5a0 2024-03-19T06:22:30.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.843+0000 7fb667200640 1 -- 172.21.15.32:0/1657844499 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6600c7520 con 0x7fb66006c5a0 2024-03-19T06:22:30.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.843+0000 7fb667200640 1 -- 172.21.15.32:0/1657844499 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6600749e0 con 0x7fb66006c5a0 2024-03-19T06:22:30.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.843+0000 7fb65cc00640 1 -- 172.21.15.32:0/1657844499 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb65001a070 con 0x7fb66006c5a0 2024-03-19T06:22:30.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.843+0000 7fb65cc00640 1 --2- 172.21.15.32:0/1657844499 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb63c067660 0x7fb63c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:30.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.843+0000 7fb65cc00640 1 -- 172.21.15.32:0/1657844499 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fb650085ed0 con 0x7fb66006c5a0 2024-03-19T06:22:30.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.843+0000 7fb657e00640 1 --2- 172.21.15.32:0/1657844499 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb63c067660 0x7fb63c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:30.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.847+0000 7fb657e00640 1 --2- 172.21.15.32:0/1657844499 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb63c067660 0x7fb63c069b20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb6480b2000 tx=0x7fb648004740 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:30.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:30.847+0000 7fb65cc00640 1 -- 172.21.15.32:0/1657844499 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fb6500569e0 con 0x7fb66006c5a0 2024-03-19T06:22:31.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.015+0000 7fb667200640 1 -- 172.21.15.32:0/1657844499 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb6600ce990 con 0x7fb66006c5a0 2024-03-19T06:22:31.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.015+0000 7fb65cc00640 1 -- 172.21.15.32:0/1657844499 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6500562e0 con 0x7fb66006c5a0 2024-03-19T06:22:31.006 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:22:31.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.019+0000 7fb667200640 1 -- 172.21.15.32:0/1657844499 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb63c067660 msgr2=0x7fb63c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.019+0000 7fb667200640 1 --2- 172.21.15.32:0/1657844499 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb63c067660 0x7fb63c069b20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb6480b2000 tx=0x7fb648004740 comp rx=0 tx=0).stop 2024-03-19T06:22:31.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.019+0000 7fb667200640 1 -- 172.21.15.32:0/1657844499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb66006c5a0 msgr2=0x7fb66015a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.019+0000 7fb667200640 1 --2- 172.21.15.32:0/1657844499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb66006c5a0 0x7fb66015a110 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb65000e930 tx=0x7fb65000edf0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.019+0000 7fb667200640 1 -- 172.21.15.32:0/1657844499 shutdown_connections 2024-03-19T06:22:31.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.019+0000 7fb667200640 1 --2- 172.21.15.32:0/1657844499 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb63c067660 0x7fb63c069b20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.019+0000 7fb667200640 1 --2- 172.21.15.32:0/1657844499 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb66015dbb0 0x7fb6600b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.019+0000 7fb667200640 1 --2- 172.21.15.32:0/1657844499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6600b3b60 0x7fb6600b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.019+0000 7fb667200640 1 --2- 172.21.15.32:0/1657844499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb66006c5a0 0x7fb66015a110 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.019+0000 7fb667200640 1 -- 172.21.15.32:0/1657844499 >> 172.21.15.32:0/1657844499 conn(0x7fb660066ca0 msgr2=0x7fb660067080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:31.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.019+0000 7fb667200640 1 -- 172.21.15.32:0/1657844499 shutdown_connections 2024-03-19T06:22:31.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.019+0000 7fb667200640 1 -- 172.21.15.32:0/1657844499 wait complete. 2024-03-19T06:22:31.027 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:22:31.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcefb800640 1 Processor -- start 2024-03-19T06:22:31.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcefb800640 1 -- start start 2024-03-19T06:22:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcefb800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef40cf7c0 0x7fcef40b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcefb800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcef4161650 0x7fcef4161ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcefb800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcef415e060 0x7fcef415e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcefb800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef4161ff0 con 0x7fcef415e060 2024-03-19T06:22:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcefb800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef406ec30 con 0x7fcef4161650 2024-03-19T06:22:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcefb800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef406ef10 con 0x7fcef40cf7c0 2024-03-19T06:22:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcef9800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcef415e060 0x7fcef415e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcef9800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcef415e060 0x7fcef415e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60100/0 (socket says 172.21.15.32:60100) 2024-03-19T06:22:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcef9800640 1 -- 172.21.15.32:0/2563267994 learned_addr learned my addr 172.21.15.32:0/2563267994 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcef8e00640 1 --2- 172.21.15.32:0/2563267994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef40cf7c0 0x7fcef40b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcef3e00640 1 --2- 172.21.15.32:0/2563267994 >> v2:172.21.15.171:3300/0 conn(0x7fcef4161650 0x7fcef4161ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcef9800640 1 -- 172.21.15.32:0/2563267994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef40cf7c0 msgr2=0x7fcef40b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:31.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcef9800640 1 --2- 172.21.15.32:0/2563267994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef40cf7c0 0x7fcef40b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcef9800640 1 -- 172.21.15.32:0/2563267994 >> v2:172.21.15.171:3300/0 conn(0x7fcef4161650 msgr2=0x7fcef4161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:31.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcef9800640 1 --2- 172.21.15.32:0/2563267994 >> v2:172.21.15.171:3300/0 conn(0x7fcef4161650 0x7fcef4161ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcef9800640 1 -- 172.21.15.32:0/2563267994 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef406f1f0 con 0x7fcef415e060 2024-03-19T06:22:31.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.183+0000 7fcef8e00640 1 --2- 172.21.15.32:0/2563267994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef40cf7c0 0x7fcef40b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:31.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.187+0000 7fcef9800640 1 --2- 172.21.15.32:0/2563267994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef415e060 0x7fcef415e4d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcef409de80 tx=0x7fceec01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a1c1e59afad6bb server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:31.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.187+0000 7fcef3400640 1 -- 172.21.15.32:0/2563267994 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec0a5840 con 0x7fcef415e060 2024-03-19T06:22:31.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.187+0000 7fcef3400640 1 -- 172.21.15.32:0/2563267994 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec0a59e0 con 0x7fcef415e060 2024-03-19T06:22:31.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.187+0000 7fcef3400640 1 -- 172.21.15.32:0/2563267994 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec0a5db0 con 0x7fcef415e060 2024-03-19T06:22:31.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.187+0000 7fcefb800640 1 -- 172.21.15.32:0/2563267994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef415e060 msgr2=0x7fcef415e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.187+0000 7fcefb800640 1 --2- 172.21.15.32:0/2563267994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef415e060 0x7fcef415e4d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcef409de80 tx=0x7fceec01c9c0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.187+0000 7fcefb800640 1 -- 172.21.15.32:0/2563267994 shutdown_connections 2024-03-19T06:22:31.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.187+0000 7fcefb800640 1 --2- 172.21.15.32:0/2563267994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef415e060 0x7fcef415e4d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.187+0000 7fcefb800640 1 --2- 172.21.15.32:0/2563267994 >> v2:172.21.15.171:3300/0 conn(0x7fcef4161650 0x7fcef4161ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.187+0000 7fcefb800640 1 --2- 172.21.15.32:0/2563267994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef40cf7c0 0x7fcef40b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.187+0000 7fcefb800640 1 -- 172.21.15.32:0/2563267994 >> 172.21.15.32:0/2563267994 conn(0x7fcef40b2480 msgr2=0x7fcef40cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:31.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.187+0000 7fcefb800640 1 -- 172.21.15.32:0/2563267994 shutdown_connections 2024-03-19T06:22:31.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.187+0000 7fcefb800640 1 -- 172.21.15.32:0/2563267994 wait complete. 2024-03-19T06:22:31.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcefb800640 1 Processor -- start 2024-03-19T06:22:31.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcefb800640 1 -- start start 2024-03-19T06:22:31.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcefb800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef40cf7c0 0x7fcef4157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcefb800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcef415e060 0x7fcef414e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcefb800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef4161650 0x7fcef409d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcefb800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40b2f80 con 0x7fcef4161650 2024-03-19T06:22:31.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcefb800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef415ee20 con 0x7fcef415e060 2024-03-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcefb800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40b3100 con 0x7fcef40cf7c0 2024-03-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcef9800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef4161650 0x7fcef409d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcef9800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef4161650 0x7fcef409d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60114/0 (socket says 172.21.15.32:60114) 2024-03-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcef9800640 1 -- 172.21.15.32:0/4128608785 learned_addr learned my addr 172.21.15.32:0/4128608785 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcef8e00640 1 --2- 172.21.15.32:0/4128608785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef40cf7c0 0x7fcef4157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcef3e00640 1 --2- 172.21.15.32:0/4128608785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcef415e060 0x7fcef414e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcef9800640 1 -- 172.21.15.32:0/4128608785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef40cf7c0 msgr2=0x7fcef4157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcef9800640 1 --2- 172.21.15.32:0/4128608785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef40cf7c0 0x7fcef4157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcef9800640 1 -- 172.21.15.32:0/4128608785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcef415e060 msgr2=0x7fcef414e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcef9800640 1 --2- 172.21.15.32:0/4128608785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcef415e060 0x7fcef414e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcef9800640 1 -- 172.21.15.32:0/4128608785 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef415efa0 con 0x7fcef4161650 2024-03-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcef9800640 1 --2- 172.21.15.32:0/4128608785 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef4161650 0x7fcef409d5c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fceec0af040 tx=0x7fceec019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:31.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcef0c00640 1 -- 172.21.15.32:0/4128608785 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec0bc020 con 0x7fcef4161650 2024-03-19T06:22:31.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcef0c00640 1 -- 172.21.15.32:0/4128608785 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec0b8690 con 0x7fcef4161650 2024-03-19T06:22:31.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcef0c00640 1 -- 172.21.15.32:0/4128608785 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec0b8a80 con 0x7fcef4161650 2024-03-19T06:22:31.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcefb800640 1 -- 172.21.15.32:0/4128608785 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef4157a30 con 0x7fcef4161650 2024-03-19T06:22:31.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcefb800640 1 -- 172.21.15.32:0/4128608785 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef4157ff0 con 0x7fcef4161650 2024-03-19T06:22:31.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.191+0000 7fcefb800640 1 -- 172.21.15.32:0/4128608785 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef40749e0 con 0x7fcef4161650 2024-03-19T06:22:31.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.195+0000 7fcef0c00640 1 -- 172.21.15.32:0/4128608785 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fceec0bf020 con 0x7fcef4161650 2024-03-19T06:22:31.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.195+0000 7fcef0c00640 1 --2- 172.21.15.32:0/4128608785 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fced4067660 0x7fced4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.195+0000 7fcef0c00640 1 -- 172.21.15.32:0/4128608785 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fceec120830 con 0x7fcef4161650 2024-03-19T06:22:31.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.195+0000 7fcef8e00640 1 --2- 172.21.15.32:0/4128608785 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fced4067660 0x7fced4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.195+0000 7fcef8e00640 1 --2- 172.21.15.32:0/4128608785 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fced4067660 0x7fced4069b20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcee80045f0 tx=0x7fcee8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:31.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.199+0000 7fcef0c00640 1 -- 172.21.15.32:0/4128608785 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fceec0c6070 con 0x7fcef4161650 2024-03-19T06:22:31.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.359+0000 7fcefb800640 1 -- 172.21.15.32:0/4128608785 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcef40d0cc0 con 0x7fcef4161650 2024-03-19T06:22:31.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.363+0000 7fcef0c00640 1 -- 172.21.15.32:0/4128608785 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7fceec0165e0 con 0x7fcef4161650 2024-03-19T06:22:31.351 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:22:31.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.363+0000 7fcefb800640 1 -- 172.21.15.32:0/4128608785 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fced4067660 msgr2=0x7fced4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.363+0000 7fcefb800640 1 --2- 172.21.15.32:0/4128608785 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fced4067660 0x7fced4069b20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcee80045f0 tx=0x7fcee8008040 comp rx=0 tx=0).stop 2024-03-19T06:22:31.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.363+0000 7fcefb800640 1 -- 172.21.15.32:0/4128608785 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef4161650 msgr2=0x7fcef409d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.363+0000 7fcefb800640 1 --2- 172.21.15.32:0/4128608785 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef4161650 0x7fcef409d5c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fceec0af040 tx=0x7fceec019760 comp rx=0 tx=0).stop 2024-03-19T06:22:31.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.363+0000 7fcefb800640 1 -- 172.21.15.32:0/4128608785 shutdown_connections 2024-03-19T06:22:31.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.363+0000 7fcefb800640 1 --2- 172.21.15.32:0/4128608785 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fced4067660 0x7fced4069b20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.363+0000 7fcefb800640 1 --2- 172.21.15.32:0/4128608785 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef4161650 0x7fcef409d5c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.363+0000 7fcefb800640 1 --2- 172.21.15.32:0/4128608785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcef415e060 0x7fcef414e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.363+0000 7fcefb800640 1 --2- 172.21.15.32:0/4128608785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef40cf7c0 0x7fcef4157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.363+0000 7fcefb800640 1 -- 172.21.15.32:0/4128608785 >> 172.21.15.32:0/4128608785 conn(0x7fcef40b2480 msgr2=0x7fcef40ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:31.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.363+0000 7fcefb800640 1 -- 172.21.15.32:0/4128608785 shutdown_connections 2024-03-19T06:22:31.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.363+0000 7fcefb800640 1 -- 172.21.15.32:0/4128608785 wait complete. 2024-03-19T06:22:31.372 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:22:31.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.527+0000 7f524b400640 1 Processor -- start 2024-03-19T06:22:31.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.527+0000 7f524b400640 1 -- start start 2024-03-19T06:22:31.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.527+0000 7f524b400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f524415ba00 0x7f52440b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.527+0000 7f524b400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f52440b7530 0x7f52440b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.527+0000 7f524b400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52440b4010 con 0x7f52440b3c10 2024-03-19T06:22:31.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.527+0000 7f524b400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52440d20c0 con 0x7f52440b7530 2024-03-19T06:22:31.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.527+0000 7f524b400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52440d08f0 con 0x7f524415ba00 2024-03-19T06:22:31.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.527+0000 7f523be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f52440b7530 0x7f52440b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.527+0000 7f5249400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f52440b3c10 0x7f524415f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58912/0 (socket says 172.21.15.32:58912) 2024-03-19T06:22:31.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.527+0000 7f5249400640 1 -- 172.21.15.32:0/3099590351 learned_addr learned my addr 172.21.15.32:0/3099590351 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:31.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.527+0000 7f5248a00640 1 --2- 172.21.15.32:0/3099590351 >> v2:172.21.15.171:3300/0 conn(0x7f524415ba00 0x7f52440b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.527+0000 7f523be00640 1 -- 172.21.15.32:0/3099590351 >> v2:172.21.15.171:3300/0 conn(0x7f524415ba00 msgr2=0x7f52440b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:31.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.527+0000 7f523be00640 1 --2- 172.21.15.32:0/3099590351 >> v2:172.21.15.171:3300/0 conn(0x7f524415ba00 0x7f52440b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.527+0000 7f523be00640 1 -- 172.21.15.32:0/3099590351 >> v1:172.21.15.32:6789/0 conn(0x7f52440b3c10 legacy=0x7f524415f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.527+0000 7f523be00640 1 -- 172.21.15.32:0/3099590351 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52440d14b0 con 0x7f52440b7530 2024-03-19T06:22:31.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.527+0000 7f5243e00640 1 -- 172.21.15.32:0/3099590351 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344633309 0 0) 0x7f52440b4010 con 0x7f52440b3c10 2024-03-19T06:22:31.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.531+0000 7f523be00640 1 --2- 172.21.15.32:0/3099590351 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52440b7530 0x7f52440b36d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f52440b43e0 tx=0x7f522c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4023bba9d35d43e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:31.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.531+0000 7f5243e00640 1 -- 172.21.15.32:0/3099590351 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c0b5070 con 0x7f52440b7530 2024-03-19T06:22:31.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.531+0000 7f5243e00640 1 -- 172.21.15.32:0/3099590351 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c0a8970 con 0x7f52440b7530 2024-03-19T06:22:31.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.531+0000 7f5243e00640 1 -- 172.21.15.32:0/3099590351 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c0a8d40 con 0x7f52440b7530 2024-03-19T06:22:31.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.531+0000 7f524b400640 1 -- 172.21.15.32:0/3099590351 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52440b7530 msgr2=0x7f52440b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.531+0000 7f524b400640 1 --2- 172.21.15.32:0/3099590351 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52440b7530 0x7f52440b36d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f52440b43e0 tx=0x7f522c01ec70 comp rx=0 tx=0).stop 2024-03-19T06:22:31.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.531+0000 7f524b400640 1 -- 172.21.15.32:0/3099590351 shutdown_connections 2024-03-19T06:22:31.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.531+0000 7f524b400640 1 --2- 172.21.15.32:0/3099590351 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52440b7530 0x7f52440b36d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.531+0000 7f524b400640 1 --2- 172.21.15.32:0/3099590351 >> v2:172.21.15.171:3300/0 conn(0x7f524415ba00 0x7f52440b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.531+0000 7f524b400640 1 -- 172.21.15.32:0/3099590351 >> 172.21.15.32:0/3099590351 conn(0x7f5244066ca0 msgr2=0x7f52440670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:31.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.531+0000 7f524b400640 1 -- 172.21.15.32:0/3099590351 shutdown_connections 2024-03-19T06:22:31.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.531+0000 7f524b400640 1 -- 172.21.15.32:0/3099590351 wait complete. 2024-03-19T06:22:31.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f524b400640 1 Processor -- start 2024-03-19T06:22:31.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f524b400640 1 -- start start 2024-03-19T06:22:31.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f524b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52440b3c10 0x7f524415db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f524b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52440b7530 0x7f524414af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f524b400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f524415ba00 0x7f5244147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f524b400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440d1d50 con 0x7f52440b3c10 2024-03-19T06:22:31.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f524b400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440d1a70 con 0x7f524415ba00 2024-03-19T06:22:31.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f524b400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524415bde0 con 0x7f52440b7530 2024-03-19T06:22:31.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f5248a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52440b3c10 0x7f524415db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f5248a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52440b3c10 0x7f524415db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60130/0 (socket says 172.21.15.32:60130) 2024-03-19T06:22:31.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f5248a00640 1 -- 172.21.15.32:0/3233876951 learned_addr learned my addr 172.21.15.32:0/3233876951 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:31.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f5248a00640 1 -- 172.21.15.32:0/3233876951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52440b7530 msgr2=0x7f524414af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f5248a00640 1 --2- 172.21.15.32:0/3233876951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52440b7530 0x7f524414af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f5248a00640 1 -- 172.21.15.32:0/3233876951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f524415ba00 msgr2=0x7f5244147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f5248a00640 1 --2- 172.21.15.32:0/3233876951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f524415ba00 0x7f5244147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f5248a00640 1 -- 172.21.15.32:0/3233876951 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5244148130 con 0x7f52440b3c10 2024-03-19T06:22:31.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f5248a00640 1 --2- 172.21.15.32:0/3233876951 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52440b3c10 0x7f524415db40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f523400e8a0 tx=0x7f523400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:31.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f5241600640 1 -- 172.21.15.32:0/3233876951 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234017070 con 0x7f52440b3c10 2024-03-19T06:22:31.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f5241600640 1 -- 172.21.15.32:0/3233876951 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523400c940 con 0x7f52440b3c10 2024-03-19T06:22:31.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f524b400640 1 -- 172.21.15.32:0/3233876951 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524415e240 con 0x7f52440b3c10 2024-03-19T06:22:31.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f5241600640 1 -- 172.21.15.32:0/3233876951 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523400ccf0 con 0x7f52440b3c10 2024-03-19T06:22:31.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.535+0000 7f524b400640 1 -- 172.21.15.32:0/3233876951 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524415e800 con 0x7f52440b3c10 2024-03-19T06:22:31.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.539+0000 7f524b400640 1 -- 172.21.15.32:0/3233876951 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524415ea40 con 0x7f52440b3c10 2024-03-19T06:22:31.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.539+0000 7f5241600640 1 -- 172.21.15.32:0/3233876951 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f523401a070 con 0x7f52440b3c10 2024-03-19T06:22:31.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.539+0000 7f5241600640 1 --2- 172.21.15.32:0/3233876951 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5220067660 0x7f5220069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.539+0000 7f5241600640 1 -- 172.21.15.32:0/3233876951 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f5234085a10 con 0x7f52440b3c10 2024-03-19T06:22:31.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.539+0000 7f523be00640 1 --2- 172.21.15.32:0/3233876951 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5220067660 0x7f5220069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.539+0000 7f523be00640 1 --2- 172.21.15.32:0/3233876951 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5220067660 0x7f5220069b20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f522c0b2000 tx=0x7f522c004740 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:31.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.543+0000 7f5241600640 1 -- 172.21.15.32:0/3233876951 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f524415ea40 con 0x7f52440b3c10 2024-03-19T06:22:31.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.707+0000 7f524b400640 1 -- 172.21.15.32:0/3233876951 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52440749e0 con 0x7f52440b3c10 2024-03-19T06:22:31.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.707+0000 7f5241600640 1 -- 172.21.15.32:0/3233876951 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5234056460 con 0x7f52440b3c10 2024-03-19T06:22:31.696 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:22:31.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.711+0000 7f524b400640 1 -- 172.21.15.32:0/3233876951 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5220067660 msgr2=0x7f5220069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.711+0000 7f524b400640 1 --2- 172.21.15.32:0/3233876951 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5220067660 0x7f5220069b20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f522c0b2000 tx=0x7f522c004740 comp rx=0 tx=0).stop 2024-03-19T06:22:31.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.711+0000 7f524b400640 1 -- 172.21.15.32:0/3233876951 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52440b3c10 msgr2=0x7f524415db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.711+0000 7f524b400640 1 --2- 172.21.15.32:0/3233876951 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52440b3c10 0x7f524415db40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f523400e8a0 tx=0x7f523400eca0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.711+0000 7f524b400640 1 -- 172.21.15.32:0/3233876951 shutdown_connections 2024-03-19T06:22:31.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.711+0000 7f524b400640 1 --2- 172.21.15.32:0/3233876951 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5220067660 0x7f5220069b20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.711+0000 7f524b400640 1 --2- 172.21.15.32:0/3233876951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f524415ba00 0x7f5244147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.711+0000 7f524b400640 1 --2- 172.21.15.32:0/3233876951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52440b7530 0x7f524414af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.711+0000 7f524b400640 1 --2- 172.21.15.32:0/3233876951 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52440b3c10 0x7f524415db40 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.711+0000 7f524b400640 1 -- 172.21.15.32:0/3233876951 >> 172.21.15.32:0/3233876951 conn(0x7f5244066ca0 msgr2=0x7f52440b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:31.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.711+0000 7f524b400640 1 -- 172.21.15.32:0/3233876951 shutdown_connections 2024-03-19T06:22:31.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.711+0000 7f524b400640 1 -- 172.21.15.32:0/3233876951 wait complete. 2024-03-19T06:22:31.717 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-03-19T06:22:31.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.871+0000 7fc412000640 1 Processor -- start 2024-03-19T06:22:31.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.871+0000 7fc412000640 1 -- start start 2024-03-19T06:22:31.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.875+0000 7fc412000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc40c06b450 0x7fc40c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.875+0000 7fc412000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0aea70 0x7fc40c0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.875+0000 7fc412000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40c0af2d0 con 0x7fc40c15a840 2024-03-19T06:22:31.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.875+0000 7fc412000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c0cdc20 con 0x7fc40c06b450 2024-03-19T06:22:31.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.875+0000 7fc412000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c15eea0 con 0x7fc40c0aea70 2024-03-19T06:22:31.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.875+0000 7fc403e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc40c06b450 0x7fc40c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.875+0000 7fc403e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc40c06b450 0x7fc40c06f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60146/0 (socket says 172.21.15.32:60146) 2024-03-19T06:22:31.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.875+0000 7fc40b400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc40c15a840 0x7fc40c06ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58914/0 (socket says 172.21.15.32:58914) 2024-03-19T06:22:31.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.875+0000 7fc403e00640 1 -- 172.21.15.32:0/2989293740 learned_addr learned my addr 172.21.15.32:0/2989293740 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:31.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.875+0000 7fc40be00640 1 --2- 172.21.15.32:0/2989293740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0aea70 0x7fc40c0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.875+0000 7fc403e00640 1 -- 172.21.15.32:0/2989293740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0aea70 msgr2=0x7fc40c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:31.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.875+0000 7fc403e00640 1 --2- 172.21.15.32:0/2989293740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0aea70 0x7fc40c0ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.875+0000 7fc403e00640 1 -- 172.21.15.32:0/2989293740 >> v1:172.21.15.32:6789/0 conn(0x7fc40c15a840 legacy=0x7fc40c06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.875+0000 7fc403e00640 1 -- 172.21.15.32:0/2989293740 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c15f180 con 0x7fc40c06b450 2024-03-19T06:22:31.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.875+0000 7fc40aa00640 1 -- 172.21.15.32:0/2989293740 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139625565 0 0) 0x7fc40c0af2d0 con 0x7fc40c15a840 2024-03-19T06:22:31.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.875+0000 7fc403e00640 1 --2- 172.21.15.32:0/2989293740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc40c06b450 0x7fc40c06f040 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4009870 tx=0x7fc3f401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b5689412f49ca8 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:31.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc40aa00640 1 -- 172.21.15.32:0/2989293740 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f40ab660 con 0x7fc40c06b450 2024-03-19T06:22:31.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc40aa00640 1 -- 172.21.15.32:0/2989293740 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f40b0070 con 0x7fc40c06b450 2024-03-19T06:22:31.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc40aa00640 1 -- 172.21.15.32:0/2989293740 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f40aba20 con 0x7fc40c06b450 2024-03-19T06:22:31.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc412000640 1 -- 172.21.15.32:0/2989293740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc40c06b450 msgr2=0x7fc40c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc412000640 1 --2- 172.21.15.32:0/2989293740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc40c06b450 0x7fc40c06f040 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4009870 tx=0x7fc3f401c400 comp rx=0 tx=0).stop 2024-03-19T06:22:31.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc412000640 1 -- 172.21.15.32:0/2989293740 shutdown_connections 2024-03-19T06:22:31.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc412000640 1 --2- 172.21.15.32:0/2989293740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0aea70 0x7fc40c0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc412000640 1 --2- 172.21.15.32:0/2989293740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc40c06b450 0x7fc40c06f040 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc412000640 1 -- 172.21.15.32:0/2989293740 >> 172.21.15.32:0/2989293740 conn(0x7fc40c0b1590 msgr2=0x7fc40c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:31.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc412000640 1 -- 172.21.15.32:0/2989293740 shutdown_connections 2024-03-19T06:22:31.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc412000640 1 -- 172.21.15.32:0/2989293740 wait complete. 2024-03-19T06:22:31.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc412000640 1 Processor -- start 2024-03-19T06:22:31.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc412000640 1 -- start start 2024-03-19T06:22:31.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc412000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc40c06b450 0x7fc40c14f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc412000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0aea70 0x7fc40c145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc412000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc40c15a840 0x7fc40c151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc412000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0cef80 con 0x7fc40c15a840 2024-03-19T06:22:31.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc412000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0cee00 con 0x7fc40c06b450 2024-03-19T06:22:31.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc412000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0cf100 con 0x7fc40c0aea70 2024-03-19T06:22:31.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc40be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc40c15a840 0x7fc40c151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc40be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc40c15a840 0x7fc40c151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60156/0 (socket says 172.21.15.32:60156) 2024-03-19T06:22:31.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.879+0000 7fc40be00640 1 -- 172.21.15.32:0/2082675556 learned_addr learned my addr 172.21.15.32:0/2082675556 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:31.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.883+0000 7fc40b400640 1 --2- 172.21.15.32:0/2082675556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc40c06b450 0x7fc40c14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.883+0000 7fc403e00640 1 --2- 172.21.15.32:0/2082675556 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0aea70 0x7fc40c145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.883+0000 7fc40be00640 1 -- 172.21.15.32:0/2082675556 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0aea70 msgr2=0x7fc40c145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.883+0000 7fc40be00640 1 --2- 172.21.15.32:0/2082675556 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0aea70 0x7fc40c145610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.883+0000 7fc40be00640 1 -- 172.21.15.32:0/2082675556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc40c06b450 msgr2=0x7fc40c14f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:31.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.883+0000 7fc40be00640 1 --2- 172.21.15.32:0/2082675556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc40c06b450 0x7fc40c14f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:31.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.883+0000 7fc40be00640 1 -- 172.21.15.32:0/2082675556 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c1507b0 con 0x7fc40c15a840 2024-03-19T06:22:31.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.883+0000 7fc40be00640 1 --2- 172.21.15.32:0/2082675556 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc40c15a840 0x7fc40c151d50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc404009d30 tx=0x7fc40400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:31.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.883+0000 7fc403400640 1 -- 172.21.15.32:0/2082675556 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404018020 con 0x7fc40c15a840 2024-03-19T06:22:31.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.883+0000 7fc403400640 1 -- 172.21.15.32:0/2082675556 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc404014480 con 0x7fc40c15a840 2024-03-19T06:22:31.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.883+0000 7fc412000640 1 -- 172.21.15.32:0/2082675556 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40c15b830 con 0x7fc40c15a840 2024-03-19T06:22:31.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.883+0000 7fc403400640 1 -- 172.21.15.32:0/2082675556 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404014870 con 0x7fc40c15a840 2024-03-19T06:22:31.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.883+0000 7fc412000640 1 -- 172.21.15.32:0/2082675556 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40c150290 con 0x7fc40c15a840 2024-03-19T06:22:31.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.883+0000 7fc412000640 1 -- 172.21.15.32:0/2082675556 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40c0749e0 con 0x7fc40c15a840 2024-03-19T06:22:31.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.883+0000 7fc403400640 1 -- 172.21.15.32:0/2082675556 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc40401b020 con 0x7fc40c15a840 2024-03-19T06:22:31.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.887+0000 7fc403400640 1 --2- 172.21.15.32:0/2082675556 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc3e8067660 0x7fc3e8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:31.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.887+0000 7fc403400640 1 -- 172.21.15.32:0/2082675556 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fc404086380 con 0x7fc40c15a840 2024-03-19T06:22:31.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.887+0000 7fc40b400640 1 --2- 172.21.15.32:0/2082675556 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc3e8067660 0x7fc3e8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:31.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.887+0000 7fc40b400640 1 --2- 172.21.15.32:0/2082675556 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc3e8067660 0x7fc3e8069b20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc007fd0 tx=0x7fc3fc007d60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:31.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:31.891+0000 7fc403400640 1 -- 172.21.15.32:0/2082675556 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fc404022070 con 0x7fc40c15a840 2024-03-19T06:22:32.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.051+0000 7fc412000640 1 -- 172.21.15.32:0/2082675556 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fc40c145b50 con 0x7fc40c15a840 2024-03-19T06:22:32.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.051+0000 7fc403400640 1 -- 172.21.15.32:0/2082675556 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v38) v1 ==== 97+0+11 (secure 0 0 0) 0x7fc404010040 con 0x7fc40c15a840 2024-03-19T06:22:32.041 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:22:32.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.055+0000 7fc412000640 1 -- 172.21.15.32:0/2082675556 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc3e8067660 msgr2=0x7fc3e8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:32.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.055+0000 7fc412000640 1 --2- 172.21.15.32:0/2082675556 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc3e8067660 0x7fc3e8069b20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc007fd0 tx=0x7fc3fc007d60 comp rx=0 tx=0).stop 2024-03-19T06:22:32.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.055+0000 7fc412000640 1 -- 172.21.15.32:0/2082675556 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc40c15a840 msgr2=0x7fc40c151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:32.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.055+0000 7fc412000640 1 --2- 172.21.15.32:0/2082675556 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc40c15a840 0x7fc40c151d50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc404009d30 tx=0x7fc40400c490 comp rx=0 tx=0).stop 2024-03-19T06:22:32.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.055+0000 7fc412000640 1 -- 172.21.15.32:0/2082675556 shutdown_connections 2024-03-19T06:22:32.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.055+0000 7fc412000640 1 --2- 172.21.15.32:0/2082675556 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc3e8067660 0x7fc3e8069b20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:32.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.055+0000 7fc412000640 1 --2- 172.21.15.32:0/2082675556 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc40c15a840 0x7fc40c151d50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:32.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.055+0000 7fc412000640 1 --2- 172.21.15.32:0/2082675556 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0aea70 0x7fc40c145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:32.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.055+0000 7fc412000640 1 --2- 172.21.15.32:0/2082675556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc40c06b450 0x7fc40c14f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:32.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.055+0000 7fc412000640 1 -- 172.21.15.32:0/2082675556 >> 172.21.15.32:0/2082675556 conn(0x7fc40c0b1590 msgr2=0x7fc40c071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:32.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.055+0000 7fc412000640 1 -- 172.21.15.32:0/2082675556 shutdown_connections 2024-03-19T06:22:32.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.055+0000 7fc412000640 1 -- 172.21.15.32:0/2082675556 wait complete. 2024-03-19T06:22:32.062 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:22:32.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e86600640 1 Processor -- start 2024-03-19T06:22:32.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e86600640 1 -- start start 2024-03-19T06:22:32.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e86600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2e8015dd70 0x7f2e8009a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:32.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e86600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2e8006be50 0x7f2e800d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:32.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e86600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e8006c480 0x7f2e8006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:32.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e86600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e800d0980 con 0x7f2e8006be50 2024-03-19T06:22:32.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e86600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e800cfad0 con 0x7f2e8015dd70 2024-03-19T06:22:32.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e86600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8015e150 con 0x7f2e8006c480 2024-03-19T06:22:32.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e76a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2e8006be50 0x7f2e800d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:32.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e76a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2e8006be50 0x7f2e800d0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60164/0 (socket says 172.21.15.32:60164) 2024-03-19T06:22:32.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e76a00640 1 -- 172.21.15.32:0/1225354553 learned_addr learned my addr 172.21.15.32:0/1225354553 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:32.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e7f400640 1 --2- 172.21.15.32:0/1225354553 >> v2:172.21.15.171:3300/0 conn(0x7f2e8015dd70 0x7f2e8009a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:32.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e7fe00640 1 --2- 172.21.15.32:0/1225354553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e8006c480 0x7f2e8006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:32.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e76a00640 1 -- 172.21.15.32:0/1225354553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e8006c480 msgr2=0x7f2e8006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:32.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e76a00640 1 --2- 172.21.15.32:0/1225354553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e8006c480 0x7f2e8006c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:32.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e76a00640 1 -- 172.21.15.32:0/1225354553 >> v2:172.21.15.171:3300/0 conn(0x7f2e8015dd70 msgr2=0x7f2e8009a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:32.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e76a00640 1 --2- 172.21.15.32:0/1225354553 >> v2:172.21.15.171:3300/0 conn(0x7f2e8015dd70 0x7f2e8009a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:32.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e76a00640 1 -- 172.21.15.32:0/1225354553 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e800cfd70 con 0x7f2e8006be50 2024-03-19T06:22:32.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e7fe00640 1 --2- 172.21.15.32:0/1225354553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e8006c480 0x7f2e8006c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:32.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.215+0000 7f2e7f400640 1 --2- 172.21.15.32:0/1225354553 >> v2:172.21.15.171:3300/0 conn(0x7f2e8015dd70 0x7f2e8009a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:32.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.219+0000 7f2e76a00640 1 --2- 172.21.15.32:0/1225354553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e8006be50 0x7f2e800d0e10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2e8006f5b0 tx=0x7f2e6801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891a504798b22358 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:32.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.219+0000 7f2e7ea00640 1 -- 172.21.15.32:0/1225354553 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e680b5070 con 0x7f2e8006be50 2024-03-19T06:22:32.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.219+0000 7f2e7ea00640 1 -- 172.21.15.32:0/1225354553 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e680a89d0 con 0x7f2e8006be50 2024-03-19T06:22:32.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.219+0000 7f2e7ea00640 1 -- 172.21.15.32:0/1225354553 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e680a8da0 con 0x7f2e8006be50 2024-03-19T06:22:32.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.219+0000 7f2e86600640 1 -- 172.21.15.32:0/1225354553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e8006be50 msgr2=0x7f2e800d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:32.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.219+0000 7f2e86600640 1 --2- 172.21.15.32:0/1225354553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e8006be50 0x7f2e800d0e10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2e8006f5b0 tx=0x7f2e6801ed10 comp rx=0 tx=0).stop 2024-03-19T06:22:32.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.219+0000 7f2e86600640 1 -- 172.21.15.32:0/1225354553 shutdown_connections 2024-03-19T06:22:32.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.219+0000 7f2e86600640 1 --2- 172.21.15.32:0/1225354553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e8006c480 0x7f2e8006c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:32.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.219+0000 7f2e86600640 1 --2- 172.21.15.32:0/1225354553 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e8006be50 0x7f2e800d0e10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:32.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.219+0000 7f2e86600640 1 --2- 172.21.15.32:0/1225354553 >> v2:172.21.15.171:3300/0 conn(0x7f2e8015dd70 0x7f2e8009a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:32.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.219+0000 7f2e86600640 1 -- 172.21.15.32:0/1225354553 >> 172.21.15.32:0/1225354553 conn(0x7f2e800d1890 msgr2=0x7f2e800d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:32.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.219+0000 7f2e86600640 1 -- 172.21.15.32:0/1225354553 shutdown_connections 2024-03-19T06:22:32.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.219+0000 7f2e86600640 1 -- 172.21.15.32:0/1225354553 wait complete. 2024-03-19T06:22:32.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e86600640 1 Processor -- start 2024-03-19T06:22:32.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e86600640 1 -- start start 2024-03-19T06:22:32.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e86600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e8006be50 0x7f2e801f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:32.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e86600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e8006c480 0x7f2e801f7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:32.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e86600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e8015dd70 0x7f2e8015e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:32.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e86600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e800d0610 con 0x7f2e8015dd70 2024-03-19T06:22:32.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e86600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e800d0330 con 0x7f2e8006be50 2024-03-19T06:22:32.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e86600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e800d1350 con 0x7f2e8006c480 2024-03-19T06:22:32.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e7fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e8015dd70 0x7f2e8015e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:32.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e7fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e8015dd70 0x7f2e8015e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60168/0 (socket says 172.21.15.32:60168) 2024-03-19T06:22:32.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e7fe00640 1 -- 172.21.15.32:0/2768286794 learned_addr learned my addr 172.21.15.32:0/2768286794 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:32.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e7f400640 1 --2- 172.21.15.32:0/2768286794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e8006be50 0x7f2e801f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:32.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e76a00640 1 --2- 172.21.15.32:0/2768286794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e8006c480 0x7f2e801f7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:32.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e7fe00640 1 -- 172.21.15.32:0/2768286794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e8006c480 msgr2=0x7f2e801f7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:32.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e7fe00640 1 --2- 172.21.15.32:0/2768286794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e8006c480 0x7f2e801f7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:32.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e7fe00640 1 -- 172.21.15.32:0/2768286794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e8006be50 msgr2=0x7f2e801f6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:32.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e7fe00640 1 --2- 172.21.15.32:0/2768286794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e8006be50 0x7f2e801f6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:32.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e7fe00640 1 -- 172.21.15.32:0/2768286794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e801600d0 con 0x7f2e8015dd70 2024-03-19T06:22:32.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e7f400640 1 --2- 172.21.15.32:0/2768286794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e8006be50 0x7f2e801f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:32.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e7fe00640 1 --2- 172.21.15.32:0/2768286794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e8015dd70 0x7f2e8015e2d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2e78007df0 tx=0x7f2e7800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:32.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e77e00640 1 -- 172.21.15.32:0/2768286794 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7801a070 con 0x7f2e8015dd70 2024-03-19T06:22:32.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e77e00640 1 -- 172.21.15.32:0/2768286794 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e780039a0 con 0x7f2e8015dd70 2024-03-19T06:22:32.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e86600640 1 -- 172.21.15.32:0/2768286794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e80161110 con 0x7f2e8015dd70 2024-03-19T06:22:32.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e77e00640 1 -- 172.21.15.32:0/2768286794 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e78003d90 con 0x7f2e8015dd70 2024-03-19T06:22:32.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.223+0000 7f2e86600640 1 -- 172.21.15.32:0/2768286794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e80160630 con 0x7f2e8015dd70 2024-03-19T06:22:32.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.227+0000 7f2e86600640 1 -- 172.21.15.32:0/2768286794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e800749e0 con 0x7f2e8015dd70 2024-03-19T06:22:32.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.227+0000 7f2e77e00640 1 -- 172.21.15.32:0/2768286794 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2e7801d070 con 0x7f2e8015dd70 2024-03-19T06:22:32.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.227+0000 7f2e77e00640 1 --2- 172.21.15.32:0/2768286794 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e5c067660 0x7f2e5c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:32.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.227+0000 7f2e77e00640 1 -- 172.21.15.32:0/2768286794 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f2e78085cc0 con 0x7f2e8015dd70 2024-03-19T06:22:32.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.227+0000 7f2e7f400640 1 --2- 172.21.15.32:0/2768286794 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e5c067660 0x7f2e5c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:32.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.227+0000 7f2e7f400640 1 --2- 172.21.15.32:0/2768286794 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e5c067660 0x7f2e5c069b20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e700098f0 tx=0x7f2e70008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:32.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.231+0000 7f2e77e00640 1 -- 172.21.15.32:0/2768286794 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2e7808c080 con 0x7f2e8015dd70 2024-03-19T06:22:32.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.403+0000 7f2e86600640 1 -- 172.21.15.32:0/2768286794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2e800b7810 con 0x7f2e8015dd70 2024-03-19T06:22:32.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.407+0000 7f2e77e00640 1 -- 172.21.15.32:0/2768286794 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2e801600d0 con 0x7f2e8015dd70 2024-03-19T06:22:32.394 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:22:32.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.407+0000 7f2e86600640 1 -- 172.21.15.32:0/2768286794 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e5c067660 msgr2=0x7f2e5c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:32.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.407+0000 7f2e86600640 1 --2- 172.21.15.32:0/2768286794 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e5c067660 0x7f2e5c069b20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e700098f0 tx=0x7f2e70008040 comp rx=0 tx=0).stop 2024-03-19T06:22:32.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.407+0000 7f2e86600640 1 -- 172.21.15.32:0/2768286794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e8015dd70 msgr2=0x7f2e8015e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:32.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.407+0000 7f2e86600640 1 --2- 172.21.15.32:0/2768286794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e8015dd70 0x7f2e8015e2d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2e78007df0 tx=0x7f2e7800d4a0 comp rx=0 tx=0).stop 2024-03-19T06:22:32.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.407+0000 7f2e86600640 1 -- 172.21.15.32:0/2768286794 shutdown_connections 2024-03-19T06:22:32.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.407+0000 7f2e86600640 1 --2- 172.21.15.32:0/2768286794 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e5c067660 0x7f2e5c069b20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:32.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.407+0000 7f2e86600640 1 --2- 172.21.15.32:0/2768286794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e8015dd70 0x7f2e8015e2d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:32.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.407+0000 7f2e86600640 1 --2- 172.21.15.32:0/2768286794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e8006c480 0x7f2e801f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:32.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.407+0000 7f2e86600640 1 --2- 172.21.15.32:0/2768286794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e8006be50 0x7f2e801f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:32.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.407+0000 7f2e86600640 1 -- 172.21.15.32:0/2768286794 >> 172.21.15.32:0/2768286794 conn(0x7f2e800d1890 msgr2=0x7f2e800cbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:32.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.407+0000 7f2e86600640 1 -- 172.21.15.32:0/2768286794 shutdown_connections 2024-03-19T06:22:32.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:32.407+0000 7f2e86600640 1 -- 172.21.15.32:0/2768286794 wait complete. 2024-03-19T06:22:32.415 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi032.front.sepia.ceph.com... 2024-03-19T06:22:32.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:32.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:32.433 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[36402]: fuse finished with error 0 and tester_r 0 2024-03-19T06:22:32.436 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:22:34.384 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:22:34.388 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:22:38.537 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:22:38.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:38.537 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-19T06:22:38.548 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-19T06:22:38.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.751+0000 7fa873600640 1 Processor -- start 2024-03-19T06:22:38.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.751+0000 7fa873600640 1 -- start start 2024-03-19T06:22:38.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa873600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa86c15a7c0 0x7fa86c0cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:38.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa873600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa86c0b4c50 0x7fa86c0b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:38.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa873600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86c0cb670 con 0x7fa86c0cc680 2024-03-19T06:22:38.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa873600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86c0b5600 con 0x7fa86c15a7c0 2024-03-19T06:22:38.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa873600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c15f400 con 0x7fa86c0b4c50 2024-03-19T06:22:38.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa863e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa86c0cc680 0x7fa86c15ecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:34678/0 (socket says 172.21.15.32:34678) 2024-03-19T06:22:38.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa863e00640 1 -- 172.21.15.32:0/1845307111 learned_addr learned my addr 172.21.15.32:0/1845307111 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:38.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa871600640 1 --2- 172.21.15.32:0/1845307111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa86c0b4c50 0x7fa86c0b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:38.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa870c00640 1 --2- 172.21.15.32:0/1845307111 >> v2:172.21.15.171:3300/0 conn(0x7fa86c15a7c0 0x7fa86c0cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:38.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa86be00640 1 -- 172.21.15.32:0/1845307111 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091435264 0 0) 0x7fa86c0cb670 con 0x7fa86c0cc680 2024-03-19T06:22:38.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa86be00640 1 -- 172.21.15.32:0/1845307111 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa850003530 con 0x7fa86c0cc680 2024-03-19T06:22:38.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa86be00640 1 -- 172.21.15.32:0/1845307111 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2161519989 0 0) 0x7fa850003530 con 0x7fa86c0cc680 2024-03-19T06:22:38.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa86be00640 1 -- 172.21.15.32:0/1845307111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa86c0b4c50 msgr2=0x7fa86c0b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:38.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa86be00640 1 --2- 172.21.15.32:0/1845307111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa86c0b4c50 0x7fa86c0b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:38.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa86be00640 1 -- 172.21.15.32:0/1845307111 >> v2:172.21.15.171:3300/0 conn(0x7fa86c15a7c0 msgr2=0x7fa86c0cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:38.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa86be00640 1 --2- 172.21.15.32:0/1845307111 >> v2:172.21.15.171:3300/0 conn(0x7fa86c15a7c0 0x7fa86c0cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:38.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa86be00640 1 -- 172.21.15.32:0/1845307111 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c0cb950 con 0x7fa86c0cc680 2024-03-19T06:22:38.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa86be00640 1 -- 172.21.15.32:0/1845307111 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fa854001680 con 0x7fa86c0cc680 2024-03-19T06:22:38.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa86be00640 1 -- 172.21.15.32:0/1845307111 >> v1:172.21.15.32:6789/0 conn(0x7fa86c0cc680 legacy=0x7fa86c15ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:38.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa86be00640 1 --2- 172.21.15.32:0/1845307111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8500039c0 0x7fa850003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:38.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa86be00640 1 --2- 172.21.15.32:0/1845307111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa86c0b4c50 0x7fa850004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:38.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa86be00640 1 --2- 172.21.15.32:0/1845307111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa850004d50 0x7fa8500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:38.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa86be00640 1 -- 172.21.15.32:0/1845307111 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c0b5600 con 0x7fa8500039c0 2024-03-19T06:22:38.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa86be00640 1 -- 172.21.15.32:0/1845307111 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c15f400 con 0x7fa850004d50 2024-03-19T06:22:38.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa86be00640 1 -- 172.21.15.32:0/1845307111 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85000b9d0 con 0x7fa86c0b4c50 2024-03-19T06:22:38.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa870c00640 1 --2- 172.21.15.32:0/1845307111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8500039c0 0x7fa850003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:38.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa871600640 1 --2- 172.21.15.32:0/1845307111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa850004d50 0x7fa8500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:38.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa863e00640 1 --2- 172.21.15.32:0/1845307111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa86c0b4c50 0x7fa850004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:38.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa870c00640 1 -- 172.21.15.32:0/1845307111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa86c0b4c50 msgr2=0x7fa850004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:38.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa870c00640 1 --2- 172.21.15.32:0/1845307111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa86c0b4c50 0x7fa850004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:38.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa870c00640 1 -- 172.21.15.32:0/1845307111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa850004d50 msgr2=0x7fa8500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:38.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa870c00640 1 --2- 172.21.15.32:0/1845307111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa850004d50 0x7fa8500051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:38.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa870c00640 1 -- 172.21.15.32:0/1845307111 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa850003530 con 0x7fa8500039c0 2024-03-19T06:22:38.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.755+0000 7fa863e00640 1 --2- 172.21.15.32:0/1845307111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa86c0b4c50 0x7fa850004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:38.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.759+0000 7fa870c00640 1 --2- 172.21.15.32:0/1845307111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8500039c0 0x7fa850003de0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009ae0 tx=0x7fa85c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2674e125ed0031bb server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:38.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.759+0000 7fa86be00640 1 -- 172.21.15.32:0/1845307111 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0096b0 con 0x7fa8500039c0 2024-03-19T06:22:38.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.759+0000 7fa86be00640 1 -- 172.21.15.32:0/1845307111 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85c0a6490 con 0x7fa8500039c0 2024-03-19T06:22:38.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.759+0000 7fa86be00640 1 -- 172.21.15.32:0/1845307111 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0a6880 con 0x7fa8500039c0 2024-03-19T06:22:38.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.759+0000 7fa873600640 1 -- 172.21.15.32:0/1845307111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8500039c0 msgr2=0x7fa850003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:38.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.759+0000 7fa873600640 1 --2- 172.21.15.32:0/1845307111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8500039c0 0x7fa850003de0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009ae0 tx=0x7fa85c01cab0 comp rx=0 tx=0).stop 2024-03-19T06:22:38.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.759+0000 7fa871600640 1 -- 172.21.15.32:0/1845307111 reap_dead start 2024-03-19T06:22:38.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.759+0000 7fa873600640 1 -- 172.21.15.32:0/1845307111 shutdown_connections 2024-03-19T06:22:38.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.759+0000 7fa873600640 1 -- 172.21.15.32:0/1845307111 >> 172.21.15.32:0/1845307111 conn(0x7fa86c0b1280 msgr2=0x7fa86c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:38.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.759+0000 7fa873600640 1 -- 172.21.15.32:0/1845307111 shutdown_connections 2024-03-19T06:22:38.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.759+0000 7fa873600640 1 -- 172.21.15.32:0/1845307111 wait complete. 2024-03-19T06:22:38.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.759+0000 7fa873600640 1 Processor -- start 2024-03-19T06:22:38.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa873600640 1 -- start start 2024-03-19T06:22:38.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa873600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8500039c0 0x7fa86c0b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa873600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa86c0b09d0 0x7fa86c0c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa873600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa86c1f9dd0 0x7fa86c1fa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa873600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c0cbdb0 con 0x7fa8500039c0 2024-03-19T06:22:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa873600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c0cbc30 con 0x7fa86c1f9dd0 2024-03-19T06:22:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa873600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c1657e0 con 0x7fa86c0b09d0 2024-03-19T06:22:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa870c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8500039c0 0x7fa86c0b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa870c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8500039c0 0x7fa86c0b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56720/0 (socket says 172.21.15.32:56720) 2024-03-19T06:22:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa870c00640 1 -- 172.21.15.32:0/3960566296 learned_addr learned my addr 172.21.15.32:0/3960566296 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa871600640 1 --2- 172.21.15.32:0/3960566296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa86c1f9dd0 0x7fa86c1fa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa863e00640 1 --2- 172.21.15.32:0/3960566296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa86c0b09d0 0x7fa86c0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa870c00640 1 -- 172.21.15.32:0/3960566296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa86c0b09d0 msgr2=0x7fa86c0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa870c00640 1 --2- 172.21.15.32:0/3960566296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa86c0b09d0 0x7fa86c0c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:38.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa870c00640 1 -- 172.21.15.32:0/3960566296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa86c1f9dd0 msgr2=0x7fa86c1fa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:38.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa870c00640 1 --2- 172.21.15.32:0/3960566296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa86c1f9dd0 0x7fa86c1fa280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:38.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa870c00640 1 -- 172.21.15.32:0/3960566296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c0b35d0 con 0x7fa8500039c0 2024-03-19T06:22:38.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa863e00640 1 --2- 172.21.15.32:0/3960566296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa86c0b09d0 0x7fa86c0c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:38.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa870c00640 1 --2- 172.21.15.32:0/3960566296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8500039c0 0x7fa86c0b2d80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009ae0 tx=0x7fa850005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:38.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa869600640 1 -- 172.21.15.32:0/3960566296 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0be070 con 0x7fa8500039c0 2024-03-19T06:22:38.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa869600640 1 -- 172.21.15.32:0/3960566296 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85c00f000 con 0x7fa8500039c0 2024-03-19T06:22:38.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa873600640 1 -- 172.21.15.32:0/3960566296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa86c0b38b0 con 0x7fa8500039c0 2024-03-19T06:22:38.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa869600640 1 -- 172.21.15.32:0/3960566296 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0a7470 con 0x7fa8500039c0 2024-03-19T06:22:38.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa873600640 1 -- 172.21.15.32:0/3960566296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86c0b3e70 con 0x7fa8500039c0 2024-03-19T06:22:38.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.763+0000 7fa873600640 1 -- 172.21.15.32:0/3960566296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa86c0749e0 con 0x7fa8500039c0 2024-03-19T06:22:38.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.767+0000 7fa869600640 1 -- 172.21.15.32:0/3960566296 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa85c0c1070 con 0x7fa8500039c0 2024-03-19T06:22:38.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.767+0000 7fa869600640 1 --2- 172.21.15.32:0/3960566296 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa848067660 0x7fa848069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:38.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.767+0000 7fa869600640 1 -- 172.21.15.32:0/3960566296 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fa85c11f240 con 0x7fa8500039c0 2024-03-19T06:22:38.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.767+0000 7fa863e00640 1 --2- 172.21.15.32:0/3960566296 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa848067660 0x7fa848069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:38.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.767+0000 7fa863e00640 1 --2- 172.21.15.32:0/3960566296 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa848067660 0x7fa848069b20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa854001000 tx=0x7fa854009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:38.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.771+0000 7fa869600640 1 -- 172.21.15.32:0/3960566296 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fa85c0ac020 con 0x7fa8500039c0 2024-03-19T06:22:38.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.975+0000 7fa873600640 1 -- 172.21.15.32:0/3960566296 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa86c0cc270 con 0x7fa8500039c0 2024-03-19T06:22:38.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.975+0000 7fa869600640 1 -- 172.21.15.32:0/3960566296 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+82 (secure 0 0 0) 0x7fa85c0167c0 con 0x7fa8500039c0 2024-03-19T06:22:38.963 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2024-03-19T06:22:38.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.975+0000 7fa873600640 1 -- 172.21.15.32:0/3960566296 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa848067660 msgr2=0x7fa848069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:38.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.975+0000 7fa873600640 1 --2- 172.21.15.32:0/3960566296 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa848067660 0x7fa848069b20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa854001000 tx=0x7fa854009040 comp rx=0 tx=0).stop 2024-03-19T06:22:38.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.975+0000 7fa873600640 1 -- 172.21.15.32:0/3960566296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8500039c0 msgr2=0x7fa86c0b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:38.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.975+0000 7fa873600640 1 --2- 172.21.15.32:0/3960566296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8500039c0 0x7fa86c0b2d80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009ae0 tx=0x7fa850005840 comp rx=0 tx=0).stop 2024-03-19T06:22:38.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.975+0000 7fa873600640 1 -- 172.21.15.32:0/3960566296 shutdown_connections 2024-03-19T06:22:38.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.975+0000 7fa873600640 1 --2- 172.21.15.32:0/3960566296 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa848067660 0x7fa848069b20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:38.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.975+0000 7fa873600640 1 --2- 172.21.15.32:0/3960566296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa86c1f9dd0 0x7fa86c1fa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:38.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.975+0000 7fa873600640 1 --2- 172.21.15.32:0/3960566296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa86c0b09d0 0x7fa86c0c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:38.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.975+0000 7fa873600640 1 --2- 172.21.15.32:0/3960566296 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8500039c0 0x7fa86c0b2d80 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:38.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.975+0000 7fa873600640 1 -- 172.21.15.32:0/3960566296 >> 172.21.15.32:0/3960566296 conn(0x7fa86c0b1280 msgr2=0x7fa86c149b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:38.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.975+0000 7fa873600640 1 -- 172.21.15.32:0/3960566296 shutdown_connections 2024-03-19T06:22:38.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:38.975+0000 7fa873600640 1 -- 172.21.15.32:0/3960566296 wait complete. 2024-03-19T06:22:38.984 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-19T06:22:38.984 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-19T06:22:38.984 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-03-19T06:22:38.984 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-19T06:22:38.984 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:38.984 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-19T06:22:38.984 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-19T06:22:38.984 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-19T06:22:38.984 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:22:38.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:38.984 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-03-19T06:22:38.993 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:22:38.993 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:22:38.993 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:22:38.994 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:38.994 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-03-19T06:22:38.994 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:38.994 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:22:38.994 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:38.994 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-03-19T06:22:38.994 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:22:38.994 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:38.994 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-03-19T06:22:38.994 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-19T06:22:38.994 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:38.994 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-03-19T06:22:38.994 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-03-19T06:22:38.994 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42338sec preferred_lft 42338sec 2024-03-19T06:22:38.995 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-03-19T06:22:38.995 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:38.995 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:22:38.995 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:38.995 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-03-19T06:22:38.995 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-19T06:22:38.995 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:f5:94:d0:dd brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:38.995 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-19T06:22:38.995 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:38.995 INFO:teuthology.orchestra.run.smithi032.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-19T06:22:38.995 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:38.995 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-19T06:22:38.995 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:38.995 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-03-19T06:22:38.995 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:38.995 INFO:teuthology.orchestra.run.smithi032.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-19T06:22:38.996 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:22:38.996 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-03-19T06:22:38.996 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:38.996 INFO:teuthology.orchestra.run.smithi032.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-19T06:22:38.996 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:22:38.996 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-03-19T06:22:38.996 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:38.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:38.997 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-19T06:22:39.055 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-03-19T06:22:39.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:39.057 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-03-19T06:22:39.112 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-03-19T06:22:39.112 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-19T06:22:39.112 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-03-19T06:22:39.112 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-19T06:22:39.112 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-03-19T06:22:39.112 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-19T06:22:39.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:39.113 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-03-19T06:22:39.113 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-03-19T06:22:39.113 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-19T06:22:39.113 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-19T06:22:39.113 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-19T06:22:39.113 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-03-19T06:22:39.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:39.204 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-03-19T06:22:39.213 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-19T06:22:39.213 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-19T06:22:39.213 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:22:39.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:39.214 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-03-19T06:22:39.277 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-19T06:22:39.277 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:22:39.277 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:39.334 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:22:39.334 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:22:39.334 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:39.385 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:22:39.450 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:22:39.503 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:22:39.503 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:22:39.503 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:22:39.503 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:22:39.503 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:22:39.503 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:22:39.503 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:22:39.503 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:22:39.503 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:22:39.503 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:22:39.503 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:22:39.504 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:22:39.505 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:22:39.505 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:22:39.505 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:22:39.505 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:22:39.505 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:22:39.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:39.506 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:22:39.561 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-19T06:22:39.562 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-19T06:22:39.608 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:22:39.629 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:22:39.680 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:22:39.680 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:22:39.680 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:22:39.680 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:22:39.680 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:22:39.680 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:22:39.680 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:22:39.680 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:22:39.680 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:22:39.680 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:22:39.680 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:22:39.680 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:22:39.680 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:22:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:22:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:22:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:22:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:22:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:22:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:22:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:22:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:22:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:22:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:22:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:22:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:22:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:22:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:22:39.681 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:22:39.682 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:22:39.682 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:22:39.682 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:22:39.682 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:22:39.682 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:22:39.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:39.683 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:22:39.705 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:2024-03-19T06:22:39.715+0000 7f35145db580 -1 init, newargv = 0x55ff3792d400 newargc=15 2024-03-19T06:22:39.705 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[36964]: starting ceph client 2024-03-19T06:22:39.712 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[36964]: starting fuse 2024-03-19T06:22:39.714 INFO:teuthology.orchestra.run.smithi032.stdout:43 2024-03-19T06:22:39.714 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-03-19T06:22:39.714 DEBUG:teuthology.orchestra.run.smithi032:> sudo stdin-killer -- python3 -c ' 2024-03-19T06:22:39.714 DEBUG:teuthology.orchestra.run.smithi032:> import glob 2024-03-19T06:22:39.715 DEBUG:teuthology.orchestra.run.smithi032:> import re 2024-03-19T06:22:39.715 DEBUG:teuthology.orchestra.run.smithi032:> import os 2024-03-19T06:22:39.715 DEBUG:teuthology.orchestra.run.smithi032:> import subprocess 2024-03-19T06:22:39.715 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:22:39.715 DEBUG:teuthology.orchestra.run.smithi032:> def _find_admin_socket(client_name): 2024-03-19T06:22:39.715 DEBUG:teuthology.orchestra.run.smithi032:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-19T06:22:39.715 DEBUG:teuthology.orchestra.run.smithi032:> files = glob.glob(asok_path) 2024-03-19T06:22:39.715 DEBUG:teuthology.orchestra.run.smithi032:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-19T06:22:39.715 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:22:39.715 DEBUG:teuthology.orchestra.run.smithi032:> # Given a non-glob path, it better be there 2024-03-19T06:22:39.715 DEBUG:teuthology.orchestra.run.smithi032:> if "*" not in asok_path: 2024-03-19T06:22:39.715 DEBUG:teuthology.orchestra.run.smithi032:> assert(len(files) == 1) 2024-03-19T06:22:39.715 DEBUG:teuthology.orchestra.run.smithi032:> return files[0] 2024-03-19T06:22:39.715 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:22:39.715 DEBUG:teuthology.orchestra.run.smithi032:> for f in files: 2024-03-19T06:22:39.716 DEBUG:teuthology.orchestra.run.smithi032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-19T06:22:39.716 DEBUG:teuthology.orchestra.run.smithi032:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-19T06:22:39.716 DEBUG:teuthology.orchestra.run.smithi032:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-19T06:22:39.716 DEBUG:teuthology.orchestra.run.smithi032:> contents = proc_f.read() 2024-03-19T06:22:39.716 DEBUG:teuthology.orchestra.run.smithi032:> if mountpoint in contents: 2024-03-19T06:22:39.716 DEBUG:teuthology.orchestra.run.smithi032:> return f 2024-03-19T06:22:39.716 DEBUG:teuthology.orchestra.run.smithi032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-19T06:22:39.716 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:22:39.716 DEBUG:teuthology.orchestra.run.smithi032:> print(_find_admin_socket("client.0")) 2024-03-19T06:22:39.716 DEBUG:teuthology.orchestra.run.smithi032:> ' 2024-03-19T06:22:39.844 INFO:teuthology.orchestra.run.smithi032.stdout:/var/run/ceph/ceph-client.0.36964.asok 2024-03-19T06:22:39.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-19T06:22:39.855 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.36964.asok 2024-03-19T06:22:39.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:39.855 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.36964.asok status 2024-03-19T06:22:40.035 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:22:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: "metadata": { 2024-03-19T06:22:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_sha1": "b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", 2024-03-19T06:22:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_version": "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)", 2024-03-19T06:22:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: "entity_id": "0", 2024-03-19T06:22:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: "hostname": "smithi032", 2024-03-19T06:22:40.035 INFO:teuthology.orchestra.run.smithi032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-19T06:22:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "pid": "36964", 2024-03-19T06:22:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "root": "/" 2024-03-19T06:22:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_count": 0, 2024-03-19T06:22:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_pinned_count": 0, 2024-03-19T06:22:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 5577, 2024-03-19T06:22:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "inst": { 2024-03-19T06:22:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "name": { 2024-03-19T06:22:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "client", 2024-03-19T06:22:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "num": 5577 2024-03-19T06:22:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-03-19T06:22:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-03-19T06:22:40.036 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:22:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3036987417 2024-03-19T06:22:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-03-19T06:22:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-03-19T06:22:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:22:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3036987417 2024-03-19T06:22:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "inst_str": "client.5577 192.168.0.1:0/3036987417", 2024-03-19T06:22:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "addr_str": "192.168.0.1:0/3036987417", 2024-03-19T06:22:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "inode_count": 1, 2024-03-19T06:22:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_epoch": 18, 2024-03-19T06:22:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch": 38, 2024-03-19T06:22:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch_barrier": 0, 2024-03-19T06:22:40.037 INFO:teuthology.orchestra.run.smithi032.stdout: "blocklisted": false, 2024-03-19T06:22:40.038 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs" 2024-03-19T06:22:40.038 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:22:40.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:40.050 DEBUG:teuthology.orchestra.run.smithi032:> stat --file-system '--printf=%T 2024-03-19T06:22:40.050 DEBUG:teuthology.orchestra.run.smithi032:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:40.060 INFO:teuthology.orchestra.run.smithi032.stdout:fuseblk 2024-03-19T06:22:40.060 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:40.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:40.060 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:40.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:40.122 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2024-03-19T06:22:40.187 INFO:teuthology.orchestra.run.smithi032.stderr:setfattr: layoutfile: Permission denied 2024-03-19T06:22:40.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:22:40.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:40.188 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2024-03-19T06:22:40.239 INFO:teuthology.orchestra.run.smithi032.stderr:setfattr: layoutdir: Permission denied 2024-03-19T06:22:40.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:22:40.240 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:22:40.240 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:22:40.290 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:22:40.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.483+0000 7f4372800640 1 Processor -- start 2024-03-19T06:22:40.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.483+0000 7f4372800640 1 -- start start 2024-03-19T06:22:40.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f4372800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f436c15a7c0 0x7f436c0cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:40.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f4372800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f436c0cc680 0x7f436c15ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:40.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f4372800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c0cb670 con 0x7f436c0b4c50 2024-03-19T06:22:40.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f4372800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436c15e860 con 0x7f436c15a7c0 2024-03-19T06:22:40.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f4372800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436c0cb950 con 0x7f436c0cc680 2024-03-19T06:22:40.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f436be00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f436c0b4c50 0x7f436c0cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:34690/0 (socket says 172.21.15.32:34690) 2024-03-19T06:22:40.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f436be00640 1 -- 172.21.15.32:0/890841956 learned_addr learned my addr 172.21.15.32:0/890841956 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:40.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f4363e00640 1 --2- 172.21.15.32:0/890841956 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f436c0cc680 0x7f436c15ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:40.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f436b400640 1 --2- 172.21.15.32:0/890841956 >> v2:172.21.15.171:3300/0 conn(0x7f436c15a7c0 0x7f436c0cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:40.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f436aa00640 1 -- 172.21.15.32:0/890841956 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653950397 0 0) 0x7f436c0cb670 con 0x7f436c0b4c50 2024-03-19T06:22:40.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f436aa00640 1 -- 172.21.15.32:0/890841956 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4350003530 con 0x7f436c0b4c50 2024-03-19T06:22:40.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f436b400640 1 -- 172.21.15.32:0/890841956 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f436c0cc680 msgr2=0x7f436c15ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:40.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f436b400640 1 --2- 172.21.15.32:0/890841956 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f436c0cc680 0x7f436c15ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:40.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f436b400640 1 -- 172.21.15.32:0/890841956 >> v1:172.21.15.32:6789/0 conn(0x7f436c0b4c50 legacy=0x7f436c0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:40.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f436aa00640 1 -- 172.21.15.32:0/890841956 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 851960608 0 0) 0x7f4350003530 con 0x7f436c0b4c50 2024-03-19T06:22:40.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f436b400640 1 -- 172.21.15.32:0/890841956 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c15e4f0 con 0x7f436c15a7c0 2024-03-19T06:22:40.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.487+0000 7f4363e00640 1 --2- 172.21.15.32:0/890841956 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f436c0cc680 0x7f436c15ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:22:40.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.491+0000 7f436b400640 1 --2- 172.21.15.32:0/890841956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f436c15a7c0 0x7f436c0cae20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f435c0097c0 tx=0x7f435c01c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3a5c62a225681c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:40.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.491+0000 7f436aa00640 1 -- 172.21.15.32:0/890841956 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c0b1070 con 0x7f436c15a7c0 2024-03-19T06:22:40.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.491+0000 7f436aa00640 1 -- 172.21.15.32:0/890841956 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c0ac630 con 0x7f436c15a7c0 2024-03-19T06:22:40.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.491+0000 7f436aa00640 1 -- 172.21.15.32:0/890841956 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c0a8050 con 0x7f436c15a7c0 2024-03-19T06:22:40.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.491+0000 7f4372800640 1 -- 172.21.15.32:0/890841956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f436c15a7c0 msgr2=0x7f436c0cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:40.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.491+0000 7f4372800640 1 --2- 172.21.15.32:0/890841956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f436c15a7c0 0x7f436c0cae20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f435c0097c0 tx=0x7f435c01c3b0 comp rx=0 tx=0).stop 2024-03-19T06:22:40.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.491+0000 7f4372800640 1 -- 172.21.15.32:0/890841956 shutdown_connections 2024-03-19T06:22:40.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.491+0000 7f4372800640 1 --2- 172.21.15.32:0/890841956 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f436c0cc680 0x7f436c15ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:40.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.491+0000 7f4372800640 1 --2- 172.21.15.32:0/890841956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f436c15a7c0 0x7f436c0cae20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:40.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.491+0000 7f4372800640 1 -- 172.21.15.32:0/890841956 >> 172.21.15.32:0/890841956 conn(0x7f436c0b1280 msgr2=0x7f436c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:40.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.491+0000 7f4372800640 1 -- 172.21.15.32:0/890841956 shutdown_connections 2024-03-19T06:22:40.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.491+0000 7f4372800640 1 -- 172.21.15.32:0/890841956 wait complete. 2024-03-19T06:22:40.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.491+0000 7f4372800640 1 Processor -- start 2024-03-19T06:22:40.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.491+0000 7f4372800640 1 -- start start 2024-03-19T06:22:40.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4372800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f436c0b4c50 0x7f436c14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4372800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f436c0cc680 0x7f436c1fafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4372800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f436c15a7c0 0x7f436c14d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4372800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c15f3b0 con 0x7f436c0cc680 2024-03-19T06:22:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4372800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c15f230 con 0x7f436c15a7c0 2024-03-19T06:22:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4372800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436c0cbc30 con 0x7f436c0b4c50 2024-03-19T06:22:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4363e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f436c0cc680 0x7f436c1fafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4363e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f436c0cc680 0x7f436c1fafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56722/0 (socket says 172.21.15.32:56722) 2024-03-19T06:22:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4363e00640 1 -- 172.21.15.32:0/3028396488 learned_addr learned my addr 172.21.15.32:0/3028396488 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f436b400640 1 --2- 172.21.15.32:0/3028396488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f436c0b4c50 0x7f436c14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f436be00640 1 --2- 172.21.15.32:0/3028396488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f436c15a7c0 0x7f436c14d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4363e00640 1 -- 172.21.15.32:0/3028396488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f436c0b4c50 msgr2=0x7f436c14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4363e00640 1 --2- 172.21.15.32:0/3028396488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f436c0b4c50 0x7f436c14eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4363e00640 1 -- 172.21.15.32:0/3028396488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f436c15a7c0 msgr2=0x7f436c14d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:40.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4363e00640 1 --2- 172.21.15.32:0/3028396488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f436c15a7c0 0x7f436c14d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:40.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4363e00640 1 -- 172.21.15.32:0/3028396488 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c0b3e60 con 0x7f436c0cc680 2024-03-19T06:22:40.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f436be00640 1 --2- 172.21.15.32:0/3028396488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f436c15a7c0 0x7f436c14d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:40.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4363e00640 1 --2- 172.21.15.32:0/3028396488 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f436c0cc680 0x7f436c1fafa0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f435400e980 tx=0x7f435400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:40.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4363400640 1 -- 172.21.15.32:0/3028396488 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354017070 con 0x7f436c0cc680 2024-03-19T06:22:40.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4363400640 1 -- 172.21.15.32:0/3028396488 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435400ca00 con 0x7f436c0cc680 2024-03-19T06:22:40.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4372800640 1 -- 172.21.15.32:0/3028396488 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436c0b4100 con 0x7f436c0cc680 2024-03-19T06:22:40.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4363400640 1 -- 172.21.15.32:0/3028396488 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435400cdd0 con 0x7f436c0cc680 2024-03-19T06:22:40.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4372800640 1 -- 172.21.15.32:0/3028396488 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436c071880 con 0x7f436c0cc680 2024-03-19T06:22:40.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4372800640 1 -- 172.21.15.32:0/3028396488 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436c0749e0 con 0x7f436c0cc680 2024-03-19T06:22:40.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.495+0000 7f4363400640 1 -- 172.21.15.32:0/3028396488 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f435401a070 con 0x7f436c0cc680 2024-03-19T06:22:40.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.499+0000 7f4363400640 1 --2- 172.21.15.32:0/3028396488 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4348067660 0x7f4348069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:40.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.499+0000 7f4363400640 1 -- 172.21.15.32:0/3028396488 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f4354085bc0 con 0x7f436c0cc680 2024-03-19T06:22:40.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.499+0000 7f436b400640 1 --2- 172.21.15.32:0/3028396488 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4348067660 0x7f4348069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:40.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.499+0000 7f436b400640 1 --2- 172.21.15.32:0/3028396488 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4348067660 0x7f4348069b20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f435c0ae000 tx=0x7f435c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:40.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.503+0000 7f4363400640 1 -- 172.21.15.32:0/3028396488 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f4354056050 con 0x7f436c0cc680 2024-03-19T06:22:40.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.667+0000 7f4372800640 1 -- 172.21.15.32:0/3028396488 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f436c0cc270 con 0x7f436c0cc680 2024-03-19T06:22:40.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.667+0000 7f4363400640 1 -- 172.21.15.32:0/3028396488 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18493 (secure 0 0 0) 0x7f435405a0f0 con 0x7f436c0cc680 2024-03-19T06:22:40.657 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:40.657 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":38,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:22:27.853859+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:22:09.983589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-19T06:22:11.172289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-19T06:22:25.205334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:22:40.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.671+0000 7f4372800640 1 -- 172.21.15.32:0/3028396488 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4348067660 msgr2=0x7f4348069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:40.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.671+0000 7f4372800640 1 --2- 172.21.15.32:0/3028396488 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4348067660 0x7f4348069b20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f435c0ae000 tx=0x7f435c008040 comp rx=0 tx=0).stop 2024-03-19T06:22:40.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.671+0000 7f4372800640 1 -- 172.21.15.32:0/3028396488 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f436c0cc680 msgr2=0x7f436c1fafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:40.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.671+0000 7f4372800640 1 --2- 172.21.15.32:0/3028396488 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f436c0cc680 0x7f436c1fafa0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f435400e980 tx=0x7f435400ee40 comp rx=0 tx=0).stop 2024-03-19T06:22:40.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.671+0000 7f4372800640 1 -- 172.21.15.32:0/3028396488 shutdown_connections 2024-03-19T06:22:40.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.671+0000 7f4372800640 1 --2- 172.21.15.32:0/3028396488 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4348067660 0x7f4348069b20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:40.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.671+0000 7f4372800640 1 --2- 172.21.15.32:0/3028396488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f436c15a7c0 0x7f436c14d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:40.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.671+0000 7f4372800640 1 --2- 172.21.15.32:0/3028396488 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f436c0cc680 0x7f436c1fafa0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:40.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.671+0000 7f4372800640 1 --2- 172.21.15.32:0/3028396488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f436c0b4c50 0x7f436c14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:40.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.671+0000 7f4372800640 1 -- 172.21.15.32:0/3028396488 >> 172.21.15.32:0/3028396488 conn(0x7f436c0b1280 msgr2=0x7f436c159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:40.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.671+0000 7f4372800640 1 -- 172.21.15.32:0/3028396488 shutdown_connections 2024-03-19T06:22:40.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.671+0000 7f4372800640 1 -- 172.21.15.32:0/3028396488 wait complete. 2024-03-19T06:22:40.678 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:22:09.983589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:22:11.172289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2024-03-19T06:22:25.205334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:22:40.678 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:22:40.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.835+0000 7f2ff5600640 1 Processor -- start 2024-03-19T06:22:40.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.835+0000 7f2ff5600640 1 -- start start 2024-03-19T06:22:40.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.835+0000 7f2ff5600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2ff00b3620 0x7f2ff00b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:40.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.835+0000 7f2ff5600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff00cbf00 con 0x7f2ff015dbb0 2024-03-19T06:22:40.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.835+0000 7f2ff5600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff006cb20 con 0x7f2ff00cc6c0 2024-03-19T06:22:40.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.835+0000 7f2ff5600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff00b3fd0 con 0x7f2ff00b3620 2024-03-19T06:22:40.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.835+0000 7f2feea00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2ff015dbb0 0x7f2ff006c060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:34692/0 (socket says 172.21.15.32:34692) 2024-03-19T06:22:40.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.835+0000 7f2feea00640 1 -- 172.21.15.32:0/3046978055 learned_addr learned my addr 172.21.15.32:0/3046978055 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:40.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.835+0000 7f2fee000640 1 --2- 172.21.15.32:0/3046978055 >> v2:172.21.15.32:3300/0 conn(0x7f2ff00b3620 0x7f2ff00b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:40.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.835+0000 7f2fed600640 1 -- 172.21.15.32:0/3046978055 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190260912 0 0) 0x7f2ff00cbf00 con 0x7f2ff015dbb0 2024-03-19T06:22:40.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.835+0000 7f2fed600640 1 -- 172.21.15.32:0/3046978055 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fd4003530 con 0x7f2ff015dbb0 2024-03-19T06:22:40.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.835+0000 7f2fee000640 1 -- 172.21.15.32:0/3046978055 >> v1:172.21.15.171:6789/0 conn(0x7f2ff00cc6c0 legacy=0x7f2ff00ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:40.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.835+0000 7f2fee000640 1 -- 172.21.15.32:0/3046978055 >> v1:172.21.15.32:6789/0 conn(0x7f2ff015dbb0 legacy=0x7f2ff006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:40.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.835+0000 7f2fee000640 1 -- 172.21.15.32:0/3046978055 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff006ce00 con 0x7f2ff00b3620 2024-03-19T06:22:40.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.839+0000 7f2fee000640 1 --2- 172.21.15.32:0/3046978055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ff00b3620 0x7f2ff00b3a90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0097c0 tx=0x7f2fdc01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6050dddfb8eb2c25 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:40.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.839+0000 7f2fed600640 1 -- 172.21.15.32:0/3046978055 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc0b5070 con 0x7f2ff00b3620 2024-03-19T06:22:40.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.839+0000 7f2fed600640 1 -- 172.21.15.32:0/3046978055 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc0a8950 con 0x7f2ff00b3620 2024-03-19T06:22:40.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.839+0000 7f2fed600640 1 -- 172.21.15.32:0/3046978055 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc0a8d20 con 0x7f2ff00b3620 2024-03-19T06:22:40.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.839+0000 7f2ff5600640 1 -- 172.21.15.32:0/3046978055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ff00b3620 msgr2=0x7f2ff00b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:40.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.839+0000 7f2ff5600640 1 --2- 172.21.15.32:0/3046978055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ff00b3620 0x7f2ff00b3a90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0097c0 tx=0x7f2fdc01ec50 comp rx=0 tx=0).stop 2024-03-19T06:22:40.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.839+0000 7f2ff5600640 1 -- 172.21.15.32:0/3046978055 shutdown_connections 2024-03-19T06:22:40.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.839+0000 7f2ff5600640 1 --2- 172.21.15.32:0/3046978055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ff00b3620 0x7f2ff00b3a90 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:40.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.839+0000 7f2ff5600640 1 -- 172.21.15.32:0/3046978055 >> 172.21.15.32:0/3046978055 conn(0x7f2ff0066ca0 msgr2=0x7f2ff00670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:40.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.839+0000 7f2ff5600640 1 -- 172.21.15.32:0/3046978055 shutdown_connections 2024-03-19T06:22:40.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.839+0000 7f2ff5600640 1 -- 172.21.15.32:0/3046978055 wait complete. 2024-03-19T06:22:40.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2ff5600640 1 Processor -- start 2024-03-19T06:22:40.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2ff5600640 1 -- start start 2024-03-19T06:22:40.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2ff5600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ff00b3620 0x7f2ff00b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:40.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2ff5600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00cc6c0 0x7f2ff014eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:40.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2ff5600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ff015dbb0 0x7f2ff014f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:40.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2ff5600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff006d910 con 0x7f2ff00b3620 2024-03-19T06:22:40.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2ff5600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff00cc1a0 con 0x7f2ff015dbb0 2024-03-19T06:22:40.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2ff5600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff015df90 con 0x7f2ff00cc6c0 2024-03-19T06:22:40.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2feea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ff00b3620 0x7f2ff00b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:40.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2feea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ff00b3620 0x7f2ff00b1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56740/0 (socket says 172.21.15.32:56740) 2024-03-19T06:22:40.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2feea00640 1 -- 172.21.15.32:0/1364491442 learned_addr learned my addr 172.21.15.32:0/1364491442 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:40.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2feea00640 1 -- 172.21.15.32:0/1364491442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00cc6c0 msgr2=0x7f2ff014eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:40.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2fef400640 1 --2- 172.21.15.32:0/1364491442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ff015dbb0 0x7f2ff014f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:40.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2fee000640 1 --2- 172.21.15.32:0/1364491442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00cc6c0 0x7f2ff014eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:40.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2feea00640 1 --2- 172.21.15.32:0/1364491442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00cc6c0 0x7f2ff014eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:40.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2feea00640 1 -- 172.21.15.32:0/1364491442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ff015dbb0 msgr2=0x7f2ff014f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:40.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2feea00640 1 --2- 172.21.15.32:0/1364491442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ff015dbb0 0x7f2ff014f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:40.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2feea00640 1 -- 172.21.15.32:0/1364491442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff01f7c50 con 0x7f2ff00b3620 2024-03-19T06:22:40.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2fef400640 1 --2- 172.21.15.32:0/1364491442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ff015dbb0 0x7f2ff014f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:40.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2fee000640 1 --2- 172.21.15.32:0/1364491442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00cc6c0 0x7f2ff014eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:40.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2feea00640 1 --2- 172.21.15.32:0/1364491442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ff00b3620 0x7f2ff00b1ad0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00010f0 tx=0x7f2fe000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:40.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2fe6a00640 1 -- 172.21.15.32:0/1364491442 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0017070 con 0x7f2ff00b3620 2024-03-19T06:22:40.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2fe6a00640 1 -- 172.21.15.32:0/1364491442 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe0005d10 con 0x7f2ff00b3620 2024-03-19T06:22:40.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2ff5600640 1 -- 172.21.15.32:0/1364491442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff00c88d0 con 0x7f2ff00b3620 2024-03-19T06:22:40.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2fe6a00640 1 -- 172.21.15.32:0/1364491442 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0007310 con 0x7f2ff00b3620 2024-03-19T06:22:40.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.843+0000 7f2ff5600640 1 -- 172.21.15.32:0/1364491442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff00c8e90 con 0x7f2ff00b3620 2024-03-19T06:22:40.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.847+0000 7f2ff5600640 1 -- 172.21.15.32:0/1364491442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff00749e0 con 0x7f2ff00b3620 2024-03-19T06:22:40.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.847+0000 7f2fe6a00640 1 -- 172.21.15.32:0/1364491442 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2fe001a070 con 0x7f2ff00b3620 2024-03-19T06:22:40.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.847+0000 7f2fe6a00640 1 --2- 172.21.15.32:0/1364491442 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2fd0067660 0x7f2fd0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:40.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.847+0000 7f2fe6a00640 1 -- 172.21.15.32:0/1364491442 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f2fe0084e40 con 0x7f2ff00b3620 2024-03-19T06:22:40.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.847+0000 7f2fee000640 1 --2- 172.21.15.32:0/1364491442 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2fd0067660 0x7f2fd0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:40.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.847+0000 7f2fee000640 1 --2- 172.21.15.32:0/1364491442 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2fd0067660 0x7f2fd0069b20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0b2000 tx=0x7f2fdc0aa070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:40.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:40.851+0000 7f2fe6a00640 1 -- 172.21.15.32:0/1364491442 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2fe0055920 con 0x7f2ff00b3620 2024-03-19T06:22:41.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.015+0000 7f2ff5600640 1 -- 172.21.15.32:0/1364491442 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ff00702b0 con 0x7f2ff00b3620 2024-03-19T06:22:41.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.015+0000 7f2fe6a00640 1 -- 172.21.15.32:0/1364491442 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2fe0055220 con 0x7f2ff00b3620 2024-03-19T06:22:41.005 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:22:41.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.019+0000 7f2ff5600640 1 -- 172.21.15.32:0/1364491442 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2fd0067660 msgr2=0x7f2fd0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.019+0000 7f2ff5600640 1 --2- 172.21.15.32:0/1364491442 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2fd0067660 0x7f2fd0069b20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0b2000 tx=0x7f2fdc0aa070 comp rx=0 tx=0).stop 2024-03-19T06:22:41.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.019+0000 7f2ff5600640 1 -- 172.21.15.32:0/1364491442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ff00b3620 msgr2=0x7f2ff00b1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.019+0000 7f2ff5600640 1 --2- 172.21.15.32:0/1364491442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ff00b3620 0x7f2ff00b1ad0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00010f0 tx=0x7f2fe000c890 comp rx=0 tx=0).stop 2024-03-19T06:22:41.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.019+0000 7f2ff5600640 1 -- 172.21.15.32:0/1364491442 shutdown_connections 2024-03-19T06:22:41.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.019+0000 7f2ff5600640 1 --2- 172.21.15.32:0/1364491442 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2fd0067660 0x7f2fd0069b20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.019+0000 7f2ff5600640 1 --2- 172.21.15.32:0/1364491442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ff015dbb0 0x7f2ff014f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.019+0000 7f2ff5600640 1 --2- 172.21.15.32:0/1364491442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00cc6c0 0x7f2ff014eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.019+0000 7f2ff5600640 1 --2- 172.21.15.32:0/1364491442 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ff00b3620 0x7f2ff00b1ad0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.019+0000 7f2ff5600640 1 -- 172.21.15.32:0/1364491442 >> 172.21.15.32:0/1364491442 conn(0x7f2ff0066ca0 msgr2=0x7f2ff0067080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:41.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.019+0000 7f2ff5600640 1 -- 172.21.15.32:0/1364491442 shutdown_connections 2024-03-19T06:22:41.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.019+0000 7f2ff5600640 1 -- 172.21.15.32:0/1364491442 wait complete. 2024-03-19T06:22:41.026 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:22:41.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.179+0000 7fca1cc00640 1 Processor -- start 2024-03-19T06:22:41.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.179+0000 7fca1cc00640 1 -- start start 2024-03-19T06:22:41.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.183+0000 7fca1cc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fca1806b450 0x7fca1806f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.183+0000 7fca1cc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca180aea70 0x7fca180ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.183+0000 7fca1cc00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca180af2d0 con 0x7fca1815a840 2024-03-19T06:22:41.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.183+0000 7fca1cc00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca180cdc20 con 0x7fca1806b450 2024-03-19T06:22:41.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.183+0000 7fca1cc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1815eea0 con 0x7fca180aea70 2024-03-19T06:22:41.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.183+0000 7fca0d400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fca1806b450 0x7fca1806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.183+0000 7fca0d400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fca1806b450 0x7fca1806f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56752/0 (socket says 172.21.15.32:56752) 2024-03-19T06:22:41.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.183+0000 7fca0d400640 1 -- 172.21.15.32:0/1907990970 learned_addr learned my addr 172.21.15.32:0/1907990970 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:41.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.183+0000 7fca16800640 1 --2- 172.21.15.32:0/1907990970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca180aea70 0x7fca180ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.183+0000 7fca0d400640 1 -- 172.21.15.32:0/1907990970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca180aea70 msgr2=0x7fca180ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:41.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.183+0000 7fca0d400640 1 --2- 172.21.15.32:0/1907990970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca180aea70 0x7fca180ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.183+0000 7fca0d400640 1 -- 172.21.15.32:0/1907990970 >> v1:172.21.15.171:6789/0 conn(0x7fca1815a840 legacy=0x7fca1806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.183+0000 7fca0d400640 1 -- 172.21.15.32:0/1907990970 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1815f180 con 0x7fca1806b450 2024-03-19T06:22:41.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.183+0000 7fca16800640 1 --2- 172.21.15.32:0/1907990970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca180aea70 0x7fca180ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:41.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.187+0000 7fca0d400640 1 --2- 172.21.15.32:0/1907990970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca1806b450 0x7fca1806f040 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fca0000bb10 tx=0x7fca0001ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cca53afdb4fa00f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:41.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.187+0000 7fca15400640 1 -- 172.21.15.32:0/1907990970 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca000b4070 con 0x7fca1806b450 2024-03-19T06:22:41.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.187+0000 7fca15400640 1 -- 172.21.15.32:0/1907990970 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca000a7c00 con 0x7fca1806b450 2024-03-19T06:22:41.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.187+0000 7fca15400640 1 -- 172.21.15.32:0/1907990970 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca000af440 con 0x7fca1806b450 2024-03-19T06:22:41.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.187+0000 7fca1cc00640 1 -- 172.21.15.32:0/1907990970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca1806b450 msgr2=0x7fca1806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.187+0000 7fca1cc00640 1 --2- 172.21.15.32:0/1907990970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca1806b450 0x7fca1806f040 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fca0000bb10 tx=0x7fca0001ead0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.187+0000 7fca1cc00640 1 -- 172.21.15.32:0/1907990970 shutdown_connections 2024-03-19T06:22:41.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.187+0000 7fca1cc00640 1 --2- 172.21.15.32:0/1907990970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca180aea70 0x7fca180ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.187+0000 7fca1cc00640 1 --2- 172.21.15.32:0/1907990970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca1806b450 0x7fca1806f040 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.187+0000 7fca1cc00640 1 -- 172.21.15.32:0/1907990970 >> 172.21.15.32:0/1907990970 conn(0x7fca180b1590 msgr2=0x7fca180b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:41.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.187+0000 7fca1cc00640 1 -- 172.21.15.32:0/1907990970 shutdown_connections 2024-03-19T06:22:41.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.187+0000 7fca1cc00640 1 -- 172.21.15.32:0/1907990970 wait complete. 2024-03-19T06:22:41.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.187+0000 7fca1cc00640 1 Processor -- start 2024-03-19T06:22:41.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.187+0000 7fca1cc00640 1 -- start start 2024-03-19T06:22:41.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca1cc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca1806b450 0x7fca181605b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca1cc00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca180aea70 0x7fca1815c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca1cc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca1815a840 0x7fca18161100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca1cc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca180cef80 con 0x7fca1815a840 2024-03-19T06:22:41.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca1cc00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca180cee00 con 0x7fca180aea70 2024-03-19T06:22:41.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca1cc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca180cf100 con 0x7fca1806b450 2024-03-19T06:22:41.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca16800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca1815a840 0x7fca18161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca0d400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca180aea70 0x7fca1815c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca15e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca1806b450 0x7fca181605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca16800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca1815a840 0x7fca18161100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56770/0 (socket says 172.21.15.32:56770) 2024-03-19T06:22:41.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca16800640 1 -- 172.21.15.32:0/2787399736 learned_addr learned my addr 172.21.15.32:0/2787399736 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:41.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca16800640 1 -- 172.21.15.32:0/2787399736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca1806b450 msgr2=0x7fca181605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca16800640 1 --2- 172.21.15.32:0/2787399736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca1806b450 0x7fca181605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca16800640 1 -- 172.21.15.32:0/2787399736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca180aea70 msgr2=0x7fca1815c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca16800640 1 --2- 172.21.15.32:0/2787399736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca180aea70 0x7fca1815c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca16800640 1 -- 172.21.15.32:0/2787399736 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca18160af0 con 0x7fca1815a840 2024-03-19T06:22:41.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca16800640 1 --2- 172.21.15.32:0/2787399736 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca1815a840 0x7fca18161100 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fca1000c7f0 tx=0x7fca1000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:41.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca0ea00640 1 -- 172.21.15.32:0/2787399736 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10015020 con 0x7fca1815a840 2024-03-19T06:22:41.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca0ea00640 1 -- 172.21.15.32:0/2787399736 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca10004250 con 0x7fca1815a840 2024-03-19T06:22:41.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca1cc00640 1 -- 172.21.15.32:0/2787399736 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1815b1e0 con 0x7fca1815a840 2024-03-19T06:22:41.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca0ea00640 1 -- 172.21.15.32:0/2787399736 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10003620 con 0x7fca1815a840 2024-03-19T06:22:41.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca1cc00640 1 -- 172.21.15.32:0/2787399736 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1815ba80 con 0x7fca1815a840 2024-03-19T06:22:41.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca1cc00640 1 -- 172.21.15.32:0/2787399736 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca180749e0 con 0x7fca1815a840 2024-03-19T06:22:41.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.191+0000 7fca0ea00640 1 -- 172.21.15.32:0/2787399736 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fca10018020 con 0x7fca1815a840 2024-03-19T06:22:41.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.195+0000 7fca0ea00640 1 --2- 172.21.15.32:0/2787399736 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc9f4067660 0x7fc9f4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.195+0000 7fca0ea00640 1 -- 172.21.15.32:0/2787399736 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fca100858a0 con 0x7fca1815a840 2024-03-19T06:22:41.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.195+0000 7fca15e00640 1 --2- 172.21.15.32:0/2787399736 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc9f4067660 0x7fc9f4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.195+0000 7fca15e00640 1 --2- 172.21.15.32:0/2787399736 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc9f4067660 0x7fc9f4069b20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fca08001ea0 tx=0x7fca08009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:41.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.199+0000 7fca0ea00640 1 -- 172.21.15.32:0/2787399736 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fca1001f030 con 0x7fca1815a840 2024-03-19T06:22:41.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.359+0000 7fca1cc00640 1 -- 172.21.15.32:0/2787399736 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca1806e6c0 con 0x7fca1815a840 2024-03-19T06:22:41.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.363+0000 7fca0ea00640 1 -- 172.21.15.32:0/2787399736 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca10055ca0 con 0x7fca1815a840 2024-03-19T06:22:41.350 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:22:41.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.363+0000 7fca1cc00640 1 -- 172.21.15.32:0/2787399736 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc9f4067660 msgr2=0x7fc9f4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.363+0000 7fca1cc00640 1 --2- 172.21.15.32:0/2787399736 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc9f4067660 0x7fc9f4069b20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fca08001ea0 tx=0x7fca08009040 comp rx=0 tx=0).stop 2024-03-19T06:22:41.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.363+0000 7fca1cc00640 1 -- 172.21.15.32:0/2787399736 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca1815a840 msgr2=0x7fca18161100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.363+0000 7fca1cc00640 1 --2- 172.21.15.32:0/2787399736 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca1815a840 0x7fca18161100 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fca1000c7f0 tx=0x7fca1000ccb0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.363+0000 7fca1cc00640 1 -- 172.21.15.32:0/2787399736 shutdown_connections 2024-03-19T06:22:41.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.363+0000 7fca1cc00640 1 --2- 172.21.15.32:0/2787399736 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc9f4067660 0x7fc9f4069b20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.363+0000 7fca1cc00640 1 --2- 172.21.15.32:0/2787399736 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca1815a840 0x7fca18161100 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.363+0000 7fca1cc00640 1 --2- 172.21.15.32:0/2787399736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca180aea70 0x7fca1815c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.363+0000 7fca1cc00640 1 --2- 172.21.15.32:0/2787399736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca1806b450 0x7fca181605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.363+0000 7fca1cc00640 1 -- 172.21.15.32:0/2787399736 >> 172.21.15.32:0/2787399736 conn(0x7fca180b1590 msgr2=0x7fca180b0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:41.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.363+0000 7fca1cc00640 1 -- 172.21.15.32:0/2787399736 shutdown_connections 2024-03-19T06:22:41.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.363+0000 7fca1cc00640 1 -- 172.21.15.32:0/2787399736 wait complete. 2024-03-19T06:22:41.371 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:22:41.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.527+0000 7fe5cd800640 1 Processor -- start 2024-03-19T06:22:41.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.527+0000 7fe5cd800640 1 -- start start 2024-03-19T06:22:41.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.527+0000 7fe5cd800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe5c815ba00 0x7fe5c80b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.527+0000 7fe5cd800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5c80b3de0 0x7fe5c80cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.527+0000 7fe5cd800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c80d14b0 con 0x7fe5c80b7530 2024-03-19T06:22:41.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.527+0000 7fe5cd800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c80d20c0 con 0x7fe5c815ba00 2024-03-19T06:22:41.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.527+0000 7fe5cd800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c80d1790 con 0x7fe5c80b3de0 2024-03-19T06:22:41.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.527+0000 7fe5c6a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe5c815ba00 0x7fe5c80b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.527+0000 7fe5c6a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe5c815ba00 0x7fe5c80b6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:35106/0 (socket says 172.21.15.32:35106) 2024-03-19T06:22:41.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.527+0000 7fe5c7400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5c80b3de0 0x7fe5c80cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.527+0000 7fe5c6a00640 1 -- 172.21.15.32:0/1545703588 learned_addr learned my addr 172.21.15.32:0/1545703588 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:41.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.527+0000 7fe5c6a00640 1 -- 172.21.15.32:0/1545703588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5c80b3de0 msgr2=0x7fe5c80cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:41.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.527+0000 7fe5c6a00640 1 --2- 172.21.15.32:0/1545703588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5c80b3de0 0x7fe5c80cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.527+0000 7fe5c6a00640 1 -- 172.21.15.32:0/1545703588 >> v1:172.21.15.171:6789/0 conn(0x7fe5c80b7530 legacy=0x7fe5c80b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.527+0000 7fe5c6a00640 1 -- 172.21.15.32:0/1545703588 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c80d1a70 con 0x7fe5c815ba00 2024-03-19T06:22:41.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.527+0000 7fe5c5600640 1 -- 172.21.15.32:0/1545703588 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386538215 0 0) 0x7fe5c80d14b0 con 0x7fe5c80b7530 2024-03-19T06:22:41.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.531+0000 7fe5c6a00640 1 --2- 172.21.15.32:0/1545703588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c815ba00 0x7fe5c80b6ff0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009870 tx=0x7fe5b801ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7131491df0ab3906 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:41.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.531+0000 7fe5c5600640 1 -- 172.21.15.32:0/1545703588 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b80b5070 con 0x7fe5c815ba00 2024-03-19T06:22:41.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.531+0000 7fe5c5600640 1 -- 172.21.15.32:0/1545703588 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b80a8a50 con 0x7fe5c815ba00 2024-03-19T06:22:41.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.531+0000 7fe5c5600640 1 -- 172.21.15.32:0/1545703588 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b80a8e20 con 0x7fe5c815ba00 2024-03-19T06:22:41.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.531+0000 7fe5cd800640 1 -- 172.21.15.32:0/1545703588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c815ba00 msgr2=0x7fe5c80b6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.531+0000 7fe5cd800640 1 --2- 172.21.15.32:0/1545703588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c815ba00 0x7fe5c80b6ff0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009870 tx=0x7fe5b801ed50 comp rx=0 tx=0).stop 2024-03-19T06:22:41.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.531+0000 7fe5cd800640 1 -- 172.21.15.32:0/1545703588 shutdown_connections 2024-03-19T06:22:41.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.531+0000 7fe5cd800640 1 --2- 172.21.15.32:0/1545703588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5c80b3de0 0x7fe5c80cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.531+0000 7fe5cd800640 1 --2- 172.21.15.32:0/1545703588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c815ba00 0x7fe5c80b6ff0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.531+0000 7fe5cd800640 1 -- 172.21.15.32:0/1545703588 >> 172.21.15.32:0/1545703588 conn(0x7fe5c8066ca0 msgr2=0x7fe5c80670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:41.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.531+0000 7fe5cd800640 1 -- 172.21.15.32:0/1545703588 shutdown_connections 2024-03-19T06:22:41.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.531+0000 7fe5cd800640 1 -- 172.21.15.32:0/1545703588 wait complete. 2024-03-19T06:22:41.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.531+0000 7fe5cd800640 1 Processor -- start 2024-03-19T06:22:41.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.531+0000 7fe5cd800640 1 -- start start 2024-03-19T06:22:41.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5cd800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5c80b3de0 0x7fe5c815e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5cd800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c80b7530 0x7fe5c814bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5cd800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5c815ba00 0x7fe5c814c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5cd800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c815bf60 con 0x7fe5c80b3de0 2024-03-19T06:22:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5cd800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c815bde0 con 0x7fe5c80b7530 2024-03-19T06:22:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5cd800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c80d10f0 con 0x7fe5c815ba00 2024-03-19T06:22:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5c6a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5c80b3de0 0x7fe5c815e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5c6a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5c80b3de0 0x7fe5c815e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56776/0 (socket says 172.21.15.32:56776) 2024-03-19T06:22:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5c6a00640 1 -- 172.21.15.32:0/729117183 learned_addr learned my addr 172.21.15.32:0/729117183 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5c7400640 1 --2- 172.21.15.32:0/729117183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5c815ba00 0x7fe5c814c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5c6000640 1 --2- 172.21.15.32:0/729117183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c80b7530 0x7fe5c814bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5c6a00640 1 -- 172.21.15.32:0/729117183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5c815ba00 msgr2=0x7fe5c814c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5c6a00640 1 --2- 172.21.15.32:0/729117183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5c815ba00 0x7fe5c814c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5c6a00640 1 -- 172.21.15.32:0/729117183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c80b7530 msgr2=0x7fe5c814bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5c6a00640 1 --2- 172.21.15.32:0/729117183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c80b7530 0x7fe5c814bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5c6a00640 1 -- 172.21.15.32:0/729117183 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c80c9520 con 0x7fe5c80b3de0 2024-03-19T06:22:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5c6a00640 1 --2- 172.21.15.32:0/729117183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5c80b3de0 0x7fe5c815e780 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80b3040 tx=0x7fe5b801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:41.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5bea00640 1 -- 172.21.15.32:0/729117183 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b80c0070 con 0x7fe5c80b3de0 2024-03-19T06:22:41.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5bea00640 1 -- 172.21.15.32:0/729117183 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b80b0e20 con 0x7fe5c80b3de0 2024-03-19T06:22:41.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5bea00640 1 -- 172.21.15.32:0/729117183 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b80b5070 con 0x7fe5c80b3de0 2024-03-19T06:22:41.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5cd800640 1 -- 172.21.15.32:0/729117183 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c80c9800 con 0x7fe5c80b3de0 2024-03-19T06:22:41.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5cd800640 1 -- 172.21.15.32:0/729117183 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c80c9dc0 con 0x7fe5c80b3de0 2024-03-19T06:22:41.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.535+0000 7fe5cd800640 1 -- 172.21.15.32:0/729117183 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c80749e0 con 0x7fe5c80b3de0 2024-03-19T06:22:41.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.539+0000 7fe5bea00640 1 -- 172.21.15.32:0/729117183 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe5b80c3070 con 0x7fe5c80b3de0 2024-03-19T06:22:41.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.539+0000 7fe5bea00640 1 --2- 172.21.15.32:0/729117183 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5a8067660 0x7fe5a8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.539+0000 7fe5bea00640 1 -- 172.21.15.32:0/729117183 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fe5b8122e60 con 0x7fe5c80b3de0 2024-03-19T06:22:41.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.539+0000 7fe5c6000640 1 --2- 172.21.15.32:0/729117183 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5a8067660 0x7fe5a8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.539+0000 7fe5c6000640 1 --2- 172.21.15.32:0/729117183 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5a8067660 0x7fe5a8069b20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80b0ba0 tx=0x7fe5b4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:41.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.543+0000 7fe5bea00640 1 -- 172.21.15.32:0/729117183 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fe5b80188b0 con 0x7fe5c80b3de0 2024-03-19T06:22:41.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.707+0000 7fe5cd800640 1 -- 172.21.15.32:0/729117183 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5c80cf0b0 con 0x7fe5c80b3de0 2024-03-19T06:22:41.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.707+0000 7fe5bea00640 1 -- 172.21.15.32:0/729117183 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5b80f3260 con 0x7fe5c80b3de0 2024-03-19T06:22:41.695 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:22:41.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.707+0000 7fe5cd800640 1 -- 172.21.15.32:0/729117183 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5a8067660 msgr2=0x7fe5a8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.707+0000 7fe5cd800640 1 --2- 172.21.15.32:0/729117183 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5a8067660 0x7fe5a8069b20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80b0ba0 tx=0x7fe5b4009040 comp rx=0 tx=0).stop 2024-03-19T06:22:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.707+0000 7fe5cd800640 1 -- 172.21.15.32:0/729117183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5c80b3de0 msgr2=0x7fe5c815e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.707+0000 7fe5cd800640 1 --2- 172.21.15.32:0/729117183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5c80b3de0 0x7fe5c815e780 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80b3040 tx=0x7fe5b801baf0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.707+0000 7fe5cd800640 1 -- 172.21.15.32:0/729117183 shutdown_connections 2024-03-19T06:22:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.707+0000 7fe5cd800640 1 --2- 172.21.15.32:0/729117183 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5a8067660 0x7fe5a8069b20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.707+0000 7fe5cd800640 1 --2- 172.21.15.32:0/729117183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5c815ba00 0x7fe5c814c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.707+0000 7fe5cd800640 1 --2- 172.21.15.32:0/729117183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c80b7530 0x7fe5c814bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.707+0000 7fe5cd800640 1 --2- 172.21.15.32:0/729117183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5c80b3de0 0x7fe5c815e780 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.707+0000 7fe5cd800640 1 -- 172.21.15.32:0/729117183 >> 172.21.15.32:0/729117183 conn(0x7fe5c8066ca0 msgr2=0x7fe5c80b6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.707+0000 7fe5cd800640 1 -- 172.21.15.32:0/729117183 shutdown_connections 2024-03-19T06:22:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.707+0000 7fe5cd800640 1 -- 172.21.15.32:0/729117183 wait complete. 2024-03-19T06:22:41.717 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-03-19T06:22:41.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.871+0000 7fd4af000640 1 Processor -- start 2024-03-19T06:22:41.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.871+0000 7fd4af000640 1 -- start start 2024-03-19T06:22:41.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.871+0000 7fd4af000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd4a815dba0 0x7fd4a806ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.871+0000 7fd4af000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd4a806b280 0x7fd4a806fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.871+0000 7fd4af000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a80d16d0 con 0x7fd4a8070070 2024-03-19T06:22:41.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.871+0000 7fd4af000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a80704c0 con 0x7fd4a815dba0 2024-03-19T06:22:41.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.871+0000 7fd4af000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a80ccea0 con 0x7fd4a806b280 2024-03-19T06:22:41.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.875+0000 7fd4a7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd4a815dba0 0x7fd4a806ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.875+0000 7fd4a7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd4a815dba0 0x7fd4a806ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56784/0 (socket says 172.21.15.32:56784) 2024-03-19T06:22:41.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.875+0000 7fd4a7e00640 1 -- 172.21.15.32:0/3769490463 learned_addr learned my addr 172.21.15.32:0/3769490463 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:41.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.875+0000 7fd49f400640 1 --2- 172.21.15.32:0/3769490463 >> v2:172.21.15.171:3300/0 conn(0x7fd4a806b280 0x7fd4a806fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.875+0000 7fd4a7e00640 1 -- 172.21.15.32:0/3769490463 >> v2:172.21.15.171:3300/0 conn(0x7fd4a806b280 msgr2=0x7fd4a806fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:41.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.875+0000 7fd4a7e00640 1 --2- 172.21.15.32:0/3769490463 >> v2:172.21.15.171:3300/0 conn(0x7fd4a806b280 0x7fd4a806fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.875+0000 7fd4a7e00640 1 -- 172.21.15.32:0/3769490463 >> v1:172.21.15.171:6789/0 conn(0x7fd4a8070070 legacy=0x7fd4a806e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.875+0000 7fd4a7e00640 1 -- 172.21.15.32:0/3769490463 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a8070710 con 0x7fd4a815dba0 2024-03-19T06:22:41.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.875+0000 7fd4a7e00640 1 --2- 172.21.15.32:0/3769490463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4a815dba0 0x7fd4a806ad40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd4a806bab0 tx=0x7fd49801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a905f348e74c62b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:41.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.875+0000 7fd4a7400640 1 -- 172.21.15.32:0/3769490463 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4980b0070 con 0x7fd4a815dba0 2024-03-19T06:22:41.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.875+0000 7fd4a7400640 1 -- 172.21.15.32:0/3769490463 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4980ab400 con 0x7fd4a815dba0 2024-03-19T06:22:41.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.875+0000 7fd4a7400640 1 -- 172.21.15.32:0/3769490463 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4980ab7d0 con 0x7fd4a815dba0 2024-03-19T06:22:41.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4af000640 1 -- 172.21.15.32:0/3769490463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4a815dba0 msgr2=0x7fd4a806ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4af000640 1 --2- 172.21.15.32:0/3769490463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4a815dba0 0x7fd4a806ad40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd4a806bab0 tx=0x7fd49801c450 comp rx=0 tx=0).stop 2024-03-19T06:22:41.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4af000640 1 -- 172.21.15.32:0/3769490463 shutdown_connections 2024-03-19T06:22:41.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4af000640 1 --2- 172.21.15.32:0/3769490463 >> v2:172.21.15.171:3300/0 conn(0x7fd4a806b280 0x7fd4a806fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4af000640 1 --2- 172.21.15.32:0/3769490463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4a815dba0 0x7fd4a806ad40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4af000640 1 -- 172.21.15.32:0/3769490463 >> 172.21.15.32:0/3769490463 conn(0x7fd4a8099a70 msgr2=0x7fd4a8099e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:41.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4af000640 1 -- 172.21.15.32:0/3769490463 shutdown_connections 2024-03-19T06:22:41.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4af000640 1 -- 172.21.15.32:0/3769490463 wait complete. 2024-03-19T06:22:41.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4af000640 1 Processor -- start 2024-03-19T06:22:41.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4af000640 1 -- start start 2024-03-19T06:22:41.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4af000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4a806b280 0x7fd4a8154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4af000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4a8070070 0x7fd4a8155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4af000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4a815dba0 0x7fd4a8155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4af000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a815df80 con 0x7fd4a806b280 2024-03-19T06:22:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4af000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a80ce0d0 con 0x7fd4a815dba0 2024-03-19T06:22:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4af000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a815e100 con 0x7fd4a8070070 2024-03-19T06:22:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4a7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4a806b280 0x7fd4a8154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4a7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4a806b280 0x7fd4a8154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56790/0 (socket says 172.21.15.32:56790) 2024-03-19T06:22:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4a7e00640 1 -- 172.21.15.32:0/1538746821 learned_addr learned my addr 172.21.15.32:0/1538746821 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4ad000640 1 --2- 172.21.15.32:0/1538746821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4a815dba0 0x7fd4a8155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd49f400640 1 --2- 172.21.15.32:0/1538746821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4a8070070 0x7fd4a8155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4a7e00640 1 -- 172.21.15.32:0/1538746821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4a8070070 msgr2=0x7fd4a8155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4a7e00640 1 --2- 172.21.15.32:0/1538746821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4a8070070 0x7fd4a8155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4a7e00640 1 -- 172.21.15.32:0/1538746821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4a815dba0 msgr2=0x7fd4a8155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4a7e00640 1 --2- 172.21.15.32:0/1538746821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4a815dba0 0x7fd4a8155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd4a7e00640 1 -- 172.21.15.32:0/1538746821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a80b4770 con 0x7fd4a806b280 2024-03-19T06:22:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.879+0000 7fd49f400640 1 --2- 172.21.15.32:0/1538746821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4a8070070 0x7fd4a8155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:41.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.883+0000 7fd4a7e00640 1 --2- 172.21.15.32:0/1538746821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4a806b280 0x7fd4a8154170 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd4980ae040 tx=0x7fd49801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:41.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.883+0000 7fd4a4c00640 1 -- 172.21.15.32:0/1538746821 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4980ba020 con 0x7fd4a806b280 2024-03-19T06:22:41.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.883+0000 7fd4a4c00640 1 -- 172.21.15.32:0/1538746821 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4980a4e00 con 0x7fd4a806b280 2024-03-19T06:22:41.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.883+0000 7fd4af000640 1 -- 172.21.15.32:0/1538746821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a80b20d0 con 0x7fd4a806b280 2024-03-19T06:22:41.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.883+0000 7fd4a4c00640 1 -- 172.21.15.32:0/1538746821 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4980b0040 con 0x7fd4a806b280 2024-03-19T06:22:41.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.883+0000 7fd4af000640 1 -- 172.21.15.32:0/1538746821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a80b2690 con 0x7fd4a806b280 2024-03-19T06:22:41.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.883+0000 7fd4af000640 1 -- 172.21.15.32:0/1538746821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a80749e0 con 0x7fd4a806b280 2024-03-19T06:22:41.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.883+0000 7fd4a4c00640 1 -- 172.21.15.32:0/1538746821 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd4980bd020 con 0x7fd4a806b280 2024-03-19T06:22:41.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.883+0000 7fd4a4c00640 1 --2- 172.21.15.32:0/1538746821 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd484067660 0x7fd484069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:41.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.883+0000 7fd4a4c00640 1 -- 172.21.15.32:0/1538746821 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fd49811fbf0 con 0x7fd4a806b280 2024-03-19T06:22:41.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.883+0000 7fd49f400640 1 --2- 172.21.15.32:0/1538746821 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd484067660 0x7fd484069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:41.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.887+0000 7fd49f400640 1 --2- 172.21.15.32:0/1538746821 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd484067660 0x7fd484069b20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd4a806fd40 tx=0x7fd490008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:41.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:41.887+0000 7fd4a4c00640 1 -- 172.21.15.32:0/1538746821 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fd4980c4030 con 0x7fd4a806b280 2024-03-19T06:22:42.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.051+0000 7fd4af000640 1 -- 172.21.15.32:0/1538746821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fd4a806d620 con 0x7fd4a806b280 2024-03-19T06:22:42.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.055+0000 7fd4a4c00640 1 -- 172.21.15.32:0/1538746821 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v38) v1 ==== 97+0+11 (secure 0 0 0) 0x7fd4980160d0 con 0x7fd4a806b280 2024-03-19T06:22:42.042 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:22:42.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.055+0000 7fd4af000640 1 -- 172.21.15.32:0/1538746821 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd484067660 msgr2=0x7fd484069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.055+0000 7fd4af000640 1 --2- 172.21.15.32:0/1538746821 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd484067660 0x7fd484069b20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd4a806fd40 tx=0x7fd490008040 comp rx=0 tx=0).stop 2024-03-19T06:22:42.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.055+0000 7fd4af000640 1 -- 172.21.15.32:0/1538746821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4a806b280 msgr2=0x7fd4a8154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.055+0000 7fd4af000640 1 --2- 172.21.15.32:0/1538746821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4a806b280 0x7fd4a8154170 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd4980ae040 tx=0x7fd49801ac90 comp rx=0 tx=0).stop 2024-03-19T06:22:42.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.055+0000 7fd4af000640 1 -- 172.21.15.32:0/1538746821 shutdown_connections 2024-03-19T06:22:42.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.055+0000 7fd4af000640 1 --2- 172.21.15.32:0/1538746821 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd484067660 0x7fd484069b20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.055+0000 7fd4af000640 1 --2- 172.21.15.32:0/1538746821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4a815dba0 0x7fd4a8155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.055+0000 7fd4af000640 1 --2- 172.21.15.32:0/1538746821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4a8070070 0x7fd4a8155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.055+0000 7fd4af000640 1 --2- 172.21.15.32:0/1538746821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4a806b280 0x7fd4a8154170 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.055+0000 7fd4af000640 1 -- 172.21.15.32:0/1538746821 >> 172.21.15.32:0/1538746821 conn(0x7fd4a8099a70 msgr2=0x7fd4a8156f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:42.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.055+0000 7fd4af000640 1 -- 172.21.15.32:0/1538746821 shutdown_connections 2024-03-19T06:22:42.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.055+0000 7fd4af000640 1 -- 172.21.15.32:0/1538746821 wait complete. 2024-03-19T06:22:42.064 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:22:42.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.215+0000 7f3cae200640 1 Processor -- start 2024-03-19T06:22:42.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.215+0000 7f3cae200640 1 -- start start 2024-03-19T06:22:42.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.219+0000 7f3cae200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3ca815a7c0 0x7f3ca80cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.219+0000 7f3cae200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80b4c50 0x7f3ca80b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.219+0000 7f3cae200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca80cb670 con 0x7f3ca80cc680 2024-03-19T06:22:42.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.219+0000 7f3cae200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca80b5600 con 0x7f3ca815a7c0 2024-03-19T06:22:42.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.219+0000 7f3cae200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca815f400 con 0x7f3ca80b4c50 2024-03-19T06:22:42.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.219+0000 7f3ca7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3ca815a7c0 0x7f3ca80cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.219+0000 7f3ca7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3ca815a7c0 0x7f3ca80cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56800/0 (socket says 172.21.15.32:56800) 2024-03-19T06:22:42.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.219+0000 7f3ca7400640 1 -- 172.21.15.32:0/1740131858 learned_addr learned my addr 172.21.15.32:0/1740131858 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:42.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.219+0000 7f3ca7e00640 1 --2- 172.21.15.32:0/1740131858 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80b4c50 0x7f3ca80b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.219+0000 7f3ca7400640 1 -- 172.21.15.32:0/1740131858 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80b4c50 msgr2=0x7f3ca80b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:42.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.219+0000 7f3ca7400640 1 --2- 172.21.15.32:0/1740131858 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80b4c50 0x7f3ca80b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.219+0000 7f3ca7400640 1 -- 172.21.15.32:0/1740131858 >> v1:172.21.15.171:6789/0 conn(0x7f3ca80cc680 legacy=0x7f3ca815ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.219+0000 7f3ca7400640 1 -- 172.21.15.32:0/1740131858 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca80cb950 con 0x7f3ca815a7c0 2024-03-19T06:22:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.223+0000 7f3ca7400640 1 --2- 172.21.15.32:0/1740131858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca815a7c0 0x7f3ca80cae20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009870 tx=0x7f3c9801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2160812b07fefcf7 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.223+0000 7f3ca6a00640 1 -- 172.21.15.32:0/1740131858 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c980ab610 con 0x7f3ca815a7c0 2024-03-19T06:22:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.223+0000 7f3ca6a00640 1 -- 172.21.15.32:0/1740131858 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c980b0070 con 0x7f3ca815a7c0 2024-03-19T06:22:42.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.223+0000 7f3ca6a00640 1 -- 172.21.15.32:0/1740131858 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c980ab9d0 con 0x7f3ca815a7c0 2024-03-19T06:22:42.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.223+0000 7f3cae200640 1 -- 172.21.15.32:0/1740131858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca815a7c0 msgr2=0x7f3ca80cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.223+0000 7f3cae200640 1 --2- 172.21.15.32:0/1740131858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca815a7c0 0x7f3ca80cae20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009870 tx=0x7f3c9801c560 comp rx=0 tx=0).stop 2024-03-19T06:22:42.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.223+0000 7f3cae200640 1 -- 172.21.15.32:0/1740131858 shutdown_connections 2024-03-19T06:22:42.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.223+0000 7f3cae200640 1 --2- 172.21.15.32:0/1740131858 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca80b4c50 0x7f3ca80b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.223+0000 7f3cae200640 1 --2- 172.21.15.32:0/1740131858 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca815a7c0 0x7f3ca80cae20 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.223+0000 7f3cae200640 1 -- 172.21.15.32:0/1740131858 >> 172.21.15.32:0/1740131858 conn(0x7f3ca80b1280 msgr2=0x7f3ca80b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:42.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.223+0000 7f3cae200640 1 -- 172.21.15.32:0/1740131858 shutdown_connections 2024-03-19T06:22:42.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.223+0000 7f3cae200640 1 -- 172.21.15.32:0/1740131858 wait complete. 2024-03-19T06:22:42.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.223+0000 7f3cae200640 1 Processor -- start 2024-03-19T06:22:42.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.223+0000 7f3cae200640 1 -- start start 2024-03-19T06:22:42.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3cae200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80b4c50 0x7f3ca815b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3cae200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ca80cc680 0x7f3ca80719c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3cae200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca815a7c0 0x7f3ca8148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3cae200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80cbdb0 con 0x7f3ca80b4c50 2024-03-19T06:22:42.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3cae200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80cbc30 con 0x7f3ca80cc680 2024-03-19T06:22:42.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3cae200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca81677f0 con 0x7f3ca815a7c0 2024-03-19T06:22:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3ca7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80b4c50 0x7f3ca815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3ca7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80b4c50 0x7f3ca815b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56810/0 (socket says 172.21.15.32:56810) 2024-03-19T06:22:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3ca7400640 1 -- 172.21.15.32:0/2407894874 learned_addr learned my addr 172.21.15.32:0/2407894874 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3ca7e00640 1 --2- 172.21.15.32:0/2407894874 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca815a7c0 0x7f3ca8148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3c9ea00640 1 --2- 172.21.15.32:0/2407894874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ca80cc680 0x7f3ca80719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3ca7400640 1 -- 172.21.15.32:0/2407894874 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca815a7c0 msgr2=0x7f3ca8148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3ca7400640 1 --2- 172.21.15.32:0/2407894874 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca815a7c0 0x7f3ca8148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3ca7400640 1 -- 172.21.15.32:0/2407894874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ca80cc680 msgr2=0x7f3ca80719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3ca7400640 1 --2- 172.21.15.32:0/2407894874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ca80cc680 0x7f3ca80719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3ca7400640 1 -- 172.21.15.32:0/2407894874 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca815c6b0 con 0x7f3ca80b4c50 2024-03-19T06:22:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3ca7400640 1 --2- 172.21.15.32:0/2407894874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80b4c50 0x7f3ca815b390 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3c980ad040 tx=0x7f3c9801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3c9fe00640 1 -- 172.21.15.32:0/2407894874 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c980be5f0 con 0x7f3ca80b4c50 2024-03-19T06:22:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3c9fe00640 1 -- 172.21.15.32:0/2407894874 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c980be790 con 0x7f3ca80b4c50 2024-03-19T06:22:42.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3cae200640 1 -- 172.21.15.32:0/2407894874 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca8156ad0 con 0x7f3ca80b4c50 2024-03-19T06:22:42.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3c9fe00640 1 -- 172.21.15.32:0/2407894874 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c980beb80 con 0x7f3ca80b4c50 2024-03-19T06:22:42.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3cae200640 1 -- 172.21.15.32:0/2407894874 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca815c0f0 con 0x7f3ca80b4c50 2024-03-19T06:22:42.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3cae200640 1 -- 172.21.15.32:0/2407894874 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca80749e0 con 0x7f3ca80b4c50 2024-03-19T06:22:42.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.227+0000 7f3c9fe00640 1 -- 172.21.15.32:0/2407894874 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3c980b43f0 con 0x7f3ca80b4c50 2024-03-19T06:22:42.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.231+0000 7f3c9fe00640 1 --2- 172.21.15.32:0/2407894874 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c84067690 0x7f3c84069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.231+0000 7f3c9fe00640 1 -- 172.21.15.32:0/2407894874 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f3c98120550 con 0x7f3ca80b4c50 2024-03-19T06:22:42.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.231+0000 7f3c9ea00640 1 --2- 172.21.15.32:0/2407894874 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c84067690 0x7f3c84069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.231+0000 7f3c9ea00640 1 --2- 172.21.15.32:0/2407894874 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c84067690 0x7f3c84069b50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8156650 tx=0x7f3c90009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:42.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.235+0000 7f3c9fe00640 1 -- 172.21.15.32:0/2407894874 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f3c980c4060 con 0x7f3ca80b4c50 2024-03-19T06:22:42.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.407+0000 7f3cae200640 1 -- 172.21.15.32:0/2407894874 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3ca80ce7b0 con 0x7f3ca80b4c50 2024-03-19T06:22:42.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.407+0000 7f3c9fe00640 1 -- 172.21.15.32:0/2407894874 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3c980a8050 con 0x7f3ca80b4c50 2024-03-19T06:22:42.396 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:22:42.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.407+0000 7f3cae200640 1 -- 172.21.15.32:0/2407894874 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c84067690 msgr2=0x7f3c84069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.407+0000 7f3cae200640 1 --2- 172.21.15.32:0/2407894874 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c84067690 0x7f3c84069b50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8156650 tx=0x7f3c90009040 comp rx=0 tx=0).stop 2024-03-19T06:22:42.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.407+0000 7f3cae200640 1 -- 172.21.15.32:0/2407894874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80b4c50 msgr2=0x7f3ca815b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.407+0000 7f3cae200640 1 --2- 172.21.15.32:0/2407894874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80b4c50 0x7f3ca815b390 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3c980ad040 tx=0x7f3c9801ada0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.411+0000 7f3cae200640 1 -- 172.21.15.32:0/2407894874 shutdown_connections 2024-03-19T06:22:42.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.411+0000 7f3cae200640 1 --2- 172.21.15.32:0/2407894874 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c84067690 0x7f3c84069b50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.411+0000 7f3cae200640 1 --2- 172.21.15.32:0/2407894874 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ca815a7c0 0x7f3ca8148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.411+0000 7f3cae200640 1 --2- 172.21.15.32:0/2407894874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ca80cc680 0x7f3ca80719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.411+0000 7f3cae200640 1 --2- 172.21.15.32:0/2407894874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ca80b4c50 0x7f3ca815b390 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.411+0000 7f3cae200640 1 -- 172.21.15.32:0/2407894874 >> 172.21.15.32:0/2407894874 conn(0x7f3ca80b1280 msgr2=0x7f3ca815ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:42.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.411+0000 7f3cae200640 1 -- 172.21.15.32:0/2407894874 shutdown_connections 2024-03-19T06:22:42.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.411+0000 7f3cae200640 1 -- 172.21.15.32:0/2407894874 wait complete. 2024-03-19T06:22:42.416 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:22:42.417 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:22:42.426 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:22:42.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.623+0000 7f7b3bc00640 1 Processor -- start 2024-03-19T06:22:42.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.623+0000 7f7b3bc00640 1 -- start start 2024-03-19T06:22:42.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.627+0000 7f7b3bc00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7b340b6b00 0x7f7b340b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.627+0000 7f7b3bc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b340d2db0 0x7f7b340d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.627+0000 7f7b3bc00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3415dfb0 con 0x7f7b3415dbd0 2024-03-19T06:22:42.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.627+0000 7f7b3bc00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b340d1ac0 con 0x7f7b340b6b00 2024-03-19T06:22:42.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.627+0000 7f7b3bc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340d1d10 con 0x7f7b340d2db0 2024-03-19T06:22:42.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.627+0000 7f7b33e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7b340b6b00 0x7f7b340b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.627+0000 7f7b39c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b340d2db0 0x7f7b340d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.627+0000 7f7b33e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7b340b6b00 0x7f7b340b6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:35138/0 (socket says 172.21.15.32:35138) 2024-03-19T06:22:42.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.627+0000 7f7b33e00640 1 -- 172.21.15.32:0/4176290786 learned_addr learned my addr 172.21.15.32:0/4176290786 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:42.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.627+0000 7f7b39200640 1 --1- 172.21.15.32:0/4176290786 >> v1:172.21.15.171:6789/0 conn(0x7f7b3415dbd0 0x7f7b340b92f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:58114/0 (socket says 172.21.15.32:58114) 2024-03-19T06:22:42.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.627+0000 7f7b33e00640 1 -- 172.21.15.32:0/4176290786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b340d2db0 msgr2=0x7f7b340d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:42.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.627+0000 7f7b33e00640 1 --2- 172.21.15.32:0/4176290786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b340d2db0 0x7f7b340d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.627+0000 7f7b33e00640 1 -- 172.21.15.32:0/4176290786 >> v1:172.21.15.171:6789/0 conn(0x7f7b3415dbd0 legacy=0x7f7b340b92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.627+0000 7f7b33e00640 1 -- 172.21.15.32:0/4176290786 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b340d1ff0 con 0x7f7b340b6b00 2024-03-19T06:22:42.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.631+0000 7f7b33e00640 1 --2- 172.21.15.32:0/4176290786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b340b6b00 0x7f7b340b6f40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009870 tx=0x7f7b2001ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60bf28d3c927b31e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:42.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.631+0000 7f7b33400640 1 -- 172.21.15.32:0/4176290786 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b200b5070 con 0x7f7b340b6b00 2024-03-19T06:22:42.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.631+0000 7f7b33400640 1 -- 172.21.15.32:0/4176290786 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b200a8a50 con 0x7f7b340b6b00 2024-03-19T06:22:42.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.631+0000 7f7b33400640 1 -- 172.21.15.32:0/4176290786 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b200a8e20 con 0x7f7b340b6b00 2024-03-19T06:22:42.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.631+0000 7f7b3bc00640 1 -- 172.21.15.32:0/4176290786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b340b6b00 msgr2=0x7f7b340b6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.631+0000 7f7b3bc00640 1 --2- 172.21.15.32:0/4176290786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b340b6b00 0x7f7b340b6f40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009870 tx=0x7f7b2001ed50 comp rx=0 tx=0).stop 2024-03-19T06:22:42.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.631+0000 7f7b3bc00640 1 -- 172.21.15.32:0/4176290786 shutdown_connections 2024-03-19T06:22:42.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.631+0000 7f7b3bc00640 1 --2- 172.21.15.32:0/4176290786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b340d2db0 0x7f7b340d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.631+0000 7f7b3bc00640 1 --2- 172.21.15.32:0/4176290786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b340b6b00 0x7f7b340b6f40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.631+0000 7f7b3bc00640 1 -- 172.21.15.32:0/4176290786 >> 172.21.15.32:0/4176290786 conn(0x7f7b340d0620 msgr2=0x7f7b340d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:42.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.631+0000 7f7b3bc00640 1 -- 172.21.15.32:0/4176290786 shutdown_connections 2024-03-19T06:22:42.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.631+0000 7f7b3bc00640 1 -- 172.21.15.32:0/4176290786 wait complete. 2024-03-19T06:22:42.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.631+0000 7f7b3bc00640 1 Processor -- start 2024-03-19T06:22:42.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.631+0000 7f7b3bc00640 1 -- start start 2024-03-19T06:22:42.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b3bc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b340b6b00 0x7f7b34153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b3bc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b340d2db0 0x7f7b340b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b3bc00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b3415dbd0 0x7f7b340cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b3bc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340d2890 con 0x7f7b340d2db0 2024-03-19T06:22:42.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b3bc00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340d25b0 con 0x7f7b3415dbd0 2024-03-19T06:22:42.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b3bc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340b3100 con 0x7f7b340b6b00 2024-03-19T06:22:42.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b33e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b340d2db0 0x7f7b340b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b33e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b340d2db0 0x7f7b340b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56824/0 (socket says 172.21.15.32:56824) 2024-03-19T06:22:42.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b33e00640 1 -- 172.21.15.32:0/4012390007 learned_addr learned my addr 172.21.15.32:0/4012390007 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:42.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b39200640 1 --2- 172.21.15.32:0/4012390007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b340b6b00 0x7f7b34153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b39c00640 1 --2- 172.21.15.32:0/4012390007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b3415dbd0 0x7f7b340cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b33e00640 1 -- 172.21.15.32:0/4012390007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b340b6b00 msgr2=0x7f7b34153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b33e00640 1 --2- 172.21.15.32:0/4012390007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b340b6b00 0x7f7b34153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b33e00640 1 -- 172.21.15.32:0/4012390007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b3415dbd0 msgr2=0x7f7b340cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b33e00640 1 --2- 172.21.15.32:0/4012390007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b3415dbd0 0x7f7b340cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b33e00640 1 -- 172.21.15.32:0/4012390007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b340b49a0 con 0x7f7b340d2db0 2024-03-19T06:22:42.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b39200640 1 --2- 172.21.15.32:0/4012390007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b340b6b00 0x7f7b34153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:42.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b39c00640 1 --2- 172.21.15.32:0/4012390007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b3415dbd0 0x7f7b340cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:42.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b33e00640 1 --2- 172.21.15.32:0/4012390007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b340d2db0 0x7f7b340b4460 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7b200b3040 tx=0x7f7b2001baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:42.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b30c00640 1 -- 172.21.15.32:0/4012390007 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b200b5070 con 0x7f7b340d2db0 2024-03-19T06:22:42.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b30c00640 1 -- 172.21.15.32:0/4012390007 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b200b0de0 con 0x7f7b340d2db0 2024-03-19T06:22:42.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b30c00640 1 -- 172.21.15.32:0/4012390007 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b200bb670 con 0x7f7b340d2db0 2024-03-19T06:22:42.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b3bc00640 1 -- 172.21.15.32:0/4012390007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b341584d0 con 0x7f7b340d2db0 2024-03-19T06:22:42.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b3bc00640 1 -- 172.21.15.32:0/4012390007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b340caee0 con 0x7f7b340d2db0 2024-03-19T06:22:42.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.635+0000 7f7b3bc00640 1 -- 172.21.15.32:0/4012390007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b340749e0 con 0x7f7b340d2db0 2024-03-19T06:22:42.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.639+0000 7f7b30c00640 1 -- 172.21.15.32:0/4012390007 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7b200c2060 con 0x7f7b340d2db0 2024-03-19T06:22:42.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.639+0000 7f7b30c00640 1 --2- 172.21.15.32:0/4012390007 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7b14067660 0x7f7b14069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.639+0000 7f7b30c00640 1 -- 172.21.15.32:0/4012390007 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f7b20122ec0 con 0x7f7b340d2db0 2024-03-19T06:22:42.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.639+0000 7f7b39200640 1 --2- 172.21.15.32:0/4012390007 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7b14067660 0x7f7b14069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.639+0000 7f7b39200640 1 --2- 172.21.15.32:0/4012390007 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7b14067660 0x7f7b14069b20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7b28000f70 tx=0x7f7b28007d70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:42.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.643+0000 7f7b30c00640 1 -- 172.21.15.32:0/4012390007 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f7b341584d0 con 0x7f7b340d2db0 2024-03-19T06:22:42.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.803+0000 7f7b3bc00640 1 -- 172.21.15.32:0/4012390007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b340d33e0 con 0x7f7b340d2db0 2024-03-19T06:22:42.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.807+0000 7f7b30c00640 1 -- 172.21.15.32:0/4012390007 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18493 (secure 0 0 0) 0x7f7b200188b0 con 0x7f7b340d2db0 2024-03-19T06:22:42.794 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:42.794 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":38,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:22:27.853859+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:22:09.983589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-19T06:22:11.172289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-19T06:22:25.205334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:22:42.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.807+0000 7f7b3bc00640 1 -- 172.21.15.32:0/4012390007 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7b14067660 msgr2=0x7f7b14069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.807+0000 7f7b3bc00640 1 --2- 172.21.15.32:0/4012390007 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7b14067660 0x7f7b14069b20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7b28000f70 tx=0x7f7b28007d70 comp rx=0 tx=0).stop 2024-03-19T06:22:42.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.807+0000 7f7b3bc00640 1 -- 172.21.15.32:0/4012390007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b340d2db0 msgr2=0x7f7b340b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.807+0000 7f7b3bc00640 1 --2- 172.21.15.32:0/4012390007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b340d2db0 0x7f7b340b4460 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7b200b3040 tx=0x7f7b2001baf0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.807+0000 7f7b3bc00640 1 -- 172.21.15.32:0/4012390007 shutdown_connections 2024-03-19T06:22:42.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.807+0000 7f7b3bc00640 1 --2- 172.21.15.32:0/4012390007 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7b14067660 0x7f7b14069b20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.807+0000 7f7b3bc00640 1 --2- 172.21.15.32:0/4012390007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b3415dbd0 0x7f7b340cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.807+0000 7f7b3bc00640 1 --2- 172.21.15.32:0/4012390007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b340d2db0 0x7f7b340b4460 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.807+0000 7f7b3bc00640 1 --2- 172.21.15.32:0/4012390007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b340b6b00 0x7f7b34153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.807+0000 7f7b3bc00640 1 -- 172.21.15.32:0/4012390007 >> 172.21.15.32:0/4012390007 conn(0x7f7b340d0620 msgr2=0x7f7b3415eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:42.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.807+0000 7f7b3bc00640 1 -- 172.21.15.32:0/4012390007 shutdown_connections 2024-03-19T06:22:42.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.807+0000 7f7b3bc00640 1 -- 172.21.15.32:0/4012390007 wait complete. 2024-03-19T06:22:42.816 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:22:09.983589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:22:11.172289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2024-03-19T06:22:25.205334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:22:42.817 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:22:42.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.971+0000 7f8797200640 1 Processor -- start 2024-03-19T06:22:42.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.975+0000 7f8797200640 1 -- start start 2024-03-19T06:22:42.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.975+0000 7f8797200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f87980cfc70 0x7f87980cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.975+0000 7f8797200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f879815dcc0 0x7f879815e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.975+0000 7f8797200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879815e740 con 0x7f87980d0050 2024-03-19T06:22:42.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.975+0000 7f8797200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87980cfad0 con 0x7f879815dcc0 2024-03-19T06:22:42.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.975+0000 7f8797200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879815ea20 con 0x7f87980cfc70 2024-03-19T06:22:42.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.975+0000 7f8796800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f879815dcc0 0x7f879815e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.975+0000 7f8796800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f879815dcc0 0x7f879815e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56838/0 (socket says 172.21.15.32:56838) 2024-03-19T06:22:42.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.975+0000 7f8796800640 1 -- 172.21.15.32:0/965990034 learned_addr learned my addr 172.21.15.32:0/965990034 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:42.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.975+0000 7f8795e00640 1 --2- 172.21.15.32:0/965990034 >> v2:172.21.15.171:3300/0 conn(0x7f87980cfc70 0x7f87980cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.975+0000 7f8796800640 1 -- 172.21.15.32:0/965990034 >> v2:172.21.15.171:3300/0 conn(0x7f87980cfc70 msgr2=0x7f87980cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:42.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.975+0000 7f8796800640 1 --2- 172.21.15.32:0/965990034 >> v2:172.21.15.171:3300/0 conn(0x7f87980cfc70 0x7f87980cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.975+0000 7f8796800640 1 -- 172.21.15.32:0/965990034 >> v1:172.21.15.171:6789/0 conn(0x7f87980d0050 legacy=0x7f879806c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.975+0000 7f8796800640 1 -- 172.21.15.32:0/965990034 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879815ed00 con 0x7f879815dcc0 2024-03-19T06:22:42.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.979+0000 7f8796800640 1 --2- 172.21.15.32:0/965990034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f879815dcc0 0x7f879815e0c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f87980cf1c0 tx=0x7f879001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792491f93b46a321 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:42.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.979+0000 7f8795400640 1 -- 172.21.15.32:0/965990034 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87900a5880 con 0x7f879815dcc0 2024-03-19T06:22:42.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.979+0000 7f8795400640 1 -- 172.21.15.32:0/965990034 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87900a5a20 con 0x7f879815dcc0 2024-03-19T06:22:42.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.979+0000 7f8795400640 1 -- 172.21.15.32:0/965990034 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87900a5df0 con 0x7f879815dcc0 2024-03-19T06:22:42.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.979+0000 7f8797200640 1 -- 172.21.15.32:0/965990034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f879815dcc0 msgr2=0x7f879815e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.979+0000 7f8797200640 1 --2- 172.21.15.32:0/965990034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f879815dcc0 0x7f879815e0c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f87980cf1c0 tx=0x7f879001c9c0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.979+0000 7f8797200640 1 -- 172.21.15.32:0/965990034 shutdown_connections 2024-03-19T06:22:42.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.979+0000 7f8797200640 1 --2- 172.21.15.32:0/965990034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f879815dcc0 0x7f879815e0c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.979+0000 7f8797200640 1 --2- 172.21.15.32:0/965990034 >> v2:172.21.15.171:3300/0 conn(0x7f87980cfc70 0x7f87980cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.979+0000 7f8797200640 1 -- 172.21.15.32:0/965990034 >> 172.21.15.32:0/965990034 conn(0x7f879809a950 msgr2=0x7f879808b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:42.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.979+0000 7f8797200640 1 -- 172.21.15.32:0/965990034 shutdown_connections 2024-03-19T06:22:42.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.979+0000 7f8797200640 1 -- 172.21.15.32:0/965990034 wait complete. 2024-03-19T06:22:42.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.979+0000 7f8797200640 1 Processor -- start 2024-03-19T06:22:42.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.979+0000 7f8797200640 1 -- start start 2024-03-19T06:22:42.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f8797200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87980cfc70 0x7f8798158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f8797200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87980d0050 0x7f87981fa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f8797200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f879815dcc0 0x7f87980c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f8797200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87980d05e0 con 0x7f87980d0050 2024-03-19T06:22:42.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f8797200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87980d0460 con 0x7f87980cfc70 2024-03-19T06:22:42.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f8797200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87980cece0 con 0x7f879815dcc0 2024-03-19T06:22:42.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f878fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87980d0050 0x7f87981fa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f878fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87980d0050 0x7f87981fa3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56848/0 (socket says 172.21.15.32:56848) 2024-03-19T06:22:42.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f878fe00640 1 -- 172.21.15.32:0/2841391664 learned_addr learned my addr 172.21.15.32:0/2841391664 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:42.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f8795e00640 1 --2- 172.21.15.32:0/2841391664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87980cfc70 0x7f8798158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f8796800640 1 --2- 172.21.15.32:0/2841391664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f879815dcc0 0x7f87980c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f878fe00640 1 -- 172.21.15.32:0/2841391664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f879815dcc0 msgr2=0x7f87980c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f878fe00640 1 --2- 172.21.15.32:0/2841391664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f879815dcc0 0x7f87980c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f878fe00640 1 -- 172.21.15.32:0/2841391664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87980cfc70 msgr2=0x7f8798158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:42.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f878fe00640 1 --2- 172.21.15.32:0/2841391664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87980cfc70 0x7f8798158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:42.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f878fe00640 1 -- 172.21.15.32:0/2841391664 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87981fa8e0 con 0x7f87980d0050 2024-03-19T06:22:42.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f878fe00640 1 --2- 172.21.15.32:0/2841391664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87980d0050 0x7f87981fa3a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f878000c420 tx=0x7f878000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:42.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f878e000640 1 -- 172.21.15.32:0/2841391664 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87800052d0 con 0x7f87980d0050 2024-03-19T06:22:42.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f878e000640 1 -- 172.21.15.32:0/2841391664 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8780005470 con 0x7f87980d0050 2024-03-19T06:22:42.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f878e000640 1 -- 172.21.15.32:0/2841391664 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780007260 con 0x7f87980d0050 2024-03-19T06:22:42.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f8797200640 1 -- 172.21.15.32:0/2841391664 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87980c90d0 con 0x7f87980d0050 2024-03-19T06:22:42.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f8797200640 1 -- 172.21.15.32:0/2841391664 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87981f9ba0 con 0x7f87980d0050 2024-03-19T06:22:42.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f8797200640 1 -- 172.21.15.32:0/2841391664 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8798075090 con 0x7f87980d0050 2024-03-19T06:22:42.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.983+0000 7f878e000640 1 -- 172.21.15.32:0/2841391664 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8780007400 con 0x7f87980d0050 2024-03-19T06:22:42.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.987+0000 7f878e000640 1 --2- 172.21.15.32:0/2841391664 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8774067660 0x7f8774069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:42.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.987+0000 7f878e000640 1 -- 172.21.15.32:0/2841391664 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f8780084ef0 con 0x7f87980d0050 2024-03-19T06:22:42.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.987+0000 7f8795e00640 1 --2- 172.21.15.32:0/2841391664 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8774067660 0x7f8774069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:42.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.987+0000 7f8795e00640 1 --2- 172.21.15.32:0/2841391664 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8774067660 0x7f8774069b20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8788006aa0 tx=0x7f8788008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:42.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:42.991+0000 7f878e000640 1 -- 172.21.15.32:0/2841391664 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f87981fa8e0 con 0x7f87980d0050 2024-03-19T06:22:43.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.151+0000 7f8797200640 1 -- 172.21.15.32:0/2841391664 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f879808bc00 con 0x7f87980d0050 2024-03-19T06:22:43.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.151+0000 7f878e000640 1 -- 172.21.15.32:0/2841391664 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87800552f0 con 0x7f87980d0050 2024-03-19T06:22:43.141 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:22:43.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.155+0000 7f8797200640 1 -- 172.21.15.32:0/2841391664 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8774067660 msgr2=0x7f8774069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:43.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.155+0000 7f8797200640 1 --2- 172.21.15.32:0/2841391664 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8774067660 0x7f8774069b20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8788006aa0 tx=0x7f8788008040 comp rx=0 tx=0).stop 2024-03-19T06:22:43.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.155+0000 7f8797200640 1 -- 172.21.15.32:0/2841391664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87980d0050 msgr2=0x7f87981fa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:43.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.155+0000 7f8797200640 1 --2- 172.21.15.32:0/2841391664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87980d0050 0x7f87981fa3a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f878000c420 tx=0x7f878000c8e0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.155+0000 7f8797200640 1 -- 172.21.15.32:0/2841391664 shutdown_connections 2024-03-19T06:22:43.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.155+0000 7f8797200640 1 --2- 172.21.15.32:0/2841391664 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8774067660 0x7f8774069b20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.155+0000 7f8797200640 1 --2- 172.21.15.32:0/2841391664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f879815dcc0 0x7f87980c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.155+0000 7f8797200640 1 --2- 172.21.15.32:0/2841391664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87980d0050 0x7f87981fa3a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.155+0000 7f8797200640 1 --2- 172.21.15.32:0/2841391664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87980cfc70 0x7f8798158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.155+0000 7f8797200640 1 -- 172.21.15.32:0/2841391664 >> 172.21.15.32:0/2841391664 conn(0x7f879809a950 msgr2=0x7f879806c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:43.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.155+0000 7f8797200640 1 -- 172.21.15.32:0/2841391664 shutdown_connections 2024-03-19T06:22:43.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.155+0000 7f8797200640 1 -- 172.21.15.32:0/2841391664 wait complete. 2024-03-19T06:22:43.162 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:22:43.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.315+0000 7fd20da00640 1 Processor -- start 2024-03-19T06:22:43.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.315+0000 7fd20da00640 1 -- start start 2024-03-19T06:22:43.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.319+0000 7fd20da00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd208071810 0x7fd2080b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:43.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.319+0000 7fd20da00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2080b4ec0 0x7fd20806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:43.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.319+0000 7fd20da00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2080ccff0 con 0x7fd20815dd30 2024-03-19T06:22:43.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.319+0000 7fd20da00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2080b2350 con 0x7fd208071810 2024-03-19T06:22:43.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.319+0000 7fd20da00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2080cd2d0 con 0x7fd2080b4ec0 2024-03-19T06:22:43.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.319+0000 7fd207e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd20815dd30 0x7fd208071100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:34708/0 (socket says 172.21.15.32:34708) 2024-03-19T06:22:43.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.319+0000 7fd207e00640 1 -- 172.21.15.32:0/3244142618 learned_addr learned my addr 172.21.15.32:0/3244142618 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:43.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.319+0000 7fd1ff400640 1 --2- 172.21.15.32:0/3244142618 >> v2:172.21.15.32:3300/0 conn(0x7fd208071810 0x7fd2080b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:43.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.319+0000 7fd20d000640 1 --2- 172.21.15.32:0/3244142618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2080b4ec0 0x7fd20806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:43.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.319+0000 7fd1ff400640 1 -- 172.21.15.32:0/3244142618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2080b4ec0 msgr2=0x7fd20806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:43.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.319+0000 7fd1ff400640 1 --2- 172.21.15.32:0/3244142618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2080b4ec0 0x7fd20806e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.319+0000 7fd1ff400640 1 -- 172.21.15.32:0/3244142618 >> v1:172.21.15.32:6789/0 conn(0x7fd20815dd30 legacy=0x7fd208071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:43.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.319+0000 7fd1ff400640 1 -- 172.21.15.32:0/3244142618 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2080cd5b0 con 0x7fd208071810 2024-03-19T06:22:43.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd1ff400640 1 --2- 172.21.15.32:0/3244142618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd208071810 0x7fd2080b4980 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00097c0 tx=0x7fd1f001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a40c51abbcfda5 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:43.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd207400640 1 -- 172.21.15.32:0/3244142618 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f00b1070 con 0x7fd208071810 2024-03-19T06:22:43.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd207400640 1 -- 172.21.15.32:0/3244142618 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f00a8050 con 0x7fd208071810 2024-03-19T06:22:43.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd207400640 1 -- 172.21.15.32:0/3244142618 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f00ac860 con 0x7fd208071810 2024-03-19T06:22:43.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd20da00640 1 -- 172.21.15.32:0/3244142618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd208071810 msgr2=0x7fd2080b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:43.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd20da00640 1 --2- 172.21.15.32:0/3244142618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd208071810 0x7fd2080b4980 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00097c0 tx=0x7fd1f001c3e0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd20da00640 1 -- 172.21.15.32:0/3244142618 shutdown_connections 2024-03-19T06:22:43.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd20da00640 1 --2- 172.21.15.32:0/3244142618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2080b4ec0 0x7fd20806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd20da00640 1 --2- 172.21.15.32:0/3244142618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd208071810 0x7fd2080b4980 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd20da00640 1 -- 172.21.15.32:0/3244142618 >> 172.21.15.32:0/3244142618 conn(0x7fd2080b16b0 msgr2=0x7fd20806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:43.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd20da00640 1 -- 172.21.15.32:0/3244142618 shutdown_connections 2024-03-19T06:22:43.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd20da00640 1 -- 172.21.15.32:0/3244142618 wait complete. 2024-03-19T06:22:43.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd20da00640 1 Processor -- start 2024-03-19T06:22:43.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd20da00640 1 -- start start 2024-03-19T06:22:43.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd20da00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd208071810 0x7fd208151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:43.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd20da00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2080b4ec0 0x7fd20814da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:43.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd20da00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd20815dd30 0x7fd20814d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:43.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd20da00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20806f130 con 0x7fd2080b4ec0 2024-03-19T06:22:43.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd20da00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20806efb0 con 0x7fd20815dd30 2024-03-19T06:22:43.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd20da00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20806f2b0 con 0x7fd208071810 2024-03-19T06:22:43.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd1ff400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2080b4ec0 0x7fd20814da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:43.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd1ff400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2080b4ec0 0x7fd20814da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56870/0 (socket says 172.21.15.32:56870) 2024-03-19T06:22:43.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.323+0000 7fd1ff400640 1 -- 172.21.15.32:0/1737035221 learned_addr learned my addr 172.21.15.32:0/1737035221 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:43.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd207e00640 1 --2- 172.21.15.32:0/1737035221 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd208071810 0x7fd208151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:43.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd20d000640 1 --2- 172.21.15.32:0/1737035221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd20815dd30 0x7fd20814d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:43.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd1ff400640 1 -- 172.21.15.32:0/1737035221 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd208071810 msgr2=0x7fd208151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:43.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd1ff400640 1 --2- 172.21.15.32:0/1737035221 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd208071810 0x7fd208151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd1ff400640 1 -- 172.21.15.32:0/1737035221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd20815dd30 msgr2=0x7fd20814d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:43.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd1ff400640 1 --2- 172.21.15.32:0/1737035221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd20815dd30 0x7fd20814d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd1ff400640 1 -- 172.21.15.32:0/1737035221 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20814e2b0 con 0x7fd2080b4ec0 2024-03-19T06:22:43.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd1ff400640 1 --2- 172.21.15.32:0/1737035221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2080b4ec0 0x7fd20814da30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd1f001aa90 tx=0x7fd1f001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:43.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd204c00640 1 -- 172.21.15.32:0/1737035221 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f00b1040 con 0x7fd2080b4ec0 2024-03-19T06:22:43.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd204c00640 1 -- 172.21.15.32:0/1737035221 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f00bc070 con 0x7fd2080b4ec0 2024-03-19T06:22:43.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd20da00640 1 -- 172.21.15.32:0/1737035221 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2081559c0 con 0x7fd2080b4ec0 2024-03-19T06:22:43.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd204c00640 1 -- 172.21.15.32:0/1737035221 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f00b7690 con 0x7fd2080b4ec0 2024-03-19T06:22:43.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd20da00640 1 -- 172.21.15.32:0/1737035221 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd208158050 con 0x7fd2080b4ec0 2024-03-19T06:22:43.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd20da00640 1 -- 172.21.15.32:0/1737035221 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd208157e80 con 0x7fd2080b4ec0 2024-03-19T06:22:43.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd204c00640 1 -- 172.21.15.32:0/1737035221 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd1f00b7830 con 0x7fd2080b4ec0 2024-03-19T06:22:43.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd204c00640 1 --2- 172.21.15.32:0/1737035221 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd1e4067660 0x7fd1e4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:43.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.327+0000 7fd204c00640 1 -- 172.21.15.32:0/1737035221 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fd1f011fe30 con 0x7fd2080b4ec0 2024-03-19T06:22:43.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.331+0000 7fd207e00640 1 --2- 172.21.15.32:0/1737035221 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd1e4067660 0x7fd1e4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:43.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.331+0000 7fd207e00640 1 --2- 172.21.15.32:0/1737035221 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd1e4067660 0x7fd1e4069b20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd2081517b0 tx=0x7fd1f8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:43.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.335+0000 7fd204c00640 1 -- 172.21.15.32:0/1737035221 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fd1f00c6020 con 0x7fd2080b4ec0 2024-03-19T06:22:43.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.495+0000 7fd20da00640 1 -- 172.21.15.32:0/1737035221 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd208075090 con 0x7fd2080b4ec0 2024-03-19T06:22:43.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.495+0000 7fd204c00640 1 -- 172.21.15.32:0/1737035221 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd20814e2b0 con 0x7fd2080b4ec0 2024-03-19T06:22:43.486 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:22:43.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.499+0000 7fd20da00640 1 -- 172.21.15.32:0/1737035221 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd1e4067660 msgr2=0x7fd1e4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:43.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.499+0000 7fd20da00640 1 --2- 172.21.15.32:0/1737035221 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd1e4067660 0x7fd1e4069b20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd2081517b0 tx=0x7fd1f8009040 comp rx=0 tx=0).stop 2024-03-19T06:22:43.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.499+0000 7fd20da00640 1 -- 172.21.15.32:0/1737035221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2080b4ec0 msgr2=0x7fd20814da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:43.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.499+0000 7fd20da00640 1 --2- 172.21.15.32:0/1737035221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2080b4ec0 0x7fd20814da30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd1f001aa90 tx=0x7fd1f001ac20 comp rx=0 tx=0).stop 2024-03-19T06:22:43.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.499+0000 7fd20da00640 1 -- 172.21.15.32:0/1737035221 shutdown_connections 2024-03-19T06:22:43.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.499+0000 7fd20da00640 1 --2- 172.21.15.32:0/1737035221 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd1e4067660 0x7fd1e4069b20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.499+0000 7fd20da00640 1 --2- 172.21.15.32:0/1737035221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd20815dd30 0x7fd20814d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.499+0000 7fd20da00640 1 --2- 172.21.15.32:0/1737035221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2080b4ec0 0x7fd20814da30 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.499+0000 7fd20da00640 1 --2- 172.21.15.32:0/1737035221 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd208071810 0x7fd208151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.499+0000 7fd20da00640 1 -- 172.21.15.32:0/1737035221 >> 172.21.15.32:0/1737035221 conn(0x7fd2080b16b0 msgr2=0x7fd2080c99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:43.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.499+0000 7fd20da00640 1 -- 172.21.15.32:0/1737035221 shutdown_connections 2024-03-19T06:22:43.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.499+0000 7fd20da00640 1 -- 172.21.15.32:0/1737035221 wait complete. 2024-03-19T06:22:43.506 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:22:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.659+0000 7f6051400640 1 Processor -- start 2024-03-19T06:22:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.659+0000 7f6051400640 1 -- start start 2024-03-19T06:22:43.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.663+0000 7f6051400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f604c15a840 0x7f604c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:43.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.663+0000 7f6051400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f604c0aea70 0x7f604c06ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:43.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.663+0000 7f6051400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f604c0af2d0 con 0x7f604c06b280 2024-03-19T06:22:43.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.663+0000 7f6051400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f604c0cdc20 con 0x7f604c0aea70 2024-03-19T06:22:43.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.663+0000 7f6051400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604c15eea0 con 0x7f604c15a840 2024-03-19T06:22:43.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.663+0000 7f604b200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f604c06b280 0x7f604c06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39178/0 (socket says 172.21.15.32:39178) 2024-03-19T06:22:43.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.663+0000 7f604b200640 1 -- 172.21.15.32:0/532582477 learned_addr learned my addr 172.21.15.32:0/532582477 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:43.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.663+0000 7f604a800640 1 --2- 172.21.15.32:0/532582477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f604c15a840 0x7f604c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:43.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.663+0000 7f6043e00640 1 --2- 172.21.15.32:0/532582477 >> v2:172.21.15.171:3300/0 conn(0x7f604c0aea70 0x7f604c06ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:43.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.663+0000 7f6049e00640 1 -- 172.21.15.32:0/532582477 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719796772 0 0) 0x7f604c0af2d0 con 0x7f604c06b280 2024-03-19T06:22:43.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.663+0000 7f6049e00640 1 -- 172.21.15.32:0/532582477 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6030003530 con 0x7f604c06b280 2024-03-19T06:22:43.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.663+0000 7f6043e00640 1 -- 172.21.15.32:0/532582477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f604c15a840 msgr2=0x7f604c06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:43.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.663+0000 7f6043e00640 1 --2- 172.21.15.32:0/532582477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f604c15a840 0x7f604c06f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.663+0000 7f6043e00640 1 -- 172.21.15.32:0/532582477 >> v1:172.21.15.32:6789/0 conn(0x7f604c06b280 legacy=0x7f604c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:43.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.663+0000 7f6043e00640 1 -- 172.21.15.32:0/532582477 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c15f180 con 0x7f604c0aea70 2024-03-19T06:22:43.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.667+0000 7f6043e00640 1 --2- 172.21.15.32:0/532582477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f604c0aea70 0x7f604c06ad40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f60340097c0 tx=0x7f603401c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aec91e3c709e7377 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:43.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.667+0000 7f6049e00640 1 -- 172.21.15.32:0/532582477 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60340b0070 con 0x7f604c0aea70 2024-03-19T06:22:43.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.667+0000 7f6049e00640 1 -- 172.21.15.32:0/532582477 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60340ab600 con 0x7f604c0aea70 2024-03-19T06:22:43.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.667+0000 7f6049e00640 1 -- 172.21.15.32:0/532582477 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60340ab9b0 con 0x7f604c0aea70 2024-03-19T06:22:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.667+0000 7f6051400640 1 -- 172.21.15.32:0/532582477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f604c0aea70 msgr2=0x7f604c06ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.667+0000 7f6051400640 1 --2- 172.21.15.32:0/532582477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f604c0aea70 0x7f604c06ad40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f60340097c0 tx=0x7f603401c380 comp rx=0 tx=0).stop 2024-03-19T06:22:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.667+0000 7f6051400640 1 -- 172.21.15.32:0/532582477 shutdown_connections 2024-03-19T06:22:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.667+0000 7f6051400640 1 --2- 172.21.15.32:0/532582477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f604c0aea70 0x7f604c06ad40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.667+0000 7f6051400640 1 --2- 172.21.15.32:0/532582477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f604c15a840 0x7f604c06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.667+0000 7f6051400640 1 -- 172.21.15.32:0/532582477 >> 172.21.15.32:0/532582477 conn(0x7f604c0b1590 msgr2=0x7f604c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:43.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.667+0000 7f6051400640 1 -- 172.21.15.32:0/532582477 shutdown_connections 2024-03-19T06:22:43.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.667+0000 7f6051400640 1 -- 172.21.15.32:0/532582477 wait complete. 2024-03-19T06:22:43.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.667+0000 7f6051400640 1 Processor -- start 2024-03-19T06:22:43.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.667+0000 7f6051400640 1 -- start start 2024-03-19T06:22:43.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f6051400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f604c06b280 0x7f604c156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:43.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f6051400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f604c0aea70 0x7f604c14fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:43.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f6051400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f604c15a840 0x7f604c153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:43.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f6051400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c167910 con 0x7f604c06b280 2024-03-19T06:22:43.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f6051400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c167790 con 0x7f604c0aea70 2024-03-19T06:22:43.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f6051400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604c167a90 con 0x7f604c15a840 2024-03-19T06:22:43.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f604a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f604c06b280 0x7f604c156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:43.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f604a800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f604c06b280 0x7f604c156860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41534/0 (socket says 172.21.15.32:41534) 2024-03-19T06:22:43.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f604a800640 1 -- 172.21.15.32:0/3474205980 learned_addr learned my addr 172.21.15.32:0/3474205980 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:43.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f604b200640 1 --2- 172.21.15.32:0/3474205980 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f604c15a840 0x7f604c153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:43.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f6043e00640 1 --2- 172.21.15.32:0/3474205980 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f604c0aea70 0x7f604c14fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:43.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f604a800640 1 -- 172.21.15.32:0/3474205980 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f604c15a840 msgr2=0x7f604c153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:43.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f604a800640 1 --2- 172.21.15.32:0/3474205980 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f604c15a840 0x7f604c153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f604a800640 1 -- 172.21.15.32:0/3474205980 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f604c0aea70 msgr2=0x7f604c14fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:43.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f604a800640 1 --2- 172.21.15.32:0/3474205980 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f604c0aea70 0x7f604c14fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f604a800640 1 -- 172.21.15.32:0/3474205980 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c15c020 con 0x7f604c06b280 2024-03-19T06:22:43.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f604a800640 1 --2- 172.21.15.32:0/3474205980 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f604c06b280 0x7f604c156860 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f603c00e930 tx=0x7f603c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:43.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f6042a00640 1 -- 172.21.15.32:0/3474205980 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c017070 con 0x7f604c06b280 2024-03-19T06:22:43.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f6042a00640 1 -- 172.21.15.32:0/3474205980 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603c00ca00 con 0x7f604c06b280 2024-03-19T06:22:43.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f6042a00640 1 -- 172.21.15.32:0/3474205980 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c00cdb0 con 0x7f604c06b280 2024-03-19T06:22:43.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f6051400640 1 -- 172.21.15.32:0/3474205980 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604c15c300 con 0x7f604c06b280 2024-03-19T06:22:43.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f6051400640 1 -- 172.21.15.32:0/3474205980 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604c152d00 con 0x7f604c06b280 2024-03-19T06:22:43.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f6051400640 1 -- 172.21.15.32:0/3474205980 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604c0749e0 con 0x7f604c06b280 2024-03-19T06:22:43.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.671+0000 7f6042a00640 1 -- 172.21.15.32:0/3474205980 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f603c01a070 con 0x7f604c06b280 2024-03-19T06:22:43.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.675+0000 7f6042a00640 1 --2- 172.21.15.32:0/3474205980 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6028067690 0x7f6028069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:43.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.675+0000 7f6042a00640 1 -- 172.21.15.32:0/3474205980 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f603c085e10 con 0x7f604c06b280 2024-03-19T06:22:43.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.675+0000 7f6043e00640 1 --2- 172.21.15.32:0/3474205980 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6028067690 0x7f6028069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:43.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.675+0000 7f6043e00640 1 --2- 172.21.15.32:0/3474205980 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6028067690 0x7f6028069b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f60340ad000 tx=0x7f60340a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:43.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.679+0000 7f6042a00640 1 -- 172.21.15.32:0/3474205980 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f603c089030 con 0x7f604c06b280 2024-03-19T06:22:43.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.843+0000 7f6051400640 1 -- 172.21.15.32:0/3474205980 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f604c06e6c0 con 0x7f604c06b280 2024-03-19T06:22:43.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.843+0000 7f6042a00640 1 -- 172.21.15.32:0/3474205980 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f603c0569b0 con 0x7f604c06b280 2024-03-19T06:22:43.831 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:22:43.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.843+0000 7f6051400640 1 -- 172.21.15.32:0/3474205980 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6028067690 msgr2=0x7f6028069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:43.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.843+0000 7f6051400640 1 --2- 172.21.15.32:0/3474205980 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6028067690 0x7f6028069b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f60340ad000 tx=0x7f60340a6000 comp rx=0 tx=0).stop 2024-03-19T06:22:43.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.843+0000 7f6051400640 1 -- 172.21.15.32:0/3474205980 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f604c06b280 msgr2=0x7f604c156860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:43.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.843+0000 7f6051400640 1 --2- 172.21.15.32:0/3474205980 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f604c06b280 0x7f604c156860 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f603c00e930 tx=0x7f603c00edf0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.843+0000 7f6051400640 1 -- 172.21.15.32:0/3474205980 shutdown_connections 2024-03-19T06:22:43.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.843+0000 7f6051400640 1 --2- 172.21.15.32:0/3474205980 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6028067690 0x7f6028069b50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.843+0000 7f6051400640 1 --2- 172.21.15.32:0/3474205980 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f604c15a840 0x7f604c153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.843+0000 7f6051400640 1 --2- 172.21.15.32:0/3474205980 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f604c0aea70 0x7f604c14fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.843+0000 7f6051400640 1 --2- 172.21.15.32:0/3474205980 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f604c06b280 0x7f604c156860 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:43.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.843+0000 7f6051400640 1 -- 172.21.15.32:0/3474205980 >> 172.21.15.32:0/3474205980 conn(0x7f604c0b1590 msgr2=0x7f604c156e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:43.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.843+0000 7f6051400640 1 -- 172.21.15.32:0/3474205980 shutdown_connections 2024-03-19T06:22:43.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:43.843+0000 7f6051400640 1 -- 172.21.15.32:0/3474205980 wait complete. 2024-03-19T06:22:43.853 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-03-19T06:22:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.007+0000 7f2cae600640 1 Processor -- start 2024-03-19T06:22:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.007+0000 7f2cae600640 1 -- start start 2024-03-19T06:22:44.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2cae600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ca809a180 0x7f2ca815fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2cae600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca80cf460 con 0x7f2ca815b9b0 2024-03-19T06:22:44.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2cae600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca80cc420 con 0x7f2ca809a760 2024-03-19T06:22:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2cae600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca80ccd50 con 0x7f2ca809a180 2024-03-19T06:22:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2cad200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2ca815b9b0 0x7f2ca8099a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39182/0 (socket says 172.21.15.32:39182) 2024-03-19T06:22:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2cad200640 1 -- 172.21.15.32:0/157325486 learned_addr learned my addr 172.21.15.32:0/157325486 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2c9fe00640 1 --2- 172.21.15.32:0/157325486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ca809a180 0x7f2ca815fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 -- 172.21.15.32:0/157325486 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250079051 0 0) 0x7f2ca80cf460 con 0x7f2ca815b9b0 2024-03-19T06:22:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 -- 172.21.15.32:0/157325486 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c8c003530 con 0x7f2ca815b9b0 2024-03-19T06:22:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 -- 172.21.15.32:0/157325486 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780853020 0 0) 0x7f2ca80cc420 con 0x7f2ca809a760 2024-03-19T06:22:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 -- 172.21.15.32:0/157325486 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca80cf460 con 0x7f2ca809a760 2024-03-19T06:22:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 -- 172.21.15.32:0/157325486 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3883212527 0 0) 0x7f2c8c003530 con 0x7f2ca815b9b0 2024-03-19T06:22:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 -- 172.21.15.32:0/157325486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ca809a180 msgr2=0x7f2ca815fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 --2- 172.21.15.32:0/157325486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ca809a180 0x7f2ca815fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 -- 172.21.15.32:0/157325486 >> v1:172.21.15.171:6789/0 conn(0x7f2ca809a760 legacy=0x7f2ca80b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 -- 172.21.15.32:0/157325486 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca80cc700 con 0x7f2ca815b9b0 2024-03-19T06:22:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 -- 172.21.15.32:0/157325486 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f2c98001680 con 0x7f2ca815b9b0 2024-03-19T06:22:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 -- 172.21.15.32:0/157325486 >> v1:172.21.15.32:6789/0 conn(0x7f2ca815b9b0 legacy=0x7f2ca8099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 --2- 172.21.15.32:0/157325486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c8c003b80 0x7f2c8c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 --2- 172.21.15.32:0/157325486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c8c004810 0x7f2c8c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 --2- 172.21.15.32:0/157325486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ca809a180 0x7f2c8c0052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 -- 172.21.15.32:0/157325486 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca80ccd50 con 0x7f2c8c003b80 2024-03-19T06:22:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 -- 172.21.15.32:0/157325486 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c00bbd0 con 0x7f2c8c004810 2024-03-19T06:22:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2ca7e00640 1 -- 172.21.15.32:0/157325486 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c00bdd0 con 0x7f2ca809a180 2024-03-19T06:22:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2cad200640 1 --2- 172.21.15.32:0/157325486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c8c003b80 0x7f2c8c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2c9fe00640 1 --2- 172.21.15.32:0/157325486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c8c004810 0x7f2c8c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2cadc00640 1 --2- 172.21.15.32:0/157325486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ca809a180 0x7f2c8c0052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2cad200640 1 -- 172.21.15.32:0/157325486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ca809a180 msgr2=0x7f2c8c0052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2cad200640 1 --2- 172.21.15.32:0/157325486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ca809a180 0x7f2c8c0052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2cad200640 1 -- 172.21.15.32:0/157325486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c8c004810 msgr2=0x7f2c8c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:44.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2cad200640 1 --2- 172.21.15.32:0/157325486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c8c004810 0x7f2c8c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2cad200640 1 -- 172.21.15.32:0/157325486 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c003530 con 0x7f2c8c003b80 2024-03-19T06:22:44.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.011+0000 7f2c9fe00640 1 --2- 172.21.15.32:0/157325486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c8c004810 0x7f2c8c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:22:44.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.015+0000 7f2cad200640 1 --2- 172.21.15.32:0/157325486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c8c003b80 0x7f2c8c003f80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2c98007fc0 tx=0x7f2c9801cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebf3d08ff861073 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:44.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.015+0000 7f2ca7e00640 1 -- 172.21.15.32:0/157325486 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98007c10 con 0x7f2c8c003b80 2024-03-19T06:22:44.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.015+0000 7f2ca7e00640 1 -- 172.21.15.32:0/157325486 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c980a9070 con 0x7f2c8c003b80 2024-03-19T06:22:44.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.015+0000 7f2ca7e00640 1 -- 172.21.15.32:0/157325486 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98005d40 con 0x7f2c8c003b80 2024-03-19T06:22:44.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.015+0000 7f2cae600640 1 -- 172.21.15.32:0/157325486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c8c003b80 msgr2=0x7f2c8c003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:44.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.015+0000 7f2cae600640 1 --2- 172.21.15.32:0/157325486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c8c003b80 0x7f2c8c003f80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2c98007fc0 tx=0x7f2c9801cb50 comp rx=0 tx=0).stop 2024-03-19T06:22:44.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.015+0000 7f2cadc00640 1 -- 172.21.15.32:0/157325486 reap_dead start 2024-03-19T06:22:44.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.015+0000 7f2cae600640 1 -- 172.21.15.32:0/157325486 shutdown_connections 2024-03-19T06:22:44.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.015+0000 7f2cae600640 1 -- 172.21.15.32:0/157325486 >> 172.21.15.32:0/157325486 conn(0x7f2ca80b3110 msgr2=0x7f2ca80b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:44.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.015+0000 7f2cae600640 1 -- 172.21.15.32:0/157325486 shutdown_connections 2024-03-19T06:22:44.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.015+0000 7f2cae600640 1 -- 172.21.15.32:0/157325486 wait complete. 2024-03-19T06:22:44.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.015+0000 7f2cae600640 1 Processor -- start 2024-03-19T06:22:44.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2cae600640 1 -- start start 2024-03-19T06:22:44.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2cae600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c8c003b80 0x7f2ca806d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2cae600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ca815cde0 0x7f2ca80b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2cae600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ca815add0 0x7f2ca80b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2cae600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca8167aa0 con 0x7f2ca815cde0 2024-03-19T06:22:44.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2cae600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca8167920 con 0x7f2c8c003b80 2024-03-19T06:22:44.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2cae600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca8167c20 con 0x7f2ca815add0 2024-03-19T06:22:44.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2c9fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ca815cde0 0x7f2ca80b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2c9fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ca815cde0 0x7f2ca80b6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41550/0 (socket says 172.21.15.32:41550) 2024-03-19T06:22:44.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2c9fe00640 1 -- 172.21.15.32:0/1681296877 learned_addr learned my addr 172.21.15.32:0/1681296877 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:44.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2cad200640 1 --2- 172.21.15.32:0/1681296877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c8c003b80 0x7f2ca806d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2cadc00640 1 --2- 172.21.15.32:0/1681296877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ca815add0 0x7f2ca80b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2c9fe00640 1 -- 172.21.15.32:0/1681296877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ca815add0 msgr2=0x7f2ca80b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:44.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2c9fe00640 1 --2- 172.21.15.32:0/1681296877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ca815add0 0x7f2ca80b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2c9fe00640 1 -- 172.21.15.32:0/1681296877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c8c003b80 msgr2=0x7f2ca806d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:44.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2c9fe00640 1 --2- 172.21.15.32:0/1681296877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c8c003b80 0x7f2ca806d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2c9fe00640 1 -- 172.21.15.32:0/1681296877 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca815d270 con 0x7f2ca815cde0 2024-03-19T06:22:44.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2cadc00640 1 --2- 172.21.15.32:0/1681296877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ca815add0 0x7f2ca80b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:44.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2c9fe00640 1 --2- 172.21.15.32:0/1681296877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ca815cde0 0x7f2ca80b6710 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2c90011af0 tx=0x7f2c9000f240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:44.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2ca5600640 1 -- 172.21.15.32:0/1681296877 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000fc20 con 0x7f2ca815cde0 2024-03-19T06:22:44.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2ca5600640 1 -- 172.21.15.32:0/1681296877 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9000fdc0 con 0x7f2ca815cde0 2024-03-19T06:22:44.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2cae600640 1 -- 172.21.15.32:0/1681296877 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca815d550 con 0x7f2ca815cde0 2024-03-19T06:22:44.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2ca5600640 1 -- 172.21.15.32:0/1681296877 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90004240 con 0x7f2ca815cde0 2024-03-19T06:22:44.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2cae600640 1 -- 172.21.15.32:0/1681296877 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca815db10 con 0x7f2ca815cde0 2024-03-19T06:22:44.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.019+0000 7f2cae600640 1 -- 172.21.15.32:0/1681296877 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca8075090 con 0x7f2ca815cde0 2024-03-19T06:22:44.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.023+0000 7f2ca5600640 1 -- 172.21.15.32:0/1681296877 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2c90012040 con 0x7f2ca815cde0 2024-03-19T06:22:44.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.023+0000 7f2ca5600640 1 --2- 172.21.15.32:0/1681296877 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2c84067690 0x7f2c84069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.023+0000 7f2ca5600640 1 -- 172.21.15.32:0/1681296877 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f2c90085f60 con 0x7f2ca815cde0 2024-03-19T06:22:44.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.023+0000 7f2cad200640 1 --2- 172.21.15.32:0/1681296877 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2c84067690 0x7f2c84069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.023+0000 7f2cad200640 1 --2- 172.21.15.32:0/1681296877 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2c84067690 0x7f2c84069b50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2c980ab000 tx=0x7f2c980b1040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:44.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.027+0000 7f2ca5600640 1 -- 172.21.15.32:0/1681296877 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2c90019030 con 0x7f2ca815cde0 2024-03-19T06:22:44.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.195+0000 7f2cae600640 1 -- 172.21.15.32:0/1681296877 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f2ca815ecf0 con 0x7f2ca815cde0 2024-03-19T06:22:44.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.195+0000 7f2ca5600640 1 -- 172.21.15.32:0/1681296877 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v38) v1 ==== 97+0+11 (secure 0 0 0) 0x7f2c900562d0 con 0x7f2ca815cde0 2024-03-19T06:22:44.184 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:22:44.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.199+0000 7f2cae600640 1 -- 172.21.15.32:0/1681296877 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2c84067690 msgr2=0x7f2c84069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:44.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.199+0000 7f2cae600640 1 --2- 172.21.15.32:0/1681296877 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2c84067690 0x7f2c84069b50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2c980ab000 tx=0x7f2c980b1040 comp rx=0 tx=0).stop 2024-03-19T06:22:44.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.199+0000 7f2cae600640 1 -- 172.21.15.32:0/1681296877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ca815cde0 msgr2=0x7f2ca80b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:44.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.199+0000 7f2cae600640 1 --2- 172.21.15.32:0/1681296877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ca815cde0 0x7f2ca80b6710 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2c90011af0 tx=0x7f2c9000f240 comp rx=0 tx=0).stop 2024-03-19T06:22:44.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.199+0000 7f2cae600640 1 -- 172.21.15.32:0/1681296877 shutdown_connections 2024-03-19T06:22:44.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.199+0000 7f2cae600640 1 --2- 172.21.15.32:0/1681296877 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2c84067690 0x7f2c84069b50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.199+0000 7f2cae600640 1 --2- 172.21.15.32:0/1681296877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ca815add0 0x7f2ca80b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.199+0000 7f2cae600640 1 --2- 172.21.15.32:0/1681296877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ca815cde0 0x7f2ca80b6710 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.199+0000 7f2cae600640 1 --2- 172.21.15.32:0/1681296877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c8c003b80 0x7f2ca806d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.199+0000 7f2cae600640 1 -- 172.21.15.32:0/1681296877 >> 172.21.15.32:0/1681296877 conn(0x7f2ca80b3110 msgr2=0x7f2ca80b5510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:44.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.199+0000 7f2cae600640 1 -- 172.21.15.32:0/1681296877 shutdown_connections 2024-03-19T06:22:44.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.199+0000 7f2cae600640 1 -- 172.21.15.32:0/1681296877 wait complete. 2024-03-19T06:22:44.206 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:22:44.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.359+0000 7f3548600640 1 Processor -- start 2024-03-19T06:22:44.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.359+0000 7f3548600640 1 -- start start 2024-03-19T06:22:44.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.359+0000 7f3548600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f354006b450 0x7f35400cc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.359+0000 7f3548600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35400cd270 0x7f35400b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.359+0000 7f3548600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354015be40 con 0x7f354015ba60 2024-03-19T06:22:44.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.359+0000 7f3548600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35400c4030 con 0x7f354006b450 2024-03-19T06:22:44.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.359+0000 7f3548600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35400cd6c0 con 0x7f35400cd270 2024-03-19T06:22:44.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.359+0000 7f3545c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f354015ba60 0x7f354006ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39198/0 (socket says 172.21.15.32:39198) 2024-03-19T06:22:44.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.359+0000 7f3545c00640 1 -- 172.21.15.32:0/705783535 learned_addr learned my addr 172.21.15.32:0/705783535 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:44.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.359+0000 7f3545200640 1 --2- 172.21.15.32:0/705783535 >> v2:172.21.15.171:3300/0 conn(0x7f354006b450 0x7f35400cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.359+0000 7f3546600640 1 --2- 172.21.15.32:0/705783535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35400cd270 0x7f35400b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f353fe00640 1 -- 172.21.15.32:0/705783535 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999183558 0 0) 0x7f3534001120 con 0x7f354015ba60 2024-03-19T06:22:44.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f353fe00640 1 -- 172.21.15.32:0/705783535 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3528003530 con 0x7f354015ba60 2024-03-19T06:22:44.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f353fe00640 1 -- 172.21.15.32:0/705783535 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4129868371 0 0) 0x7f3528003530 con 0x7f354015ba60 2024-03-19T06:22:44.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f353fe00640 1 -- 172.21.15.32:0/705783535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35400cd270 msgr2=0x7f35400b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:44.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f353fe00640 1 --2- 172.21.15.32:0/705783535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35400cd270 0x7f35400b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f353fe00640 1 -- 172.21.15.32:0/705783535 >> v2:172.21.15.171:3300/0 conn(0x7f354006b450 msgr2=0x7f35400cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:44.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f353fe00640 1 --2- 172.21.15.32:0/705783535 >> v2:172.21.15.171:3300/0 conn(0x7f354006b450 0x7f35400cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f353fe00640 1 -- 172.21.15.32:0/705783535 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35400cd970 con 0x7f354015ba60 2024-03-19T06:22:44.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f353fe00640 1 -- 172.21.15.32:0/705783535 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f3534001850 con 0x7f354015ba60 2024-03-19T06:22:44.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f353fe00640 1 -- 172.21.15.32:0/705783535 >> v1:172.21.15.32:6789/0 conn(0x7f354015ba60 legacy=0x7f354006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:44.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f353fe00640 1 --2- 172.21.15.32:0/705783535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35280039c0 0x7f3528003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f353fe00640 1 --2- 172.21.15.32:0/705783535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3528004810 0x7f3528004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f353fe00640 1 --2- 172.21.15.32:0/705783535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35400cd270 0x7f35280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f353fe00640 1 -- 172.21.15.32:0/705783535 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35400c4030 con 0x7f35280039c0 2024-03-19T06:22:44.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f353fe00640 1 -- 172.21.15.32:0/705783535 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35400cd6c0 con 0x7f3528004810 2024-03-19T06:22:44.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f353fe00640 1 -- 172.21.15.32:0/705783535 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352800b9d0 con 0x7f35400cd270 2024-03-19T06:22:44.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f3545c00640 1 --2- 172.21.15.32:0/705783535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35280039c0 0x7f3528003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f3545200640 1 --2- 172.21.15.32:0/705783535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3528004810 0x7f3528004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f3546600640 1 --2- 172.21.15.32:0/705783535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35400cd270 0x7f35280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f3545c00640 1 -- 172.21.15.32:0/705783535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35400cd270 msgr2=0x7f35280051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:44.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f3545c00640 1 --2- 172.21.15.32:0/705783535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35400cd270 0x7f35280051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f3545c00640 1 -- 172.21.15.32:0/705783535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3528004810 msgr2=0x7f3528004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:44.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f3545c00640 1 --2- 172.21.15.32:0/705783535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3528004810 0x7f3528004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.363+0000 7f3545c00640 1 -- 172.21.15.32:0/705783535 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3528003530 con 0x7f35280039c0 2024-03-19T06:22:44.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f3545c00640 1 --2- 172.21.15.32:0/705783535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35280039c0 0x7f3528003de0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f353400c4c0 tx=0x7f353401cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81669edceaf7119 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:44.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f353fe00640 1 -- 172.21.15.32:0/705783535 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353400c0e0 con 0x7f35280039c0 2024-03-19T06:22:44.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f353fe00640 1 -- 172.21.15.32:0/705783535 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35340a9020 con 0x7f35280039c0 2024-03-19T06:22:44.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f353fe00640 1 -- 172.21.15.32:0/705783535 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3534005ae0 con 0x7f35280039c0 2024-03-19T06:22:44.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f3548600640 1 -- 172.21.15.32:0/705783535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35280039c0 msgr2=0x7f3528003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:44.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f3548600640 1 --2- 172.21.15.32:0/705783535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35280039c0 0x7f3528003de0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f353400c4c0 tx=0x7f353401cc90 comp rx=0 tx=0).stop 2024-03-19T06:22:44.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f3546600640 1 -- 172.21.15.32:0/705783535 reap_dead start 2024-03-19T06:22:44.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f3548600640 1 -- 172.21.15.32:0/705783535 shutdown_connections 2024-03-19T06:22:44.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f3548600640 1 -- 172.21.15.32:0/705783535 >> 172.21.15.32:0/705783535 conn(0x7f35400b2250 msgr2=0x7f35400b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:44.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f3548600640 1 -- 172.21.15.32:0/705783535 shutdown_connections 2024-03-19T06:22:44.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f3548600640 1 -- 172.21.15.32:0/705783535 wait complete. 2024-03-19T06:22:44.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f3548600640 1 Processor -- start 2024-03-19T06:22:44.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f3548600640 1 -- start start 2024-03-19T06:22:44.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f3548600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35280039c0 0x7f3540148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f3548600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35400c7790 0x7f35400c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f3548600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35400c8620 0x7f35400c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f3548600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35400b4600 con 0x7f35280039c0 2024-03-19T06:22:44.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f3548600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35400cdf30 con 0x7f35400c8620 2024-03-19T06:22:44.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.367+0000 7f3548600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35400b4780 con 0x7f35400c7790 2024-03-19T06:22:44.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f3545c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35280039c0 0x7f3540148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f3545c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35280039c0 0x7f3540148b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41554/0 (socket says 172.21.15.32:41554) 2024-03-19T06:22:44.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f3545c00640 1 -- 172.21.15.32:0/1782395494 learned_addr learned my addr 172.21.15.32:0/1782395494 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:44.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f3546600640 1 --2- 172.21.15.32:0/1782395494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35400c8620 0x7f35400c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f3545200640 1 --2- 172.21.15.32:0/1782395494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35400c7790 0x7f35400c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f3545c00640 1 -- 172.21.15.32:0/1782395494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35400c7790 msgr2=0x7f35400c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:44.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f3545c00640 1 --2- 172.21.15.32:0/1782395494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35400c7790 0x7f35400c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f3545c00640 1 -- 172.21.15.32:0/1782395494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35400c8620 msgr2=0x7f35400c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:44.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f3545c00640 1 --2- 172.21.15.32:0/1782395494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35400c8620 0x7f35400c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f3545c00640 1 -- 172.21.15.32:0/1782395494 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3540162b60 con 0x7f35280039c0 2024-03-19T06:22:44.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f3545200640 1 --2- 172.21.15.32:0/1782395494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35400c7790 0x7f35400c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:44.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f3545c00640 1 --2- 172.21.15.32:0/1782395494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35280039c0 0x7f3540148b60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f35340ab040 tx=0x7f3528005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:44.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f353d600640 1 -- 172.21.15.32:0/1782395494 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35340a5b50 con 0x7f35280039c0 2024-03-19T06:22:44.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f353d600640 1 -- 172.21.15.32:0/1782395494 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35340a5cf0 con 0x7f35280039c0 2024-03-19T06:22:44.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f353d600640 1 -- 172.21.15.32:0/1782395494 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3534004a10 con 0x7f35280039c0 2024-03-19T06:22:44.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f3548600640 1 -- 172.21.15.32:0/1782395494 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3540162e40 con 0x7f35280039c0 2024-03-19T06:22:44.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f3548600640 1 -- 172.21.15.32:0/1782395494 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3540163400 con 0x7f35280039c0 2024-03-19T06:22:44.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f3548600640 1 -- 172.21.15.32:0/1782395494 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35400749e0 con 0x7f35280039c0 2024-03-19T06:22:44.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.371+0000 7f353d600640 1 -- 172.21.15.32:0/1782395494 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3534004bb0 con 0x7f35280039c0 2024-03-19T06:22:44.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.375+0000 7f353d600640 1 --2- 172.21.15.32:0/1782395494 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3520067660 0x7f3520069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:44.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.375+0000 7f353d600640 1 -- 172.21.15.32:0/1782395494 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f353411efe0 con 0x7f35280039c0 2024-03-19T06:22:44.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.375+0000 7f3545200640 1 --2- 172.21.15.32:0/1782395494 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3520067660 0x7f3520069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:44.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.375+0000 7f3545200640 1 --2- 172.21.15.32:0/1782395494 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3520067660 0x7f3520069b20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f35400d0470 tx=0x7f352c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:44.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.379+0000 7f353d600640 1 -- 172.21.15.32:0/1782395494 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f354015be40 con 0x7f35280039c0 2024-03-19T06:22:44.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.555+0000 7f3548600640 1 -- 172.21.15.32:0/1782395494 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f354006e0d0 con 0x7f35280039c0 2024-03-19T06:22:44.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.555+0000 7f353d600640 1 -- 172.21.15.32:0/1782395494 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7f35340efa50 con 0x7f35280039c0 2024-03-19T06:22:44.543 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:22:44.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.555+0000 7f3548600640 1 -- 172.21.15.32:0/1782395494 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3520067660 msgr2=0x7f3520069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:44.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.555+0000 7f3548600640 1 --2- 172.21.15.32:0/1782395494 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3520067660 0x7f3520069b20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f35400d0470 tx=0x7f352c008040 comp rx=0 tx=0).stop 2024-03-19T06:22:44.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.555+0000 7f3548600640 1 -- 172.21.15.32:0/1782395494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35280039c0 msgr2=0x7f3540148b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:44.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.555+0000 7f3548600640 1 --2- 172.21.15.32:0/1782395494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35280039c0 0x7f3540148b60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f35340ab040 tx=0x7f3528005840 comp rx=0 tx=0).stop 2024-03-19T06:22:44.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.555+0000 7f3548600640 1 -- 172.21.15.32:0/1782395494 shutdown_connections 2024-03-19T06:22:44.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.555+0000 7f3548600640 1 --2- 172.21.15.32:0/1782395494 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3520067660 0x7f3520069b20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.555+0000 7f3548600640 1 --2- 172.21.15.32:0/1782395494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35400c8620 0x7f35400c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.555+0000 7f3548600640 1 --2- 172.21.15.32:0/1782395494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35400c7790 0x7f35400c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.555+0000 7f3548600640 1 --2- 172.21.15.32:0/1782395494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35280039c0 0x7f3540148b60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:44.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.555+0000 7f3548600640 1 -- 172.21.15.32:0/1782395494 >> 172.21.15.32:0/1782395494 conn(0x7f35400b2250 msgr2=0x7f354006e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:44.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.555+0000 7f3548600640 1 -- 172.21.15.32:0/1782395494 shutdown_connections 2024-03-19T06:22:44.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:44.555+0000 7f3548600640 1 -- 172.21.15.32:0/1782395494 wait complete. 2024-03-19T06:22:44.564 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi032.front.sepia.ceph.com... 2024-03-19T06:22:44.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:44.564 DEBUG:teuthology.orchestra.run.smithi032:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:44.583 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[36964]: fuse finished with error 0 and tester_r 0 2024-03-19T06:22:44.586 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:22:50.688 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:22:50.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:50.688 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-19T06:22:50.698 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2024-03-19T06:22:50.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.907+0000 7f9c53a00640 1 Processor -- start 2024-03-19T06:22:50.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.907+0000 7f9c53a00640 1 -- start start 2024-03-19T06:22:50.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.907+0000 7f9c53a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9c4c06b450 0x7f9c4c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:50.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.907+0000 7f9c53a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4c0af2d0 con 0x7f9c4c0aea70 2024-03-19T06:22:50.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.907+0000 7f9c53a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4c15eea0 con 0x7f9c4c15a840 2024-03-19T06:22:50.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.907+0000 7f9c53a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4c0cdc20 con 0x7f9c4c06b450 2024-03-19T06:22:50.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.907+0000 7f9c51a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9c4c0aea70 0x7f9c4c0ce0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39214/0 (socket says 172.21.15.32:39214) 2024-03-19T06:22:50.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.907+0000 7f9c51a00640 1 -- 172.21.15.32:0/3351504538 learned_addr learned my addr 172.21.15.32:0/3351504538 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:50.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.907+0000 7f9c43e00640 1 --2- 172.21.15.32:0/3351504538 >> v2:172.21.15.171:3300/0 conn(0x7f9c4c06b450 0x7f9c4c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:50.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.907+0000 7f9c4be00640 1 -- 172.21.15.32:0/3351504538 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925572333 0 0) 0x7f9c4c0af2d0 con 0x7f9c4c0aea70 2024-03-19T06:22:50.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.907+0000 7f9c4be00640 1 -- 172.21.15.32:0/3351504538 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c30003530 con 0x7f9c4c0aea70 2024-03-19T06:22:50.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c4be00640 1 -- 172.21.15.32:0/3351504538 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1471978612 0 0) 0x7f9c30003530 con 0x7f9c4c0aea70 2024-03-19T06:22:50.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c4be00640 1 -- 172.21.15.32:0/3351504538 >> v2:172.21.15.171:3300/0 conn(0x7f9c4c06b450 msgr2=0x7f9c4c06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:50.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c4be00640 1 --2- 172.21.15.32:0/3351504538 >> v2:172.21.15.171:3300/0 conn(0x7f9c4c06b450 0x7f9c4c06f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:50.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c4be00640 1 -- 172.21.15.32:0/3351504538 >> v1:172.21.15.171:6789/0 conn(0x7f9c4c15a840 legacy=0x7f9c4c06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:50.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c4be00640 1 -- 172.21.15.32:0/3351504538 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c15f180 con 0x7f9c4c0aea70 2024-03-19T06:22:50.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c4be00640 1 -- 172.21.15.32:0/3351504538 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f9c44001a00 con 0x7f9c4c0aea70 2024-03-19T06:22:50.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c4be00640 1 -- 172.21.15.32:0/3351504538 >> v1:172.21.15.32:6789/0 conn(0x7f9c4c0aea70 legacy=0x7f9c4c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:50.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c4be00640 1 --2- 172.21.15.32:0/3351504538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c300039c0 0x7f9c30003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:50.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c4be00640 1 --2- 172.21.15.32:0/3351504538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c300043c0 0x7f9c30004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:50.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c4be00640 1 --2- 172.21.15.32:0/3351504538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c30005130 0x7f9c3000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:50.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c4be00640 1 -- 172.21.15.32:0/3351504538 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c0cdc20 con 0x7f9c300043c0 2024-03-19T06:22:50.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c4be00640 1 -- 172.21.15.32:0/3351504538 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3000c070 con 0x7f9c30005130 2024-03-19T06:22:50.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c4be00640 1 -- 172.21.15.32:0/3351504538 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3000c270 con 0x7f9c300039c0 2024-03-19T06:22:50.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c43e00640 1 --2- 172.21.15.32:0/3351504538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c300043c0 0x7f9c30004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:50.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c51000640 1 --2- 172.21.15.32:0/3351504538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c300039c0 0x7f9c30003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:50.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c51a00640 1 --2- 172.21.15.32:0/3351504538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c30005130 0x7f9c3000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:50.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c43e00640 1 -- 172.21.15.32:0/3351504538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c300039c0 msgr2=0x7f9c30003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:50.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c43e00640 1 --2- 172.21.15.32:0/3351504538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c300039c0 0x7f9c30003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:50.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c43e00640 1 -- 172.21.15.32:0/3351504538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c30005130 msgr2=0x7f9c3000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:50.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c43e00640 1 --2- 172.21.15.32:0/3351504538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c30005130 0x7f9c3000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:50.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c51a00640 1 -- 172.21.15.32:0/3351504538 reap_dead start 2024-03-19T06:22:50.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c43e00640 1 -- 172.21.15.32:0/3351504538 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c30003530 con 0x7f9c300043c0 2024-03-19T06:22:50.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.911+0000 7f9c43e00640 1 --2- 172.21.15.32:0/3351504538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c300043c0 0x7f9c30004890 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9c34009ae0 tx=0x7f9c3401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5370a014c0b1421 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:50.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c4be00640 1 -- 172.21.15.32:0/3351504538 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c340b2070 con 0x7f9c300043c0 2024-03-19T06:22:50.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c4be00640 1 -- 172.21.15.32:0/3351504538 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c340a5660 con 0x7f9c300043c0 2024-03-19T06:22:50.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c4be00640 1 -- 172.21.15.32:0/3351504538 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c340096b0 con 0x7f9c300043c0 2024-03-19T06:22:50.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c53a00640 1 -- 172.21.15.32:0/3351504538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c300043c0 msgr2=0x7f9c30004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:50.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c53a00640 1 --2- 172.21.15.32:0/3351504538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c300043c0 0x7f9c30004890 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9c34009ae0 tx=0x7f9c3401ca70 comp rx=0 tx=0).stop 2024-03-19T06:22:50.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c53a00640 1 -- 172.21.15.32:0/3351504538 shutdown_connections 2024-03-19T06:22:50.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c53a00640 1 --2- 172.21.15.32:0/3351504538 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c300043c0 0x7f9c30004890 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:50.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c53a00640 1 -- 172.21.15.32:0/3351504538 >> 172.21.15.32:0/3351504538 conn(0x7f9c4c0b1590 msgr2=0x7f9c4c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:50.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c53a00640 1 -- 172.21.15.32:0/3351504538 shutdown_connections 2024-03-19T06:22:50.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c53a00640 1 -- 172.21.15.32:0/3351504538 wait complete. 2024-03-19T06:22:50.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c53a00640 1 Processor -- start 2024-03-19T06:22:50.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c53a00640 1 -- start start 2024-03-19T06:22:50.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c53a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c300043c0 0x7f9c4c144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:50.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c53a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c4c0ac8e0 0x7f9c4c156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:50.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c53a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c4c0adef0 0x7f9c4c147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:50.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c53a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c0aef30 con 0x7f9c4c0adef0 2024-03-19T06:22:50.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c53a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c0cd840 con 0x7f9c300043c0 2024-03-19T06:22:50.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c53a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c0af0b0 con 0x7f9c4c0ac8e0 2024-03-19T06:22:50.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c51a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c4c0adef0 0x7f9c4c147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:50.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c51a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c4c0adef0 0x7f9c4c147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41578/0 (socket says 172.21.15.32:41578) 2024-03-19T06:22:50.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c51a00640 1 -- 172.21.15.32:0/1055277065 learned_addr learned my addr 172.21.15.32:0/1055277065 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:50.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c51000640 1 --2- 172.21.15.32:0/1055277065 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c300043c0 0x7f9c4c144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:50.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c43e00640 1 --2- 172.21.15.32:0/1055277065 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c4c0ac8e0 0x7f9c4c156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:50.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c51a00640 1 -- 172.21.15.32:0/1055277065 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c4c0ac8e0 msgr2=0x7f9c4c156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:50.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.915+0000 7f9c51a00640 1 --2- 172.21.15.32:0/1055277065 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c4c0ac8e0 0x7f9c4c156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:50.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.919+0000 7f9c51a00640 1 -- 172.21.15.32:0/1055277065 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c300043c0 msgr2=0x7f9c4c144ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:50.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.919+0000 7f9c51a00640 1 --2- 172.21.15.32:0/1055277065 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c300043c0 0x7f9c4c144ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:50.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.919+0000 7f9c51a00640 1 -- 172.21.15.32:0/1055277065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c0ace50 con 0x7f9c4c0adef0 2024-03-19T06:22:50.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.919+0000 7f9c51a00640 1 --2- 172.21.15.32:0/1055277065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c4c0adef0 0x7f9c4c147600 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9c44000f90 tx=0x7f9c44007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:50.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.919+0000 7f9c49600640 1 -- 172.21.15.32:0/1055277065 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4400ab70 con 0x7f9c4c0adef0 2024-03-19T06:22:50.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.919+0000 7f9c49600640 1 -- 172.21.15.32:0/1055277065 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c44019070 con 0x7f9c4c0adef0 2024-03-19T06:22:50.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.919+0000 7f9c49600640 1 -- 172.21.15.32:0/1055277065 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c440133f0 con 0x7f9c4c0adef0 2024-03-19T06:22:50.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.919+0000 7f9c53a00640 1 -- 172.21.15.32:0/1055277065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4c0ad130 con 0x7f9c4c0adef0 2024-03-19T06:22:50.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.919+0000 7f9c53a00640 1 -- 172.21.15.32:0/1055277065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4c0ad6f0 con 0x7f9c4c0adef0 2024-03-19T06:22:50.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.919+0000 7f9c53a00640 1 -- 172.21.15.32:0/1055277065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4c0749e0 con 0x7f9c4c0adef0 2024-03-19T06:22:50.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.919+0000 7f9c49600640 1 -- 172.21.15.32:0/1055277065 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9c44013590 con 0x7f9c4c0adef0 2024-03-19T06:22:50.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.919+0000 7f9c49600640 1 --2- 172.21.15.32:0/1055277065 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9c28067690 0x7f9c28069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:50.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.919+0000 7f9c49600640 1 -- 172.21.15.32:0/1055277065 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f9c44085e50 con 0x7f9c4c0adef0 2024-03-19T06:22:50.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.919+0000 7f9c51000640 1 --2- 172.21.15.32:0/1055277065 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9c28067690 0x7f9c28069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:50.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.923+0000 7f9c51000640 1 --2- 172.21.15.32:0/1055277065 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9c28067690 0x7f9c28069b50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c000c10 tx=0x7f9c3c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:50.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:50.923+0000 7f9c49600640 1 -- 172.21.15.32:0/1055277065 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f9c44056250 con 0x7f9c4c0adef0 2024-03-19T06:22:51.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.147+0000 7f9c53a00640 1 -- 172.21.15.32:0/1055277065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f9c4c15e880 con 0x7f9c4c0adef0 2024-03-19T06:22:51.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.151+0000 7f9c49600640 1 -- 172.21.15.32:0/1055277065 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v13) v1 ==== 211+0+168 (secure 0 0 0) 0x7f9c4405a2f0 con 0x7f9c4c0adef0 2024-03-19T06:22:51.138 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-03-19T06:22:51.138 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCWLvll4jsFMxAAr4PzH6Djodh2O01vGYgxKA== 2024-03-19T06:22:51.138 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow rwp" 2024-03-19T06:22:51.138 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2024-03-19T06:22:51.138 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2024-03-19T06:22:51.139 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.0 2024-03-19T06:22:51.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.151+0000 7f9c53a00640 1 -- 172.21.15.32:0/1055277065 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9c28067690 msgr2=0x7f9c28069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:51.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.151+0000 7f9c53a00640 1 --2- 172.21.15.32:0/1055277065 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9c28067690 0x7f9c28069b50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c000c10 tx=0x7f9c3c009040 comp rx=0 tx=0).stop 2024-03-19T06:22:51.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.151+0000 7f9c53a00640 1 -- 172.21.15.32:0/1055277065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c4c0adef0 msgr2=0x7f9c4c147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:51.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.151+0000 7f9c53a00640 1 --2- 172.21.15.32:0/1055277065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c4c0adef0 0x7f9c4c147600 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9c44000f90 tx=0x7f9c44007b00 comp rx=0 tx=0).stop 2024-03-19T06:22:51.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.151+0000 7f9c53a00640 1 -- 172.21.15.32:0/1055277065 shutdown_connections 2024-03-19T06:22:51.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.151+0000 7f9c53a00640 1 --2- 172.21.15.32:0/1055277065 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9c28067690 0x7f9c28069b50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:51.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.151+0000 7f9c53a00640 1 --2- 172.21.15.32:0/1055277065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c4c0adef0 0x7f9c4c147600 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:51.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.151+0000 7f9c53a00640 1 --2- 172.21.15.32:0/1055277065 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c4c0ac8e0 0x7f9c4c156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:51.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.151+0000 7f9c53a00640 1 --2- 172.21.15.32:0/1055277065 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c300043c0 0x7f9c4c144ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:51.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.151+0000 7f9c53a00640 1 -- 172.21.15.32:0/1055277065 >> 172.21.15.32:0/1055277065 conn(0x7f9c4c0b1590 msgr2=0x7f9c4c0b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:51.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.151+0000 7f9c53a00640 1 -- 172.21.15.32:0/1055277065 shutdown_connections 2024-03-19T06:22:51.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.151+0000 7f9c53a00640 1 -- 172.21.15.32:0/1055277065 wait complete. 2024-03-19T06:22:51.160 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-19T06:22:51.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.311+0000 7f3665800640 1 Processor -- start 2024-03-19T06:22:51.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.311+0000 7f3665800640 1 -- start start 2024-03-19T06:22:51.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.311+0000 7f3665800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f36600cc220 0x7f36600ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:51.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.311+0000 7f3665800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36600cc600 0x7f36600717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:51.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.315+0000 7f3665800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3660161e10 0x7f36600cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:51.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.315+0000 7f3665800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36601616a0 con 0x7f3660161e10 2024-03-19T06:22:51.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.315+0000 7f3665800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3660071ee0 con 0x7f36600cc220 2024-03-19T06:22:51.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.315+0000 7f3665800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36600721c0 con 0x7f36600cc600 2024-03-19T06:22:51.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.315+0000 7f365f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3660161e10 0x7f36600cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:51.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.315+0000 7f365f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3660161e10 0x7f36600cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41588/0 (socket says 172.21.15.32:41588) 2024-03-19T06:22:51.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.315+0000 7f365f400640 1 -- 172.21.15.32:0/2129982250 learned_addr learned my addr 172.21.15.32:0/2129982250 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:51.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.315+0000 7f365ea00640 1 --2- 172.21.15.32:0/2129982250 >> v2:172.21.15.171:3300/0 conn(0x7f36600cc220 0x7f36600ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:51.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.315+0000 7f3657e00640 1 --2- 172.21.15.32:0/2129982250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36600cc600 0x7f36600717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:51.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.315+0000 7f365f400640 1 -- 172.21.15.32:0/2129982250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36600cc600 msgr2=0x7f36600717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:51.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.315+0000 7f365f400640 1 --2- 172.21.15.32:0/2129982250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36600cc600 0x7f36600717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:51.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.315+0000 7f365f400640 1 -- 172.21.15.32:0/2129982250 >> v2:172.21.15.171:3300/0 conn(0x7f36600cc220 msgr2=0x7f36600ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:51.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.315+0000 7f365f400640 1 --2- 172.21.15.32:0/2129982250 >> v2:172.21.15.171:3300/0 conn(0x7f36600cc220 0x7f36600ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:51.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.315+0000 7f365f400640 1 -- 172.21.15.32:0/2129982250 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36600724a0 con 0x7f3660161e10 2024-03-19T06:22:51.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.315+0000 7f365f400640 1 --2- 172.21.15.32:0/2129982250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3660161e10 0x7f36600cd180 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f36600cbf90 tx=0x7f365801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09e7643a4557c5e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:51.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f365e000640 1 -- 172.21.15.32:0/2129982250 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580a56f0 con 0x7f3660161e10 2024-03-19T06:22:51.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f365e000640 1 -- 172.21.15.32:0/2129982250 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36580a5890 con 0x7f3660161e10 2024-03-19T06:22:51.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f365e000640 1 -- 172.21.15.32:0/2129982250 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580a5c60 con 0x7f3660161e10 2024-03-19T06:22:51.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 -- 172.21.15.32:0/2129982250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3660161e10 msgr2=0x7f36600cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:51.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 --2- 172.21.15.32:0/2129982250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3660161e10 0x7f36600cd180 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f36600cbf90 tx=0x7f365801c960 comp rx=0 tx=0).stop 2024-03-19T06:22:51.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 -- 172.21.15.32:0/2129982250 shutdown_connections 2024-03-19T06:22:51.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 --2- 172.21.15.32:0/2129982250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3660161e10 0x7f36600cd180 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:51.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 --2- 172.21.15.32:0/2129982250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36600cc600 0x7f36600717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:51.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 --2- 172.21.15.32:0/2129982250 >> v2:172.21.15.171:3300/0 conn(0x7f36600cc220 0x7f36600ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:51.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 -- 172.21.15.32:0/2129982250 >> 172.21.15.32:0/2129982250 conn(0x7f36600b1280 msgr2=0x7f36600b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:51.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 -- 172.21.15.32:0/2129982250 shutdown_connections 2024-03-19T06:22:51.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 -- 172.21.15.32:0/2129982250 wait complete. 2024-03-19T06:22:51.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 Processor -- start 2024-03-19T06:22:51.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 -- start start 2024-03-19T06:22:51.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36600cc220 0x7f366013fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:51.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36600cc600 0x7f366013e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:51.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3660161e10 0x7f366013ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:51.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36600c8c90 con 0x7f36600cc220 2024-03-19T06:22:51.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36600c8b10 con 0x7f3660161e10 2024-03-19T06:22:51.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3665800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36600c8e10 con 0x7f36600cc600 2024-03-19T06:22:51.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f365ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36600cc220 0x7f366013fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:51.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f365ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36600cc220 0x7f366013fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41602/0 (socket says 172.21.15.32:41602) 2024-03-19T06:22:51.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f365ea00640 1 -- 172.21.15.32:0/3656042166 learned_addr learned my addr 172.21.15.32:0/3656042166 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:51.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f3657e00640 1 --2- 172.21.15.32:0/3656042166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36600cc600 0x7f366013e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:51.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.319+0000 7f365f400640 1 --2- 172.21.15.32:0/3656042166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3660161e10 0x7f366013ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:51.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.323+0000 7f365ea00640 1 -- 172.21.15.32:0/3656042166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36600cc600 msgr2=0x7f366013e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:51.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.323+0000 7f365ea00640 1 --2- 172.21.15.32:0/3656042166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36600cc600 0x7f366013e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:51.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.323+0000 7f365ea00640 1 -- 172.21.15.32:0/3656042166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3660161e10 msgr2=0x7f366013ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:51.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.323+0000 7f365ea00640 1 --2- 172.21.15.32:0/3656042166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3660161e10 0x7f366013ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:51.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.323+0000 7f365ea00640 1 -- 172.21.15.32:0/3656042166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36600b4710 con 0x7f36600cc220 2024-03-19T06:22:51.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.323+0000 7f365ea00640 1 --2- 172.21.15.32:0/3656042166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36600cc220 0x7f366013fc50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f365000e930 tx=0x7f365000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:51.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.323+0000 7f3656a00640 1 -- 172.21.15.32:0/3656042166 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650017070 con 0x7f36600cc220 2024-03-19T06:22:51.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.323+0000 7f3656a00640 1 -- 172.21.15.32:0/3656042166 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365000ca00 con 0x7f36600cc220 2024-03-19T06:22:51.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.323+0000 7f3665800640 1 -- 172.21.15.32:0/3656042166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36600b49b0 con 0x7f36600cc220 2024-03-19T06:22:51.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.323+0000 7f3656a00640 1 -- 172.21.15.32:0/3656042166 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365000cdb0 con 0x7f36600cc220 2024-03-19T06:22:51.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.323+0000 7f3665800640 1 -- 172.21.15.32:0/3656042166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36600b5250 con 0x7f36600cc220 2024-03-19T06:22:51.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.323+0000 7f3665800640 1 -- 172.21.15.32:0/3656042166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36600749e0 con 0x7f36600cc220 2024-03-19T06:22:51.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.323+0000 7f3656a00640 1 -- 172.21.15.32:0/3656042166 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f365001a070 con 0x7f36600cc220 2024-03-19T06:22:51.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.323+0000 7f3656a00640 1 --2- 172.21.15.32:0/3656042166 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f363c067660 0x7f363c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:51.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.323+0000 7f3656a00640 1 -- 172.21.15.32:0/3656042166 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f3650085a80 con 0x7f36600cc220 2024-03-19T06:22:51.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.327+0000 7f3657e00640 1 --2- 172.21.15.32:0/3656042166 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f363c067660 0x7f363c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:51.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.327+0000 7f3657e00640 1 --2- 172.21.15.32:0/3656042166 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f363c067660 0x7f363c069b20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f366013e800 tx=0x7f3648009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:51.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.327+0000 7f3656a00640 1 -- 172.21.15.32:0/3656042166 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f3650087e20 con 0x7f36600cc220 2024-03-19T06:22:51.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.527+0000 7f3665800640 1 -- 172.21.15.32:0/3656042166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3660161410 con 0x7f36600cc220 2024-03-19T06:22:51.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.527+0000 7f3656a00640 1 -- 172.21.15.32:0/3656042166 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+82 (secure 0 0 0) 0x7f3650055f40 con 0x7f36600cc220 2024-03-19T06:22:51.515 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2024-03-19T06:22:51.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.527+0000 7f3665800640 1 -- 172.21.15.32:0/3656042166 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f363c067660 msgr2=0x7f363c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:51.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.527+0000 7f3665800640 1 --2- 172.21.15.32:0/3656042166 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f363c067660 0x7f363c069b20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f366013e800 tx=0x7f3648009190 comp rx=0 tx=0).stop 2024-03-19T06:22:51.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.527+0000 7f3665800640 1 -- 172.21.15.32:0/3656042166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36600cc220 msgr2=0x7f366013fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.527+0000 7f3665800640 1 --2- 172.21.15.32:0/3656042166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36600cc220 0x7f366013fc50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f365000e930 tx=0x7f365000edf0 comp rx=0 tx=0).stop 2024-03-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.527+0000 7f3665800640 1 -- 172.21.15.32:0/3656042166 shutdown_connections 2024-03-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.527+0000 7f3665800640 1 --2- 172.21.15.32:0/3656042166 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f363c067660 0x7f363c069b20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.527+0000 7f3665800640 1 --2- 172.21.15.32:0/3656042166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3660161e10 0x7f366013ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.527+0000 7f3665800640 1 --2- 172.21.15.32:0/3656042166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36600cc600 0x7f366013e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.527+0000 7f3665800640 1 --2- 172.21.15.32:0/3656042166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36600cc220 0x7f366013fc50 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.527+0000 7f3665800640 1 -- 172.21.15.32:0/3656042166 >> 172.21.15.32:0/3656042166 conn(0x7f36600b1280 msgr2=0x7f36600c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.527+0000 7f3665800640 1 -- 172.21.15.32:0/3656042166 shutdown_connections 2024-03-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:51.527+0000 7f3665800640 1 -- 172.21.15.32:0/3656042166 wait complete. 2024-03-19T06:22:51.536 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-19T06:22:51.536 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-19T06:22:51.536 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-03-19T06:22:51.536 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-19T06:22:51.536 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:51.536 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-19T06:22:51.536 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-19T06:22:51.536 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-19T06:22:51.536 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:22:51.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:51.537 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-03-19T06:22:51.546 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:22:51.546 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:22:51.546 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:22:51.546 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:51.546 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-03-19T06:22:51.546 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:51.546 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:22:51.546 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:51.546 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-03-19T06:22:51.546 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:22:51.546 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:51.546 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-03-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-03-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-03-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42326sec preferred_lft 42326sec 2024-03-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-03-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-03-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:f5:94:d0:dd brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi032.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-03-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-03-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi032.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-03-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi032.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-03-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:22:51.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:51.549 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-19T06:22:51.611 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-03-19T06:22:51.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:51.613 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-03-19T06:22:51.670 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-03-19T06:22:51.670 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-19T06:22:51.670 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-03-19T06:22:51.670 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-19T06:22:51.671 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-03-19T06:22:51.671 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-19T06:22:51.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:51.671 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-03-19T06:22:51.671 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-03-19T06:22:51.671 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-19T06:22:51.671 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-19T06:22:51.671 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-19T06:22:51.671 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-03-19T06:22:51.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:51.764 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-03-19T06:22:51.773 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-19T06:22:51.773 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-19T06:22:51.774 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:22:51.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:51.774 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-03-19T06:22:51.841 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-19T06:22:51.842 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:22:51.842 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:51.898 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:22:51.898 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:22:51.898 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:51.949 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:22:52.019 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:22:52.071 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:22:52.071 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:22:52.071 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:22:52.071 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:22:52.071 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:22:52.071 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:22:52.071 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:22:52.071 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:22:52.071 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:22:52.071 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:22:52.071 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:22:52.071 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:22:52.072 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:22:52.072 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:22:52.072 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:22:52.072 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:22:52.072 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:22:52.072 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:22:52.072 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:22:52.072 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:22:52.072 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:22:52.073 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:22:52.073 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:22:52.073 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:22:52.073 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:22:52.073 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:22:52.073 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:22:52.073 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:22:52.073 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:22:52.073 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:22:52.073 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:22:52.073 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:22:52.073 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:22:52.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:52.074 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:22:52.125 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-19T06:22:52.126 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-19T06:22:52.172 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:22:52.193 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:22:52.243 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:22:52.243 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:22:52.243 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:22:52.243 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:22:52.243 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:22:52.243 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:22:52.244 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:22:52.244 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:22:52.244 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:22:52.244 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:22:52.244 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:22:52.244 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:22:52.244 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:22:52.244 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:22:52.244 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:22:52.244 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:22:52.244 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:22:52.244 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:22:52.244 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:22:52.244 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:22:52.244 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:22:52.245 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:22:52.245 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:22:52.245 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:22:52.245 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:22:52.245 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:22:52.245 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:22:52.245 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:22:52.245 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:22:52.245 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:22:52.245 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:22:52.245 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:22:52.245 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:22:52.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:52.246 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:22:52.268 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:2024-03-19T06:22:52.279+0000 7f5e45a47580 -1 init, newargv = 0x55882a5642f0 newargc=15 2024-03-19T06:22:52.268 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[37415]: starting ceph client 2024-03-19T06:22:52.274 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[37415]: starting fuse 2024-03-19T06:22:52.277 INFO:teuthology.orchestra.run.smithi032.stdout:43 2024-03-19T06:22:52.277 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-03-19T06:22:52.277 DEBUG:teuthology.orchestra.run.smithi032:> sudo stdin-killer -- python3 -c ' 2024-03-19T06:22:52.277 DEBUG:teuthology.orchestra.run.smithi032:> import glob 2024-03-19T06:22:52.277 DEBUG:teuthology.orchestra.run.smithi032:> import re 2024-03-19T06:22:52.277 DEBUG:teuthology.orchestra.run.smithi032:> import os 2024-03-19T06:22:52.278 DEBUG:teuthology.orchestra.run.smithi032:> import subprocess 2024-03-19T06:22:52.278 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:22:52.278 DEBUG:teuthology.orchestra.run.smithi032:> def _find_admin_socket(client_name): 2024-03-19T06:22:52.278 DEBUG:teuthology.orchestra.run.smithi032:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-19T06:22:52.278 DEBUG:teuthology.orchestra.run.smithi032:> files = glob.glob(asok_path) 2024-03-19T06:22:52.278 DEBUG:teuthology.orchestra.run.smithi032:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-19T06:22:52.278 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:22:52.278 DEBUG:teuthology.orchestra.run.smithi032:> # Given a non-glob path, it better be there 2024-03-19T06:22:52.278 DEBUG:teuthology.orchestra.run.smithi032:> if "*" not in asok_path: 2024-03-19T06:22:52.278 DEBUG:teuthology.orchestra.run.smithi032:> assert(len(files) == 1) 2024-03-19T06:22:52.278 DEBUG:teuthology.orchestra.run.smithi032:> return files[0] 2024-03-19T06:22:52.278 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:22:52.278 DEBUG:teuthology.orchestra.run.smithi032:> for f in files: 2024-03-19T06:22:52.278 DEBUG:teuthology.orchestra.run.smithi032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-19T06:22:52.278 DEBUG:teuthology.orchestra.run.smithi032:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-19T06:22:52.278 DEBUG:teuthology.orchestra.run.smithi032:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-19T06:22:52.279 DEBUG:teuthology.orchestra.run.smithi032:> contents = proc_f.read() 2024-03-19T06:22:52.279 DEBUG:teuthology.orchestra.run.smithi032:> if mountpoint in contents: 2024-03-19T06:22:52.279 DEBUG:teuthology.orchestra.run.smithi032:> return f 2024-03-19T06:22:52.279 DEBUG:teuthology.orchestra.run.smithi032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-19T06:22:52.279 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:22:52.279 DEBUG:teuthology.orchestra.run.smithi032:> print(_find_admin_socket("client.0")) 2024-03-19T06:22:52.279 DEBUG:teuthology.orchestra.run.smithi032:> ' 2024-03-19T06:22:52.400 INFO:teuthology.orchestra.run.smithi032.stdout:/var/run/ceph/ceph-client.0.37415.asok 2024-03-19T06:22:52.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-19T06:22:52.411 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37415.asok 2024-03-19T06:22:52.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:52.412 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37415.asok status 2024-03-19T06:22:52.585 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:22:52.585 INFO:teuthology.orchestra.run.smithi032.stdout: "metadata": { 2024-03-19T06:22:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_sha1": "b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", 2024-03-19T06:22:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_version": "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)", 2024-03-19T06:22:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "entity_id": "0", 2024-03-19T06:22:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "hostname": "smithi032", 2024-03-19T06:22:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-19T06:22:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "pid": "37415", 2024-03-19T06:22:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "root": "/" 2024-03-19T06:22:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_count": 0, 2024-03-19T06:22:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_pinned_count": 0, 2024-03-19T06:22:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 5670, 2024-03-19T06:22:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "inst": { 2024-03-19T06:22:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "name": { 2024-03-19T06:22:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "client", 2024-03-19T06:22:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "num": 5670 2024-03-19T06:22:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-03-19T06:22:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-03-19T06:22:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:22:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3500839179 2024-03-19T06:22:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:22:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-03-19T06:22:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-03-19T06:22:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:22:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3500839179 2024-03-19T06:22:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:22:52.587 INFO:teuthology.orchestra.run.smithi032.stdout: "inst_str": "client.5670 192.168.0.1:0/3500839179", 2024-03-19T06:22:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "addr_str": "192.168.0.1:0/3500839179", 2024-03-19T06:22:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "inode_count": 1, 2024-03-19T06:22:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_epoch": 18, 2024-03-19T06:22:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch": 38, 2024-03-19T06:22:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch_barrier": 0, 2024-03-19T06:22:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "blocklisted": false, 2024-03-19T06:22:52.588 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs" 2024-03-19T06:22:52.588 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:22:52.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:52.600 DEBUG:teuthology.orchestra.run.smithi032:> stat --file-system '--printf=%T 2024-03-19T06:22:52.600 DEBUG:teuthology.orchestra.run.smithi032:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:52.610 INFO:teuthology.orchestra.run.smithi032.stdout:fuseblk 2024-03-19T06:22:52.610 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:52.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:52.610 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:52.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:52.672 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2024-03-19T06:22:52.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:52.726 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2024-03-19T06:22:52.784 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:22:52.784 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:22:52.834 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:22:53.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.031+0000 7fcd9c400640 1 Processor -- start 2024-03-19T06:22:53.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.031+0000 7fcd9c400640 1 -- start start 2024-03-19T06:22:53.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.031+0000 7fcd9c400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcd9415a2b0 0x7fcd940cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.031+0000 7fcd9c400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcd940cdb40 0x7fcd94071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.031+0000 7fcd9c400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd940ce3e0 con 0x7fcd94159ed0 2024-03-19T06:22:53.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.031+0000 7fcd9c400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd940ca1d0 con 0x7fcd940cdb40 2024-03-19T06:22:53.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.031+0000 7fcd9c400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd940ca4b0 con 0x7fcd9415a2b0 2024-03-19T06:22:53.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.031+0000 7fcd9a400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcd940cdb40 0x7fcd94071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.031+0000 7fcd9a400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcd940cdb40 0x7fcd94071350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41612/0 (socket says 172.21.15.32:41612) 2024-03-19T06:22:53.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.031+0000 7fcd9a400640 1 -- 172.21.15.32:0/3124411637 learned_addr learned my addr 172.21.15.32:0/3124411637 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:53.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.031+0000 7fcd99000640 1 --2- 172.21.15.32:0/3124411637 >> v2:172.21.15.171:3300/0 conn(0x7fcd9415a2b0 0x7fcd940cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.031+0000 7fcd9a400640 1 -- 172.21.15.32:0/3124411637 >> v2:172.21.15.171:3300/0 conn(0x7fcd9415a2b0 msgr2=0x7fcd940cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:53.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.031+0000 7fcd9a400640 1 --2- 172.21.15.32:0/3124411637 >> v2:172.21.15.171:3300/0 conn(0x7fcd9415a2b0 0x7fcd940cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.031+0000 7fcd9a400640 1 -- 172.21.15.32:0/3124411637 >> v1:172.21.15.171:6789/0 conn(0x7fcd94159ed0 legacy=0x7fcd940caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.031+0000 7fcd9a400640 1 -- 172.21.15.32:0/3124411637 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd940ca790 con 0x7fcd940cdb40 2024-03-19T06:22:53.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.035+0000 7fcd9a400640 1 --2- 172.21.15.32:0/3124411637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd940cdb40 0x7fcd94071350 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fcd940cbfe0 tx=0x7fcd8c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87149c5317f5ff18 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:53.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.035+0000 7fcd93e00640 1 -- 172.21.15.32:0/3124411637 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0a5680 con 0x7fcd940cdb40 2024-03-19T06:22:53.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.035+0000 7fcd93e00640 1 -- 172.21.15.32:0/3124411637 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c0a5820 con 0x7fcd940cdb40 2024-03-19T06:22:53.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.035+0000 7fcd93e00640 1 -- 172.21.15.32:0/3124411637 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0a5bf0 con 0x7fcd940cdb40 2024-03-19T06:22:53.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.035+0000 7fcd9c400640 1 -- 172.21.15.32:0/3124411637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd940cdb40 msgr2=0x7fcd94071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.035+0000 7fcd9c400640 1 --2- 172.21.15.32:0/3124411637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd940cdb40 0x7fcd94071350 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fcd940cbfe0 tx=0x7fcd8c01c930 comp rx=0 tx=0).stop 2024-03-19T06:22:53.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.035+0000 7fcd9c400640 1 -- 172.21.15.32:0/3124411637 shutdown_connections 2024-03-19T06:22:53.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.035+0000 7fcd9c400640 1 --2- 172.21.15.32:0/3124411637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd940cdb40 0x7fcd94071350 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.035+0000 7fcd9c400640 1 --2- 172.21.15.32:0/3124411637 >> v2:172.21.15.171:3300/0 conn(0x7fcd9415a2b0 0x7fcd940cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.035+0000 7fcd9c400640 1 -- 172.21.15.32:0/3124411637 >> 172.21.15.32:0/3124411637 conn(0x7fcd940b1280 msgr2=0x7fcd940b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:53.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.035+0000 7fcd9c400640 1 -- 172.21.15.32:0/3124411637 shutdown_connections 2024-03-19T06:22:53.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.035+0000 7fcd9c400640 1 -- 172.21.15.32:0/3124411637 wait complete. 2024-03-19T06:22:53.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.035+0000 7fcd9c400640 1 Processor -- start 2024-03-19T06:22:53.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9c400640 1 -- start start 2024-03-19T06:22:53.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9c400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd940cdb40 0x7fcd9413f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9c400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd94159ed0 0x7fcd940c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9c400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd9415a2b0 0x7fcd940c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9c400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9406e1c0 con 0x7fcd9415a2b0 2024-03-19T06:22:53.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9c400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9406e040 con 0x7fcd94159ed0 2024-03-19T06:22:53.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9c400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9406e340 con 0x7fcd940cdb40 2024-03-19T06:22:53.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9a400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd9415a2b0 0x7fcd940c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9a400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd9415a2b0 0x7fcd940c8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41614/0 (socket says 172.21.15.32:41614) 2024-03-19T06:22:53.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9a400640 1 -- 172.21.15.32:0/191647843 learned_addr learned my addr 172.21.15.32:0/191647843 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:53.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd99000640 1 --2- 172.21.15.32:0/191647843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd94159ed0 0x7fcd940c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd99a00640 1 --2- 172.21.15.32:0/191647843 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd940cdb40 0x7fcd9413f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9a400640 1 -- 172.21.15.32:0/191647843 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd940cdb40 msgr2=0x7fcd9413f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9a400640 1 --2- 172.21.15.32:0/191647843 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd940cdb40 0x7fcd9413f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9a400640 1 -- 172.21.15.32:0/191647843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd94159ed0 msgr2=0x7fcd940c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9a400640 1 --2- 172.21.15.32:0/191647843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd94159ed0 0x7fcd940c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9a400640 1 -- 172.21.15.32:0/191647843 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9413f9e0 con 0x7fcd9415a2b0 2024-03-19T06:22:53.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd99a00640 1 --2- 172.21.15.32:0/191647843 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd940cdb40 0x7fcd9413f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:53.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9a400640 1 --2- 172.21.15.32:0/191647843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd9415a2b0 0x7fcd940c8f90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c01a560 tx=0x7fcd8c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:53.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd91600640 1 -- 172.21.15.32:0/191647843 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0bc020 con 0x7fcd9415a2b0 2024-03-19T06:22:53.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd91600640 1 -- 172.21.15.32:0/191647843 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c0b8670 con 0x7fcd9415a2b0 2024-03-19T06:22:53.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9c400640 1 -- 172.21.15.32:0/191647843 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd940b4590 con 0x7fcd9415a2b0 2024-03-19T06:22:53.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd91600640 1 -- 172.21.15.32:0/191647843 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0b8a60 con 0x7fcd9415a2b0 2024-03-19T06:22:53.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9c400640 1 -- 172.21.15.32:0/191647843 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd940b4b50 con 0x7fcd9415a2b0 2024-03-19T06:22:53.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.039+0000 7fcd9c400640 1 -- 172.21.15.32:0/191647843 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd940749e0 con 0x7fcd9415a2b0 2024-03-19T06:22:53.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.043+0000 7fcd91600640 1 -- 172.21.15.32:0/191647843 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fcd8c0bf020 con 0x7fcd9415a2b0 2024-03-19T06:22:53.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.043+0000 7fcd91600640 1 --2- 172.21.15.32:0/191647843 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcd74067660 0x7fcd74069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.043+0000 7fcd91600640 1 -- 172.21.15.32:0/191647843 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fcd8c120af0 con 0x7fcd9415a2b0 2024-03-19T06:22:53.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.043+0000 7fcd99a00640 1 --2- 172.21.15.32:0/191647843 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcd74067660 0x7fcd74069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.043+0000 7fcd99a00640 1 --2- 172.21.15.32:0/191647843 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcd74067660 0x7fcd74069b20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcd88000f70 tx=0x7fcd88009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:53.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.047+0000 7fcd91600640 1 -- 172.21.15.32:0/191647843 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fcd8c0c6030 con 0x7fcd9415a2b0 2024-03-19T06:22:53.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.211+0000 7fcd9c400640 1 -- 172.21.15.32:0/191647843 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd940ae980 con 0x7fcd9415a2b0 2024-03-19T06:22:53.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.211+0000 7fcd91600640 1 -- 172.21.15.32:0/191647843 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18493 (secure 0 0 0) 0x7fcd8c0165e0 con 0x7fcd9415a2b0 2024-03-19T06:22:53.201 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:53.202 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":38,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:22:27.853859+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:22:09.983589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-19T06:22:11.172289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-19T06:22:25.205334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:22:53.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.215+0000 7fcd9c400640 1 -- 172.21.15.32:0/191647843 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcd74067660 msgr2=0x7fcd74069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.215+0000 7fcd9c400640 1 --2- 172.21.15.32:0/191647843 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcd74067660 0x7fcd74069b20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcd88000f70 tx=0x7fcd88009040 comp rx=0 tx=0).stop 2024-03-19T06:22:53.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.215+0000 7fcd9c400640 1 -- 172.21.15.32:0/191647843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd9415a2b0 msgr2=0x7fcd940c8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.215+0000 7fcd9c400640 1 --2- 172.21.15.32:0/191647843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd9415a2b0 0x7fcd940c8f90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c01a560 tx=0x7fcd8c0196d0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.215+0000 7fcd9c400640 1 -- 172.21.15.32:0/191647843 shutdown_connections 2024-03-19T06:22:53.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.215+0000 7fcd9c400640 1 --2- 172.21.15.32:0/191647843 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcd74067660 0x7fcd74069b20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.215+0000 7fcd9c400640 1 --2- 172.21.15.32:0/191647843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd9415a2b0 0x7fcd940c8f90 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.215+0000 7fcd9c400640 1 --2- 172.21.15.32:0/191647843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd94159ed0 0x7fcd940c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.215+0000 7fcd9c400640 1 --2- 172.21.15.32:0/191647843 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd940cdb40 0x7fcd9413f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.215+0000 7fcd9c400640 1 -- 172.21.15.32:0/191647843 >> 172.21.15.32:0/191647843 conn(0x7fcd940b1280 msgr2=0x7fcd940ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:53.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.215+0000 7fcd9c400640 1 -- 172.21.15.32:0/191647843 shutdown_connections 2024-03-19T06:22:53.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.215+0000 7fcd9c400640 1 -- 172.21.15.32:0/191647843 wait complete. 2024-03-19T06:22:53.222 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:22:09.983589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:22:11.172289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2024-03-19T06:22:25.205334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:22:53.223 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:22:53.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3b04a00640 1 Processor -- start 2024-03-19T06:22:53.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3b04a00640 1 -- start start 2024-03-19T06:22:53.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3b04a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3b00150ad0 0x7f3b00150f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3b04a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b000b3c00 con 0x7f3b000b2f80 2024-03-19T06:22:53.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3b04a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b000b3ee0 con 0x7f3b00071550 2024-03-19T06:22:53.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3b04a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b001514a0 con 0x7f3b00150ad0 2024-03-19T06:22:53.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afe800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3b000b2f80 0x7f3b000b33f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39224/0 (socket says 172.21.15.32:39224) 2024-03-19T06:22:53.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afe800640 1 -- 172.21.15.32:0/1318232763 learned_addr learned my addr 172.21.15.32:0/1318232763 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3af7e00640 1 --2- 172.21.15.32:0/1318232763 >> v2:172.21.15.171:3300/0 conn(0x7f3b00150ad0 0x7f3b00150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afd400640 1 -- 172.21.15.32:0/1318232763 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847032095 0 0) 0x7f3b000b3c00 con 0x7f3b000b2f80 2024-03-19T06:22:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afd400640 1 -- 172.21.15.32:0/1318232763 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ae4003530 con 0x7f3b000b2f80 2024-03-19T06:22:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afd400640 1 -- 172.21.15.32:0/1318232763 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3855708927 0 0) 0x7f3ae4003530 con 0x7f3b000b2f80 2024-03-19T06:22:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afd400640 1 -- 172.21.15.32:0/1318232763 >> v2:172.21.15.171:3300/0 conn(0x7f3b00150ad0 msgr2=0x7f3b00150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afd400640 1 --2- 172.21.15.32:0/1318232763 >> v2:172.21.15.171:3300/0 conn(0x7f3b00150ad0 0x7f3b00150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afd400640 1 -- 172.21.15.32:0/1318232763 >> v1:172.21.15.171:6789/0 conn(0x7f3b00071550 legacy=0x7f3b00071930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afd400640 1 -- 172.21.15.32:0/1318232763 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000b41c0 con 0x7f3b000b2f80 2024-03-19T06:22:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afd400640 1 -- 172.21.15.32:0/1318232763 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f3af8001a00 con 0x7f3b000b2f80 2024-03-19T06:22:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afd400640 1 -- 172.21.15.32:0/1318232763 >> v1:172.21.15.32:6789/0 conn(0x7f3b000b2f80 legacy=0x7f3b000b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afd400640 1 --2- 172.21.15.32:0/1318232763 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ae40039c0 0x7f3ae4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afd400640 1 --2- 172.21.15.32:0/1318232763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ae4004810 0x7f3ae4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afd400640 1 --2- 172.21.15.32:0/1318232763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ae40051d0 0x7f3ae400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afd400640 1 -- 172.21.15.32:0/1318232763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b001514a0 con 0x7f3ae4004810 2024-03-19T06:22:53.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afd400640 1 -- 172.21.15.32:0/1318232763 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae400c070 con 0x7f3ae40051d0 2024-03-19T06:22:53.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.379+0000 7f3afd400640 1 -- 172.21.15.32:0/1318232763 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae400c270 con 0x7f3ae40039c0 2024-03-19T06:22:53.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.383+0000 7f3af7e00640 1 --2- 172.21.15.32:0/1318232763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ae4004810 0x7f3ae4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.383+0000 7f3afe800640 1 --2- 172.21.15.32:0/1318232763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ae40051d0 0x7f3ae400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.383+0000 7f3afde00640 1 --2- 172.21.15.32:0/1318232763 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ae40039c0 0x7f3ae4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.383+0000 7f3af7e00640 1 -- 172.21.15.32:0/1318232763 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ae40039c0 msgr2=0x7f3ae4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:53.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.383+0000 7f3af7e00640 1 --2- 172.21.15.32:0/1318232763 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ae40039c0 0x7f3ae4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.383+0000 7f3af7e00640 1 -- 172.21.15.32:0/1318232763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ae40051d0 msgr2=0x7f3ae400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:53.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.383+0000 7f3af7e00640 1 --2- 172.21.15.32:0/1318232763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ae40051d0 0x7f3ae400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.383+0000 7f3afe800640 1 -- 172.21.15.32:0/1318232763 reap_dead start 2024-03-19T06:22:53.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.383+0000 7f3af7e00640 1 -- 172.21.15.32:0/1318232763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae4003530 con 0x7f3ae4004810 2024-03-19T06:22:53.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.383+0000 7f3af7e00640 1 --2- 172.21.15.32:0/1318232763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ae4004810 0x7f3ae4004c90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8009ae0 tx=0x7f3ae801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce83e23b2eec1b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:53.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.383+0000 7f3afd400640 1 -- 172.21.15.32:0/1318232763 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae80b2070 con 0x7f3ae4004810 2024-03-19T06:22:53.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.383+0000 7f3afd400640 1 -- 172.21.15.32:0/1318232763 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae80a5660 con 0x7f3ae4004810 2024-03-19T06:22:53.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.383+0000 7f3afd400640 1 -- 172.21.15.32:0/1318232763 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae80096b0 con 0x7f3ae4004810 2024-03-19T06:22:53.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3b04a00640 1 -- 172.21.15.32:0/1318232763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ae4004810 msgr2=0x7f3ae4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3b04a00640 1 --2- 172.21.15.32:0/1318232763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ae4004810 0x7f3ae4004c90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8009ae0 tx=0x7f3ae801ca70 comp rx=0 tx=0).stop 2024-03-19T06:22:53.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3b04a00640 1 -- 172.21.15.32:0/1318232763 shutdown_connections 2024-03-19T06:22:53.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3b04a00640 1 --2- 172.21.15.32:0/1318232763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ae4004810 0x7f3ae4004c90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3b04a00640 1 -- 172.21.15.32:0/1318232763 >> 172.21.15.32:0/1318232763 conn(0x7f3b000b1590 msgr2=0x7f3b000b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:53.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3b04a00640 1 -- 172.21.15.32:0/1318232763 shutdown_connections 2024-03-19T06:22:53.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3b04a00640 1 -- 172.21.15.32:0/1318232763 wait complete. 2024-03-19T06:22:53.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3b04a00640 1 Processor -- start 2024-03-19T06:22:53.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3b04a00640 1 -- start start 2024-03-19T06:22:53.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3b04a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ae4004810 0x7f3b000cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3b04a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0014a1b0 0x7f3b0006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3b04a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b00149450 0x7f3b001498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3b04a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b001510e0 con 0x7f3b0014a1b0 2024-03-19T06:22:53.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3b04a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b00150f60 con 0x7f3b00149450 2024-03-19T06:22:53.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3b04a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b00151260 con 0x7f3ae4004810 2024-03-19T06:22:53.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3af7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0014a1b0 0x7f3b0006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3af7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0014a1b0 0x7f3b0006e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41640/0 (socket says 172.21.15.32:41640) 2024-03-19T06:22:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3af7e00640 1 -- 172.21.15.32:0/77716071 learned_addr learned my addr 172.21.15.32:0/77716071 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3afde00640 1 --2- 172.21.15.32:0/77716071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ae4004810 0x7f3b000cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3afe800640 1 --2- 172.21.15.32:0/77716071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b00149450 0x7f3b001498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3af7e00640 1 -- 172.21.15.32:0/77716071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ae4004810 msgr2=0x7f3b000cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3af7e00640 1 --2- 172.21.15.32:0/77716071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ae4004810 0x7f3b000cebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3af7e00640 1 -- 172.21.15.32:0/77716071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b00149450 msgr2=0x7f3b001498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3af7e00640 1 --2- 172.21.15.32:0/77716071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b00149450 0x7f3b001498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3af7e00640 1 -- 172.21.15.32:0/77716071 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000b1a20 con 0x7f3b0014a1b0 2024-03-19T06:22:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3afde00640 1 --2- 172.21.15.32:0/77716071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ae4004810 0x7f3b000cebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.387+0000 7f3af7e00640 1 --2- 172.21.15.32:0/77716071 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0014a1b0 0x7f3b0006e9f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3ae801c8a0 tx=0x7f3ae8019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.391+0000 7f3af6000640 1 -- 172.21.15.32:0/77716071 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae80b2040 con 0x7f3b0014a1b0 2024-03-19T06:22:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.391+0000 7f3af6000640 1 -- 172.21.15.32:0/77716071 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae8004020 con 0x7f3b0014a1b0 2024-03-19T06:22:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.391+0000 7f3af6000640 1 -- 172.21.15.32:0/77716071 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8004430 con 0x7f3b0014a1b0 2024-03-19T06:22:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.391+0000 7f3b04a00640 1 -- 172.21.15.32:0/77716071 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b000ac8e0 con 0x7f3b0014a1b0 2024-03-19T06:22:53.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.391+0000 7f3b04a00640 1 -- 172.21.15.32:0/77716071 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b000acea0 con 0x7f3b0014a1b0 2024-03-19T06:22:53.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.391+0000 7f3b04a00640 1 -- 172.21.15.32:0/77716071 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b000749e0 con 0x7f3b0014a1b0 2024-03-19T06:22:53.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.391+0000 7f3af6000640 1 -- 172.21.15.32:0/77716071 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3ae80bf030 con 0x7f3b0014a1b0 2024-03-19T06:22:53.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.391+0000 7f3af6000640 1 --2- 172.21.15.32:0/77716071 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3adc067660 0x7f3adc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.391+0000 7f3af6000640 1 -- 172.21.15.32:0/77716071 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f3ae811f940 con 0x7f3b0014a1b0 2024-03-19T06:22:53.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.391+0000 7f3afde00640 1 --2- 172.21.15.32:0/77716071 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3adc067660 0x7f3adc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.395+0000 7f3afde00640 1 --2- 172.21.15.32:0/77716071 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3adc067660 0x7f3adc069b20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3af0000c10 tx=0x7f3af0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:53.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.395+0000 7f3af6000640 1 -- 172.21.15.32:0/77716071 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f3ae80c6060 con 0x7f3b0014a1b0 2024-03-19T06:22:53.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.559+0000 7f3b04a00640 1 -- 172.21.15.32:0/77716071 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b000af7a0 con 0x7f3b0014a1b0 2024-03-19T06:22:53.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.559+0000 7f3af6000640 1 -- 172.21.15.32:0/77716071 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ae8016780 con 0x7f3b0014a1b0 2024-03-19T06:22:53.548 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:22:53.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.563+0000 7f3b04a00640 1 -- 172.21.15.32:0/77716071 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3adc067660 msgr2=0x7f3adc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.563+0000 7f3b04a00640 1 --2- 172.21.15.32:0/77716071 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3adc067660 0x7f3adc069b20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3af0000c10 tx=0x7f3af0009040 comp rx=0 tx=0).stop 2024-03-19T06:22:53.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.563+0000 7f3b04a00640 1 -- 172.21.15.32:0/77716071 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0014a1b0 msgr2=0x7f3b0006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.563+0000 7f3b04a00640 1 --2- 172.21.15.32:0/77716071 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0014a1b0 0x7f3b0006e9f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3ae801c8a0 tx=0x7f3ae8019810 comp rx=0 tx=0).stop 2024-03-19T06:22:53.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.563+0000 7f3b04a00640 1 -- 172.21.15.32:0/77716071 shutdown_connections 2024-03-19T06:22:53.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.563+0000 7f3b04a00640 1 --2- 172.21.15.32:0/77716071 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3adc067660 0x7f3adc069b20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.563+0000 7f3b04a00640 1 --2- 172.21.15.32:0/77716071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b00149450 0x7f3b001498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.563+0000 7f3b04a00640 1 --2- 172.21.15.32:0/77716071 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b0014a1b0 0x7f3b0006e9f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.563+0000 7f3b04a00640 1 --2- 172.21.15.32:0/77716071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ae4004810 0x7f3b000cebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.563+0000 7f3b04a00640 1 -- 172.21.15.32:0/77716071 >> 172.21.15.32:0/77716071 conn(0x7f3b000b1590 msgr2=0x7f3b000b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:53.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.563+0000 7f3b04a00640 1 -- 172.21.15.32:0/77716071 shutdown_connections 2024-03-19T06:22:53.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.563+0000 7f3b04a00640 1 -- 172.21.15.32:0/77716071 wait complete. 2024-03-19T06:22:53.570 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:22:53.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.723+0000 7ffb4ea00640 1 Processor -- start 2024-03-19T06:22:53.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.723+0000 7ffb4ea00640 1 -- start start 2024-03-19T06:22:53.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.727+0000 7ffb4ea00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffb480b3620 0x7ffb480b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.727+0000 7ffb4ea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffb480cc6c0 0x7ffb480ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.727+0000 7ffb4ea00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb480cbf00 con 0x7ffb4815dbb0 2024-03-19T06:22:53.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.727+0000 7ffb4ea00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb480b3fd0 con 0x7ffb480cc6c0 2024-03-19T06:22:53.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.727+0000 7ffb4ea00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4806cb20 con 0x7ffb480b3620 2024-03-19T06:22:53.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.727+0000 7ffb4ca00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffb480cc6c0 0x7ffb480ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.727+0000 7ffb4ca00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffb480cc6c0 0x7ffb480ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54850/0 (socket says 172.21.15.32:54850) 2024-03-19T06:22:53.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.727+0000 7ffb4ca00640 1 -- 172.21.15.32:0/1878929340 learned_addr learned my addr 172.21.15.32:0/1878929340 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:53.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.727+0000 7ffb3fe00640 1 --2- 172.21.15.32:0/1878929340 >> v2:172.21.15.171:3300/0 conn(0x7ffb480b3620 0x7ffb480b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.727+0000 7ffb4ca00640 1 -- 172.21.15.32:0/1878929340 >> v2:172.21.15.171:3300/0 conn(0x7ffb480b3620 msgr2=0x7ffb480b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:53.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.727+0000 7ffb4ca00640 1 --2- 172.21.15.32:0/1878929340 >> v2:172.21.15.171:3300/0 conn(0x7ffb480b3620 0x7ffb480b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.727+0000 7ffb4ca00640 1 -- 172.21.15.32:0/1878929340 >> v1:172.21.15.171:6789/0 conn(0x7ffb4815dbb0 legacy=0x7ffb4806c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.727+0000 7ffb4ca00640 1 -- 172.21.15.32:0/1878929340 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4806ce00 con 0x7ffb480cc6c0 2024-03-19T06:22:53.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ca00640 1 --2- 172.21.15.32:0/1878929340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb480cc6c0 0x7ffb480ccaf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ffb480cf2f0 tx=0x7ffb4001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7f1d6346ca23e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:53.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb47400640 1 -- 172.21.15.32:0/1878929340 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb400b4070 con 0x7ffb480cc6c0 2024-03-19T06:22:53.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb47400640 1 -- 172.21.15.32:0/1878929340 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb400af400 con 0x7ffb480cc6c0 2024-03-19T06:22:53.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb47400640 1 -- 172.21.15.32:0/1878929340 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb400af7d0 con 0x7ffb480cc6c0 2024-03-19T06:22:53.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ea00640 1 -- 172.21.15.32:0/1878929340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb480cc6c0 msgr2=0x7ffb480ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ea00640 1 --2- 172.21.15.32:0/1878929340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb480cc6c0 0x7ffb480ccaf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ffb480cf2f0 tx=0x7ffb4001f1e0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ea00640 1 -- 172.21.15.32:0/1878929340 shutdown_connections 2024-03-19T06:22:53.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ea00640 1 --2- 172.21.15.32:0/1878929340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb480cc6c0 0x7ffb480ccaf0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ea00640 1 --2- 172.21.15.32:0/1878929340 >> v2:172.21.15.171:3300/0 conn(0x7ffb480b3620 0x7ffb480b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ea00640 1 -- 172.21.15.32:0/1878929340 >> 172.21.15.32:0/1878929340 conn(0x7ffb48066ca0 msgr2=0x7ffb480670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:53.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ea00640 1 -- 172.21.15.32:0/1878929340 shutdown_connections 2024-03-19T06:22:53.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ea00640 1 -- 172.21.15.32:0/1878929340 wait complete. 2024-03-19T06:22:53.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ea00640 1 Processor -- start 2024-03-19T06:22:53.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ea00640 1 -- start start 2024-03-19T06:22:53.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb480b3620 0x7ffb481f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ea00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb480cc6c0 0x7ffb480b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb4815dbb0 0x7ffb481543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ea00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4806d910 con 0x7ffb480b3620 2024-03-19T06:22:53.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ea00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb480cc1a0 con 0x7ffb480cc6c0 2024-03-19T06:22:53.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.731+0000 7ffb4ea00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4815df90 con 0x7ffb4815dbb0 2024-03-19T06:22:53.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb47e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb480b3620 0x7ffb481f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb47e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb480b3620 0x7ffb481f7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54864/0 (socket says 172.21.15.32:54864) 2024-03-19T06:22:53.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb47e00640 1 -- 172.21.15.32:0/4291362324 learned_addr learned my addr 172.21.15.32:0/4291362324 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:53.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb3fe00640 1 --2- 172.21.15.32:0/4291362324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb480cc6c0 0x7ffb480b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb4ca00640 1 --2- 172.21.15.32:0/4291362324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb4815dbb0 0x7ffb481543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb47e00640 1 -- 172.21.15.32:0/4291362324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb4815dbb0 msgr2=0x7ffb481543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb47e00640 1 --2- 172.21.15.32:0/4291362324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb4815dbb0 0x7ffb481543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb47e00640 1 -- 172.21.15.32:0/4291362324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb480cc6c0 msgr2=0x7ffb480b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb47e00640 1 --2- 172.21.15.32:0/4291362324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb480cc6c0 0x7ffb480b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb47e00640 1 -- 172.21.15.32:0/4291362324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb480c5670 con 0x7ffb480b3620 2024-03-19T06:22:53.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb4ca00640 1 --2- 172.21.15.32:0/4291362324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb4815dbb0 0x7ffb481543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:53.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb47e00640 1 --2- 172.21.15.32:0/4291362324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb480b3620 0x7ffb481f7330 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800c390 tx=0x7ffb3800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:53.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb44c00640 1 -- 172.21.15.32:0/4291362324 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38017070 con 0x7ffb480b3620 2024-03-19T06:22:53.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb44c00640 1 -- 172.21.15.32:0/4291362324 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb380052f0 con 0x7ffb480b3620 2024-03-19T06:22:53.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb4ea00640 1 -- 172.21.15.32:0/4291362324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb481f35d0 con 0x7ffb480b3620 2024-03-19T06:22:53.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb44c00640 1 -- 172.21.15.32:0/4291362324 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38003840 con 0x7ffb480b3620 2024-03-19T06:22:53.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb4ea00640 1 -- 172.21.15.32:0/4291362324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb481f3b90 con 0x7ffb480b3620 2024-03-19T06:22:53.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb4ea00640 1 -- 172.21.15.32:0/4291362324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb480749e0 con 0x7ffb480b3620 2024-03-19T06:22:53.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb44c00640 1 -- 172.21.15.32:0/4291362324 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ffb3801a070 con 0x7ffb480b3620 2024-03-19T06:22:53.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.735+0000 7ffb44c00640 1 --2- 172.21.15.32:0/4291362324 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffb24067660 0x7ffb24069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:53.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.739+0000 7ffb44c00640 1 -- 172.21.15.32:0/4291362324 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7ffb38084d50 con 0x7ffb480b3620 2024-03-19T06:22:53.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.739+0000 7ffb3fe00640 1 --2- 172.21.15.32:0/4291362324 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffb24067660 0x7ffb24069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:53.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.739+0000 7ffb3fe00640 1 --2- 172.21.15.32:0/4291362324 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffb24067660 0x7ffb24069b20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffb480c6c40 tx=0x7ffb30008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:53.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.743+0000 7ffb44c00640 1 -- 172.21.15.32:0/4291362324 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7ffb38055150 con 0x7ffb480b3620 2024-03-19T06:22:53.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.903+0000 7ffb4ea00640 1 -- 172.21.15.32:0/4291362324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb4806c2b0 con 0x7ffb480b3620 2024-03-19T06:22:53.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.903+0000 7ffb44c00640 1 -- 172.21.15.32:0/4291362324 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb380591f0 con 0x7ffb480b3620 2024-03-19T06:22:53.892 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:22:53.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.903+0000 7ffb4ea00640 1 -- 172.21.15.32:0/4291362324 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffb24067660 msgr2=0x7ffb24069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.903+0000 7ffb4ea00640 1 --2- 172.21.15.32:0/4291362324 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffb24067660 0x7ffb24069b20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffb480c6c40 tx=0x7ffb30008040 comp rx=0 tx=0).stop 2024-03-19T06:22:53.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.903+0000 7ffb4ea00640 1 -- 172.21.15.32:0/4291362324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb480b3620 msgr2=0x7ffb481f7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:53.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.903+0000 7ffb4ea00640 1 --2- 172.21.15.32:0/4291362324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb480b3620 0x7ffb481f7330 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800c390 tx=0x7ffb3800c850 comp rx=0 tx=0).stop 2024-03-19T06:22:53.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.903+0000 7ffb4ea00640 1 -- 172.21.15.32:0/4291362324 shutdown_connections 2024-03-19T06:22:53.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.903+0000 7ffb4ea00640 1 --2- 172.21.15.32:0/4291362324 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffb24067660 0x7ffb24069b20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.903+0000 7ffb4ea00640 1 --2- 172.21.15.32:0/4291362324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb4815dbb0 0x7ffb481543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.903+0000 7ffb4ea00640 1 --2- 172.21.15.32:0/4291362324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb480cc6c0 0x7ffb480b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.903+0000 7ffb4ea00640 1 --2- 172.21.15.32:0/4291362324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb480b3620 0x7ffb481f7330 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:53.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.903+0000 7ffb4ea00640 1 -- 172.21.15.32:0/4291362324 >> 172.21.15.32:0/4291362324 conn(0x7ffb48066ca0 msgr2=0x7ffb48067080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:53.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.903+0000 7ffb4ea00640 1 -- 172.21.15.32:0/4291362324 shutdown_connections 2024-03-19T06:22:53.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:53.903+0000 7ffb4ea00640 1 -- 172.21.15.32:0/4291362324 wait complete. 2024-03-19T06:22:53.913 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:22:54.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.067+0000 7fd997000640 1 Processor -- start 2024-03-19T06:22:54.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.067+0000 7fd997000640 1 -- start start 2024-03-19T06:22:54.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd997000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd99015ba20 0x7fd9900af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd997000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd990160030 con 0x7fd9900cc850 2024-03-19T06:22:54.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd997000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9901602f0 con 0x7fd9900ad6d0 2024-03-19T06:22:54.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd997000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd99006b390 con 0x7fd99015ba20 2024-03-19T06:22:54.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd987e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd9900cc850 0x7fd9900acfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60470/0 (socket says 172.21.15.32:60470) 2024-03-19T06:22:54.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd987e00640 1 -- 172.21.15.32:0/2110458654 learned_addr learned my addr 172.21.15.32:0/2110458654 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:54.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98fe00640 1 --2- 172.21.15.32:0/2110458654 >> v2:172.21.15.171:3300/0 conn(0x7fd99015ba20 0x7fd9900af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98f400640 1 -- 172.21.15.32:0/2110458654 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648036196 0 0) 0x7fd990160030 con 0x7fd9900cc850 2024-03-19T06:22:54.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98f400640 1 -- 172.21.15.32:0/2110458654 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd974003530 con 0x7fd9900cc850 2024-03-19T06:22:54.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98f400640 1 -- 172.21.15.32:0/2110458654 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2175555629 0 0) 0x7fd974003530 con 0x7fd9900cc850 2024-03-19T06:22:54.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98f400640 1 -- 172.21.15.32:0/2110458654 >> v2:172.21.15.171:3300/0 conn(0x7fd99015ba20 msgr2=0x7fd9900af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:54.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98f400640 1 --2- 172.21.15.32:0/2110458654 >> v2:172.21.15.171:3300/0 conn(0x7fd99015ba20 0x7fd9900af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98f400640 1 -- 172.21.15.32:0/2110458654 >> v1:172.21.15.171:6789/0 conn(0x7fd9900ad6d0 legacy=0x7fd99006b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98f400640 1 -- 172.21.15.32:0/2110458654 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99006ad40 con 0x7fd9900cc850 2024-03-19T06:22:54.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98f400640 1 -- 172.21.15.32:0/2110458654 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fd978001680 con 0x7fd9900cc850 2024-03-19T06:22:54.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98f400640 1 -- 172.21.15.32:0/2110458654 >> v1:172.21.15.32:6789/0 conn(0x7fd9900cc850 legacy=0x7fd9900acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98f400640 1 --2- 172.21.15.32:0/2110458654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9740039c0 0x7fd974003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98f400640 1 --2- 172.21.15.32:0/2110458654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd974004810 0x7fd974004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98f400640 1 --2- 172.21.15.32:0/2110458654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9740051d0 0x7fd97400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98f400640 1 -- 172.21.15.32:0/2110458654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99006b390 con 0x7fd9740051d0 2024-03-19T06:22:54.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98f400640 1 -- 172.21.15.32:0/2110458654 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97400c0a0 con 0x7fd974004810 2024-03-19T06:22:54.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98f400640 1 -- 172.21.15.32:0/2110458654 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97400c2a0 con 0x7fd9740039c0 2024-03-19T06:22:54.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98fe00640 1 --2- 172.21.15.32:0/2110458654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9740039c0 0x7fd974003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd987e00640 1 --2- 172.21.15.32:0/2110458654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd974004810 0x7fd974004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd995000640 1 --2- 172.21.15.32:0/2110458654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9740051d0 0x7fd97400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98fe00640 1 -- 172.21.15.32:0/2110458654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd974004810 msgr2=0x7fd974004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:54.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98fe00640 1 --2- 172.21.15.32:0/2110458654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd974004810 0x7fd974004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98fe00640 1 -- 172.21.15.32:0/2110458654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9740051d0 msgr2=0x7fd97400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:54.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98fe00640 1 --2- 172.21.15.32:0/2110458654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9740051d0 0x7fd97400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd98fe00640 1 -- 172.21.15.32:0/2110458654 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd974003530 con 0x7fd9740039c0 2024-03-19T06:22:54.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.071+0000 7fd995000640 1 -- 172.21.15.32:0/2110458654 reap_dead start 2024-03-19T06:22:54.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.075+0000 7fd98fe00640 1 --2- 172.21.15.32:0/2110458654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9740039c0 0x7fd974003e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd980009b10 tx=0x7fd98001ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c089a94a1975ce4 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:54.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.075+0000 7fd98f400640 1 -- 172.21.15.32:0/2110458654 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9800b2070 con 0x7fd9740039c0 2024-03-19T06:22:54.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.075+0000 7fd98f400640 1 -- 172.21.15.32:0/2110458654 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9800a5620 con 0x7fd9740039c0 2024-03-19T06:22:54.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.075+0000 7fd98f400640 1 -- 172.21.15.32:0/2110458654 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9800096b0 con 0x7fd9740039c0 2024-03-19T06:22:54.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.075+0000 7fd997000640 1 -- 172.21.15.32:0/2110458654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9740039c0 msgr2=0x7fd974003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.075+0000 7fd997000640 1 --2- 172.21.15.32:0/2110458654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9740039c0 0x7fd974003e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd980009b10 tx=0x7fd98001ca30 comp rx=0 tx=0).stop 2024-03-19T06:22:54.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.075+0000 7fd997000640 1 -- 172.21.15.32:0/2110458654 shutdown_connections 2024-03-19T06:22:54.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.075+0000 7fd997000640 1 --2- 172.21.15.32:0/2110458654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9740039c0 0x7fd974003e00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.075+0000 7fd997000640 1 -- 172.21.15.32:0/2110458654 >> 172.21.15.32:0/2110458654 conn(0x7fd9900b2480 msgr2=0x7fd9900cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:54.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.075+0000 7fd997000640 1 -- 172.21.15.32:0/2110458654 shutdown_connections 2024-03-19T06:22:54.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.075+0000 7fd997000640 1 -- 172.21.15.32:0/2110458654 wait complete. 2024-03-19T06:22:54.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.075+0000 7fd997000640 1 Processor -- start 2024-03-19T06:22:54.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.075+0000 7fd997000640 1 -- start start 2024-03-19T06:22:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd997000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9740039c0 0x7fd9901f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd997000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd990158590 0x7fd990158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd997000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd990146320 0x7fd9901467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd997000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99006f740 con 0x7fd990146320 2024-03-19T06:22:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd997000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900adcb0 con 0x7fd9740039c0 2024-03-19T06:22:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd997000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99006f8c0 con 0x7fd990158590 2024-03-19T06:22:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd995000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd990146320 0x7fd9901467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd995000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd990146320 0x7fd9901467a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54890/0 (socket says 172.21.15.32:54890) 2024-03-19T06:22:54.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd995000640 1 -- 172.21.15.32:0/3653587417 learned_addr learned my addr 172.21.15.32:0/3653587417 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:54.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd987e00640 1 --2- 172.21.15.32:0/3653587417 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd990158590 0x7fd990158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd98fe00640 1 --2- 172.21.15.32:0/3653587417 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9740039c0 0x7fd9901f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd995000640 1 -- 172.21.15.32:0/3653587417 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd990158590 msgr2=0x7fd990158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd995000640 1 --2- 172.21.15.32:0/3653587417 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd990158590 0x7fd990158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd995000640 1 -- 172.21.15.32:0/3653587417 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9740039c0 msgr2=0x7fd9901f36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd995000640 1 --2- 172.21.15.32:0/3653587417 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9740039c0 0x7fd9901f36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd995000640 1 -- 172.21.15.32:0/3653587417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99015a860 con 0x7fd990146320 2024-03-19T06:22:54.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd995000640 1 --2- 172.21.15.32:0/3653587417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd990146320 0x7fd9901467a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd98800f770 tx=0x7fd98800fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:54.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd98cc00640 1 -- 172.21.15.32:0/3653587417 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98801a070 con 0x7fd990146320 2024-03-19T06:22:54.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd98cc00640 1 -- 172.21.15.32:0/3653587417 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98800fe80 con 0x7fd990146320 2024-03-19T06:22:54.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd98cc00640 1 -- 172.21.15.32:0/3653587417 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd988003980 con 0x7fd990146320 2024-03-19T06:22:54.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd997000640 1 -- 172.21.15.32:0/3653587417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd99015a240 con 0x7fd990146320 2024-03-19T06:22:54.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd997000640 1 -- 172.21.15.32:0/3653587417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd990159480 con 0x7fd990146320 2024-03-19T06:22:54.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd997000640 1 -- 172.21.15.32:0/3653587417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd990159d70 con 0x7fd990146320 2024-03-19T06:22:54.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.079+0000 7fd98cc00640 1 -- 172.21.15.32:0/3653587417 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd988003b20 con 0x7fd990146320 2024-03-19T06:22:54.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.083+0000 7fd98cc00640 1 --2- 172.21.15.32:0/3653587417 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd96c067660 0x7fd96c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.083+0000 7fd98cc00640 1 -- 172.21.15.32:0/3653587417 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fd988084d10 con 0x7fd990146320 2024-03-19T06:22:54.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.083+0000 7fd98fe00640 1 --2- 172.21.15.32:0/3653587417 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd96c067660 0x7fd96c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.083+0000 7fd98fe00640 1 --2- 172.21.15.32:0/3653587417 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd96c067660 0x7fd96c069b20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd9800af000 tx=0x7fd9800046d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:54.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.087+0000 7fd98cc00640 1 -- 172.21.15.32:0/3653587417 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fd99015a860 con 0x7fd990146320 2024-03-19T06:22:54.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.247+0000 7fd997000640 1 -- 172.21.15.32:0/3653587417 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd9900749e0 con 0x7fd990146320 2024-03-19T06:22:54.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.247+0000 7fd98cc00640 1 -- 172.21.15.32:0/3653587417 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd988055190 con 0x7fd990146320 2024-03-19T06:22:54.237 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:22:54.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.251+0000 7fd997000640 1 -- 172.21.15.32:0/3653587417 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd96c067660 msgr2=0x7fd96c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.251+0000 7fd997000640 1 --2- 172.21.15.32:0/3653587417 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd96c067660 0x7fd96c069b20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd9800af000 tx=0x7fd9800046d0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.251+0000 7fd997000640 1 -- 172.21.15.32:0/3653587417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd990146320 msgr2=0x7fd9901467a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.251+0000 7fd997000640 1 --2- 172.21.15.32:0/3653587417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd990146320 0x7fd9901467a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd98800f770 tx=0x7fd98800fb70 comp rx=0 tx=0).stop 2024-03-19T06:22:54.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.251+0000 7fd997000640 1 -- 172.21.15.32:0/3653587417 shutdown_connections 2024-03-19T06:22:54.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.251+0000 7fd997000640 1 --2- 172.21.15.32:0/3653587417 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd96c067660 0x7fd96c069b20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.251+0000 7fd997000640 1 --2- 172.21.15.32:0/3653587417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd990146320 0x7fd9901467a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.251+0000 7fd997000640 1 --2- 172.21.15.32:0/3653587417 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd990158590 0x7fd990158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.251+0000 7fd997000640 1 --2- 172.21.15.32:0/3653587417 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9740039c0 0x7fd9901f36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.251+0000 7fd997000640 1 -- 172.21.15.32:0/3653587417 >> 172.21.15.32:0/3653587417 conn(0x7fd9900b2480 msgr2=0x7fd9900cbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:54.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.251+0000 7fd997000640 1 -- 172.21.15.32:0/3653587417 shutdown_connections 2024-03-19T06:22:54.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.251+0000 7fd997000640 1 -- 172.21.15.32:0/3653587417 wait complete. 2024-03-19T06:22:54.258 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-03-19T06:22:54.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.411+0000 7fd375000640 1 Processor -- start 2024-03-19T06:22:54.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.411+0000 7fd375000640 1 -- start start 2024-03-19T06:22:54.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.415+0000 7fd375000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd3700c51e0 0x7fd3700cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.415+0000 7fd375000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3700cd050 con 0x7fd3700cc920 2024-03-19T06:22:54.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.415+0000 7fd375000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3700cd330 con 0x7fd3700d1620 2024-03-19T06:22:54.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.415+0000 7fd375000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3700cd610 con 0x7fd3700c51e0 2024-03-19T06:22:54.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.415+0000 7fd367e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd3700c51e0 0x7fd3700cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.415+0000 7fd36fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd3700cc920 0x7fd3700ce0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60486/0 (socket says 172.21.15.32:60486) 2024-03-19T06:22:54.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.415+0000 7fd367e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd3700c51e0 0x7fd3700cc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54898/0 (socket says 172.21.15.32:54898) 2024-03-19T06:22:54.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.415+0000 7fd36fe00640 1 -- 172.21.15.32:0/311689158 learned_addr learned my addr 172.21.15.32:0/311689158 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:54.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.415+0000 7fd367e00640 1 -- 172.21.15.32:0/311689158 >> v1:172.21.15.171:6789/0 conn(0x7fd3700d1620 legacy=0x7fd3700d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:54.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.415+0000 7fd367e00640 1 -- 172.21.15.32:0/311689158 >> v1:172.21.15.32:6789/0 conn(0x7fd3700cc920 legacy=0x7fd3700ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.415+0000 7fd367e00640 1 -- 172.21.15.32:0/311689158 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3700cd8f0 con 0x7fd3700c51e0 2024-03-19T06:22:54.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.415+0000 7fd367e00640 1 --2- 172.21.15.32:0/311689158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3700c51e0 0x7fd3700cc3e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd3580097c0 tx=0x7fd35801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608d50ffb94dd3a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:54.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd36ea00640 1 -- 172.21.15.32:0/311689158 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3580b0070 con 0x7fd3700c51e0 2024-03-19T06:22:54.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd36ea00640 1 -- 172.21.15.32:0/311689158 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3580ab600 con 0x7fd3700c51e0 2024-03-19T06:22:54.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd36ea00640 1 -- 172.21.15.32:0/311689158 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3580ab9d0 con 0x7fd3700c51e0 2024-03-19T06:22:54.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd375000640 1 -- 172.21.15.32:0/311689158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3700c51e0 msgr2=0x7fd3700cc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd375000640 1 --2- 172.21.15.32:0/311689158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3700c51e0 0x7fd3700cc3e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd3580097c0 tx=0x7fd35801c3a0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd375000640 1 -- 172.21.15.32:0/311689158 shutdown_connections 2024-03-19T06:22:54.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd375000640 1 --2- 172.21.15.32:0/311689158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3700c51e0 0x7fd3700cc3e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd375000640 1 -- 172.21.15.32:0/311689158 >> 172.21.15.32:0/311689158 conn(0x7fd37008b000 msgr2=0x7fd37008b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:54.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd375000640 1 -- 172.21.15.32:0/311689158 shutdown_connections 2024-03-19T06:22:54.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd375000640 1 -- 172.21.15.32:0/311689158 wait complete. 2024-03-19T06:22:54.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd375000640 1 Processor -- start 2024-03-19T06:22:54.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd375000640 1 -- start start 2024-03-19T06:22:54.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd375000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3700c51e0 0x7fd37014f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd375000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3700cc920 0x7fd3701514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd375000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3700d1620 0x7fd370151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd375000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37015be40 con 0x7fd3700c51e0 2024-03-19T06:22:54.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd375000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37015bcc0 con 0x7fd3700cc920 2024-03-19T06:22:54.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd375000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3701698c0 con 0x7fd3700d1620 2024-03-19T06:22:54.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd36f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3700c51e0 0x7fd37014f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd36f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3700c51e0 0x7fd37014f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54900/0 (socket says 172.21.15.32:54900) 2024-03-19T06:22:54.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.419+0000 7fd36f400640 1 -- 172.21.15.32:0/213106392 learned_addr learned my addr 172.21.15.32:0/213106392 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:54.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd36fe00640 1 --2- 172.21.15.32:0/213106392 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3700d1620 0x7fd370151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd367e00640 1 --2- 172.21.15.32:0/213106392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3700cc920 0x7fd3701514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd36f400640 1 -- 172.21.15.32:0/213106392 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3700d1620 msgr2=0x7fd370151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd36f400640 1 --2- 172.21.15.32:0/213106392 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3700d1620 0x7fd370151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd36f400640 1 -- 172.21.15.32:0/213106392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3700cc920 msgr2=0x7fd3701514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd36f400640 1 --2- 172.21.15.32:0/213106392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3700cc920 0x7fd3701514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd36f400640 1 -- 172.21.15.32:0/213106392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd370157f50 con 0x7fd3700c51e0 2024-03-19T06:22:54.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd36f400640 1 --2- 172.21.15.32:0/213106392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3700c51e0 0x7fd37014f480 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd36000b440 tx=0x7fd36000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:54.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd367400640 1 -- 172.21.15.32:0/213106392 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360015020 con 0x7fd3700c51e0 2024-03-19T06:22:54.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd367400640 1 -- 172.21.15.32:0/213106392 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd360011890 con 0x7fd3700c51e0 2024-03-19T06:22:54.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd367400640 1 -- 172.21.15.32:0/213106392 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360011c80 con 0x7fd3700c51e0 2024-03-19T06:22:54.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd375000640 1 -- 172.21.15.32:0/213106392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd370158230 con 0x7fd3700c51e0 2024-03-19T06:22:54.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd375000640 1 -- 172.21.15.32:0/213106392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3700b4c20 con 0x7fd3700c51e0 2024-03-19T06:22:54.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd375000640 1 -- 172.21.15.32:0/213106392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd370075090 con 0x7fd3700c51e0 2024-03-19T06:22:54.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd367400640 1 -- 172.21.15.32:0/213106392 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd360018020 con 0x7fd3700c51e0 2024-03-19T06:22:54.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd367400640 1 --2- 172.21.15.32:0/213106392 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd34c067660 0x7fd34c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.423+0000 7fd367400640 1 -- 172.21.15.32:0/213106392 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fd360085900 con 0x7fd3700c51e0 2024-03-19T06:22:54.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.427+0000 7fd367e00640 1 --2- 172.21.15.32:0/213106392 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd34c067660 0x7fd34c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.427+0000 7fd367e00640 1 --2- 172.21.15.32:0/213106392 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd34c067660 0x7fd34c069b20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd3580ad000 tx=0x7fd3580a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:54.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.427+0000 7fd367400640 1 -- 172.21.15.32:0/213106392 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fd36001f030 con 0x7fd3700c51e0 2024-03-19T06:22:54.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.591+0000 7fd375000640 1 -- 172.21.15.32:0/213106392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fd37008bc80 con 0x7fd3700c51e0 2024-03-19T06:22:54.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.591+0000 7fd367400640 1 -- 172.21.15.32:0/213106392 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v38) v1 ==== 97+0+11 (secure 0 0 0) 0x7fd36000d040 con 0x7fd3700c51e0 2024-03-19T06:22:54.579 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:22:54.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.591+0000 7fd375000640 1 -- 172.21.15.32:0/213106392 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd34c067660 msgr2=0x7fd34c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.591+0000 7fd375000640 1 --2- 172.21.15.32:0/213106392 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd34c067660 0x7fd34c069b20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd3580ad000 tx=0x7fd3580a6000 comp rx=0 tx=0).stop 2024-03-19T06:22:54.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.591+0000 7fd375000640 1 -- 172.21.15.32:0/213106392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3700c51e0 msgr2=0x7fd37014f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.591+0000 7fd375000640 1 --2- 172.21.15.32:0/213106392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3700c51e0 0x7fd37014f480 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd36000b440 tx=0x7fd36000b900 comp rx=0 tx=0).stop 2024-03-19T06:22:54.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.591+0000 7fd375000640 1 -- 172.21.15.32:0/213106392 shutdown_connections 2024-03-19T06:22:54.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.591+0000 7fd375000640 1 --2- 172.21.15.32:0/213106392 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd34c067660 0x7fd34c069b20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.591+0000 7fd375000640 1 --2- 172.21.15.32:0/213106392 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3700d1620 0x7fd370151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.591+0000 7fd375000640 1 --2- 172.21.15.32:0/213106392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3700cc920 0x7fd3701514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.591+0000 7fd375000640 1 --2- 172.21.15.32:0/213106392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3700c51e0 0x7fd37014f480 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.591+0000 7fd375000640 1 -- 172.21.15.32:0/213106392 >> 172.21.15.32:0/213106392 conn(0x7fd37008b000 msgr2=0x7fd3700ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:54.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.591+0000 7fd375000640 1 -- 172.21.15.32:0/213106392 shutdown_connections 2024-03-19T06:22:54.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.591+0000 7fd375000640 1 -- 172.21.15.32:0/213106392 wait complete. 2024-03-19T06:22:54.600 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:22:54.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.751+0000 7f3999600640 1 Processor -- start 2024-03-19T06:22:54.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.751+0000 7f3999600640 1 -- start start 2024-03-19T06:22:54.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.755+0000 7f3999600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3994161270 0x7f39940ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.755+0000 7f3999600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f39940cc2e0 0x7f39940cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.755+0000 7f3999600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399406ad40 con 0x7f39940cfa70 2024-03-19T06:22:54.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.755+0000 7f3999600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399406b020 con 0x7f39940cc2e0 2024-03-19T06:22:54.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.755+0000 7f3999600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399406b300 con 0x7f3994161270 2024-03-19T06:22:54.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.755+0000 7f3993400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f39940cc2e0 0x7f39940cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.755+0000 7f3993400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f39940cc2e0 0x7f39940cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54914/0 (socket says 172.21.15.32:54914) 2024-03-19T06:22:54.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.755+0000 7f3993400640 1 -- 172.21.15.32:0/3988649151 learned_addr learned my addr 172.21.15.32:0/3988649151 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:54.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.755+0000 7f3992a00640 1 --2- 172.21.15.32:0/3988649151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3994161270 0x7f39940ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.755+0000 7f3993400640 1 -- 172.21.15.32:0/3988649151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3994161270 msgr2=0x7f39940ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:54.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.755+0000 7f3993400640 1 --2- 172.21.15.32:0/3988649151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3994161270 0x7f39940ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.755+0000 7f3993400640 1 -- 172.21.15.32:0/3988649151 >> v1:172.21.15.171:6789/0 conn(0x7f39940cfa70 legacy=0x7f39940cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:54.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.755+0000 7f3993400640 1 -- 172.21.15.32:0/3988649151 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399406b5e0 con 0x7f39940cc2e0 2024-03-19T06:22:54.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.755+0000 7f3992a00640 1 --2- 172.21.15.32:0/3988649151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3994161270 0x7f39940ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:54.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.759+0000 7f3993400640 1 --2- 172.21.15.32:0/3988649151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39940cc2e0 0x7f39940cc950 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f398c009e50 tx=0x7f398c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff7b9338161877a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:54.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.759+0000 7f3992000640 1 -- 172.21.15.32:0/3988649151 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c0a5780 con 0x7f39940cc2e0 2024-03-19T06:22:54.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.759+0000 7f3992000640 1 -- 172.21.15.32:0/3988649151 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398c0a5920 con 0x7f39940cc2e0 2024-03-19T06:22:54.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.759+0000 7f3992000640 1 -- 172.21.15.32:0/3988649151 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c0a5cf0 con 0x7f39940cc2e0 2024-03-19T06:22:54.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.759+0000 7f3999600640 1 -- 172.21.15.32:0/3988649151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39940cc2e0 msgr2=0x7f39940cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.759+0000 7f3999600640 1 --2- 172.21.15.32:0/3988649151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39940cc2e0 0x7f39940cc950 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f398c009e50 tx=0x7f398c01c9f0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.759+0000 7f3999600640 1 -- 172.21.15.32:0/3988649151 shutdown_connections 2024-03-19T06:22:54.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.759+0000 7f3999600640 1 --2- 172.21.15.32:0/3988649151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39940cc2e0 0x7f39940cc950 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.759+0000 7f3999600640 1 --2- 172.21.15.32:0/3988649151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3994161270 0x7f39940ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.759+0000 7f3999600640 1 -- 172.21.15.32:0/3988649151 >> 172.21.15.32:0/3988649151 conn(0x7f39940b2250 msgr2=0x7f39940b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:54.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.759+0000 7f3999600640 1 -- 172.21.15.32:0/3988649151 shutdown_connections 2024-03-19T06:22:54.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.759+0000 7f3999600640 1 -- 172.21.15.32:0/3988649151 wait complete. 2024-03-19T06:22:54.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.759+0000 7f3999600640 1 Processor -- start 2024-03-19T06:22:54.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.759+0000 7f3999600640 1 -- start start 2024-03-19T06:22:54.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f3999600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39940cc2e0 0x7f39940b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f3999600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39940cfa70 0x7f39940ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f3999600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3994161270 0x7f3994158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f3999600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39940cda30 con 0x7f39940cfa70 2024-03-19T06:22:54.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f3999600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39940cd8b0 con 0x7f39940cc2e0 2024-03-19T06:22:54.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f3999600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39940cdbb0 con 0x7f3994161270 2024-03-19T06:22:54.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f398a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39940cfa70 0x7f39940ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f398a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39940cfa70 0x7f39940ad5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54924/0 (socket says 172.21.15.32:54924) 2024-03-19T06:22:54.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f398a000640 1 -- 172.21.15.32:0/3334273724 learned_addr learned my addr 172.21.15.32:0/3334273724 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:54.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f3992a00640 1 --2- 172.21.15.32:0/3334273724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39940cc2e0 0x7f39940b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f3993400640 1 --2- 172.21.15.32:0/3334273724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3994161270 0x7f3994158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f398a000640 1 -- 172.21.15.32:0/3334273724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3994161270 msgr2=0x7f3994158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f398a000640 1 --2- 172.21.15.32:0/3334273724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3994161270 0x7f3994158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f398a000640 1 -- 172.21.15.32:0/3334273724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39940cc2e0 msgr2=0x7f39940b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f398a000640 1 --2- 172.21.15.32:0/3334273724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39940cc2e0 0x7f39940b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f398a000640 1 -- 172.21.15.32:0/3334273724 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39940adb20 con 0x7f39940cfa70 2024-03-19T06:22:54.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f3992a00640 1 --2- 172.21.15.32:0/3334273724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39940cc2e0 0x7f39940b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:54.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f398a000640 1 --2- 172.21.15.32:0/3334273724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39940cfa70 0x7f39940ad5e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f397c00c450 tx=0x7f397c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:54.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f398b400640 1 -- 172.21.15.32:0/3334273724 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c012830 con 0x7f39940cfa70 2024-03-19T06:22:54.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f398b400640 1 -- 172.21.15.32:0/3334273724 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c017070 con 0x7f39940cfa70 2024-03-19T06:22:54.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f398b400640 1 -- 172.21.15.32:0/3334273724 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c012c30 con 0x7f39940cfa70 2024-03-19T06:22:54.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f3999600640 1 -- 172.21.15.32:0/3334273724 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39941597e0 con 0x7f39940cfa70 2024-03-19T06:22:54.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f3999600640 1 -- 172.21.15.32:0/3334273724 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399415bf70 con 0x7f39940cfa70 2024-03-19T06:22:54.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f3999600640 1 -- 172.21.15.32:0/3334273724 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39940749e0 con 0x7f39940cfa70 2024-03-19T06:22:54.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.763+0000 7f398b400640 1 -- 172.21.15.32:0/3334273724 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f397c01c460 con 0x7f39940cfa70 2024-03-19T06:22:54.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.767+0000 7f398b400640 1 --2- 172.21.15.32:0/3334273724 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3970067690 0x7f3970069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:54.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.767+0000 7f398b400640 1 -- 172.21.15.32:0/3334273724 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f397c0856f0 con 0x7f39940cfa70 2024-03-19T06:22:54.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.767+0000 7f3992a00640 1 --2- 172.21.15.32:0/3334273724 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3970067690 0x7f3970069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:54.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.767+0000 7f3992a00640 1 --2- 172.21.15.32:0/3334273724 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3970067690 0x7f3970069b50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f398400a9b0 tx=0x7f3984008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:54.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.771+0000 7f398b400640 1 -- 172.21.15.32:0/3334273724 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f397c0561d0 con 0x7f39940cfa70 2024-03-19T06:22:54.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.943+0000 7f3999600640 1 -- 172.21.15.32:0/3334273724 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f39940ca380 con 0x7f39940cfa70 2024-03-19T06:22:54.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.943+0000 7f398b400640 1 -- 172.21.15.32:0/3334273724 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7f397c055ad0 con 0x7f39940cfa70 2024-03-19T06:22:54.932 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:22:54.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.943+0000 7f3999600640 1 -- 172.21.15.32:0/3334273724 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3970067690 msgr2=0x7f3970069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.943+0000 7f3999600640 1 --2- 172.21.15.32:0/3334273724 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3970067690 0x7f3970069b50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f398400a9b0 tx=0x7f3984008040 comp rx=0 tx=0).stop 2024-03-19T06:22:54.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.947+0000 7f3999600640 1 -- 172.21.15.32:0/3334273724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39940cfa70 msgr2=0x7f39940ad5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:54.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.947+0000 7f3999600640 1 --2- 172.21.15.32:0/3334273724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39940cfa70 0x7f39940ad5e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f397c00c450 tx=0x7f397c00c910 comp rx=0 tx=0).stop 2024-03-19T06:22:54.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.947+0000 7f3999600640 1 -- 172.21.15.32:0/3334273724 shutdown_connections 2024-03-19T06:22:54.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.947+0000 7f3999600640 1 --2- 172.21.15.32:0/3334273724 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3970067690 0x7f3970069b50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.947+0000 7f3999600640 1 --2- 172.21.15.32:0/3334273724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3994161270 0x7f3994158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.947+0000 7f3999600640 1 --2- 172.21.15.32:0/3334273724 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39940cfa70 0x7f39940ad5e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.947+0000 7f3999600640 1 --2- 172.21.15.32:0/3334273724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39940cc2e0 0x7f39940b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:54.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.947+0000 7f3999600640 1 -- 172.21.15.32:0/3334273724 >> 172.21.15.32:0/3334273724 conn(0x7f39940b2250 msgr2=0x7f39940b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:54.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.947+0000 7f3999600640 1 -- 172.21.15.32:0/3334273724 shutdown_connections 2024-03-19T06:22:54.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:54.947+0000 7f3999600640 1 -- 172.21.15.32:0/3334273724 wait complete. 2024-03-19T06:22:54.953 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:22:54.953 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:22:54.962 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:22:55.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.159+0000 7fa8d0000640 1 Processor -- start 2024-03-19T06:22:55.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.159+0000 7fa8d0000640 1 -- start start 2024-03-19T06:22:55.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.163+0000 7fa8d0000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa8c806f620 0x7fa8c80cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.163+0000 7fa8d0000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa8c80b0bc0 0x7fa8c80cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.163+0000 7fa8d0000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c80cc5c0 con 0x7fa8c8099a70 2024-03-19T06:22:55.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.163+0000 7fa8d0000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c80cc860 con 0x7fa8c806f620 2024-03-19T06:22:55.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.163+0000 7fa8d0000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c80ccb40 con 0x7fa8c80b0bc0 2024-03-19T06:22:55.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.163+0000 7fa8ccc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa8c806f620 0x7fa8c80cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.163+0000 7fa8ccc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa8c806f620 0x7fa8c80cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54938/0 (socket says 172.21.15.32:54938) 2024-03-19T06:22:55.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.163+0000 7fa8ccc00640 1 -- 172.21.15.32:0/4106395634 learned_addr learned my addr 172.21.15.32:0/4106395634 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:55.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.163+0000 7fa8ce000640 1 --2- 172.21.15.32:0/4106395634 >> v2:172.21.15.171:3300/0 conn(0x7fa8c80b0bc0 0x7fa8c80cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.163+0000 7fa8ccc00640 1 -- 172.21.15.32:0/4106395634 >> v2:172.21.15.171:3300/0 conn(0x7fa8c80b0bc0 msgr2=0x7fa8c80cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:55.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.163+0000 7fa8ccc00640 1 --2- 172.21.15.32:0/4106395634 >> v2:172.21.15.171:3300/0 conn(0x7fa8c80b0bc0 0x7fa8c80cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.163+0000 7fa8ccc00640 1 -- 172.21.15.32:0/4106395634 >> v1:172.21.15.171:6789/0 conn(0x7fa8c8099a70 legacy=0x7fa8c8099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:55.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.163+0000 7fa8ccc00640 1 -- 172.21.15.32:0/4106395634 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c815bf60 con 0x7fa8c806f620 2024-03-19T06:22:55.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.167+0000 7fa8ccc00640 1 --2- 172.21.15.32:0/4106395634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8c806f620 0x7fa8c80cf710 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80b3290 tx=0x7fa8b401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50bda40861f72c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:55.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.167+0000 7fa8c7e00640 1 -- 172.21.15.32:0/4106395634 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40b0070 con 0x7fa8c806f620 2024-03-19T06:22:55.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.167+0000 7fa8c7e00640 1 -- 172.21.15.32:0/4106395634 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b40ab600 con 0x7fa8c806f620 2024-03-19T06:22:55.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.167+0000 7fa8c7e00640 1 -- 172.21.15.32:0/4106395634 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40ab9d0 con 0x7fa8c806f620 2024-03-19T06:22:55.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.167+0000 7fa8d0000640 1 -- 172.21.15.32:0/4106395634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8c806f620 msgr2=0x7fa8c80cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:55.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.167+0000 7fa8d0000640 1 --2- 172.21.15.32:0/4106395634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8c806f620 0x7fa8c80cf710 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80b3290 tx=0x7fa8b401c3c0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.167+0000 7fa8d0000640 1 -- 172.21.15.32:0/4106395634 shutdown_connections 2024-03-19T06:22:55.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.167+0000 7fa8d0000640 1 --2- 172.21.15.32:0/4106395634 >> v2:172.21.15.171:3300/0 conn(0x7fa8c80b0bc0 0x7fa8c80cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.167+0000 7fa8d0000640 1 --2- 172.21.15.32:0/4106395634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8c806f620 0x7fa8c80cf710 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.167+0000 7fa8d0000640 1 -- 172.21.15.32:0/4106395634 >> 172.21.15.32:0/4106395634 conn(0x7fa8c80b3300 msgr2=0x7fa8c80b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:55.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.167+0000 7fa8d0000640 1 -- 172.21.15.32:0/4106395634 shutdown_connections 2024-03-19T06:22:55.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.167+0000 7fa8d0000640 1 -- 172.21.15.32:0/4106395634 wait complete. 2024-03-19T06:22:55.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.167+0000 7fa8d0000640 1 Processor -- start 2024-03-19T06:22:55.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.167+0000 7fa8d0000640 1 -- start start 2024-03-19T06:22:55.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8d0000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8c806f620 0x7fa8c8166360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8d0000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8c8099a70 0x7fa8c8152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8d0000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8c80b0bc0 0x7fa8c815dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8d0000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c80cfdd0 con 0x7fa8c806f620 2024-03-19T06:22:55.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8d0000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c80cfc50 con 0x7fa8c80b0bc0 2024-03-19T06:22:55.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8d0000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8169240 con 0x7fa8c8099a70 2024-03-19T06:22:55.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8cd600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8c806f620 0x7fa8c8166360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8cd600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8c806f620 0x7fa8c8166360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54942/0 (socket says 172.21.15.32:54942) 2024-03-19T06:22:55.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8cd600640 1 -- 172.21.15.32:0/4293168967 learned_addr learned my addr 172.21.15.32:0/4293168967 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:55.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8ccc00640 1 --2- 172.21.15.32:0/4293168967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8c8099a70 0x7fa8c8152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8ce000640 1 --2- 172.21.15.32:0/4293168967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8c80b0bc0 0x7fa8c815dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8cd600640 1 -- 172.21.15.32:0/4293168967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8c8099a70 msgr2=0x7fa8c8152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:55.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8cd600640 1 --2- 172.21.15.32:0/4293168967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8c8099a70 0x7fa8c8152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8cd600640 1 -- 172.21.15.32:0/4293168967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8c80b0bc0 msgr2=0x7fa8c815dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:55.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8cd600640 1 --2- 172.21.15.32:0/4293168967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8c80b0bc0 0x7fa8c815dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8cd600640 1 -- 172.21.15.32:0/4293168967 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8152da0 con 0x7fa8c806f620 2024-03-19T06:22:55.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8ce000640 1 --2- 172.21.15.32:0/4293168967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8c80b0bc0 0x7fa8c815dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:55.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8cd600640 1 --2- 172.21.15.32:0/4293168967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8c806f620 0x7fa8c8166360 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00c480 tx=0x7fa8bc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:55.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8c5600640 1 -- 172.21.15.32:0/4293168967 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc012830 con 0x7fa8c806f620 2024-03-19T06:22:55.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8c5600640 1 -- 172.21.15.32:0/4293168967 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc017070 con 0x7fa8c806f620 2024-03-19T06:22:55.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8d0000640 1 -- 172.21.15.32:0/4293168967 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c815e1c0 con 0x7fa8c806f620 2024-03-19T06:22:55.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8c5600640 1 -- 172.21.15.32:0/4293168967 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc012c30 con 0x7fa8c806f620 2024-03-19T06:22:55.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8d0000640 1 -- 172.21.15.32:0/4293168967 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c8163a90 con 0x7fa8c806f620 2024-03-19T06:22:55.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8d0000640 1 -- 172.21.15.32:0/4293168967 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c80749e0 con 0x7fa8c806f620 2024-03-19T06:22:55.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.171+0000 7fa8c5600640 1 -- 172.21.15.32:0/4293168967 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa8bc01c460 con 0x7fa8c806f620 2024-03-19T06:22:55.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.175+0000 7fa8c5600640 1 --2- 172.21.15.32:0/4293168967 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa8a8067660 0x7fa8a8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.175+0000 7fa8c5600640 1 -- 172.21.15.32:0/4293168967 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fa8bc085720 con 0x7fa8c806f620 2024-03-19T06:22:55.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.175+0000 7fa8ccc00640 1 --2- 172.21.15.32:0/4293168967 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa8a8067660 0x7fa8a8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.175+0000 7fa8ccc00640 1 --2- 172.21.15.32:0/4293168967 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa8a8067660 0x7fa8a8069b20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40ad000 tx=0x7fa8b4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:55.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.179+0000 7fa8c5600640 1 -- 172.21.15.32:0/4293168967 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fa8bc0562a0 con 0x7fa8c806f620 2024-03-19T06:22:55.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.343+0000 7fa8d0000640 1 -- 172.21.15.32:0/4293168967 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8c80b4100 con 0x7fa8c806f620 2024-03-19T06:22:55.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.347+0000 7fa8c5600640 1 -- 172.21.15.32:0/4293168967 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18493 (secure 0 0 0) 0x7fa8bc055ba0 con 0x7fa8c806f620 2024-03-19T06:22:55.334 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:22:55.334 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":38,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:22:27.853859+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:22:09.983589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-19T06:22:11.172289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-19T06:22:25.205334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:22:55.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.347+0000 7fa8d0000640 1 -- 172.21.15.32:0/4293168967 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa8a8067660 msgr2=0x7fa8a8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:55.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.347+0000 7fa8d0000640 1 --2- 172.21.15.32:0/4293168967 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa8a8067660 0x7fa8a8069b20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40ad000 tx=0x7fa8b4008040 comp rx=0 tx=0).stop 2024-03-19T06:22:55.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.347+0000 7fa8d0000640 1 -- 172.21.15.32:0/4293168967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8c806f620 msgr2=0x7fa8c8166360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:55.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.347+0000 7fa8d0000640 1 --2- 172.21.15.32:0/4293168967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8c806f620 0x7fa8c8166360 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00c480 tx=0x7fa8bc00c940 comp rx=0 tx=0).stop 2024-03-19T06:22:55.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.347+0000 7fa8d0000640 1 -- 172.21.15.32:0/4293168967 shutdown_connections 2024-03-19T06:22:55.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.347+0000 7fa8d0000640 1 --2- 172.21.15.32:0/4293168967 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa8a8067660 0x7fa8a8069b20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.347+0000 7fa8d0000640 1 --2- 172.21.15.32:0/4293168967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8c80b0bc0 0x7fa8c815dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.347+0000 7fa8d0000640 1 --2- 172.21.15.32:0/4293168967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8c8099a70 0x7fa8c8152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.347+0000 7fa8d0000640 1 --2- 172.21.15.32:0/4293168967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8c806f620 0x7fa8c8166360 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.347+0000 7fa8d0000640 1 -- 172.21.15.32:0/4293168967 >> 172.21.15.32:0/4293168967 conn(0x7fa8c80b3300 msgr2=0x7fa8c80cff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:55.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.347+0000 7fa8d0000640 1 -- 172.21.15.32:0/4293168967 shutdown_connections 2024-03-19T06:22:55.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.347+0000 7fa8d0000640 1 -- 172.21.15.32:0/4293168967 wait complete. 2024-03-19T06:22:55.355 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:22:09.983589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:22:11.172289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2024-03-19T06:22:25.205334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:22:55.356 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:22:55.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.511+0000 7f52d6e00640 1 Processor -- start 2024-03-19T06:22:55.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.511+0000 7f52d6e00640 1 -- start start 2024-03-19T06:22:55.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.511+0000 7f52d6e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f52d006b450 0x7f52d006f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.511+0000 7f52d6e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52d00aea70 0x7f52d00ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.511+0000 7f52d6e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d00af2d0 con 0x7f52d015a840 2024-03-19T06:22:55.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.511+0000 7f52d6e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d00cdc20 con 0x7f52d006b450 2024-03-19T06:22:55.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.511+0000 7f52d6e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d015eea0 con 0x7f52d00aea70 2024-03-19T06:22:55.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.511+0000 7f52c7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f52d006b450 0x7f52d006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.511+0000 7f52c7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f52d006b450 0x7f52d006f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54958/0 (socket says 172.21.15.32:54958) 2024-03-19T06:22:55.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.511+0000 7f52c7400640 1 -- 172.21.15.32:0/2952163160 learned_addr learned my addr 172.21.15.32:0/2952163160 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:55.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.511+0000 7f52d4e00640 1 --2- 172.21.15.32:0/2952163160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52d00aea70 0x7f52d00ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.511+0000 7f52c7400640 1 -- 172.21.15.32:0/2952163160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52d00aea70 msgr2=0x7f52d00ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:55.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.511+0000 7f52c7400640 1 --2- 172.21.15.32:0/2952163160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52d00aea70 0x7f52d00ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.511+0000 7f52c7400640 1 -- 172.21.15.32:0/2952163160 >> v1:172.21.15.171:6789/0 conn(0x7f52d015a840 legacy=0x7f52d006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:55.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.511+0000 7f52c7400640 1 -- 172.21.15.32:0/2952163160 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d015f180 con 0x7f52d006b450 2024-03-19T06:22:55.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.515+0000 7f52c7400640 1 --2- 172.21.15.32:0/2952163160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d006b450 0x7f52d006f040 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009870 tx=0x7f52b801e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb999057cf6775e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:55.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.515+0000 7f52cf400640 1 -- 172.21.15.32:0/2952163160 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b80ae070 con 0x7f52d006b450 2024-03-19T06:22:55.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.515+0000 7f52cf400640 1 -- 172.21.15.32:0/2952163160 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b80a8640 con 0x7f52d006b450 2024-03-19T06:22:55.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.515+0000 7f52cf400640 1 -- 172.21.15.32:0/2952163160 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b80a8a10 con 0x7f52d006b450 2024-03-19T06:22:55.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.515+0000 7f52d6e00640 1 -- 172.21.15.32:0/2952163160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d006b450 msgr2=0x7f52d006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:55.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.515+0000 7f52d6e00640 1 --2- 172.21.15.32:0/2952163160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d006b450 0x7f52d006f040 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009870 tx=0x7f52b801e610 comp rx=0 tx=0).stop 2024-03-19T06:22:55.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.515+0000 7f52d6e00640 1 -- 172.21.15.32:0/2952163160 shutdown_connections 2024-03-19T06:22:55.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.515+0000 7f52d6e00640 1 --2- 172.21.15.32:0/2952163160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52d00aea70 0x7f52d00ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.515+0000 7f52d6e00640 1 --2- 172.21.15.32:0/2952163160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d006b450 0x7f52d006f040 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.515+0000 7f52d6e00640 1 -- 172.21.15.32:0/2952163160 >> 172.21.15.32:0/2952163160 conn(0x7f52d00b1590 msgr2=0x7f52d00b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:55.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.515+0000 7f52d6e00640 1 -- 172.21.15.32:0/2952163160 shutdown_connections 2024-03-19T06:22:55.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.515+0000 7f52d6e00640 1 -- 172.21.15.32:0/2952163160 wait complete. 2024-03-19T06:22:55.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d6e00640 1 Processor -- start 2024-03-19T06:22:55.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d6e00640 1 -- start start 2024-03-19T06:22:55.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d6e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52d006b450 0x7f52d01453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d6e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52d00aea70 0x7f52d01f6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d6e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d015a840 0x7f52d0159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d6e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00cef80 con 0x7f52d015a840 2024-03-19T06:22:55.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d6e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00cee00 con 0x7f52d006b450 2024-03-19T06:22:55.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d6e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00cf100 con 0x7f52d00aea70 2024-03-19T06:22:55.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d4e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d015a840 0x7f52d0159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52cfe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52d006b450 0x7f52d01453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d4e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d015a840 0x7f52d0159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54974/0 (socket says 172.21.15.32:54974) 2024-03-19T06:22:55.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52cfe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52d006b450 0x7f52d01453d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:45126/0 (socket says 172.21.15.32:45126) 2024-03-19T06:22:55.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d4e00640 1 -- 172.21.15.32:0/323143675 learned_addr learned my addr 172.21.15.32:0/323143675 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:55.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52c7400640 1 --2- 172.21.15.32:0/323143675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52d00aea70 0x7f52d01f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d4e00640 1 -- 172.21.15.32:0/323143675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52d00aea70 msgr2=0x7f52d01f6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:55.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d4e00640 1 --2- 172.21.15.32:0/323143675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52d00aea70 0x7f52d01f6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d4e00640 1 -- 172.21.15.32:0/323143675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52d006b450 msgr2=0x7f52d01453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:55.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d4e00640 1 --2- 172.21.15.32:0/323143675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52d006b450 0x7f52d01453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d4e00640 1 -- 172.21.15.32:0/323143675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d015c0b0 con 0x7f52d015a840 2024-03-19T06:22:55.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d4e00640 1 --2- 172.21.15.32:0/323143675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d015a840 0x7f52d0159930 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f52c8007e40 tx=0x7f52c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:55.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52ccc00640 1 -- 172.21.15.32:0/323143675 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8014620 con 0x7f52d015a840 2024-03-19T06:22:55.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52ccc00640 1 -- 172.21.15.32:0/323143675 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c8019070 con 0x7f52d015a840 2024-03-19T06:22:55.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52ccc00640 1 -- 172.21.15.32:0/323143675 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8014a20 con 0x7f52d015a840 2024-03-19T06:22:55.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d6e00640 1 -- 172.21.15.32:0/323143675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d015c390 con 0x7f52d015a840 2024-03-19T06:22:55.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d6e00640 1 -- 172.21.15.32:0/323143675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d015c950 con 0x7f52d015a840 2024-03-19T06:22:55.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.519+0000 7f52d6e00640 1 -- 172.21.15.32:0/323143675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d00749e0 con 0x7f52d015a840 2024-03-19T06:22:55.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.523+0000 7f52ccc00640 1 -- 172.21.15.32:0/323143675 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f52c8014bc0 con 0x7f52d015a840 2024-03-19T06:22:55.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.523+0000 7f52ccc00640 1 --2- 172.21.15.32:0/323143675 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f52ac067660 0x7f52ac069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.523+0000 7f52ccc00640 1 -- 172.21.15.32:0/323143675 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f52c8086270 con 0x7f52d015a840 2024-03-19T06:22:55.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.523+0000 7f52cfe00640 1 --2- 172.21.15.32:0/323143675 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f52ac067660 0x7f52ac069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.523+0000 7f52cfe00640 1 --2- 172.21.15.32:0/323143675 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f52ac067660 0x7f52ac069b20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f52d015bfa0 tx=0x7f52c0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:55.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.527+0000 7f52ccc00640 1 -- 172.21.15.32:0/323143675 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f52c8056670 con 0x7f52d015a840 2024-03-19T06:22:55.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.687+0000 7f52d6e00640 1 -- 172.21.15.32:0/323143675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52d006e6c0 con 0x7f52d015a840 2024-03-19T06:22:55.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.687+0000 7f52ccc00640 1 -- 172.21.15.32:0/323143675 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52c805a710 con 0x7f52d015a840 2024-03-19T06:22:55.678 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:22:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.691+0000 7f52d6e00640 1 -- 172.21.15.32:0/323143675 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f52ac067660 msgr2=0x7f52ac069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.691+0000 7f52d6e00640 1 --2- 172.21.15.32:0/323143675 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f52ac067660 0x7f52ac069b20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f52d015bfa0 tx=0x7f52c0009040 comp rx=0 tx=0).stop 2024-03-19T06:22:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.691+0000 7f52d6e00640 1 -- 172.21.15.32:0/323143675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d015a840 msgr2=0x7f52d0159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.691+0000 7f52d6e00640 1 --2- 172.21.15.32:0/323143675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d015a840 0x7f52d0159930 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f52c8007e40 tx=0x7f52c800e4b0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.691+0000 7f52d6e00640 1 -- 172.21.15.32:0/323143675 shutdown_connections 2024-03-19T06:22:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.691+0000 7f52d6e00640 1 --2- 172.21.15.32:0/323143675 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f52ac067660 0x7f52ac069b20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.691+0000 7f52d6e00640 1 --2- 172.21.15.32:0/323143675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52d015a840 0x7f52d0159930 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.691+0000 7f52d6e00640 1 --2- 172.21.15.32:0/323143675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52d00aea70 0x7f52d01f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.691+0000 7f52d6e00640 1 --2- 172.21.15.32:0/323143675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52d006b450 0x7f52d01453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.691+0000 7f52d6e00640 1 -- 172.21.15.32:0/323143675 >> 172.21.15.32:0/323143675 conn(0x7f52d00b1590 msgr2=0x7f52d0071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:55.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.691+0000 7f52d6e00640 1 -- 172.21.15.32:0/323143675 shutdown_connections 2024-03-19T06:22:55.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.691+0000 7f52d6e00640 1 -- 172.21.15.32:0/323143675 wait complete. 2024-03-19T06:22:55.698 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:22:55.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.851+0000 7fdf74e00640 1 Processor -- start 2024-03-19T06:22:55.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.851+0000 7fdf74e00640 1 -- start start 2024-03-19T06:22:55.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.855+0000 7fdf74e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdf7006b450 0x7fdf7006f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.855+0000 7fdf74e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf700aea70 0x7fdf700ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.855+0000 7fdf74e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf700af2d0 con 0x7fdf7015a840 2024-03-19T06:22:55.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.855+0000 7fdf74e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf700cdc20 con 0x7fdf7006b450 2024-03-19T06:22:55.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.855+0000 7fdf74e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7015eea0 con 0x7fdf700aea70 2024-03-19T06:22:55.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.855+0000 7fdf65400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdf7006b450 0x7fdf7006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.855+0000 7fdf65400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdf7006b450 0x7fdf7006f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54978/0 (socket says 172.21.15.32:54978) 2024-03-19T06:22:55.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.855+0000 7fdf6de00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdf7015a840 0x7fdf7006ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60494/0 (socket says 172.21.15.32:60494) 2024-03-19T06:22:55.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.855+0000 7fdf65400640 1 -- 172.21.15.32:0/3675977685 learned_addr learned my addr 172.21.15.32:0/3675977685 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:55.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.855+0000 7fdf6e800640 1 --2- 172.21.15.32:0/3675977685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf700aea70 0x7fdf700ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.855+0000 7fdf65400640 1 -- 172.21.15.32:0/3675977685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf700aea70 msgr2=0x7fdf700ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:55.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.855+0000 7fdf65400640 1 --2- 172.21.15.32:0/3675977685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf700aea70 0x7fdf700ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.855+0000 7fdf65400640 1 -- 172.21.15.32:0/3675977685 >> v1:172.21.15.32:6789/0 conn(0x7fdf7015a840 legacy=0x7fdf7006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:55.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.855+0000 7fdf65400640 1 -- 172.21.15.32:0/3675977685 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7015f180 con 0x7fdf7006b450 2024-03-19T06:22:55.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.859+0000 7fdf65400640 1 --2- 172.21.15.32:0/3675977685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf7006b450 0x7fdf7006f040 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdf58009870 tx=0x7fdf5801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29d88371e4038e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:55.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.859+0000 7fdf6d400640 1 -- 172.21.15.32:0/3675977685 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf580ab660 con 0x7fdf7006b450 2024-03-19T06:22:55.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.859+0000 7fdf6d400640 1 -- 172.21.15.32:0/3675977685 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf580b0070 con 0x7fdf7006b450 2024-03-19T06:22:55.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.859+0000 7fdf6d400640 1 -- 172.21.15.32:0/3675977685 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf580aba20 con 0x7fdf7006b450 2024-03-19T06:22:55.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.859+0000 7fdf74e00640 1 -- 172.21.15.32:0/3675977685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf7006b450 msgr2=0x7fdf7006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:55.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.859+0000 7fdf74e00640 1 --2- 172.21.15.32:0/3675977685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf7006b450 0x7fdf7006f040 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdf58009870 tx=0x7fdf5801c400 comp rx=0 tx=0).stop 2024-03-19T06:22:55.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.859+0000 7fdf74e00640 1 -- 172.21.15.32:0/3675977685 shutdown_connections 2024-03-19T06:22:55.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.859+0000 7fdf74e00640 1 --2- 172.21.15.32:0/3675977685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf700aea70 0x7fdf700ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.859+0000 7fdf74e00640 1 --2- 172.21.15.32:0/3675977685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf7006b450 0x7fdf7006f040 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.859+0000 7fdf74e00640 1 -- 172.21.15.32:0/3675977685 >> 172.21.15.32:0/3675977685 conn(0x7fdf700b1590 msgr2=0x7fdf700b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:55.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.859+0000 7fdf74e00640 1 -- 172.21.15.32:0/3675977685 shutdown_connections 2024-03-19T06:22:55.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.859+0000 7fdf74e00640 1 -- 172.21.15.32:0/3675977685 wait complete. 2024-03-19T06:22:55.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.859+0000 7fdf74e00640 1 Processor -- start 2024-03-19T06:22:55.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.859+0000 7fdf74e00640 1 -- start start 2024-03-19T06:22:55.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf74e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf7006b450 0x7fdf70146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf74e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf700aea70 0x7fdf70157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf74e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf7015a840 0x7fdf70149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf74e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700cef80 con 0x7fdf700aea70 2024-03-19T06:22:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf74e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700cee00 con 0x7fdf7015a840 2024-03-19T06:22:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf74e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700cf100 con 0x7fdf7006b450 2024-03-19T06:22:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf65400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf700aea70 0x7fdf70157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf65400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf700aea70 0x7fdf70157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54980/0 (socket says 172.21.15.32:54980) 2024-03-19T06:22:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf65400640 1 -- 172.21.15.32:0/3225424675 learned_addr learned my addr 172.21.15.32:0/3225424675 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf6de00640 1 --2- 172.21.15.32:0/3225424675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf7006b450 0x7fdf70146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf6e800640 1 --2- 172.21.15.32:0/3225424675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf7015a840 0x7fdf70149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf65400640 1 -- 172.21.15.32:0/3225424675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf7006b450 msgr2=0x7fdf70146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf65400640 1 --2- 172.21.15.32:0/3225424675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf7006b450 0x7fdf70146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf65400640 1 -- 172.21.15.32:0/3225424675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf7015a840 msgr2=0x7fdf70149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf65400640 1 --2- 172.21.15.32:0/3225424675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf7015a840 0x7fdf70149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf65400640 1 -- 172.21.15.32:0/3225424675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf70153de0 con 0x7fdf700aea70 2024-03-19T06:22:55.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf65400640 1 --2- 172.21.15.32:0/3225424675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf700aea70 0x7fdf70157190 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdf580ad040 tx=0x7fdf5801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:55.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf66a00640 1 -- 172.21.15.32:0/3225424675 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf580be5f0 con 0x7fdf700aea70 2024-03-19T06:22:55.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf66a00640 1 -- 172.21.15.32:0/3225424675 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf580be790 con 0x7fdf700aea70 2024-03-19T06:22:55.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf74e00640 1 -- 172.21.15.32:0/3225424675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf701540c0 con 0x7fdf700aea70 2024-03-19T06:22:55.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf66a00640 1 -- 172.21.15.32:0/3225424675 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf580beb80 con 0x7fdf700aea70 2024-03-19T06:22:55.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf74e00640 1 -- 172.21.15.32:0/3225424675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf70154680 con 0x7fdf700aea70 2024-03-19T06:22:55.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf74e00640 1 -- 172.21.15.32:0/3225424675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf700749e0 con 0x7fdf700aea70 2024-03-19T06:22:55.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.863+0000 7fdf66a00640 1 -- 172.21.15.32:0/3225424675 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fdf580b43f0 con 0x7fdf700aea70 2024-03-19T06:22:55.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.867+0000 7fdf66a00640 1 --2- 172.21.15.32:0/3225424675 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdf4c067660 0x7fdf4c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:55.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.867+0000 7fdf66a00640 1 -- 172.21.15.32:0/3225424675 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fdf581205c0 con 0x7fdf700aea70 2024-03-19T06:22:55.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.867+0000 7fdf6de00640 1 --2- 172.21.15.32:0/3225424675 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdf4c067660 0x7fdf4c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:55.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.867+0000 7fdf6de00640 1 --2- 172.21.15.32:0/3225424675 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdf4c067660 0x7fdf4c069b20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdf70154f80 tx=0x7fdf60001640 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:55.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:55.871+0000 7fdf66a00640 1 -- 172.21.15.32:0/3225424675 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fdf58016110 con 0x7fdf700aea70 2024-03-19T06:22:56.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.039+0000 7fdf74e00640 1 -- 172.21.15.32:0/3225424675 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf7006e6c0 con 0x7fdf700aea70 2024-03-19T06:22:56.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.039+0000 7fdf66a00640 1 -- 172.21.15.32:0/3225424675 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf580f0b70 con 0x7fdf700aea70 2024-03-19T06:22:56.027 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:22:56.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.039+0000 7fdf74e00640 1 -- 172.21.15.32:0/3225424675 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdf4c067660 msgr2=0x7fdf4c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.039+0000 7fdf74e00640 1 --2- 172.21.15.32:0/3225424675 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdf4c067660 0x7fdf4c069b20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdf70154f80 tx=0x7fdf60001640 comp rx=0 tx=0).stop 2024-03-19T06:22:56.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.039+0000 7fdf74e00640 1 -- 172.21.15.32:0/3225424675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf700aea70 msgr2=0x7fdf70157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.039+0000 7fdf74e00640 1 --2- 172.21.15.32:0/3225424675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf700aea70 0x7fdf70157190 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdf580ad040 tx=0x7fdf5801ac40 comp rx=0 tx=0).stop 2024-03-19T06:22:56.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.039+0000 7fdf74e00640 1 -- 172.21.15.32:0/3225424675 shutdown_connections 2024-03-19T06:22:56.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.039+0000 7fdf74e00640 1 --2- 172.21.15.32:0/3225424675 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdf4c067660 0x7fdf4c069b20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.039+0000 7fdf74e00640 1 --2- 172.21.15.32:0/3225424675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf7015a840 0x7fdf70149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.039+0000 7fdf74e00640 1 --2- 172.21.15.32:0/3225424675 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdf700aea70 0x7fdf70157190 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.039+0000 7fdf74e00640 1 --2- 172.21.15.32:0/3225424675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf7006b450 0x7fdf70146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.039+0000 7fdf74e00640 1 -- 172.21.15.32:0/3225424675 >> 172.21.15.32:0/3225424675 conn(0x7fdf700b1590 msgr2=0x7fdf70150d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:56.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.039+0000 7fdf74e00640 1 -- 172.21.15.32:0/3225424675 shutdown_connections 2024-03-19T06:22:56.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.039+0000 7fdf74e00640 1 -- 172.21.15.32:0/3225424675 wait complete. 2024-03-19T06:22:56.049 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:22:56.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.203+0000 7f70a2600640 1 Processor -- start 2024-03-19T06:22:56.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.203+0000 7f70a2600640 1 -- start start 2024-03-19T06:22:56.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f70a2600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f709c15dbb0 0x7f709c06c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f70a2600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f709c0b3d30 0x7f709c0cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f70a2600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709c0cbf00 con 0x7f709c06c5a0 2024-03-19T06:22:56.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f70a2600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c06cb20 con 0x7f709c0b3d30 2024-03-19T06:22:56.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f70a2600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c06ce00 con 0x7f709c15dbb0 2024-03-19T06:22:56.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f7092a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f709c06c5a0 0x7f709c0b3620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60510/0 (socket says 172.21.15.32:60510) 2024-03-19T06:22:56.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f7092a00640 1 -- 172.21.15.32:0/1544077385 learned_addr learned my addr 172.21.15.32:0/1544077385 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:56.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709aa00640 1 -- 172.21.15.32:0/1544077385 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988727455 0 0) 0x7f709c0cbf00 con 0x7f709c06c5a0 2024-03-19T06:22:56.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709be00640 1 --2- 172.21.15.32:0/1544077385 >> v2:172.21.15.171:3300/0 conn(0x7f709c0b3d30 0x7f709c0cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709aa00640 1 -- 172.21.15.32:0/1544077385 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7080003530 con 0x7f709c06c5a0 2024-03-19T06:22:56.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709b400640 1 --2- 172.21.15.32:0/1544077385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f709c15dbb0 0x7f709c06c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709aa00640 1 -- 172.21.15.32:0/1544077385 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3844128303 0 0) 0x7f7080003530 con 0x7f709c06c5a0 2024-03-19T06:22:56.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709aa00640 1 -- 172.21.15.32:0/1544077385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f709c15dbb0 msgr2=0x7f709c06c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:56.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709aa00640 1 --2- 172.21.15.32:0/1544077385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f709c15dbb0 0x7f709c06c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709aa00640 1 -- 172.21.15.32:0/1544077385 >> v2:172.21.15.171:3300/0 conn(0x7f709c0b3d30 msgr2=0x7f709c0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:56.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709aa00640 1 --2- 172.21.15.32:0/1544077385 >> v2:172.21.15.171:3300/0 conn(0x7f709c0b3d30 0x7f709c0cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709aa00640 1 -- 172.21.15.32:0/1544077385 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c06d0e0 con 0x7f709c06c5a0 2024-03-19T06:22:56.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709aa00640 1 -- 172.21.15.32:0/1544077385 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f70840016a0 con 0x7f709c06c5a0 2024-03-19T06:22:56.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709aa00640 1 -- 172.21.15.32:0/1544077385 >> v1:172.21.15.32:6789/0 conn(0x7f709c06c5a0 legacy=0x7f709c0b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709aa00640 1 --2- 172.21.15.32:0/1544077385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f709c15dbb0 0x7f70800039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709aa00640 1 --2- 172.21.15.32:0/1544077385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7080003f90 0x7f7080004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709aa00640 1 --2- 172.21.15.32:0/1544077385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7080004d50 0x7f70800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709aa00640 1 -- 172.21.15.32:0/1544077385 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c06cb20 con 0x7f7080004d50 2024-03-19T06:22:56.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709aa00640 1 -- 172.21.15.32:0/1544077385 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c06ce00 con 0x7f7080003f90 2024-03-19T06:22:56.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709aa00640 1 -- 172.21.15.32:0/1544077385 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708000ba50 con 0x7f709c15dbb0 2024-03-19T06:22:56.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709be00640 1 --2- 172.21.15.32:0/1544077385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7080004d50 0x7f70800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709b400640 1 --2- 172.21.15.32:0/1544077385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f709c15dbb0 0x7f70800039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f7092a00640 1 --2- 172.21.15.32:0/1544077385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7080003f90 0x7f7080004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709be00640 1 -- 172.21.15.32:0/1544077385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f709c15dbb0 msgr2=0x7f70800039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:56.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709be00640 1 --2- 172.21.15.32:0/1544077385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f709c15dbb0 0x7f70800039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709be00640 1 -- 172.21.15.32:0/1544077385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7080003f90 msgr2=0x7f7080004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:56.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709be00640 1 --2- 172.21.15.32:0/1544077385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7080003f90 0x7f7080004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.207+0000 7f709be00640 1 -- 172.21.15.32:0/1544077385 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7080003530 con 0x7f7080004d50 2024-03-19T06:22:56.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.211+0000 7f709be00640 1 --2- 172.21.15.32:0/1544077385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7080004d50 0x7f70800051d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7094009f90 tx=0x7f709401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6400327a81e4f5bb server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:56.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.211+0000 7f709aa00640 1 -- 172.21.15.32:0/1544077385 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70940b2070 con 0x7f7080004d50 2024-03-19T06:22:56.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.211+0000 7f709aa00640 1 -- 172.21.15.32:0/1544077385 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70940a5c90 con 0x7f7080004d50 2024-03-19T06:22:56.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.211+0000 7f709aa00640 1 -- 172.21.15.32:0/1544077385 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7094009c10 con 0x7f7080004d50 2024-03-19T06:22:56.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.211+0000 7f70a2600640 1 -- 172.21.15.32:0/1544077385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7080004d50 msgr2=0x7f70800051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.211+0000 7f70a2600640 1 --2- 172.21.15.32:0/1544077385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7080004d50 0x7f70800051d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7094009f90 tx=0x7f709401cc80 comp rx=0 tx=0).stop 2024-03-19T06:22:56.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.211+0000 7f709be00640 1 -- 172.21.15.32:0/1544077385 reap_dead start 2024-03-19T06:22:56.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.211+0000 7f70a2600640 1 -- 172.21.15.32:0/1544077385 shutdown_connections 2024-03-19T06:22:56.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.211+0000 7f70a2600640 1 -- 172.21.15.32:0/1544077385 >> 172.21.15.32:0/1544077385 conn(0x7f709c066ca0 msgr2=0x7f709c0670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:56.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.211+0000 7f70a2600640 1 -- 172.21.15.32:0/1544077385 shutdown_connections 2024-03-19T06:22:56.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.211+0000 7f70a2600640 1 -- 172.21.15.32:0/1544077385 wait complete. 2024-03-19T06:22:56.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f70a2600640 1 Processor -- start 2024-03-19T06:22:56.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f70a2600640 1 -- start start 2024-03-19T06:22:56.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f70a2600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7080004d50 0x7f709c152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f70a2600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f709c0cd2f0 0x7f709c0cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f70a2600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c0b5d20 0x7f709c0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f70a2600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c15df90 con 0x7f709c0b5d20 2024-03-19T06:22:56.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f70a2600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c06d910 con 0x7f709c0cd2f0 2024-03-19T06:22:56.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f70a2600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c06c060 con 0x7f7080004d50 2024-03-19T06:22:56.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f709be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c0b5d20 0x7f709c0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f709be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c0b5d20 0x7f709c0b61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54992/0 (socket says 172.21.15.32:54992) 2024-03-19T06:22:56.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f709be00640 1 -- 172.21.15.32:0/640626794 learned_addr learned my addr 172.21.15.32:0/640626794 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:56.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f7092a00640 1 --2- 172.21.15.32:0/640626794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f709c0cd2f0 0x7f709c0cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f709be00640 1 -- 172.21.15.32:0/640626794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7080004d50 msgr2=0x7f709c152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f709b400640 1 --2- 172.21.15.32:0/640626794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7080004d50 0x7f709c152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f709be00640 1 --2- 172.21.15.32:0/640626794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7080004d50 0x7f709c152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f709be00640 1 -- 172.21.15.32:0/640626794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f709c0cd2f0 msgr2=0x7f709c0cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f709be00640 1 --2- 172.21.15.32:0/640626794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f709c0cd2f0 0x7f709c0cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f709be00640 1 -- 172.21.15.32:0/640626794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c0b7310 con 0x7f709c0b5d20 2024-03-19T06:22:56.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f7092a00640 1 --2- 172.21.15.32:0/640626794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f709c0cd2f0 0x7f709c0cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:56.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f709b400640 1 --2- 172.21.15.32:0/640626794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7080004d50 0x7f709c152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:22:56.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f709be00640 1 --2- 172.21.15.32:0/640626794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c0b5d20 0x7f709c0b61a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7094009f90 tx=0x7f7094009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:56.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f7093e00640 1 -- 172.21.15.32:0/640626794 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70940b2040 con 0x7f709c0b5d20 2024-03-19T06:22:56.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f7093e00640 1 -- 172.21.15.32:0/640626794 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70940bc070 con 0x7f709c0b5d20 2024-03-19T06:22:56.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f7093e00640 1 -- 172.21.15.32:0/640626794 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7094009c10 con 0x7f709c0b5d20 2024-03-19T06:22:56.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f70a2600640 1 -- 172.21.15.32:0/640626794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c0b6a70 con 0x7f709c0b5d20 2024-03-19T06:22:56.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f70a2600640 1 -- 172.21.15.32:0/640626794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c0b7030 con 0x7f709c0b5d20 2024-03-19T06:22:56.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.215+0000 7f70a2600640 1 -- 172.21.15.32:0/640626794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c0cdc90 con 0x7f709c0b5d20 2024-03-19T06:22:56.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.219+0000 7f7093e00640 1 -- 172.21.15.32:0/640626794 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f70940aeb40 con 0x7f709c0b5d20 2024-03-19T06:22:56.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.219+0000 7f7093e00640 1 --2- 172.21.15.32:0/640626794 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f70780676e0 0x7f7078069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.219+0000 7f7093e00640 1 -- 172.21.15.32:0/640626794 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f7094120440 con 0x7f709c0b5d20 2024-03-19T06:22:56.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.219+0000 7f709b400640 1 --2- 172.21.15.32:0/640626794 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f70780676e0 0x7f7078069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.219+0000 7f709b400640 1 --2- 172.21.15.32:0/640626794 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f70780676e0 0x7f7078069ba0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f708c009ad0 tx=0x7f708c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:56.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.223+0000 7f7093e00640 1 -- 172.21.15.32:0/640626794 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f7094016990 con 0x7f709c0b5d20 2024-03-19T06:22:56.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.395+0000 7f70a2600640 1 -- 172.21.15.32:0/640626794 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f709c0b0a50 con 0x7f709c0b5d20 2024-03-19T06:22:56.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.395+0000 7f7093e00640 1 -- 172.21.15.32:0/640626794 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f70940f0fa0 con 0x7f709c0b5d20 2024-03-19T06:22:56.385 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:22:56.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.399+0000 7f70a2600640 1 -- 172.21.15.32:0/640626794 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f70780676e0 msgr2=0x7f7078069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.399+0000 7f70a2600640 1 --2- 172.21.15.32:0/640626794 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f70780676e0 0x7f7078069ba0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f708c009ad0 tx=0x7f708c008040 comp rx=0 tx=0).stop 2024-03-19T06:22:56.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.399+0000 7f70a2600640 1 -- 172.21.15.32:0/640626794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c0b5d20 msgr2=0x7f709c0b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.399+0000 7f70a2600640 1 --2- 172.21.15.32:0/640626794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c0b5d20 0x7f709c0b61a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7094009f90 tx=0x7f7094009750 comp rx=0 tx=0).stop 2024-03-19T06:22:56.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.399+0000 7f70a2600640 1 -- 172.21.15.32:0/640626794 shutdown_connections 2024-03-19T06:22:56.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.399+0000 7f70a2600640 1 --2- 172.21.15.32:0/640626794 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f70780676e0 0x7f7078069ba0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.399+0000 7f70a2600640 1 --2- 172.21.15.32:0/640626794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f709c0b5d20 0x7f709c0b61a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.399+0000 7f70a2600640 1 --2- 172.21.15.32:0/640626794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f709c0cd2f0 0x7f709c0cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.399+0000 7f70a2600640 1 --2- 172.21.15.32:0/640626794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7080004d50 0x7f709c152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.399+0000 7f70a2600640 1 -- 172.21.15.32:0/640626794 >> 172.21.15.32:0/640626794 conn(0x7f709c066ca0 msgr2=0x7f709c15bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:56.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.399+0000 7f70a2600640 1 -- 172.21.15.32:0/640626794 shutdown_connections 2024-03-19T06:22:56.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.399+0000 7f70a2600640 1 -- 172.21.15.32:0/640626794 wait complete. 2024-03-19T06:22:56.406 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-03-19T06:22:56.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.559+0000 7f2ec2400640 1 Processor -- start 2024-03-19T06:22:56.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.559+0000 7f2ec2400640 1 -- start start 2024-03-19T06:22:56.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.563+0000 7f2ec2400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ebc06b450 0x7f2ebc06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.563+0000 7f2ec2400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2ebc0aea70 0x7f2ebc0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.563+0000 7f2ec2400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ebc0af2d0 con 0x7f2ebc15a840 2024-03-19T06:22:56.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.563+0000 7f2ec2400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ebc0cdc20 con 0x7f2ebc0aea70 2024-03-19T06:22:56.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.563+0000 7f2ec2400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc15eea0 con 0x7f2ebc06b450 2024-03-19T06:22:56.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.563+0000 7f2ebb400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2ebc15a840 0x7f2ebc06ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60512/0 (socket says 172.21.15.32:60512) 2024-03-19T06:22:56.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.563+0000 7f2ebb400640 1 -- 172.21.15.32:0/1208995992 learned_addr learned my addr 172.21.15.32:0/1208995992 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:22:56.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.563+0000 7f2ebbe00640 1 --2- 172.21.15.32:0/1208995992 >> v2:172.21.15.171:3300/0 conn(0x7f2ebc0aea70 0x7f2ebc0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.563+0000 7f2eb2a00640 1 --2- 172.21.15.32:0/1208995992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ebc06b450 0x7f2ebc06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.563+0000 7f2ebaa00640 1 -- 172.21.15.32:0/1208995992 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815097471 0 0) 0x7f2ebc0af2d0 con 0x7f2ebc15a840 2024-03-19T06:22:56.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.563+0000 7f2ebaa00640 1 -- 172.21.15.32:0/1208995992 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ea0003530 con 0x7f2ebc15a840 2024-03-19T06:22:56.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.563+0000 7f2ebbe00640 1 -- 172.21.15.32:0/1208995992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ebc06b450 msgr2=0x7f2ebc06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:56.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.563+0000 7f2ebbe00640 1 --2- 172.21.15.32:0/1208995992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ebc06b450 0x7f2ebc06f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.563+0000 7f2ebbe00640 1 -- 172.21.15.32:0/1208995992 >> v1:172.21.15.32:6789/0 conn(0x7f2ebc15a840 legacy=0x7f2ebc06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.563+0000 7f2ebbe00640 1 -- 172.21.15.32:0/1208995992 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc15f180 con 0x7f2ebc0aea70 2024-03-19T06:22:56.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.563+0000 7f2eb2a00640 1 --2- 172.21.15.32:0/1208995992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ebc06b450 0x7f2ebc06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:22:56.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.567+0000 7f2ebbe00640 1 --2- 172.21.15.32:0/1208995992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ebc0aea70 0x7f2ebc0ce0b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4009d90 tx=0x7f2eb401c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcc2de2ec8091566 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:56.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.567+0000 7f2ebaa00640 1 -- 172.21.15.32:0/1208995992 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40b2070 con 0x7f2ebc0aea70 2024-03-19T06:22:56.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.567+0000 7f2ebaa00640 1 -- 172.21.15.32:0/1208995992 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb40a5930 con 0x7f2ebc0aea70 2024-03-19T06:22:56.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.567+0000 7f2ebaa00640 1 -- 172.21.15.32:0/1208995992 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40a5d00 con 0x7f2ebc0aea70 2024-03-19T06:22:56.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.567+0000 7f2ec2400640 1 -- 172.21.15.32:0/1208995992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ebc0aea70 msgr2=0x7f2ebc0ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.567+0000 7f2ec2400640 1 --2- 172.21.15.32:0/1208995992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ebc0aea70 0x7f2ebc0ce0b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4009d90 tx=0x7f2eb401c810 comp rx=0 tx=0).stop 2024-03-19T06:22:56.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.567+0000 7f2ec2400640 1 -- 172.21.15.32:0/1208995992 shutdown_connections 2024-03-19T06:22:56.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.567+0000 7f2ec2400640 1 --2- 172.21.15.32:0/1208995992 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ebc06b450 0x7f2ebc06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.567+0000 7f2ec2400640 1 --2- 172.21.15.32:0/1208995992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ebc0aea70 0x7f2ebc0ce0b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.567+0000 7f2ec2400640 1 -- 172.21.15.32:0/1208995992 >> 172.21.15.32:0/1208995992 conn(0x7f2ebc0b1590 msgr2=0x7f2ebc0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:56.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.567+0000 7f2ec2400640 1 -- 172.21.15.32:0/1208995992 shutdown_connections 2024-03-19T06:22:56.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.567+0000 7f2ec2400640 1 -- 172.21.15.32:0/1208995992 wait complete. 2024-03-19T06:22:56.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.567+0000 7f2ec2400640 1 Processor -- start 2024-03-19T06:22:56.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.567+0000 7f2ec2400640 1 -- start start 2024-03-19T06:22:56.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ec2400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ebc06b450 0x7f2ebc1524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ec2400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ebc0aea70 0x7f2ebc156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ec2400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ebc15a840 0x7f2ebc156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ec2400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0cef80 con 0x7f2ebc06b450 2024-03-19T06:22:56.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ec2400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0cee00 con 0x7f2ebc0aea70 2024-03-19T06:22:56.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ec2400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0cf100 con 0x7f2ebc15a840 2024-03-19T06:22:56.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ebb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ebc06b450 0x7f2ebc1524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ebb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ebc06b450 0x7f2ebc1524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55006/0 (socket says 172.21.15.32:55006) 2024-03-19T06:22:56.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ebb400640 1 -- 172.21.15.32:0/1098675394 learned_addr learned my addr 172.21.15.32:0/1098675394 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:56.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2eb2a00640 1 --2- 172.21.15.32:0/1098675394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ebc0aea70 0x7f2ebc156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ebbe00640 1 --2- 172.21.15.32:0/1098675394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ebc15a840 0x7f2ebc156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ebb400640 1 -- 172.21.15.32:0/1098675394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ebc15a840 msgr2=0x7f2ebc156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ebb400640 1 --2- 172.21.15.32:0/1098675394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ebc15a840 0x7f2ebc156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ebb400640 1 -- 172.21.15.32:0/1098675394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ebc0aea70 msgr2=0x7f2ebc156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ebb400640 1 --2- 172.21.15.32:0/1098675394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ebc0aea70 0x7f2ebc156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ebb400640 1 -- 172.21.15.32:0/1098675394 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc1529e0 con 0x7f2ebc06b450 2024-03-19T06:22:56.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ebb400640 1 --2- 172.21.15.32:0/1098675394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ebc06b450 0x7f2ebc1524a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00c450 tx=0x7f2eac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:56.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2eb3e00640 1 -- 172.21.15.32:0/1098675394 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac017070 con 0x7f2ebc06b450 2024-03-19T06:22:56.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2eb3e00640 1 -- 172.21.15.32:0/1098675394 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac005cf0 con 0x7f2ebc06b450 2024-03-19T06:22:56.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ec2400640 1 -- 172.21.15.32:0/1098675394 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ebc1570b0 con 0x7f2ebc06b450 2024-03-19T06:22:56.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2eb3e00640 1 -- 172.21.15.32:0/1098675394 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0072f0 con 0x7f2ebc06b450 2024-03-19T06:22:56.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ec2400640 1 -- 172.21.15.32:0/1098675394 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ebc157660 con 0x7f2ebc06b450 2024-03-19T06:22:56.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2ec2400640 1 -- 172.21.15.32:0/1098675394 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ebc0749e0 con 0x7f2ebc06b450 2024-03-19T06:22:56.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.571+0000 7f2eb3e00640 1 -- 172.21.15.32:0/1098675394 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2eac01a070 con 0x7f2ebc06b450 2024-03-19T06:22:56.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.575+0000 7f2eb3e00640 1 --2- 172.21.15.32:0/1098675394 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e98067660 0x7f2e98069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.575+0000 7f2eb3e00640 1 -- 172.21.15.32:0/1098675394 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f2eac084e90 con 0x7f2ebc06b450 2024-03-19T06:22:56.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.575+0000 7f2eb2a00640 1 --2- 172.21.15.32:0/1098675394 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e98067660 0x7f2e98069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.575+0000 7f2eb2a00640 1 --2- 172.21.15.32:0/1098675394 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e98067660 0x7f2e98069b20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009580 tx=0x7f2ea4009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:56.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.579+0000 7f2eb3e00640 1 -- 172.21.15.32:0/1098675394 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2eac055290 con 0x7f2ebc06b450 2024-03-19T06:22:56.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.739+0000 7f2ec2400640 1 -- 172.21.15.32:0/1098675394 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f2ebc06e6c0 con 0x7f2ebc06b450 2024-03-19T06:22:56.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.739+0000 7f2eb3e00640 1 -- 172.21.15.32:0/1098675394 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v38) v1 ==== 97+0+11 (secure 0 0 0) 0x7f2eac086020 con 0x7f2ebc06b450 2024-03-19T06:22:56.728 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:22:56.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.739+0000 7f2ec2400640 1 -- 172.21.15.32:0/1098675394 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e98067660 msgr2=0x7f2e98069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.739+0000 7f2ec2400640 1 --2- 172.21.15.32:0/1098675394 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e98067660 0x7f2e98069b20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009580 tx=0x7f2ea4009190 comp rx=0 tx=0).stop 2024-03-19T06:22:56.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.739+0000 7f2ec2400640 1 -- 172.21.15.32:0/1098675394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ebc06b450 msgr2=0x7f2ebc1524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.739+0000 7f2ec2400640 1 --2- 172.21.15.32:0/1098675394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ebc06b450 0x7f2ebc1524a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00c450 tx=0x7f2eac00c910 comp rx=0 tx=0).stop 2024-03-19T06:22:56.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.743+0000 7f2ec2400640 1 -- 172.21.15.32:0/1098675394 shutdown_connections 2024-03-19T06:22:56.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.743+0000 7f2ec2400640 1 --2- 172.21.15.32:0/1098675394 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2e98067660 0x7f2e98069b20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.743+0000 7f2ec2400640 1 --2- 172.21.15.32:0/1098675394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ebc15a840 0x7f2ebc156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.743+0000 7f2ec2400640 1 --2- 172.21.15.32:0/1098675394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ebc0aea70 0x7f2ebc156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.743+0000 7f2ec2400640 1 --2- 172.21.15.32:0/1098675394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ebc06b450 0x7f2ebc1524a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.743+0000 7f2ec2400640 1 -- 172.21.15.32:0/1098675394 >> 172.21.15.32:0/1098675394 conn(0x7f2ebc0b1590 msgr2=0x7f2ebc0ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:56.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.743+0000 7f2ec2400640 1 -- 172.21.15.32:0/1098675394 shutdown_connections 2024-03-19T06:22:56.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.743+0000 7f2ec2400640 1 -- 172.21.15.32:0/1098675394 wait complete. 2024-03-19T06:22:56.748 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:22:56.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.899+0000 7f308fc00640 1 Processor -- start 2024-03-19T06:22:56.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.899+0000 7f308fc00640 1 -- start start 2024-03-19T06:22:56.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.903+0000 7f308fc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f308815c010 0x7f308815f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.903+0000 7f308fc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f308806d6c0 0x7f308806db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.903+0000 7f308fc00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f308815fe20 con 0x7f30880aecf0 2024-03-19T06:22:56.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.903+0000 7f308fc00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f308806e070 con 0x7f308806d6c0 2024-03-19T06:22:56.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.903+0000 7f308fc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30881603e0 con 0x7f308815c010 2024-03-19T06:22:56.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.903+0000 7f308dc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f308806d6c0 0x7f308806db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.903+0000 7f308dc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f308806d6c0 0x7f308806db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55010/0 (socket says 172.21.15.32:55010) 2024-03-19T06:22:56.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.903+0000 7f308dc00640 1 -- 172.21.15.32:0/1393388895 learned_addr learned my addr 172.21.15.32:0/1393388895 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:56.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.903+0000 7f3087e00640 1 --2- 172.21.15.32:0/1393388895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f308815c010 0x7f308815f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.903+0000 7f308dc00640 1 -- 172.21.15.32:0/1393388895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f308815c010 msgr2=0x7f308815f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:22:56.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.903+0000 7f308dc00640 1 --2- 172.21.15.32:0/1393388895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f308815c010 0x7f308815f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.903+0000 7f308dc00640 1 -- 172.21.15.32:0/1393388895 >> v1:172.21.15.171:6789/0 conn(0x7f30880aecf0 legacy=0x7f30880ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.903+0000 7f308dc00640 1 -- 172.21.15.32:0/1393388895 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3088160100 con 0x7f308806d6c0 2024-03-19T06:22:56.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.907+0000 7f308dc00640 1 --2- 172.21.15.32:0/1393388895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f308806d6c0 0x7f308806db30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3080009e50 tx=0x7f308001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5dcbbf926021c6c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:56.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.907+0000 7f3087400640 1 -- 172.21.15.32:0/1393388895 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30800a5770 con 0x7f308806d6c0 2024-03-19T06:22:56.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.907+0000 7f3087400640 1 -- 172.21.15.32:0/1393388895 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30800a5910 con 0x7f308806d6c0 2024-03-19T06:22:56.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.907+0000 7f3087400640 1 -- 172.21.15.32:0/1393388895 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30800a5ce0 con 0x7f308806d6c0 2024-03-19T06:22:56.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.907+0000 7f308fc00640 1 -- 172.21.15.32:0/1393388895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f308806d6c0 msgr2=0x7f308806db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.907+0000 7f308fc00640 1 --2- 172.21.15.32:0/1393388895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f308806d6c0 0x7f308806db30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3080009e50 tx=0x7f308001c9a0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.907+0000 7f308fc00640 1 -- 172.21.15.32:0/1393388895 shutdown_connections 2024-03-19T06:22:56.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.907+0000 7f308fc00640 1 --2- 172.21.15.32:0/1393388895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f308806d6c0 0x7f308806db30 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.907+0000 7f308fc00640 1 --2- 172.21.15.32:0/1393388895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f308815c010 0x7f308815f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.907+0000 7f308fc00640 1 -- 172.21.15.32:0/1393388895 >> 172.21.15.32:0/1393388895 conn(0x7f30880b1280 msgr2=0x7f30880b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:56.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.907+0000 7f308fc00640 1 -- 172.21.15.32:0/1393388895 shutdown_connections 2024-03-19T06:22:56.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.907+0000 7f308fc00640 1 -- 172.21.15.32:0/1393388895 wait complete. 2024-03-19T06:22:56.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.907+0000 7f308fc00640 1 Processor -- start 2024-03-19T06:22:56.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.907+0000 7f308fc00640 1 -- start start 2024-03-19T06:22:56.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308fc00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f308806d6c0 0x7f3088163180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308fc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30880aecf0 0x7f3088160630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308fc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f308815c010 0x7f30881613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308fc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30880cbde0 con 0x7f308815c010 2024-03-19T06:22:56.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308fc00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30880cbc60 con 0x7f308806d6c0 2024-03-19T06:22:56.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308fc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3088168690 con 0x7f30880aecf0 2024-03-19T06:22:56.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f308815c010 0x7f30881613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308dc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f308815c010 0x7f30881613c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55012/0 (socket says 172.21.15.32:55012) 2024-03-19T06:22:56.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308dc00640 1 -- 172.21.15.32:0/2419327451 learned_addr learned my addr 172.21.15.32:0/2419327451 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:22:56.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f3087e00640 1 --2- 172.21.15.32:0/2419327451 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30880aecf0 0x7f3088160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308d200640 1 --2- 172.21.15.32:0/2419327451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f308806d6c0 0x7f3088163180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308dc00640 1 -- 172.21.15.32:0/2419327451 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30880aecf0 msgr2=0x7f3088160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308dc00640 1 --2- 172.21.15.32:0/2419327451 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30880aecf0 0x7f3088160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308dc00640 1 -- 172.21.15.32:0/2419327451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f308806d6c0 msgr2=0x7f3088163180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:56.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308dc00640 1 --2- 172.21.15.32:0/2419327451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f308806d6c0 0x7f3088163180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:56.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308dc00640 1 -- 172.21.15.32:0/2419327451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30881636c0 con 0x7f308815c010 2024-03-19T06:22:56.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308d200640 1 --2- 172.21.15.32:0/2419327451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f308806d6c0 0x7f3088163180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:22:56.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308dc00640 1 --2- 172.21.15.32:0/2419327451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f308815c010 0x7f30881613c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f308001a5d0 tx=0x7f3080019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:56.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f3084c00640 1 -- 172.21.15.32:0/2419327451 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30800bc020 con 0x7f308815c010 2024-03-19T06:22:56.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f3084c00640 1 -- 172.21.15.32:0/2419327451 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30800b86b0 con 0x7f308815c010 2024-03-19T06:22:56.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f3084c00640 1 -- 172.21.15.32:0/2419327451 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30800b8aa0 con 0x7f308815c010 2024-03-19T06:22:56.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308fc00640 1 -- 172.21.15.32:0/2419327451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30880cd4c0 con 0x7f308815c010 2024-03-19T06:22:56.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308fc00640 1 -- 172.21.15.32:0/2419327451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30880cda80 con 0x7f308815c010 2024-03-19T06:22:56.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f308fc00640 1 -- 172.21.15.32:0/2419327451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30880749e0 con 0x7f308815c010 2024-03-19T06:22:56.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.911+0000 7f3084c00640 1 -- 172.21.15.32:0/2419327451 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f30800bf020 con 0x7f308815c010 2024-03-19T06:22:56.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.915+0000 7f3084c00640 1 --2- 172.21.15.32:0/2419327451 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3068067660 0x7f3068069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:22:56.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.915+0000 7f3084c00640 1 -- 172.21.15.32:0/2419327451 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f3080120b50 con 0x7f308815c010 2024-03-19T06:22:56.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.915+0000 7f308d200640 1 --2- 172.21.15.32:0/2419327451 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3068067660 0x7f3068069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:22:56.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.915+0000 7f308d200640 1 --2- 172.21.15.32:0/2419327451 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3068067660 0x7f3068069b20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f307c001670 tx=0x7f307c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:22:56.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:56.919+0000 7f3084c00640 1 -- 172.21.15.32:0/2419327451 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f3080016620 con 0x7f308815c010 2024-03-19T06:22:57.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:57.091+0000 7f308fc00640 1 -- 172.21.15.32:0/2419327451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f308806c310 con 0x7f308815c010 2024-03-19T06:22:57.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:57.091+0000 7f3084c00640 1 -- 172.21.15.32:0/2419327451 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7f30800f1630 con 0x7f308815c010 2024-03-19T06:22:57.080 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:22:57.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:57.095+0000 7f308fc00640 1 -- 172.21.15.32:0/2419327451 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3068067660 msgr2=0x7f3068069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:57.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:57.095+0000 7f308fc00640 1 --2- 172.21.15.32:0/2419327451 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3068067660 0x7f3068069b20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f307c001670 tx=0x7f307c009040 comp rx=0 tx=0).stop 2024-03-19T06:22:57.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:57.095+0000 7f308fc00640 1 -- 172.21.15.32:0/2419327451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f308815c010 msgr2=0x7f30881613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:22:57.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:57.095+0000 7f308fc00640 1 --2- 172.21.15.32:0/2419327451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f308815c010 0x7f30881613c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f308001a5d0 tx=0x7f3080019740 comp rx=0 tx=0).stop 2024-03-19T06:22:57.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:57.095+0000 7f308fc00640 1 -- 172.21.15.32:0/2419327451 shutdown_connections 2024-03-19T06:22:57.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:57.095+0000 7f308fc00640 1 --2- 172.21.15.32:0/2419327451 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3068067660 0x7f3068069b20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:57.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:57.095+0000 7f308fc00640 1 --2- 172.21.15.32:0/2419327451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f308815c010 0x7f30881613c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:57.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:57.095+0000 7f308fc00640 1 --2- 172.21.15.32:0/2419327451 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30880aecf0 0x7f3088160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:57.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:57.095+0000 7f308fc00640 1 --2- 172.21.15.32:0/2419327451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f308806d6c0 0x7f3088163180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:22:57.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:57.095+0000 7f308fc00640 1 -- 172.21.15.32:0/2419327451 >> 172.21.15.32:0/2419327451 conn(0x7f30880b1280 msgr2=0x7f308815d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:22:57.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:57.095+0000 7f308fc00640 1 -- 172.21.15.32:0/2419327451 shutdown_connections 2024-03-19T06:22:57.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:22:57.095+0000 7f308fc00640 1 -- 172.21.15.32:0/2419327451 wait complete. 2024-03-19T06:22:57.100 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi032.front.sepia.ceph.com... 2024-03-19T06:22:57.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:22:57.101 DEBUG:teuthology.orchestra.run.smithi032:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-19T06:22:57.118 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[37415]: fuse finished with error 0 and tester_r 0 2024-03-19T06:22:57.121 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:23:03.223 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:23:03.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:03.224 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-19T06:23:03.234 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2024-03-19T06:23:03.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0c0200640 1 Processor -- start 2024-03-19T06:23:03.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0c0200640 1 -- start start 2024-03-19T06:23:03.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0c0200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe0b806e320 0x7fe0b815bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:03.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0c0200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b80cc290 con 0x7fe0b806eed0 2024-03-19T06:23:03.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0c0200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b80cc570 con 0x7fe0b806ad40 2024-03-19T06:23:03.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0c0200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b80cd420 con 0x7fe0b806e320 2024-03-19T06:23:03.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0bce00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe0b806eed0 0x7fe0b80ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:60526/0 (socket says 172.21.15.32:60526) 2024-03-19T06:23:03.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0bce00640 1 -- 172.21.15.32:0/544747551 learned_addr learned my addr 172.21.15.32:0/544747551 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0be200640 1 --2- 172.21.15.32:0/544747551 >> v2:172.21.15.171:3300/0 conn(0x7fe0b806e320 0x7fe0b815bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 -- 172.21.15.32:0/544747551 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410303605 0 0) 0x7fe0b80cc290 con 0x7fe0b806eed0 2024-03-19T06:23:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 -- 172.21.15.32:0/544747551 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0a0003530 con 0x7fe0b806eed0 2024-03-19T06:23:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 -- 172.21.15.32:0/544747551 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945069386 0 0) 0x7fe0b80cc570 con 0x7fe0b806ad40 2024-03-19T06:23:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 -- 172.21.15.32:0/544747551 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0b80cc290 con 0x7fe0b806ad40 2024-03-19T06:23:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 -- 172.21.15.32:0/544747551 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 922339884 0 0) 0x7fe0a0003530 con 0x7fe0b806eed0 2024-03-19T06:23:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 -- 172.21.15.32:0/544747551 >> v2:172.21.15.171:3300/0 conn(0x7fe0b806e320 msgr2=0x7fe0b815bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 --2- 172.21.15.32:0/544747551 >> v2:172.21.15.171:3300/0 conn(0x7fe0b806e320 0x7fe0b815bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 -- 172.21.15.32:0/544747551 >> v1:172.21.15.171:6789/0 conn(0x7fe0b806ad40 legacy=0x7fe0b806b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 -- 172.21.15.32:0/544747551 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b80cc850 con 0x7fe0b806eed0 2024-03-19T06:23:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 -- 172.21.15.32:0/544747551 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fe0a4001680 con 0x7fe0b806eed0 2024-03-19T06:23:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 -- 172.21.15.32:0/544747551 >> v1:172.21.15.32:6789/0 conn(0x7fe0b806eed0 legacy=0x7fe0b80ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 --2- 172.21.15.32:0/544747551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a0003b50 0x7fe0a0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 --2- 172.21.15.32:0/544747551 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0a0004810 0x7fe0a0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 --2- 172.21.15.32:0/544747551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0a00051d0 0x7fe0a000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 -- 172.21.15.32:0/544747551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b80cd420 con 0x7fe0a0003b50 2024-03-19T06:23:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 -- 172.21.15.32:0/544747551 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a000c100 con 0x7fe0a00051d0 2024-03-19T06:23:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0b7e00640 1 -- 172.21.15.32:0/544747551 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a000c300 con 0x7fe0a0004810 2024-03-19T06:23:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0bd800640 1 --2- 172.21.15.32:0/544747551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a0003b50 0x7fe0a0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0be200640 1 --2- 172.21.15.32:0/544747551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0a00051d0 0x7fe0a000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0bce00640 1 --2- 172.21.15.32:0/544747551 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0a0004810 0x7fe0a0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0bd800640 1 -- 172.21.15.32:0/544747551 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0a0004810 msgr2=0x7fe0a0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0bd800640 1 --2- 172.21.15.32:0/544747551 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0a0004810 0x7fe0a0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0bd800640 1 -- 172.21.15.32:0/544747551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0a00051d0 msgr2=0x7fe0a000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0bd800640 1 --2- 172.21.15.32:0/544747551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0a00051d0 0x7fe0a000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0bd800640 1 -- 172.21.15.32:0/544747551 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0003530 con 0x7fe0a0003b50 2024-03-19T06:23:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.451+0000 7fe0be200640 1 -- 172.21.15.32:0/544747551 reap_dead start 2024-03-19T06:23:03.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.455+0000 7fe0bd800640 1 --2- 172.21.15.32:0/544747551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a0003b50 0x7fe0a0003f50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0018d0 tx=0x7fe0ac01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0c4b5ea4218317 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:03.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.455+0000 7fe0b7e00640 1 -- 172.21.15.32:0/544747551 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac001520 con 0x7fe0a0003b50 2024-03-19T06:23:03.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.455+0000 7fe0b7e00640 1 -- 172.21.15.32:0/544747551 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac0052f0 con 0x7fe0a0003b50 2024-03-19T06:23:03.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.455+0000 7fe0b7e00640 1 -- 172.21.15.32:0/544747551 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac003840 con 0x7fe0a0003b50 2024-03-19T06:23:03.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.455+0000 7fe0c0200640 1 -- 172.21.15.32:0/544747551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a0003b50 msgr2=0x7fe0a0003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:03.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.455+0000 7fe0c0200640 1 --2- 172.21.15.32:0/544747551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a0003b50 0x7fe0a0003f50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0018d0 tx=0x7fe0ac01c520 comp rx=0 tx=0).stop 2024-03-19T06:23:03.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.455+0000 7fe0c0200640 1 -- 172.21.15.32:0/544747551 shutdown_connections 2024-03-19T06:23:03.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.455+0000 7fe0c0200640 1 --2- 172.21.15.32:0/544747551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a0003b50 0x7fe0a0003f50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:03.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.455+0000 7fe0c0200640 1 -- 172.21.15.32:0/544747551 >> 172.21.15.32:0/544747551 conn(0x7fe0b80b1590 msgr2=0x7fe0b80b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:03.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.455+0000 7fe0c0200640 1 -- 172.21.15.32:0/544747551 shutdown_connections 2024-03-19T06:23:03.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.455+0000 7fe0c0200640 1 -- 172.21.15.32:0/544747551 wait complete. 2024-03-19T06:23:03.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0c0200640 1 Processor -- start 2024-03-19T06:23:03.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0c0200640 1 -- start start 2024-03-19T06:23:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0c0200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a0003b50 0x7fe0b814fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0c0200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0b81480d0 0x7fe0b80afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0c0200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0b8148530 0x7fe0b80b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0c0200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b815c7f0 con 0x7fe0a0003b50 2024-03-19T06:23:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0c0200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b815c670 con 0x7fe0b81480d0 2024-03-19T06:23:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0c0200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b815c970 con 0x7fe0b8148530 2024-03-19T06:23:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0bd800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a0003b50 0x7fe0b814fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0bd800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a0003b50 0x7fe0b814fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55026/0 (socket says 172.21.15.32:55026) 2024-03-19T06:23:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0bd800640 1 -- 172.21.15.32:0/450618929 learned_addr learned my addr 172.21.15.32:0/450618929 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0bce00640 1 --2- 172.21.15.32:0/450618929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0b81480d0 0x7fe0b80afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0be200640 1 --2- 172.21.15.32:0/450618929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0b8148530 0x7fe0b80b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0bd800640 1 -- 172.21.15.32:0/450618929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0b8148530 msgr2=0x7fe0b80b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0bd800640 1 --2- 172.21.15.32:0/450618929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0b8148530 0x7fe0b80b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0bd800640 1 -- 172.21.15.32:0/450618929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0b81480d0 msgr2=0x7fe0b80afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0bd800640 1 --2- 172.21.15.32:0/450618929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0b81480d0 0x7fe0b80afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0bd800640 1 -- 172.21.15.32:0/450618929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b8150190 con 0x7fe0a0003b50 2024-03-19T06:23:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0bd800640 1 --2- 172.21.15.32:0/450618929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a0003b50 0x7fe0b814fc50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0018d0 tx=0x7fe0a0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0b5600640 1 -- 172.21.15.32:0/450618929 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0bf070 con 0x7fe0a0003b50 2024-03-19T06:23:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0b5600640 1 -- 172.21.15.32:0/450618929 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac0054a0 con 0x7fe0a0003b50 2024-03-19T06:23:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0b5600640 1 -- 172.21.15.32:0/450618929 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac006a20 con 0x7fe0a0003b50 2024-03-19T06:23:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0c0200640 1 -- 172.21.15.32:0/450618929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b80acc10 con 0x7fe0a0003b50 2024-03-19T06:23:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.459+0000 7fe0c0200640 1 -- 172.21.15.32:0/450618929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b80ad1d0 con 0x7fe0a0003b50 2024-03-19T06:23:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.463+0000 7fe0c0200640 1 -- 172.21.15.32:0/450618929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b8151620 con 0x7fe0a0003b50 2024-03-19T06:23:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.463+0000 7fe0b5600640 1 -- 172.21.15.32:0/450618929 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe0ac0c2070 con 0x7fe0a0003b50 2024-03-19T06:23:03.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.463+0000 7fe0b5600640 1 --2- 172.21.15.32:0/450618929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe098067690 0x7fe098069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:03.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.463+0000 7fe0b5600640 1 -- 172.21.15.32:0/450618929 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fe0ac11f270 con 0x7fe0a0003b50 2024-03-19T06:23:03.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.463+0000 7fe0bce00640 1 --2- 172.21.15.32:0/450618929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe098067690 0x7fe098069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:03.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.463+0000 7fe0bce00640 1 --2- 172.21.15.32:0/450618929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe098067690 0x7fe098069b50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4001210 tx=0x7fe0a4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:03.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.467+0000 7fe0b5600640 1 -- 172.21.15.32:0/450618929 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fe0b8151620 con 0x7fe0a0003b50 2024-03-19T06:23:03.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.687+0000 7fe0c0200640 1 -- 172.21.15.32:0/450618929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fe0b80b1de0 con 0x7fe0a0003b50 2024-03-19T06:23:03.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.687+0000 7fe0b5600640 1 -- 172.21.15.32:0/450618929 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v14) v1 ==== 184+0+141 (secure 0 0 0) 0x7fe0ac016230 con 0x7fe0a0003b50 2024-03-19T06:23:03.676 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-03-19T06:23:03.677 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCWLvll4jsFMxAAr4PzH6Djodh2O01vGYgxKA== 2024-03-19T06:23:03.677 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow" 2024-03-19T06:23:03.677 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2024-03-19T06:23:03.677 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw pool=cephfs_data" 2024-03-19T06:23:03.677 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.0 2024-03-19T06:23:03.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.691+0000 7fe0c0200640 1 -- 172.21.15.32:0/450618929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe098067690 msgr2=0x7fe098069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:03.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.691+0000 7fe0c0200640 1 --2- 172.21.15.32:0/450618929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe098067690 0x7fe098069b50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4001210 tx=0x7fe0a4009040 comp rx=0 tx=0).stop 2024-03-19T06:23:03.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.691+0000 7fe0c0200640 1 -- 172.21.15.32:0/450618929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a0003b50 msgr2=0x7fe0b814fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:03.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.691+0000 7fe0c0200640 1 --2- 172.21.15.32:0/450618929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a0003b50 0x7fe0b814fc50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0018d0 tx=0x7fe0a0005840 comp rx=0 tx=0).stop 2024-03-19T06:23:03.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.691+0000 7fe0c0200640 1 -- 172.21.15.32:0/450618929 shutdown_connections 2024-03-19T06:23:03.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.691+0000 7fe0c0200640 1 --2- 172.21.15.32:0/450618929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe098067690 0x7fe098069b50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:03.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.691+0000 7fe0c0200640 1 --2- 172.21.15.32:0/450618929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0b8148530 0x7fe0b80b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:03.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.691+0000 7fe0c0200640 1 --2- 172.21.15.32:0/450618929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0b81480d0 0x7fe0b80afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:03.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.691+0000 7fe0c0200640 1 --2- 172.21.15.32:0/450618929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a0003b50 0x7fe0b814fc50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:03.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.691+0000 7fe0c0200640 1 -- 172.21.15.32:0/450618929 >> 172.21.15.32:0/450618929 conn(0x7fe0b80b1590 msgr2=0x7fe0b806b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:03.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.691+0000 7fe0c0200640 1 -- 172.21.15.32:0/450618929 shutdown_connections 2024-03-19T06:23:03.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:03.691+0000 7fe0c0200640 1 -- 172.21.15.32:0/450618929 wait complete. 2024-03-19T06:23:03.699 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-19T06:23:03.699 DEBUG:teuthology.orchestra.run.smithi032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-19T06:23:03.788 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-19T06:23:03.882 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-19T06:23:03.882 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:23:03.882 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:23:03.891 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357716k,nr_inodes=4089429,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4371 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-19T06:23:03.891 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:23:03.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:03.891 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-19T06:23:03.941 INFO:teuthology.orchestra.run.smithi032.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-19T06:23:03.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:23:03.942 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:23:03.942 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:23:03.957 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-19T06:23:03.957 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:23:03.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:03.957 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-19T06:23:04.007 INFO:teuthology.orchestra.run.smithi171.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-03-19T06:23:04.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:23:04.008 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:23:04.008 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:23:04.016 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357716k,nr_inodes=4089429,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4371 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-19T06:23:04.016 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:23:04.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:04.017 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-19T06:23:04.065 INFO:teuthology.orchestra.run.smithi032.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-03-19T06:23:04.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:23:04.066 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:23:04.066 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:23:04.075 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-19T06:23:04.075 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:23:04.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:04.076 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-19T06:23:04.126 INFO:teuthology.orchestra.run.smithi171.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-03-19T06:23:04.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:23:04.127 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:23:04.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.283+0000 7f2ad7200640 1 Processor -- start 2024-03-19T06:23:04.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.283+0000 7f2ad7200640 1 -- start start 2024-03-19T06:23:04.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.283+0000 7f2ad7200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2ad00aecf0 0x7f2ad00ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:04.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.283+0000 7f2ad7200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad015fe20 con 0x7f2ad015c010 2024-03-19T06:23:04.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.283+0000 7f2ad7200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad0160100 con 0x7f2ad006d6c0 2024-03-19T06:23:04.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.283+0000 7f2ad7200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad01603e0 con 0x7f2ad00aecf0 2024-03-19T06:23:04.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.283+0000 7f2ac7400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2ad015c010 0x7f2ad015f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45798/0 (socket says 172.21.15.32:45798) 2024-03-19T06:23:04.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.283+0000 7f2ac7400640 1 -- 172.21.15.32:0/865102532 learned_addr learned my addr 172.21.15.32:0/865102532 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:04.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.283+0000 7f2acfe00640 1 --2- 172.21.15.32:0/865102532 >> v2:172.21.15.171:3300/0 conn(0x7f2ad00aecf0 0x7f2ad00ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:04.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.283+0000 7f2acf400640 1 -- 172.21.15.32:0/865102532 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738640334 0 0) 0x7f2ad015fe20 con 0x7f2ad015c010 2024-03-19T06:23:04.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.283+0000 7f2acf400640 1 -- 172.21.15.32:0/865102532 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ab4003530 con 0x7f2ad015c010 2024-03-19T06:23:04.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.283+0000 7f2acf400640 1 -- 172.21.15.32:0/865102532 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251570429 0 0) 0x7f2ad0160100 con 0x7f2ad006d6c0 2024-03-19T06:23:04.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.283+0000 7f2acf400640 1 -- 172.21.15.32:0/865102532 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ad015fe20 con 0x7f2ad006d6c0 2024-03-19T06:23:04.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.283+0000 7f2acfe00640 1 -- 172.21.15.32:0/865102532 >> v1:172.21.15.171:6789/0 conn(0x7f2ad006d6c0 legacy=0x7f2ad00cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:04.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.283+0000 7f2acfe00640 1 -- 172.21.15.32:0/865102532 >> v1:172.21.15.32:6789/0 conn(0x7f2ad015c010 legacy=0x7f2ad015f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:04.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.283+0000 7f2acfe00640 1 -- 172.21.15.32:0/865102532 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad00ca1f0 con 0x7f2ad00aecf0 2024-03-19T06:23:04.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.287+0000 7f2acfe00640 1 --2- 172.21.15.32:0/865102532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ad00aecf0 0x7f2ad00ca9f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00097c0 tx=0x7f2ac001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1b15ff10160c1b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:04.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.287+0000 7f2acf400640 1 -- 172.21.15.32:0/865102532 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00b0070 con 0x7f2ad00aecf0 2024-03-19T06:23:04.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.287+0000 7f2acf400640 1 -- 172.21.15.32:0/865102532 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac00ab600 con 0x7f2ad00aecf0 2024-03-19T06:23:04.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.287+0000 7f2acf400640 1 -- 172.21.15.32:0/865102532 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00ab9d0 con 0x7f2ad00aecf0 2024-03-19T06:23:04.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.287+0000 7f2ad7200640 1 -- 172.21.15.32:0/865102532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ad00aecf0 msgr2=0x7f2ad00ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:04.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.287+0000 7f2ad7200640 1 --2- 172.21.15.32:0/865102532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ad00aecf0 0x7f2ad00ca9f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00097c0 tx=0x7f2ac001c410 comp rx=0 tx=0).stop 2024-03-19T06:23:04.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.287+0000 7f2ad7200640 1 -- 172.21.15.32:0/865102532 shutdown_connections 2024-03-19T06:23:04.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.287+0000 7f2ad7200640 1 --2- 172.21.15.32:0/865102532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ad00aecf0 0x7f2ad00ca9f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.287+0000 7f2ad7200640 1 -- 172.21.15.32:0/865102532 >> 172.21.15.32:0/865102532 conn(0x7f2ad00b1280 msgr2=0x7f2ad00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:04.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.287+0000 7f2ad7200640 1 -- 172.21.15.32:0/865102532 shutdown_connections 2024-03-19T06:23:04.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.287+0000 7f2ad7200640 1 -- 172.21.15.32:0/865102532 wait complete. 2024-03-19T06:23:04.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2ad7200640 1 Processor -- start 2024-03-19T06:23:04.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2ad7200640 1 -- start start 2024-03-19T06:23:04.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2ad7200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ad006d6c0 0x7f2ad00b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:04.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2ad7200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad00aecf0 0x7f2ad00af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:04.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2ad7200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ad015c010 0x7f2ad0159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:04.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2ad7200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad016a030 con 0x7f2ad006d6c0 2024-03-19T06:23:04.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2ad7200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad0169eb0 con 0x7f2ad015c010 2024-03-19T06:23:04.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2ad7200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad016a1b0 con 0x7f2ad00aecf0 2024-03-19T06:23:04.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2acfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ad006d6c0 0x7f2ad00b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:04.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2acfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ad006d6c0 0x7f2ad00b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33608/0 (socket says 172.21.15.32:33608) 2024-03-19T06:23:04.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2acfe00640 1 -- 172.21.15.32:0/288539755 learned_addr learned my addr 172.21.15.32:0/288539755 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:04.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2ac7400640 1 --2- 172.21.15.32:0/288539755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad00aecf0 0x7f2ad00af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:04.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2ad5200640 1 --2- 172.21.15.32:0/288539755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ad015c010 0x7f2ad0159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:04.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2acfe00640 1 -- 172.21.15.32:0/288539755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad00aecf0 msgr2=0x7f2ad00af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:04.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2acfe00640 1 --2- 172.21.15.32:0/288539755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad00aecf0 0x7f2ad00af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2acfe00640 1 -- 172.21.15.32:0/288539755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ad015c010 msgr2=0x7f2ad0159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:04.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2acfe00640 1 --2- 172.21.15.32:0/288539755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ad015c010 0x7f2ad0159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2acfe00640 1 -- 172.21.15.32:0/288539755 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad00b4dd0 con 0x7f2ad006d6c0 2024-03-19T06:23:04.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2ac7400640 1 --2- 172.21.15.32:0/288539755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad00aecf0 0x7f2ad00af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:04.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2acfe00640 1 --2- 172.21.15.32:0/288539755 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ad006d6c0 0x7f2ad00b4890 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2ac001a040 tx=0x7f2ac00191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:04.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2accc00640 1 -- 172.21.15.32:0/288539755 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00b8020 con 0x7f2ad006d6c0 2024-03-19T06:23:04.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2accc00640 1 -- 172.21.15.32:0/288539755 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac00b4410 con 0x7f2ad006d6c0 2024-03-19T06:23:04.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2accc00640 1 -- 172.21.15.32:0/288539755 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00b0040 con 0x7f2ad006d6c0 2024-03-19T06:23:04.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2ad7200640 1 -- 172.21.15.32:0/288539755 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad01596f0 con 0x7f2ad006d6c0 2024-03-19T06:23:04.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2ad7200640 1 -- 172.21.15.32:0/288539755 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad0159410 con 0x7f2ad006d6c0 2024-03-19T06:23:04.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.291+0000 7f2ad7200640 1 -- 172.21.15.32:0/288539755 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad00749e0 con 0x7f2ad006d6c0 2024-03-19T06:23:04.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.295+0000 7f2accc00640 1 -- 172.21.15.32:0/288539755 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2ac00bb020 con 0x7f2ad006d6c0 2024-03-19T06:23:04.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.295+0000 7f2accc00640 1 --2- 172.21.15.32:0/288539755 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2aac067660 0x7f2aac069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:04.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.295+0000 7f2accc00640 1 -- 172.21.15.32:0/288539755 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f2ac011f3d0 con 0x7f2ad006d6c0 2024-03-19T06:23:04.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.295+0000 7f2ac7400640 1 --2- 172.21.15.32:0/288539755 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2aac067660 0x7f2aac069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:04.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.295+0000 7f2ac7400640 1 --2- 172.21.15.32:0/288539755 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2aac067660 0x7f2aac069b20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2ad006d290 tx=0x7f2ab8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:04.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.299+0000 7f2accc00640 1 -- 172.21.15.32:0/288539755 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f2ac00c2030 con 0x7f2ad006d6c0 2024-03-19T06:23:04.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.495+0000 7f2ad7200640 1 -- 172.21.15.32:0/288539755 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ad006f010 con 0x7f2ad006d6c0 2024-03-19T06:23:04.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.495+0000 7f2accc00640 1 -- 172.21.15.32:0/288539755 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f2ac0016090 con 0x7f2ad006d6c0 2024-03-19T06:23:04.485 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:04.485 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3394778234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3394778234},{"type":"v1","addr":"172.21.15.171:6836","nonce":3394778234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2000291327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2000291327},{"type":"v1","addr":"172.21.15.171:6837","nonce":2000291327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/4039299860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":4039299860},{"type":"v1","addr":"172.21.15.32:6833","nonce":4039299860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:22:12.167128+0000","modified":"2024-03-19T06:22:26.236754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/2680502611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":2680502611},{"type":"v1","addr":"172.21.15.32:6835","nonce":2680502611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-19T06:23:04.486 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 18 2024-03-19T06:23:04.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.499+0000 7f2ad7200640 1 -- 172.21.15.32:0/288539755 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2aac067660 msgr2=0x7f2aac069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:04.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.499+0000 7f2ad7200640 1 --2- 172.21.15.32:0/288539755 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2aac067660 0x7f2aac069b20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2ad006d290 tx=0x7f2ab8009040 comp rx=0 tx=0).stop 2024-03-19T06:23:04.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.499+0000 7f2ad7200640 1 -- 172.21.15.32:0/288539755 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ad006d6c0 msgr2=0x7f2ad00b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:04.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.499+0000 7f2ad7200640 1 --2- 172.21.15.32:0/288539755 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ad006d6c0 0x7f2ad00b4890 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2ac001a040 tx=0x7f2ac00191b0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.499+0000 7f2ad7200640 1 -- 172.21.15.32:0/288539755 shutdown_connections 2024-03-19T06:23:04.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.499+0000 7f2ad7200640 1 --2- 172.21.15.32:0/288539755 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2aac067660 0x7f2aac069b20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.499+0000 7f2ad7200640 1 --2- 172.21.15.32:0/288539755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ad015c010 0x7f2ad0159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.499+0000 7f2ad7200640 1 --2- 172.21.15.32:0/288539755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad00aecf0 0x7f2ad00af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.499+0000 7f2ad7200640 1 --2- 172.21.15.32:0/288539755 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ad006d6c0 0x7f2ad00b4890 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.499+0000 7f2ad7200640 1 -- 172.21.15.32:0/288539755 >> 172.21.15.32:0/288539755 conn(0x7f2ad00b1280 msgr2=0x7f2ad0166e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:04.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.499+0000 7f2ad7200640 1 -- 172.21.15.32:0/288539755 shutdown_connections 2024-03-19T06:23:04.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.499+0000 7f2ad7200640 1 -- 172.21.15.32:0/288539755 wait complete. 2024-03-19T06:23:04.506 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:23:04.565 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:23:04.569 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:23:04.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.659+0000 7ffaac200640 1 Processor -- start 2024-03-19T06:23:04.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.659+0000 7ffaac200640 1 -- start start 2024-03-19T06:23:04.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.659+0000 7ffaac200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffaa4159ed0 0x7ffaa40cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:04.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.659+0000 7ffaac200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffaa415a2b0 0x7ffaa40caf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:04.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.659+0000 7ffaac200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa40ce3e0 con 0x7ffaa40cdb40 2024-03-19T06:23:04.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.659+0000 7ffaac200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa40ca1d0 con 0x7ffaa4159ed0 2024-03-19T06:23:04.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.659+0000 7ffaac200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa40ca4b0 con 0x7ffaa415a2b0 2024-03-19T06:23:04.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.663+0000 7ffaa9800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffaa4159ed0 0x7ffaa40cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:04.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.663+0000 7ffaaa200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ffaa40cdb40 0x7ffaa4071350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45810/0 (socket says 172.21.15.32:45810) 2024-03-19T06:23:04.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.663+0000 7ffaaa200640 1 -- 172.21.15.32:0/2661973465 learned_addr learned my addr 172.21.15.32:0/2661973465 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:04.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.663+0000 7ffaa8e00640 1 --2- 172.21.15.32:0/2661973465 >> v2:172.21.15.171:3300/0 conn(0x7ffaa415a2b0 0x7ffaa40caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:04.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.663+0000 7ffaa9800640 1 -- 172.21.15.32:0/2661973465 >> v2:172.21.15.171:3300/0 conn(0x7ffaa415a2b0 msgr2=0x7ffaa40caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:04.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.663+0000 7ffaa9800640 1 --2- 172.21.15.32:0/2661973465 >> v2:172.21.15.171:3300/0 conn(0x7ffaa415a2b0 0x7ffaa40caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.663+0000 7ffaa9800640 1 -- 172.21.15.32:0/2661973465 >> v1:172.21.15.32:6789/0 conn(0x7ffaa40cdb40 legacy=0x7ffaa4071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:04.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.663+0000 7ffaa9800640 1 -- 172.21.15.32:0/2661973465 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa40ca790 con 0x7ffaa4159ed0 2024-03-19T06:23:04.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.663+0000 7ffaa3e00640 1 -- 172.21.15.32:0/2661973465 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281496486 0 0) 0x7ffaa40ce3e0 con 0x7ffaa40cdb40 2024-03-19T06:23:04.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.663+0000 7ffaa9800640 1 --2- 172.21.15.32:0/2661973465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa4159ed0 0x7ffaa40cea60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40cbfe0 tx=0x7ffa9801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecbd755961e56a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:04.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.663+0000 7ffaa3e00640 1 -- 172.21.15.32:0/2661973465 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980b2070 con 0x7ffaa4159ed0 2024-03-19T06:23:04.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.663+0000 7ffaa3e00640 1 -- 172.21.15.32:0/2661973465 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa980a9070 con 0x7ffaa4159ed0 2024-03-19T06:23:04.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.663+0000 7ffaa3e00640 1 -- 172.21.15.32:0/2661973465 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980ad880 con 0x7ffaa4159ed0 2024-03-19T06:23:04.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaac200640 1 -- 172.21.15.32:0/2661973465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa4159ed0 msgr2=0x7ffaa40cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:04.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaac200640 1 --2- 172.21.15.32:0/2661973465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa4159ed0 0x7ffaa40cea60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40cbfe0 tx=0x7ffa9801c3c0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaac200640 1 -- 172.21.15.32:0/2661973465 shutdown_connections 2024-03-19T06:23:04.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaac200640 1 --2- 172.21.15.32:0/2661973465 >> v2:172.21.15.171:3300/0 conn(0x7ffaa415a2b0 0x7ffaa40caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaac200640 1 --2- 172.21.15.32:0/2661973465 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa4159ed0 0x7ffaa40cea60 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaac200640 1 -- 172.21.15.32:0/2661973465 >> 172.21.15.32:0/2661973465 conn(0x7ffaa40b1280 msgr2=0x7ffaa40b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:04.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaac200640 1 -- 172.21.15.32:0/2661973465 shutdown_connections 2024-03-19T06:23:04.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaac200640 1 -- 172.21.15.32:0/2661973465 wait complete. 2024-03-19T06:23:04.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaac200640 1 Processor -- start 2024-03-19T06:23:04.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaac200640 1 -- start start 2024-03-19T06:23:04.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaac200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa40cdb40 0x7ffaa4149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:04.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaac200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaa4159ed0 0x7ffaa4158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:04.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaac200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffaa415a2b0 0x7ffaa41485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:04.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaac200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4071a60 con 0x7ffaa40cdb40 2024-03-19T06:23:04.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaac200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40ce160 con 0x7ffaa4159ed0 2024-03-19T06:23:04.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaac200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4071be0 con 0x7ffaa415a2b0 2024-03-19T06:23:04.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaa9800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa40cdb40 0x7ffaa4149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:04.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaa9800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa40cdb40 0x7ffaa4149a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33630/0 (socket says 172.21.15.32:33630) 2024-03-19T06:23:04.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaa9800640 1 -- 172.21.15.32:0/785689425 learned_addr learned my addr 172.21.15.32:0/785689425 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:04.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaa9800640 1 -- 172.21.15.32:0/785689425 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffaa415a2b0 msgr2=0x7ffaa41485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:04.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaa9800640 1 --2- 172.21.15.32:0/785689425 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffaa415a2b0 0x7ffaa41485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaa8e00640 1 --2- 172.21.15.32:0/785689425 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaa4159ed0 0x7ffaa4158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:04.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaa9800640 1 -- 172.21.15.32:0/785689425 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaa4159ed0 msgr2=0x7ffaa4158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:04.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaa9800640 1 --2- 172.21.15.32:0/785689425 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaa4159ed0 0x7ffaa4158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaa9800640 1 -- 172.21.15.32:0/785689425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa40b3dc0 con 0x7ffaa40cdb40 2024-03-19T06:23:04.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.667+0000 7ffaa8e00640 1 --2- 172.21.15.32:0/785689425 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaa4159ed0 0x7ffaa4158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:04.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.671+0000 7ffaa9800640 1 --2- 172.21.15.32:0/785689425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa40cdb40 0x7ffaa4149a90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ffa98019ff0 tx=0x7ffa9801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:04.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.671+0000 7ffaa1600640 1 -- 172.21.15.32:0/785689425 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980b2050 con 0x7ffaa40cdb40 2024-03-19T06:23:04.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.671+0000 7ffaa1600640 1 -- 172.21.15.32:0/785689425 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa980b3040 con 0x7ffaa40cdb40 2024-03-19T06:23:04.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.671+0000 7ffaa1600640 1 -- 172.21.15.32:0/785689425 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98006e20 con 0x7ffaa40cdb40 2024-03-19T06:23:04.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.671+0000 7ffaac200640 1 -- 172.21.15.32:0/785689425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa40b40a0 con 0x7ffaa40cdb40 2024-03-19T06:23:04.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.671+0000 7ffaac200640 1 -- 172.21.15.32:0/785689425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa414dee0 con 0x7ffaa40cdb40 2024-03-19T06:23:04.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.671+0000 7ffaac200640 1 -- 172.21.15.32:0/785689425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa40749e0 con 0x7ffaa40cdb40 2024-03-19T06:23:04.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.671+0000 7ffaa1600640 1 -- 172.21.15.32:0/785689425 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ffa980c0060 con 0x7ffaa40cdb40 2024-03-19T06:23:04.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.671+0000 7ffaa1600640 1 --2- 172.21.15.32:0/785689425 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffa840676b0 0x7ffa84069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:04.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.671+0000 7ffaa1600640 1 -- 172.21.15.32:0/785689425 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7ffa9811f390 con 0x7ffaa40cdb40 2024-03-19T06:23:04.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.671+0000 7ffaa8e00640 1 --2- 172.21.15.32:0/785689425 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffa840676b0 0x7ffa84069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:04.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.675+0000 7ffaa8e00640 1 --2- 172.21.15.32:0/785689425 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffa840676b0 0x7ffa84069b70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffaa414a050 tx=0x7ffa90008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:04.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.675+0000 7ffaa1600640 1 -- 172.21.15.32:0/785689425 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7ffa98016070 con 0x7ffaa40cdb40 2024-03-19T06:23:04.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.839+0000 7ffaac200640 1 -- 172.21.15.32:0/785689425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaa4072600 con 0x7ffaa40cdb40 2024-03-19T06:23:04.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.843+0000 7ffaa1600640 1 -- 172.21.15.32:0/785689425 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18493 (secure 0 0 0) 0x7ffa980efee0 con 0x7ffaa40cdb40 2024-03-19T06:23:04.830 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:04.830 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":38,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:22:27.853859+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:22:09.983589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-19T06:22:11.172289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-19T06:22:25.205334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:23:04.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.843+0000 7ffaac200640 1 -- 172.21.15.32:0/785689425 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffa840676b0 msgr2=0x7ffa84069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:04.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.843+0000 7ffaac200640 1 --2- 172.21.15.32:0/785689425 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffa840676b0 0x7ffa84069b70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffaa414a050 tx=0x7ffa90008040 comp rx=0 tx=0).stop 2024-03-19T06:23:04.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.843+0000 7ffaac200640 1 -- 172.21.15.32:0/785689425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa40cdb40 msgr2=0x7ffaa4149a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:04.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.843+0000 7ffaac200640 1 --2- 172.21.15.32:0/785689425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa40cdb40 0x7ffaa4149a90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ffa98019ff0 tx=0x7ffa9801ac00 comp rx=0 tx=0).stop 2024-03-19T06:23:04.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.843+0000 7ffaac200640 1 -- 172.21.15.32:0/785689425 shutdown_connections 2024-03-19T06:23:04.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.843+0000 7ffaac200640 1 --2- 172.21.15.32:0/785689425 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffa840676b0 0x7ffa84069b70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.843+0000 7ffaac200640 1 --2- 172.21.15.32:0/785689425 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffaa415a2b0 0x7ffaa41485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.843+0000 7ffaac200640 1 --2- 172.21.15.32:0/785689425 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaa4159ed0 0x7ffaa4158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.843+0000 7ffaac200640 1 --2- 172.21.15.32:0/785689425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa40cdb40 0x7ffaa4149a90 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:04.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.843+0000 7ffaac200640 1 -- 172.21.15.32:0/785689425 >> 172.21.15.32:0/785689425 conn(0x7ffaa40b1280 msgr2=0x7ffaa406ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:04.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.843+0000 7ffaac200640 1 -- 172.21.15.32:0/785689425 shutdown_connections 2024-03-19T06:23:04.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:04.843+0000 7ffaac200640 1 -- 172.21.15.32:0/785689425 wait complete. 2024-03-19T06:23:04.852 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:22:09.983589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:22:11.172289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2024-03-19T06:22:25.205334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:23:04.852 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:23:05.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.047+0000 7f0462800640 1 Processor -- start 2024-03-19T06:23:05.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.047+0000 7f0462800640 1 -- start start 2024-03-19T06:23:05.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f0462800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f045c06e320 0x7f045c15bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f0462800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045c0cc290 con 0x7f045c06ad40 2024-03-19T06:23:05.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f0462800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045c0cc570 con 0x7f045c06eed0 2024-03-19T06:23:05.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f0462800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045c0cd420 con 0x7f045c06e320 2024-03-19T06:23:05.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045b400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f045c06ad40 0x7f045c06b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45818/0 (socket says 172.21.15.32:45818) 2024-03-19T06:23:05.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045b400640 1 -- 172.21.15.32:0/2995368718 learned_addr learned my addr 172.21.15.32:0/2995368718 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:05.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045aa00640 1 -- 172.21.15.32:0/2995368718 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045901562 0 0) 0x7f045c0cc290 con 0x7f045c06ad40 2024-03-19T06:23:05.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045be00640 1 --2- 172.21.15.32:0/2995368718 >> v2:172.21.15.171:3300/0 conn(0x7f045c06e320 0x7f045c15bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045aa00640 1 -- 172.21.15.32:0/2995368718 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0440003530 con 0x7f045c06ad40 2024-03-19T06:23:05.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045aa00640 1 -- 172.21.15.32:0/2995368718 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2072051900 0 0) 0x7f0440003530 con 0x7f045c06ad40 2024-03-19T06:23:05.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045aa00640 1 -- 172.21.15.32:0/2995368718 >> v2:172.21.15.171:3300/0 conn(0x7f045c06e320 msgr2=0x7f045c15bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:05.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045aa00640 1 --2- 172.21.15.32:0/2995368718 >> v2:172.21.15.171:3300/0 conn(0x7f045c06e320 0x7f045c15bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045aa00640 1 -- 172.21.15.32:0/2995368718 >> v1:172.21.15.171:6789/0 conn(0x7f045c06eed0 legacy=0x7f045c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045aa00640 1 -- 172.21.15.32:0/2995368718 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c0cc850 con 0x7f045c06ad40 2024-03-19T06:23:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045aa00640 1 -- 172.21.15.32:0/2995368718 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f044c001680 con 0x7f045c06ad40 2024-03-19T06:23:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045aa00640 1 -- 172.21.15.32:0/2995368718 >> v1:172.21.15.32:6789/0 conn(0x7f045c06ad40 legacy=0x7f045c06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045aa00640 1 --2- 172.21.15.32:0/2995368718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0440003a10 0x7f0440003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045aa00640 1 --2- 172.21.15.32:0/2995368718 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0440004810 0x7f0440004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045aa00640 1 --2- 172.21.15.32:0/2995368718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0440005220 0x7f044000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045aa00640 1 -- 172.21.15.32:0/2995368718 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c0cd420 con 0x7f0440004810 2024-03-19T06:23:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045aa00640 1 -- 172.21.15.32:0/2995368718 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044000c170 con 0x7f0440005220 2024-03-19T06:23:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045aa00640 1 -- 172.21.15.32:0/2995368718 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044000c370 con 0x7f0440003a10 2024-03-19T06:23:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f0452a00640 1 --2- 172.21.15.32:0/2995368718 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0440004810 0x7f0440004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045b400640 1 --2- 172.21.15.32:0/2995368718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0440003a10 0x7f0440003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045be00640 1 --2- 172.21.15.32:0/2995368718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0440005220 0x7f044000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f0452a00640 1 -- 172.21.15.32:0/2995368718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0440003a10 msgr2=0x7f0440003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f0452a00640 1 --2- 172.21.15.32:0/2995368718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0440003a10 0x7f0440003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f0452a00640 1 -- 172.21.15.32:0/2995368718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0440005220 msgr2=0x7f044000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:05.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f0452a00640 1 --2- 172.21.15.32:0/2995368718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0440005220 0x7f044000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f0452a00640 1 -- 172.21.15.32:0/2995368718 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0440003530 con 0x7f0440004810 2024-03-19T06:23:05.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.051+0000 7f045be00640 1 -- 172.21.15.32:0/2995368718 reap_dead start 2024-03-19T06:23:05.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.055+0000 7f0452a00640 1 --2- 172.21.15.32:0/2995368718 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0440004810 0x7f0440004c90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0444001750 tx=0x7f044401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f7944a8c76559 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:05.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.055+0000 7f045aa00640 1 -- 172.21.15.32:0/2995368718 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04440013a0 con 0x7f0440004810 2024-03-19T06:23:05.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.055+0000 7f045aa00640 1 -- 172.21.15.32:0/2995368718 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04440052f0 con 0x7f0440004810 2024-03-19T06:23:05.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.055+0000 7f045aa00640 1 -- 172.21.15.32:0/2995368718 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444003840 con 0x7f0440004810 2024-03-19T06:23:05.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.055+0000 7f0462800640 1 -- 172.21.15.32:0/2995368718 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0440004810 msgr2=0x7f0440004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.055+0000 7f0462800640 1 --2- 172.21.15.32:0/2995368718 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0440004810 0x7f0440004c90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0444001750 tx=0x7f044401c3c0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.055+0000 7f0462800640 1 -- 172.21.15.32:0/2995368718 shutdown_connections 2024-03-19T06:23:05.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.055+0000 7f0462800640 1 --2- 172.21.15.32:0/2995368718 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0440004810 0x7f0440004c90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.055+0000 7f0462800640 1 -- 172.21.15.32:0/2995368718 >> 172.21.15.32:0/2995368718 conn(0x7f045c0b1590 msgr2=0x7f045c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:05.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.055+0000 7f0462800640 1 -- 172.21.15.32:0/2995368718 shutdown_connections 2024-03-19T06:23:05.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.055+0000 7f0462800640 1 -- 172.21.15.32:0/2995368718 wait complete. 2024-03-19T06:23:05.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.055+0000 7f0462800640 1 Processor -- start 2024-03-19T06:23:05.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.055+0000 7f0462800640 1 -- start start 2024-03-19T06:23:05.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f0462800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0440004810 0x7f045c0ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f0462800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f045c0acff0 0x7f045c1420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f0462800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f045c1f6980 0x7f045c155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f0462800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c15c7f0 con 0x7f045c1f6980 2024-03-19T06:23:05.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f0462800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c15c670 con 0x7f045c0acff0 2024-03-19T06:23:05.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f0462800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c15c970 con 0x7f0440004810 2024-03-19T06:23:05.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f045be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f045c1f6980 0x7f045c155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f045b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0440004810 0x7f045c0ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f045be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f045c1f6980 0x7f045c155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33654/0 (socket says 172.21.15.32:33654) 2024-03-19T06:23:05.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f045be00640 1 -- 172.21.15.32:0/519039372 learned_addr learned my addr 172.21.15.32:0/519039372 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:05.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f0452a00640 1 --2- 172.21.15.32:0/519039372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f045c0acff0 0x7f045c1420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f045be00640 1 -- 172.21.15.32:0/519039372 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0440004810 msgr2=0x7f045c0ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f045be00640 1 --2- 172.21.15.32:0/519039372 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0440004810 0x7f045c0ae600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f045be00640 1 -- 172.21.15.32:0/519039372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f045c0acff0 msgr2=0x7f045c1420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f045be00640 1 --2- 172.21.15.32:0/519039372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f045c0acff0 0x7f045c1420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f045be00640 1 -- 172.21.15.32:0/519039372 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c0ad560 con 0x7f045c1f6980 2024-03-19T06:23:05.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f045be00640 1 --2- 172.21.15.32:0/519039372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f045c1f6980 0x7f045c155a90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f045c06db40 tx=0x7f045400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:05.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f0453e00640 1 -- 172.21.15.32:0/519039372 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045400fd80 con 0x7f045c1f6980 2024-03-19T06:23:05.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f0453e00640 1 -- 172.21.15.32:0/519039372 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045401d070 con 0x7f045c1f6980 2024-03-19T06:23:05.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f0453e00640 1 -- 172.21.15.32:0/519039372 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0454015670 con 0x7f045c1f6980 2024-03-19T06:23:05.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f0462800640 1 -- 172.21.15.32:0/519039372 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045c0ad840 con 0x7f045c1f6980 2024-03-19T06:23:05.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f0462800640 1 -- 172.21.15.32:0/519039372 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045c0ade00 con 0x7f045c1f6980 2024-03-19T06:23:05.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.059+0000 7f0462800640 1 -- 172.21.15.32:0/519039372 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045c0749e0 con 0x7f045c1f6980 2024-03-19T06:23:05.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.063+0000 7f0453e00640 1 -- 172.21.15.32:0/519039372 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0454015810 con 0x7f045c1f6980 2024-03-19T06:23:05.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.063+0000 7f0453e00640 1 --2- 172.21.15.32:0/519039372 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0438067660 0x7f0438069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.063+0000 7f0453e00640 1 -- 172.21.15.32:0/519039372 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f0454086600 con 0x7f045c1f6980 2024-03-19T06:23:05.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.063+0000 7f045b400640 1 --2- 172.21.15.32:0/519039372 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0438067660 0x7f0438069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.063+0000 7f045b400640 1 --2- 172.21.15.32:0/519039372 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0438067660 0x7f0438069b20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f044c000c10 tx=0x7f044c001dc0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:05.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.067+0000 7f0453e00640 1 -- 172.21.15.32:0/519039372 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f0454027020 con 0x7f045c1f6980 2024-03-19T06:23:05.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.227+0000 7f0462800640 1 -- 172.21.15.32:0/519039372 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f045c06b4a0 con 0x7f045c1f6980 2024-03-19T06:23:05.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.227+0000 7f0453e00640 1 -- 172.21.15.32:0/519039372 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0454010040 con 0x7f045c1f6980 2024-03-19T06:23:05.216 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:23:05.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.231+0000 7f0462800640 1 -- 172.21.15.32:0/519039372 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0438067660 msgr2=0x7f0438069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.231+0000 7f0462800640 1 --2- 172.21.15.32:0/519039372 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0438067660 0x7f0438069b20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f044c000c10 tx=0x7f044c001dc0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.231+0000 7f0462800640 1 -- 172.21.15.32:0/519039372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f045c1f6980 msgr2=0x7f045c155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.231+0000 7f0462800640 1 --2- 172.21.15.32:0/519039372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f045c1f6980 0x7f045c155a90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f045c06db40 tx=0x7f045400f580 comp rx=0 tx=0).stop 2024-03-19T06:23:05.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.231+0000 7f0462800640 1 -- 172.21.15.32:0/519039372 shutdown_connections 2024-03-19T06:23:05.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.231+0000 7f0462800640 1 --2- 172.21.15.32:0/519039372 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0438067660 0x7f0438069b20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.231+0000 7f0462800640 1 --2- 172.21.15.32:0/519039372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f045c1f6980 0x7f045c155a90 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.231+0000 7f0462800640 1 --2- 172.21.15.32:0/519039372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f045c0acff0 0x7f045c1420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.231+0000 7f0462800640 1 --2- 172.21.15.32:0/519039372 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0440004810 0x7f045c0ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.231+0000 7f0462800640 1 -- 172.21.15.32:0/519039372 >> 172.21.15.32:0/519039372 conn(0x7f045c0b1590 msgr2=0x7f045c158770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:05.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.231+0000 7f0462800640 1 -- 172.21.15.32:0/519039372 shutdown_connections 2024-03-19T06:23:05.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.231+0000 7f0462800640 1 -- 172.21.15.32:0/519039372 wait complete. 2024-03-19T06:23:05.237 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:23:05.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.391+0000 7fc865400640 1 Processor -- start 2024-03-19T06:23:05.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.391+0000 7fc865400640 1 -- start start 2024-03-19T06:23:05.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.395+0000 7fc865400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc86015a840 0x7fc86006f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.395+0000 7fc865400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc86006b450 0x7fc8600ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.395+0000 7fc865400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8600af2d0 con 0x7fc8600aea70 2024-03-19T06:23:05.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.395+0000 7fc865400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8600cdc20 con 0x7fc86015a840 2024-03-19T06:23:05.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.395+0000 7fc865400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86015eea0 con 0x7fc86006b450 2024-03-19T06:23:05.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.395+0000 7fc85e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc86015a840 0x7fc86006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.395+0000 7fc85e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc86015a840 0x7fc86006f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33656/0 (socket says 172.21.15.32:33656) 2024-03-19T06:23:05.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.395+0000 7fc85e800640 1 -- 172.21.15.32:0/4293582797 learned_addr learned my addr 172.21.15.32:0/4293582797 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:05.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.395+0000 7fc85f200640 1 --2- 172.21.15.32:0/4293582797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc86006b450 0x7fc8600ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.395+0000 7fc85e800640 1 -- 172.21.15.32:0/4293582797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc86006b450 msgr2=0x7fc8600ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:05.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.395+0000 7fc85e800640 1 --2- 172.21.15.32:0/4293582797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc86006b450 0x7fc8600ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.395+0000 7fc85e800640 1 -- 172.21.15.32:0/4293582797 >> v1:172.21.15.171:6789/0 conn(0x7fc8600aea70 legacy=0x7fc86006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.395+0000 7fc85e800640 1 -- 172.21.15.32:0/4293582797 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86015f180 con 0x7fc86015a840 2024-03-19T06:23:05.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.399+0000 7fc85e800640 1 --2- 172.21.15.32:0/4293582797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc86015a840 0x7fc86006f040 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc850009870 tx=0x7fc85001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d006f06bb26f71 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:05.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.399+0000 7fc85de00640 1 -- 172.21.15.32:0/4293582797 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8500ab660 con 0x7fc86015a840 2024-03-19T06:23:05.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.399+0000 7fc85de00640 1 -- 172.21.15.32:0/4293582797 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8500b0070 con 0x7fc86015a840 2024-03-19T06:23:05.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.399+0000 7fc85de00640 1 -- 172.21.15.32:0/4293582797 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8500aba20 con 0x7fc86015a840 2024-03-19T06:23:05.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.399+0000 7fc865400640 1 -- 172.21.15.32:0/4293582797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc86015a840 msgr2=0x7fc86006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.399+0000 7fc865400640 1 --2- 172.21.15.32:0/4293582797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc86015a840 0x7fc86006f040 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc850009870 tx=0x7fc85001c400 comp rx=0 tx=0).stop 2024-03-19T06:23:05.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.399+0000 7fc865400640 1 -- 172.21.15.32:0/4293582797 shutdown_connections 2024-03-19T06:23:05.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.399+0000 7fc865400640 1 --2- 172.21.15.32:0/4293582797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc86006b450 0x7fc8600ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.399+0000 7fc865400640 1 --2- 172.21.15.32:0/4293582797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc86015a840 0x7fc86006f040 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.399+0000 7fc865400640 1 -- 172.21.15.32:0/4293582797 >> 172.21.15.32:0/4293582797 conn(0x7fc8600b1590 msgr2=0x7fc8600b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:05.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.399+0000 7fc865400640 1 -- 172.21.15.32:0/4293582797 shutdown_connections 2024-03-19T06:23:05.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.399+0000 7fc865400640 1 -- 172.21.15.32:0/4293582797 wait complete. 2024-03-19T06:23:05.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.399+0000 7fc865400640 1 Processor -- start 2024-03-19T06:23:05.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.399+0000 7fc865400640 1 -- start start 2024-03-19T06:23:05.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc865400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc86006b450 0x7fc8601529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc865400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8600aea70 0x7fc860146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc865400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc86015a840 0x7fc8601532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc865400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8600cef80 con 0x7fc8600aea70 2024-03-19T06:23:05.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc865400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8600cee00 con 0x7fc86015a840 2024-03-19T06:23:05.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc865400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8600cf100 con 0x7fc86006b450 2024-03-19T06:23:05.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc857e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8600aea70 0x7fc860146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc857e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8600aea70 0x7fc860146690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33658/0 (socket says 172.21.15.32:33658) 2024-03-19T06:23:05.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc857e00640 1 -- 172.21.15.32:0/3550637370 learned_addr learned my addr 172.21.15.32:0/3550637370 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:05.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc85e800640 1 --2- 172.21.15.32:0/3550637370 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc86006b450 0x7fc8601529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc85f200640 1 --2- 172.21.15.32:0/3550637370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc86015a840 0x7fc8601532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc857e00640 1 -- 172.21.15.32:0/3550637370 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc86006b450 msgr2=0x7fc8601529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc857e00640 1 --2- 172.21.15.32:0/3550637370 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc86006b450 0x7fc8601529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc857e00640 1 -- 172.21.15.32:0/3550637370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc86015a840 msgr2=0x7fc8601532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc857e00640 1 --2- 172.21.15.32:0/3550637370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc86015a840 0x7fc8601532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc857e00640 1 -- 172.21.15.32:0/3550637370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc860153c10 con 0x7fc8600aea70 2024-03-19T06:23:05.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc857e00640 1 --2- 172.21.15.32:0/3550637370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8600aea70 0x7fc860146690 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc84800c340 tx=0x7fc84800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:05.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc856a00640 1 -- 172.21.15.32:0/3550637370 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8480052d0 con 0x7fc8600aea70 2024-03-19T06:23:05.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc856a00640 1 -- 172.21.15.32:0/3550637370 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc848005470 con 0x7fc8600aea70 2024-03-19T06:23:05.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc856a00640 1 -- 172.21.15.32:0/3550637370 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc848007260 con 0x7fc8600aea70 2024-03-19T06:23:05.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc865400640 1 -- 172.21.15.32:0/3550637370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc860153ef0 con 0x7fc8600aea70 2024-03-19T06:23:05.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc865400640 1 -- 172.21.15.32:0/3550637370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8601521f0 con 0x7fc8600aea70 2024-03-19T06:23:05.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc865400640 1 -- 172.21.15.32:0/3550637370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8600749e0 con 0x7fc8600aea70 2024-03-19T06:23:05.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.403+0000 7fc856a00640 1 -- 172.21.15.32:0/3550637370 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc848007400 con 0x7fc8600aea70 2024-03-19T06:23:05.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.407+0000 7fc856a00640 1 --2- 172.21.15.32:0/3550637370 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc83c067660 0x7fc83c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.407+0000 7fc856a00640 1 -- 172.21.15.32:0/3550637370 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fc848084d40 con 0x7fc8600aea70 2024-03-19T06:23:05.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.407+0000 7fc85e800640 1 --2- 172.21.15.32:0/3550637370 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc83c067660 0x7fc83c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.407+0000 7fc85e800640 1 --2- 172.21.15.32:0/3550637370 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc83c067660 0x7fc83c069b20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc8500af000 tx=0x7fc8500a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:05.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.411+0000 7fc856a00640 1 -- 172.21.15.32:0/3550637370 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fc848055270 con 0x7fc8600aea70 2024-03-19T06:23:05.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.571+0000 7fc865400640 1 -- 172.21.15.32:0/3550637370 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc860155240 con 0x7fc8600aea70 2024-03-19T06:23:05.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.571+0000 7fc856a00640 1 -- 172.21.15.32:0/3550637370 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc848059310 con 0x7fc8600aea70 2024-03-19T06:23:05.561 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:23:05.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.575+0000 7fc865400640 1 -- 172.21.15.32:0/3550637370 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc83c067660 msgr2=0x7fc83c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.575+0000 7fc865400640 1 --2- 172.21.15.32:0/3550637370 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc83c067660 0x7fc83c069b20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc8500af000 tx=0x7fc8500a7000 comp rx=0 tx=0).stop 2024-03-19T06:23:05.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.575+0000 7fc865400640 1 -- 172.21.15.32:0/3550637370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8600aea70 msgr2=0x7fc860146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.575+0000 7fc865400640 1 --2- 172.21.15.32:0/3550637370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8600aea70 0x7fc860146690 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc84800c340 tx=0x7fc84800c800 comp rx=0 tx=0).stop 2024-03-19T06:23:05.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.575+0000 7fc865400640 1 -- 172.21.15.32:0/3550637370 shutdown_connections 2024-03-19T06:23:05.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.575+0000 7fc865400640 1 --2- 172.21.15.32:0/3550637370 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc83c067660 0x7fc83c069b20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.575+0000 7fc865400640 1 --2- 172.21.15.32:0/3550637370 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc86015a840 0x7fc8601532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.575+0000 7fc865400640 1 --2- 172.21.15.32:0/3550637370 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8600aea70 0x7fc860146690 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.575+0000 7fc865400640 1 --2- 172.21.15.32:0/3550637370 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc86006b450 0x7fc8601529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.575+0000 7fc865400640 1 -- 172.21.15.32:0/3550637370 >> 172.21.15.32:0/3550637370 conn(0x7fc8600b1590 msgr2=0x7fc860157380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:05.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.575+0000 7fc865400640 1 -- 172.21.15.32:0/3550637370 shutdown_connections 2024-03-19T06:23:05.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.575+0000 7fc865400640 1 -- 172.21.15.32:0/3550637370 wait complete. 2024-03-19T06:23:05.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:23:05.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.739+0000 7fe9a5000640 1 Processor -- start 2024-03-19T06:23:05.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.739+0000 7fe9a5000640 1 -- start start 2024-03-19T06:23:05.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.739+0000 7fe9a5000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9a00cf7c0 0x7fe9a00b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.739+0000 7fe9a5000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe9a0161650 0x7fe9a0161ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.739+0000 7fe9a5000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a006ec30 con 0x7fe9a015e060 2024-03-19T06:23:05.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.739+0000 7fe9a5000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a0161ff0 con 0x7fe9a0161650 2024-03-19T06:23:05.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.739+0000 7fe9a5000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a006ef10 con 0x7fe9a00cf7c0 2024-03-19T06:23:05.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.739+0000 7fe99de00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9a00cf7c0 0x7fe9a00b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.739+0000 7fe995400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe9a0161650 0x7fe9a0161ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.739+0000 7fe99de00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9a00cf7c0 0x7fe9a00b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:56656/0 (socket says 172.21.15.32:56656) 2024-03-19T06:23:05.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.739+0000 7fe99de00640 1 -- 172.21.15.32:0/1174701940 learned_addr learned my addr 172.21.15.32:0/1174701940 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:05.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.739+0000 7fe99de00640 1 -- 172.21.15.32:0/1174701940 >> v2:172.21.15.171:3300/0 conn(0x7fe9a0161650 msgr2=0x7fe9a0161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:05.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.739+0000 7fe99de00640 1 --2- 172.21.15.32:0/1174701940 >> v2:172.21.15.171:3300/0 conn(0x7fe9a0161650 0x7fe9a0161ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.739+0000 7fe99d400640 1 -- 172.21.15.32:0/1174701940 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865423261 0 0) 0x7fe9a006ec30 con 0x7fe9a015e060 2024-03-19T06:23:05.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.739+0000 7fe99de00640 1 -- 172.21.15.32:0/1174701940 >> v1:172.21.15.171:6789/0 conn(0x7fe9a015e060 legacy=0x7fe9a015e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.739+0000 7fe99de00640 1 -- 172.21.15.32:0/1174701940 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a006f1f0 con 0x7fe9a00cf7c0 2024-03-19T06:23:05.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.743+0000 7fe99de00640 1 --2- 172.21.15.32:0/1174701940 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9a00cf7c0 0x7fe9a00b3850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe990009e50 tx=0x7fe99001ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50c110aa235935d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:05.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.743+0000 7fe99d400640 1 -- 172.21.15.32:0/1174701940 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9900a58d0 con 0x7fe9a00cf7c0 2024-03-19T06:23:05.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.743+0000 7fe99d400640 1 -- 172.21.15.32:0/1174701940 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9900a5a70 con 0x7fe9a00cf7c0 2024-03-19T06:23:05.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.743+0000 7fe99d400640 1 -- 172.21.15.32:0/1174701940 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9900a5e40 con 0x7fe9a00cf7c0 2024-03-19T06:23:05.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.743+0000 7fe9a5000640 1 -- 172.21.15.32:0/1174701940 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9a00cf7c0 msgr2=0x7fe9a00b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.743+0000 7fe9a5000640 1 --2- 172.21.15.32:0/1174701940 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9a00cf7c0 0x7fe9a00b3850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe990009e50 tx=0x7fe99001ca00 comp rx=0 tx=0).stop 2024-03-19T06:23:05.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.743+0000 7fe9a5000640 1 -- 172.21.15.32:0/1174701940 shutdown_connections 2024-03-19T06:23:05.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.743+0000 7fe9a5000640 1 --2- 172.21.15.32:0/1174701940 >> v2:172.21.15.171:3300/0 conn(0x7fe9a0161650 0x7fe9a0161ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.743+0000 7fe9a5000640 1 --2- 172.21.15.32:0/1174701940 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9a00cf7c0 0x7fe9a00b3850 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.743+0000 7fe9a5000640 1 -- 172.21.15.32:0/1174701940 >> 172.21.15.32:0/1174701940 conn(0x7fe9a00b2480 msgr2=0x7fe9a00cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:05.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.743+0000 7fe9a5000640 1 -- 172.21.15.32:0/1174701940 shutdown_connections 2024-03-19T06:23:05.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.743+0000 7fe9a5000640 1 -- 172.21.15.32:0/1174701940 wait complete. 2024-03-19T06:23:05.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe9a5000640 1 Processor -- start 2024-03-19T06:23:05.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe9a5000640 1 -- start start 2024-03-19T06:23:05.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe9a5000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9a00cf7c0 0x7fe9a01534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe9a5000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9a015e060 0x7fe9a0168040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe9a5000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9a0161650 0x7fe9a0141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe9a5000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a00b3100 con 0x7fe9a0161650 2024-03-19T06:23:05.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe9a5000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a00b2f80 con 0x7fe9a00cf7c0 2024-03-19T06:23:05.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe9a5000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a00b3d90 con 0x7fe9a015e060 2024-03-19T06:23:05.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe99e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9a0161650 0x7fe9a0141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe99e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9a0161650 0x7fe9a0141c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33674/0 (socket says 172.21.15.32:33674) 2024-03-19T06:23:05.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe99e800640 1 -- 172.21.15.32:0/2490892790 learned_addr learned my addr 172.21.15.32:0/2490892790 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:05.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe995400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9a015e060 0x7fe9a0168040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe99de00640 1 --2- 172.21.15.32:0/2490892790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9a00cf7c0 0x7fe9a01534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe99e800640 1 -- 172.21.15.32:0/2490892790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9a015e060 msgr2=0x7fe9a0168040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe99e800640 1 --2- 172.21.15.32:0/2490892790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9a015e060 0x7fe9a0168040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe99e800640 1 -- 172.21.15.32:0/2490892790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9a00cf7c0 msgr2=0x7fe9a01534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe99e800640 1 --2- 172.21.15.32:0/2490892790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9a00cf7c0 0x7fe9a01534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe99e800640 1 -- 172.21.15.32:0/2490892790 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a013ec10 con 0x7fe9a0161650 2024-03-19T06:23:05.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe99e800640 1 --2- 172.21.15.32:0/2490892790 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9a0161650 0x7fe9a0141c70 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe99800c450 tx=0x7fe99800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:05.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe996a00640 1 -- 172.21.15.32:0/2490892790 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998017070 con 0x7fe9a0161650 2024-03-19T06:23:05.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe996a00640 1 -- 172.21.15.32:0/2490892790 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe998003600 con 0x7fe9a0161650 2024-03-19T06:23:05.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe9a5000640 1 -- 172.21.15.32:0/2490892790 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a013eef0 con 0x7fe9a0161650 2024-03-19T06:23:05.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe996a00640 1 -- 172.21.15.32:0/2490892790 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9980039f0 con 0x7fe9a0161650 2024-03-19T06:23:05.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe9a5000640 1 -- 172.21.15.32:0/2490892790 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a013f4b0 con 0x7fe9a0161650 2024-03-19T06:23:05.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.747+0000 7fe9a5000640 1 -- 172.21.15.32:0/2490892790 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a00749e0 con 0x7fe9a0161650 2024-03-19T06:23:05.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.751+0000 7fe996a00640 1 -- 172.21.15.32:0/2490892790 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe99801a070 con 0x7fe9a0161650 2024-03-19T06:23:05.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.751+0000 7fe996a00640 1 --2- 172.21.15.32:0/2490892790 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe97c067660 0x7fe97c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:05.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.751+0000 7fe996a00640 1 -- 172.21.15.32:0/2490892790 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fe998084ef0 con 0x7fe9a0161650 2024-03-19T06:23:05.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.751+0000 7fe99de00640 1 --2- 172.21.15.32:0/2490892790 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe97c067660 0x7fe97c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:05.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.751+0000 7fe99de00640 1 --2- 172.21.15.32:0/2490892790 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe97c067660 0x7fe97c069b20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe9900ae000 tx=0x7fe9900a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:05.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.755+0000 7fe996a00640 1 -- 172.21.15.32:0/2490892790 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fe998055260 con 0x7fe9a0161650 2024-03-19T06:23:05.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.915+0000 7fe9a5000640 1 -- 172.21.15.32:0/2490892790 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe9a00d0cc0 con 0x7fe9a0161650 2024-03-19T06:23:05.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.915+0000 7fe996a00640 1 -- 172.21.15.32:0/2490892790 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe998059300 con 0x7fe9a0161650 2024-03-19T06:23:05.905 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:23:05.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.919+0000 7fe9a5000640 1 -- 172.21.15.32:0/2490892790 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe97c067660 msgr2=0x7fe97c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.919+0000 7fe9a5000640 1 --2- 172.21.15.32:0/2490892790 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe97c067660 0x7fe97c069b20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe9900ae000 tx=0x7fe9900a7070 comp rx=0 tx=0).stop 2024-03-19T06:23:05.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.919+0000 7fe9a5000640 1 -- 172.21.15.32:0/2490892790 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9a0161650 msgr2=0x7fe9a0141c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:05.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.919+0000 7fe9a5000640 1 --2- 172.21.15.32:0/2490892790 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9a0161650 0x7fe9a0141c70 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe99800c450 tx=0x7fe99800c910 comp rx=0 tx=0).stop 2024-03-19T06:23:05.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.919+0000 7fe9a5000640 1 -- 172.21.15.32:0/2490892790 shutdown_connections 2024-03-19T06:23:05.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.919+0000 7fe9a5000640 1 --2- 172.21.15.32:0/2490892790 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe97c067660 0x7fe97c069b20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.919+0000 7fe9a5000640 1 --2- 172.21.15.32:0/2490892790 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9a0161650 0x7fe9a0141c70 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.919+0000 7fe9a5000640 1 --2- 172.21.15.32:0/2490892790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9a015e060 0x7fe9a0168040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.919+0000 7fe9a5000640 1 --2- 172.21.15.32:0/2490892790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9a00cf7c0 0x7fe9a01534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:05.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.919+0000 7fe9a5000640 1 -- 172.21.15.32:0/2490892790 >> 172.21.15.32:0/2490892790 conn(0x7fe9a00b2480 msgr2=0x7fe9a0154d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:05.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.919+0000 7fe9a5000640 1 -- 172.21.15.32:0/2490892790 shutdown_connections 2024-03-19T06:23:05.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:05.919+0000 7fe9a5000640 1 -- 172.21.15.32:0/2490892790 wait complete. 2024-03-19T06:23:05.927 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-03-19T06:23:06.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.083+0000 7f6165000640 1 Processor -- start 2024-03-19T06:23:06.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.083+0000 7f6165000640 1 -- start start 2024-03-19T06:23:06.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.083+0000 7f6165000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f61600b3620 0x7f61600b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.083+0000 7f6165000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f61600cc6c0 0x7f61600ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.083+0000 7f6165000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61600cbf00 con 0x7f616015dbb0 2024-03-19T06:23:06.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.083+0000 7f6165000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61600b3fd0 con 0x7f61600b3620 2024-03-19T06:23:06.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.083+0000 7f6165000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616006cb20 con 0x7f61600cc6c0 2024-03-19T06:23:06.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.083+0000 7f6157e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f61600b3620 0x7f61600b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.083+0000 7f6157e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f61600b3620 0x7f61600b3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33684/0 (socket says 172.21.15.32:33684) 2024-03-19T06:23:06.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.083+0000 7f6157e00640 1 -- 172.21.15.32:0/1514601610 learned_addr learned my addr 172.21.15.32:0/1514601610 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:06.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.083+0000 7f615e800640 1 --2- 172.21.15.32:0/1514601610 >> v2:172.21.15.171:3300/0 conn(0x7f61600cc6c0 0x7f61600ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.083+0000 7f6157e00640 1 -- 172.21.15.32:0/1514601610 >> v2:172.21.15.171:3300/0 conn(0x7f61600cc6c0 msgr2=0x7f61600ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:06.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.083+0000 7f6157e00640 1 --2- 172.21.15.32:0/1514601610 >> v2:172.21.15.171:3300/0 conn(0x7f61600cc6c0 0x7f61600ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.083+0000 7f6157e00640 1 -- 172.21.15.32:0/1514601610 >> v1:172.21.15.171:6789/0 conn(0x7f616015dbb0 legacy=0x7f616006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.083+0000 7f6157e00640 1 -- 172.21.15.32:0/1514601610 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616006ce00 con 0x7f61600b3620 2024-03-19T06:23:06.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.083+0000 7f615e800640 1 --2- 172.21.15.32:0/1514601610 >> v2:172.21.15.171:3300/0 conn(0x7f61600cc6c0 0x7f61600ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:06.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.087+0000 7f6157e00640 1 --2- 172.21.15.32:0/1514601610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61600b3620 0x7f61600b3a90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f61600b7970 tx=0x7f614801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20015fa17455abaa server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:06.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.087+0000 7f615d400640 1 -- 172.21.15.32:0/1514601610 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61480b5070 con 0x7f61600b3620 2024-03-19T06:23:06.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.087+0000 7f615d400640 1 -- 172.21.15.32:0/1514601610 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61480a8a10 con 0x7f61600b3620 2024-03-19T06:23:06.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.087+0000 7f615d400640 1 -- 172.21.15.32:0/1514601610 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61480a8de0 con 0x7f61600b3620 2024-03-19T06:23:06.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.087+0000 7f6165000640 1 -- 172.21.15.32:0/1514601610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61600b3620 msgr2=0x7f61600b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.087+0000 7f6165000640 1 --2- 172.21.15.32:0/1514601610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61600b3620 0x7f61600b3a90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f61600b7970 tx=0x7f614801ed10 comp rx=0 tx=0).stop 2024-03-19T06:23:06.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.087+0000 7f6165000640 1 -- 172.21.15.32:0/1514601610 shutdown_connections 2024-03-19T06:23:06.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.087+0000 7f6165000640 1 --2- 172.21.15.32:0/1514601610 >> v2:172.21.15.171:3300/0 conn(0x7f61600cc6c0 0x7f61600ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.087+0000 7f6165000640 1 --2- 172.21.15.32:0/1514601610 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61600b3620 0x7f61600b3a90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.087+0000 7f6165000640 1 -- 172.21.15.32:0/1514601610 >> 172.21.15.32:0/1514601610 conn(0x7f6160066ca0 msgr2=0x7f61600670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:06.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.087+0000 7f6165000640 1 -- 172.21.15.32:0/1514601610 shutdown_connections 2024-03-19T06:23:06.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.087+0000 7f6165000640 1 -- 172.21.15.32:0/1514601610 wait complete. 2024-03-19T06:23:06.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f6165000640 1 Processor -- start 2024-03-19T06:23:06.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f6165000640 1 -- start start 2024-03-19T06:23:06.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f6165000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61600b3620 0x7f6160153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f6165000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61600cc6c0 0x7f61601f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f6165000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f616015dbb0 0x7f61600c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f6165000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616006d910 con 0x7f616015dbb0 2024-03-19T06:23:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f6165000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61600cc1a0 con 0x7f61600cc6c0 2024-03-19T06:23:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f6165000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616015df90 con 0x7f61600b3620 2024-03-19T06:23:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f615e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f616015dbb0 0x7f61600c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f615e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f616015dbb0 0x7f61600c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33690/0 (socket says 172.21.15.32:33690) 2024-03-19T06:23:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f615e800640 1 -- 172.21.15.32:0/21379106 learned_addr learned my addr 172.21.15.32:0/21379106 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f615de00640 1 --2- 172.21.15.32:0/21379106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61600b3620 0x7f6160153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f6157e00640 1 --2- 172.21.15.32:0/21379106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61600cc6c0 0x7f61601f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f615e800640 1 -- 172.21.15.32:0/21379106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61600b3620 msgr2=0x7f6160153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f615e800640 1 --2- 172.21.15.32:0/21379106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61600b3620 0x7f6160153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f615e800640 1 -- 172.21.15.32:0/21379106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61600cc6c0 msgr2=0x7f61601f3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f615e800640 1 --2- 172.21.15.32:0/21379106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61600cc6c0 0x7f61601f3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f615e800640 1 -- 172.21.15.32:0/21379106 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61601f41a0 con 0x7f616015dbb0 2024-03-19T06:23:06.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f615e800640 1 --2- 172.21.15.32:0/21379106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f616015dbb0 0x7f61600c9c20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6158009fa0 tx=0x7f615800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:06.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f6156000640 1 -- 172.21.15.32:0/21379106 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615801a070 con 0x7f616015dbb0 2024-03-19T06:23:06.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f6156000640 1 -- 172.21.15.32:0/21379106 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6158003bc0 con 0x7f616015dbb0 2024-03-19T06:23:06.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f6156000640 1 -- 172.21.15.32:0/21379106 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158004030 con 0x7f616015dbb0 2024-03-19T06:23:06.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f6165000640 1 -- 172.21.15.32:0/21379106 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61600acc90 con 0x7f616015dbb0 2024-03-19T06:23:06.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f6165000640 1 -- 172.21.15.32:0/21379106 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61600ad250 con 0x7f616015dbb0 2024-03-19T06:23:06.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.091+0000 7f6165000640 1 -- 172.21.15.32:0/21379106 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61600749e0 con 0x7f616015dbb0 2024-03-19T06:23:06.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.095+0000 7f6156000640 1 -- 172.21.15.32:0/21379106 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f615801d070 con 0x7f616015dbb0 2024-03-19T06:23:06.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.095+0000 7f6156000640 1 --2- 172.21.15.32:0/21379106 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f613c067660 0x7f613c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.095+0000 7f6156000640 1 -- 172.21.15.32:0/21379106 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f6158085c30 con 0x7f616015dbb0 2024-03-19T06:23:06.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.095+0000 7f615de00640 1 --2- 172.21.15.32:0/21379106 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f613c067660 0x7f613c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.095+0000 7f615de00640 1 --2- 172.21.15.32:0/21379106 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f613c067660 0x7f613c069b20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6150007fd0 tx=0x7f6150009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:06.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.099+0000 7f6156000640 1 -- 172.21.15.32:0/21379106 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f615808c080 con 0x7f616015dbb0 2024-03-19T06:23:06.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.263+0000 7f6165000640 1 -- 172.21.15.32:0/21379106 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f616006fdd0 con 0x7f616015dbb0 2024-03-19T06:23:06.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.263+0000 7f6156000640 1 -- 172.21.15.32:0/21379106 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v38) v1 ==== 97+0+11 (secure 0 0 0) 0x7f6158010070 con 0x7f616015dbb0 2024-03-19T06:23:06.251 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:23:06.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.263+0000 7f6165000640 1 -- 172.21.15.32:0/21379106 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f613c067660 msgr2=0x7f613c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.263+0000 7f6165000640 1 --2- 172.21.15.32:0/21379106 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f613c067660 0x7f613c069b20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6150007fd0 tx=0x7f6150009040 comp rx=0 tx=0).stop 2024-03-19T06:23:06.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.263+0000 7f6165000640 1 -- 172.21.15.32:0/21379106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f616015dbb0 msgr2=0x7f61600c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.263+0000 7f6165000640 1 --2- 172.21.15.32:0/21379106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f616015dbb0 0x7f61600c9c20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6158009fa0 tx=0x7f615800d560 comp rx=0 tx=0).stop 2024-03-19T06:23:06.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.263+0000 7f6165000640 1 -- 172.21.15.32:0/21379106 shutdown_connections 2024-03-19T06:23:06.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.263+0000 7f6165000640 1 --2- 172.21.15.32:0/21379106 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f613c067660 0x7f613c069b20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.263+0000 7f6165000640 1 --2- 172.21.15.32:0/21379106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f616015dbb0 0x7f61600c9c20 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.263+0000 7f6165000640 1 --2- 172.21.15.32:0/21379106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61600cc6c0 0x7f61601f3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.263+0000 7f6165000640 1 --2- 172.21.15.32:0/21379106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61600b3620 0x7f6160153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.263+0000 7f6165000640 1 -- 172.21.15.32:0/21379106 >> 172.21.15.32:0/21379106 conn(0x7f6160066ca0 msgr2=0x7f6160067080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:06.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.263+0000 7f6165000640 1 -- 172.21.15.32:0/21379106 shutdown_connections 2024-03-19T06:23:06.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.263+0000 7f6165000640 1 -- 172.21.15.32:0/21379106 wait complete. 2024-03-19T06:23:06.272 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:23:06.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.423+0000 7f24b4800640 1 Processor -- start 2024-03-19T06:23:06.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.423+0000 7f24b4800640 1 -- start start 2024-03-19T06:23:06.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.427+0000 7f24b4800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24ac0ae0b0 0x7f24ac0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.427+0000 7f24b4800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f24ac15dff0 0x7f24ac06bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.427+0000 7f24b4800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac15e520 con 0x7f24ac06c290 2024-03-19T06:23:06.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.427+0000 7f24b4800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ac15f1b0 con 0x7f24ac15dff0 2024-03-19T06:23:06.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.427+0000 7f24b4800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac15e800 con 0x7f24ac0ae0b0 2024-03-19T06:23:06.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.427+0000 7f24b1400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f24ac15dff0 0x7f24ac06bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.427+0000 7f24b1400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f24ac15dff0 0x7f24ac06bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33696/0 (socket says 172.21.15.32:33696) 2024-03-19T06:23:06.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.427+0000 7f24b1400640 1 -- 172.21.15.32:0/551531946 learned_addr learned my addr 172.21.15.32:0/551531946 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:06.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.427+0000 7f24b1e00640 1 --2- 172.21.15.32:0/551531946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24ac0ae0b0 0x7f24ac0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.427+0000 7f24b1400640 1 -- 172.21.15.32:0/551531946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24ac0ae0b0 msgr2=0x7f24ac0acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:06.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.427+0000 7f24b1400640 1 --2- 172.21.15.32:0/551531946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24ac0ae0b0 0x7f24ac0acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.427+0000 7f24b1400640 1 -- 172.21.15.32:0/551531946 >> v1:172.21.15.171:6789/0 conn(0x7f24ac06c290 legacy=0x7f24ac154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.427+0000 7f24b1400640 1 -- 172.21.15.32:0/551531946 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac15eae0 con 0x7f24ac15dff0 2024-03-19T06:23:06.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b1400640 1 --2- 172.21.15.32:0/551531946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ac15dff0 0x7f24ac06bd50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f249c009870 tx=0x7f249c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdecd697186b803 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:06.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b0a00640 1 -- 172.21.15.32:0/551531946 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c0b0070 con 0x7f24ac15dff0 2024-03-19T06:23:06.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b0a00640 1 -- 172.21.15.32:0/551531946 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c0ab600 con 0x7f24ac15dff0 2024-03-19T06:23:06.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b0a00640 1 -- 172.21.15.32:0/551531946 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c0ab9d0 con 0x7f24ac15dff0 2024-03-19T06:23:06.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b4800640 1 -- 172.21.15.32:0/551531946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ac15dff0 msgr2=0x7f24ac06bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b4800640 1 --2- 172.21.15.32:0/551531946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ac15dff0 0x7f24ac06bd50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f249c009870 tx=0x7f249c01c4a0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b4800640 1 -- 172.21.15.32:0/551531946 shutdown_connections 2024-03-19T06:23:06.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b4800640 1 --2- 172.21.15.32:0/551531946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ac15dff0 0x7f24ac06bd50 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b4800640 1 --2- 172.21.15.32:0/551531946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24ac0ae0b0 0x7f24ac0acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b4800640 1 -- 172.21.15.32:0/551531946 >> 172.21.15.32:0/551531946 conn(0x7f24ac071c50 msgr2=0x7f24ac072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:06.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b4800640 1 -- 172.21.15.32:0/551531946 shutdown_connections 2024-03-19T06:23:06.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b4800640 1 -- 172.21.15.32:0/551531946 wait complete. 2024-03-19T06:23:06.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b4800640 1 Processor -- start 2024-03-19T06:23:06.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b4800640 1 -- start start 2024-03-19T06:23:06.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b4800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24ac06c290 0x7f24ac1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b4800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ac0ae0b0 0x7f24ac14c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b4800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24ac15dff0 0x7f24ac1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b4800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac15f640 con 0x7f24ac0ae0b0 2024-03-19T06:23:06.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b4800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac06c6a0 con 0x7f24ac06c290 2024-03-19T06:23:06.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b4800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac15f7c0 con 0x7f24ac15dff0 2024-03-19T06:23:06.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b1400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ac0ae0b0 0x7f24ac14c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b1400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ac0ae0b0 0x7f24ac14c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33702/0 (socket says 172.21.15.32:33702) 2024-03-19T06:23:06.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.431+0000 7f24b1400640 1 -- 172.21.15.32:0/2153020608 learned_addr learned my addr 172.21.15.32:0/2153020608 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:06.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.435+0000 7f24b1e00640 1 --2- 172.21.15.32:0/2153020608 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24ac06c290 0x7f24ac1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.435+0000 7f24b2800640 1 --2- 172.21.15.32:0/2153020608 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24ac15dff0 0x7f24ac1521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.435+0000 7f24b1400640 1 -- 172.21.15.32:0/2153020608 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24ac15dff0 msgr2=0x7f24ac1521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.435+0000 7f24b1400640 1 --2- 172.21.15.32:0/2153020608 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24ac15dff0 0x7f24ac1521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.435+0000 7f24b1400640 1 -- 172.21.15.32:0/2153020608 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24ac06c290 msgr2=0x7f24ac1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.435+0000 7f24b1400640 1 --2- 172.21.15.32:0/2153020608 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24ac06c290 0x7f24ac1519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.435+0000 7f24b1400640 1 -- 172.21.15.32:0/2153020608 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac151f90 con 0x7f24ac0ae0b0 2024-03-19T06:23:06.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.435+0000 7f24b2800640 1 --2- 172.21.15.32:0/2153020608 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24ac15dff0 0x7f24ac1521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:06.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.435+0000 7f24b1400640 1 --2- 172.21.15.32:0/2153020608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ac0ae0b0 0x7f24ac14c540 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f249c0ae040 tx=0x7f249c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:06.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.435+0000 7f24a6000640 1 -- 172.21.15.32:0/2153020608 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c0b0040 con 0x7f24ac0ae0b0 2024-03-19T06:23:06.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.435+0000 7f24a6000640 1 -- 172.21.15.32:0/2153020608 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c0b4640 con 0x7f24ac0ae0b0 2024-03-19T06:23:06.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.435+0000 7f24a6000640 1 -- 172.21.15.32:0/2153020608 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c0b4a30 con 0x7f24ac0ae0b0 2024-03-19T06:23:06.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.435+0000 7f24b4800640 1 -- 172.21.15.32:0/2153020608 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ac14f6a0 con 0x7f24ac0ae0b0 2024-03-19T06:23:06.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.435+0000 7f24b4800640 1 -- 172.21.15.32:0/2153020608 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ac14fc60 con 0x7f24ac0ae0b0 2024-03-19T06:23:06.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.435+0000 7f24b4800640 1 -- 172.21.15.32:0/2153020608 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ac0749e0 con 0x7f24ac0ae0b0 2024-03-19T06:23:06.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.435+0000 7f24a6000640 1 -- 172.21.15.32:0/2153020608 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f249c0ab4c0 con 0x7f24ac0ae0b0 2024-03-19T06:23:06.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.439+0000 7f24a6000640 1 --2- 172.21.15.32:0/2153020608 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2490067660 0x7f2490069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.439+0000 7f24a6000640 1 -- 172.21.15.32:0/2153020608 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f249c11f560 con 0x7f24ac0ae0b0 2024-03-19T06:23:06.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.439+0000 7f24b1e00640 1 --2- 172.21.15.32:0/2153020608 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2490067660 0x7f2490069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.439+0000 7f24b1e00640 1 --2- 172.21.15.32:0/2153020608 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2490067660 0x7f2490069b20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0b0040 tx=0x7f24a0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:06.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.443+0000 7f24a6000640 1 -- 172.21.15.32:0/2153020608 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f249c016150 con 0x7f24ac0ae0b0 2024-03-19T06:23:06.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.639+0000 7f24b4800640 1 -- 172.21.15.32:0/2153020608 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24ac06cc10 con 0x7f24ac0ae0b0 2024-03-19T06:23:06.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.639+0000 7f24a6000640 1 -- 172.21.15.32:0/2153020608 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f249c0f00c0 con 0x7f24ac0ae0b0 2024-03-19T06:23:06.627 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:06.627 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3394778234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3394778234},{"type":"v1","addr":"172.21.15.171:6836","nonce":3394778234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2000291327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2000291327},{"type":"v1","addr":"172.21.15.171:6837","nonce":2000291327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/4039299860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":4039299860},{"type":"v1","addr":"172.21.15.32:6833","nonce":4039299860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:22:12.167128+0000","modified":"2024-03-19T06:22:26.236754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/2680502611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":2680502611},{"type":"v1","addr":"172.21.15.32:6835","nonce":2680502611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-19T06:23:06.627 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 18 2024-03-19T06:23:06.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.639+0000 7f24b4800640 1 -- 172.21.15.32:0/2153020608 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2490067660 msgr2=0x7f2490069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.639+0000 7f24b4800640 1 --2- 172.21.15.32:0/2153020608 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2490067660 0x7f2490069b20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0b0040 tx=0x7f24a0008040 comp rx=0 tx=0).stop 2024-03-19T06:23:06.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.639+0000 7f24b4800640 1 -- 172.21.15.32:0/2153020608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ac0ae0b0 msgr2=0x7f24ac14c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.639+0000 7f24b4800640 1 --2- 172.21.15.32:0/2153020608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ac0ae0b0 0x7f24ac14c540 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f249c0ae040 tx=0x7f249c019240 comp rx=0 tx=0).stop 2024-03-19T06:23:06.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.639+0000 7f24b4800640 1 -- 172.21.15.32:0/2153020608 shutdown_connections 2024-03-19T06:23:06.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.639+0000 7f24b4800640 1 --2- 172.21.15.32:0/2153020608 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2490067660 0x7f2490069b20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.639+0000 7f24b4800640 1 --2- 172.21.15.32:0/2153020608 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24ac15dff0 0x7f24ac1521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.639+0000 7f24b4800640 1 --2- 172.21.15.32:0/2153020608 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24ac0ae0b0 0x7f24ac14c540 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.639+0000 7f24b4800640 1 --2- 172.21.15.32:0/2153020608 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24ac06c290 0x7f24ac1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.639+0000 7f24b4800640 1 -- 172.21.15.32:0/2153020608 >> 172.21.15.32:0/2153020608 conn(0x7f24ac071c50 msgr2=0x7f24ac06b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:06.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.639+0000 7f24b4800640 1 -- 172.21.15.32:0/2153020608 shutdown_connections 2024-03-19T06:23:06.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.639+0000 7f24b4800640 1 -- 172.21.15.32:0/2153020608 wait complete. 2024-03-19T06:23:06.648 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:23:06.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.799+0000 7efecf000640 1 Processor -- start 2024-03-19T06:23:06.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.799+0000 7efecf000640 1 -- start start 2024-03-19T06:23:06.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.799+0000 7efecf000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efec80ae0b0 0x7efec80acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.799+0000 7efecf000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec806c460 0x7efec8154130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.799+0000 7efecf000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec815e520 con 0x7efec815dff0 2024-03-19T06:23:06.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.799+0000 7efecf000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec815f1b0 con 0x7efec80ae0b0 2024-03-19T06:23:06.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.799+0000 7efecf000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec815e800 con 0x7efec806c460 2024-03-19T06:23:06.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.803+0000 7efec7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efec80ae0b0 0x7efec80acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.803+0000 7efec7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efec80ae0b0 0x7efec80acdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33708/0 (socket says 172.21.15.32:33708) 2024-03-19T06:23:06.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.803+0000 7efec7e00640 1 -- 172.21.15.32:0/505597798 learned_addr learned my addr 172.21.15.32:0/505597798 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:06.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.803+0000 7efecd000640 1 --2- 172.21.15.32:0/505597798 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec806c460 0x7efec8154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.803+0000 7efec7e00640 1 -- 172.21.15.32:0/505597798 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec806c460 msgr2=0x7efec8154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:06.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.803+0000 7efec7e00640 1 --2- 172.21.15.32:0/505597798 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec806c460 0x7efec8154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.803+0000 7efec7e00640 1 -- 172.21.15.32:0/505597798 >> v1:172.21.15.171:6789/0 conn(0x7efec815dff0 legacy=0x7efec806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.803+0000 7efec7e00640 1 -- 172.21.15.32:0/505597798 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec815eae0 con 0x7efec80ae0b0 2024-03-19T06:23:06.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.803+0000 7efec7e00640 1 --2- 172.21.15.32:0/505597798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efec80ae0b0 0x7efec80acdb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009870 tx=0x7efeb801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd7b0fd93ed92ed server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:06.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.803+0000 7efec7400640 1 -- 172.21.15.32:0/505597798 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb80b2070 con 0x7efec80ae0b0 2024-03-19T06:23:06.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.803+0000 7efec7400640 1 -- 172.21.15.32:0/505597798 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb80a9070 con 0x7efec80ae0b0 2024-03-19T06:23:06.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.803+0000 7efec7400640 1 -- 172.21.15.32:0/505597798 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb80ad880 con 0x7efec80ae0b0 2024-03-19T06:23:06.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecf000640 1 -- 172.21.15.32:0/505597798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efec80ae0b0 msgr2=0x7efec80acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecf000640 1 --2- 172.21.15.32:0/505597798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efec80ae0b0 0x7efec80acdb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009870 tx=0x7efeb801c560 comp rx=0 tx=0).stop 2024-03-19T06:23:06.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecf000640 1 -- 172.21.15.32:0/505597798 shutdown_connections 2024-03-19T06:23:06.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecf000640 1 --2- 172.21.15.32:0/505597798 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec806c460 0x7efec8154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecf000640 1 --2- 172.21.15.32:0/505597798 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efec80ae0b0 0x7efec80acdb0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecf000640 1 -- 172.21.15.32:0/505597798 >> 172.21.15.32:0/505597798 conn(0x7efec8071c50 msgr2=0x7efec8072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:06.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecf000640 1 -- 172.21.15.32:0/505597798 shutdown_connections 2024-03-19T06:23:06.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecf000640 1 -- 172.21.15.32:0/505597798 wait complete. 2024-03-19T06:23:06.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecf000640 1 Processor -- start 2024-03-19T06:23:06.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecf000640 1 -- start start 2024-03-19T06:23:06.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecf000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efec806c460 0x7efec8155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecf000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec80ae0b0 0x7efec814daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecf000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec815dff0 0x7efec814dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecf000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec815f7c0 con 0x7efec806c460 2024-03-19T06:23:06.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecf000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec815f640 con 0x7efec80ae0b0 2024-03-19T06:23:06.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecf000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec815f940 con 0x7efec815dff0 2024-03-19T06:23:06.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efec7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efec806c460 0x7efec8155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efec7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efec806c460 0x7efec8155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33716/0 (socket says 172.21.15.32:33716) 2024-03-19T06:23:06.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efec7e00640 1 -- 172.21.15.32:0/1031682966 learned_addr learned my addr 172.21.15.32:0/1031682966 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:06.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efecd000640 1 --2- 172.21.15.32:0/1031682966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec815dff0 0x7efec814dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efebf400640 1 --2- 172.21.15.32:0/1031682966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec80ae0b0 0x7efec814daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efec7e00640 1 -- 172.21.15.32:0/1031682966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec815dff0 msgr2=0x7efec814dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efec7e00640 1 --2- 172.21.15.32:0/1031682966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec815dff0 0x7efec814dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efec7e00640 1 -- 172.21.15.32:0/1031682966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec80ae0b0 msgr2=0x7efec814daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efec7e00640 1 --2- 172.21.15.32:0/1031682966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec80ae0b0 0x7efec814daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efec7e00640 1 -- 172.21.15.32:0/1031682966 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec813bad0 con 0x7efec806c460 2024-03-19T06:23:06.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efebf400640 1 --2- 172.21.15.32:0/1031682966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec80ae0b0 0x7efec814daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:06.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.807+0000 7efec7e00640 1 --2- 172.21.15.32:0/1031682966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efec806c460 0x7efec8155110 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7efeb80b0040 tx=0x7efeb801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:06.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.811+0000 7efec4c00640 1 -- 172.21.15.32:0/1031682966 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb80b2040 con 0x7efec806c460 2024-03-19T06:23:06.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.811+0000 7efec4c00640 1 -- 172.21.15.32:0/1031682966 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb80be070 con 0x7efec806c460 2024-03-19T06:23:06.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.811+0000 7efec4c00640 1 -- 172.21.15.32:0/1031682966 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb80b8660 con 0x7efec806c460 2024-03-19T06:23:06.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.811+0000 7efecf000640 1 -- 172.21.15.32:0/1031682966 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec813bdb0 con 0x7efec806c460 2024-03-19T06:23:06.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.811+0000 7efecf000640 1 -- 172.21.15.32:0/1031682966 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec814e7a0 con 0x7efec806c460 2024-03-19T06:23:06.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.811+0000 7efecf000640 1 -- 172.21.15.32:0/1031682966 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec814d090 con 0x7efec806c460 2024-03-19T06:23:06.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.811+0000 7efec4c00640 1 -- 172.21.15.32:0/1031682966 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7efeb80ab070 con 0x7efec806c460 2024-03-19T06:23:06.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.811+0000 7efec4c00640 1 --2- 172.21.15.32:0/1031682966 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efea4067660 0x7efea4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:06.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.811+0000 7efec4c00640 1 -- 172.21.15.32:0/1031682966 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7efeb811fbf0 con 0x7efec806c460 2024-03-19T06:23:06.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.811+0000 7efebf400640 1 --2- 172.21.15.32:0/1031682966 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efea4067660 0x7efea4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:06.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.815+0000 7efebf400640 1 --2- 172.21.15.32:0/1031682966 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efea4067660 0x7efea4069b20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efec815de10 tx=0x7efeb0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:06.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.815+0000 7efec4c00640 1 -- 172.21.15.32:0/1031682966 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7efeb8016150 con 0x7efec806c460 2024-03-19T06:23:06.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.983+0000 7efecf000640 1 -- 172.21.15.32:0/1031682966 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efec80680d0 con 0x7efec806c460 2024-03-19T06:23:06.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.983+0000 7efec4c00640 1 -- 172.21.15.32:0/1031682966 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18493 (secure 0 0 0) 0x7efeb80f0640 con 0x7efec806c460 2024-03-19T06:23:06.972 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:06.972 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":38,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:22:27.853859+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:22:09.983589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-19T06:22:11.172289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-19T06:22:25.205334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:23:06.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.983+0000 7efecf000640 1 -- 172.21.15.32:0/1031682966 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efea4067660 msgr2=0x7efea4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.983+0000 7efecf000640 1 --2- 172.21.15.32:0/1031682966 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efea4067660 0x7efea4069b20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efec815de10 tx=0x7efeb0009040 comp rx=0 tx=0).stop 2024-03-19T06:23:06.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.983+0000 7efecf000640 1 -- 172.21.15.32:0/1031682966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efec806c460 msgr2=0x7efec8155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:06.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.983+0000 7efecf000640 1 --2- 172.21.15.32:0/1031682966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efec806c460 0x7efec8155110 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7efeb80b0040 tx=0x7efeb801ada0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.983+0000 7efecf000640 1 -- 172.21.15.32:0/1031682966 shutdown_connections 2024-03-19T06:23:06.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.983+0000 7efecf000640 1 --2- 172.21.15.32:0/1031682966 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efea4067660 0x7efea4069b20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.983+0000 7efecf000640 1 --2- 172.21.15.32:0/1031682966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec815dff0 0x7efec814dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.983+0000 7efecf000640 1 --2- 172.21.15.32:0/1031682966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec80ae0b0 0x7efec814daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.983+0000 7efecf000640 1 --2- 172.21.15.32:0/1031682966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efec806c460 0x7efec8155110 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:06.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.983+0000 7efecf000640 1 -- 172.21.15.32:0/1031682966 >> 172.21.15.32:0/1031682966 conn(0x7efec8071c50 msgr2=0x7efec80afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:06.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.987+0000 7efecf000640 1 -- 172.21.15.32:0/1031682966 shutdown_connections 2024-03-19T06:23:06.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:06.987+0000 7efecf000640 1 -- 172.21.15.32:0/1031682966 wait complete. 2024-03-19T06:23:06.993 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-19T06:23:06.994 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:23:07.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.147+0000 7f0610800640 1 Processor -- start 2024-03-19T06:23:07.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.147+0000 7f0610800640 1 -- start start 2024-03-19T06:23:07.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.147+0000 7f0610800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f06080cc680 0x7f060815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.147+0000 7f0610800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06080b4c50 0x7f06080b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.147+0000 7f0610800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06080cb670 con 0x7f060815a7c0 2024-03-19T06:23:07.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.147+0000 7f0610800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06080b5600 con 0x7f06080cc680 2024-03-19T06:23:07.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.147+0000 7f0610800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060815e860 con 0x7f06080b4c50 2024-03-19T06:23:07.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.147+0000 7f060d400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f06080cc680 0x7f060815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.147+0000 7f060d400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f06080cc680 0x7f060815ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33720/0 (socket says 172.21.15.32:33720) 2024-03-19T06:23:07.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.147+0000 7f060d400640 1 -- 172.21.15.32:0/1034308443 learned_addr learned my addr 172.21.15.32:0/1034308443 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:07.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.147+0000 7f060e800640 1 --2- 172.21.15.32:0/1034308443 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06080b4c50 0x7f06080b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.147+0000 7f060d400640 1 -- 172.21.15.32:0/1034308443 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06080b4c50 msgr2=0x7f06080b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:07.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.147+0000 7f060d400640 1 --2- 172.21.15.32:0/1034308443 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06080b4c50 0x7f06080b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.147+0000 7f060d400640 1 -- 172.21.15.32:0/1034308443 >> v1:172.21.15.171:6789/0 conn(0x7f060815a7c0 legacy=0x7f06080cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:07.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.147+0000 7f060d400640 1 -- 172.21.15.32:0/1034308443 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06080cb950 con 0x7f06080cc680 2024-03-19T06:23:07.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.151+0000 7f060d400640 1 --2- 172.21.15.32:0/1034308443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06080cc680 0x7f060815ecf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f05f800bb10 tx=0x7f05f801ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a727b65ea3cfcb77 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:07.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.151+0000 7f060ca00640 1 -- 172.21.15.32:0/1034308443 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f80b4070 con 0x7f06080cc680 2024-03-19T06:23:07.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.151+0000 7f060ca00640 1 -- 172.21.15.32:0/1034308443 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f80a7cf0 con 0x7f06080cc680 2024-03-19T06:23:07.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.151+0000 7f060ca00640 1 -- 172.21.15.32:0/1034308443 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f80af660 con 0x7f06080cc680 2024-03-19T06:23:07.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.151+0000 7f0610800640 1 -- 172.21.15.32:0/1034308443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06080cc680 msgr2=0x7f060815ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:07.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.151+0000 7f0610800640 1 --2- 172.21.15.32:0/1034308443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06080cc680 0x7f060815ecf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f05f800bb10 tx=0x7f05f801ec00 comp rx=0 tx=0).stop 2024-03-19T06:23:07.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.151+0000 7f0610800640 1 -- 172.21.15.32:0/1034308443 shutdown_connections 2024-03-19T06:23:07.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.151+0000 7f0610800640 1 --2- 172.21.15.32:0/1034308443 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06080b4c50 0x7f06080b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.151+0000 7f0610800640 1 --2- 172.21.15.32:0/1034308443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06080cc680 0x7f060815ecf0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.151+0000 7f0610800640 1 -- 172.21.15.32:0/1034308443 >> 172.21.15.32:0/1034308443 conn(0x7f06080b1280 msgr2=0x7f06080b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:07.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.151+0000 7f0610800640 1 -- 172.21.15.32:0/1034308443 shutdown_connections 2024-03-19T06:23:07.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.151+0000 7f0610800640 1 -- 172.21.15.32:0/1034308443 wait complete. 2024-03-19T06:23:07.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f0610800640 1 Processor -- start 2024-03-19T06:23:07.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f0610800640 1 -- start start 2024-03-19T06:23:07.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f0610800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06080b4c50 0x7f0608147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f0610800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06080cc680 0x7f06081f6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f0610800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f060815a7c0 0x7f0608137820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f0610800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06080cbdb0 con 0x7f06080b4c50 2024-03-19T06:23:07.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f0610800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06080cbc30 con 0x7f060815a7c0 2024-03-19T06:23:07.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f0610800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0608071350 con 0x7f06080cc680 2024-03-19T06:23:07.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f060de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06080b4c50 0x7f0608147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f060de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06080b4c50 0x7f0608147890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33726/0 (socket says 172.21.15.32:33726) 2024-03-19T06:23:07.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f060de00640 1 -- 172.21.15.32:0/1596833728 learned_addr learned my addr 172.21.15.32:0/1596833728 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:07.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f060d400640 1 --2- 172.21.15.32:0/1596833728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06080cc680 0x7f06081f6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f060e800640 1 --2- 172.21.15.32:0/1596833728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f060815a7c0 0x7f0608137820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f060de00640 1 -- 172.21.15.32:0/1596833728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06080cc680 msgr2=0x7f06081f6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:07.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f060de00640 1 --2- 172.21.15.32:0/1596833728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06080cc680 0x7f06081f6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f060de00640 1 -- 172.21.15.32:0/1596833728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f060815a7c0 msgr2=0x7f0608137820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:07.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f060de00640 1 --2- 172.21.15.32:0/1596833728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f060815a7c0 0x7f0608137820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f060de00640 1 -- 172.21.15.32:0/1596833728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0608147dd0 con 0x7f06080b4c50 2024-03-19T06:23:07.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f060d400640 1 --2- 172.21.15.32:0/1596833728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06080cc680 0x7f06081f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:07.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f060de00640 1 --2- 172.21.15.32:0/1596833728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06080b4c50 0x7f0608147890 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00c3a0 tx=0x7f05fc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:07.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f0602000640 1 -- 172.21.15.32:0/1596833728 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc0052d0 con 0x7f06080b4c50 2024-03-19T06:23:07.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f0602000640 1 -- 172.21.15.32:0/1596833728 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc005470 con 0x7f06080b4c50 2024-03-19T06:23:07.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f0602000640 1 -- 172.21.15.32:0/1596833728 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc007260 con 0x7f06080b4c50 2024-03-19T06:23:07.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f0610800640 1 -- 172.21.15.32:0/1596833728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060815dc80 con 0x7f06080b4c50 2024-03-19T06:23:07.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f0610800640 1 -- 172.21.15.32:0/1596833728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060814a0f0 con 0x7f06080b4c50 2024-03-19T06:23:07.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.155+0000 7f0610800640 1 -- 172.21.15.32:0/1596833728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06080749e0 con 0x7f06080b4c50 2024-03-19T06:23:07.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.159+0000 7f0602000640 1 -- 172.21.15.32:0/1596833728 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f05fc007400 con 0x7f06080b4c50 2024-03-19T06:23:07.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.159+0000 7f0602000640 1 --2- 172.21.15.32:0/1596833728 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f05ec067660 0x7f05ec069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.159+0000 7f0602000640 1 -- 172.21.15.32:0/1596833728 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f05fc084f70 con 0x7f06080b4c50 2024-03-19T06:23:07.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.159+0000 7f060d400640 1 --2- 172.21.15.32:0/1596833728 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f05ec067660 0x7f05ec069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.159+0000 7f060d400640 1 --2- 172.21.15.32:0/1596833728 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f05ec067660 0x7f05ec069b20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f05f80b1000 tx=0x7f05f8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:07.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.163+0000 7f0602000640 1 -- 172.21.15.32:0/1596833728 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f05fc0559c0 con 0x7f06080b4c50 2024-03-19T06:23:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.359+0000 7f0610800640 1 -- 172.21.15.32:0/1596833728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0608159aa0 con 0x7f06080b4c50 2024-03-19T06:23:07.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.359+0000 7f0602000640 1 -- 172.21.15.32:0/1596833728 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f05fc0552c0 con 0x7f06080b4c50 2024-03-19T06:23:07.346 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:07.347 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3394778234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3394778234},{"type":"v1","addr":"172.21.15.171:6836","nonce":3394778234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2000291327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2000291327},{"type":"v1","addr":"172.21.15.171:6837","nonce":2000291327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/4039299860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":4039299860},{"type":"v1","addr":"172.21.15.32:6833","nonce":4039299860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:22:12.167128+0000","modified":"2024-03-19T06:22:26.236754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/2680502611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":2680502611},{"type":"v1","addr":"172.21.15.32:6835","nonce":2680502611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-19T06:23:07.347 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 18 2024-03-19T06:23:07.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.359+0000 7f0610800640 1 -- 172.21.15.32:0/1596833728 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f05ec067660 msgr2=0x7f05ec069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:07.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.359+0000 7f0610800640 1 --2- 172.21.15.32:0/1596833728 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f05ec067660 0x7f05ec069b20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f05f80b1000 tx=0x7f05f8008040 comp rx=0 tx=0).stop 2024-03-19T06:23:07.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.359+0000 7f0610800640 1 -- 172.21.15.32:0/1596833728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06080b4c50 msgr2=0x7f0608147890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:07.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.359+0000 7f0610800640 1 --2- 172.21.15.32:0/1596833728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06080b4c50 0x7f0608147890 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00c3a0 tx=0x7f05fc00c860 comp rx=0 tx=0).stop 2024-03-19T06:23:07.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.359+0000 7f0610800640 1 -- 172.21.15.32:0/1596833728 shutdown_connections 2024-03-19T06:23:07.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.359+0000 7f0610800640 1 --2- 172.21.15.32:0/1596833728 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f05ec067660 0x7f05ec069b20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.359+0000 7f0610800640 1 --2- 172.21.15.32:0/1596833728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f060815a7c0 0x7f0608137820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.359+0000 7f0610800640 1 --2- 172.21.15.32:0/1596833728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06080cc680 0x7f06081f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.359+0000 7f0610800640 1 --2- 172.21.15.32:0/1596833728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06080b4c50 0x7f0608147890 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.359+0000 7f0610800640 1 -- 172.21.15.32:0/1596833728 >> 172.21.15.32:0/1596833728 conn(0x7f06080b1280 msgr2=0x7f060814e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:07.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.359+0000 7f0610800640 1 -- 172.21.15.32:0/1596833728 shutdown_connections 2024-03-19T06:23:07.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.359+0000 7f0610800640 1 -- 172.21.15.32:0/1596833728 wait complete. 2024-03-19T06:23:07.368 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:23:07.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.519+0000 7f0ac3200640 1 Processor -- start 2024-03-19T06:23:07.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.519+0000 7f0ac3200640 1 -- start start 2024-03-19T06:23:07.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0ac3200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0abc099a70 0x7f0abc099e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0ac3200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0abc06f620 0x7f0abc0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0ac3200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0abc0b0bc0 0x7f0abc0cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0ac3200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0abc0cc5c0 con 0x7f0abc06f620 2024-03-19T06:23:07.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0ac3200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0abc09a390 con 0x7f0abc099a70 2024-03-19T06:23:07.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0ac3200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0cc860 con 0x7f0abc0b0bc0 2024-03-19T06:23:07.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0ab3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0abc06f620 0x7f0abc0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0ab3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0abc06f620 0x7f0abc0cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33734/0 (socket says 172.21.15.32:33734) 2024-03-19T06:23:07.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0ab3e00640 1 -- 172.21.15.32:0/1295494836 learned_addr learned my addr 172.21.15.32:0/1295494836 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:07.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0abbe00640 1 --2- 172.21.15.32:0/1295494836 >> v2:172.21.15.171:3300/0 conn(0x7f0abc099a70 0x7f0abc099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0ac1200640 1 --2- 172.21.15.32:0/1295494836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0abc0b0bc0 0x7f0abc0cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0ab3e00640 1 -- 172.21.15.32:0/1295494836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0abc0b0bc0 msgr2=0x7f0abc0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:07.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0ab3e00640 1 --2- 172.21.15.32:0/1295494836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0abc0b0bc0 0x7f0abc0cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0ab3e00640 1 -- 172.21.15.32:0/1295494836 >> v2:172.21.15.171:3300/0 conn(0x7f0abc099a70 msgr2=0x7f0abc099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:07.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0ab3e00640 1 --2- 172.21.15.32:0/1295494836 >> v2:172.21.15.171:3300/0 conn(0x7f0abc099a70 0x7f0abc099e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0ab3e00640 1 -- 172.21.15.32:0/1295494836 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc0ccb40 con 0x7f0abc06f620 2024-03-19T06:23:07.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.523+0000 7f0ab3e00640 1 --2- 172.21.15.32:0/1295494836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc06f620 0x7f0abc0cf710 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0685f0 tx=0x7f0aa401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b8f9a0d7364a0c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:07.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0abb400640 1 -- 172.21.15.32:0/1295494836 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40b0070 con 0x7f0abc06f620 2024-03-19T06:23:07.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0abb400640 1 -- 172.21.15.32:0/1295494836 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa40ab600 con 0x7f0abc06f620 2024-03-19T06:23:07.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0abb400640 1 -- 172.21.15.32:0/1295494836 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40ab9d0 con 0x7f0abc06f620 2024-03-19T06:23:07.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 -- 172.21.15.32:0/1295494836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc06f620 msgr2=0x7f0abc0cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:07.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 --2- 172.21.15.32:0/1295494836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc06f620 0x7f0abc0cf710 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0685f0 tx=0x7f0aa401c400 comp rx=0 tx=0).stop 2024-03-19T06:23:07.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 -- 172.21.15.32:0/1295494836 shutdown_connections 2024-03-19T06:23:07.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 --2- 172.21.15.32:0/1295494836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0abc0b0bc0 0x7f0abc0cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 --2- 172.21.15.32:0/1295494836 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc06f620 0x7f0abc0cf710 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 --2- 172.21.15.32:0/1295494836 >> v2:172.21.15.171:3300/0 conn(0x7f0abc099a70 0x7f0abc099e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 -- 172.21.15.32:0/1295494836 >> 172.21.15.32:0/1295494836 conn(0x7f0abc0b3300 msgr2=0x7f0abc0b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:07.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 -- 172.21.15.32:0/1295494836 shutdown_connections 2024-03-19T06:23:07.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 -- 172.21.15.32:0/1295494836 wait complete. 2024-03-19T06:23:07.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 Processor -- start 2024-03-19T06:23:07.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 -- start start 2024-03-19T06:23:07.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc06f620 0x7f0abc14f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0abc099a70 0x7f0abc15aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0abc0b0bc0 0x7f0abc15af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc070a10 con 0x7f0abc06f620 2024-03-19T06:23:07.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc070890 con 0x7f0abc0b0bc0 2024-03-19T06:23:07.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac3200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0cfc50 con 0x7f0abc099a70 2024-03-19T06:23:07.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0abbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc06f620 0x7f0abc14f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0abbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc06f620 0x7f0abc14f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33740/0 (socket says 172.21.15.32:33740) 2024-03-19T06:23:07.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0abbe00640 1 -- 172.21.15.32:0/434170540 learned_addr learned my addr 172.21.15.32:0/434170540 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:07.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ac1200640 1 --2- 172.21.15.32:0/434170540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0abc0b0bc0 0x7f0abc15af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0ab3e00640 1 --2- 172.21.15.32:0/434170540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0abc099a70 0x7f0abc15aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0abbe00640 1 -- 172.21.15.32:0/434170540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0abc099a70 msgr2=0x7f0abc15aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:07.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.527+0000 7f0abbe00640 1 --2- 172.21.15.32:0/434170540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0abc099a70 0x7f0abc15aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.531+0000 7f0abbe00640 1 -- 172.21.15.32:0/434170540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0abc0b0bc0 msgr2=0x7f0abc15af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:07.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.531+0000 7f0abbe00640 1 --2- 172.21.15.32:0/434170540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0abc0b0bc0 0x7f0abc15af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.531+0000 7f0abbe00640 1 -- 172.21.15.32:0/434170540 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc164d20 con 0x7f0abc06f620 2024-03-19T06:23:07.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.531+0000 7f0ac1200640 1 --2- 172.21.15.32:0/434170540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0abc0b0bc0 0x7f0abc15af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:07.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.531+0000 7f0abbe00640 1 --2- 172.21.15.32:0/434170540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc06f620 0x7f0abc14f1c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00d800 tx=0x7f0aac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:07.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.531+0000 7f0ab8c00640 1 -- 172.21.15.32:0/434170540 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac018020 con 0x7f0abc06f620 2024-03-19T06:23:07.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.531+0000 7f0ab8c00640 1 -- 172.21.15.32:0/434170540 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac0096a0 con 0x7f0abc06f620 2024-03-19T06:23:07.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.531+0000 7f0ab8c00640 1 -- 172.21.15.32:0/434170540 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac009a50 con 0x7f0abc06f620 2024-03-19T06:23:07.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.531+0000 7f0ac3200640 1 -- 172.21.15.32:0/434170540 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0abc165000 con 0x7f0abc06f620 2024-03-19T06:23:07.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.531+0000 7f0ac3200640 1 -- 172.21.15.32:0/434170540 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc06bef0 con 0x7f0abc06f620 2024-03-19T06:23:07.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.531+0000 7f0ac3200640 1 -- 172.21.15.32:0/434170540 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0abc0749e0 con 0x7f0abc06f620 2024-03-19T06:23:07.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.531+0000 7f0ab8c00640 1 -- 172.21.15.32:0/434170540 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0aac01b020 con 0x7f0abc06f620 2024-03-19T06:23:07.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.531+0000 7f0ab8c00640 1 --2- 172.21.15.32:0/434170540 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0a98067660 0x7f0a98069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.531+0000 7f0ab8c00640 1 -- 172.21.15.32:0/434170540 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f0aac086030 con 0x7f0abc06f620 2024-03-19T06:23:07.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.531+0000 7f0ab3e00640 1 --2- 172.21.15.32:0/434170540 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0a98067660 0x7f0a98069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.535+0000 7f0ab3e00640 1 --2- 172.21.15.32:0/434170540 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0a98067660 0x7f0a98069b20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40ad000 tx=0x7f0aa4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:07.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.535+0000 7f0ab8c00640 1 -- 172.21.15.32:0/434170540 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f0aac022020 con 0x7f0abc06f620 2024-03-19T06:23:07.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.735+0000 7f0ac3200640 1 -- 172.21.15.32:0/434170540 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0abc0b4100 con 0x7f0abc06f620 2024-03-19T06:23:07.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.735+0000 7f0ab8c00640 1 -- 172.21.15.32:0/434170540 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f0aac056b20 con 0x7f0abc06f620 2024-03-19T06:23:07.724 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:07.724 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3394778234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3394778234},{"type":"v1","addr":"172.21.15.171:6836","nonce":3394778234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2000291327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2000291327},{"type":"v1","addr":"172.21.15.171:6837","nonce":2000291327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/4039299860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":4039299860},{"type":"v1","addr":"172.21.15.32:6833","nonce":4039299860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:22:12.167128+0000","modified":"2024-03-19T06:22:26.236754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/2680502611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":2680502611},{"type":"v1","addr":"172.21.15.32:6835","nonce":2680502611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-19T06:23:07.725 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 18 2024-03-19T06:23:07.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.739+0000 7f0ac3200640 1 -- 172.21.15.32:0/434170540 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0a98067660 msgr2=0x7f0a98069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:07.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.739+0000 7f0ac3200640 1 --2- 172.21.15.32:0/434170540 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0a98067660 0x7f0a98069b20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40ad000 tx=0x7f0aa4008040 comp rx=0 tx=0).stop 2024-03-19T06:23:07.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.739+0000 7f0ac3200640 1 -- 172.21.15.32:0/434170540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc06f620 msgr2=0x7f0abc14f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:07.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.739+0000 7f0ac3200640 1 --2- 172.21.15.32:0/434170540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc06f620 0x7f0abc14f1c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00d800 tx=0x7f0aac00dcc0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.739+0000 7f0ac3200640 1 -- 172.21.15.32:0/434170540 shutdown_connections 2024-03-19T06:23:07.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.739+0000 7f0ac3200640 1 --2- 172.21.15.32:0/434170540 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0a98067660 0x7f0a98069b20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.739+0000 7f0ac3200640 1 --2- 172.21.15.32:0/434170540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0abc0b0bc0 0x7f0abc15af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.739+0000 7f0ac3200640 1 --2- 172.21.15.32:0/434170540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0abc099a70 0x7f0abc15aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.739+0000 7f0ac3200640 1 --2- 172.21.15.32:0/434170540 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0abc06f620 0x7f0abc14f1c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.739+0000 7f0ac3200640 1 -- 172.21.15.32:0/434170540 >> 172.21.15.32:0/434170540 conn(0x7f0abc0b3300 msgr2=0x7f0abc1595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:07.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.739+0000 7f0ac3200640 1 -- 172.21.15.32:0/434170540 shutdown_connections 2024-03-19T06:23:07.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.739+0000 7f0ac3200640 1 -- 172.21.15.32:0/434170540 wait complete. 2024-03-19T06:23:07.745 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:23:07.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.899+0000 7fbb5e000640 1 Processor -- start 2024-03-19T06:23:07.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.899+0000 7fbb5e000640 1 -- start start 2024-03-19T06:23:07.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.899+0000 7fbb5e000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbb5815bb20 0x7fbb5809a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.899+0000 7fbb5e000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5815bf00 con 0x7fbb580cf460 2024-03-19T06:23:07.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.899+0000 7fbb5e000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb580cc5d0 con 0x7fbb580cd390 2024-03-19T06:23:07.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.899+0000 7fbb5e000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb580cc3a0 con 0x7fbb5815bb20 2024-03-19T06:23:07.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.899+0000 7fbb4ea00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fbb580cf460 0x7fbb580c53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45830/0 (socket says 172.21.15.32:45830) 2024-03-19T06:23:07.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.899+0000 7fbb4ea00640 1 -- 172.21.15.32:0/2359011117 learned_addr learned my addr 172.21.15.32:0/2359011117 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:07.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.899+0000 7fbb57400640 1 --2- 172.21.15.32:0/2359011117 >> v2:172.21.15.171:3300/0 conn(0x7fbb5815bb20 0x7fbb5809a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.899+0000 7fbb56a00640 1 -- 172.21.15.32:0/2359011117 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171708555 0 0) 0x7fbb5815bf00 con 0x7fbb580cf460 2024-03-19T06:23:07.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.899+0000 7fbb56a00640 1 -- 172.21.15.32:0/2359011117 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb3c003530 con 0x7fbb580cf460 2024-03-19T06:23:07.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.899+0000 7fbb56a00640 1 -- 172.21.15.32:0/2359011117 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893221030 0 0) 0x7fbb580cc5d0 con 0x7fbb580cd390 2024-03-19T06:23:07.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.899+0000 7fbb56a00640 1 -- 172.21.15.32:0/2359011117 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb5815bf00 con 0x7fbb580cd390 2024-03-19T06:23:07.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.899+0000 7fbb57400640 1 -- 172.21.15.32:0/2359011117 >> v1:172.21.15.171:6789/0 conn(0x7fbb580cd390 legacy=0x7fbb580cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:07.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.899+0000 7fbb57400640 1 -- 172.21.15.32:0/2359011117 >> v1:172.21.15.32:6789/0 conn(0x7fbb580cf460 legacy=0x7fbb580c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:07.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.899+0000 7fbb57400640 1 -- 172.21.15.32:0/2359011117 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb580cc8b0 con 0x7fbb5815bb20 2024-03-19T06:23:07.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.903+0000 7fbb57400640 1 --2- 172.21.15.32:0/2359011117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb5815bb20 0x7fbb5809a480 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbb480097c0 tx=0x7fbb4801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62e64ddef06d0b81 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:07.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.903+0000 7fbb56a00640 1 -- 172.21.15.32:0/2359011117 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb480b1070 con 0x7fbb5815bb20 2024-03-19T06:23:07.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.903+0000 7fbb56a00640 1 -- 172.21.15.32:0/2359011117 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb480ac5f0 con 0x7fbb5815bb20 2024-03-19T06:23:07.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.903+0000 7fbb56a00640 1 -- 172.21.15.32:0/2359011117 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb480ac9c0 con 0x7fbb5815bb20 2024-03-19T06:23:07.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.903+0000 7fbb5e000640 1 -- 172.21.15.32:0/2359011117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb5815bb20 msgr2=0x7fbb5809a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:07.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.903+0000 7fbb5e000640 1 --2- 172.21.15.32:0/2359011117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb5815bb20 0x7fbb5809a480 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbb480097c0 tx=0x7fbb4801c4a0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.903+0000 7fbb5e000640 1 -- 172.21.15.32:0/2359011117 shutdown_connections 2024-03-19T06:23:07.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.903+0000 7fbb5e000640 1 --2- 172.21.15.32:0/2359011117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb5815bb20 0x7fbb5809a480 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.903+0000 7fbb5e000640 1 -- 172.21.15.32:0/2359011117 >> 172.21.15.32:0/2359011117 conn(0x7fbb580d1890 msgr2=0x7fbb580d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:07.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.903+0000 7fbb5e000640 1 -- 172.21.15.32:0/2359011117 shutdown_connections 2024-03-19T06:23:07.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.903+0000 7fbb5e000640 1 -- 172.21.15.32:0/2359011117 wait complete. 2024-03-19T06:23:07.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb5e000640 1 Processor -- start 2024-03-19T06:23:07.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb5e000640 1 -- start start 2024-03-19T06:23:07.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb5e000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb580cd390 0x7fbb58156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb5e000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb580cf460 0x7fbb5815cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb5e000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb5815bb20 0x7fbb58159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb5e000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580d0580 con 0x7fbb580cf460 2024-03-19T06:23:07.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb5e000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580cf870 con 0x7fbb5815bb20 2024-03-19T06:23:07.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb5e000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580d0700 con 0x7fbb580cd390 2024-03-19T06:23:07.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb4ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb580cf460 0x7fbb5815cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb4ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb580cf460 0x7fbb5815cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33748/0 (socket says 172.21.15.32:33748) 2024-03-19T06:23:07.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb4ea00640 1 -- 172.21.15.32:0/3330493731 learned_addr learned my addr 172.21.15.32:0/3330493731 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:07.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb57400640 1 --2- 172.21.15.32:0/3330493731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb580cd390 0x7fbb58156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb57e00640 1 --2- 172.21.15.32:0/3330493731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb5815bb20 0x7fbb58159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb4ea00640 1 -- 172.21.15.32:0/3330493731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb580cd390 msgr2=0x7fbb58156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:07.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb4ea00640 1 --2- 172.21.15.32:0/3330493731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb580cd390 0x7fbb58156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb4ea00640 1 -- 172.21.15.32:0/3330493731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb5815bb20 msgr2=0x7fbb58159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:07.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb4ea00640 1 --2- 172.21.15.32:0/3330493731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb5815bb20 0x7fbb58159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb4ea00640 1 -- 172.21.15.32:0/3330493731 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5815a620 con 0x7fbb580cf460 2024-03-19T06:23:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb57400640 1 --2- 172.21.15.32:0/3330493731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb580cd390 0x7fbb58156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb57e00640 1 --2- 172.21.15.32:0/3330493731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb5815bb20 0x7fbb58159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb4ea00640 1 --2- 172.21.15.32:0/3330493731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb580cf460 0x7fbb5815cec0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000c4d0 tx=0x7fbb4000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb4fe00640 1 -- 172.21.15.32:0/3330493731 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40017070 con 0x7fbb580cf460 2024-03-19T06:23:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb4fe00640 1 -- 172.21.15.32:0/3330493731 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb40005cf0 con 0x7fbb580cf460 2024-03-19T06:23:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb5e000640 1 -- 172.21.15.32:0/3330493731 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5815c100 con 0x7fbb580cf460 2024-03-19T06:23:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb4fe00640 1 -- 172.21.15.32:0/3330493731 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40007290 con 0x7fbb580cf460 2024-03-19T06:23:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb5e000640 1 -- 172.21.15.32:0/3330493731 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5815c9a0 con 0x7fbb580cf460 2024-03-19T06:23:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.907+0000 7fbb5e000640 1 -- 172.21.15.32:0/3330493731 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5815c2d0 con 0x7fbb580cf460 2024-03-19T06:23:07.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.911+0000 7fbb4fe00640 1 -- 172.21.15.32:0/3330493731 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fbb4001a070 con 0x7fbb580cf460 2024-03-19T06:23:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.911+0000 7fbb4fe00640 1 --2- 172.21.15.32:0/3330493731 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fbb34067660 0x7fbb34069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.911+0000 7fbb4fe00640 1 -- 172.21.15.32:0/3330493731 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7fbb40084dd0 con 0x7fbb580cf460 2024-03-19T06:23:07.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.911+0000 7fbb57400640 1 --2- 172.21.15.32:0/3330493731 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fbb34067660 0x7fbb34069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:07.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.911+0000 7fbb57400640 1 --2- 172.21.15.32:0/3330493731 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fbb34067660 0x7fbb34069b20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbb480ae000 tx=0x7fbb48008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:07.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:07.915+0000 7fbb4fe00640 1 -- 172.21.15.32:0/3330493731 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fbb40055950 con 0x7fbb580cf460 2024-03-19T06:23:08.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.079+0000 7fbb5e000640 1 -- 172.21.15.32:0/3330493731 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb580b7810 con 0x7fbb580cf460 2024-03-19T06:23:08.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.079+0000 7fbb4fe00640 1 -- 172.21.15.32:0/3330493731 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18493 (secure 0 0 0) 0x7fbb40086020 con 0x7fbb580cf460 2024-03-19T06:23:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:08.069 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":38,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:22:27.853859+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:22:09.983589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-19T06:22:11.172289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-03-19T06:22:25.205334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:23:08.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.083+0000 7fbb5e000640 1 -- 172.21.15.32:0/3330493731 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fbb34067660 msgr2=0x7fbb34069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:08.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.083+0000 7fbb5e000640 1 --2- 172.21.15.32:0/3330493731 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fbb34067660 0x7fbb34069b20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbb480ae000 tx=0x7fbb48008040 comp rx=0 tx=0).stop 2024-03-19T06:23:08.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.083+0000 7fbb5e000640 1 -- 172.21.15.32:0/3330493731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb580cf460 msgr2=0x7fbb5815cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.083+0000 7fbb5e000640 1 --2- 172.21.15.32:0/3330493731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb580cf460 0x7fbb5815cec0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000c4d0 tx=0x7fbb4000c990 comp rx=0 tx=0).stop 2024-03-19T06:23:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.083+0000 7fbb5e000640 1 -- 172.21.15.32:0/3330493731 shutdown_connections 2024-03-19T06:23:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.083+0000 7fbb5e000640 1 --2- 172.21.15.32:0/3330493731 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fbb34067660 0x7fbb34069b20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.083+0000 7fbb5e000640 1 --2- 172.21.15.32:0/3330493731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb5815bb20 0x7fbb58159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.083+0000 7fbb5e000640 1 --2- 172.21.15.32:0/3330493731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb580cf460 0x7fbb5815cec0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.083+0000 7fbb5e000640 1 --2- 172.21.15.32:0/3330493731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb580cd390 0x7fbb58156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.083+0000 7fbb5e000640 1 -- 172.21.15.32:0/3330493731 >> 172.21.15.32:0/3330493731 conn(0x7fbb580d1890 msgr2=0x7fbb580cd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.083+0000 7fbb5e000640 1 -- 172.21.15.32:0/3330493731 shutdown_connections 2024-03-19T06:23:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.083+0000 7fbb5e000640 1 -- 172.21.15.32:0/3330493731 wait complete. 2024-03-19T06:23:08.090 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-19T06:23:08.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.243+0000 7f8775e00640 1 Processor -- start 2024-03-19T06:23:08.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.243+0000 7f8775e00640 1 -- start start 2024-03-19T06:23:08.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.243+0000 7f8775e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f87700cc2e0 0x7f87700ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:08.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.243+0000 7f8775e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f87700d0180 0x7f87700cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:08.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.243+0000 7f8775e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877006ad40 con 0x7f8770161270 2024-03-19T06:23:08.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.243+0000 7f8775e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877006b020 con 0x7f87700d0180 2024-03-19T06:23:08.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.243+0000 7f8775e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877006b300 con 0x7f87700cc2e0 2024-03-19T06:23:08.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.243+0000 7f876f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f87700d0180 0x7f87700cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:08.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.243+0000 7f876ea00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8770161270 0x7f87700cfa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45838/0 (socket says 172.21.15.32:45838) 2024-03-19T06:23:08.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.243+0000 7f876ea00640 1 -- 172.21.15.32:0/2078279633 learned_addr learned my addr 172.21.15.32:0/2078279633 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:08.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.247+0000 7f876e000640 1 --2- 172.21.15.32:0/2078279633 >> v2:172.21.15.171:3300/0 conn(0x7f87700cc2e0 0x7f87700ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:08.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.247+0000 7f876f400640 1 -- 172.21.15.32:0/2078279633 >> v2:172.21.15.171:3300/0 conn(0x7f87700cc2e0 msgr2=0x7f87700ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:08.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.247+0000 7f876f400640 1 --2- 172.21.15.32:0/2078279633 >> v2:172.21.15.171:3300/0 conn(0x7f87700cc2e0 0x7f87700ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.247+0000 7f876f400640 1 -- 172.21.15.32:0/2078279633 >> v1:172.21.15.32:6789/0 conn(0x7f8770161270 legacy=0x7f87700cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:08.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.247+0000 7f876f400640 1 -- 172.21.15.32:0/2078279633 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877006b5e0 con 0x7f87700d0180 2024-03-19T06:23:08.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.247+0000 7f876d600640 1 -- 172.21.15.32:0/2078279633 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643822647 0 0) 0x7f877006ad40 con 0x7f8770161270 2024-03-19T06:23:08.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.247+0000 7f876f400640 1 --2- 172.21.15.32:0/2078279633 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87700d0180 0x7f87700cc950 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8770070ea0 tx=0x7f876801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b921e3d9dbdf3a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:08.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.247+0000 7f876d600640 1 -- 172.21.15.32:0/2078279633 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87680b2070 con 0x7f87700d0180 2024-03-19T06:23:08.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.247+0000 7f876d600640 1 -- 172.21.15.32:0/2078279633 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87680a5900 con 0x7f87700d0180 2024-03-19T06:23:08.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.247+0000 7f876d600640 1 -- 172.21.15.32:0/2078279633 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87680a5cd0 con 0x7f87700d0180 2024-03-19T06:23:08.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.247+0000 7f8775e00640 1 -- 172.21.15.32:0/2078279633 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87700d0180 msgr2=0x7f87700cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:08.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.247+0000 7f8775e00640 1 --2- 172.21.15.32:0/2078279633 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87700d0180 0x7f87700cc950 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8770070ea0 tx=0x7f876801c930 comp rx=0 tx=0).stop 2024-03-19T06:23:08.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.247+0000 7f8775e00640 1 -- 172.21.15.32:0/2078279633 shutdown_connections 2024-03-19T06:23:08.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f8775e00640 1 --2- 172.21.15.32:0/2078279633 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87700d0180 0x7f87700cc950 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f8775e00640 1 --2- 172.21.15.32:0/2078279633 >> v2:172.21.15.171:3300/0 conn(0x7f87700cc2e0 0x7f87700ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f8775e00640 1 -- 172.21.15.32:0/2078279633 >> 172.21.15.32:0/2078279633 conn(0x7f87700b2250 msgr2=0x7f87700b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:08.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f8775e00640 1 -- 172.21.15.32:0/2078279633 shutdown_connections 2024-03-19T06:23:08.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f8775e00640 1 -- 172.21.15.32:0/2078279633 wait complete. 2024-03-19T06:23:08.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f8775e00640 1 Processor -- start 2024-03-19T06:23:08.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f8775e00640 1 -- start start 2024-03-19T06:23:08.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f8775e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87700cc2e0 0x7f8770159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:08.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f8775e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87700d0180 0x7f87700c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:08.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f8775e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8770161270 0x7f87700af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:08.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f8775e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87700cda30 con 0x7f87700cc2e0 2024-03-19T06:23:08.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f8775e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87700cd8b0 con 0x7f87700d0180 2024-03-19T06:23:08.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f8775e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87700cdbb0 con 0x7f8770161270 2024-03-19T06:23:08.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f876ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87700cc2e0 0x7f8770159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:08.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f876ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87700cc2e0 0x7f8770159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33764/0 (socket says 172.21.15.32:33764) 2024-03-19T06:23:08.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f876ea00640 1 -- 172.21.15.32:0/366593664 learned_addr learned my addr 172.21.15.32:0/366593664 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:08.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f876e000640 1 --2- 172.21.15.32:0/366593664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87700d0180 0x7f87700c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:08.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f876f400640 1 --2- 172.21.15.32:0/366593664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8770161270 0x7f87700af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f876ea00640 1 -- 172.21.15.32:0/366593664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8770161270 msgr2=0x7f87700af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f876ea00640 1 --2- 172.21.15.32:0/366593664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8770161270 0x7f87700af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f876ea00640 1 -- 172.21.15.32:0/366593664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87700d0180 msgr2=0x7f87700c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f876ea00640 1 --2- 172.21.15.32:0/366593664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87700d0180 0x7f87700c4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f876ea00640 1 -- 172.21.15.32:0/366593664 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87700c4d00 con 0x7f87700cc2e0 2024-03-19T06:23:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f876ea00640 1 --2- 172.21.15.32:0/366593664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87700cc2e0 0x7f8770159120 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f876000c480 tx=0x7f876000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.251+0000 7f8767400640 1 -- 172.21.15.32:0/366593664 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760018070 con 0x7f87700cc2e0 2024-03-19T06:23:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.255+0000 7f8767400640 1 -- 172.21.15.32:0/366593664 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8760007500 con 0x7f87700cc2e0 2024-03-19T06:23:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.255+0000 7f8767400640 1 -- 172.21.15.32:0/366593664 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760004a30 con 0x7f87700cc2e0 2024-03-19T06:23:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.255+0000 7f8775e00640 1 -- 172.21.15.32:0/366593664 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87700c4fe0 con 0x7f87700cc2e0 2024-03-19T06:23:08.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.255+0000 7f8775e00640 1 -- 172.21.15.32:0/366593664 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8770159660 con 0x7f87700cc2e0 2024-03-19T06:23:08.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.255+0000 7f8775e00640 1 -- 172.21.15.32:0/366593664 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87700c51b0 con 0x7f87700cc2e0 2024-03-19T06:23:08.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.255+0000 7f8767400640 1 -- 172.21.15.32:0/366593664 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8760004bd0 con 0x7f87700cc2e0 2024-03-19T06:23:08.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.255+0000 7f8767400640 1 --2- 172.21.15.32:0/366593664 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8750067660 0x7f8750069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:08.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.255+0000 7f8767400640 1 -- 172.21.15.32:0/366593664 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6104+0+0 (secure 0 0 0) 0x7f8760084d70 con 0x7f87700cc2e0 2024-03-19T06:23:08.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.255+0000 7f876e000640 1 --2- 172.21.15.32:0/366593664 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8750067660 0x7f8750069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:08.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.259+0000 7f876e000640 1 --2- 172.21.15.32:0/366593664 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8750067660 0x7f8750069b20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f87700c9e40 tx=0x7f875c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:08.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.259+0000 7f8767400640 1 -- 172.21.15.32:0/366593664 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f8760055850 con 0x7f87700cc2e0 2024-03-19T06:23:08.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.455+0000 7f8775e00640 1 -- 172.21.15.32:0/366593664 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f87700749e0 con 0x7f87700cc2e0 2024-03-19T06:23:08.447 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-03-19T06:23:08.455+0000 7f6650800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-19T06:23:08.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.459+0000 7f8767400640 1 -- 172.21.15.32:0/366593664 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8760055150 con 0x7f87700cc2e0 2024-03-19T06:23:08.447 INFO:teuthology.orchestra.run.smithi032.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-19T06:23:08.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.459+0000 7f8775e00640 1 -- 172.21.15.32:0/366593664 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8750067660 msgr2=0x7f8750069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:08.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.459+0000 7f8775e00640 1 --2- 172.21.15.32:0/366593664 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8750067660 0x7f8750069b20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f87700c9e40 tx=0x7f875c008040 comp rx=0 tx=0).stop 2024-03-19T06:23:08.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.459+0000 7f8775e00640 1 -- 172.21.15.32:0/366593664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87700cc2e0 msgr2=0x7f8770159120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:08.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.459+0000 7f8775e00640 1 --2- 172.21.15.32:0/366593664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87700cc2e0 0x7f8770159120 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f876000c480 tx=0x7f876000c940 comp rx=0 tx=0).stop 2024-03-19T06:23:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.463+0000 7f8775e00640 1 -- 172.21.15.32:0/366593664 shutdown_connections 2024-03-19T06:23:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.463+0000 7f8775e00640 1 --2- 172.21.15.32:0/366593664 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8750067660 0x7f8750069b20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.463+0000 7f8775e00640 1 --2- 172.21.15.32:0/366593664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8770161270 0x7f87700af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.463+0000 7f8775e00640 1 --2- 172.21.15.32:0/366593664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87700d0180 0x7f87700c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.463+0000 7f8775e00640 1 --2- 172.21.15.32:0/366593664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87700cc2e0 0x7f8770159120 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.463+0000 7f8775e00640 1 -- 172.21.15.32:0/366593664 >> 172.21.15.32:0/366593664 conn(0x7f87700b2250 msgr2=0x7f877006e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:08.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.463+0000 7f8775e00640 1 -- 172.21.15.32:0/366593664 shutdown_connections 2024-03-19T06:23:08.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.463+0000 7f8775e00640 1 -- 172.21.15.32:0/366593664 wait complete. 2024-03-19T06:23:08.458 INFO:tasks.ceph.mds.c.smithi032.stderr: -4031> 2024-03-19T06:22:16.732+0000 7f1fdfe00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-19T06:23:08.470 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-19T06:23:08.507 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2024-03-19T06:23:08.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.627+0000 7f92d0800640 1 Processor -- start 2024-03-19T06:23:08.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.627+0000 7f92d0800640 1 -- start start 2024-03-19T06:23:08.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.627+0000 7f92d0800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f92c806eed0 0x7f92c80ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:08.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.627+0000 7f92d0800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c80cc290 con 0x7f92c806ad40 2024-03-19T06:23:08.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.627+0000 7f92d0800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c80cc570 con 0x7f92c806e320 2024-03-19T06:23:08.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.627+0000 7f92d0800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c806dbb0 con 0x7f92c806eed0 2024-03-19T06:23:08.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.627+0000 7f92cd400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f92c806eed0 0x7f92c80ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:08.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.627+0000 7f92cde00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f92c806ad40 0x7f92c806b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45844/0 (socket says 172.21.15.32:45844) 2024-03-19T06:23:08.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.627+0000 7f92cd400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f92c806eed0 0x7f92c80ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33792/0 (socket says 172.21.15.32:33792) 2024-03-19T06:23:08.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.627+0000 7f92cde00640 1 -- 172.21.15.32:0/189094716 learned_addr learned my addr 172.21.15.32:0/189094716 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:08.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.627+0000 7f92cd400640 1 -- 172.21.15.32:0/189094716 >> v1:172.21.15.171:6789/0 conn(0x7f92c806e320 legacy=0x7f92c815bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:08.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.627+0000 7f92cd400640 1 -- 172.21.15.32:0/189094716 >> v1:172.21.15.32:6789/0 conn(0x7f92c806ad40 legacy=0x7f92c806b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:08.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.627+0000 7f92cd400640 1 -- 172.21.15.32:0/189094716 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c80cc850 con 0x7f92c806eed0 2024-03-19T06:23:08.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.627+0000 7f92cca00640 1 -- 172.21.15.32:0/189094716 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674563514 0 0) 0x7f92c80cc290 con 0x7f92c806ad40 2024-03-19T06:23:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.631+0000 7f92cd400640 1 --2- 172.21.15.32:0/189094716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92c806eed0 0x7f92c80ccd10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f92b80097c0 tx=0x7f92b801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7d3d156677103c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.631+0000 7f92cca00640 1 -- 172.21.15.32:0/189094716 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b80ab600 con 0x7f92c806eed0 2024-03-19T06:23:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.631+0000 7f92cca00640 1 -- 172.21.15.32:0/189094716 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b80b0070 con 0x7f92c806eed0 2024-03-19T06:23:08.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.631+0000 7f92cca00640 1 -- 172.21.15.32:0/189094716 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b80ab9c0 con 0x7f92c806eed0 2024-03-19T06:23:08.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.631+0000 7f92d0800640 1 -- 172.21.15.32:0/189094716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92c806eed0 msgr2=0x7f92c80ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:08.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.631+0000 7f92d0800640 1 --2- 172.21.15.32:0/189094716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92c806eed0 0x7f92c80ccd10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f92b80097c0 tx=0x7f92b801c3e0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.631+0000 7f92d0800640 1 -- 172.21.15.32:0/189094716 shutdown_connections 2024-03-19T06:23:08.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.631+0000 7f92d0800640 1 --2- 172.21.15.32:0/189094716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92c806eed0 0x7f92c80ccd10 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.631+0000 7f92d0800640 1 -- 172.21.15.32:0/189094716 >> 172.21.15.32:0/189094716 conn(0x7f92c80b1590 msgr2=0x7f92c80b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:08.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.631+0000 7f92d0800640 1 -- 172.21.15.32:0/189094716 shutdown_connections 2024-03-19T06:23:08.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.631+0000 7f92d0800640 1 -- 172.21.15.32:0/189094716 wait complete. 2024-03-19T06:23:08.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92d0800640 1 Processor -- start 2024-03-19T06:23:08.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92d0800640 1 -- start start 2024-03-19T06:23:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92d0800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92c806ad40 0x7f92c80b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92d0800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92c806e320 0x7f92c814d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92d0800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c806eed0 0x7f92c814dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92d0800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c8169d30 con 0x7f92c806ad40 2024-03-19T06:23:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92d0800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c8169eb0 con 0x7f92c806e320 2024-03-19T06:23:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92d0800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c816a030 con 0x7f92c806eed0 2024-03-19T06:23:08.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92cde00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92c806ad40 0x7f92c80b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92cde00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92c806ad40 0x7f92c80b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33808/0 (socket says 172.21.15.32:33808) 2024-03-19T06:23:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92cde00640 1 -- 172.21.15.32:0/65566314 learned_addr learned my addr 172.21.15.32:0/65566314 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92ce800640 1 --2- 172.21.15.32:0/65566314 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c806eed0 0x7f92c814dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92cd400640 1 --2- 172.21.15.32:0/65566314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92c806e320 0x7f92c814d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92cde00640 1 -- 172.21.15.32:0/65566314 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c806eed0 msgr2=0x7f92c814dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92cde00640 1 --2- 172.21.15.32:0/65566314 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c806eed0 0x7f92c814dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92cde00640 1 -- 172.21.15.32:0/65566314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92c806e320 msgr2=0x7f92c814d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92cde00640 1 --2- 172.21.15.32:0/65566314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92c806e320 0x7f92c814d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:08.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92cde00640 1 -- 172.21.15.32:0/65566314 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c81587b0 con 0x7f92c806ad40 2024-03-19T06:23:08.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92cde00640 1 --2- 172.21.15.32:0/65566314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92c806ad40 0x7f92c80b3080 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00c410 tx=0x7f92bc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:08.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92c2000640 1 -- 172.21.15.32:0/65566314 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0074e0 con 0x7f92c806ad40 2024-03-19T06:23:08.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92c2000640 1 -- 172.21.15.32:0/65566314 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc0047f0 con 0x7f92c806ad40 2024-03-19T06:23:08.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92c2000640 1 -- 172.21.15.32:0/65566314 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc007680 con 0x7f92c806ad40 2024-03-19T06:23:08.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92d0800640 1 -- 172.21.15.32:0/65566314 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c80b39f0 con 0x7f92c806ad40 2024-03-19T06:23:08.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.635+0000 7f92d0800640 1 -- 172.21.15.32:0/65566314 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c80b3fb0 con 0x7f92c806ad40 2024-03-19T06:23:08.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.639+0000 7f92d0800640 1 -- 172.21.15.32:0/65566314 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c80749e0 con 0x7f92c806ad40 2024-03-19T06:23:08.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.639+0000 7f92c2000640 1 -- 172.21.15.32:0/65566314 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f92bc011070 con 0x7f92c806ad40 2024-03-19T06:23:08.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.639+0000 7f92c2000640 1 --2- 172.21.15.32:0/65566314 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f92ac067660 0x7f92ac069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:08.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.639+0000 7f92c2000640 1 -- 172.21.15.32:0/65566314 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6190+0+0 (secure 0 0 0) 0x7f92bc0855e0 con 0x7f92c806ad40 2024-03-19T06:23:08.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.639+0000 7f92cd400640 1 --2- 172.21.15.32:0/65566314 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f92ac067660 0x7f92ac069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:08.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.639+0000 7f92cd400640 1 --2- 172.21.15.32:0/65566314 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f92ac067660 0x7f92ac069b20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f92b80af000 tx=0x7f92b80a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:08.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.643+0000 7f92c2000640 1 -- 172.21.15.32:0/65566314 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f92bc055990 con 0x7f92c806ad40 2024-03-19T06:23:08.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:08.847+0000 7f92d0800640 1 -- 172.21.15.32:0/65566314 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f92c815ad10 con 0x7f92c806ad40 2024-03-19T06:23:09.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.459+0000 7f92c2000640 1 -- 172.21.15.32:0/65566314 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f92bc059a30 con 0x7f92c806ad40 2024-03-19T06:23:09.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.463+0000 7f92d0800640 1 -- 172.21.15.32:0/65566314 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f92ac067660 msgr2=0x7f92ac069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:09.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.463+0000 7f92d0800640 1 --2- 172.21.15.32:0/65566314 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f92ac067660 0x7f92ac069b20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f92b80af000 tx=0x7f92b80a7000 comp rx=0 tx=0).stop 2024-03-19T06:23:09.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.463+0000 7f92d0800640 1 -- 172.21.15.32:0/65566314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92c806ad40 msgr2=0x7f92c80b3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:09.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.463+0000 7f92d0800640 1 --2- 172.21.15.32:0/65566314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92c806ad40 0x7f92c80b3080 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00c410 tx=0x7f92bc00c8d0 comp rx=0 tx=0).stop 2024-03-19T06:23:09.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.463+0000 7f92d0800640 1 -- 172.21.15.32:0/65566314 shutdown_connections 2024-03-19T06:23:09.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.463+0000 7f92d0800640 1 --2- 172.21.15.32:0/65566314 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f92ac067660 0x7f92ac069b20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:09.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.463+0000 7f92d0800640 1 --2- 172.21.15.32:0/65566314 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c806eed0 0x7f92c814dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:09.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.463+0000 7f92d0800640 1 --2- 172.21.15.32:0/65566314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92c806e320 0x7f92c814d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:09.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.463+0000 7f92d0800640 1 --2- 172.21.15.32:0/65566314 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92c806ad40 0x7f92c80b3080 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:09.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.463+0000 7f92d0800640 1 -- 172.21.15.32:0/65566314 >> 172.21.15.32:0/65566314 conn(0x7f92c80b1590 msgr2=0x7f92c8071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:09.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.463+0000 7f92d0800640 1 -- 172.21.15.32:0/65566314 shutdown_connections 2024-03-19T06:23:09.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.463+0000 7f92d0800640 1 -- 172.21.15.32:0/65566314 wait complete. 2024-03-19T06:23:09.476 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-19T06:23:09.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.679+0000 7fca40000640 1 Processor -- start 2024-03-19T06:23:09.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.679+0000 7fca40000640 1 -- start start 2024-03-19T06:23:09.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca40000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fca380cef20 0x7fca380b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:09.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca40000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fca380cf300 0x7fca380ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:09.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca40000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca380cd130 0x7fca3806e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:09.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca40000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3815b170 con 0x7fca380cf300 2024-03-19T06:23:09.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca40000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3815b450 con 0x7fca380cef20 2024-03-19T06:23:09.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca40000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3815b730 con 0x7fca380cd130 2024-03-19T06:23:09.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca3cc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fca380cf300 0x7fca380ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:09.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca3cc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fca380cf300 0x7fca380ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33810/0 (socket says 172.21.15.32:33810) 2024-03-19T06:23:09.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca3cc00640 1 -- 172.21.15.32:0/3225590243 learned_addr learned my addr 172.21.15.32:0/3225590243 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:09.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca3d600640 1 --2- 172.21.15.32:0/3225590243 >> v2:172.21.15.171:3300/0 conn(0x7fca380cef20 0x7fca380b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:09.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca3e000640 1 --2- 172.21.15.32:0/3225590243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca380cd130 0x7fca3806e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:09.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca3cc00640 1 -- 172.21.15.32:0/3225590243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca380cd130 msgr2=0x7fca3806e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:09.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca3cc00640 1 --2- 172.21.15.32:0/3225590243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca380cd130 0x7fca3806e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:09.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca3cc00640 1 -- 172.21.15.32:0/3225590243 >> v2:172.21.15.171:3300/0 conn(0x7fca380cef20 msgr2=0x7fca380b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:09.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca3cc00640 1 --2- 172.21.15.32:0/3225590243 >> v2:172.21.15.171:3300/0 conn(0x7fca380cef20 0x7fca380b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:09.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca3cc00640 1 -- 172.21.15.32:0/3225590243 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3815ba10 con 0x7fca380cf300 2024-03-19T06:23:09.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca3d600640 1 --2- 172.21.15.32:0/3225590243 >> v2:172.21.15.171:3300/0 conn(0x7fca380cef20 0x7fca380b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:09.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.683+0000 7fca3e000640 1 --2- 172.21.15.32:0/3225590243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca380cd130 0x7fca3806e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:09.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca3cc00640 1 --2- 172.21.15.32:0/3225590243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca380cf300 0x7fca380ccbf0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fca38069e00 tx=0x7fca2401ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e90b258213cc9a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:09.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca37e00640 1 -- 172.21.15.32:0/3225590243 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca240b4070 con 0x7fca380cf300 2024-03-19T06:23:09.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca37e00640 1 -- 172.21.15.32:0/3225590243 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca240a7a80 con 0x7fca380cf300 2024-03-19T06:23:09.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca37e00640 1 -- 172.21.15.32:0/3225590243 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca240a7e50 con 0x7fca380cf300 2024-03-19T06:23:09.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca40000640 1 -- 172.21.15.32:0/3225590243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca380cf300 msgr2=0x7fca380ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:09.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca40000640 1 --2- 172.21.15.32:0/3225590243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca380cf300 0x7fca380ccbf0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fca38069e00 tx=0x7fca2401ebf0 comp rx=0 tx=0).stop 2024-03-19T06:23:09.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca40000640 1 -- 172.21.15.32:0/3225590243 shutdown_connections 2024-03-19T06:23:09.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca40000640 1 --2- 172.21.15.32:0/3225590243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca380cd130 0x7fca3806e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:09.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca40000640 1 --2- 172.21.15.32:0/3225590243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca380cf300 0x7fca380ccbf0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:09.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca40000640 1 --2- 172.21.15.32:0/3225590243 >> v2:172.21.15.171:3300/0 conn(0x7fca380cef20 0x7fca380b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:09.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca40000640 1 -- 172.21.15.32:0/3225590243 >> 172.21.15.32:0/3225590243 conn(0x7fca380671f0 msgr2=0x7fca3806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:09.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca40000640 1 -- 172.21.15.32:0/3225590243 shutdown_connections 2024-03-19T06:23:09.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca40000640 1 -- 172.21.15.32:0/3225590243 wait complete. 2024-03-19T06:23:09.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca40000640 1 Processor -- start 2024-03-19T06:23:09.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca40000640 1 -- start start 2024-03-19T06:23:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca40000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca380cd130 0x7fca38147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca40000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca380cef20 0x7fca38153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.687+0000 7fca40000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca380cf300 0x7fca3815e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca40000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca38072280 con 0x7fca380cef20 2024-03-19T06:23:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca40000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca38072100 con 0x7fca380cd130 2024-03-19T06:23:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca40000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca38148350 con 0x7fca380cf300 2024-03-19T06:23:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca3cc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca380cef20 0x7fca38153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca3cc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca380cef20 0x7fca38153850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33826/0 (socket says 172.21.15.32:33826) 2024-03-19T06:23:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca3cc00640 1 -- 172.21.15.32:0/2834592253 learned_addr learned my addr 172.21.15.32:0/2834592253 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca3e000640 1 --2- 172.21.15.32:0/2834592253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca380cf300 0x7fca3815e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:09.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca3d600640 1 --2- 172.21.15.32:0/2834592253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca380cd130 0x7fca38147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:09.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca3cc00640 1 -- 172.21.15.32:0/2834592253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca380cf300 msgr2=0x7fca3815e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:09.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca3cc00640 1 --2- 172.21.15.32:0/2834592253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca380cf300 0x7fca3815e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:09.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca3cc00640 1 -- 172.21.15.32:0/2834592253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca380cd130 msgr2=0x7fca38147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:09.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca3cc00640 1 --2- 172.21.15.32:0/2834592253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca380cd130 0x7fca38147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:09.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca3cc00640 1 -- 172.21.15.32:0/2834592253 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3815f0c0 con 0x7fca380cef20 2024-03-19T06:23:09.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca3cc00640 1 --2- 172.21.15.32:0/2834592253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca380cef20 0x7fca38153850 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fca2401d2a0 tx=0x7fca2401b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:09.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca35600640 1 -- 172.21.15.32:0/2834592253 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca240b4030 con 0x7fca380cef20 2024-03-19T06:23:09.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca35600640 1 -- 172.21.15.32:0/2834592253 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca240b6070 con 0x7fca380cef20 2024-03-19T06:23:09.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca35600640 1 -- 172.21.15.32:0/2834592253 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca240ad7b0 con 0x7fca380cef20 2024-03-19T06:23:09.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca40000640 1 -- 172.21.15.32:0/2834592253 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca38152d70 con 0x7fca380cef20 2024-03-19T06:23:09.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca40000640 1 -- 172.21.15.32:0/2834592253 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca38153330 con 0x7fca380cef20 2024-03-19T06:23:09.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca40000640 1 -- 172.21.15.32:0/2834592253 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca380749e0 con 0x7fca380cef20 2024-03-19T06:23:09.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.691+0000 7fca35600640 1 -- 172.21.15.32:0/2834592253 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fca240c1060 con 0x7fca380cef20 2024-03-19T06:23:09.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.695+0000 7fca35600640 1 --2- 172.21.15.32:0/2834592253 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fca18067660 0x7fca18069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:09.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.695+0000 7fca35600640 1 -- 172.21.15.32:0/2834592253 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6190+0+0 (secure 0 0 0) 0x7fca2411ff90 con 0x7fca380cef20 2024-03-19T06:23:09.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.695+0000 7fca3d600640 1 --2- 172.21.15.32:0/2834592253 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fca18067660 0x7fca18069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:09.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.695+0000 7fca3d600640 1 --2- 172.21.15.32:0/2834592253 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fca18067660 0x7fca18069b20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fca2c006fd0 tx=0x7fca2c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:09.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.699+0000 7fca35600640 1 -- 172.21.15.32:0/2834592253 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fca240187e0 con 0x7fca380cef20 2024-03-19T06:23:09.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:09.859+0000 7fca40000640 1 -- 172.21.15.32:0/2834592253 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fca380b2ca0 con 0x7fca380cef20 2024-03-19T06:23:10.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.467+0000 7fca35600640 1 -- 172.21.15.32:0/2834592253 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) v1 ==== 181+0+0 (secure 0 0 0) 0x7fca240f0340 con 0x7fca380cef20 2024-03-19T06:23:10.454 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' removed 2024-03-19T06:23:10.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.471+0000 7fca40000640 1 -- 172.21.15.32:0/2834592253 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fca18067660 msgr2=0x7fca18069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:10.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.471+0000 7fca40000640 1 --2- 172.21.15.32:0/2834592253 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fca18067660 0x7fca18069b20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fca2c006fd0 tx=0x7fca2c008040 comp rx=0 tx=0).stop 2024-03-19T06:23:10.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.471+0000 7fca40000640 1 -- 172.21.15.32:0/2834592253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca380cef20 msgr2=0x7fca38153850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:10.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.471+0000 7fca40000640 1 --2- 172.21.15.32:0/2834592253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca380cef20 0x7fca38153850 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fca2401d2a0 tx=0x7fca2401b990 comp rx=0 tx=0).stop 2024-03-19T06:23:10.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.471+0000 7fca40000640 1 -- 172.21.15.32:0/2834592253 shutdown_connections 2024-03-19T06:23:10.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.471+0000 7fca40000640 1 --2- 172.21.15.32:0/2834592253 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fca18067660 0x7fca18069b20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:10.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.471+0000 7fca40000640 1 --2- 172.21.15.32:0/2834592253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca380cf300 0x7fca3815e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:10.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.471+0000 7fca40000640 1 --2- 172.21.15.32:0/2834592253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca380cef20 0x7fca38153850 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:10.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.471+0000 7fca40000640 1 --2- 172.21.15.32:0/2834592253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca380cd130 0x7fca38147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:10.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.471+0000 7fca40000640 1 -- 172.21.15.32:0/2834592253 >> 172.21.15.32:0/2834592253 conn(0x7fca380671f0 msgr2=0x7fca38149f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:10.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.471+0000 7fca40000640 1 -- 172.21.15.32:0/2834592253 shutdown_connections 2024-03-19T06:23:10.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.471+0000 7fca40000640 1 -- 172.21.15.32:0/2834592253 wait complete. 2024-03-19T06:23:10.483 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-19T06:23:10.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.643+0000 7f4476400640 1 Processor -- start 2024-03-19T06:23:10.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.643+0000 7f4476400640 1 -- start start 2024-03-19T06:23:10.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.643+0000 7f4476400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44700713c0 0x7f4470071820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:10.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.643+0000 7f4476400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f447015c300 0x7f447015c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:10.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.643+0000 7f4476400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44700af190 con 0x7f44701450a0 2024-03-19T06:23:10.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.643+0000 7f4476400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4470071d60 con 0x7f447015c300 2024-03-19T06:23:10.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.643+0000 7f4476400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447006df90 con 0x7f44700713c0 2024-03-19T06:23:10.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.643+0000 7f4467e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44700713c0 0x7f4470071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:10.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.643+0000 7f446fe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f447015c300 0x7f447015c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:10.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.643+0000 7f446fe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f447015c300 0x7f447015c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:58556/0 (socket says 172.21.15.32:58556) 2024-03-19T06:23:10.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.643+0000 7f446fe00640 1 -- 172.21.15.32:0/3034015596 learned_addr learned my addr 172.21.15.32:0/3034015596 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:10.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.643+0000 7f4467e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44700713c0 0x7f4470071820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:56802/0 (socket says 172.21.15.32:56802) 2024-03-19T06:23:10.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.647+0000 7f446fe00640 1 -- 172.21.15.32:0/3034015596 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44700713c0 msgr2=0x7f4470071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:10.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.647+0000 7f446fe00640 1 --2- 172.21.15.32:0/3034015596 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44700713c0 0x7f4470071820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:10.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.647+0000 7f446fe00640 1 -- 172.21.15.32:0/3034015596 >> v1:172.21.15.171:6789/0 conn(0x7f44701450a0 legacy=0x7f447006d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:10.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.647+0000 7f446fe00640 1 -- 172.21.15.32:0/3034015596 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447006e270 con 0x7f447015c300 2024-03-19T06:23:10.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.647+0000 7f4467e00640 1 --2- 172.21.15.32:0/3034015596 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44700713c0 0x7f4470071820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:23:10.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.647+0000 7f446ea00640 1 -- 172.21.15.32:0/3034015596 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086360052 0 0) 0x7f44700af190 con 0x7f44701450a0 2024-03-19T06:23:10.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.647+0000 7f446fe00640 1 --2- 172.21.15.32:0/3034015596 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f447015c300 0x7f447015c770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4468009e50 tx=0x7f446801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f69c029f1e73ee0e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:10.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.647+0000 7f446ea00640 1 -- 172.21.15.32:0/3034015596 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680a5830 con 0x7f447015c300 2024-03-19T06:23:10.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.647+0000 7f446ea00640 1 -- 172.21.15.32:0/3034015596 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44680a59d0 con 0x7f447015c300 2024-03-19T06:23:10.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.647+0000 7f446ea00640 1 -- 172.21.15.32:0/3034015596 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680a5da0 con 0x7f447015c300 2024-03-19T06:23:10.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.647+0000 7f4476400640 1 -- 172.21.15.32:0/3034015596 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f447015c300 msgr2=0x7f447015c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:10.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.647+0000 7f4476400640 1 --2- 172.21.15.32:0/3034015596 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f447015c300 0x7f447015c770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4468009e50 tx=0x7f446801c970 comp rx=0 tx=0).stop 2024-03-19T06:23:10.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f4476400640 1 -- 172.21.15.32:0/3034015596 shutdown_connections 2024-03-19T06:23:10.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f4476400640 1 --2- 172.21.15.32:0/3034015596 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f447015c300 0x7f447015c770 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:10.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f4476400640 1 --2- 172.21.15.32:0/3034015596 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44700713c0 0x7f4470071820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:10.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f4476400640 1 -- 172.21.15.32:0/3034015596 >> 172.21.15.32:0/3034015596 conn(0x7f44700671f0 msgr2=0x7f447006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:10.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f4476400640 1 -- 172.21.15.32:0/3034015596 shutdown_connections 2024-03-19T06:23:10.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f4476400640 1 -- 172.21.15.32:0/3034015596 wait complete. 2024-03-19T06:23:10.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f4476400640 1 Processor -- start 2024-03-19T06:23:10.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f4476400640 1 -- start start 2024-03-19T06:23:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f4476400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44700713c0 0x7f44701420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f4476400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44701450a0 0x7f44701f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f4476400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f447015c300 0x7f447012fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f4476400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447006db30 con 0x7f447015c300 2024-03-19T06:23:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f4476400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4470145480 con 0x7f44701450a0 2024-03-19T06:23:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f4476400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447006dcb0 con 0x7f44700713c0 2024-03-19T06:23:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f446fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f447015c300 0x7f447012fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f446fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f447015c300 0x7f447012fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33832/0 (socket says 172.21.15.32:33832) 2024-03-19T06:23:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f446fe00640 1 -- 172.21.15.32:0/964488857 learned_addr learned my addr 172.21.15.32:0/964488857 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f4467e00640 1 --2- 172.21.15.32:0/964488857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44701450a0 0x7f44701f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f446f400640 1 --2- 172.21.15.32:0/964488857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44700713c0 0x7f44701420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f446fe00640 1 -- 172.21.15.32:0/964488857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44700713c0 msgr2=0x7f44701420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:10.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f446fe00640 1 --2- 172.21.15.32:0/964488857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44700713c0 0x7f44701420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:10.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f446fe00640 1 -- 172.21.15.32:0/964488857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44701450a0 msgr2=0x7f44701f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:10.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f446fe00640 1 --2- 172.21.15.32:0/964488857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44701450a0 0x7f44701f66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:10.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f446fe00640 1 -- 172.21.15.32:0/964488857 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44701f6be0 con 0x7f447015c300 2024-03-19T06:23:10.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f4467e00640 1 --2- 172.21.15.32:0/964488857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44701450a0 0x7f44701f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:10.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f446f400640 1 --2- 172.21.15.32:0/964488857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44700713c0 0x7f44701420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:10.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.651+0000 7f446fe00640 1 --2- 172.21.15.32:0/964488857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f447015c300 0x7f447012fc90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f44680af040 tx=0x7f4468019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:10.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.655+0000 7f4467400640 1 -- 172.21.15.32:0/964488857 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680bc020 con 0x7f447015c300 2024-03-19T06:23:10.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.655+0000 7f4467400640 1 -- 172.21.15.32:0/964488857 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44680b8670 con 0x7f447015c300 2024-03-19T06:23:10.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.655+0000 7f4467400640 1 -- 172.21.15.32:0/964488857 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680b8a60 con 0x7f447015c300 2024-03-19T06:23:10.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.655+0000 7f4476400640 1 -- 172.21.15.32:0/964488857 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4470142730 con 0x7f447015c300 2024-03-19T06:23:10.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.655+0000 7f4476400640 1 -- 172.21.15.32:0/964488857 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44700b2c10 con 0x7f447015c300 2024-03-19T06:23:10.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.655+0000 7f4476400640 1 -- 172.21.15.32:0/964488857 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44700749e0 con 0x7f447015c300 2024-03-19T06:23:10.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.655+0000 7f4467400640 1 -- 172.21.15.32:0/964488857 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f44680bf020 con 0x7f447015c300 2024-03-19T06:23:10.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.655+0000 7f4467400640 1 --2- 172.21.15.32:0/964488857 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f444c067660 0x7f444c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:10.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.655+0000 7f4467400640 1 -- 172.21.15.32:0/964488857 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5752+0+0 (secure 0 0 0) 0x7f4468120a30 con 0x7f447015c300 2024-03-19T06:23:10.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.655+0000 7f446f400640 1 --2- 172.21.15.32:0/964488857 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f444c067660 0x7f444c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:10.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.655+0000 7f446f400640 1 --2- 172.21.15.32:0/964488857 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f444c067660 0x7f444c069b20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4460000f70 tx=0x7f4460009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:10.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.659+0000 7f4467400640 1 -- 172.21.15.32:0/964488857 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f44680c6030 con 0x7f447015c300 2024-03-19T06:23:10.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:10.827+0000 7f4476400640 1 -- 172.21.15.32:0/964488857 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f447006b020 con 0x7f447015c300 2024-03-19T06:23:11.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.467+0000 7f4467400640 1 -- 172.21.15.32:0/964488857 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4468016620 con 0x7f447015c300 2024-03-19T06:23:11.456 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' removed 2024-03-19T06:23:11.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.471+0000 7f4476400640 1 -- 172.21.15.32:0/964488857 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f444c067660 msgr2=0x7f444c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:11.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.471+0000 7f4476400640 1 --2- 172.21.15.32:0/964488857 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f444c067660 0x7f444c069b20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4460000f70 tx=0x7f4460009040 comp rx=0 tx=0).stop 2024-03-19T06:23:11.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.471+0000 7f4476400640 1 -- 172.21.15.32:0/964488857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f447015c300 msgr2=0x7f447012fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:11.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.471+0000 7f4476400640 1 --2- 172.21.15.32:0/964488857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f447015c300 0x7f447012fc90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f44680af040 tx=0x7f4468019710 comp rx=0 tx=0).stop 2024-03-19T06:23:11.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.471+0000 7f4476400640 1 -- 172.21.15.32:0/964488857 shutdown_connections 2024-03-19T06:23:11.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.471+0000 7f4476400640 1 --2- 172.21.15.32:0/964488857 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f444c067660 0x7f444c069b20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:11.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.471+0000 7f4476400640 1 --2- 172.21.15.32:0/964488857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f447015c300 0x7f447012fc90 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:11.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.471+0000 7f4476400640 1 --2- 172.21.15.32:0/964488857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44701450a0 0x7f44701f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:11.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.471+0000 7f4476400640 1 --2- 172.21.15.32:0/964488857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44700713c0 0x7f44701420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:11.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.471+0000 7f4476400640 1 -- 172.21.15.32:0/964488857 >> 172.21.15.32:0/964488857 conn(0x7f44700671f0 msgr2=0x7f447015f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:11.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.471+0000 7f4476400640 1 -- 172.21.15.32:0/964488857 shutdown_connections 2024-03-19T06:23:11.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.471+0000 7f4476400640 1 -- 172.21.15.32:0/964488857 wait complete. 2024-03-19T06:23:11.486 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2024-03-19T06:23:11.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.643+0000 7f8dd7400640 1 Processor -- start 2024-03-19T06:23:11.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.643+0000 7f8dd7400640 1 -- start start 2024-03-19T06:23:11.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.647+0000 7f8dd7400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd01450a0 0x7f8dd006d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:11.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.647+0000 7f8dd7400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8dd006d960 0x7f8dd00713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:11.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.647+0000 7f8dd7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8dd0071900 0x7f8dd015f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:11.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.647+0000 7f8dd7400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd0071d70 con 0x7f8dd0071900 2024-03-19T06:23:11.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.647+0000 7f8dd7400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd00af190 con 0x7f8dd006d960 2024-03-19T06:23:11.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.647+0000 7f8dd7400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd006df90 con 0x7f8dd01450a0 2024-03-19T06:23:11.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.647+0000 7f8dd5400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8dd0071900 0x7f8dd015f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:11.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.647+0000 7f8dd5400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8dd0071900 0x7f8dd015f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33846/0 (socket says 172.21.15.32:33846) 2024-03-19T06:23:11.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.647+0000 7f8dd5400640 1 -- 172.21.15.32:0/3031734409 learned_addr learned my addr 172.21.15.32:0/3031734409 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:11.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.647+0000 7f8dcfe00640 1 --2- 172.21.15.32:0/3031734409 >> v2:172.21.15.171:3300/0 conn(0x7f8dd006d960 0x7f8dd00713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:11.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.647+0000 7f8dd4a00640 1 --2- 172.21.15.32:0/3031734409 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd01450a0 0x7f8dd006d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:11.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.647+0000 7f8dd5400640 1 -- 172.21.15.32:0/3031734409 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd01450a0 msgr2=0x7f8dd006d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:11.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.647+0000 7f8dd5400640 1 --2- 172.21.15.32:0/3031734409 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd01450a0 0x7f8dd006d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:11.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.647+0000 7f8dd5400640 1 -- 172.21.15.32:0/3031734409 >> v2:172.21.15.171:3300/0 conn(0x7f8dd006d960 msgr2=0x7f8dd00713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:11.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.647+0000 7f8dd5400640 1 --2- 172.21.15.32:0/3031734409 >> v2:172.21.15.171:3300/0 conn(0x7f8dd006d960 0x7f8dd00713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:11.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.647+0000 7f8dd5400640 1 -- 172.21.15.32:0/3031734409 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd006e270 con 0x7f8dd0071900 2024-03-19T06:23:11.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.651+0000 7f8dd5400640 1 --2- 172.21.15.32:0/3031734409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dd0071900 0x7f8dd015f3f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8dd006e1a0 tx=0x7f8dc801c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4187a9295cc82aaa server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:11.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.651+0000 7f8dcf400640 1 -- 172.21.15.32:0/3031734409 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc80ac020 con 0x7f8dd0071900 2024-03-19T06:23:11.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.651+0000 7f8dcf400640 1 -- 172.21.15.32:0/3031734409 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc80a6420 con 0x7f8dd0071900 2024-03-19T06:23:11.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.651+0000 7f8dcf400640 1 -- 172.21.15.32:0/3031734409 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc80a67f0 con 0x7f8dd0071900 2024-03-19T06:23:11.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.651+0000 7f8dd7400640 1 -- 172.21.15.32:0/3031734409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dd0071900 msgr2=0x7f8dd015f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:11.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.651+0000 7f8dd7400640 1 --2- 172.21.15.32:0/3031734409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dd0071900 0x7f8dd015f3f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8dd006e1a0 tx=0x7f8dc801c6a0 comp rx=0 tx=0).stop 2024-03-19T06:23:11.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.651+0000 7f8dd7400640 1 -- 172.21.15.32:0/3031734409 shutdown_connections 2024-03-19T06:23:11.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.651+0000 7f8dd7400640 1 --2- 172.21.15.32:0/3031734409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dd0071900 0x7f8dd015f3f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:11.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.651+0000 7f8dd7400640 1 --2- 172.21.15.32:0/3031734409 >> v2:172.21.15.171:3300/0 conn(0x7f8dd006d960 0x7f8dd00713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:11.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.651+0000 7f8dd7400640 1 --2- 172.21.15.32:0/3031734409 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd01450a0 0x7f8dd006d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:11.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.651+0000 7f8dd7400640 1 -- 172.21.15.32:0/3031734409 >> 172.21.15.32:0/3031734409 conn(0x7f8dd00671f0 msgr2=0x7f8dd006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:11.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.651+0000 7f8dd7400640 1 -- 172.21.15.32:0/3031734409 shutdown_connections 2024-03-19T06:23:11.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.651+0000 7f8dd7400640 1 -- 172.21.15.32:0/3031734409 wait complete. 2024-03-19T06:23:11.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.651+0000 7f8dd7400640 1 Processor -- start 2024-03-19T06:23:11.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.651+0000 7f8dd7400640 1 -- start start 2024-03-19T06:23:11.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dd006d960 0x7f8dd0164b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:11.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd7400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dd0071900 0x7f8dd00b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:11.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd7400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd01450a0 0x7f8dd013f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:11.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd7400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd015c300 con 0x7f8dd006d960 2024-03-19T06:23:11.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd7400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd0145480 con 0x7f8dd0071900 2024-03-19T06:23:11.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd7400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd015c480 con 0x7f8dd01450a0 2024-03-19T06:23:11.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd4a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dd006d960 0x7f8dd0164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:11.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd4a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dd006d960 0x7f8dd0164b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33862/0 (socket says 172.21.15.32:33862) 2024-03-19T06:23:11.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd4a00640 1 -- 172.21.15.32:0/2981956527 learned_addr learned my addr 172.21.15.32:0/2981956527 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dcfe00640 1 --2- 172.21.15.32:0/2981956527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dd0071900 0x7f8dd00b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd5400640 1 --2- 172.21.15.32:0/2981956527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd01450a0 0x7f8dd013f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd4a00640 1 -- 172.21.15.32:0/2981956527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd01450a0 msgr2=0x7f8dd013f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd4a00640 1 --2- 172.21.15.32:0/2981956527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd01450a0 0x7f8dd013f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd4a00640 1 -- 172.21.15.32:0/2981956527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dd0071900 msgr2=0x7f8dd00b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd4a00640 1 --2- 172.21.15.32:0/2981956527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dd0071900 0x7f8dd00b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd4a00640 1 -- 172.21.15.32:0/2981956527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd00b29c0 con 0x7f8dd006d960 2024-03-19T06:23:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dcfe00640 1 --2- 172.21.15.32:0/2981956527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dd0071900 0x7f8dd00b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd4a00640 1 --2- 172.21.15.32:0/2981956527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dd006d960 0x7f8dd0164b90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400d5f0 tx=0x7f8dc400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dccc00640 1 -- 172.21.15.32:0/2981956527 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc40125f0 con 0x7f8dd006d960 2024-03-19T06:23:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dccc00640 1 -- 172.21.15.32:0/2981956527 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc4019070 con 0x7f8dd006d960 2024-03-19T06:23:11.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dccc00640 1 -- 172.21.15.32:0/2981956527 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc40129b0 con 0x7f8dd006d960 2024-03-19T06:23:11.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd7400640 1 -- 172.21.15.32:0/2981956527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd00b2ca0 con 0x7f8dd006d960 2024-03-19T06:23:11.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd7400640 1 -- 172.21.15.32:0/2981956527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd00b3260 con 0x7f8dd006d960 2024-03-19T06:23:11.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dd7400640 1 -- 172.21.15.32:0/2981956527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd00749e0 con 0x7f8dd006d960 2024-03-19T06:23:11.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.655+0000 7f8dccc00640 1 -- 172.21.15.32:0/2981956527 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8dc4012b50 con 0x7f8dd006d960 2024-03-19T06:23:11.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.659+0000 7f8dccc00640 1 --2- 172.21.15.32:0/2981956527 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8db0067660 0x7f8db0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:11.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.659+0000 7f8dccc00640 1 -- 172.21.15.32:0/2981956527 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5338+0+0 (secure 0 0 0) 0x7f8dc4086590 con 0x7f8dd006d960 2024-03-19T06:23:11.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.659+0000 7f8dcfe00640 1 --2- 172.21.15.32:0/2981956527 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8db0067660 0x7f8db0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:11.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.659+0000 7f8dcfe00640 1 --2- 172.21.15.32:0/2981956527 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8db0067660 0x7f8db0069b20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8dd015b730 tx=0x7f8dbc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:11.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.659+0000 7f8dccc00640 1 -- 172.21.15.32:0/2981956527 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f8dc4013390 con 0x7f8dd006d960 2024-03-19T06:23:11.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:11.823+0000 7f8dd7400640 1 -- 172.21.15.32:0/2981956527 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8dd015b970 con 0x7f8dd006d960 2024-03-19T06:23:12.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.483+0000 7f8dccc00640 1 -- 172.21.15.32:0/2981956527 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v42) v1 ==== 160+0+0 (secure 0 0 0) 0x7f8dc40573f0 con 0x7f8dd006d960 2024-03-19T06:23:12.471 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'data_new' removed 2024-03-19T06:23:12.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.487+0000 7f8dd7400640 1 -- 172.21.15.32:0/2981956527 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8db0067660 msgr2=0x7f8db0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:12.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.487+0000 7f8dd7400640 1 --2- 172.21.15.32:0/2981956527 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8db0067660 0x7f8db0069b20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8dd015b730 tx=0x7f8dbc008040 comp rx=0 tx=0).stop 2024-03-19T06:23:12.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.487+0000 7f8dd7400640 1 -- 172.21.15.32:0/2981956527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dd006d960 msgr2=0x7f8dd0164b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:12.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.487+0000 7f8dd7400640 1 --2- 172.21.15.32:0/2981956527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dd006d960 0x7f8dd0164b90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400d5f0 tx=0x7f8dc400dab0 comp rx=0 tx=0).stop 2024-03-19T06:23:12.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.487+0000 7f8dd7400640 1 -- 172.21.15.32:0/2981956527 shutdown_connections 2024-03-19T06:23:12.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.487+0000 7f8dd7400640 1 --2- 172.21.15.32:0/2981956527 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8db0067660 0x7f8db0069b20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:12.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.487+0000 7f8dd7400640 1 --2- 172.21.15.32:0/2981956527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd01450a0 0x7f8dd013f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:12.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.487+0000 7f8dd7400640 1 --2- 172.21.15.32:0/2981956527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dd0071900 0x7f8dd00b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:12.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.487+0000 7f8dd7400640 1 --2- 172.21.15.32:0/2981956527 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dd006d960 0x7f8dd0164b90 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:12.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.487+0000 7f8dd7400640 1 -- 172.21.15.32:0/2981956527 >> 172.21.15.32:0/2981956527 conn(0x7f8dd00671f0 msgr2=0x7f8dd0074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:12.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.487+0000 7f8dd7400640 1 -- 172.21.15.32:0/2981956527 shutdown_connections 2024-03-19T06:23:12.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.487+0000 7f8dd7400640 1 -- 172.21.15.32:0/2981956527 wait complete. 2024-03-19T06:23:12.500 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-19T06:23:12.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.659+0000 7f7463200640 1 Processor -- start 2024-03-19T06:23:12.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.659+0000 7f7463200640 1 -- start start 2024-03-19T06:23:12.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.659+0000 7f7463200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f745c06b450 0x7f745c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:12.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.659+0000 7f7463200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f745c0aea70 0x7f745c0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:12.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.659+0000 7f7463200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745c0af2d0 con 0x7f745c15a840 2024-03-19T06:23:12.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.659+0000 7f7463200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745c0cdc20 con 0x7f745c06b450 2024-03-19T06:23:12.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.659+0000 7f7463200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745c15eea0 con 0x7f745c0aea70 2024-03-19T06:23:12.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.659+0000 7f7453400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f745c06b450 0x7f745c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:12.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.659+0000 7f7453400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f745c06b450 0x7f745c06f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33874/0 (socket says 172.21.15.32:33874) 2024-03-19T06:23:12.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.659+0000 7f7453400640 1 -- 172.21.15.32:0/2268543233 learned_addr learned my addr 172.21.15.32:0/2268543233 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:12.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.659+0000 7f7461200640 1 --2- 172.21.15.32:0/2268543233 >> v2:172.21.15.171:3300/0 conn(0x7f745c0aea70 0x7f745c0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:12.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.659+0000 7f7453400640 1 -- 172.21.15.32:0/2268543233 >> v2:172.21.15.171:3300/0 conn(0x7f745c0aea70 msgr2=0x7f745c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:12.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.659+0000 7f7453400640 1 --2- 172.21.15.32:0/2268543233 >> v2:172.21.15.171:3300/0 conn(0x7f745c0aea70 0x7f745c0ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:12.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.659+0000 7f7453400640 1 -- 172.21.15.32:0/2268543233 >> v1:172.21.15.171:6789/0 conn(0x7f745c15a840 legacy=0x7f745c06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:12.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.659+0000 7f7453400640 1 -- 172.21.15.32:0/2268543233 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c15f180 con 0x7f745c06b450 2024-03-19T06:23:12.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.663+0000 7f7453400640 1 --2- 172.21.15.32:0/2268543233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c06b450 0x7f745c06f040 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f745c06bcb0 tx=0x7f744401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cfc66d049943238 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:12.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.663+0000 7f745b400640 1 -- 172.21.15.32:0/2268543233 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74440a5840 con 0x7f745c06b450 2024-03-19T06:23:12.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.663+0000 7f745b400640 1 -- 172.21.15.32:0/2268543233 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74440a59e0 con 0x7f745c06b450 2024-03-19T06:23:12.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.663+0000 7f745b400640 1 -- 172.21.15.32:0/2268543233 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74440a5db0 con 0x7f745c06b450 2024-03-19T06:23:12.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.663+0000 7f7463200640 1 -- 172.21.15.32:0/2268543233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c06b450 msgr2=0x7f745c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:12.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.663+0000 7f7463200640 1 --2- 172.21.15.32:0/2268543233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c06b450 0x7f745c06f040 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f745c06bcb0 tx=0x7f744401c920 comp rx=0 tx=0).stop 2024-03-19T06:23:12.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.663+0000 7f7463200640 1 -- 172.21.15.32:0/2268543233 shutdown_connections 2024-03-19T06:23:12.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.663+0000 7f7463200640 1 --2- 172.21.15.32:0/2268543233 >> v2:172.21.15.171:3300/0 conn(0x7f745c0aea70 0x7f745c0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:12.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.663+0000 7f7463200640 1 --2- 172.21.15.32:0/2268543233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c06b450 0x7f745c06f040 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:12.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.663+0000 7f7463200640 1 -- 172.21.15.32:0/2268543233 >> 172.21.15.32:0/2268543233 conn(0x7f745c0b1590 msgr2=0x7f745c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:12.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.663+0000 7f7463200640 1 -- 172.21.15.32:0/2268543233 shutdown_connections 2024-03-19T06:23:12.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.663+0000 7f7463200640 1 -- 172.21.15.32:0/2268543233 wait complete. 2024-03-19T06:23:12.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7463200640 1 Processor -- start 2024-03-19T06:23:12.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7463200640 1 -- start start 2024-03-19T06:23:12.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7463200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f745c06b450 0x7f745c157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7463200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c0aea70 0x7f745c15d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7463200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f745c15a840 0x7f745c1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7463200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c0cef80 con 0x7f745c0aea70 2024-03-19T06:23:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7463200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c0cee00 con 0x7f745c15a840 2024-03-19T06:23:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7463200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745c0cf100 con 0x7f745c06b450 2024-03-19T06:23:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7453400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c0aea70 0x7f745c15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7453400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c0aea70 0x7f745c15d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33886/0 (socket says 172.21.15.32:33886) 2024-03-19T06:23:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7453400640 1 -- 172.21.15.32:0/2566436415 learned_addr learned my addr 172.21.15.32:0/2566436415 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7461200640 1 --2- 172.21.15.32:0/2566436415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f745c15a840 0x7f745c1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f745be00640 1 --2- 172.21.15.32:0/2566436415 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f745c06b450 0x7f745c157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7453400640 1 -- 172.21.15.32:0/2566436415 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f745c06b450 msgr2=0x7f745c157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7453400640 1 --2- 172.21.15.32:0/2566436415 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f745c06b450 0x7f745c157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7453400640 1 -- 172.21.15.32:0/2566436415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f745c15a840 msgr2=0x7f745c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7453400640 1 --2- 172.21.15.32:0/2566436415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f745c15a840 0x7f745c1591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:12.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7453400640 1 -- 172.21.15.32:0/2566436415 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c156a60 con 0x7f745c0aea70 2024-03-19T06:23:12.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7453400640 1 --2- 172.21.15.32:0/2566436415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c0aea70 0x7f745c15d250 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7444019530 tx=0x7f74440196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:12.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7458c00640 1 -- 172.21.15.32:0/2566436415 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74440bc020 con 0x7f745c0aea70 2024-03-19T06:23:12.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7458c00640 1 -- 172.21.15.32:0/2566436415 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74440b8690 con 0x7f745c0aea70 2024-03-19T06:23:12.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7458c00640 1 -- 172.21.15.32:0/2566436415 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74440b8a80 con 0x7f745c0aea70 2024-03-19T06:23:12.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7463200640 1 -- 172.21.15.32:0/2566436415 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745c156d40 con 0x7f745c0aea70 2024-03-19T06:23:12.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7463200640 1 -- 172.21.15.32:0/2566436415 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745c157300 con 0x7f745c0aea70 2024-03-19T06:23:12.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.667+0000 7f7463200640 1 -- 172.21.15.32:0/2566436415 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745c0749e0 con 0x7f745c0aea70 2024-03-19T06:23:12.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.671+0000 7f7458c00640 1 -- 172.21.15.32:0/2566436415 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f74440bf020 con 0x7f745c0aea70 2024-03-19T06:23:12.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.671+0000 7f7458c00640 1 --2- 172.21.15.32:0/2566436415 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7438067660 0x7f7438069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:12.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.671+0000 7f7458c00640 1 -- 172.21.15.32:0/2566436415 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7444120650 con 0x7f745c0aea70 2024-03-19T06:23:12.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.671+0000 7f745be00640 1 --2- 172.21.15.32:0/2566436415 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7438067660 0x7f7438069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:12.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.671+0000 7f745be00640 1 --2- 172.21.15.32:0/2566436415 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7438067660 0x7f7438069b20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f744c007fd0 tx=0x7f744c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:12.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.675+0000 7f7458c00640 1 -- 172.21.15.32:0/2566436415 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f74440c6030 con 0x7f745c0aea70 2024-03-19T06:23:12.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.847+0000 7f7463200640 1 -- 172.21.15.32:0/2566436415 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f745c0723f0 con 0x7f745c0aea70 2024-03-19T06:23:12.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.851+0000 7f7458c00640 1 -- 172.21.15.32:0/2566436415 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f74440165a0 con 0x7f745c0aea70 2024-03-19T06:23:12.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.855+0000 7f7463200640 1 -- 172.21.15.32:0/2566436415 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7438067660 msgr2=0x7f7438069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:12.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.855+0000 7f7463200640 1 --2- 172.21.15.32:0/2566436415 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7438067660 0x7f7438069b20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f744c007fd0 tx=0x7f744c009040 comp rx=0 tx=0).stop 2024-03-19T06:23:12.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.855+0000 7f7463200640 1 -- 172.21.15.32:0/2566436415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c0aea70 msgr2=0x7f745c15d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:12.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.855+0000 7f7463200640 1 --2- 172.21.15.32:0/2566436415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c0aea70 0x7f745c15d250 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7444019530 tx=0x7f74440196c0 comp rx=0 tx=0).stop 2024-03-19T06:23:12.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.855+0000 7f7463200640 1 -- 172.21.15.32:0/2566436415 shutdown_connections 2024-03-19T06:23:12.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.855+0000 7f7463200640 1 --2- 172.21.15.32:0/2566436415 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7438067660 0x7f7438069b20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:12.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.855+0000 7f7463200640 1 --2- 172.21.15.32:0/2566436415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f745c15a840 0x7f745c1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:12.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.855+0000 7f7463200640 1 --2- 172.21.15.32:0/2566436415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f745c0aea70 0x7f745c15d250 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:12.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.855+0000 7f7463200640 1 --2- 172.21.15.32:0/2566436415 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f745c06b450 0x7f745c157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:12.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.855+0000 7f7463200640 1 -- 172.21.15.32:0/2566436415 >> 172.21.15.32:0/2566436415 conn(0x7f745c0b1590 msgr2=0x7f745c0b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:12.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.855+0000 7f7463200640 1 -- 172.21.15.32:0/2566436415 shutdown_connections 2024-03-19T06:23:12.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:12.855+0000 7f7463200640 1 -- 172.21.15.32:0/2566436415 wait complete. 2024-03-19T06:23:12.862 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2024-03-19T06:23:13.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe516c00640 1 Processor -- start 2024-03-19T06:23:13.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe516c00640 1 -- start start 2024-03-19T06:23:13.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe516c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe510159ed0 0x7fe5100cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe516c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe51015a2b0 0x7fe5100caf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe516c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5100ce3e0 con 0x7fe5100cdb40 2024-03-19T06:23:13.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe516c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5100ca1d0 con 0x7fe510159ed0 2024-03-19T06:23:13.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe516c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100ca4b0 con 0x7fe51015a2b0 2024-03-19T06:23:13.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe514c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe5100cdb40 0x7fe510071350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45850/0 (socket says 172.21.15.32:45850) 2024-03-19T06:23:13.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe514c00640 1 -- 172.21.15.32:0/756869841 learned_addr learned my addr 172.21.15.32:0/756869841 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:13.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe507400640 1 --2- 172.21.15.32:0/756869841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe51015a2b0 0x7fe5100caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe50fe00640 1 --2- 172.21.15.32:0/756869841 >> v2:172.21.15.171:3300/0 conn(0x7fe510159ed0 0x7fe5100cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe50f400640 1 -- 172.21.15.32:0/756869841 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317400578 0 0) 0x7fe5100ce3e0 con 0x7fe5100cdb40 2024-03-19T06:23:13.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe50f400640 1 -- 172.21.15.32:0/756869841 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4f4003530 con 0x7fe5100cdb40 2024-03-19T06:23:13.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe50f400640 1 -- 172.21.15.32:0/756869841 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2192250516 0 0) 0x7fe4f4003530 con 0x7fe5100cdb40 2024-03-19T06:23:13.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe50f400640 1 -- 172.21.15.32:0/756869841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe51015a2b0 msgr2=0x7fe5100caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:13.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe50f400640 1 --2- 172.21.15.32:0/756869841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe51015a2b0 0x7fe5100caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe50f400640 1 -- 172.21.15.32:0/756869841 >> v2:172.21.15.171:3300/0 conn(0x7fe510159ed0 msgr2=0x7fe5100cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:13.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe50f400640 1 --2- 172.21.15.32:0/756869841 >> v2:172.21.15.171:3300/0 conn(0x7fe510159ed0 0x7fe5100cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe50f400640 1 -- 172.21.15.32:0/756869841 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5100ca790 con 0x7fe5100cdb40 2024-03-19T06:23:13.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe50f400640 1 -- 172.21.15.32:0/756869841 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fe5080016a0 con 0x7fe5100cdb40 2024-03-19T06:23:13.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.015+0000 7fe50f400640 1 -- 172.21.15.32:0/756869841 >> v1:172.21.15.32:6789/0 conn(0x7fe5100cdb40 legacy=0x7fe510071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50f400640 1 --2- 172.21.15.32:0/756869841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f40039c0 0x7fe4f4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50f400640 1 --2- 172.21.15.32:0/756869841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4f4004810 0x7fe4f4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50f400640 1 --2- 172.21.15.32:0/756869841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f40051d0 0x7fe4f400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50f400640 1 -- 172.21.15.32:0/756869841 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100ca1d0 con 0x7fe4f40039c0 2024-03-19T06:23:13.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50f400640 1 -- 172.21.15.32:0/756869841 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100ca4b0 con 0x7fe4f40051d0 2024-03-19T06:23:13.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50f400640 1 -- 172.21.15.32:0/756869841 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f400bf60 con 0x7fe4f4004810 2024-03-19T06:23:13.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50fe00640 1 --2- 172.21.15.32:0/756869841 >> v2:172.21.15.171:3300/0 conn(0x7fe510159ed0 0x7fe5100cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:23:13.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe507400640 1 --2- 172.21.15.32:0/756869841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe51015a2b0 0x7fe5100caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:23:13.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50fe00640 1 --2- 172.21.15.32:0/756869841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f40039c0 0x7fe4f4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe514c00640 1 --2- 172.21.15.32:0/756869841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f40051d0 0x7fe4f400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe507400640 1 --2- 172.21.15.32:0/756869841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4f4004810 0x7fe4f4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50fe00640 1 -- 172.21.15.32:0/756869841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4f4004810 msgr2=0x7fe4f4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:13.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50fe00640 1 --2- 172.21.15.32:0/756869841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4f4004810 0x7fe4f4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50fe00640 1 -- 172.21.15.32:0/756869841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f40051d0 msgr2=0x7fe4f400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:13.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50fe00640 1 --2- 172.21.15.32:0/756869841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f40051d0 0x7fe4f400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50fe00640 1 -- 172.21.15.32:0/756869841 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f4003530 con 0x7fe4f40039c0 2024-03-19T06:23:13.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe514c00640 1 --2- 172.21.15.32:0/756869841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f40051d0 0x7fe4f400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:13.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50fe00640 1 --2- 172.21.15.32:0/756869841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f40039c0 0x7fe4f4003de0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe500009cc0 tx=0x7fe50001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b69ed87c135afd server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:13.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50f400640 1 -- 172.21.15.32:0/756869841 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe500009860 con 0x7fe4f40039c0 2024-03-19T06:23:13.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50f400640 1 -- 172.21.15.32:0/756869841 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe500004020 con 0x7fe4f40039c0 2024-03-19T06:23:13.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.019+0000 7fe50f400640 1 -- 172.21.15.32:0/756869841 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe500004410 con 0x7fe4f40039c0 2024-03-19T06:23:13.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe516c00640 1 -- 172.21.15.32:0/756869841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f40039c0 msgr2=0x7fe4f4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe516c00640 1 --2- 172.21.15.32:0/756869841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f40039c0 0x7fe4f4003de0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe500009cc0 tx=0x7fe50001cc20 comp rx=0 tx=0).stop 2024-03-19T06:23:13.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe514c00640 1 -- 172.21.15.32:0/756869841 reap_dead start 2024-03-19T06:23:13.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe516c00640 1 -- 172.21.15.32:0/756869841 shutdown_connections 2024-03-19T06:23:13.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe516c00640 1 -- 172.21.15.32:0/756869841 >> 172.21.15.32:0/756869841 conn(0x7fe5100b1280 msgr2=0x7fe5100b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:13.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe516c00640 1 -- 172.21.15.32:0/756869841 shutdown_connections 2024-03-19T06:23:13.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe516c00640 1 -- 172.21.15.32:0/756869841 wait complete. 2024-03-19T06:23:13.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe516c00640 1 Processor -- start 2024-03-19T06:23:13.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe516c00640 1 -- start start 2024-03-19T06:23:13.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe516c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f40039c0 0x7fe5100b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe516c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe51014e1a0 0x7fe51014d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe516c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5101f7050 0x7fe510156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe516c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100caf90 con 0x7fe5101f7050 2024-03-19T06:23:13.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe516c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe510071c70 con 0x7fe4f40039c0 2024-03-19T06:23:13.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe516c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100cb110 con 0x7fe51014e1a0 2024-03-19T06:23:13.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe514c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5101f7050 0x7fe510156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe514c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5101f7050 0x7fe510156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33894/0 (socket says 172.21.15.32:33894) 2024-03-19T06:23:13.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe514c00640 1 -- 172.21.15.32:0/1052340130 learned_addr learned my addr 172.21.15.32:0/1052340130 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:13.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe507400640 1 --2- 172.21.15.32:0/1052340130 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe51014e1a0 0x7fe51014d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe50fe00640 1 --2- 172.21.15.32:0/1052340130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f40039c0 0x7fe5100b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe514c00640 1 -- 172.21.15.32:0/1052340130 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe51014e1a0 msgr2=0x7fe51014d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe514c00640 1 --2- 172.21.15.32:0/1052340130 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe51014e1a0 0x7fe51014d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe514c00640 1 -- 172.21.15.32:0/1052340130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f40039c0 msgr2=0x7fe5100b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe514c00640 1 --2- 172.21.15.32:0/1052340130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f40039c0 0x7fe5100b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.023+0000 7fe514c00640 1 -- 172.21.15.32:0/1052340130 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5100af130 con 0x7fe5101f7050 2024-03-19T06:23:13.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.027+0000 7fe514c00640 1 --2- 172.21.15.32:0/1052340130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5101f7050 0x7fe510156780 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe5100d06b0 tx=0x7fe50800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:13.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.027+0000 7fe50cc00640 1 -- 172.21.15.32:0/1052340130 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50800c5b0 con 0x7fe5101f7050 2024-03-19T06:23:13.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.027+0000 7fe50cc00640 1 -- 172.21.15.32:0/1052340130 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe508018070 con 0x7fe5101f7050 2024-03-19T06:23:13.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.027+0000 7fe516c00640 1 -- 172.21.15.32:0/1052340130 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5100af410 con 0x7fe5101f7050 2024-03-19T06:23:13.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.027+0000 7fe50cc00640 1 -- 172.21.15.32:0/1052340130 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50800c990 con 0x7fe5101f7050 2024-03-19T06:23:13.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.027+0000 7fe516c00640 1 -- 172.21.15.32:0/1052340130 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5100af9d0 con 0x7fe5101f7050 2024-03-19T06:23:13.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.027+0000 7fe516c00640 1 -- 172.21.15.32:0/1052340130 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5100749e0 con 0x7fe5101f7050 2024-03-19T06:23:13.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.027+0000 7fe50cc00640 1 -- 172.21.15.32:0/1052340130 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe50800cb30 con 0x7fe5101f7050 2024-03-19T06:23:13.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.027+0000 7fe50cc00640 1 --2- 172.21.15.32:0/1052340130 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe4ec067660 0x7fe4ec069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.027+0000 7fe50cc00640 1 -- 172.21.15.32:0/1052340130 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe508085160 con 0x7fe5101f7050 2024-03-19T06:23:13.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.027+0000 7fe50fe00640 1 --2- 172.21.15.32:0/1052340130 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe4ec067660 0x7fe4ec069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.031+0000 7fe50fe00640 1 --2- 172.21.15.32:0/1052340130 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe4ec067660 0x7fe4ec069b20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe5000ae000 tx=0x7fe5000046d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:13.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.031+0000 7fe50cc00640 1 -- 172.21.15.32:0/1052340130 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fe508056040 con 0x7fe5101f7050 2024-03-19T06:23:13.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.255+0000 7fe516c00640 1 -- 172.21.15.32:0/1052340130 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7fe510072600 con 0x7fe5101f7050 2024-03-19T06:23:13.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.483+0000 7fe50cc00640 1 -- 172.21.15.32:0/1052340130 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v132) v1 ==== 147+0+0 (secure 0 0 0) 0x7fe508055940 con 0x7fe5101f7050 2024-03-19T06:23:13.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.487+0000 7fe516c00640 1 -- 172.21.15.32:0/1052340130 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe4ec067660 msgr2=0x7fe4ec069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.487+0000 7fe516c00640 1 --2- 172.21.15.32:0/1052340130 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe4ec067660 0x7fe4ec069b20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe5000ae000 tx=0x7fe5000046d0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.487+0000 7fe516c00640 1 -- 172.21.15.32:0/1052340130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5101f7050 msgr2=0x7fe510156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.487+0000 7fe516c00640 1 --2- 172.21.15.32:0/1052340130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5101f7050 0x7fe510156780 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe5100d06b0 tx=0x7fe50800eb90 comp rx=0 tx=0).stop 2024-03-19T06:23:13.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.487+0000 7fe516c00640 1 -- 172.21.15.32:0/1052340130 shutdown_connections 2024-03-19T06:23:13.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.487+0000 7fe516c00640 1 --2- 172.21.15.32:0/1052340130 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe4ec067660 0x7fe4ec069b20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.487+0000 7fe516c00640 1 --2- 172.21.15.32:0/1052340130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5101f7050 0x7fe510156780 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.487+0000 7fe516c00640 1 --2- 172.21.15.32:0/1052340130 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe51014e1a0 0x7fe51014d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.487+0000 7fe516c00640 1 --2- 172.21.15.32:0/1052340130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f40039c0 0x7fe5100b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.487+0000 7fe516c00640 1 -- 172.21.15.32:0/1052340130 >> 172.21.15.32:0/1052340130 conn(0x7fe5100b1280 msgr2=0x7fe5100cb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:13.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.487+0000 7fe516c00640 1 -- 172.21.15.32:0/1052340130 shutdown_connections 2024-03-19T06:23:13.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.487+0000 7fe516c00640 1 -- 172.21.15.32:0/1052340130 wait complete. 2024-03-19T06:23:13.495 INFO:tasks.cephfs_test_runner:That a client who does not have the capability for setting ... ok 2024-03-19T06:23:13.495 INFO:tasks.cephfs_test_runner:Starting test: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-03-19T06:23:13.495 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:23:13.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.647+0000 7fd835e00640 1 Processor -- start 2024-03-19T06:23:13.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.647+0000 7fd835e00640 1 -- start start 2024-03-19T06:23:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.647+0000 7fd835e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8300cc600 0x7fd8300ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.647+0000 7fd835e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd8300717b0 0x7fd8300cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.647+0000 7fd835e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd830162520 con 0x7fd8300cc220 2024-03-19T06:23:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.647+0000 7fd835e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8301616a0 con 0x7fd8300cc600 2024-03-19T06:23:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.647+0000 7fd835e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd830071ee0 con 0x7fd8300717b0 2024-03-19T06:23:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.647+0000 7fd827e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8300cc600 0x7fd8300ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.647+0000 7fd827e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8300cc600 0x7fd8300ceff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39974/0 (socket says 172.21.15.32:39974) 2024-03-19T06:23:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.647+0000 7fd827e00640 1 -- 172.21.15.32:0/2286064326 learned_addr learned my addr 172.21.15.32:0/2286064326 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.647+0000 7fd82ea00640 1 --1- 172.21.15.32:0/2286064326 >> v1:172.21.15.32:6789/0 conn(0x7fd8300cc220 0x7fd830161e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:44928/0 (socket says 172.21.15.32:44928) 2024-03-19T06:23:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.651+0000 7fd82f400640 1 --2- 172.21.15.32:0/2286064326 >> v2:172.21.15.171:3300/0 conn(0x7fd8300717b0 0x7fd8300cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.651+0000 7fd827e00640 1 -- 172.21.15.32:0/2286064326 >> v2:172.21.15.171:3300/0 conn(0x7fd8300717b0 msgr2=0x7fd8300cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.651+0000 7fd827e00640 1 --2- 172.21.15.32:0/2286064326 >> v2:172.21.15.171:3300/0 conn(0x7fd8300717b0 0x7fd8300cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.651+0000 7fd827e00640 1 -- 172.21.15.32:0/2286064326 >> v1:172.21.15.32:6789/0 conn(0x7fd8300cc220 legacy=0x7fd830161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.651+0000 7fd827e00640 1 -- 172.21.15.32:0/2286064326 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8300721c0 con 0x7fd8300cc600 2024-03-19T06:23:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.651+0000 7fd82f400640 1 --2- 172.21.15.32:0/2286064326 >> v2:172.21.15.171:3300/0 conn(0x7fd8300717b0 0x7fd8300cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:13.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.651+0000 7fd827e00640 1 --2- 172.21.15.32:0/2286064326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8300cc600 0x7fd8300ceff0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd8300cca90 tx=0x7fd81801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21f6083ab78881f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:13.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.651+0000 7fd82e000640 1 -- 172.21.15.32:0/2286064326 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8180ab600 con 0x7fd8300cc600 2024-03-19T06:23:13.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.651+0000 7fd82e000640 1 -- 172.21.15.32:0/2286064326 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8180b0070 con 0x7fd8300cc600 2024-03-19T06:23:13.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.651+0000 7fd82e000640 1 -- 172.21.15.32:0/2286064326 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8180ab9c0 con 0x7fd8300cc600 2024-03-19T06:23:13.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.651+0000 7fd835e00640 1 -- 172.21.15.32:0/2286064326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8300cc600 msgr2=0x7fd8300ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.651+0000 7fd835e00640 1 --2- 172.21.15.32:0/2286064326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8300cc600 0x7fd8300ceff0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd8300cca90 tx=0x7fd81801c4f0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd835e00640 1 -- 172.21.15.32:0/2286064326 shutdown_connections 2024-03-19T06:23:13.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd835e00640 1 --2- 172.21.15.32:0/2286064326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8300cc600 0x7fd8300ceff0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd835e00640 1 --2- 172.21.15.32:0/2286064326 >> v2:172.21.15.171:3300/0 conn(0x7fd8300717b0 0x7fd8300cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd835e00640 1 -- 172.21.15.32:0/2286064326 >> 172.21.15.32:0/2286064326 conn(0x7fd8300b1280 msgr2=0x7fd8300b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:13.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd835e00640 1 -- 172.21.15.32:0/2286064326 shutdown_connections 2024-03-19T06:23:13.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd835e00640 1 -- 172.21.15.32:0/2286064326 wait complete. 2024-03-19T06:23:13.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd835e00640 1 Processor -- start 2024-03-19T06:23:13.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd835e00640 1 -- start start 2024-03-19T06:23:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd835e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8300717b0 0x7fd83015d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd835e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8300cc220 0x7fd830146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd835e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8300cc600 0x7fd83015f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd835e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83016abc0 con 0x7fd8300717b0 2024-03-19T06:23:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd835e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83016aa40 con 0x7fd8300cc220 2024-03-19T06:23:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd835e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83016ad40 con 0x7fd8300cc600 2024-03-19T06:23:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd82ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8300717b0 0x7fd83015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd82ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8300717b0 0x7fd83015d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39976/0 (socket says 172.21.15.32:39976) 2024-03-19T06:23:13.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd82ea00640 1 -- 172.21.15.32:0/106833573 learned_addr learned my addr 172.21.15.32:0/106833573 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:13.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd827e00640 1 --2- 172.21.15.32:0/106833573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8300cc220 0x7fd830146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd82f400640 1 --2- 172.21.15.32:0/106833573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8300cc600 0x7fd83015f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd82ea00640 1 -- 172.21.15.32:0/106833573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8300cc600 msgr2=0x7fd83015f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd82ea00640 1 --2- 172.21.15.32:0/106833573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8300cc600 0x7fd83015f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd82ea00640 1 -- 172.21.15.32:0/106833573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8300cc220 msgr2=0x7fd830146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd82ea00640 1 --2- 172.21.15.32:0/106833573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8300cc220 0x7fd830146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd82ea00640 1 -- 172.21.15.32:0/106833573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8301464c0 con 0x7fd8300717b0 2024-03-19T06:23:13.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.655+0000 7fd82ea00640 1 --2- 172.21.15.32:0/106833573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8300717b0 0x7fd83015d460 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd82000c450 tx=0x7fd82000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:13.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.659+0000 7fd827400640 1 -- 172.21.15.32:0/106833573 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820018070 con 0x7fd8300717b0 2024-03-19T06:23:13.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.659+0000 7fd827400640 1 -- 172.21.15.32:0/106833573 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd820007480 con 0x7fd8300717b0 2024-03-19T06:23:13.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.659+0000 7fd827400640 1 -- 172.21.15.32:0/106833573 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8200047f0 con 0x7fd8300717b0 2024-03-19T06:23:13.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.659+0000 7fd835e00640 1 -- 172.21.15.32:0/106833573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83015d9a0 con 0x7fd8300717b0 2024-03-19T06:23:13.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.659+0000 7fd835e00640 1 -- 172.21.15.32:0/106833573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83013fbe0 con 0x7fd8300717b0 2024-03-19T06:23:13.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.659+0000 7fd835e00640 1 -- 172.21.15.32:0/106833573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8300749e0 con 0x7fd8300717b0 2024-03-19T06:23:13.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.659+0000 7fd827400640 1 -- 172.21.15.32:0/106833573 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd82001b070 con 0x7fd8300717b0 2024-03-19T06:23:13.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.659+0000 7fd827400640 1 --2- 172.21.15.32:0/106833573 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd80c067690 0x7fd80c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.659+0000 7fd827400640 1 -- 172.21.15.32:0/106833573 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd8200847c0 con 0x7fd8300717b0 2024-03-19T06:23:13.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.659+0000 7fd827e00640 1 --2- 172.21.15.32:0/106833573 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd80c067690 0x7fd80c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.663+0000 7fd827e00640 1 --2- 172.21.15.32:0/106833573 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd80c067690 0x7fd80c069b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd8180af000 tx=0x7fd8180a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:13.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.663+0000 7fd827400640 1 -- 172.21.15.32:0/106833573 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fd820055050 con 0x7fd8300717b0 2024-03-19T06:23:13.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.827+0000 7fd835e00640 1 -- 172.21.15.32:0/106833573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd830161410 con 0x7fd8300717b0 2024-03-19T06:23:13.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.827+0000 7fd827400640 1 -- 172.21.15.32:0/106833573 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+13032 (secure 0 0 0) 0x7fd8200590f0 con 0x7fd8300717b0 2024-03-19T06:23:13.816 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:13.816 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":42,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:23:12.479995+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.32:6835/2680502611":"2024-03-20T06:23:08.459323+0000","172.21.15.32:6834/2680502611":"2024-03-20T06:23:08.459323+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:23:13.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.831+0000 7fd835e00640 1 -- 172.21.15.32:0/106833573 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd80c067690 msgr2=0x7fd80c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.831+0000 7fd835e00640 1 --2- 172.21.15.32:0/106833573 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd80c067690 0x7fd80c069b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd8180af000 tx=0x7fd8180a7000 comp rx=0 tx=0).stop 2024-03-19T06:23:13.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.831+0000 7fd835e00640 1 -- 172.21.15.32:0/106833573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8300717b0 msgr2=0x7fd83015d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.831+0000 7fd835e00640 1 --2- 172.21.15.32:0/106833573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8300717b0 0x7fd83015d460 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd82000c450 tx=0x7fd82000c910 comp rx=0 tx=0).stop 2024-03-19T06:23:13.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.831+0000 7fd835e00640 1 -- 172.21.15.32:0/106833573 shutdown_connections 2024-03-19T06:23:13.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.831+0000 7fd835e00640 1 --2- 172.21.15.32:0/106833573 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd80c067690 0x7fd80c069b50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.831+0000 7fd835e00640 1 --2- 172.21.15.32:0/106833573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8300cc600 0x7fd83015f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.831+0000 7fd835e00640 1 --2- 172.21.15.32:0/106833573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8300cc220 0x7fd830146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.831+0000 7fd835e00640 1 --2- 172.21.15.32:0/106833573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8300717b0 0x7fd83015d460 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.831+0000 7fd835e00640 1 -- 172.21.15.32:0/106833573 >> 172.21.15.32:0/106833573 conn(0x7fd8300b1280 msgr2=0x7fd8300af1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:13.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.831+0000 7fd835e00640 1 -- 172.21.15.32:0/106833573 shutdown_connections 2024-03-19T06:23:13.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.831+0000 7fd835e00640 1 -- 172.21.15.32:0/106833573 wait complete. 2024-03-19T06:23:13.838 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:23:13.839 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:23:13.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.995+0000 7f3cc7c00640 1 Processor -- start 2024-03-19T06:23:13.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.995+0000 7f3cc7c00640 1 -- start start 2024-03-19T06:23:13.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.995+0000 7f3cc7c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3cc006eed0 0x7f3cc00ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.995+0000 7f3cc7c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc00cc290 con 0x7f3cc006ad40 2024-03-19T06:23:13.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.995+0000 7f3cc7c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc00cc570 con 0x7f3cc006e320 2024-03-19T06:23:13.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.995+0000 7f3cc7c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc006dbb0 con 0x7f3cc006eed0 2024-03-19T06:23:13.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.995+0000 7f3cc5200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3cc006ad40 0x7f3cc006b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:44936/0 (socket says 172.21.15.32:44936) 2024-03-19T06:23:13.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.995+0000 7f3cc5200640 1 -- 172.21.15.32:0/2559250106 learned_addr learned my addr 172.21.15.32:0/2559250106 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:13.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.995+0000 7f3cb7e00640 1 --2- 172.21.15.32:0/2559250106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3cc006eed0 0x7f3cc00ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.995+0000 7f3cbfe00640 1 -- 172.21.15.32:0/2559250106 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686543094 0 0) 0x7f3cc00cc290 con 0x7f3cc006ad40 2024-03-19T06:23:13.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.995+0000 7f3cbfe00640 1 -- 172.21.15.32:0/2559250106 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ca4003530 con 0x7f3cc006ad40 2024-03-19T06:23:13.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.995+0000 7f3cbfe00640 1 -- 172.21.15.32:0/2559250106 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729072211 0 0) 0x7f3cc00cc570 con 0x7f3cc006e320 2024-03-19T06:23:13.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.995+0000 7f3cbfe00640 1 -- 172.21.15.32:0/2559250106 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cc00cc290 con 0x7f3cc006e320 2024-03-19T06:23:13.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.995+0000 7f3cb7e00640 1 -- 172.21.15.32:0/2559250106 >> v1:172.21.15.171:6789/0 conn(0x7f3cc006e320 legacy=0x7f3cc015bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.995+0000 7f3cb7e00640 1 -- 172.21.15.32:0/2559250106 >> v1:172.21.15.32:6789/0 conn(0x7f3cc006ad40 legacy=0x7f3cc006b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.995+0000 7f3cb7e00640 1 -- 172.21.15.32:0/2559250106 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc00cc850 con 0x7f3cc006eed0 2024-03-19T06:23:13.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.999+0000 7f3cb7e00640 1 --2- 172.21.15.32:0/2559250106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3cc006eed0 0x7f3cc00ccd10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80097f0 tx=0x7f3ca801c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e94f78d11be5f05 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:13.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.999+0000 7f3cbfe00640 1 -- 172.21.15.32:0/2559250106 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca80ab640 con 0x7f3cc006eed0 2024-03-19T06:23:13.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.999+0000 7f3cbfe00640 1 -- 172.21.15.32:0/2559250106 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca80b0070 con 0x7f3cc006eed0 2024-03-19T06:23:13.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.999+0000 7f3cbfe00640 1 -- 172.21.15.32:0/2559250106 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca80aba00 con 0x7f3cc006eed0 2024-03-19T06:23:13.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.999+0000 7f3cc7c00640 1 -- 172.21.15.32:0/2559250106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3cc006eed0 msgr2=0x7f3cc00ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.999+0000 7f3cc7c00640 1 --2- 172.21.15.32:0/2559250106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3cc006eed0 0x7f3cc00ccd10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80097f0 tx=0x7f3ca801c420 comp rx=0 tx=0).stop 2024-03-19T06:23:13.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.999+0000 7f3cc7c00640 1 -- 172.21.15.32:0/2559250106 shutdown_connections 2024-03-19T06:23:13.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.999+0000 7f3cc7c00640 1 --2- 172.21.15.32:0/2559250106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3cc006eed0 0x7f3cc00ccd10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.999+0000 7f3cc7c00640 1 -- 172.21.15.32:0/2559250106 >> 172.21.15.32:0/2559250106 conn(0x7f3cc00b1590 msgr2=0x7f3cc00b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:13.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.999+0000 7f3cc7c00640 1 -- 172.21.15.32:0/2559250106 shutdown_connections 2024-03-19T06:23:13.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:13.999+0000 7f3cc7c00640 1 -- 172.21.15.32:0/2559250106 wait complete. 2024-03-19T06:23:13.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc7c00640 1 Processor -- start 2024-03-19T06:23:13.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc7c00640 1 -- start start 2024-03-19T06:23:13.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc7c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3cc006ad40 0x7f3cc014edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc7c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3cc006e320 0x7f3cc014cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc7c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3cc006eed0 0x7f3cc014a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc7c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc0169d30 con 0x7f3cc006eed0 2024-03-19T06:23:13.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc7c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc015c980 con 0x7f3cc006e320 2024-03-19T06:23:13.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc7c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc0169eb0 con 0x7f3cc006ad40 2024-03-19T06:23:13.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc5c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3cc006eed0 0x7f3cc014a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc5c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3cc006eed0 0x7f3cc014a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39982/0 (socket says 172.21.15.32:39982) 2024-03-19T06:23:13.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc5c00640 1 -- 172.21.15.32:0/2343013289 learned_addr learned my addr 172.21.15.32:0/2343013289 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:13.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc5200640 1 --2- 172.21.15.32:0/2343013289 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3cc006ad40 0x7f3cc014edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cb7e00640 1 --2- 172.21.15.32:0/2343013289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3cc006e320 0x7f3cc014cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc5c00640 1 -- 172.21.15.32:0/2343013289 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3cc006ad40 msgr2=0x7f3cc014edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc5c00640 1 --2- 172.21.15.32:0/2343013289 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3cc006ad40 0x7f3cc014edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc5c00640 1 -- 172.21.15.32:0/2343013289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3cc006e320 msgr2=0x7f3cc014cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:13.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc5c00640 1 --2- 172.21.15.32:0/2343013289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3cc006e320 0x7f3cc014cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:13.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc5c00640 1 -- 172.21.15.32:0/2343013289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc014f440 con 0x7f3cc006eed0 2024-03-19T06:23:13.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc5c00640 1 --2- 172.21.15.32:0/2343013289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3cc006eed0 0x7f3cc014a320 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800c790 tx=0x7f3cb800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:13.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cbd600640 1 -- 172.21.15.32:0/2343013289 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8003b80 con 0x7f3cc006eed0 2024-03-19T06:23:13.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cbd600640 1 -- 172.21.15.32:0/2343013289 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb8003d20 con 0x7f3cc006eed0 2024-03-19T06:23:13.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cbd600640 1 -- 172.21.15.32:0/2343013289 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb800aa50 con 0x7f3cc006eed0 2024-03-19T06:23:13.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc7c00640 1 -- 172.21.15.32:0/2343013289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc014bc50 con 0x7f3cc006eed0 2024-03-19T06:23:13.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.003+0000 7f3cc7c00640 1 -- 172.21.15.32:0/2343013289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc014c210 con 0x7f3cc006eed0 2024-03-19T06:23:13.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.007+0000 7f3cc7c00640 1 -- 172.21.15.32:0/2343013289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc00749e0 con 0x7f3cc006eed0 2024-03-19T06:23:13.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.007+0000 7f3cbd600640 1 -- 172.21.15.32:0/2343013289 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3cb800abf0 con 0x7f3cc006eed0 2024-03-19T06:23:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.007+0000 7f3cbd600640 1 --2- 172.21.15.32:0/2343013289 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c9c067660 0x7f3c9c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.007+0000 7f3cbd600640 1 -- 172.21.15.32:0/2343013289 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3cb80854d0 con 0x7f3cc006eed0 2024-03-19T06:23:13.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.007+0000 7f3cc5200640 1 --2- 172.21.15.32:0/2343013289 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c9c067660 0x7f3c9c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:13.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.007+0000 7f3cc5200640 1 --2- 172.21.15.32:0/2343013289 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c9c067660 0x7f3c9c069b20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00011f0 tx=0x7f3cb0007d40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:14.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.011+0000 7f3cbd600640 1 -- 172.21.15.32:0/2343013289 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f3cb8055d60 con 0x7f3cc006eed0 2024-03-19T06:23:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.175+0000 7f3cc7c00640 1 -- 172.21.15.32:0/2343013289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3cc014c450 con 0x7f3cc006eed0 2024-03-19T06:23:14.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.175+0000 7f3cbd600640 1 -- 172.21.15.32:0/2343013289 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3cb8059e00 con 0x7f3cc006eed0 2024-03-19T06:23:14.162 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:23:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.175+0000 7f3cc7c00640 1 -- 172.21.15.32:0/2343013289 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c9c067660 msgr2=0x7f3c9c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.175+0000 7f3cc7c00640 1 --2- 172.21.15.32:0/2343013289 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c9c067660 0x7f3c9c069b20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00011f0 tx=0x7f3cb0007d40 comp rx=0 tx=0).stop 2024-03-19T06:23:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.175+0000 7f3cc7c00640 1 -- 172.21.15.32:0/2343013289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3cc006eed0 msgr2=0x7f3cc014a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.175+0000 7f3cc7c00640 1 --2- 172.21.15.32:0/2343013289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3cc006eed0 0x7f3cc014a320 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800c790 tx=0x7f3cb800cc50 comp rx=0 tx=0).stop 2024-03-19T06:23:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.175+0000 7f3cc7c00640 1 -- 172.21.15.32:0/2343013289 shutdown_connections 2024-03-19T06:23:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.175+0000 7f3cc7c00640 1 --2- 172.21.15.32:0/2343013289 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3c9c067660 0x7f3c9c069b20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.175+0000 7f3cc7c00640 1 --2- 172.21.15.32:0/2343013289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3cc006eed0 0x7f3cc014a320 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:14.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.175+0000 7f3cc7c00640 1 --2- 172.21.15.32:0/2343013289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3cc006e320 0x7f3cc014cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:14.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.175+0000 7f3cc7c00640 1 --2- 172.21.15.32:0/2343013289 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3cc006ad40 0x7f3cc014edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:14.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.175+0000 7f3cc7c00640 1 -- 172.21.15.32:0/2343013289 >> 172.21.15.32:0/2343013289 conn(0x7f3cc00b1590 msgr2=0x7f3cc00718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:14.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.175+0000 7f3cc7c00640 1 -- 172.21.15.32:0/2343013289 shutdown_connections 2024-03-19T06:23:14.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.175+0000 7f3cc7c00640 1 -- 172.21.15.32:0/2343013289 wait complete. 2024-03-19T06:23:14.183 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2024-03-19T06:23:14.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.335+0000 7f7617c00640 1 Processor -- start 2024-03-19T06:23:14.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.335+0000 7f7617c00640 1 -- start start 2024-03-19T06:23:14.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.335+0000 7f7617c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76100ae0b0 0x7f76100acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:14.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.335+0000 7f7617c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f761015dff0 0x7f761006bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:14.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.335+0000 7f7617c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761015e520 con 0x7f761006c290 2024-03-19T06:23:14.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.335+0000 7f7617c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f761015f1b0 con 0x7f761015dff0 2024-03-19T06:23:14.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.335+0000 7f7617c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761015e800 con 0x7f76100ae0b0 2024-03-19T06:23:14.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.335+0000 7f7615c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f761006c290 0x7f7610154130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:44940/0 (socket says 172.21.15.32:44940) 2024-03-19T06:23:14.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.335+0000 7f7615c00640 1 -- 172.21.15.32:0/3797117790 learned_addr learned my addr 172.21.15.32:0/3797117790 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:14.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.335+0000 7f7607e00640 1 --2- 172.21.15.32:0/3797117790 >> v2:172.21.15.171:3300/0 conn(0x7f761015dff0 0x7f761006bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:14.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.335+0000 7f7615200640 1 --2- 172.21.15.32:0/3797117790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76100ae0b0 0x7f76100acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:14.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f760fe00640 1 -- 172.21.15.32:0/3797117790 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768713284 0 0) 0x7f761015e520 con 0x7f761006c290 2024-03-19T06:23:14.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f760fe00640 1 -- 172.21.15.32:0/3797117790 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f4003530 con 0x7f761006c290 2024-03-19T06:23:14.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f760fe00640 1 -- 172.21.15.32:0/3797117790 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2846521553 0 0) 0x7f75f4003530 con 0x7f761006c290 2024-03-19T06:23:14.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f760fe00640 1 -- 172.21.15.32:0/3797117790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76100ae0b0 msgr2=0x7f76100acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f760fe00640 1 --2- 172.21.15.32:0/3797117790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76100ae0b0 0x7f76100acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f760fe00640 1 -- 172.21.15.32:0/3797117790 >> v2:172.21.15.171:3300/0 conn(0x7f761015dff0 msgr2=0x7f761006bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f760fe00640 1 --2- 172.21.15.32:0/3797117790 >> v2:172.21.15.171:3300/0 conn(0x7f761015dff0 0x7f761006bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f760fe00640 1 -- 172.21.15.32:0/3797117790 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761015eae0 con 0x7f761006c290 2024-03-19T06:23:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f760fe00640 1 -- 172.21.15.32:0/3797117790 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f7608001a00 con 0x7f761006c290 2024-03-19T06:23:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f760fe00640 1 -- 172.21.15.32:0/3797117790 >> v1:172.21.15.32:6789/0 conn(0x7f761006c290 legacy=0x7f7610154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f760fe00640 1 --2- 172.21.15.32:0/3797117790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75f40039c0 0x7f75f4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f760fe00640 1 --2- 172.21.15.32:0/3797117790 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75f4004810 0x7f75f4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f760fe00640 1 --2- 172.21.15.32:0/3797117790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76100ae0b0 0x7f75f40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f760fe00640 1 -- 172.21.15.32:0/3797117790 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761015f1b0 con 0x7f75f4004810 2024-03-19T06:23:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f760fe00640 1 -- 172.21.15.32:0/3797117790 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761015e800 con 0x7f75f40039c0 2024-03-19T06:23:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f760fe00640 1 -- 172.21.15.32:0/3797117790 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f400b9d0 con 0x7f76100ae0b0 2024-03-19T06:23:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f7607e00640 1 --2- 172.21.15.32:0/3797117790 >> v2:172.21.15.171:3300/0 conn(0x7f761015dff0 0x7f761006bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:23:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f7615200640 1 --2- 172.21.15.32:0/3797117790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75f40039c0 0x7f75f4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f7607e00640 1 --2- 172.21.15.32:0/3797117790 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75f4004810 0x7f75f4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:14.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f7615c00640 1 --2- 172.21.15.32:0/3797117790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76100ae0b0 0x7f75f40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:14.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f7607e00640 1 -- 172.21.15.32:0/3797117790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76100ae0b0 msgr2=0x7f75f40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:14.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f7607e00640 1 --2- 172.21.15.32:0/3797117790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76100ae0b0 0x7f75f40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:14.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f7607e00640 1 -- 172.21.15.32:0/3797117790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75f40039c0 msgr2=0x7f75f4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:14.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f7607e00640 1 --2- 172.21.15.32:0/3797117790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75f40039c0 0x7f75f4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:14.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.339+0000 7f7607e00640 1 -- 172.21.15.32:0/3797117790 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f4003530 con 0x7f75f4004810 2024-03-19T06:23:14.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f7607e00640 1 --2- 172.21.15.32:0/3797117790 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75f4004810 0x7f75f4004c90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009c90 tx=0x7f75f801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e585622399d50b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:14.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f760fe00640 1 -- 172.21.15.32:0/3797117790 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8009860 con 0x7f75f4004810 2024-03-19T06:23:14.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f760fe00640 1 -- 172.21.15.32:0/3797117790 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f8004020 con 0x7f75f4004810 2024-03-19T06:23:14.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f760fe00640 1 -- 172.21.15.32:0/3797117790 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8004410 con 0x7f75f4004810 2024-03-19T06:23:14.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f7617c00640 1 -- 172.21.15.32:0/3797117790 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75f4004810 msgr2=0x7f75f4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:14.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f7617c00640 1 --2- 172.21.15.32:0/3797117790 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75f4004810 0x7f75f4004c90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009c90 tx=0x7f75f801cc10 comp rx=0 tx=0).stop 2024-03-19T06:23:14.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f7615c00640 1 -- 172.21.15.32:0/3797117790 reap_dead start 2024-03-19T06:23:14.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f7617c00640 1 -- 172.21.15.32:0/3797117790 shutdown_connections 2024-03-19T06:23:14.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f7617c00640 1 -- 172.21.15.32:0/3797117790 >> 172.21.15.32:0/3797117790 conn(0x7f7610071c50 msgr2=0x7f7610072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:14.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f7617c00640 1 -- 172.21.15.32:0/3797117790 shutdown_connections 2024-03-19T06:23:14.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f7617c00640 1 -- 172.21.15.32:0/3797117790 wait complete. 2024-03-19T06:23:14.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f7617c00640 1 Processor -- start 2024-03-19T06:23:14.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f7617c00640 1 -- start start 2024-03-19T06:23:14.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f7617c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75f4004810 0x7f76101573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:14.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f7617c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f761015cc60 0x7f761015d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:14.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f7617c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f761015a880 0x7f761015ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:14.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f7617c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76100ae490 con 0x7f761015a880 2024-03-19T06:23:14.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f7617c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7610072d60 con 0x7f75f4004810 2024-03-19T06:23:14.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.343+0000 7f7617c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76100acdb0 con 0x7f761015cc60 2024-03-19T06:23:14.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f7615c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f761015a880 0x7f761015ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:14.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f7615c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f761015a880 0x7f761015ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40000/0 (socket says 172.21.15.32:40000) 2024-03-19T06:23:14.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f7615c00640 1 -- 172.21.15.32:0/3418387208 learned_addr learned my addr 172.21.15.32:0/3418387208 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:14.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f7615200640 1 --2- 172.21.15.32:0/3418387208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75f4004810 0x7f76101573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:14.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f7607e00640 1 --2- 172.21.15.32:0/3418387208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f761015cc60 0x7f761015d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:14.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f7615c00640 1 -- 172.21.15.32:0/3418387208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f761015cc60 msgr2=0x7f761015d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:14.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f7615c00640 1 --2- 172.21.15.32:0/3418387208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f761015cc60 0x7f761015d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:14.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f7615c00640 1 -- 172.21.15.32:0/3418387208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75f4004810 msgr2=0x7f76101573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:14.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f7615c00640 1 --2- 172.21.15.32:0/3418387208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75f4004810 0x7f76101573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:14.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f7615c00640 1 -- 172.21.15.32:0/3418387208 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761015b240 con 0x7f761015a880 2024-03-19T06:23:14.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f7615c00640 1 --2- 172.21.15.32:0/3418387208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f761015a880 0x7f761015ad00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f76100b52a0 tx=0x7f76080079b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:14.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f760d600640 1 -- 172.21.15.32:0/3418387208 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760801c070 con 0x7f761015a880 2024-03-19T06:23:14.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f760d600640 1 -- 172.21.15.32:0/3418387208 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760800ae30 con 0x7f761015a880 2024-03-19T06:23:14.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f7617c00640 1 -- 172.21.15.32:0/3418387208 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761014c790 con 0x7f761015a880 2024-03-19T06:23:14.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f760d600640 1 -- 172.21.15.32:0/3418387208 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608010040 con 0x7f761015a880 2024-03-19T06:23:14.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f7617c00640 1 -- 172.21.15.32:0/3418387208 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761014ca40 con 0x7f761015a880 2024-03-19T06:23:14.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f7617c00640 1 -- 172.21.15.32:0/3418387208 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76100749e0 con 0x7f761015a880 2024-03-19T06:23:14.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f760d600640 1 -- 172.21.15.32:0/3418387208 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f760801f070 con 0x7f761015a880 2024-03-19T06:23:14.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.347+0000 7f760d600640 1 --2- 172.21.15.32:0/3418387208 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f75ec067660 0x7f75ec069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:14.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.351+0000 7f760d600640 1 -- 172.21.15.32:0/3418387208 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7608087cf0 con 0x7f761015a880 2024-03-19T06:23:14.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.351+0000 7f7615200640 1 --2- 172.21.15.32:0/3418387208 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f75ec067660 0x7f75ec069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:14.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.351+0000 7f7615200640 1 --2- 172.21.15.32:0/3418387208 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f75ec067660 0x7f75ec069b20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7600009a80 tx=0x7f7600009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:14.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.351+0000 7f760d600640 1 -- 172.21.15.32:0/3418387208 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f7608058610 con 0x7f761015a880 2024-03-19T06:23:14.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:14.571+0000 7f7617c00640 1 -- 172.21.15.32:0/3418387208 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7f761015a030 con 0x7f761015a880 2024-03-19T06:23:15.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.491+0000 7f760d600640 1 -- 172.21.15.32:0/3418387208 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v134) v1 ==== 137+0+0 (secure 0 0 0) 0x7f760805c6b0 con 0x7f761015a880 2024-03-19T06:23:15.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.495+0000 7f7617c00640 1 -- 172.21.15.32:0/3418387208 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f75ec067660 msgr2=0x7f75ec069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:15.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.495+0000 7f7617c00640 1 --2- 172.21.15.32:0/3418387208 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f75ec067660 0x7f75ec069b20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7600009a80 tx=0x7f7600009190 comp rx=0 tx=0).stop 2024-03-19T06:23:15.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.495+0000 7f7617c00640 1 -- 172.21.15.32:0/3418387208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f761015a880 msgr2=0x7f761015ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:15.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.495+0000 7f7617c00640 1 --2- 172.21.15.32:0/3418387208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f761015a880 0x7f761015ad00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f76100b52a0 tx=0x7f76080079b0 comp rx=0 tx=0).stop 2024-03-19T06:23:15.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.495+0000 7f7617c00640 1 -- 172.21.15.32:0/3418387208 shutdown_connections 2024-03-19T06:23:15.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.495+0000 7f7617c00640 1 --2- 172.21.15.32:0/3418387208 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f75ec067660 0x7f75ec069b20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:15.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.495+0000 7f7617c00640 1 --2- 172.21.15.32:0/3418387208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f761015a880 0x7f761015ad00 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:15.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.495+0000 7f7617c00640 1 --2- 172.21.15.32:0/3418387208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f761015cc60 0x7f761015d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:15.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.495+0000 7f7617c00640 1 --2- 172.21.15.32:0/3418387208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f75f4004810 0x7f76101573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:15.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.495+0000 7f7617c00640 1 -- 172.21.15.32:0/3418387208 >> 172.21.15.32:0/3418387208 conn(0x7f7610071c50 msgr2=0x7f76100b4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:15.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.495+0000 7f7617c00640 1 -- 172.21.15.32:0/3418387208 shutdown_connections 2024-03-19T06:23:15.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.495+0000 7f7617c00640 1 -- 172.21.15.32:0/3418387208 wait complete. 2024-03-19T06:23:15.507 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-19T06:23:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.671+0000 7f5413c00640 1 Processor -- start 2024-03-19T06:23:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.671+0000 7f5413c00640 1 -- start start 2024-03-19T06:23:15.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.675+0000 7f5413c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f540c06ad40 0x7f540c06b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:15.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.675+0000 7f5413c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f540c06eed0 0x7f540c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.675+0000 7f5413c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540c06b660 con 0x7f540c06e320 2024-03-19T06:23:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.675+0000 7f5413c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c06dbb0 con 0x7f540c06ad40 2024-03-19T06:23:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.675+0000 7f5413c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0cc290 con 0x7f540c06eed0 2024-03-19T06:23:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.675+0000 7f5411200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f540c06ad40 0x7f540c06b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.675+0000 7f5411c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f540c06e320 0x7f540c15bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:44942/0 (socket says 172.21.15.32:44942) 2024-03-19T06:23:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.675+0000 7f5411200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f540c06ad40 0x7f540c06b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40006/0 (socket says 172.21.15.32:40006) 2024-03-19T06:23:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.675+0000 7f5411c00640 1 -- 172.21.15.32:0/1865896518 learned_addr learned my addr 172.21.15.32:0/1865896518 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.675+0000 7f5403e00640 1 --2- 172.21.15.32:0/1865896518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f540c06eed0 0x7f540c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.675+0000 7f5411200640 1 -- 172.21.15.32:0/1865896518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f540c06eed0 msgr2=0x7f540c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.675+0000 7f5411200640 1 --2- 172.21.15.32:0/1865896518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f540c06eed0 0x7f540c0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.675+0000 7f5411200640 1 -- 172.21.15.32:0/1865896518 >> v1:172.21.15.32:6789/0 conn(0x7f540c06e320 legacy=0x7f540c15bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.675+0000 7f5411200640 1 -- 172.21.15.32:0/1865896518 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c0cc570 con 0x7f540c06ad40 2024-03-19T06:23:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.675+0000 7f540be00640 1 -- 172.21.15.32:0/1865896518 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365308857 0 0) 0x7f540c06b660 con 0x7f540c06e320 2024-03-19T06:23:15.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.679+0000 7f5411200640 1 --2- 172.21.15.32:0/1865896518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540c06ad40 0x7f540c06b120 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f53fc0097c0 tx=0x7f53fc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125edbbc59dd4e7c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:15.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.679+0000 7f540be00640 1 -- 172.21.15.32:0/1865896518 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc0b1070 con 0x7f540c06ad40 2024-03-19T06:23:15.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.679+0000 7f540be00640 1 -- 172.21.15.32:0/1865896518 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc0a8050 con 0x7f540c06ad40 2024-03-19T06:23:15.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.679+0000 7f540be00640 1 -- 172.21.15.32:0/1865896518 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc0ac860 con 0x7f540c06ad40 2024-03-19T06:23:15.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.679+0000 7f5413c00640 1 -- 172.21.15.32:0/1865896518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540c06ad40 msgr2=0x7f540c06b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:15.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.679+0000 7f5413c00640 1 --2- 172.21.15.32:0/1865896518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540c06ad40 0x7f540c06b120 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f53fc0097c0 tx=0x7f53fc01c3e0 comp rx=0 tx=0).stop 2024-03-19T06:23:15.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.679+0000 7f5413c00640 1 -- 172.21.15.32:0/1865896518 shutdown_connections 2024-03-19T06:23:15.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.679+0000 7f5413c00640 1 --2- 172.21.15.32:0/1865896518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f540c06eed0 0x7f540c0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:15.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.679+0000 7f5413c00640 1 --2- 172.21.15.32:0/1865896518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540c06ad40 0x7f540c06b120 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:15.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.679+0000 7f5413c00640 1 -- 172.21.15.32:0/1865896518 >> 172.21.15.32:0/1865896518 conn(0x7f540c0b1590 msgr2=0x7f540c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:15.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.679+0000 7f5413c00640 1 -- 172.21.15.32:0/1865896518 shutdown_connections 2024-03-19T06:23:15.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.679+0000 7f5413c00640 1 -- 172.21.15.32:0/1865896518 wait complete. 2024-03-19T06:23:15.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.679+0000 7f5413c00640 1 Processor -- start 2024-03-19T06:23:15.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.679+0000 7f5413c00640 1 -- start start 2024-03-19T06:23:15.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5413c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f540c06ad40 0x7f540c1460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:15.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5413c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540c06e320 0x7f540c15a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:15.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5413c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f540c06eed0 0x7f540c15af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:15.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5413c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c15c8f0 con 0x7f540c06e320 2024-03-19T06:23:15.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5413c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c15c770 con 0x7f540c06ad40 2024-03-19T06:23:15.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5413c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c168d20 con 0x7f540c06eed0 2024-03-19T06:23:15.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5403e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540c06e320 0x7f540c15a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:15.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5403e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540c06e320 0x7f540c15a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40018/0 (socket says 172.21.15.32:40018) 2024-03-19T06:23:15.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5403e00640 1 -- 172.21.15.32:0/2908384516 learned_addr learned my addr 172.21.15.32:0/2908384516 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:15.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5411200640 1 --2- 172.21.15.32:0/2908384516 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f540c06ad40 0x7f540c1460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:15.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5411c00640 1 --2- 172.21.15.32:0/2908384516 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f540c06eed0 0x7f540c15af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:15.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5403e00640 1 -- 172.21.15.32:0/2908384516 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f540c06eed0 msgr2=0x7f540c15af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:15.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5403e00640 1 --2- 172.21.15.32:0/2908384516 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f540c06eed0 0x7f540c15af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:15.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5403e00640 1 -- 172.21.15.32:0/2908384516 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f540c06ad40 msgr2=0x7f540c1460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:15.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5403e00640 1 --2- 172.21.15.32:0/2908384516 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f540c06ad40 0x7f540c1460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:15.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5403e00640 1 -- 172.21.15.32:0/2908384516 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c0b39c0 con 0x7f540c06e320 2024-03-19T06:23:15.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5403e00640 1 --2- 172.21.15.32:0/2908384516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540c06e320 0x7f540c15a9f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f53f400d7d0 tx=0x7f53f400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:15.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5409600640 1 -- 172.21.15.32:0/2908384516 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f400b6c0 con 0x7f540c06e320 2024-03-19T06:23:15.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5409600640 1 -- 172.21.15.32:0/2908384516 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f4019070 con 0x7f540c06e320 2024-03-19T06:23:15.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5409600640 1 -- 172.21.15.32:0/2908384516 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f400ba80 con 0x7f540c06e320 2024-03-19T06:23:15.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5413c00640 1 -- 172.21.15.32:0/2908384516 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540c0b3ca0 con 0x7f540c06e320 2024-03-19T06:23:15.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5413c00640 1 -- 172.21.15.32:0/2908384516 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c0b4260 con 0x7f540c06e320 2024-03-19T06:23:15.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5413c00640 1 -- 172.21.15.32:0/2908384516 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540c0749e0 con 0x7f540c06e320 2024-03-19T06:23:15.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.683+0000 7f5409600640 1 -- 172.21.15.32:0/2908384516 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f53f400bc20 con 0x7f540c06e320 2024-03-19T06:23:15.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.687+0000 7f5409600640 1 --2- 172.21.15.32:0/2908384516 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f53e8067660 0x7f53e8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:15.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.687+0000 7f5409600640 1 -- 172.21.15.32:0/2908384516 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f53f4085870 con 0x7f540c06e320 2024-03-19T06:23:15.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.687+0000 7f5411200640 1 --2- 172.21.15.32:0/2908384516 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f53e8067660 0x7f53e8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:15.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.687+0000 7f5411200640 1 --2- 172.21.15.32:0/2908384516 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f53e8067660 0x7f53e8069b20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f53fc0ae000 tx=0x7f53fc0a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:15.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.691+0000 7f5409600640 1 -- 172.21.15.32:0/2908384516 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f53f4056190 con 0x7f540c06e320 2024-03-19T06:23:15.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.851+0000 7f5413c00640 1 -- 172.21.15.32:0/2908384516 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f540c0cec80 con 0x7f540c06e320 2024-03-19T06:23:15.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.855+0000 7f5409600640 1 -- 172.21.15.32:0/2908384516 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f53f405a230 con 0x7f540c06e320 2024-03-19T06:23:15.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.855+0000 7f5413c00640 1 -- 172.21.15.32:0/2908384516 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f53e8067660 msgr2=0x7f53e8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.855+0000 7f5413c00640 1 --2- 172.21.15.32:0/2908384516 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f53e8067660 0x7f53e8069b20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f53fc0ae000 tx=0x7f53fc0a7000 comp rx=0 tx=0).stop 2024-03-19T06:23:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.855+0000 7f5413c00640 1 -- 172.21.15.32:0/2908384516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540c06e320 msgr2=0x7f540c15a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.855+0000 7f5413c00640 1 --2- 172.21.15.32:0/2908384516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540c06e320 0x7f540c15a9f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f53f400d7d0 tx=0x7f53f400dc90 comp rx=0 tx=0).stop 2024-03-19T06:23:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.855+0000 7f5413c00640 1 -- 172.21.15.32:0/2908384516 shutdown_connections 2024-03-19T06:23:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.855+0000 7f5413c00640 1 --2- 172.21.15.32:0/2908384516 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f53e8067660 0x7f53e8069b20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.855+0000 7f5413c00640 1 --2- 172.21.15.32:0/2908384516 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f540c06eed0 0x7f540c15af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.855+0000 7f5413c00640 1 --2- 172.21.15.32:0/2908384516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f540c06e320 0x7f540c15a9f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.855+0000 7f5413c00640 1 --2- 172.21.15.32:0/2908384516 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f540c06ad40 0x7f540c1460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.855+0000 7f5413c00640 1 -- 172.21.15.32:0/2908384516 >> 172.21.15.32:0/2908384516 conn(0x7f540c0b1590 msgr2=0x7f540c06b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.855+0000 7f5413c00640 1 -- 172.21.15.32:0/2908384516 shutdown_connections 2024-03-19T06:23:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:15.855+0000 7f5413c00640 1 -- 172.21.15.32:0/2908384516 wait complete. 2024-03-19T06:23:15.864 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-19T06:23:15.865 DEBUG:teuthology.orchestra.run.smithi032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-19T06:23:15.964 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-19T06:23:16.058 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-19T06:23:16.058 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:23:16.058 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:23:16.068 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357716k,nr_inodes=4089429,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4371 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-19T06:23:16.068 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:23:16.068 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:23:16.078 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-19T06:23:16.079 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:23:16.079 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:23:16.118 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357716k,nr_inodes=4089429,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4371 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-19T06:23:16.118 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:23:16.118 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:23:16.135 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-19T06:23:16.135 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-19T06:23:16.135 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:23:16.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.311+0000 7f764c000640 1 Processor -- start 2024-03-19T06:23:16.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.311+0000 7f764c000640 1 -- start start 2024-03-19T06:23:16.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f764c000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7644159ed0 0x7f76440cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:16.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f764c000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f764415a2b0 0x7f76440caf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:16.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f764c000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76440cdb40 0x7f7644071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:16.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f764c000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76440ce3e0 con 0x7f7644159ed0 2024-03-19T06:23:16.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f764c000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76440ca1d0 con 0x7f764415a2b0 2024-03-19T06:23:16.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f764c000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76440ca4b0 con 0x7f76440cdb40 2024-03-19T06:23:16.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f7649600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7644159ed0 0x7f76440cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:16.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f7649600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7644159ed0 0x7f76440cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40032/0 (socket says 172.21.15.32:40032) 2024-03-19T06:23:16.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f7649600640 1 -- 172.21.15.32:0/449832526 learned_addr learned my addr 172.21.15.32:0/449832526 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:16.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f7648c00640 1 --2- 172.21.15.32:0/449832526 >> v2:172.21.15.171:3300/0 conn(0x7f764415a2b0 0x7f76440caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:16.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f764a000640 1 --2- 172.21.15.32:0/449832526 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76440cdb40 0x7f7644071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:16.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f7649600640 1 -- 172.21.15.32:0/449832526 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76440cdb40 msgr2=0x7f7644071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:16.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f7649600640 1 --2- 172.21.15.32:0/449832526 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76440cdb40 0x7f7644071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f7649600640 1 -- 172.21.15.32:0/449832526 >> v2:172.21.15.171:3300/0 conn(0x7f764415a2b0 msgr2=0x7f76440caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:16.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f7649600640 1 --2- 172.21.15.32:0/449832526 >> v2:172.21.15.171:3300/0 conn(0x7f764415a2b0 0x7f76440caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f7649600640 1 -- 172.21.15.32:0/449832526 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76440ca790 con 0x7f7644159ed0 2024-03-19T06:23:16.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.315+0000 7f7648c00640 1 --2- 172.21.15.32:0/449832526 >> v2:172.21.15.171:3300/0 conn(0x7f764415a2b0 0x7f76440caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:16.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.319+0000 7f7649600640 1 --2- 172.21.15.32:0/449832526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7644159ed0 0x7f76440cea60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f76440cbfe0 tx=0x7f763801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcff2a4534679e3d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:16.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.319+0000 7f7643e00640 1 -- 172.21.15.32:0/449832526 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76380b0070 con 0x7f7644159ed0 2024-03-19T06:23:16.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.319+0000 7f7643e00640 1 -- 172.21.15.32:0/449832526 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76380ab600 con 0x7f7644159ed0 2024-03-19T06:23:16.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.319+0000 7f7643e00640 1 -- 172.21.15.32:0/449832526 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76380ab9d0 con 0x7f7644159ed0 2024-03-19T06:23:16.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.319+0000 7f764c000640 1 -- 172.21.15.32:0/449832526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7644159ed0 msgr2=0x7f76440cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:16.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.319+0000 7f764c000640 1 --2- 172.21.15.32:0/449832526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7644159ed0 0x7f76440cea60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f76440cbfe0 tx=0x7f763801c460 comp rx=0 tx=0).stop 2024-03-19T06:23:16.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.319+0000 7f764c000640 1 -- 172.21.15.32:0/449832526 shutdown_connections 2024-03-19T06:23:16.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.319+0000 7f764c000640 1 --2- 172.21.15.32:0/449832526 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76440cdb40 0x7f7644071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.319+0000 7f764c000640 1 --2- 172.21.15.32:0/449832526 >> v2:172.21.15.171:3300/0 conn(0x7f764415a2b0 0x7f76440caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.319+0000 7f764c000640 1 --2- 172.21.15.32:0/449832526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7644159ed0 0x7f76440cea60 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.319+0000 7f764c000640 1 -- 172.21.15.32:0/449832526 >> 172.21.15.32:0/449832526 conn(0x7f76440b1280 msgr2=0x7f76440b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:16.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.319+0000 7f764c000640 1 -- 172.21.15.32:0/449832526 shutdown_connections 2024-03-19T06:23:16.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.319+0000 7f764c000640 1 -- 172.21.15.32:0/449832526 wait complete. 2024-03-19T06:23:16.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.319+0000 7f764c000640 1 Processor -- start 2024-03-19T06:23:16.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.319+0000 7f764c000640 1 -- start start 2024-03-19T06:23:16.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f764c000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76440cdb40 0x7f7644152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:16.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f764c000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7644159ed0 0x7f7644155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:16.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f764c000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f764415a2b0 0x7f76440c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:16.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f764c000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764406de30 con 0x7f76440cdb40 2024-03-19T06:23:16.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f764c000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76440ce160 con 0x7f7644159ed0 2024-03-19T06:23:16.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f764c000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764406dfb0 con 0x7f764415a2b0 2024-03-19T06:23:16.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f7649600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76440cdb40 0x7f7644152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:16.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f7649600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76440cdb40 0x7f7644152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40048/0 (socket says 172.21.15.32:40048) 2024-03-19T06:23:16.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f7649600640 1 -- 172.21.15.32:0/3685976283 learned_addr learned my addr 172.21.15.32:0/3685976283 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:16.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f7648c00640 1 --2- 172.21.15.32:0/3685976283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7644159ed0 0x7f7644155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:16.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f764a000640 1 --2- 172.21.15.32:0/3685976283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f764415a2b0 0x7f76440c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:16.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f7649600640 1 -- 172.21.15.32:0/3685976283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f764415a2b0 msgr2=0x7f76440c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:16.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f7649600640 1 --2- 172.21.15.32:0/3685976283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f764415a2b0 0x7f76440c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f7649600640 1 -- 172.21.15.32:0/3685976283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7644159ed0 msgr2=0x7f7644155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:16.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f7649600640 1 --2- 172.21.15.32:0/3685976283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7644159ed0 0x7f7644155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f7649600640 1 -- 172.21.15.32:0/3685976283 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7644154670 con 0x7f76440cdb40 2024-03-19T06:23:16.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f764a000640 1 --2- 172.21.15.32:0/3685976283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f764415a2b0 0x7f76440c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:16.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f7649600640 1 --2- 172.21.15.32:0/3685976283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76440cdb40 0x7f7644152cb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f76380ae040 tx=0x7f7638019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:16.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f7641600640 1 -- 172.21.15.32:0/3685976283 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76380bb070 con 0x7f76440cdb40 2024-03-19T06:23:16.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f7641600640 1 -- 172.21.15.32:0/3685976283 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76380b6430 con 0x7f76440cdb40 2024-03-19T06:23:16.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f764c000640 1 -- 172.21.15.32:0/3685976283 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7644154950 con 0x7f76440cdb40 2024-03-19T06:23:16.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f7641600640 1 -- 172.21.15.32:0/3685976283 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76380b0040 con 0x7f76440cdb40 2024-03-19T06:23:16.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f764c000640 1 -- 172.21.15.32:0/3685976283 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7644154f10 con 0x7f76440cdb40 2024-03-19T06:23:16.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.323+0000 7f764c000640 1 -- 172.21.15.32:0/3685976283 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76440749e0 con 0x7f76440cdb40 2024-03-19T06:23:16.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.327+0000 7f7641600640 1 -- 172.21.15.32:0/3685976283 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f76380be070 con 0x7f76440cdb40 2024-03-19T06:23:16.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.327+0000 7f7641600640 1 --2- 172.21.15.32:0/3685976283 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7624067660 0x7f7624069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:16.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.327+0000 7f7641600640 1 -- 172.21.15.32:0/3685976283 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f763811eb40 con 0x7f76440cdb40 2024-03-19T06:23:16.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.327+0000 7f7648c00640 1 --2- 172.21.15.32:0/3685976283 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7624067660 0x7f7624069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:16.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.327+0000 7f7648c00640 1 --2- 172.21.15.32:0/3685976283 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7624067660 0x7f7624069b20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f764415b740 tx=0x7f7630008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:16.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.331+0000 7f7641600640 1 -- 172.21.15.32:0/3685976283 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f7638016110 con 0x7f76440cdb40 2024-03-19T06:23:16.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.527+0000 7f764c000640 1 -- 172.21.15.32:0/3685976283 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7644072600 con 0x7f76440cdb40 2024-03-19T06:23:16.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.527+0000 7f7641600640 1 -- 172.21.15.32:0/3685976283 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f76380ef470 con 0x7f76440cdb40 2024-03-19T06:23:16.514 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:16.514 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3394778234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3394778234},{"type":"v1","addr":"172.21.15.171:6836","nonce":3394778234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2000291327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2000291327},{"type":"v1","addr":"172.21.15.171:6837","nonce":2000291327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/4039299860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":4039299860},{"type":"v1","addr":"172.21.15.32:6833","nonce":4039299860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5835,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/2084809860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":2084809860},{"type":"v1","addr":"172.21.15.32:6835","nonce":2084809860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[]} 2024-03-19T06:23:16.515 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 20 2024-03-19T06:23:16.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.527+0000 7f764c000640 1 -- 172.21.15.32:0/3685976283 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7624067660 msgr2=0x7f7624069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.527+0000 7f764c000640 1 --2- 172.21.15.32:0/3685976283 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7624067660 0x7f7624069b20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f764415b740 tx=0x7f7630008040 comp rx=0 tx=0).stop 2024-03-19T06:23:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.527+0000 7f764c000640 1 -- 172.21.15.32:0/3685976283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76440cdb40 msgr2=0x7f7644152cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.527+0000 7f764c000640 1 --2- 172.21.15.32:0/3685976283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76440cdb40 0x7f7644152cb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f76380ae040 tx=0x7f7638019200 comp rx=0 tx=0).stop 2024-03-19T06:23:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.527+0000 7f764c000640 1 -- 172.21.15.32:0/3685976283 shutdown_connections 2024-03-19T06:23:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.527+0000 7f764c000640 1 --2- 172.21.15.32:0/3685976283 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7624067660 0x7f7624069b20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.527+0000 7f764c000640 1 --2- 172.21.15.32:0/3685976283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f764415a2b0 0x7f76440c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.527+0000 7f764c000640 1 --2- 172.21.15.32:0/3685976283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7644159ed0 0x7f7644155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.527+0000 7f764c000640 1 --2- 172.21.15.32:0/3685976283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76440cdb40 0x7f7644152cb0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.527+0000 7f764c000640 1 -- 172.21.15.32:0/3685976283 >> 172.21.15.32:0/3685976283 conn(0x7f76440b1280 msgr2=0x7f764415cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.527+0000 7f764c000640 1 -- 172.21.15.32:0/3685976283 shutdown_connections 2024-03-19T06:23:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.527+0000 7f764c000640 1 -- 172.21.15.32:0/3685976283 wait complete. 2024-03-19T06:23:16.535 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-19T06:23:16.536 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-19T06:23:16.536 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-19T06:23:16.536 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:23:16.536 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-19T06:23:16.536 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-19T06:23:16.536 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-19T06:23:16.536 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:23:16.537 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-19T06:23:16.537 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-19T06:23:16.537 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-19T06:23:16.537 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:23:16.537 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-19T06:23:16.537 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-19T06:23:16.537 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-19T06:23:16.538 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:23:16.549 INFO:tasks.ceph.mds.a:Stopped 2024-03-19T06:23:16.549 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-19T06:23:16.550 INFO:tasks.ceph.mds.c:Stopped 2024-03-19T06:23:16.550 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-19T06:23:16.551 INFO:tasks.ceph.mds.b:Stopped 2024-03-19T06:23:16.552 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-19T06:23:16.552 INFO:tasks.ceph.mds.d:Stopped 2024-03-19T06:23:16.552 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-19T06:23:16.596 INFO:tasks.ceph.mds.a:Started 2024-03-19T06:23:16.596 DEBUG:teuthology.parallel:result is None 2024-03-19T06:23:16.597 INFO:tasks.ceph.mds.b:Started 2024-03-19T06:23:16.597 DEBUG:teuthology.parallel:result is None 2024-03-19T06:23:16.598 INFO:tasks.ceph.mds.c:Started 2024-03-19T06:23:16.598 DEBUG:teuthology.parallel:result is None 2024-03-19T06:23:16.599 INFO:tasks.ceph.mds.d:Started 2024-03-19T06:23:16.599 DEBUG:teuthology.parallel:result is None 2024-03-19T06:23:16.599 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-19T06:23:16.683 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2024-03-19T06:23:16.685 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2024-03-19T06:23:16.687 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-03-19T06:23:16.687 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-03-19T06:23:16.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.755+0000 7f0d01000640 1 Processor -- start 2024-03-19T06:23:16.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0d01000640 1 -- start start 2024-03-19T06:23:16.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0d01000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0cfc06c060 0x7f0cfc15e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:16.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0d01000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cfc06fbe0 con 0x7f0cfc099a70 2024-03-19T06:23:16.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0d01000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cfc15e940 con 0x7f0cfc0700a0 2024-03-19T06:23:16.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0d01000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cfc15ec20 con 0x7f0cfc06c060 2024-03-19T06:23:16.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0cfc099a70 0x7f0cfc099e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:44950/0 (socket says 172.21.15.32:44950) 2024-03-19T06:23:16.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9e00640 1 -- 172.21.15.32:0/2582274394 learned_addr learned my addr 172.21.15.32:0/2582274394 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9400640 1 -- 172.21.15.32:0/2582274394 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761260734 0 0) 0x7f0cec001120 con 0x7f0cfc099a70 2024-03-19T06:23:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9400640 1 -- 172.21.15.32:0/2582274394 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ce0003530 con 0x7f0cfc099a70 2024-03-19T06:23:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf1400640 1 --2- 172.21.15.32:0/2582274394 >> v2:172.21.15.171:3300/0 conn(0x7f0cfc06c060 0x7f0cfc15e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9400640 1 -- 172.21.15.32:0/2582274394 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3488244866 0 0) 0x7f0ce0003530 con 0x7f0cfc099a70 2024-03-19T06:23:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9400640 1 -- 172.21.15.32:0/2582274394 >> v2:172.21.15.171:3300/0 conn(0x7f0cfc06c060 msgr2=0x7f0cfc15e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9400640 1 --2- 172.21.15.32:0/2582274394 >> v2:172.21.15.171:3300/0 conn(0x7f0cfc06c060 0x7f0cfc15e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9400640 1 -- 172.21.15.32:0/2582274394 >> v1:172.21.15.171:6789/0 conn(0x7f0cfc0700a0 legacy=0x7f0cfc0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9400640 1 -- 172.21.15.32:0/2582274394 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc15ef00 con 0x7f0cfc099a70 2024-03-19T06:23:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9400640 1 -- 172.21.15.32:0/2582274394 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f0cec001850 con 0x7f0cfc099a70 2024-03-19T06:23:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9400640 1 -- 172.21.15.32:0/2582274394 >> v1:172.21.15.32:6789/0 conn(0x7f0cfc099a70 legacy=0x7f0cfc099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:16.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9400640 1 --2- 172.21.15.32:0/2582274394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ce0003a10 0x7f0ce0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:16.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9400640 1 --2- 172.21.15.32:0/2582274394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ce0004810 0x7f0ce0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:16.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9400640 1 --2- 172.21.15.32:0/2582274394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ce00051d0 0x7f0ce000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:16.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9400640 1 -- 172.21.15.32:0/2582274394 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc15ec20 con 0x7f0ce00051d0 2024-03-19T06:23:16.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9400640 1 -- 172.21.15.32:0/2582274394 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce000c0d0 con 0x7f0ce0004810 2024-03-19T06:23:16.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9400640 1 -- 172.21.15.32:0/2582274394 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce000c2d0 con 0x7f0ce0003a10 2024-03-19T06:23:16.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cfa800640 1 --2- 172.21.15.32:0/2582274394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ce00051d0 0x7f0ce000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:16.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf1400640 1 --2- 172.21.15.32:0/2582274394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ce0004810 0x7f0ce0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:16.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf9e00640 1 --2- 172.21.15.32:0/2582274394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ce0003a10 0x7f0ce0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:16.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf1400640 1 -- 172.21.15.32:0/2582274394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ce0003a10 msgr2=0x7f0ce0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:16.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf1400640 1 --2- 172.21.15.32:0/2582274394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ce0003a10 0x7f0ce0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf1400640 1 -- 172.21.15.32:0/2582274394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ce00051d0 msgr2=0x7f0ce000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:16.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf1400640 1 --2- 172.21.15.32:0/2582274394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ce00051d0 0x7f0ce000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cf1400640 1 -- 172.21.15.32:0/2582274394 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce0003530 con 0x7f0ce0004810 2024-03-19T06:23:16.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cfa800640 1 --2- 172.21.15.32:0/2582274394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ce00051d0 0x7f0ce000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:23:16.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.759+0000 7f0cfa800640 1 -- 172.21.15.32:0/2582274394 reap_dead start 2024-03-19T06:23:16.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.763+0000 7f0cf1400640 1 --2- 172.21.15.32:0/2582274394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ce0004810 0x7f0ce0004c90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009ae0 tx=0x7f0ce401ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f266f7fcc2c7542 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:16.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.763+0000 7f0cf9400640 1 -- 172.21.15.32:0/2582274394 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40b2070 con 0x7f0ce0004810 2024-03-19T06:23:16.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.763+0000 7f0cf9400640 1 -- 172.21.15.32:0/2582274394 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce40a5660 con 0x7f0ce0004810 2024-03-19T06:23:16.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.763+0000 7f0cf9400640 1 -- 172.21.15.32:0/2582274394 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40096b0 con 0x7f0ce0004810 2024-03-19T06:23:16.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.763+0000 7f0d01000640 1 -- 172.21.15.32:0/2582274394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ce0004810 msgr2=0x7f0ce0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.763+0000 7f0d01000640 1 --2- 172.21.15.32:0/2582274394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ce0004810 0x7f0ce0004c90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009ae0 tx=0x7f0ce401ca70 comp rx=0 tx=0).stop 2024-03-19T06:23:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.763+0000 7f0d01000640 1 -- 172.21.15.32:0/2582274394 shutdown_connections 2024-03-19T06:23:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.763+0000 7f0d01000640 1 --2- 172.21.15.32:0/2582274394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ce0004810 0x7f0ce0004c90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.763+0000 7f0d01000640 1 -- 172.21.15.32:0/2582274394 >> 172.21.15.32:0/2582274394 conn(0x7f0cfc0b3300 msgr2=0x7f0cfc0b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.763+0000 7f0d01000640 1 -- 172.21.15.32:0/2582274394 shutdown_connections 2024-03-19T06:23:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.763+0000 7f0d01000640 1 -- 172.21.15.32:0/2582274394 wait complete. 2024-03-19T06:23:16.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0d01000640 1 Processor -- start 2024-03-19T06:23:16.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0d01000640 1 -- start start 2024-03-19T06:23:16.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0d01000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ce0004810 0x7f0cfc1f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:16.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0d01000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cfc0c5d50 0x7f0cfc0c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:16.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0d01000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cfc161930 0x7f0cfc161db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:16.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0d01000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc099e50 con 0x7f0ce0004810 2024-03-19T06:23:16.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0d01000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc09a760 con 0x7f0cfc161930 2024-03-19T06:23:16.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0d01000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc099fd0 con 0x7f0cfc0c5d50 2024-03-19T06:23:16.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0cf9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ce0004810 0x7f0cfc1f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:16.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0cf9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ce0004810 0x7f0cfc1f7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40108/0 (socket says 172.21.15.32:40108) 2024-03-19T06:23:16.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0cf9e00640 1 -- 172.21.15.32:0/4071370583 learned_addr learned my addr 172.21.15.32:0/4071370583 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:16.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0cf1400640 1 --2- 172.21.15.32:0/4071370583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cfc0c5d50 0x7f0cfc0c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:16.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0cfa800640 1 --2- 172.21.15.32:0/4071370583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cfc161930 0x7f0cfc161db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:16.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0cf9e00640 1 -- 172.21.15.32:0/4071370583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cfc0c5d50 msgr2=0x7f0cfc0c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:16.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0cf9e00640 1 --2- 172.21.15.32:0/4071370583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cfc0c5d50 0x7f0cfc0c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0cf9e00640 1 -- 172.21.15.32:0/4071370583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cfc161930 msgr2=0x7f0cfc161db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:16.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0cf9e00640 1 --2- 172.21.15.32:0/4071370583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cfc161930 0x7f0cfc161db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:16.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0cf9e00640 1 -- 172.21.15.32:0/4071370583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc0c67d0 con 0x7f0ce0004810 2024-03-19T06:23:16.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0cf9e00640 1 --2- 172.21.15.32:0/4071370583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ce0004810 0x7f0cfc1f7440 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0cec007090 tx=0x7f0cec007550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:16.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0cf2a00640 1 -- 172.21.15.32:0/4071370583 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec01a070 con 0x7f0ce0004810 2024-03-19T06:23:16.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0cf2a00640 1 -- 172.21.15.32:0/4071370583 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec00f860 con 0x7f0ce0004810 2024-03-19T06:23:16.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0cf2a00640 1 -- 172.21.15.32:0/4071370583 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00fc30 con 0x7f0ce0004810 2024-03-19T06:23:16.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0d01000640 1 -- 172.21.15.32:0/4071370583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cfc0c6ab0 con 0x7f0ce0004810 2024-03-19T06:23:16.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0d01000640 1 -- 172.21.15.32:0/4071370583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cfc0c7070 con 0x7f0ce0004810 2024-03-19T06:23:16.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.767+0000 7f0d01000640 1 -- 172.21.15.32:0/4071370583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cfc0749e0 con 0x7f0ce0004810 2024-03-19T06:23:16.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.771+0000 7f0cf2a00640 1 -- 172.21.15.32:0/4071370583 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0cec01d360 con 0x7f0ce0004810 2024-03-19T06:23:16.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.771+0000 7f0cf2a00640 1 --2- 172.21.15.32:0/4071370583 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0cd8067660 0x7f0cd8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:16.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.771+0000 7f0cf2a00640 1 -- 172.21.15.32:0/4071370583 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0cec084e10 con 0x7f0ce0004810 2024-03-19T06:23:16.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.771+0000 7f0cf1400640 1 --2- 172.21.15.32:0/4071370583 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0cd8067660 0x7f0cd8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:16.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.771+0000 7f0cf1400640 1 --2- 172.21.15.32:0/4071370583 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0cd8067660 0x7f0cd8069b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40af000 tx=0x7f0ce4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:16.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.775+0000 7f0cf2a00640 1 -- 172.21.15.32:0/4071370583 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f0cec088030 con 0x7f0ce0004810 2024-03-19T06:23:16.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:16.955+0000 7f0d01000640 1 -- 172.21.15.32:0/4071370583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0cfc0b18b0 con 0x7f0ce0004810 2024-03-19T06:23:17.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:17.871+0000 7f0cf2a00640 1 -- 172.21.15.32:0/4071370583 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v47) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0cfc06fbe0 con 0x7f0ce0004810 2024-03-19T06:23:17.859 INFO:teuthology.orchestra.run.smithi032.stderr: removed all blocklist entries 2024-03-19T06:23:17.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:17.875+0000 7f0d01000640 1 -- 172.21.15.32:0/4071370583 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0cd8067660 msgr2=0x7f0cd8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:17.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:17.875+0000 7f0d01000640 1 --2- 172.21.15.32:0/4071370583 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0cd8067660 0x7f0cd8069b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40af000 tx=0x7f0ce4008040 comp rx=0 tx=0).stop 2024-03-19T06:23:17.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:17.875+0000 7f0d01000640 1 -- 172.21.15.32:0/4071370583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ce0004810 msgr2=0x7f0cfc1f7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:17.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:17.875+0000 7f0d01000640 1 --2- 172.21.15.32:0/4071370583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ce0004810 0x7f0cfc1f7440 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0cec007090 tx=0x7f0cec007550 comp rx=0 tx=0).stop 2024-03-19T06:23:17.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:17.875+0000 7f0d01000640 1 -- 172.21.15.32:0/4071370583 shutdown_connections 2024-03-19T06:23:17.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:17.875+0000 7f0d01000640 1 --2- 172.21.15.32:0/4071370583 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0cd8067660 0x7f0cd8069b20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:17.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:17.875+0000 7f0d01000640 1 --2- 172.21.15.32:0/4071370583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cfc161930 0x7f0cfc161db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:17.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:17.875+0000 7f0d01000640 1 --2- 172.21.15.32:0/4071370583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cfc0c5d50 0x7f0cfc0c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:17.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:17.875+0000 7f0d01000640 1 --2- 172.21.15.32:0/4071370583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0ce0004810 0x7f0cfc1f7440 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:17.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:17.875+0000 7f0d01000640 1 -- 172.21.15.32:0/4071370583 >> 172.21.15.32:0/4071370583 conn(0x7f0cfc0b3300 msgr2=0x7f0cfc158780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:17.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:17.875+0000 7f0d01000640 1 -- 172.21.15.32:0/4071370583 shutdown_connections 2024-03-19T06:23:17.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:17.875+0000 7f0d01000640 1 -- 172.21.15.32:0/4071370583 wait complete. 2024-03-19T06:23:17.885 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-19T06:23:18.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96f1800640 1 Processor -- start 2024-03-19T06:23:18.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96f1800640 1 -- start start 2024-03-19T06:23:18.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96f1800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f96ec06d6c0 0x7f96ec06daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96f1800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ec15fe20 con 0x7f96ec0aecf0 2024-03-19T06:23:18.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96f1800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ec160100 con 0x7f96ec15c010 2024-03-19T06:23:18.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96f1800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ec1603e0 con 0x7f96ec06d6c0 2024-03-19T06:23:18.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96eaa00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f96ec0aecf0 0x7f96ec0ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:44954/0 (socket says 172.21.15.32:44954) 2024-03-19T06:23:18.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96eaa00640 1 -- 172.21.15.32:0/3739456959 learned_addr learned my addr 172.21.15.32:0/3739456959 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:18.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96e9600640 1 -- 172.21.15.32:0/3739456959 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047379472 0 0) 0x7f96ec15fe20 con 0x7f96ec0aecf0 2024-03-19T06:23:18.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96e9600640 1 -- 172.21.15.32:0/3739456959 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96d0003530 con 0x7f96ec0aecf0 2024-03-19T06:23:18.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96eb400640 1 --2- 172.21.15.32:0/3739456959 >> v2:172.21.15.171:3300/0 conn(0x7f96ec06d6c0 0x7f96ec06daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96e9600640 1 -- 172.21.15.32:0/3739456959 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4037809639 0 0) 0x7f96d0003530 con 0x7f96ec0aecf0 2024-03-19T06:23:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96e9600640 1 -- 172.21.15.32:0/3739456959 >> v2:172.21.15.171:3300/0 conn(0x7f96ec06d6c0 msgr2=0x7f96ec06daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96e9600640 1 --2- 172.21.15.32:0/3739456959 >> v2:172.21.15.171:3300/0 conn(0x7f96ec06d6c0 0x7f96ec06daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96e9600640 1 -- 172.21.15.32:0/3739456959 >> v1:172.21.15.171:6789/0 conn(0x7f96ec15c010 legacy=0x7f96ec15f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96e9600640 1 -- 172.21.15.32:0/3739456959 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec0ca1f0 con 0x7f96ec0aecf0 2024-03-19T06:23:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96e9600640 1 -- 172.21.15.32:0/3739456959 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f96dc001680 con 0x7f96ec0aecf0 2024-03-19T06:23:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96e9600640 1 -- 172.21.15.32:0/3739456959 >> v1:172.21.15.32:6789/0 conn(0x7f96ec0aecf0 legacy=0x7f96ec0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96e9600640 1 --2- 172.21.15.32:0/3739456959 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96d00039c0 0x7f96d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96e9600640 1 --2- 172.21.15.32:0/3739456959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d0004810 0x7f96d0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96e9600640 1 --2- 172.21.15.32:0/3739456959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d00052f0 0x7f96d000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96e9600640 1 -- 172.21.15.32:0/3739456959 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec1603e0 con 0x7f96d0004810 2024-03-19T06:23:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96e9600640 1 -- 172.21.15.32:0/3739456959 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d000c1c0 con 0x7f96d00052f0 2024-03-19T06:23:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96e9600640 1 -- 172.21.15.32:0/3739456959 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d000c3c0 con 0x7f96d00039c0 2024-03-19T06:23:18.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96ea000640 1 --2- 172.21.15.32:0/3739456959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d0004810 0x7f96d0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96eaa00640 1 --2- 172.21.15.32:0/3739456959 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96d00039c0 0x7f96d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96eb400640 1 --2- 172.21.15.32:0/3739456959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d00052f0 0x7f96d000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96ea000640 1 -- 172.21.15.32:0/3739456959 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96d00039c0 msgr2=0x7f96d0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:18.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96ea000640 1 --2- 172.21.15.32:0/3739456959 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96d00039c0 0x7f96d0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96ea000640 1 -- 172.21.15.32:0/3739456959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d00052f0 msgr2=0x7f96d000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:18.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96ea000640 1 --2- 172.21.15.32:0/3739456959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d00052f0 0x7f96d000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96ea000640 1 -- 172.21.15.32:0/3739456959 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d0003530 con 0x7f96d0004810 2024-03-19T06:23:18.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.043+0000 7f96eb400640 1 -- 172.21.15.32:0/3739456959 reap_dead start 2024-03-19T06:23:18.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.047+0000 7f96ea000640 1 --2- 172.21.15.32:0/3739456959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d0004810 0x7f96d0004c90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f96d8001750 tx=0x7f96d801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a380a8689960dc9c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:18.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.047+0000 7f96e9600640 1 -- 172.21.15.32:0/3739456959 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d80013a0 con 0x7f96d0004810 2024-03-19T06:23:18.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.047+0000 7f96e9600640 1 -- 172.21.15.32:0/3739456959 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d80052f0 con 0x7f96d0004810 2024-03-19T06:23:18.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.047+0000 7f96e9600640 1 -- 172.21.15.32:0/3739456959 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8003840 con 0x7f96d0004810 2024-03-19T06:23:18.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.047+0000 7f96f1800640 1 -- 172.21.15.32:0/3739456959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d0004810 msgr2=0x7f96d0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.047+0000 7f96f1800640 1 --2- 172.21.15.32:0/3739456959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d0004810 0x7f96d0004c90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f96d8001750 tx=0x7f96d801c3c0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.047+0000 7f96f1800640 1 -- 172.21.15.32:0/3739456959 shutdown_connections 2024-03-19T06:23:18.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.047+0000 7f96f1800640 1 --2- 172.21.15.32:0/3739456959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96d0004810 0x7f96d0004c90 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.047+0000 7f96f1800640 1 -- 172.21.15.32:0/3739456959 >> 172.21.15.32:0/3739456959 conn(0x7f96ec0b1280 msgr2=0x7f96ec0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:18.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.047+0000 7f96f1800640 1 -- 172.21.15.32:0/3739456959 shutdown_connections 2024-03-19T06:23:18.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.047+0000 7f96f1800640 1 -- 172.21.15.32:0/3739456959 wait complete. 2024-03-19T06:23:18.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96f1800640 1 Processor -- start 2024-03-19T06:23:18.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96f1800640 1 -- start start 2024-03-19T06:23:18.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96f1800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d0004810 0x7f96ec1516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96f1800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96ec150830 0x7f96ec1567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96f1800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96ec156d10 0x7f96ec15de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96f1800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec15f8b0 con 0x7f96ec150830 2024-03-19T06:23:18.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96f1800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec15f730 con 0x7f96d0004810 2024-03-19T06:23:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96f1800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec15fa30 con 0x7f96ec156d10 2024-03-19T06:23:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96ea000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96ec150830 0x7f96ec1567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96ea000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96ec150830 0x7f96ec1567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40130/0 (socket says 172.21.15.32:40130) 2024-03-19T06:23:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96ea000640 1 -- 172.21.15.32:0/2303902480 learned_addr learned my addr 172.21.15.32:0/2303902480 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96eaa00640 1 --2- 172.21.15.32:0/2303902480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d0004810 0x7f96ec1516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96eb400640 1 --2- 172.21.15.32:0/2303902480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96ec156d10 0x7f96ec15de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96ea000640 1 -- 172.21.15.32:0/2303902480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96ec156d10 msgr2=0x7f96ec15de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96ea000640 1 --2- 172.21.15.32:0/2303902480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96ec156d10 0x7f96ec15de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96ea000640 1 -- 172.21.15.32:0/2303902480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d0004810 msgr2=0x7f96ec1516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96ea000640 1 --2- 172.21.15.32:0/2303902480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d0004810 0x7f96ec1516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96ea000640 1 -- 172.21.15.32:0/2303902480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec151c20 con 0x7f96ec150830 2024-03-19T06:23:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96ea000640 1 --2- 172.21.15.32:0/2303902480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96ec150830 0x7f96ec1567d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f96d8005040 tx=0x7f96d0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96e2a00640 1 -- 172.21.15.32:0/2303902480 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8007a40 con 0x7f96ec150830 2024-03-19T06:23:18.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96e2a00640 1 -- 172.21.15.32:0/2303902480 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d80ba070 con 0x7f96ec150830 2024-03-19T06:23:18.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96e2a00640 1 -- 172.21.15.32:0/2303902480 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d80054a0 con 0x7f96ec150830 2024-03-19T06:23:18.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.051+0000 7f96f1800640 1 -- 172.21.15.32:0/2303902480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ec157880 con 0x7f96ec150830 2024-03-19T06:23:18.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.055+0000 7f96f1800640 1 -- 172.21.15.32:0/2303902480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ec157e40 con 0x7f96ec150830 2024-03-19T06:23:18.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.055+0000 7f96f1800640 1 -- 172.21.15.32:0/2303902480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ec0749e0 con 0x7f96ec150830 2024-03-19T06:23:18.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.055+0000 7f96e2a00640 1 -- 172.21.15.32:0/2303902480 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f96d8007030 con 0x7f96ec150830 2024-03-19T06:23:18.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.055+0000 7f96e2a00640 1 --2- 172.21.15.32:0/2303902480 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96cc067660 0x7f96cc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.055+0000 7f96e2a00640 1 -- 172.21.15.32:0/2303902480 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f96d811f320 con 0x7f96ec150830 2024-03-19T06:23:18.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.055+0000 7f96eaa00640 1 --2- 172.21.15.32:0/2303902480 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96cc067660 0x7f96cc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.059+0000 7f96eaa00640 1 --2- 172.21.15.32:0/2303902480 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96cc067660 0x7f96cc069b20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f96dc000c10 tx=0x7f96dc007040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:18.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.059+0000 7f96e2a00640 1 -- 172.21.15.32:0/2303902480 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f96ec151c20 con 0x7f96ec150830 2024-03-19T06:23:18.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.279+0000 7f96f1800640 1 -- 172.21.15.32:0/2303902480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f96ec0afda0 con 0x7f96ec150830 2024-03-19T06:23:18.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.279+0000 7f96e2a00640 1 -- 172.21.15.32:0/2303902480 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f96d80160d0 con 0x7f96ec150830 2024-03-19T06:23:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:18.268 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:23:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_dump": [ 2024-03-19T06:23:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.a", 2024-03-19T06:23:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCWLvlljLvFGxAAlds2Mvwa4/hC2skBcC2ceA==", 2024-03-19T06:23:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-03-19T06:23:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-03-19T06:23:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-03-19T06:23:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:23:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.b", 2024-03-19T06:23:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCWLvllqALDJxAAfoy/TWEOQH79VM3rc4wOJA==", 2024-03-19T06:23:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-03-19T06:23:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-03-19T06:23:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-03-19T06:23:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:23:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.c", 2024-03-19T06:23:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCWLvllWfL0IhAAbekYB7Oxo0Mkvhr9MfnTlQ==", 2024-03-19T06:23:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-03-19T06:23:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-03-19T06:23:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-03-19T06:23:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:23:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.d", 2024-03-19T06:23:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCWLvll/Ij7LhAA6Kje3GNOhtsqVtw2XxnzbA==", 2024-03-19T06:23:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-03-19T06:23:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-03-19T06:23:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-03-19T06:23:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:23:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.0", 2024-03-19T06:23:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCYLvllx+jFFhAAnkaZb1RSqgc++W4yccQSwQ==", 2024-03-19T06:23:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-03-19T06:23:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-03-19T06:23:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:23:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.1", 2024-03-19T06:23:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCbLvllpaOLHBAAUrnlxbToEpaUGPK64IPpcw==", 2024-03-19T06:23:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-03-19T06:23:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-03-19T06:23:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:23:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.2", 2024-03-19T06:23:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCeLvllF3C8IRAAdroKWih6nFV1qSYCoB/lmw==", 2024-03-19T06:23:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-03-19T06:23:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-03-19T06:23:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:23:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.3", 2024-03-19T06:23:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQChLvllvtbDJxAArLL+/yemOLsey+PM9dkWRg==", 2024-03-19T06:23:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-03-19T06:23:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-03-19T06:23:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:23:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.4", 2024-03-19T06:23:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCnLvllKeTFLhAA9mcJnZWoF4dg9uAiVbNCvQ==", 2024-03-19T06:23:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-03-19T06:23:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-03-19T06:23:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:23:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.5", 2024-03-19T06:23:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCqLvllMLEDNBAAOS5umMhq4ko7Xaq3EPfbGA==", 2024-03-19T06:23:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-03-19T06:23:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-03-19T06:23:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:23:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.6", 2024-03-19T06:23:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCtLvllAMULORAAkXGAk1fzYoe3aLCX3X7X/Q==", 2024-03-19T06:23:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-03-19T06:23:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-03-19T06:23:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:23:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.7", 2024-03-19T06:23:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCxLvllXLiCBBAAhLxVcFjGUC/9oUgvZeEhvA==", 2024-03-19T06:23:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2024-03-19T06:23:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2024-03-19T06:23:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:23:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.0", 2024-03-19T06:23:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCWLvll4jsFMxAAr4PzH6Djodh2O01vGYgxKA==", 2024-03-19T06:23:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-03-19T06:23:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow r", 2024-03-19T06:23:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rw pool=cephfs_data" 2024-03-19T06:23:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.1", 2024-03-19T06:23:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCXLvll7wIgARAAaX65ntzvAhcJTgqzb0y1Ew==", 2024-03-19T06:23:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-03-19T06:23:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2024-03-19T06:23:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2024-03-19T06:23:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2024-03-19T06:23:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.2", 2024-03-19T06:23:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCWLvllYZFNORAALY1J92J5+349+Qeis5e7qA==", 2024-03-19T06:23:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-03-19T06:23:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2024-03-19T06:23:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2024-03-19T06:23:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2024-03-19T06:23:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.3", 2024-03-19T06:23:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCXLvllT1RXBxAAI6mJ94oohPbKmh4ItjkrBQ==", 2024-03-19T06:23:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2024-03-19T06:23:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2024-03-19T06:23:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2024-03-19T06:23:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2024-03-19T06:23:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.admin", 2024-03-19T06:23:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCVLvllGx/oOhAA13gLxJVMoUXzUlbvTMiZWw==", 2024-03-19T06:23:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-03-19T06:23:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2024-03-19T06:23:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2024-03-19T06:23:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:23:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.x", 2024-03-19T06:23:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCWLvlluVExFxAAtRoYgLHd1QZXDoHoE7hcGQ==", 2024-03-19T06:23:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-03-19T06:23:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2024-03-19T06:23:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:23:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.y", 2024-03-19T06:23:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCWLvllS0JQExAA9gZOkTMS3zZfd6B3JtfXNw==", 2024-03-19T06:23:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2024-03-19T06:23:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2024-03-19T06:23:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2024-03-19T06:23:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2024-03-19T06:23:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-03-19T06:23:18.284 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:23:18.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.283+0000 7f96f1800640 1 -- 172.21.15.32:0/2303902480 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96cc067660 msgr2=0x7f96cc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.283+0000 7f96f1800640 1 --2- 172.21.15.32:0/2303902480 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96cc067660 0x7f96cc069b20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f96dc000c10 tx=0x7f96dc007040 comp rx=0 tx=0).stop 2024-03-19T06:23:18.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.283+0000 7f96f1800640 1 -- 172.21.15.32:0/2303902480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96ec150830 msgr2=0x7f96ec1567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.283+0000 7f96f1800640 1 --2- 172.21.15.32:0/2303902480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96ec150830 0x7f96ec1567d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f96d8005040 tx=0x7f96d0005840 comp rx=0 tx=0).stop 2024-03-19T06:23:18.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.283+0000 7f96f1800640 1 -- 172.21.15.32:0/2303902480 shutdown_connections 2024-03-19T06:23:18.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.283+0000 7f96f1800640 1 --2- 172.21.15.32:0/2303902480 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96cc067660 0x7f96cc069b20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.283+0000 7f96f1800640 1 --2- 172.21.15.32:0/2303902480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96ec156d10 0x7f96ec15de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.283+0000 7f96f1800640 1 --2- 172.21.15.32:0/2303902480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96ec150830 0x7f96ec1567d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.283+0000 7f96f1800640 1 --2- 172.21.15.32:0/2303902480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d0004810 0x7f96ec1516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.283+0000 7f96f1800640 1 -- 172.21.15.32:0/2303902480 >> 172.21.15.32:0/2303902480 conn(0x7f96ec0b1280 msgr2=0x7f96ec0b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:18.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.283+0000 7f96f1800640 1 -- 172.21.15.32:0/2303902480 shutdown_connections 2024-03-19T06:23:18.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.283+0000 7f96f1800640 1 -- 172.21.15.32:0/2303902480 wait complete. 2024-03-19T06:23:18.289 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:23:18.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.439+0000 7f7a64c00640 1 Processor -- start 2024-03-19T06:23:18.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.439+0000 7f7a64c00640 1 -- start start 2024-03-19T06:23:18.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.443+0000 7f7a64c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7a6015a7c0 0x7f7a600cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.443+0000 7f7a64c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7a600cc680 0x7f7a6015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.443+0000 7f7a64c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a600cb670 con 0x7f7a600b4c50 2024-03-19T06:23:18.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.443+0000 7f7a64c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a6015e860 con 0x7f7a600cc680 2024-03-19T06:23:18.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.443+0000 7f7a64c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a600cb950 con 0x7f7a6015a7c0 2024-03-19T06:23:18.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.443+0000 7f7a57e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7a600cc680 0x7f7a6015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.443+0000 7f7a57e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7a600cc680 0x7f7a6015ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40146/0 (socket says 172.21.15.32:40146) 2024-03-19T06:23:18.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.443+0000 7f7a57e00640 1 -- 172.21.15.32:0/2596737689 learned_addr learned my addr 172.21.15.32:0/2596737689 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:18.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.443+0000 7f7a5e800640 1 --1- 172.21.15.32:0/2596737689 >> v1:172.21.15.32:6789/0 conn(0x7f7a600b4c50 0x7f7a600cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:44968/0 (socket says 172.21.15.32:44968) 2024-03-19T06:23:18.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.443+0000 7f7a5de00640 1 --2- 172.21.15.32:0/2596737689 >> v2:172.21.15.171:3300/0 conn(0x7f7a6015a7c0 0x7f7a600cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.443+0000 7f7a57e00640 1 -- 172.21.15.32:0/2596737689 >> v2:172.21.15.171:3300/0 conn(0x7f7a6015a7c0 msgr2=0x7f7a600cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:18.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.443+0000 7f7a57e00640 1 --2- 172.21.15.32:0/2596737689 >> v2:172.21.15.171:3300/0 conn(0x7f7a6015a7c0 0x7f7a600cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.443+0000 7f7a57e00640 1 -- 172.21.15.32:0/2596737689 >> v1:172.21.15.32:6789/0 conn(0x7f7a600b4c50 legacy=0x7f7a600cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.443+0000 7f7a57e00640 1 -- 172.21.15.32:0/2596737689 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6015e4f0 con 0x7f7a600cc680 2024-03-19T06:23:18.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.447+0000 7f7a57e00640 1 --2- 172.21.15.32:0/2596737689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600cc680 0x7f7a6015ecf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7a600d06b0 tx=0x7f7a4801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57493792b29ba9a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:18.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.447+0000 7f7a5d400640 1 -- 172.21.15.32:0/2596737689 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480b1070 con 0x7f7a600cc680 2024-03-19T06:23:18.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.447+0000 7f7a5d400640 1 -- 172.21.15.32:0/2596737689 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a480a8050 con 0x7f7a600cc680 2024-03-19T06:23:18.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.447+0000 7f7a5d400640 1 -- 172.21.15.32:0/2596737689 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480ac860 con 0x7f7a600cc680 2024-03-19T06:23:18.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.447+0000 7f7a64c00640 1 -- 172.21.15.32:0/2596737689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600cc680 msgr2=0x7f7a6015ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.447+0000 7f7a64c00640 1 --2- 172.21.15.32:0/2596737689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600cc680 0x7f7a6015ecf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7a600d06b0 tx=0x7f7a4801c4c0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.447+0000 7f7a64c00640 1 -- 172.21.15.32:0/2596737689 shutdown_connections 2024-03-19T06:23:18.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.447+0000 7f7a64c00640 1 --2- 172.21.15.32:0/2596737689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600cc680 0x7f7a6015ecf0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.447+0000 7f7a64c00640 1 --2- 172.21.15.32:0/2596737689 >> v2:172.21.15.171:3300/0 conn(0x7f7a6015a7c0 0x7f7a600cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.447+0000 7f7a64c00640 1 -- 172.21.15.32:0/2596737689 >> 172.21.15.32:0/2596737689 conn(0x7f7a600b1280 msgr2=0x7f7a600b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:18.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.447+0000 7f7a64c00640 1 -- 172.21.15.32:0/2596737689 shutdown_connections 2024-03-19T06:23:18.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.447+0000 7f7a64c00640 1 -- 172.21.15.32:0/2596737689 wait complete. 2024-03-19T06:23:18.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.447+0000 7f7a64c00640 1 Processor -- start 2024-03-19T06:23:18.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.447+0000 7f7a64c00640 1 -- start start 2024-03-19T06:23:18.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a64c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600b4c50 0x7f7a601f72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a64c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a600cc680 0x7f7a601fb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a64c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a6015a7c0 0x7f7a600b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a64c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6015f3b0 con 0x7f7a600b4c50 2024-03-19T06:23:18.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a64c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6015f230 con 0x7f7a6015a7c0 2024-03-19T06:23:18.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a64c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a600cbc30 con 0x7f7a600cc680 2024-03-19T06:23:18.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a5de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600b4c50 0x7f7a601f72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a5de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600b4c50 0x7f7a601f72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40148/0 (socket says 172.21.15.32:40148) 2024-03-19T06:23:18.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a5de00640 1 -- 172.21.15.32:0/1233421156 learned_addr learned my addr 172.21.15.32:0/1233421156 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:18.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a5de00640 1 -- 172.21.15.32:0/1233421156 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a600cc680 msgr2=0x7f7a601fb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a5de00640 1 --2- 172.21.15.32:0/1233421156 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a600cc680 0x7f7a601fb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a5de00640 1 -- 172.21.15.32:0/1233421156 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a6015a7c0 msgr2=0x7f7a600b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a5de00640 1 --2- 172.21.15.32:0/1233421156 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a6015a7c0 0x7f7a600b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a5de00640 1 -- 172.21.15.32:0/1233421156 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a601fb830 con 0x7f7a600b4c50 2024-03-19T06:23:18.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a5de00640 1 --2- 172.21.15.32:0/1233421156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600b4c50 0x7f7a601f72f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7a5000e930 tx=0x7f7a5000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:18.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a56000640 1 -- 172.21.15.32:0/1233421156 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a50017070 con 0x7f7a600b4c50 2024-03-19T06:23:18.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a56000640 1 -- 172.21.15.32:0/1233421156 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5000ca00 con 0x7f7a600b4c50 2024-03-19T06:23:18.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a56000640 1 -- 172.21.15.32:0/1233421156 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5000cdb0 con 0x7f7a600b4c50 2024-03-19T06:23:18.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a64c00640 1 -- 172.21.15.32:0/1233421156 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a601f78e0 con 0x7f7a600b4c50 2024-03-19T06:23:18.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a64c00640 1 -- 172.21.15.32:0/1233421156 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a601f7ea0 con 0x7f7a600b4c50 2024-03-19T06:23:18.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a64c00640 1 -- 172.21.15.32:0/1233421156 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a600749e0 con 0x7f7a600b4c50 2024-03-19T06:23:18.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.451+0000 7f7a56000640 1 -- 172.21.15.32:0/1233421156 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7a5001a070 con 0x7f7a600b4c50 2024-03-19T06:23:18.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.455+0000 7f7a56000640 1 --2- 172.21.15.32:0/1233421156 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7a3c067660 0x7f7a3c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.455+0000 7f7a56000640 1 -- 172.21.15.32:0/1233421156 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7a50085650 con 0x7f7a600b4c50 2024-03-19T06:23:18.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.455+0000 7f7a57e00640 1 --2- 172.21.15.32:0/1233421156 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7a3c067660 0x7f7a3c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.455+0000 7f7a57e00640 1 --2- 172.21.15.32:0/1233421156 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7a3c067660 0x7f7a3c069b20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7a480ae000 tx=0x7f7a48004740 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:18.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.459+0000 7f7a56000640 1 -- 172.21.15.32:0/1233421156 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f7a50056640 con 0x7f7a600b4c50 2024-03-19T06:23:18.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.619+0000 7f7a64c00640 1 -- 172.21.15.32:0/1233421156 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a600ce2d0 con 0x7f7a600b4c50 2024-03-19T06:23:18.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.619+0000 7f7a56000640 1 -- 172.21.15.32:0/1233421156 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+12903 (secure 0 0 0) 0x7f7a50055f40 con 0x7f7a600b4c50 2024-03-19T06:23:18.608 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:18.609 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":47,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:23:17.870945+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:23:18.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.623+0000 7f7a64c00640 1 -- 172.21.15.32:0/1233421156 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7a3c067660 msgr2=0x7f7a3c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.623+0000 7f7a64c00640 1 --2- 172.21.15.32:0/1233421156 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7a3c067660 0x7f7a3c069b20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7a480ae000 tx=0x7f7a48004740 comp rx=0 tx=0).stop 2024-03-19T06:23:18.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.623+0000 7f7a64c00640 1 -- 172.21.15.32:0/1233421156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600b4c50 msgr2=0x7f7a601f72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.623+0000 7f7a64c00640 1 --2- 172.21.15.32:0/1233421156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600b4c50 0x7f7a601f72f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7a5000e930 tx=0x7f7a5000edf0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.623+0000 7f7a64c00640 1 -- 172.21.15.32:0/1233421156 shutdown_connections 2024-03-19T06:23:18.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.623+0000 7f7a64c00640 1 --2- 172.21.15.32:0/1233421156 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7a3c067660 0x7f7a3c069b20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.623+0000 7f7a64c00640 1 --2- 172.21.15.32:0/1233421156 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a6015a7c0 0x7f7a600b06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.623+0000 7f7a64c00640 1 --2- 172.21.15.32:0/1233421156 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a600cc680 0x7f7a601fb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.623+0000 7f7a64c00640 1 --2- 172.21.15.32:0/1233421156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a600b4c50 0x7f7a601f72f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.623+0000 7f7a64c00640 1 -- 172.21.15.32:0/1233421156 >> 172.21.15.32:0/1233421156 conn(0x7f7a600b1280 msgr2=0x7f7a600b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:18.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.623+0000 7f7a64c00640 1 -- 172.21.15.32:0/1233421156 shutdown_connections 2024-03-19T06:23:18.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.623+0000 7f7a64c00640 1 -- 172.21.15.32:0/1233421156 wait complete. 2024-03-19T06:23:18.630 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:23:18.630 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:23:18.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.783+0000 7f5afc800640 1 Processor -- start 2024-03-19T06:23:18.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.783+0000 7f5afc800640 1 -- start start 2024-03-19T06:23:18.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.787+0000 7f5afc800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5af4150ad0 0x7f5af4150f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.787+0000 7f5afc800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5af40b2f80 0x7f5af40b3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.787+0000 7f5afc800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af40b3950 con 0x7f5af4071550 2024-03-19T06:23:18.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.787+0000 7f5afc800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af41514a0 con 0x7f5af4150ad0 2024-03-19T06:23:18.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.787+0000 7f5afc800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af40b3c00 con 0x7f5af40b2f80 2024-03-19T06:23:18.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.787+0000 7f5af9e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5af4071550 0x7f5af4071930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:44984/0 (socket says 172.21.15.32:44984) 2024-03-19T06:23:18.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.787+0000 7f5af9e00640 1 -- 172.21.15.32:0/3891776728 learned_addr learned my addr 172.21.15.32:0/3891776728 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:18.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.787+0000 7f5af9400640 1 --2- 172.21.15.32:0/3891776728 >> v2:172.21.15.32:3300/0 conn(0x7f5af4150ad0 0x7f5af4150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.787+0000 7f5afa800640 1 --2- 172.21.15.32:0/3891776728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5af40b2f80 0x7f5af40b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.787+0000 7f5af8a00640 1 -- 172.21.15.32:0/3891776728 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747337292 0 0) 0x7f5af40b3950 con 0x7f5af4071550 2024-03-19T06:23:18.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.787+0000 7f5af8a00640 1 -- 172.21.15.32:0/3891776728 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5adc005740 con 0x7f5af4071550 2024-03-19T06:23:18.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.787+0000 7f5af9400640 1 -- 172.21.15.32:0/3891776728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5af40b2f80 msgr2=0x7f5af40b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:18.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.787+0000 7f5af9400640 1 --2- 172.21.15.32:0/3891776728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5af40b2f80 0x7f5af40b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.787+0000 7f5af9400640 1 -- 172.21.15.32:0/3891776728 >> v1:172.21.15.32:6789/0 conn(0x7f5af4071550 legacy=0x7f5af4071930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.787+0000 7f5af9400640 1 -- 172.21.15.32:0/3891776728 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af40b3ee0 con 0x7f5af4150ad0 2024-03-19T06:23:18.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.787+0000 7f5afa800640 1 --2- 172.21.15.32:0/3891776728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5af40b2f80 0x7f5af40b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:18.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.791+0000 7f5af9400640 1 --2- 172.21.15.32:0/3891776728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5af4150ad0 0x7f5af4150f60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400a960 tx=0x7f5ae401c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614115406ab19080 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:18.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.791+0000 7f5af8a00640 1 -- 172.21.15.32:0/3891776728 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae400b040 con 0x7f5af4150ad0 2024-03-19T06:23:18.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.791+0000 7f5af8a00640 1 -- 172.21.15.32:0/3891776728 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae40a66b0 con 0x7f5af4150ad0 2024-03-19T06:23:18.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.791+0000 7f5af8a00640 1 -- 172.21.15.32:0/3891776728 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40a6a80 con 0x7f5af4150ad0 2024-03-19T06:23:18.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.791+0000 7f5afc800640 1 -- 172.21.15.32:0/3891776728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5af4150ad0 msgr2=0x7f5af4150f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.791+0000 7f5afc800640 1 --2- 172.21.15.32:0/3891776728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5af4150ad0 0x7f5af4150f60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400a960 tx=0x7f5ae401c770 comp rx=0 tx=0).stop 2024-03-19T06:23:18.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.791+0000 7f5afc800640 1 -- 172.21.15.32:0/3891776728 shutdown_connections 2024-03-19T06:23:18.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.791+0000 7f5afc800640 1 --2- 172.21.15.32:0/3891776728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5af40b2f80 0x7f5af40b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.791+0000 7f5afc800640 1 --2- 172.21.15.32:0/3891776728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5af4150ad0 0x7f5af4150f60 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.791+0000 7f5afc800640 1 -- 172.21.15.32:0/3891776728 >> 172.21.15.32:0/3891776728 conn(0x7f5af40b1590 msgr2=0x7f5af40b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:18.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.791+0000 7f5afc800640 1 -- 172.21.15.32:0/3891776728 shutdown_connections 2024-03-19T06:23:18.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.791+0000 7f5afc800640 1 -- 172.21.15.32:0/3891776728 wait complete. 2024-03-19T06:23:18.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.791+0000 7f5afc800640 1 Processor -- start 2024-03-19T06:23:18.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.791+0000 7f5afc800640 1 -- start start 2024-03-19T06:23:18.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afc800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5af4071550 0x7f5af40ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afc800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5af40b2f80 0x7f5af414c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afc800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5af4150ad0 0x7f5af40cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afc800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af415ae00 con 0x7f5af4150ad0 2024-03-19T06:23:18.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afc800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af415ac80 con 0x7f5af4071550 2024-03-19T06:23:18.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afc800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af415af80 con 0x7f5af40b2f80 2024-03-19T06:23:18.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afa800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5af4150ad0 0x7f5af40cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afa800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5af4150ad0 0x7f5af40cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40166/0 (socket says 172.21.15.32:40166) 2024-03-19T06:23:18.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afa800640 1 -- 172.21.15.32:0/2967579822 learned_addr learned my addr 172.21.15.32:0/2967579822 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:18.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5af9400640 1 --2- 172.21.15.32:0/2967579822 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5af40b2f80 0x7f5af414c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5af9e00640 1 --2- 172.21.15.32:0/2967579822 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5af4071550 0x7f5af40ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afa800640 1 -- 172.21.15.32:0/2967579822 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5af40b2f80 msgr2=0x7f5af414c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afa800640 1 --2- 172.21.15.32:0/2967579822 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5af40b2f80 0x7f5af414c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afa800640 1 -- 172.21.15.32:0/2967579822 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5af4071550 msgr2=0x7f5af40ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afa800640 1 --2- 172.21.15.32:0/2967579822 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5af4071550 0x7f5af40ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afa800640 1 -- 172.21.15.32:0/2967579822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af40ce330 con 0x7f5af4150ad0 2024-03-19T06:23:18.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5af9e00640 1 --2- 172.21.15.32:0/2967579822 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5af4071550 0x7f5af40ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:18.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afa800640 1 --2- 172.21.15.32:0/2967579822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5af4150ad0 0x7f5af40cddf0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5af000cef0 tx=0x7f5af000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:18.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5aee000640 1 -- 172.21.15.32:0/2967579822 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af001a070 con 0x7f5af4150ad0 2024-03-19T06:23:18.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5aee000640 1 -- 172.21.15.32:0/2967579822 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af000d860 con 0x7f5af4150ad0 2024-03-19T06:23:18.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5aee000640 1 -- 172.21.15.32:0/2967579822 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000dc50 con 0x7f5af4150ad0 2024-03-19T06:23:18.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afc800640 1 -- 172.21.15.32:0/2967579822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af40cefc0 con 0x7f5af4150ad0 2024-03-19T06:23:18.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afc800640 1 -- 172.21.15.32:0/2967579822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af40cf580 con 0x7f5af4150ad0 2024-03-19T06:23:18.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5afc800640 1 -- 172.21.15.32:0/2967579822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af40749e0 con 0x7f5af4150ad0 2024-03-19T06:23:18.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.795+0000 7f5aee000640 1 -- 172.21.15.32:0/2967579822 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5af001d070 con 0x7f5af4150ad0 2024-03-19T06:23:18.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.799+0000 7f5aee000640 1 --2- 172.21.15.32:0/2967579822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5ad8067660 0x7f5ad8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:18.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.799+0000 7f5aee000640 1 -- 172.21.15.32:0/2967579822 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5af0085d70 con 0x7f5af4150ad0 2024-03-19T06:23:18.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.799+0000 7f5af9e00640 1 --2- 172.21.15.32:0/2967579822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5ad8067660 0x7f5ad8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:18.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.799+0000 7f5af9e00640 1 --2- 172.21.15.32:0/2967579822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5ad8067660 0x7f5ad8069b20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8005890 tx=0x7f5ae8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:18.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.803+0000 7f5aee000640 1 -- 172.21.15.32:0/2967579822 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f5af00567a0 con 0x7f5af4150ad0 2024-03-19T06:23:18.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.963+0000 7f5afc800640 1 -- 172.21.15.32:0/2967579822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5af4165d30 con 0x7f5af4150ad0 2024-03-19T06:23:18.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.963+0000 7f5aee000640 1 -- 172.21.15.32:0/2967579822 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5af005a840 con 0x7f5af4150ad0 2024-03-19T06:23:18.953 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:23:18.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.967+0000 7f5afc800640 1 -- 172.21.15.32:0/2967579822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5ad8067660 msgr2=0x7f5ad8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.967+0000 7f5afc800640 1 --2- 172.21.15.32:0/2967579822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5ad8067660 0x7f5ad8069b20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8005890 tx=0x7f5ae8009040 comp rx=0 tx=0).stop 2024-03-19T06:23:18.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.967+0000 7f5afc800640 1 -- 172.21.15.32:0/2967579822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5af4150ad0 msgr2=0x7f5af40cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:18.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.967+0000 7f5afc800640 1 --2- 172.21.15.32:0/2967579822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5af4150ad0 0x7f5af40cddf0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5af000cef0 tx=0x7f5af000a710 comp rx=0 tx=0).stop 2024-03-19T06:23:18.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.967+0000 7f5afc800640 1 -- 172.21.15.32:0/2967579822 shutdown_connections 2024-03-19T06:23:18.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.967+0000 7f5afc800640 1 --2- 172.21.15.32:0/2967579822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5ad8067660 0x7f5ad8069b20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.967+0000 7f5afc800640 1 --2- 172.21.15.32:0/2967579822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5af4150ad0 0x7f5af40cddf0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.967+0000 7f5afc800640 1 --2- 172.21.15.32:0/2967579822 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5af40b2f80 0x7f5af414c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.967+0000 7f5afc800640 1 --2- 172.21.15.32:0/2967579822 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5af4071550 0x7f5af40ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:18.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.967+0000 7f5afc800640 1 -- 172.21.15.32:0/2967579822 >> 172.21.15.32:0/2967579822 conn(0x7f5af40b1590 msgr2=0x7f5af40b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:18.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.967+0000 7f5afc800640 1 -- 172.21.15.32:0/2967579822 shutdown_connections 2024-03-19T06:23:18.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:18.967+0000 7f5afc800640 1 -- 172.21.15.32:0/2967579822 wait complete. 2024-03-19T06:23:18.975 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-19T06:23:19.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.127+0000 7f937ce00640 1 Processor -- start 2024-03-19T06:23:19.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.127+0000 7f937ce00640 1 -- start start 2024-03-19T06:23:19.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.131+0000 7f937ce00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f937815a7c0 0x7f93780cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:19.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.131+0000 7f937ce00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f93780b4c50 0x7f93780b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:19.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.131+0000 7f937ce00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93780cb670 con 0x7f93780cc680 2024-03-19T06:23:19.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.131+0000 7f937ce00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937815f400 con 0x7f937815a7c0 2024-03-19T06:23:19.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.131+0000 7f937ce00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937815e860 con 0x7f93780b4c50 2024-03-19T06:23:19.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.131+0000 7f9375e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f937815a7c0 0x7f93780cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:19.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.131+0000 7f9375e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f937815a7c0 0x7f93780cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40182/0 (socket says 172.21.15.32:40182) 2024-03-19T06:23:19.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.131+0000 7f9375e00640 1 -- 172.21.15.32:0/4283651878 learned_addr learned my addr 172.21.15.32:0/4283651878 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:19.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.131+0000 7f9376800640 1 --2- 172.21.15.32:0/4283651878 >> v2:172.21.15.171:3300/0 conn(0x7f93780b4c50 0x7f93780b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:19.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.131+0000 7f9375e00640 1 -- 172.21.15.32:0/4283651878 >> v2:172.21.15.171:3300/0 conn(0x7f93780b4c50 msgr2=0x7f93780b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:19.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.131+0000 7f9375e00640 1 --2- 172.21.15.32:0/4283651878 >> v2:172.21.15.171:3300/0 conn(0x7f93780b4c50 0x7f93780b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:19.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.131+0000 7f9375400640 1 -- 172.21.15.32:0/4283651878 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144221166 0 0) 0x7f93780cb670 con 0x7f93780cc680 2024-03-19T06:23:19.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.131+0000 7f9375e00640 1 -- 172.21.15.32:0/4283651878 >> v1:172.21.15.32:6789/0 conn(0x7f93780cc680 legacy=0x7f937815ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:19.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.131+0000 7f9375e00640 1 -- 172.21.15.32:0/4283651878 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93780cb950 con 0x7f937815a7c0 2024-03-19T06:23:19.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.131+0000 7f9376800640 1 --2- 172.21.15.32:0/4283651878 >> v2:172.21.15.171:3300/0 conn(0x7f93780b4c50 0x7f93780b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:19.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.135+0000 7f9375e00640 1 --2- 172.21.15.32:0/4283651878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f937815a7c0 0x7f93780cae20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f93780c9b90 tx=0x7f936801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803f4c35764d33d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:19.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.135+0000 7f9375400640 1 -- 172.21.15.32:0/4283651878 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93680b1070 con 0x7f937815a7c0 2024-03-19T06:23:19.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.135+0000 7f9375400640 1 -- 172.21.15.32:0/4283651878 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93680ac630 con 0x7f937815a7c0 2024-03-19T06:23:19.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.135+0000 7f9375400640 1 -- 172.21.15.32:0/4283651878 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93680a8050 con 0x7f937815a7c0 2024-03-19T06:23:19.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.135+0000 7f937ce00640 1 -- 172.21.15.32:0/4283651878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f937815a7c0 msgr2=0x7f93780cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:19.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.135+0000 7f937ce00640 1 --2- 172.21.15.32:0/4283651878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f937815a7c0 0x7f93780cae20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f93780c9b90 tx=0x7f936801c520 comp rx=0 tx=0).stop 2024-03-19T06:23:19.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.135+0000 7f937ce00640 1 -- 172.21.15.32:0/4283651878 shutdown_connections 2024-03-19T06:23:19.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.135+0000 7f937ce00640 1 --2- 172.21.15.32:0/4283651878 >> v2:172.21.15.171:3300/0 conn(0x7f93780b4c50 0x7f93780b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:19.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.135+0000 7f937ce00640 1 --2- 172.21.15.32:0/4283651878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f937815a7c0 0x7f93780cae20 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:19.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.135+0000 7f937ce00640 1 -- 172.21.15.32:0/4283651878 >> 172.21.15.32:0/4283651878 conn(0x7f93780b1280 msgr2=0x7f93780b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:19.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.135+0000 7f937ce00640 1 -- 172.21.15.32:0/4283651878 shutdown_connections 2024-03-19T06:23:19.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.135+0000 7f937ce00640 1 -- 172.21.15.32:0/4283651878 wait complete. 2024-03-19T06:23:19.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.135+0000 7f937ce00640 1 Processor -- start 2024-03-19T06:23:19.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.135+0000 7f937ce00640 1 -- start start 2024-03-19T06:23:19.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f937ce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93780b4c50 0x7f937815b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:19.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f937ce00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93780cc680 0x7f93781fb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:19.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f937ce00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9378146fd0 0x7f9378151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:19.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f937ce00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93780cbdb0 con 0x7f93780b4c50 2024-03-19T06:23:19.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f937ce00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93780cbc30 con 0x7f9378146fd0 2024-03-19T06:23:19.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f937ce00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93781677f0 con 0x7f93780cc680 2024-03-19T06:23:19.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f9375e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93780b4c50 0x7f937815b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:19.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f9375e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93780b4c50 0x7f937815b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40184/0 (socket says 172.21.15.32:40184) 2024-03-19T06:23:19.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f9375e00640 1 -- 172.21.15.32:0/864805822 learned_addr learned my addr 172.21.15.32:0/864805822 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:19.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f9375e00640 1 -- 172.21.15.32:0/864805822 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93780cc680 msgr2=0x7f93781fb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:19.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f9375e00640 1 --2- 172.21.15.32:0/864805822 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93780cc680 0x7f93781fb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:19.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f9375e00640 1 -- 172.21.15.32:0/864805822 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9378146fd0 msgr2=0x7f9378151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:19.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f9375e00640 1 --2- 172.21.15.32:0/864805822 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9378146fd0 0x7f9378151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:19.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f9375e00640 1 -- 172.21.15.32:0/864805822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937815b880 con 0x7f93780b4c50 2024-03-19T06:23:19.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f9375e00640 1 --2- 172.21.15.32:0/864805822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93780b4c50 0x7f937815b170 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f936801ca00 tx=0x7f93680192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:19.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f936ea00640 1 -- 172.21.15.32:0/864805822 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93680ba070 con 0x7f93780b4c50 2024-03-19T06:23:19.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f936ea00640 1 -- 172.21.15.32:0/864805822 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93680b5410 con 0x7f93780b4c50 2024-03-19T06:23:19.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f937ce00640 1 -- 172.21.15.32:0/864805822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f937815bb60 con 0x7f93780b4c50 2024-03-19T06:23:19.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f936ea00640 1 -- 172.21.15.32:0/864805822 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93680b1040 con 0x7f93780b4c50 2024-03-19T06:23:19.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f937ce00640 1 -- 172.21.15.32:0/864805822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9378147480 con 0x7f93780b4c50 2024-03-19T06:23:19.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f937ce00640 1 -- 172.21.15.32:0/864805822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93780749e0 con 0x7f93780b4c50 2024-03-19T06:23:19.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.139+0000 7f936ea00640 1 -- 172.21.15.32:0/864805822 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f93680bd070 con 0x7f93780b4c50 2024-03-19T06:23:19.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.143+0000 7f936ea00640 1 --2- 172.21.15.32:0/864805822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9354067660 0x7f9354069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:19.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.143+0000 7f936ea00640 1 -- 172.21.15.32:0/864805822 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f936811e750 con 0x7f93780b4c50 2024-03-19T06:23:19.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.143+0000 7f936d400640 1 --2- 172.21.15.32:0/864805822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9354067660 0x7f9354069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:19.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.143+0000 7f936d400640 1 --2- 172.21.15.32:0/864805822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9354067660 0x7f9354069b20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f93781fa8a0 tx=0x7f9360007cc0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:19.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.147+0000 7f936ea00640 1 -- 172.21.15.32:0/864805822 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f9368016110 con 0x7f93780b4c50 2024-03-19T06:23:19.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.311+0000 7f937ce00640 1 -- 172.21.15.32:0/864805822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f937815ed80 con 0x7f93780b4c50 2024-03-19T06:23:19.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.311+0000 7f936ea00640 1 -- 172.21.15.32:0/864805822 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) v1 ==== 84+0+65 (secure 0 0 0) 0x7f93680ef030 con 0x7f93780b4c50 2024-03-19T06:23:19.301 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:19.302 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2024-03-19T06:23:19.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-03-19T06:23:19.302 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2024-03-19T06:23:19.302 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2024-03-19T06:23:19.302 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:19.302 INFO:teuthology.orchestra.run.smithi032.stdout:] 2024-03-19T06:23:19.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.315+0000 7f937ce00640 1 -- 172.21.15.32:0/864805822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9354067660 msgr2=0x7f9354069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:19.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.315+0000 7f937ce00640 1 --2- 172.21.15.32:0/864805822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9354067660 0x7f9354069b20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f93781fa8a0 tx=0x7f9360007cc0 comp rx=0 tx=0).stop 2024-03-19T06:23:19.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.315+0000 7f937ce00640 1 -- 172.21.15.32:0/864805822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93780b4c50 msgr2=0x7f937815b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:19.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.315+0000 7f937ce00640 1 --2- 172.21.15.32:0/864805822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93780b4c50 0x7f937815b170 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f936801ca00 tx=0x7f93680192c0 comp rx=0 tx=0).stop 2024-03-19T06:23:19.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.315+0000 7f937ce00640 1 -- 172.21.15.32:0/864805822 shutdown_connections 2024-03-19T06:23:19.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.315+0000 7f937ce00640 1 --2- 172.21.15.32:0/864805822 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9354067660 0x7f9354069b20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:19.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.315+0000 7f937ce00640 1 --2- 172.21.15.32:0/864805822 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9378146fd0 0x7f9378151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:19.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.315+0000 7f937ce00640 1 --2- 172.21.15.32:0/864805822 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93780cc680 0x7f93781fb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:19.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.315+0000 7f937ce00640 1 --2- 172.21.15.32:0/864805822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93780b4c50 0x7f937815b170 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:19.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.315+0000 7f937ce00640 1 -- 172.21.15.32:0/864805822 >> 172.21.15.32:0/864805822 conn(0x7f93780b1280 msgr2=0x7f93780af260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:19.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.315+0000 7f937ce00640 1 -- 172.21.15.32:0/864805822 shutdown_connections 2024-03-19T06:23:19.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.315+0000 7f937ce00640 1 -- 172.21.15.32:0/864805822 wait complete. 2024-03-19T06:23:19.323 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-19T06:23:19.323 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-19T06:23:19.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.479+0000 7f4a17200640 1 Processor -- start 2024-03-19T06:23:19.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.479+0000 7f4a17200640 1 -- start start 2024-03-19T06:23:19.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.479+0000 7f4a17200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a18144f60 0x7f4a180b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:19.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.479+0000 7f4a17200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4a180b31b0 0x7f4a180cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:19.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.479+0000 7f4a17200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a180b2780 con 0x7f4a180cc640 2024-03-19T06:23:19.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.479+0000 7f4a17200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a180ccab0 con 0x7f4a180b31b0 2024-03-19T06:23:19.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.479+0000 7f4a17200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a180b37c0 con 0x7f4a18144f60 2024-03-19T06:23:19.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.479+0000 7f4a0d400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4a180b31b0 0x7f4a180cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:19.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.479+0000 7f4a0d400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4a180b31b0 0x7f4a180cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40190/0 (socket says 172.21.15.32:40190) 2024-03-19T06:23:19.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.479+0000 7f4a0d400640 1 -- 172.21.15.32:0/1784243623 learned_addr learned my addr 172.21.15.32:0/1784243623 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:19.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.479+0000 7f4a15e00640 1 --2- 172.21.15.32:0/1784243623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a18144f60 0x7f4a180b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:19.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.483+0000 7f4a0d400640 1 -- 172.21.15.32:0/1784243623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a18144f60 msgr2=0x7f4a180b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:19.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.483+0000 7f4a0d400640 1 --2- 172.21.15.32:0/1784243623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a18144f60 0x7f4a180b2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:19.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.483+0000 7f4a0d400640 1 -- 172.21.15.32:0/1784243623 >> v1:172.21.15.32:6789/0 conn(0x7f4a180cc640 legacy=0x7f4a180711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:19.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.483+0000 7f4a0d400640 1 -- 172.21.15.32:0/1784243623 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a180b3aa0 con 0x7f4a180b31b0 2024-03-19T06:23:19.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.483+0000 7f4a15e00640 1 --2- 172.21.15.32:0/1784243623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a18144f60 0x7f4a180b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:19.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.483+0000 7f4a0d400640 1 --2- 172.21.15.32:0/1784243623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a180b31b0 0x7f4a180cc100 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009870 tx=0x7f4a0001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ecea3b325829ad4 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:19.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.483+0000 7f4a15400640 1 -- 172.21.15.32:0/1784243623 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a000a95f0 con 0x7f4a180b31b0 2024-03-19T06:23:19.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.483+0000 7f4a15400640 1 -- 172.21.15.32:0/1784243623 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a000a9790 con 0x7f4a180b31b0 2024-03-19T06:23:19.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.483+0000 7f4a15400640 1 -- 172.21.15.32:0/1784243623 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a000a9b60 con 0x7f4a180b31b0 2024-03-19T06:23:19.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.483+0000 7f4a17200640 1 -- 172.21.15.32:0/1784243623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a180b31b0 msgr2=0x7f4a180cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:19.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.483+0000 7f4a17200640 1 --2- 172.21.15.32:0/1784243623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a180b31b0 0x7f4a180cc100 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009870 tx=0x7f4a0001c530 comp rx=0 tx=0).stop 2024-03-19T06:23:19.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a17200640 1 -- 172.21.15.32:0/1784243623 shutdown_connections 2024-03-19T06:23:19.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a17200640 1 --2- 172.21.15.32:0/1784243623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a180b31b0 0x7f4a180cc100 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:19.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a17200640 1 --2- 172.21.15.32:0/1784243623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a18144f60 0x7f4a180b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:19.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a17200640 1 -- 172.21.15.32:0/1784243623 >> 172.21.15.32:0/1784243623 conn(0x7f4a180670a0 msgr2=0x7f4a1806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:19.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a17200640 1 -- 172.21.15.32:0/1784243623 shutdown_connections 2024-03-19T06:23:19.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a17200640 1 -- 172.21.15.32:0/1784243623 wait complete. 2024-03-19T06:23:19.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a17200640 1 Processor -- start 2024-03-19T06:23:19.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a17200640 1 -- start start 2024-03-19T06:23:19.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a17200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a180b31b0 0x7f4a18155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:19.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a17200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a180cc640 0x7f4a1813c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:19.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a17200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a18144f60 0x7f4a1815ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:19.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a17200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a180ce440 con 0x7f4a18144f60 2024-03-19T06:23:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a17200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a180ce2c0 con 0x7f4a180cc640 2024-03-19T06:23:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a17200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a18168330 con 0x7f4a180b31b0 2024-03-19T06:23:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a16800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a18144f60 0x7f4a1815ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a16800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a18144f60 0x7f4a1815ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40200/0 (socket says 172.21.15.32:40200) 2024-03-19T06:23:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a16800640 1 -- 172.21.15.32:0/2357328172 learned_addr learned my addr 172.21.15.32:0/2357328172 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a0d400640 1 --2- 172.21.15.32:0/2357328172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a180cc640 0x7f4a1813c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a15e00640 1 --2- 172.21.15.32:0/2357328172 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a180b31b0 0x7f4a18155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a16800640 1 -- 172.21.15.32:0/2357328172 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a180b31b0 msgr2=0x7f4a18155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a16800640 1 --2- 172.21.15.32:0/2357328172 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a180b31b0 0x7f4a18155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a16800640 1 -- 172.21.15.32:0/2357328172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a180cc640 msgr2=0x7f4a1813c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a16800640 1 --2- 172.21.15.32:0/2357328172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a180cc640 0x7f4a1813c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a16800640 1 -- 172.21.15.32:0/2357328172 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a18155ba0 con 0x7f4a18144f60 2024-03-19T06:23:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a0d400640 1 --2- 172.21.15.32:0/2357328172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a180cc640 0x7f4a1813c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a16800640 1 --2- 172.21.15.32:0/2357328172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a18144f60 0x7f4a1815ab70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000c730 tx=0x7f4a1000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:19.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a0ea00640 1 -- 172.21.15.32:0/2357328172 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10003ba0 con 0x7f4a18144f60 2024-03-19T06:23:19.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a0ea00640 1 -- 172.21.15.32:0/2357328172 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10003d40 con 0x7f4a18144f60 2024-03-19T06:23:19.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a17200640 1 -- 172.21.15.32:0/2357328172 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1813b840 con 0x7f4a18144f60 2024-03-19T06:23:19.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.487+0000 7f4a0ea00640 1 -- 172.21.15.32:0/2357328172 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10005310 con 0x7f4a18144f60 2024-03-19T06:23:19.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.491+0000 7f4a17200640 1 -- 172.21.15.32:0/2357328172 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1813be00 con 0x7f4a18144f60 2024-03-19T06:23:19.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.491+0000 7f4a17200640 1 -- 172.21.15.32:0/2357328172 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a18075090 con 0x7f4a18144f60 2024-03-19T06:23:19.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.491+0000 7f4a0ea00640 1 -- 172.21.15.32:0/2357328172 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f4a100056c0 con 0x7f4a18144f60 2024-03-19T06:23:19.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.491+0000 7f4a0ea00640 1 --2- 172.21.15.32:0/2357328172 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f49f4067660 0x7f49f4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:19.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.491+0000 7f4a0ea00640 1 -- 172.21.15.32:0/2357328172 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4a10085570 con 0x7f4a18144f60 2024-03-19T06:23:19.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.491+0000 7f4a15e00640 1 --2- 172.21.15.32:0/2357328172 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f49f4067660 0x7f49f4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:19.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.495+0000 7f4a15e00640 1 --2- 172.21.15.32:0/2357328172 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f49f4067660 0x7f49f4069b20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4a180cc0a0 tx=0x7f4a08008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:19.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.495+0000 7f4a0ea00640 1 -- 172.21.15.32:0/2357328172 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f4a100565d0 con 0x7f4a18144f60 2024-03-19T06:23:19.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:19.659+0000 7f4a17200640 1 -- 172.21.15.32:0/2357328172 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4a18144790 con 0x7f4a18144f60 2024-03-19T06:23:20.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.515+0000 7f4a0ea00640 1 -- 172.21.15.32:0/2357328172 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4a10055ed0 con 0x7f4a18144f60 2024-03-19T06:23:20.502 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' created 2024-03-19T06:23:20.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.515+0000 7f4a17200640 1 -- 172.21.15.32:0/2357328172 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f49f4067660 msgr2=0x7f49f4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:20.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.515+0000 7f4a17200640 1 --2- 172.21.15.32:0/2357328172 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f49f4067660 0x7f49f4069b20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4a180cc0a0 tx=0x7f4a08008040 comp rx=0 tx=0).stop 2024-03-19T06:23:20.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.515+0000 7f4a17200640 1 -- 172.21.15.32:0/2357328172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a18144f60 msgr2=0x7f4a1815ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:20.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.515+0000 7f4a17200640 1 --2- 172.21.15.32:0/2357328172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a18144f60 0x7f4a1815ab70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000c730 tx=0x7f4a1000cbf0 comp rx=0 tx=0).stop 2024-03-19T06:23:20.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.515+0000 7f4a17200640 1 -- 172.21.15.32:0/2357328172 shutdown_connections 2024-03-19T06:23:20.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.515+0000 7f4a17200640 1 --2- 172.21.15.32:0/2357328172 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f49f4067660 0x7f49f4069b20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:20.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.515+0000 7f4a17200640 1 --2- 172.21.15.32:0/2357328172 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a18144f60 0x7f4a1815ab70 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:20.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.515+0000 7f4a17200640 1 --2- 172.21.15.32:0/2357328172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a180cc640 0x7f4a1813c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:20.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.515+0000 7f4a17200640 1 --2- 172.21.15.32:0/2357328172 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a180b31b0 0x7f4a18155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:20.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.515+0000 7f4a17200640 1 -- 172.21.15.32:0/2357328172 >> 172.21.15.32:0/2357328172 conn(0x7f4a180670a0 msgr2=0x7f4a1806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:20.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.515+0000 7f4a17200640 1 -- 172.21.15.32:0/2357328172 shutdown_connections 2024-03-19T06:23:20.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.515+0000 7f4a17200640 1 -- 172.21.15.32:0/2357328172 wait complete. 2024-03-19T06:23:20.533 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-19T06:23:20.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.695+0000 7fb986800640 1 Processor -- start 2024-03-19T06:23:20.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.695+0000 7fb986800640 1 -- start start 2024-03-19T06:23:20.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.699+0000 7fb986800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb98015a840 0x7fb98006f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:20.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.699+0000 7fb986800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb98006b450 0x7fb9800ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:20.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.699+0000 7fb986800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9800af2d0 con 0x7fb9800aea70 2024-03-19T06:23:20.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.699+0000 7fb986800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9800cdc20 con 0x7fb98015a840 2024-03-19T06:23:20.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.699+0000 7fb986800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98015eea0 con 0x7fb98006b450 2024-03-19T06:23:20.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.699+0000 7fb97f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb98015a840 0x7fb98006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:20.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.699+0000 7fb977e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb9800aea70 0x7fb98006ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45016/0 (socket says 172.21.15.32:45016) 2024-03-19T06:23:20.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.699+0000 7fb977e00640 1 -- 172.21.15.32:0/2854353999 learned_addr learned my addr 172.21.15.32:0/2854353999 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:20.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.699+0000 7fb97fe00640 1 --2- 172.21.15.32:0/2854353999 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb98006b450 0x7fb9800ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:20.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.699+0000 7fb97f400640 1 -- 172.21.15.32:0/2854353999 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb98006b450 msgr2=0x7fb9800ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:20.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.699+0000 7fb97f400640 1 --2- 172.21.15.32:0/2854353999 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb98006b450 0x7fb9800ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:20.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.699+0000 7fb97f400640 1 -- 172.21.15.32:0/2854353999 >> v1:172.21.15.32:6789/0 conn(0x7fb9800aea70 legacy=0x7fb98006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:20.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.699+0000 7fb97f400640 1 -- 172.21.15.32:0/2854353999 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98015f180 con 0x7fb98015a840 2024-03-19T06:23:20.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.699+0000 7fb97ea00640 1 -- 172.21.15.32:0/2854353999 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581568076 0 0) 0x7fb9800af2d0 con 0x7fb9800aea70 2024-03-19T06:23:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.703+0000 7fb97f400640 1 --2- 172.21.15.32:0/2854353999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb98015a840 0x7fb98006f040 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb9700097c0 tx=0x7fb97001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9185c116027a732c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.703+0000 7fb97ea00640 1 -- 172.21.15.32:0/2854353999 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9700b1070 con 0x7fb98015a840 2024-03-19T06:23:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.703+0000 7fb97ea00640 1 -- 172.21.15.32:0/2854353999 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9700ac600 con 0x7fb98015a840 2024-03-19T06:23:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.703+0000 7fb97ea00640 1 -- 172.21.15.32:0/2854353999 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9700ac9d0 con 0x7fb98015a840 2024-03-19T06:23:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.703+0000 7fb986800640 1 -- 172.21.15.32:0/2854353999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb98015a840 msgr2=0x7fb98006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.703+0000 7fb986800640 1 --2- 172.21.15.32:0/2854353999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb98015a840 0x7fb98006f040 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb9700097c0 tx=0x7fb97001c340 comp rx=0 tx=0).stop 2024-03-19T06:23:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.703+0000 7fb986800640 1 -- 172.21.15.32:0/2854353999 shutdown_connections 2024-03-19T06:23:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.703+0000 7fb986800640 1 --2- 172.21.15.32:0/2854353999 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb98006b450 0x7fb9800ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.703+0000 7fb986800640 1 --2- 172.21.15.32:0/2854353999 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb98015a840 0x7fb98006f040 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.703+0000 7fb986800640 1 -- 172.21.15.32:0/2854353999 >> 172.21.15.32:0/2854353999 conn(0x7fb9800b1590 msgr2=0x7fb9800b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.703+0000 7fb986800640 1 -- 172.21.15.32:0/2854353999 shutdown_connections 2024-03-19T06:23:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.703+0000 7fb986800640 1 -- 172.21.15.32:0/2854353999 wait complete. 2024-03-19T06:23:20.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.703+0000 7fb986800640 1 Processor -- start 2024-03-19T06:23:20.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.703+0000 7fb986800640 1 -- start start 2024-03-19T06:23:20.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb986800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb98006b450 0x7fb9801503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:20.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb986800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9800aea70 0x7fb980139a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:20.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb986800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb98015a840 0x7fb980148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:20.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb986800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9800cef80 con 0x7fb98006b450 2024-03-19T06:23:20.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb986800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9800cee00 con 0x7fb98015a840 2024-03-19T06:23:20.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb986800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9800cf100 con 0x7fb9800aea70 2024-03-19T06:23:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb97f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb98006b450 0x7fb9801503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb97f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb98006b450 0x7fb9801503e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40218/0 (socket says 172.21.15.32:40218) 2024-03-19T06:23:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb97f400640 1 -- 172.21.15.32:0/3354081502 learned_addr learned my addr 172.21.15.32:0/3354081502 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb977e00640 1 --2- 172.21.15.32:0/3354081502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9800aea70 0x7fb980139a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb97fe00640 1 --2- 172.21.15.32:0/3354081502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb98015a840 0x7fb980148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb97f400640 1 -- 172.21.15.32:0/3354081502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9800aea70 msgr2=0x7fb980139a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb97f400640 1 --2- 172.21.15.32:0/3354081502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9800aea70 0x7fb980139a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb97f400640 1 -- 172.21.15.32:0/3354081502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb98015a840 msgr2=0x7fb980148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:20.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb97f400640 1 --2- 172.21.15.32:0/3354081502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb98015a840 0x7fb980148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:20.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb97f400640 1 -- 172.21.15.32:0/3354081502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb980139fb0 con 0x7fb98006b450 2024-03-19T06:23:20.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb97f400640 1 --2- 172.21.15.32:0/3354081502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb98006b450 0x7fb9801503e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb970019f70 tx=0x7fb97001ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:20.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb977400640 1 -- 172.21.15.32:0/3354081502 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9700b1040 con 0x7fb98006b450 2024-03-19T06:23:20.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb977400640 1 -- 172.21.15.32:0/3354081502 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9700bc070 con 0x7fb98006b450 2024-03-19T06:23:20.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb986800640 1 -- 172.21.15.32:0/3354081502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98014f340 con 0x7fb98006b450 2024-03-19T06:23:20.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb977400640 1 -- 172.21.15.32:0/3354081502 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9700b7690 con 0x7fb98006b450 2024-03-19T06:23:20.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb986800640 1 -- 172.21.15.32:0/3354081502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98014f900 con 0x7fb98006b450 2024-03-19T06:23:20.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.707+0000 7fb986800640 1 -- 172.21.15.32:0/3354081502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9800749e0 con 0x7fb98006b450 2024-03-19T06:23:20.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.711+0000 7fb977400640 1 -- 172.21.15.32:0/3354081502 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb9700b7830 con 0x7fb98006b450 2024-03-19T06:23:20.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.711+0000 7fb977400640 1 --2- 172.21.15.32:0/3354081502 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb95c067660 0x7fb95c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:20.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.711+0000 7fb977400640 1 -- 172.21.15.32:0/3354081502 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fb97011f410 con 0x7fb98006b450 2024-03-19T06:23:20.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.711+0000 7fb977e00640 1 --2- 172.21.15.32:0/3354081502 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb95c067660 0x7fb95c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:20.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.711+0000 7fb977e00640 1 --2- 172.21.15.32:0/3354081502 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb95c067660 0x7fb95c069b20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb980159c40 tx=0x7fb968007d60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:20.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.715+0000 7fb977400640 1 -- 172.21.15.32:0/3354081502 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fb9700c5020 con 0x7fb98006b450 2024-03-19T06:23:20.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:20.879+0000 7fb986800640 1 -- 172.21.15.32:0/3354081502 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb98006e6c0 con 0x7fb98006b450 2024-03-19T06:23:21.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.515+0000 7fb977400640 1 -- 172.21.15.32:0/3354081502 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb970016050 con 0x7fb98006b450 2024-03-19T06:23:21.505 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' created 2024-03-19T06:23:21.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.519+0000 7fb986800640 1 -- 172.21.15.32:0/3354081502 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb95c067660 msgr2=0x7fb95c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:21.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.519+0000 7fb986800640 1 --2- 172.21.15.32:0/3354081502 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb95c067660 0x7fb95c069b20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb980159c40 tx=0x7fb968007d60 comp rx=0 tx=0).stop 2024-03-19T06:23:21.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.519+0000 7fb986800640 1 -- 172.21.15.32:0/3354081502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb98006b450 msgr2=0x7fb9801503e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:21.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.519+0000 7fb986800640 1 --2- 172.21.15.32:0/3354081502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb98006b450 0x7fb9801503e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb970019f70 tx=0x7fb97001ab80 comp rx=0 tx=0).stop 2024-03-19T06:23:21.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.519+0000 7fb986800640 1 -- 172.21.15.32:0/3354081502 shutdown_connections 2024-03-19T06:23:21.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.519+0000 7fb986800640 1 --2- 172.21.15.32:0/3354081502 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb95c067660 0x7fb95c069b20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:21.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.519+0000 7fb986800640 1 --2- 172.21.15.32:0/3354081502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb98015a840 0x7fb980148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:21.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.519+0000 7fb986800640 1 --2- 172.21.15.32:0/3354081502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9800aea70 0x7fb980139a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:21.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.519+0000 7fb986800640 1 --2- 172.21.15.32:0/3354081502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb98006b450 0x7fb9801503e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:21.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.519+0000 7fb986800640 1 -- 172.21.15.32:0/3354081502 >> 172.21.15.32:0/3354081502 conn(0x7fb9800b1590 msgr2=0x7fb9800b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:21.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.519+0000 7fb986800640 1 -- 172.21.15.32:0/3354081502 shutdown_connections 2024-03-19T06:23:21.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.519+0000 7fb986800640 1 -- 172.21.15.32:0/3354081502 wait complete. 2024-03-19T06:23:21.547 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-19T06:23:21.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.703+0000 7f9d61800640 1 Processor -- start 2024-03-19T06:23:21.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.703+0000 7f9d61800640 1 -- start start 2024-03-19T06:23:21.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.703+0000 7f9d61800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9d5c15bad0 0x7f9d5c0b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:21.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.703+0000 7f9d61800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9d5c0b0f40 0x7f9d5c06ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:21.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.703+0000 7f9d61800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c0ae510 con 0x7f9d5c06b280 2024-03-19T06:23:21.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.703+0000 7f9d61800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c06b6f0 con 0x7f9d5c15bad0 2024-03-19T06:23:21.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.703+0000 7f9d61800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c0ae7f0 con 0x7f9d5c0b0f40 2024-03-19T06:23:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.703+0000 7f9d5be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9d5c15bad0 0x7f9d5c0b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.707+0000 7f9d53400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9d5c0b0f40 0x7f9d5c06ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.707+0000 7f9d5be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9d5c15bad0 0x7f9d5c0b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40228/0 (socket says 172.21.15.32:40228) 2024-03-19T06:23:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.707+0000 7f9d60e00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f9d5c06b280 0x7f9d5c0ad360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:33726/0 (socket says 172.21.15.32:33726) 2024-03-19T06:23:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.707+0000 7f9d5be00640 1 -- 172.21.15.32:0/3919342005 learned_addr learned my addr 172.21.15.32:0/3919342005 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.707+0000 7f9d5be00640 1 -- 172.21.15.32:0/3919342005 >> v2:172.21.15.171:3300/0 conn(0x7f9d5c0b0f40 msgr2=0x7f9d5c06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.707+0000 7f9d5be00640 1 --2- 172.21.15.32:0/3919342005 >> v2:172.21.15.171:3300/0 conn(0x7f9d5c0b0f40 0x7f9d5c06ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.707+0000 7f9d5be00640 1 -- 172.21.15.32:0/3919342005 >> v1:172.21.15.171:6789/0 conn(0x7f9d5c06b280 legacy=0x7f9d5c0ad360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:21.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.707+0000 7f9d5be00640 1 -- 172.21.15.32:0/3919342005 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c0aead0 con 0x7f9d5c15bad0 2024-03-19T06:23:21.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.707+0000 7f9d5b400640 1 -- 172.21.15.32:0/3919342005 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779234264 0 0) 0x7f9d5c0ae510 con 0x7f9d5c06b280 2024-03-19T06:23:21.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.707+0000 7f9d5be00640 1 --2- 172.21.15.32:0/3919342005 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d5c15bad0 0x7f9d5c0b0a00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c071e20 tx=0x7f9d4c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3a89f489856153 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:21.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.707+0000 7f9d5b400640 1 -- 172.21.15.32:0/3919342005 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c0a5790 con 0x7f9d5c15bad0 2024-03-19T06:23:21.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.707+0000 7f9d5b400640 1 -- 172.21.15.32:0/3919342005 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c0a5930 con 0x7f9d5c15bad0 2024-03-19T06:23:21.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.707+0000 7f9d5b400640 1 -- 172.21.15.32:0/3919342005 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c0a5d00 con 0x7f9d5c15bad0 2024-03-19T06:23:21.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d61800640 1 -- 172.21.15.32:0/3919342005 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d5c15bad0 msgr2=0x7f9d5c0b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d61800640 1 --2- 172.21.15.32:0/3919342005 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d5c15bad0 0x7f9d5c0b0a00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c071e20 tx=0x7f9d4c01c9c0 comp rx=0 tx=0).stop 2024-03-19T06:23:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d61800640 1 -- 172.21.15.32:0/3919342005 shutdown_connections 2024-03-19T06:23:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d61800640 1 --2- 172.21.15.32:0/3919342005 >> v2:172.21.15.171:3300/0 conn(0x7f9d5c0b0f40 0x7f9d5c06ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d61800640 1 --2- 172.21.15.32:0/3919342005 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d5c15bad0 0x7f9d5c0b0a00 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d61800640 1 -- 172.21.15.32:0/3919342005 >> 172.21.15.32:0/3919342005 conn(0x7f9d5c0b58e0 msgr2=0x7f9d5c0b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d61800640 1 -- 172.21.15.32:0/3919342005 shutdown_connections 2024-03-19T06:23:21.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d61800640 1 -- 172.21.15.32:0/3919342005 wait complete. 2024-03-19T06:23:21.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d61800640 1 Processor -- start 2024-03-19T06:23:21.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d61800640 1 -- start start 2024-03-19T06:23:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d61800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d5c06b280 0x7f9d5c15eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d61800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d5c0b0f40 0x7f9d5c0b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d61800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d5c15bad0 0x7f9d5c0b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d61800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c15c030 con 0x7f9d5c15bad0 2024-03-19T06:23:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d61800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c15beb0 con 0x7f9d5c0b0f40 2024-03-19T06:23:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d61800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c1687c0 con 0x7f9d5c06b280 2024-03-19T06:23:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d60e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d5c15bad0 0x7f9d5c0b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d60e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d5c15bad0 0x7f9d5c0b4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40236/0 (socket says 172.21.15.32:40236) 2024-03-19T06:23:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d60e00640 1 -- 172.21.15.32:0/2986864949 learned_addr learned my addr 172.21.15.32:0/2986864949 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d5be00640 1 --2- 172.21.15.32:0/2986864949 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d5c06b280 0x7f9d5c15eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d53400640 1 --2- 172.21.15.32:0/2986864949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d5c0b0f40 0x7f9d5c0b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d60e00640 1 -- 172.21.15.32:0/2986864949 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d5c06b280 msgr2=0x7f9d5c15eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d60e00640 1 --2- 172.21.15.32:0/2986864949 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d5c06b280 0x7f9d5c15eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d60e00640 1 -- 172.21.15.32:0/2986864949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d5c0b0f40 msgr2=0x7f9d5c0b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d60e00640 1 --2- 172.21.15.32:0/2986864949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d5c0b0f40 0x7f9d5c0b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.711+0000 7f9d60e00640 1 -- 172.21.15.32:0/2986864949 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c0b3480 con 0x7f9d5c15bad0 2024-03-19T06:23:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.715+0000 7f9d60e00640 1 --2- 172.21.15.32:0/2986864949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d5c15bad0 0x7f9d5c0b4a60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400c480 tx=0x7f9d5400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.715+0000 7f9d58c00640 1 -- 172.21.15.32:0/2986864949 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54018070 con 0x7f9d5c15bad0 2024-03-19T06:23:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.715+0000 7f9d58c00640 1 -- 172.21.15.32:0/2986864949 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d540074e0 con 0x7f9d5c15bad0 2024-03-19T06:23:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.715+0000 7f9d61800640 1 -- 172.21.15.32:0/2986864949 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c0b3760 con 0x7f9d5c15bad0 2024-03-19T06:23:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.715+0000 7f9d58c00640 1 -- 172.21.15.32:0/2986864949 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54004a30 con 0x7f9d5c15bad0 2024-03-19T06:23:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.715+0000 7f9d61800640 1 -- 172.21.15.32:0/2986864949 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5c0b3d20 con 0x7f9d5c15bad0 2024-03-19T06:23:21.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.715+0000 7f9d61800640 1 -- 172.21.15.32:0/2986864949 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5c075090 con 0x7f9d5c15bad0 2024-03-19T06:23:21.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.715+0000 7f9d58c00640 1 -- 172.21.15.32:0/2986864949 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9d5401b070 con 0x7f9d5c15bad0 2024-03-19T06:23:21.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.715+0000 7f9d58c00640 1 --2- 172.21.15.32:0/2986864949 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9d38067660 0x7f9d38069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:21.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.715+0000 7f9d58c00640 1 -- 172.21.15.32:0/2986864949 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f9d54084dd0 con 0x7f9d5c15bad0 2024-03-19T06:23:21.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.715+0000 7f9d5be00640 1 --2- 172.21.15.32:0/2986864949 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9d38067660 0x7f9d38069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:21.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.719+0000 7f9d5be00640 1 --2- 172.21.15.32:0/2986864949 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9d38067660 0x7f9d38069b20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0ae000 tx=0x7f9d4c0a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:21.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.719+0000 7f9d58c00640 1 -- 172.21.15.32:0/2986864949 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f9d540554d0 con 0x7f9d5c15bad0 2024-03-19T06:23:21.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:21.915+0000 7f9d61800640 1 -- 172.21.15.32:0/2986864949 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9d5c06b870 con 0x7f9d5c15bad0 2024-03-19T06:23:22.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.543+0000 7f9d58c00640 1 -- 172.21.15.32:0/2986864949 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v22) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9d54059570 con 0x7f9d5c15bad0 2024-03-19T06:23:22.537 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 7 and data pool 8 2024-03-19T06:23:22.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.555+0000 7f9d61800640 1 -- 172.21.15.32:0/2986864949 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9d38067660 msgr2=0x7f9d38069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.555+0000 7f9d61800640 1 --2- 172.21.15.32:0/2986864949 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9d38067660 0x7f9d38069b20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0ae000 tx=0x7f9d4c0a7070 comp rx=0 tx=0).stop 2024-03-19T06:23:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.555+0000 7f9d61800640 1 -- 172.21.15.32:0/2986864949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d5c15bad0 msgr2=0x7f9d5c0b4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.555+0000 7f9d61800640 1 --2- 172.21.15.32:0/2986864949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d5c15bad0 0x7f9d5c0b4a60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400c480 tx=0x7f9d5400c940 comp rx=0 tx=0).stop 2024-03-19T06:23:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.555+0000 7f9d61800640 1 -- 172.21.15.32:0/2986864949 shutdown_connections 2024-03-19T06:23:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.555+0000 7f9d61800640 1 --2- 172.21.15.32:0/2986864949 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9d38067660 0x7f9d38069b20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.555+0000 7f9d61800640 1 --2- 172.21.15.32:0/2986864949 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d5c15bad0 0x7f9d5c0b4a60 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.555+0000 7f9d61800640 1 --2- 172.21.15.32:0/2986864949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d5c0b0f40 0x7f9d5c0b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.555+0000 7f9d61800640 1 --2- 172.21.15.32:0/2986864949 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d5c06b280 0x7f9d5c15eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:22.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.555+0000 7f9d61800640 1 -- 172.21.15.32:0/2986864949 >> 172.21.15.32:0/2986864949 conn(0x7f9d5c0b58e0 msgr2=0x7f9d5c06ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:22.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.559+0000 7f9d61800640 1 -- 172.21.15.32:0/2986864949 shutdown_connections 2024-03-19T06:23:22.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.559+0000 7f9d61800640 1 -- 172.21.15.32:0/2986864949 wait complete. 2024-03-19T06:23:22.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:23:22.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2d0c00640 1 Processor -- start 2024-03-19T06:23:22.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2d0c00640 1 -- start start 2024-03-19T06:23:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2d0c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb2cc0ae0b0 0x7fb2cc0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2d0c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2cc06c460 0x7fb2cc154130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2d0c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2cc15e520 con 0x7fb2cc15dff0 2024-03-19T06:23:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2d0c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2cc15f1b0 con 0x7fb2cc0ae0b0 2024-03-19T06:23:22.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2d0c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc15e800 con 0x7fb2cc06c460 2024-03-19T06:23:22.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2ca800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2cc06c460 0x7fb2cc154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:22.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2c9400640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fb2cc15dff0 0x7fb2cc06bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:33738/0 (socket says 172.21.15.32:33738) 2024-03-19T06:23:22.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2c9400640 1 -- 172.21.15.32:0/1656583805 learned_addr learned my addr 172.21.15.32:0/1656583805 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:22.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2ca800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2cc06c460 0x7fb2cc154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:49672/0 (socket says 172.21.15.32:49672) 2024-03-19T06:23:22.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2c9e00640 1 --2- 172.21.15.32:0/1656583805 >> v2:172.21.15.171:3300/0 conn(0x7fb2cc0ae0b0 0x7fb2cc0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:22.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2c8a00640 1 -- 172.21.15.32:0/1656583805 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060771987 0 0) 0x7fb2cc15e520 con 0x7fb2cc15dff0 2024-03-19T06:23:22.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2ca800640 1 -- 172.21.15.32:0/1656583805 >> v2:172.21.15.171:3300/0 conn(0x7fb2cc0ae0b0 msgr2=0x7fb2cc0acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:22.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2ca800640 1 --2- 172.21.15.32:0/1656583805 >> v2:172.21.15.171:3300/0 conn(0x7fb2cc0ae0b0 0x7fb2cc0acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:22.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2ca800640 1 -- 172.21.15.32:0/1656583805 >> v1:172.21.15.171:6789/0 conn(0x7fb2cc15dff0 legacy=0x7fb2cc06bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:22.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2ca800640 1 -- 172.21.15.32:0/1656583805 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc15eae0 con 0x7fb2cc06c460 2024-03-19T06:23:22.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.739+0000 7fb2c9e00640 1 --2- 172.21.15.32:0/1656583805 >> v2:172.21.15.171:3300/0 conn(0x7fb2cc0ae0b0 0x7fb2cc0acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:23:22.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.743+0000 7fb2ca800640 1 --2- 172.21.15.32:0/1656583805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2cc06c460 0x7fb2cc154130 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009d90 tx=0x7fb2c401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec1b98b15f20bc22 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:22.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.743+0000 7fb2c8a00640 1 -- 172.21.15.32:0/1656583805 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c40b2070 con 0x7fb2cc06c460 2024-03-19T06:23:22.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.743+0000 7fb2c8a00640 1 -- 172.21.15.32:0/1656583805 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c40a5830 con 0x7fb2cc06c460 2024-03-19T06:23:22.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.743+0000 7fb2c8a00640 1 -- 172.21.15.32:0/1656583805 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c40a5c00 con 0x7fb2cc06c460 2024-03-19T06:23:22.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.743+0000 7fb2d0c00640 1 -- 172.21.15.32:0/1656583805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2cc06c460 msgr2=0x7fb2cc154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:22.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.743+0000 7fb2d0c00640 1 --2- 172.21.15.32:0/1656583805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2cc06c460 0x7fb2cc154130 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009d90 tx=0x7fb2c401c970 comp rx=0 tx=0).stop 2024-03-19T06:23:22.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.743+0000 7fb2d0c00640 1 -- 172.21.15.32:0/1656583805 shutdown_connections 2024-03-19T06:23:22.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.743+0000 7fb2d0c00640 1 --2- 172.21.15.32:0/1656583805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2cc06c460 0x7fb2cc154130 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.743+0000 7fb2d0c00640 1 --2- 172.21.15.32:0/1656583805 >> v2:172.21.15.171:3300/0 conn(0x7fb2cc0ae0b0 0x7fb2cc0acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.743+0000 7fb2d0c00640 1 -- 172.21.15.32:0/1656583805 >> 172.21.15.32:0/1656583805 conn(0x7fb2cc071c50 msgr2=0x7fb2cc072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.743+0000 7fb2d0c00640 1 -- 172.21.15.32:0/1656583805 shutdown_connections 2024-03-19T06:23:22.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.743+0000 7fb2d0c00640 1 -- 172.21.15.32:0/1656583805 wait complete. 2024-03-19T06:23:22.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2d0c00640 1 Processor -- start 2024-03-19T06:23:22.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2d0c00640 1 -- start start 2024-03-19T06:23:22.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2d0c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2cc06c460 0x7fb2cc15cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:22.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2d0c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2cc0ae0b0 0x7fb2cc1406a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:22.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2d0c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2cc15dff0 0x7fb2cc159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:22.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2d0c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc15f7c0 con 0x7fb2cc0ae0b0 2024-03-19T06:23:22.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2d0c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc15f640 con 0x7fb2cc06c460 2024-03-19T06:23:22.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2d0c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc15f940 con 0x7fb2cc15dff0 2024-03-19T06:23:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2c9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2cc0ae0b0 0x7fb2cc1406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2c9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2cc0ae0b0 0x7fb2cc1406a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40246/0 (socket says 172.21.15.32:40246) 2024-03-19T06:23:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2c9400640 1 -- 172.21.15.32:0/973418114 learned_addr learned my addr 172.21.15.32:0/973418114 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2ca800640 1 --2- 172.21.15.32:0/973418114 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2cc15dff0 0x7fb2cc159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2c9e00640 1 --2- 172.21.15.32:0/973418114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2cc06c460 0x7fb2cc15cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2c9400640 1 -- 172.21.15.32:0/973418114 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2cc15dff0 msgr2=0x7fb2cc159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2c9400640 1 --2- 172.21.15.32:0/973418114 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2cc15dff0 0x7fb2cc159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2c9400640 1 -- 172.21.15.32:0/973418114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2cc06c460 msgr2=0x7fb2cc15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2c9400640 1 --2- 172.21.15.32:0/973418114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2cc06c460 0x7fb2cc15cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2c9400640 1 -- 172.21.15.32:0/973418114 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc159cc0 con 0x7fb2cc0ae0b0 2024-03-19T06:23:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2c9400640 1 --2- 172.21.15.32:0/973418114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2cc0ae0b0 0x7fb2cc1406a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800c480 tx=0x7fb2b800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2c2000640 1 -- 172.21.15.32:0/973418114 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8018070 con 0x7fb2cc0ae0b0 2024-03-19T06:23:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2c2000640 1 -- 172.21.15.32:0/973418114 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b8007500 con 0x7fb2cc0ae0b0 2024-03-19T06:23:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2c2000640 1 -- 172.21.15.32:0/973418114 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8004a30 con 0x7fb2cc0ae0b0 2024-03-19T06:23:22.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2d0c00640 1 -- 172.21.15.32:0/973418114 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2cc158c20 con 0x7fb2cc0ae0b0 2024-03-19T06:23:22.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.747+0000 7fb2d0c00640 1 -- 172.21.15.32:0/973418114 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2cc1591e0 con 0x7fb2cc0ae0b0 2024-03-19T06:23:22.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.751+0000 7fb2d0c00640 1 -- 172.21.15.32:0/973418114 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2cc0749e0 con 0x7fb2cc0ae0b0 2024-03-19T06:23:22.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.751+0000 7fb2c2000640 1 -- 172.21.15.32:0/973418114 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb2b8004bd0 con 0x7fb2cc0ae0b0 2024-03-19T06:23:22.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.751+0000 7fb2c2000640 1 --2- 172.21.15.32:0/973418114 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb2ac067660 0x7fb2ac069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:22.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.751+0000 7fb2c2000640 1 -- 172.21.15.32:0/973418114 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2b8084b50 con 0x7fb2cc0ae0b0 2024-03-19T06:23:22.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.751+0000 7fb2c9e00640 1 --2- 172.21.15.32:0/973418114 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb2ac067660 0x7fb2ac069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:22.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.751+0000 7fb2c9e00640 1 --2- 172.21.15.32:0/973418114 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb2ac067660 0x7fb2ac069b20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009580 tx=0x7fb2bc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:22.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.755+0000 7fb2c2000640 1 -- 172.21.15.32:0/973418114 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fb2b80557c0 con 0x7fb2cc0ae0b0 2024-03-19T06:23:22.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.919+0000 7fb2d0c00640 1 -- 172.21.15.32:0/973418114 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2cc0728b0 con 0x7fb2cc0ae0b0 2024-03-19T06:23:22.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.919+0000 7fb2c2000640 1 -- 172.21.15.32:0/973418114 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16694 (secure 0 0 0) 0x7fb2b80550c0 con 0x7fb2cc0ae0b0 2024-03-19T06:23:22.908 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:22.908 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":50,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:23:21.920310+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:23:19.707249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-19T06:23:20.926932+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:23:22.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.923+0000 7fb2d0c00640 1 -- 172.21.15.32:0/973418114 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb2ac067660 msgr2=0x7fb2ac069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:22.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.923+0000 7fb2d0c00640 1 --2- 172.21.15.32:0/973418114 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb2ac067660 0x7fb2ac069b20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009580 tx=0x7fb2bc008040 comp rx=0 tx=0).stop 2024-03-19T06:23:22.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.923+0000 7fb2d0c00640 1 -- 172.21.15.32:0/973418114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2cc0ae0b0 msgr2=0x7fb2cc1406a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:22.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.923+0000 7fb2d0c00640 1 --2- 172.21.15.32:0/973418114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2cc0ae0b0 0x7fb2cc1406a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800c480 tx=0x7fb2b800c940 comp rx=0 tx=0).stop 2024-03-19T06:23:22.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.923+0000 7fb2d0c00640 1 -- 172.21.15.32:0/973418114 shutdown_connections 2024-03-19T06:23:22.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.923+0000 7fb2d0c00640 1 --2- 172.21.15.32:0/973418114 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb2ac067660 0x7fb2ac069b20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:22.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.923+0000 7fb2d0c00640 1 --2- 172.21.15.32:0/973418114 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2cc15dff0 0x7fb2cc159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:22.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.923+0000 7fb2d0c00640 1 --2- 172.21.15.32:0/973418114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb2cc0ae0b0 0x7fb2cc1406a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:22.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.923+0000 7fb2d0c00640 1 --2- 172.21.15.32:0/973418114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2cc06c460 0x7fb2cc15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:22.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.923+0000 7fb2d0c00640 1 -- 172.21.15.32:0/973418114 >> 172.21.15.32:0/973418114 conn(0x7fb2cc071c50 msgr2=0x7fb2cc06dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:22.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.923+0000 7fb2d0c00640 1 -- 172.21.15.32:0/973418114 shutdown_connections 2024-03-19T06:23:22.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:22.923+0000 7fb2d0c00640 1 -- 172.21.15.32:0/973418114 wait complete. 2024-03-19T06:23:22.929 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:23:23.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.083+0000 7fba48600640 1 Processor -- start 2024-03-19T06:23:23.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.083+0000 7fba48600640 1 -- start start 2024-03-19T06:23:23.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.083+0000 7fba48600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba40159ed0 0x7fba400cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:23.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.083+0000 7fba48600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fba400cdb40 0x7fba40071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.083+0000 7fba48600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba400ce3e0 con 0x7fba4015a2b0 2024-03-19T06:23:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.083+0000 7fba48600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba400ca1d0 con 0x7fba400cdb40 2024-03-19T06:23:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.083+0000 7fba48600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba400ca4b0 con 0x7fba40159ed0 2024-03-19T06:23:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.083+0000 7fba45c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba40159ed0 0x7fba400cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:23.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.083+0000 7fba45c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba40159ed0 0x7fba400cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:49692/0 (socket says 172.21.15.32:49692) 2024-03-19T06:23:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.083+0000 7fba45c00640 1 -- 172.21.15.32:0/1780623966 learned_addr learned my addr 172.21.15.32:0/1780623966 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.083+0000 7fba46600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fba400cdb40 0x7fba40071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.083+0000 7fba45c00640 1 -- 172.21.15.32:0/1780623966 >> v2:172.21.15.171:3300/0 conn(0x7fba400cdb40 msgr2=0x7fba40071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.083+0000 7fba45c00640 1 --2- 172.21.15.32:0/1780623966 >> v2:172.21.15.171:3300/0 conn(0x7fba400cdb40 0x7fba40071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.083+0000 7fba45c00640 1 -- 172.21.15.32:0/1780623966 >> v1:172.21.15.171:6789/0 conn(0x7fba4015a2b0 legacy=0x7fba400caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:23.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.083+0000 7fba45c00640 1 -- 172.21.15.32:0/1780623966 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba400ca790 con 0x7fba40159ed0 2024-03-19T06:23:23.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.087+0000 7fba45c00640 1 --2- 172.21.15.32:0/1780623966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba40159ed0 0x7fba400cea60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fba3400af60 tx=0x7fba3401da70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d46d39eccc3a6fe5 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:23.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.087+0000 7fba3fe00640 1 -- 172.21.15.32:0/1780623966 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3400a2d0 con 0x7fba40159ed0 2024-03-19T06:23:23.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.087+0000 7fba3fe00640 1 -- 172.21.15.32:0/1780623966 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba340a67e0 con 0x7fba40159ed0 2024-03-19T06:23:23.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.087+0000 7fba3fe00640 1 -- 172.21.15.32:0/1780623966 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba340a6bb0 con 0x7fba40159ed0 2024-03-19T06:23:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.087+0000 7fba48600640 1 -- 172.21.15.32:0/1780623966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba40159ed0 msgr2=0x7fba400cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.087+0000 7fba48600640 1 --2- 172.21.15.32:0/1780623966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba40159ed0 0x7fba400cea60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fba3400af60 tx=0x7fba3401da70 comp rx=0 tx=0).stop 2024-03-19T06:23:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.087+0000 7fba48600640 1 -- 172.21.15.32:0/1780623966 shutdown_connections 2024-03-19T06:23:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.087+0000 7fba48600640 1 --2- 172.21.15.32:0/1780623966 >> v2:172.21.15.171:3300/0 conn(0x7fba400cdb40 0x7fba40071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.087+0000 7fba48600640 1 --2- 172.21.15.32:0/1780623966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba40159ed0 0x7fba400cea60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.087+0000 7fba48600640 1 -- 172.21.15.32:0/1780623966 >> 172.21.15.32:0/1780623966 conn(0x7fba400b1280 msgr2=0x7fba400b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.087+0000 7fba48600640 1 -- 172.21.15.32:0/1780623966 shutdown_connections 2024-03-19T06:23:23.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.087+0000 7fba48600640 1 -- 172.21.15.32:0/1780623966 wait complete. 2024-03-19T06:23:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba48600640 1 Processor -- start 2024-03-19T06:23:23.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba48600640 1 -- start start 2024-03-19T06:23:23.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba48600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba400cdb40 0x7fba40141030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:23.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba48600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba40159ed0 0x7fba400b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:23.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba48600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba4015a2b0 0x7fba4014ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:23.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba48600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4006e1c0 con 0x7fba400cdb40 2024-03-19T06:23:23.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba48600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4006e040 con 0x7fba4015a2b0 2024-03-19T06:23:23.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba48600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4006e340 con 0x7fba40159ed0 2024-03-19T06:23:23.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba45c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba400cdb40 0x7fba40141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:23.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba45c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba400cdb40 0x7fba40141030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40254/0 (socket says 172.21.15.32:40254) 2024-03-19T06:23:23.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba45c00640 1 -- 172.21.15.32:0/3682416287 learned_addr learned my addr 172.21.15.32:0/3682416287 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:23.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba45200640 1 --2- 172.21.15.32:0/3682416287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba40159ed0 0x7fba400b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:23.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba46600640 1 --2- 172.21.15.32:0/3682416287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba4015a2b0 0x7fba4014ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:23.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba45c00640 1 -- 172.21.15.32:0/3682416287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba40159ed0 msgr2=0x7fba400b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:23.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba45c00640 1 --2- 172.21.15.32:0/3682416287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba40159ed0 0x7fba400b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:23.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba45c00640 1 -- 172.21.15.32:0/3682416287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba4015a2b0 msgr2=0x7fba4014ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:23.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba45c00640 1 --2- 172.21.15.32:0/3682416287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba4015a2b0 0x7fba4014ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:23.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba45c00640 1 -- 172.21.15.32:0/3682416287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba40154a30 con 0x7fba400cdb40 2024-03-19T06:23:23.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba45200640 1 --2- 172.21.15.32:0/3682416287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba40159ed0 0x7fba400b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:23.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba46600640 1 --2- 172.21.15.32:0/3682416287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba4015a2b0 0x7fba4014ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:23.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba45c00640 1 --2- 172.21.15.32:0/3682416287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba400cdb40 0x7fba40141030 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fba340b0040 tx=0x7fba3401a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:23.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba3d600640 1 -- 172.21.15.32:0/3682416287 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba340a6da0 con 0x7fba400cdb40 2024-03-19T06:23:23.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba3d600640 1 -- 172.21.15.32:0/3682416287 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba34008500 con 0x7fba400cdb40 2024-03-19T06:23:23.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba3d600640 1 -- 172.21.15.32:0/3682416287 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba340088f0 con 0x7fba400cdb40 2024-03-19T06:23:23.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba48600640 1 -- 172.21.15.32:0/3682416287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba40154d10 con 0x7fba400cdb40 2024-03-19T06:23:23.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.091+0000 7fba48600640 1 -- 172.21.15.32:0/3682416287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba401552d0 con 0x7fba400cdb40 2024-03-19T06:23:23.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.095+0000 7fba48600640 1 -- 172.21.15.32:0/3682416287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba400749e0 con 0x7fba400cdb40 2024-03-19T06:23:23.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.095+0000 7fba3d600640 1 -- 172.21.15.32:0/3682416287 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fba340bf030 con 0x7fba400cdb40 2024-03-19T06:23:23.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.095+0000 7fba3d600640 1 --2- 172.21.15.32:0/3682416287 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba20067660 0x7fba20069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:23.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.095+0000 7fba3d600640 1 -- 172.21.15.32:0/3682416287 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba34120540 con 0x7fba400cdb40 2024-03-19T06:23:23.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.095+0000 7fba45200640 1 --2- 172.21.15.32:0/3682416287 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba20067660 0x7fba20069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:23.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.095+0000 7fba45200640 1 --2- 172.21.15.32:0/3682416287 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba20067660 0x7fba20069b20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fba400b4480 tx=0x7fba2c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:23.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.099+0000 7fba3d600640 1 -- 172.21.15.32:0/3682416287 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fba340c6020 con 0x7fba400cdb40 2024-03-19T06:23:23.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.267+0000 7fba48600640 1 -- 172.21.15.32:0/3682416287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba40072600 con 0x7fba400cdb40 2024-03-19T06:23:23.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.267+0000 7fba3d600640 1 -- 172.21.15.32:0/3682416287 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16694 (secure 0 0 0) 0x7fba34017720 con 0x7fba400cdb40 2024-03-19T06:23:23.256 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:23.256 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":50,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:23:21.920310+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:23:19.707249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-19T06:23:20.926932+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:23:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.271+0000 7fba48600640 1 -- 172.21.15.32:0/3682416287 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba20067660 msgr2=0x7fba20069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.271+0000 7fba48600640 1 --2- 172.21.15.32:0/3682416287 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba20067660 0x7fba20069b20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fba400b4480 tx=0x7fba2c009040 comp rx=0 tx=0).stop 2024-03-19T06:23:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.271+0000 7fba48600640 1 -- 172.21.15.32:0/3682416287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba400cdb40 msgr2=0x7fba40141030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.271+0000 7fba48600640 1 --2- 172.21.15.32:0/3682416287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba400cdb40 0x7fba40141030 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fba340b0040 tx=0x7fba3401a810 comp rx=0 tx=0).stop 2024-03-19T06:23:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.271+0000 7fba48600640 1 -- 172.21.15.32:0/3682416287 shutdown_connections 2024-03-19T06:23:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.271+0000 7fba48600640 1 --2- 172.21.15.32:0/3682416287 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba20067660 0x7fba20069b20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.271+0000 7fba48600640 1 --2- 172.21.15.32:0/3682416287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba4015a2b0 0x7fba4014ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.271+0000 7fba48600640 1 --2- 172.21.15.32:0/3682416287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba40159ed0 0x7fba400b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.271+0000 7fba48600640 1 --2- 172.21.15.32:0/3682416287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba400cdb40 0x7fba40141030 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.271+0000 7fba48600640 1 -- 172.21.15.32:0/3682416287 >> 172.21.15.32:0/3682416287 conn(0x7fba400b1280 msgr2=0x7fba4015cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:23.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.271+0000 7fba48600640 1 -- 172.21.15.32:0/3682416287 shutdown_connections 2024-03-19T06:23:23.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.271+0000 7fba48600640 1 -- 172.21.15.32:0/3682416287 wait complete. 2024-03-19T06:23:23.277 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-19T06:23:23.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.431+0000 7fd8ddc00640 1 Processor -- start 2024-03-19T06:23:23.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.431+0000 7fd8ddc00640 1 -- start start 2024-03-19T06:23:23.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.431+0000 7fd8ddc00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd8d815a840 0x7fd8d806f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:23.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.431+0000 7fd8ddc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8d80aea70 0x7fd8d806ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:23.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.431+0000 7fd8ddc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8d806b280 0x7fd8d806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:23.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.431+0000 7fd8ddc00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d80cdc20 con 0x7fd8d80aea70 2024-03-19T06:23:23.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.431+0000 7fd8ddc00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d80af2d0 con 0x7fd8d815a840 2024-03-19T06:23:23.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.431+0000 7fd8ddc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d815eea0 con 0x7fd8d806b280 2024-03-19T06:23:23.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.435+0000 7fd8cfe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8d80aea70 0x7fd8d806ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:23.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.435+0000 7fd8cfe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8d80aea70 0x7fd8d806ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40260/0 (socket says 172.21.15.32:40260) 2024-03-19T06:23:23.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.435+0000 7fd8cfe00640 1 -- 172.21.15.32:0/3378423991 learned_addr learned my addr 172.21.15.32:0/3378423991 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:23.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.435+0000 7fd8d6a00640 1 --2- 172.21.15.32:0/3378423991 >> v2:172.21.15.171:3300/0 conn(0x7fd8d815a840 0x7fd8d806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:23.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.435+0000 7fd8d7400640 1 --2- 172.21.15.32:0/3378423991 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8d806b280 0x7fd8d806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:23.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.435+0000 7fd8cfe00640 1 -- 172.21.15.32:0/3378423991 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8d806b280 msgr2=0x7fd8d806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:23.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.435+0000 7fd8cfe00640 1 --2- 172.21.15.32:0/3378423991 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8d806b280 0x7fd8d806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:23.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.435+0000 7fd8cfe00640 1 -- 172.21.15.32:0/3378423991 >> v2:172.21.15.171:3300/0 conn(0x7fd8d815a840 msgr2=0x7fd8d806f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:23.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.435+0000 7fd8cfe00640 1 --2- 172.21.15.32:0/3378423991 >> v2:172.21.15.171:3300/0 conn(0x7fd8d815a840 0x7fd8d806f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:23.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.435+0000 7fd8cfe00640 1 -- 172.21.15.32:0/3378423991 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d815f180 con 0x7fd8d80aea70 2024-03-19T06:23:23.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.435+0000 7fd8d6a00640 1 --2- 172.21.15.32:0/3378423991 >> v2:172.21.15.171:3300/0 conn(0x7fd8d815a840 0x7fd8d806f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:23.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.435+0000 7fd8cfe00640 1 --2- 172.21.15.32:0/3378423991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d80aea70 0x7fd8d806ad40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd8d806f6f0 tx=0x7fd8c001c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1671bf34b1f162c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:23.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.435+0000 7fd8d6000640 1 -- 172.21.15.32:0/3378423991 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00b0070 con 0x7fd8d80aea70 2024-03-19T06:23:23.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.435+0000 7fd8d6000640 1 -- 172.21.15.32:0/3378423991 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c00ab600 con 0x7fd8d80aea70 2024-03-19T06:23:23.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.435+0000 7fd8d6000640 1 -- 172.21.15.32:0/3378423991 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00ab9d0 con 0x7fd8d80aea70 2024-03-19T06:23:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 -- 172.21.15.32:0/3378423991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d80aea70 msgr2=0x7fd8d806ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 --2- 172.21.15.32:0/3378423991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d80aea70 0x7fd8d806ad40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd8d806f6f0 tx=0x7fd8c001c140 comp rx=0 tx=0).stop 2024-03-19T06:23:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 -- 172.21.15.32:0/3378423991 shutdown_connections 2024-03-19T06:23:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 --2- 172.21.15.32:0/3378423991 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8d806b280 0x7fd8d806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 --2- 172.21.15.32:0/3378423991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d80aea70 0x7fd8d806ad40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 --2- 172.21.15.32:0/3378423991 >> v2:172.21.15.171:3300/0 conn(0x7fd8d815a840 0x7fd8d806f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 -- 172.21.15.32:0/3378423991 >> 172.21.15.32:0/3378423991 conn(0x7fd8d80b1590 msgr2=0x7fd8d80b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 -- 172.21.15.32:0/3378423991 shutdown_connections 2024-03-19T06:23:23.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 -- 172.21.15.32:0/3378423991 wait complete. 2024-03-19T06:23:23.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 Processor -- start 2024-03-19T06:23:23.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 -- start start 2024-03-19T06:23:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8d806b280 0x7fd8d81442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d80aea70 0x7fd8d8145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8d815a840 0x7fd8d81464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d80ce210 con 0x7fd8d80aea70 2024-03-19T06:23:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d80ce090 con 0x7fd8d815a840 2024-03-19T06:23:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8ddc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d80ce390 con 0x7fd8d806b280 2024-03-19T06:23:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8cfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d80aea70 0x7fd8d8145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8cfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d80aea70 0x7fd8d8145f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40272/0 (socket says 172.21.15.32:40272) 2024-03-19T06:23:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8cfe00640 1 -- 172.21.15.32:0/1356405732 learned_addr learned my addr 172.21.15.32:0/1356405732 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8d6a00640 1 --2- 172.21.15.32:0/1356405732 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8d806b280 0x7fd8d81442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8d7400640 1 --2- 172.21.15.32:0/1356405732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8d815a840 0x7fd8d81464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:23.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8cfe00640 1 -- 172.21.15.32:0/1356405732 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8d806b280 msgr2=0x7fd8d81442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:23.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8cfe00640 1 --2- 172.21.15.32:0/1356405732 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8d806b280 0x7fd8d81442e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:23.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8cfe00640 1 -- 172.21.15.32:0/1356405732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8d815a840 msgr2=0x7fd8d81464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:23.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8cfe00640 1 --2- 172.21.15.32:0/1356405732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8d815a840 0x7fd8d81464b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:23.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8cfe00640 1 -- 172.21.15.32:0/1356405732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8144820 con 0x7fd8d80aea70 2024-03-19T06:23:23.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8d7400640 1 --2- 172.21.15.32:0/1356405732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8d815a840 0x7fd8d81464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:23.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8d6a00640 1 --2- 172.21.15.32:0/1356405732 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8d806b280 0x7fd8d81442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:23.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.439+0000 7fd8cfe00640 1 --2- 172.21.15.32:0/1356405732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d80aea70 0x7fd8d8145f70 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00ae040 tx=0x7fd8c0018ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:23.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.443+0000 7fd8cea00640 1 -- 172.21.15.32:0/1356405732 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00b0040 con 0x7fd8d80aea70 2024-03-19T06:23:23.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.443+0000 7fd8cea00640 1 -- 172.21.15.32:0/1356405732 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c00b4420 con 0x7fd8d80aea70 2024-03-19T06:23:23.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.443+0000 7fd8cea00640 1 -- 172.21.15.32:0/1356405732 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00b4810 con 0x7fd8d80aea70 2024-03-19T06:23:23.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.443+0000 7fd8ddc00640 1 -- 172.21.15.32:0/1356405732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d8164610 con 0x7fd8d80aea70 2024-03-19T06:23:23.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.443+0000 7fd8ddc00640 1 -- 172.21.15.32:0/1356405732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d8164bd0 con 0x7fd8d80aea70 2024-03-19T06:23:23.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.443+0000 7fd8ddc00640 1 -- 172.21.15.32:0/1356405732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d80749e0 con 0x7fd8d80aea70 2024-03-19T06:23:23.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.443+0000 7fd8cea00640 1 -- 172.21.15.32:0/1356405732 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd8c00b49b0 con 0x7fd8d80aea70 2024-03-19T06:23:23.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.443+0000 7fd8cea00640 1 --2- 172.21.15.32:0/1356405732 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd8b4067660 0x7fd8b4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:23.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.443+0000 7fd8cea00640 1 -- 172.21.15.32:0/1356405732 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8c011f520 con 0x7fd8d80aea70 2024-03-19T06:23:23.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.443+0000 7fd8d6a00640 1 --2- 172.21.15.32:0/1356405732 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd8b4067660 0x7fd8b4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:23.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.447+0000 7fd8d6a00640 1 --2- 172.21.15.32:0/1356405732 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd8b4067660 0x7fd8b4069b20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80097a0 tx=0x7fd8c8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:23.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.447+0000 7fd8cea00640 1 -- 172.21.15.32:0/1356405732 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fd8c0016110 con 0x7fd8d80aea70 2024-03-19T06:23:23.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:23.647+0000 7fd8ddc00640 1 -- 172.21.15.32:0/1356405732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd8d80b35b0 con 0x7fd8d80aea70 2024-03-19T06:23:24.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.555+0000 7fd8cea00640 1 -- 172.21.15.32:0/1356405732 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd8c00f0190 con 0x7fd8d80aea70 2024-03-19T06:23:24.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.555+0000 7fd8ddc00640 1 -- 172.21.15.32:0/1356405732 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd8b4067660 msgr2=0x7fd8b4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:24.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.555+0000 7fd8ddc00640 1 --2- 172.21.15.32:0/1356405732 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd8b4067660 0x7fd8b4069b20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80097a0 tx=0x7fd8c8008040 comp rx=0 tx=0).stop 2024-03-19T06:23:24.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.555+0000 7fd8ddc00640 1 -- 172.21.15.32:0/1356405732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d80aea70 msgr2=0x7fd8d8145f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:24.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.555+0000 7fd8ddc00640 1 --2- 172.21.15.32:0/1356405732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d80aea70 0x7fd8d8145f70 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00ae040 tx=0x7fd8c0018ee0 comp rx=0 tx=0).stop 2024-03-19T06:23:24.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.559+0000 7fd8ddc00640 1 -- 172.21.15.32:0/1356405732 shutdown_connections 2024-03-19T06:23:24.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.559+0000 7fd8ddc00640 1 --2- 172.21.15.32:0/1356405732 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd8b4067660 0x7fd8b4069b20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:24.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.559+0000 7fd8ddc00640 1 --2- 172.21.15.32:0/1356405732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8d815a840 0x7fd8d81464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:24.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.559+0000 7fd8ddc00640 1 --2- 172.21.15.32:0/1356405732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d80aea70 0x7fd8d8145f70 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:24.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.559+0000 7fd8ddc00640 1 --2- 172.21.15.32:0/1356405732 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8d806b280 0x7fd8d81442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:24.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.559+0000 7fd8ddc00640 1 -- 172.21.15.32:0/1356405732 >> 172.21.15.32:0/1356405732 conn(0x7fd8d80b1590 msgr2=0x7fd8d80b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:24.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.559+0000 7fd8ddc00640 1 -- 172.21.15.32:0/1356405732 shutdown_connections 2024-03-19T06:23:24.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.559+0000 7fd8ddc00640 1 -- 172.21.15.32:0/1356405732 wait complete. 2024-03-19T06:23:24.568 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-19T06:23:24.568 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-19T06:23:24.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.727+0000 7f3e40000640 1 Processor -- start 2024-03-19T06:23:24.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.727+0000 7f3e40000640 1 -- start start 2024-03-19T06:23:24.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.731+0000 7f3e40000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e3806eed0 0x7f3e380ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:24.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.731+0000 7f3e40000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3e3806e320 0x7f3e3815bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:24.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.731+0000 7f3e40000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e380cc290 con 0x7f3e3806ad40 2024-03-19T06:23:24.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.731+0000 7f3e40000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3806dbb0 con 0x7f3e3806e320 2024-03-19T06:23:24.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.731+0000 7f3e40000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e380cc570 con 0x7f3e3806eed0 2024-03-19T06:23:24.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.731+0000 7f3e3e000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3e3806e320 0x7f3e3815bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:24.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.731+0000 7f3e3d600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3e3806ad40 0x7f3e3806b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41542/0 (socket says 172.21.15.32:41542) 2024-03-19T06:23:24.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.731+0000 7f3e3e000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3e3806e320 0x7f3e3815bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40804/0 (socket says 172.21.15.32:40804) 2024-03-19T06:23:24.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.731+0000 7f3e3d600640 1 -- 172.21.15.32:0/1778812017 learned_addr learned my addr 172.21.15.32:0/1778812017 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:24.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.731+0000 7f3e3cc00640 1 --2- 172.21.15.32:0/1778812017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e3806eed0 0x7f3e380ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:24.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.731+0000 7f3e3e000640 1 -- 172.21.15.32:0/1778812017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e3806eed0 msgr2=0x7f3e380ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:24.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.731+0000 7f3e3e000640 1 --2- 172.21.15.32:0/1778812017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e3806eed0 0x7f3e380ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:24.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.731+0000 7f3e3e000640 1 -- 172.21.15.32:0/1778812017 >> v1:172.21.15.32:6789/0 conn(0x7f3e3806ad40 legacy=0x7f3e3806b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:24.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.731+0000 7f3e3e000640 1 -- 172.21.15.32:0/1778812017 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e380cc850 con 0x7f3e3806e320 2024-03-19T06:23:24.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.731+0000 7f3e37e00640 1 -- 172.21.15.32:0/1778812017 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681886336 0 0) 0x7f3e380cc290 con 0x7f3e3806ad40 2024-03-19T06:23:24.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e3e000640 1 --2- 172.21.15.32:0/1778812017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3806e320 0x7f3e3815bc50 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009d90 tx=0x7f3e3001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0c74774f35a12d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:24.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e37e00640 1 -- 172.21.15.32:0/1778812017 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e300b2070 con 0x7f3e3806e320 2024-03-19T06:23:24.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e37e00640 1 -- 172.21.15.32:0/1778812017 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3815c9a0 con 0x7f3e3806e320 2024-03-19T06:23:24.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e37e00640 1 -- 172.21.15.32:0/1778812017 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e300a5bb0 con 0x7f3e3806e320 2024-03-19T06:23:24.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e40000640 1 -- 172.21.15.32:0/1778812017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3806e320 msgr2=0x7f3e3815bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:24.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e40000640 1 --2- 172.21.15.32:0/1778812017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3806e320 0x7f3e3815bc50 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009d90 tx=0x7f3e3001c8b0 comp rx=0 tx=0).stop 2024-03-19T06:23:24.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e40000640 1 -- 172.21.15.32:0/1778812017 shutdown_connections 2024-03-19T06:23:24.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e40000640 1 --2- 172.21.15.32:0/1778812017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3806e320 0x7f3e3815bc50 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:24.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e40000640 1 --2- 172.21.15.32:0/1778812017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e3806eed0 0x7f3e380ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:24.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e40000640 1 -- 172.21.15.32:0/1778812017 >> 172.21.15.32:0/1778812017 conn(0x7f3e380b1590 msgr2=0x7f3e380b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:24.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e40000640 1 -- 172.21.15.32:0/1778812017 shutdown_connections 2024-03-19T06:23:24.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e40000640 1 -- 172.21.15.32:0/1778812017 wait complete. 2024-03-19T06:23:24.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e40000640 1 Processor -- start 2024-03-19T06:23:24.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e40000640 1 -- start start 2024-03-19T06:23:24.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e40000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3806ad40 0x7f3e38150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:24.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e40000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e3806e320 0x7f3e380b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:24.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e40000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e3806eed0 0x7f3e380b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e40000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e381688a0 con 0x7f3e3806ad40 2024-03-19T06:23:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e40000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e38168720 con 0x7f3e3806eed0 2024-03-19T06:23:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.735+0000 7f3e40000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e38168a20 con 0x7f3e3806e320 2024-03-19T06:23:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e3d600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3806ad40 0x7f3e38150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e3d600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3806ad40 0x7f3e38150ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40808/0 (socket says 172.21.15.32:40808) 2024-03-19T06:23:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e3d600640 1 -- 172.21.15.32:0/1398457281 learned_addr learned my addr 172.21.15.32:0/1398457281 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e3e000640 1 --2- 172.21.15.32:0/1398457281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e3806eed0 0x7f3e380b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e3cc00640 1 --2- 172.21.15.32:0/1398457281 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e3806e320 0x7f3e380b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e3d600640 1 -- 172.21.15.32:0/1398457281 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e3806e320 msgr2=0x7f3e380b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e3d600640 1 --2- 172.21.15.32:0/1398457281 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e3806e320 0x7f3e380b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e3d600640 1 -- 172.21.15.32:0/1398457281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e3806eed0 msgr2=0x7f3e380b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e3d600640 1 --2- 172.21.15.32:0/1398457281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e3806eed0 0x7f3e380b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e3d600640 1 -- 172.21.15.32:0/1398457281 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e380aec10 con 0x7f3e3806ad40 2024-03-19T06:23:24.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e3d600640 1 --2- 172.21.15.32:0/1398457281 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3806ad40 0x7f3e38150ed0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0011f0 tx=0x7f3e2c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:24.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e35600640 1 -- 172.21.15.32:0/1398457281 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c018070 con 0x7f3e3806ad40 2024-03-19T06:23:24.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e35600640 1 -- 172.21.15.32:0/1398457281 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c0074e0 con 0x7f3e3806ad40 2024-03-19T06:23:24.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e40000640 1 -- 172.21.15.32:0/1398457281 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e38156ce0 con 0x7f3e3806ad40 2024-03-19T06:23:24.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e35600640 1 -- 172.21.15.32:0/1398457281 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c004a10 con 0x7f3e3806ad40 2024-03-19T06:23:24.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e40000640 1 -- 172.21.15.32:0/1398457281 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e38156fa0 con 0x7f3e3806ad40 2024-03-19T06:23:24.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e40000640 1 -- 172.21.15.32:0/1398457281 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e380749e0 con 0x7f3e3806ad40 2024-03-19T06:23:24.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e35600640 1 -- 172.21.15.32:0/1398457281 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3e2c01b070 con 0x7f3e3806ad40 2024-03-19T06:23:24.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e35600640 1 --2- 172.21.15.32:0/1398457281 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3e18067690 0x7f3e18069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:24.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.739+0000 7f3e35600640 1 -- 172.21.15.32:0/1398457281 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e2c084c40 con 0x7f3e3806ad40 2024-03-19T06:23:24.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.743+0000 7f3e3cc00640 1 --2- 172.21.15.32:0/1398457281 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3e18067690 0x7f3e18069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:24.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.743+0000 7f3e3cc00640 1 --2- 172.21.15.32:0/1398457281 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3e18067690 0x7f3e18069b50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3e380d00c0 tx=0x7f3e24008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:24.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.743+0000 7f3e35600640 1 -- 172.21.15.32:0/1398457281 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f3e2c055820 con 0x7f3e3806ad40 2024-03-19T06:23:24.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:24.947+0000 7f3e40000640 1 -- 172.21.15.32:0/1398457281 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3e380b4900 con 0x7f3e3806ad40 2024-03-19T06:23:25.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.555+0000 7f3e35600640 1 -- 172.21.15.32:0/1398457281 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3e2c055120 con 0x7f3e3806ad40 2024-03-19T06:23:25.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.559+0000 7f3e40000640 1 -- 172.21.15.32:0/1398457281 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3e18067690 msgr2=0x7f3e18069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:25.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.559+0000 7f3e40000640 1 --2- 172.21.15.32:0/1398457281 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3e18067690 0x7f3e18069b50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3e380d00c0 tx=0x7f3e24008040 comp rx=0 tx=0).stop 2024-03-19T06:23:25.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.559+0000 7f3e40000640 1 -- 172.21.15.32:0/1398457281 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3806ad40 msgr2=0x7f3e38150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:25.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.559+0000 7f3e40000640 1 --2- 172.21.15.32:0/1398457281 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3806ad40 0x7f3e38150ed0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0011f0 tx=0x7f3e2c00c9b0 comp rx=0 tx=0).stop 2024-03-19T06:23:25.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.559+0000 7f3e40000640 1 -- 172.21.15.32:0/1398457281 shutdown_connections 2024-03-19T06:23:25.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.559+0000 7f3e40000640 1 --2- 172.21.15.32:0/1398457281 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3e18067690 0x7f3e18069b50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:25.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.559+0000 7f3e40000640 1 --2- 172.21.15.32:0/1398457281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e3806eed0 0x7f3e380b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:25.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.559+0000 7f3e40000640 1 --2- 172.21.15.32:0/1398457281 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e3806e320 0x7f3e380b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:25.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.559+0000 7f3e40000640 1 --2- 172.21.15.32:0/1398457281 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e3806ad40 0x7f3e38150ed0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:25.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.559+0000 7f3e40000640 1 -- 172.21.15.32:0/1398457281 >> 172.21.15.32:0/1398457281 conn(0x7f3e380b1590 msgr2=0x7f3e3815dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:25.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.559+0000 7f3e40000640 1 -- 172.21.15.32:0/1398457281 shutdown_connections 2024-03-19T06:23:25.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.559+0000 7f3e40000640 1 -- 172.21.15.32:0/1398457281 wait complete. 2024-03-19T06:23:25.572 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-19T06:23:25.572 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:23:25.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.727+0000 7fa22fe00640 1 Processor -- start 2024-03-19T06:23:25.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.727+0000 7fa22fe00640 1 -- start start 2024-03-19T06:23:25.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.731+0000 7fa22fe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa22815dff0 0x7fa2280acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:25.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.731+0000 7fa22fe00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22815e520 con 0x7fa2280ae0b0 2024-03-19T06:23:25.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.731+0000 7fa22fe00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22815e800 con 0x7fa22806c460 2024-03-19T06:23:25.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.731+0000 7fa22fe00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22815f1b0 con 0x7fa22815dff0 2024-03-19T06:23:25.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.731+0000 7fa22de00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa22815dff0 0x7fa2280acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:25.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.731+0000 7fa22de00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa22815dff0 0x7fa2280acdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40818/0 (socket says 172.21.15.32:40818) 2024-03-19T06:23:25.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.731+0000 7fa22d400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa2280ae0b0 0x7fa22806bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41548/0 (socket says 172.21.15.32:41548) 2024-03-19T06:23:25.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.731+0000 7fa22de00640 1 -- 172.21.15.32:0/519945794 learned_addr learned my addr 172.21.15.32:0/519945794 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:25.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.731+0000 7fa22de00640 1 -- 172.21.15.32:0/519945794 >> v1:172.21.15.171:6789/0 conn(0x7fa22806c460 legacy=0x7fa228154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:25.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.731+0000 7fa22de00640 1 -- 172.21.15.32:0/519945794 >> v1:172.21.15.32:6789/0 conn(0x7fa2280ae0b0 legacy=0x7fa22806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:25.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.731+0000 7fa22de00640 1 -- 172.21.15.32:0/519945794 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22815eae0 con 0x7fa22815dff0 2024-03-19T06:23:25.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa22de00640 1 --2- 172.21.15.32:0/519945794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa22815dff0 0x7fa2280acdb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa22815f330 tx=0x7fa22001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ce677e4ca2bfcf server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:25.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa227e00640 1 -- 172.21.15.32:0/519945794 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2200a55d0 con 0x7fa22815dff0 2024-03-19T06:23:25.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa227e00640 1 -- 172.21.15.32:0/519945794 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2200a5770 con 0x7fa22815dff0 2024-03-19T06:23:25.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa227e00640 1 -- 172.21.15.32:0/519945794 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2200a5b40 con 0x7fa22815dff0 2024-03-19T06:23:25.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa22fe00640 1 -- 172.21.15.32:0/519945794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa22815dff0 msgr2=0x7fa2280acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:25.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa22fe00640 1 --2- 172.21.15.32:0/519945794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa22815dff0 0x7fa2280acdb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa22815f330 tx=0x7fa22001c9d0 comp rx=0 tx=0).stop 2024-03-19T06:23:25.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa22fe00640 1 -- 172.21.15.32:0/519945794 shutdown_connections 2024-03-19T06:23:25.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa22fe00640 1 --2- 172.21.15.32:0/519945794 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa22815dff0 0x7fa2280acdb0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:25.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa22fe00640 1 -- 172.21.15.32:0/519945794 >> 172.21.15.32:0/519945794 conn(0x7fa228071c50 msgr2=0x7fa228072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:25.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa22fe00640 1 -- 172.21.15.32:0/519945794 shutdown_connections 2024-03-19T06:23:25.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa22fe00640 1 -- 172.21.15.32:0/519945794 wait complete. 2024-03-19T06:23:25.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa22fe00640 1 Processor -- start 2024-03-19T06:23:25.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa22fe00640 1 -- start start 2024-03-19T06:23:25.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa22fe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22806c460 0x7fa228156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:25.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa22fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2280ae0b0 0x7fa228145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:25.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa22fe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa22815dff0 0x7fa22815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:25.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa22fe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22816bb10 con 0x7fa2280ae0b0 2024-03-19T06:23:25.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa22fe00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22816b990 con 0x7fa22806c460 2024-03-19T06:23:25.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.735+0000 7fa22fe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22816bc90 con 0x7fa22815dff0 2024-03-19T06:23:25.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa22ca00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2280ae0b0 0x7fa228145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:25.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa22ca00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2280ae0b0 0x7fa228145040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40826/0 (socket says 172.21.15.32:40826) 2024-03-19T06:23:25.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa22ca00640 1 -- 172.21.15.32:0/3577042990 learned_addr learned my addr 172.21.15.32:0/3577042990 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:25.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa22d400640 1 --2- 172.21.15.32:0/3577042990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22806c460 0x7fa228156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:25.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa22de00640 1 --2- 172.21.15.32:0/3577042990 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa22815dff0 0x7fa22815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:25.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa22ca00640 1 -- 172.21.15.32:0/3577042990 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa22815dff0 msgr2=0x7fa22815cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:25.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa22ca00640 1 --2- 172.21.15.32:0/3577042990 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa22815dff0 0x7fa22815cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:25.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa22ca00640 1 -- 172.21.15.32:0/3577042990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22806c460 msgr2=0x7fa228156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:25.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa22ca00640 1 --2- 172.21.15.32:0/3577042990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22806c460 0x7fa228156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:25.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa22ca00640 1 -- 172.21.15.32:0/3577042990 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2281f6da0 con 0x7fa2280ae0b0 2024-03-19T06:23:25.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa22d400640 1 --2- 172.21.15.32:0/3577042990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22806c460 0x7fa228156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:25.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa22ca00640 1 --2- 172.21.15.32:0/3577042990 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2280ae0b0 0x7fa228145040 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa21400c480 tx=0x7fa21400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:25.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa225600640 1 -- 172.21.15.32:0/3577042990 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa214012830 con 0x7fa2280ae0b0 2024-03-19T06:23:25.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa225600640 1 -- 172.21.15.32:0/3577042990 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa214017070 con 0x7fa2280ae0b0 2024-03-19T06:23:25.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa22fe00640 1 -- 172.21.15.32:0/3577042990 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa228157250 con 0x7fa2280ae0b0 2024-03-19T06:23:25.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa225600640 1 -- 172.21.15.32:0/3577042990 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa214012c30 con 0x7fa2280ae0b0 2024-03-19T06:23:25.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa22fe00640 1 -- 172.21.15.32:0/3577042990 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa228150b60 con 0x7fa2280ae0b0 2024-03-19T06:23:25.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa22fe00640 1 -- 172.21.15.32:0/3577042990 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2280749e0 con 0x7fa2280ae0b0 2024-03-19T06:23:25.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa225600640 1 -- 172.21.15.32:0/3577042990 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa21401c460 con 0x7fa2280ae0b0 2024-03-19T06:23:25.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.739+0000 7fa225600640 1 --2- 172.21.15.32:0/3577042990 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa208067660 0x7fa208069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:25.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.743+0000 7fa225600640 1 -- 172.21.15.32:0/3577042990 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2140856f0 con 0x7fa2280ae0b0 2024-03-19T06:23:25.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.743+0000 7fa22d400640 1 --2- 172.21.15.32:0/3577042990 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa208067660 0x7fa208069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:25.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.743+0000 7fa22d400640 1 --2- 172.21.15.32:0/3577042990 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa208067660 0x7fa208069b20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa21c000f70 tx=0x7fa21c007d70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:25.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.747+0000 7fa225600640 1 -- 172.21.15.32:0/3577042990 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fa214056360 con 0x7fa2280ae0b0 2024-03-19T06:23:25.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.939+0000 7fa22fe00640 1 -- 172.21.15.32:0/3577042990 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2280728b0 con 0x7fa2280ae0b0 2024-03-19T06:23:25.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.939+0000 7fa225600640 1 -- 172.21.15.32:0/3577042990 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fa214055c60 con 0x7fa2280ae0b0 2024-03-19T06:23:25.929 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:25.930 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3631486110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3631486110},{"type":"v1","addr":"172.21.15.171:6836","nonce":3631486110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/3410824978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3410824978},{"type":"v1","addr":"172.21.15.32:6833","nonce":3410824978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3585939515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3585939515},{"type":"v1","addr":"172.21.15.32:6835","nonce":3585939515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:23:21.920668+0000","modified":"2024-03-19T06:23:24.948860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5934},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5934":{"gid":5934,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/1907516739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1907516739},{"type":"v1","addr":"172.21.15.171:6837","nonce":1907516739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-03-19T06:23:25.930 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 26 2024-03-19T06:23:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.943+0000 7fa22fe00640 1 -- 172.21.15.32:0/3577042990 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa208067660 msgr2=0x7fa208069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.943+0000 7fa22fe00640 1 --2- 172.21.15.32:0/3577042990 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa208067660 0x7fa208069b20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa21c000f70 tx=0x7fa21c007d70 comp rx=0 tx=0).stop 2024-03-19T06:23:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.943+0000 7fa22fe00640 1 -- 172.21.15.32:0/3577042990 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2280ae0b0 msgr2=0x7fa228145040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.943+0000 7fa22fe00640 1 --2- 172.21.15.32:0/3577042990 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2280ae0b0 0x7fa228145040 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa21400c480 tx=0x7fa21400c940 comp rx=0 tx=0).stop 2024-03-19T06:23:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.943+0000 7fa22fe00640 1 -- 172.21.15.32:0/3577042990 shutdown_connections 2024-03-19T06:23:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.943+0000 7fa22fe00640 1 --2- 172.21.15.32:0/3577042990 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa208067660 0x7fa208069b20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.943+0000 7fa22fe00640 1 --2- 172.21.15.32:0/3577042990 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa22815dff0 0x7fa22815cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.943+0000 7fa22fe00640 1 --2- 172.21.15.32:0/3577042990 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2280ae0b0 0x7fa228145040 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.943+0000 7fa22fe00640 1 --2- 172.21.15.32:0/3577042990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22806c460 0x7fa228156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.943+0000 7fa22fe00640 1 -- 172.21.15.32:0/3577042990 >> 172.21.15.32:0/3577042990 conn(0x7fa228071c50 msgr2=0x7fa2280b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.943+0000 7fa22fe00640 1 -- 172.21.15.32:0/3577042990 shutdown_connections 2024-03-19T06:23:25.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:25.943+0000 7fa22fe00640 1 -- 172.21.15.32:0/3577042990 wait complete. 2024-03-19T06:23:25.951 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:23:26.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.103+0000 7f96fa800640 1 Processor -- start 2024-03-19T06:23:26.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.103+0000 7f96fa800640 1 -- start start 2024-03-19T06:23:26.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96fa800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f96f415c010 0x7f96f415f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96fa800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f96f406d6c0 0x7f96f406daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96fa800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f415fe20 con 0x7f96f40aecf0 2024-03-19T06:23:26.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96fa800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f41603e0 con 0x7f96f406d6c0 2024-03-19T06:23:26.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96fa800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f406e030 con 0x7f96f415c010 2024-03-19T06:23:26.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96f3400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f96f40aecf0 0x7f96f40ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41556/0 (socket says 172.21.15.32:41556) 2024-03-19T06:23:26.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96f3400640 1 -- 172.21.15.32:0/2178034666 learned_addr learned my addr 172.21.15.32:0/2178034666 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:26.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96f3e00640 1 --2- 172.21.15.32:0/2178034666 >> v2:172.21.15.32:3300/0 conn(0x7f96f406d6c0 0x7f96f406daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96ebe00640 1 --2- 172.21.15.32:0/2178034666 >> v2:172.21.15.171:3300/0 conn(0x7f96f415c010 0x7f96f415f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96f2a00640 1 -- 172.21.15.32:0/2178034666 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482813855 0 0) 0x7f96f415fe20 con 0x7f96f40aecf0 2024-03-19T06:23:26.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96f2a00640 1 -- 172.21.15.32:0/2178034666 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96d8003530 con 0x7f96f40aecf0 2024-03-19T06:23:26.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96f3e00640 1 -- 172.21.15.32:0/2178034666 >> v2:172.21.15.171:3300/0 conn(0x7f96f415c010 msgr2=0x7f96f415f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:26.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96f3e00640 1 --2- 172.21.15.32:0/2178034666 >> v2:172.21.15.171:3300/0 conn(0x7f96f415c010 0x7f96f415f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96f3e00640 1 -- 172.21.15.32:0/2178034666 >> v1:172.21.15.32:6789/0 conn(0x7f96f40aecf0 legacy=0x7f96f40ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:26.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96f3e00640 1 -- 172.21.15.32:0/2178034666 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f4160100 con 0x7f96f406d6c0 2024-03-19T06:23:26.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96ebe00640 1 --2- 172.21.15.32:0/2178034666 >> v2:172.21.15.171:3300/0 conn(0x7f96f415c010 0x7f96f415f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:26.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.107+0000 7f96f3e00640 1 --2- 172.21.15.32:0/2178034666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f406d6c0 0x7f96f406daf0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f96f4068930 tx=0x7f96ec01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b60a9146077c1c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:26.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96f2a00640 1 -- 172.21.15.32:0/2178034666 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec0b2070 con 0x7f96f406d6c0 2024-03-19T06:23:26.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96f2a00640 1 -- 172.21.15.32:0/2178034666 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec0a5870 con 0x7f96f406d6c0 2024-03-19T06:23:26.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96f2a00640 1 -- 172.21.15.32:0/2178034666 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec0a5c40 con 0x7f96f406d6c0 2024-03-19T06:23:26.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96fa800640 1 -- 172.21.15.32:0/2178034666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f406d6c0 msgr2=0x7f96f406daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:26.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96fa800640 1 --2- 172.21.15.32:0/2178034666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f406d6c0 0x7f96f406daf0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f96f4068930 tx=0x7f96ec01c8a0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96fa800640 1 -- 172.21.15.32:0/2178034666 shutdown_connections 2024-03-19T06:23:26.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96fa800640 1 --2- 172.21.15.32:0/2178034666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f406d6c0 0x7f96f406daf0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96fa800640 1 --2- 172.21.15.32:0/2178034666 >> v2:172.21.15.171:3300/0 conn(0x7f96f415c010 0x7f96f415f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96fa800640 1 -- 172.21.15.32:0/2178034666 >> 172.21.15.32:0/2178034666 conn(0x7f96f40b1280 msgr2=0x7f96f40b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:26.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96fa800640 1 -- 172.21.15.32:0/2178034666 shutdown_connections 2024-03-19T06:23:26.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96fa800640 1 -- 172.21.15.32:0/2178034666 wait complete. 2024-03-19T06:23:26.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96fa800640 1 Processor -- start 2024-03-19T06:23:26.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96fa800640 1 -- start start 2024-03-19T06:23:26.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96fa800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f406d6c0 0x7f96f40ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96fa800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96f40aecf0 0x7f96f40ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96fa800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96f415c010 0x7f96f41573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96fa800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f40cbde0 con 0x7f96f406d6c0 2024-03-19T06:23:26.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96fa800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f40cbc60 con 0x7f96f40aecf0 2024-03-19T06:23:26.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96fa800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f4168690 con 0x7f96f415c010 2024-03-19T06:23:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96f3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f406d6c0 0x7f96f40ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96f3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f406d6c0 0x7f96f40ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40848/0 (socket says 172.21.15.32:40848) 2024-03-19T06:23:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.111+0000 7f96f3400640 1 -- 172.21.15.32:0/3857209786 learned_addr learned my addr 172.21.15.32:0/3857209786 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.115+0000 7f96f3400640 1 -- 172.21.15.32:0/3857209786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96f415c010 msgr2=0x7f96f41573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.115+0000 7f96f3400640 1 --2- 172.21.15.32:0/3857209786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96f415c010 0x7f96f41573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.115+0000 7f96f3400640 1 -- 172.21.15.32:0/3857209786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96f40aecf0 msgr2=0x7f96f40ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.115+0000 7f96f3400640 1 --2- 172.21.15.32:0/3857209786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96f40aecf0 0x7f96f40ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.115+0000 7f96f3400640 1 -- 172.21.15.32:0/3857209786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f4158180 con 0x7f96f406d6c0 2024-03-19T06:23:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.115+0000 7f96f3400640 1 --2- 172.21.15.32:0/3857209786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f406d6c0 0x7f96f40ce1d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f96e400c4b0 tx=0x7f96e400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.115+0000 7f96eb400640 1 -- 172.21.15.32:0/3857209786 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4017070 con 0x7f96f406d6c0 2024-03-19T06:23:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.115+0000 7f96eb400640 1 -- 172.21.15.32:0/3857209786 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e4005db0 con 0x7f96f406d6c0 2024-03-19T06:23:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.115+0000 7f96eb400640 1 -- 172.21.15.32:0/3857209786 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4007290 con 0x7f96f406d6c0 2024-03-19T06:23:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.115+0000 7f96fa800640 1 -- 172.21.15.32:0/3857209786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f4158460 con 0x7f96f406d6c0 2024-03-19T06:23:26.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.115+0000 7f96fa800640 1 -- 172.21.15.32:0/3857209786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f4158a20 con 0x7f96f406d6c0 2024-03-19T06:23:26.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.115+0000 7f96fa800640 1 -- 172.21.15.32:0/3857209786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f40749e0 con 0x7f96f406d6c0 2024-03-19T06:23:26.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.115+0000 7f96eb400640 1 -- 172.21.15.32:0/3857209786 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f96e401a070 con 0x7f96f406d6c0 2024-03-19T06:23:26.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.115+0000 7f96eb400640 1 --2- 172.21.15.32:0/3857209786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96d0067690 0x7f96d0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.115+0000 7f96eb400640 1 -- 172.21.15.32:0/3857209786 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96e4084d80 con 0x7f96f406d6c0 2024-03-19T06:23:26.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.115+0000 7f96ebe00640 1 --2- 172.21.15.32:0/3857209786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96d0067690 0x7f96d0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.119+0000 7f96ebe00640 1 --2- 172.21.15.32:0/3857209786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96d0067690 0x7f96d0069b50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f96dc006f10 tx=0x7f96dc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:26.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.119+0000 7f96eb400640 1 -- 172.21.15.32:0/3857209786 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f96e40558d0 con 0x7f96f406d6c0 2024-03-19T06:23:26.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.287+0000 7f96fa800640 1 -- 172.21.15.32:0/3857209786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96f4158c20 con 0x7f96f406d6c0 2024-03-19T06:23:26.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.287+0000 7f96eb400640 1 -- 172.21.15.32:0/3857209786 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16681 (secure 0 0 0) 0x7f96e40551d0 con 0x7f96f406d6c0 2024-03-19T06:23:26.275 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:26.276 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":51,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:23:23.544172+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:23:19.707249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-19T06:23:20.926932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:23:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.287+0000 7f96fa800640 1 -- 172.21.15.32:0/3857209786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96d0067690 msgr2=0x7f96d0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.287+0000 7f96fa800640 1 --2- 172.21.15.32:0/3857209786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96d0067690 0x7f96d0069b50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f96dc006f10 tx=0x7f96dc008040 comp rx=0 tx=0).stop 2024-03-19T06:23:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.287+0000 7f96fa800640 1 -- 172.21.15.32:0/3857209786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f406d6c0 msgr2=0x7f96f40ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.287+0000 7f96fa800640 1 --2- 172.21.15.32:0/3857209786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f406d6c0 0x7f96f40ce1d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f96e400c4b0 tx=0x7f96e400c970 comp rx=0 tx=0).stop 2024-03-19T06:23:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.291+0000 7f96fa800640 1 -- 172.21.15.32:0/3857209786 shutdown_connections 2024-03-19T06:23:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.291+0000 7f96fa800640 1 --2- 172.21.15.32:0/3857209786 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96d0067690 0x7f96d0069b50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.291+0000 7f96fa800640 1 --2- 172.21.15.32:0/3857209786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96f415c010 0x7f96f41573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.291+0000 7f96fa800640 1 --2- 172.21.15.32:0/3857209786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96f40aecf0 0x7f96f40ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.291+0000 7f96fa800640 1 --2- 172.21.15.32:0/3857209786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96f406d6c0 0x7f96f40ce1d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.291+0000 7f96fa800640 1 -- 172.21.15.32:0/3857209786 >> 172.21.15.32:0/3857209786 conn(0x7f96f40b1280 msgr2=0x7f96f40cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.291+0000 7f96fa800640 1 -- 172.21.15.32:0/3857209786 shutdown_connections 2024-03-19T06:23:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.291+0000 7f96fa800640 1 -- 172.21.15.32:0/3857209786 wait complete. 2024-03-19T06:23:26.297 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-19T06:23:26.298 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:23:26.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.451+0000 7f625f000640 1 Processor -- start 2024-03-19T06:23:26.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.451+0000 7f625f000640 1 -- start start 2024-03-19T06:23:26.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.451+0000 7f625f000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625815a980 0x7f625806e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.451+0000 7f625f000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f625806ea40 0x7f62580ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.451+0000 7f625f000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62580cc140 con 0x7f62580cf280 2024-03-19T06:23:26.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.451+0000 7f625f000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62580cf6e0 con 0x7f625806ea40 2024-03-19T06:23:26.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.451+0000 7f625f000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62580ce2f0 con 0x7f625815a980 2024-03-19T06:23:26.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.451+0000 7f6257400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f625806ea40 0x7f62580ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.451+0000 7f6257400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f625806ea40 0x7f62580ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40858/0 (socket says 172.21.15.32:40858) 2024-03-19T06:23:26.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.451+0000 7f6257400640 1 -- 172.21.15.32:0/1267825706 learned_addr learned my addr 172.21.15.32:0/1267825706 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:26.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.451+0000 7f6257e00640 1 --2- 172.21.15.32:0/1267825706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625815a980 0x7f625806e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.451+0000 7f6257400640 1 -- 172.21.15.32:0/1267825706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625815a980 msgr2=0x7f625806e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:26.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.451+0000 7f6257400640 1 --2- 172.21.15.32:0/1267825706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625815a980 0x7f625806e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.451+0000 7f6257400640 1 -- 172.21.15.32:0/1267825706 >> v1:172.21.15.171:6789/0 conn(0x7f62580cf280 legacy=0x7f62580cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:26.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.451+0000 7f6257400640 1 -- 172.21.15.32:0/1267825706 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62580cc420 con 0x7f625806ea40 2024-03-19T06:23:26.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.455+0000 7f6257400640 1 --2- 172.21.15.32:0/1267825706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f625806ea40 0x7f62580ced40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6244009870 tx=0x7f624401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c91dd6cc69b740 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:26.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.455+0000 7f6256a00640 1 -- 172.21.15.32:0/1267825706 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440b1070 con 0x7f625806ea40 2024-03-19T06:23:26.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.455+0000 7f6256a00640 1 -- 172.21.15.32:0/1267825706 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62440ac620 con 0x7f625806ea40 2024-03-19T06:23:26.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.455+0000 7f6256a00640 1 -- 172.21.15.32:0/1267825706 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440ac9f0 con 0x7f625806ea40 2024-03-19T06:23:26.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.455+0000 7f625f000640 1 -- 172.21.15.32:0/1267825706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f625806ea40 msgr2=0x7f62580ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:26.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.455+0000 7f625f000640 1 --2- 172.21.15.32:0/1267825706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f625806ea40 0x7f62580ced40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6244009870 tx=0x7f624401c4a0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.455+0000 7f625f000640 1 -- 172.21.15.32:0/1267825706 shutdown_connections 2024-03-19T06:23:26.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.455+0000 7f625f000640 1 --2- 172.21.15.32:0/1267825706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f625806ea40 0x7f62580ced40 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.455+0000 7f625f000640 1 --2- 172.21.15.32:0/1267825706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625815a980 0x7f625806e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.455+0000 7f625f000640 1 -- 172.21.15.32:0/1267825706 >> 172.21.15.32:0/1267825706 conn(0x7f62580b2250 msgr2=0x7f62580b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:26.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.455+0000 7f625f000640 1 -- 172.21.15.32:0/1267825706 shutdown_connections 2024-03-19T06:23:26.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.455+0000 7f625f000640 1 -- 172.21.15.32:0/1267825706 wait complete. 2024-03-19T06:23:26.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f625f000640 1 Processor -- start 2024-03-19T06:23:26.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f625f000640 1 -- start start 2024-03-19T06:23:26.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f625f000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625806ea40 0x7f62581592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f625f000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62580cf280 0x7f6258156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f625f000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f625815a980 0x7f62581573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f625f000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62580b30b0 con 0x7f62580cf280 2024-03-19T06:23:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f625f000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62580b2f30 con 0x7f625815a980 2024-03-19T06:23:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f625f000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62580cbcd0 con 0x7f625806ea40 2024-03-19T06:23:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f6257400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62580cf280 0x7f6258156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f6257400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62580cf280 0x7f6258156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40868/0 (socket says 172.21.15.32:40868) 2024-03-19T06:23:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f6257400640 1 -- 172.21.15.32:0/1675119319 learned_addr learned my addr 172.21.15.32:0/1675119319 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f6257e00640 1 --2- 172.21.15.32:0/1675119319 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625806ea40 0x7f62581592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f625d000640 1 --2- 172.21.15.32:0/1675119319 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f625815a980 0x7f62581573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f6257400640 1 -- 172.21.15.32:0/1675119319 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625806ea40 msgr2=0x7f62581592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f6257400640 1 --2- 172.21.15.32:0/1675119319 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625806ea40 0x7f62581592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f6257400640 1 -- 172.21.15.32:0/1675119319 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f625815a980 msgr2=0x7f62581573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f6257400640 1 --2- 172.21.15.32:0/1675119319 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f625815a980 0x7f62581573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f6257400640 1 -- 172.21.15.32:0/1675119319 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258157bc0 con 0x7f62580cf280 2024-03-19T06:23:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f6257e00640 1 --2- 172.21.15.32:0/1675119319 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625806ea40 0x7f62581592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f625d000640 1 --2- 172.21.15.32:0/1675119319 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f625815a980 0x7f62581573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f6257400640 1 --2- 172.21.15.32:0/1675119319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62580cf280 0x7f6258156e90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f62440af040 tx=0x7f6244019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f624fe00640 1 -- 172.21.15.32:0/1675119319 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440b1040 con 0x7f62580cf280 2024-03-19T06:23:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f624fe00640 1 -- 172.21.15.32:0/1675119319 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62440ac420 con 0x7f62580cf280 2024-03-19T06:23:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f624fe00640 1 -- 172.21.15.32:0/1675119319 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440b5680 con 0x7f62580cf280 2024-03-19T06:23:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f625f000640 1 -- 172.21.15.32:0/1675119319 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6258157ea0 con 0x7f62580cf280 2024-03-19T06:23:26.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f625f000640 1 -- 172.21.15.32:0/1675119319 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6258158460 con 0x7f62580cf280 2024-03-19T06:23:26.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.459+0000 7f625f000640 1 -- 172.21.15.32:0/1675119319 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6258158c40 con 0x7f62580cf280 2024-03-19T06:23:26.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.463+0000 7f624fe00640 1 -- 172.21.15.32:0/1675119319 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f62440bc020 con 0x7f62580cf280 2024-03-19T06:23:26.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.463+0000 7f624fe00640 1 --2- 172.21.15.32:0/1675119319 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6238067660 0x7f6238069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.463+0000 7f624fe00640 1 -- 172.21.15.32:0/1675119319 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f624411eea0 con 0x7f62580cf280 2024-03-19T06:23:26.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.463+0000 7f6257e00640 1 --2- 172.21.15.32:0/1675119319 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6238067660 0x7f6238069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.463+0000 7f6257e00640 1 --2- 172.21.15.32:0/1675119319 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6238067660 0x7f6238069b20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f624800b9f0 tx=0x7f6248008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:26.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.467+0000 7f624fe00640 1 -- 172.21.15.32:0/1675119319 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f6258158c40 con 0x7f62580cf280 2024-03-19T06:23:26.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.627+0000 7f625f000640 1 -- 172.21.15.32:0/1675119319 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f625814b160 con 0x7f6238067660 2024-03-19T06:23:26.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.635+0000 7f624fe00640 1 -- 172.21.15.32:0/1675119319 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243066 (secure 0 0 0) 0x7f625814b160 con 0x7f6238067660 2024-03-19T06:23:26.628 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:26.630 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:23:26.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.639+0000 7f625f000640 1 -- 172.21.15.32:0/1675119319 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6238067660 msgr2=0x7f6238069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:26.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.639+0000 7f625f000640 1 --2- 172.21.15.32:0/1675119319 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6238067660 0x7f6238069b20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f624800b9f0 tx=0x7f6248008040 comp rx=0 tx=0).stop 2024-03-19T06:23:26.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.639+0000 7f625f000640 1 -- 172.21.15.32:0/1675119319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62580cf280 msgr2=0x7f6258156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:26.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.639+0000 7f625f000640 1 --2- 172.21.15.32:0/1675119319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62580cf280 0x7f6258156e90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f62440af040 tx=0x7f6244019240 comp rx=0 tx=0).stop 2024-03-19T06:23:26.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.639+0000 7f625f000640 1 -- 172.21.15.32:0/1675119319 shutdown_connections 2024-03-19T06:23:26.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.639+0000 7f625f000640 1 --2- 172.21.15.32:0/1675119319 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6238067660 0x7f6238069b20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.639+0000 7f625f000640 1 --2- 172.21.15.32:0/1675119319 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f625815a980 0x7f62581573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.639+0000 7f625f000640 1 --2- 172.21.15.32:0/1675119319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62580cf280 0x7f6258156e90 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.639+0000 7f625f000640 1 --2- 172.21.15.32:0/1675119319 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625806ea40 0x7f62581592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.639+0000 7f625f000640 1 -- 172.21.15.32:0/1675119319 >> 172.21.15.32:0/1675119319 conn(0x7f62580b2250 msgr2=0x7f62580b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:26.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.639+0000 7f625f000640 1 -- 172.21.15.32:0/1675119319 shutdown_connections 2024-03-19T06:23:26.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.639+0000 7f625f000640 1 -- 172.21.15.32:0/1675119319 wait complete. 2024-03-19T06:23:26.646 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-03-19T06:23:25.952879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":177,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238432,"kb_used_data":5588,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736288,"statfs":{"total":773094113280,"available":772849958912,"internally_reserved":0,"allocated":5722112,"data_stored":3026360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.432084"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558640+0000","last_change":"2024-03-19T06:23:22.557767+0000","last_active":"2024-03-19T06:23:23.558640+0000","last_peered":"2024-03-19T06:23:23.558640+0000","last_clean":"2024-03-19T06:23:23.558640+0000","last_became_active":"2024-03-19T06:23:22.557450+0000","last_became_peered":"2024-03-19T06:23:22.557450+0000","last_unstale":"2024-03-19T06:23:23.558640+0000","last_undegraded":"2024-03-19T06:23:23.558640+0000","last_fullsized":"2024-03-19T06:23:23.558640+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:42:44.189385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552568+0000","last_change":"2024-03-19T06:23:22.553064+0000","last_active":"2024-03-19T06:23:23.552568+0000","last_peered":"2024-03-19T06:23:23.552568+0000","last_clean":"2024-03-19T06:23:23.552568+0000","last_became_active":"2024-03-19T06:23:22.552784+0000","last_became_peered":"2024-03-19T06:23:22.552784+0000","last_unstale":"2024-03-19T06:23:23.552568+0000","last_undegraded":"2024-03-19T06:23:23.552568+0000","last_fullsized":"2024-03-19T06:23:23.552568+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:28.771832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553240+0000","last_change":"2024-03-19T06:23:22.562187+0000","last_active":"2024-03-19T06:23:23.553240+0000","last_peered":"2024-03-19T06:23:23.553240+0000","last_clean":"2024-03-19T06:23:23.553240+0000","last_became_active":"2024-03-19T06:23:22.561713+0000","last_became_peered":"2024-03-19T06:23:22.561713+0000","last_unstale":"2024-03-19T06:23:23.553240+0000","last_undegraded":"2024-03-19T06:23:23.553240+0000","last_fullsized":"2024-03-19T06:23:23.553240+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:29:22.406290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553069+0000","last_change":"2024-03-19T06:23:22.556143+0000","last_active":"2024-03-19T06:23:23.553069+0000","last_peered":"2024-03-19T06:23:23.553069+0000","last_clean":"2024-03-19T06:23:23.553069+0000","last_became_active":"2024-03-19T06:23:22.555873+0000","last_became_peered":"2024-03-19T06:23:22.555873+0000","last_unstale":"2024-03-19T06:23:23.553069+0000","last_undegraded":"2024-03-19T06:23:23.553069+0000","last_fullsized":"2024-03-19T06:23:23.553069+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:37:24.117721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552509+0000","last_change":"2024-03-19T06:23:22.549825+0000","last_active":"2024-03-19T06:23:23.552509+0000","last_peered":"2024-03-19T06:23:23.552509+0000","last_clean":"2024-03-19T06:23:23.552509+0000","last_became_active":"2024-03-19T06:23:22.549560+0000","last_became_peered":"2024-03-19T06:23:22.549560+0000","last_unstale":"2024-03-19T06:23:23.552509+0000","last_undegraded":"2024-03-19T06:23:23.552509+0000","last_fullsized":"2024-03-19T06:23:23.552509+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:20:48.708717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552977+0000","last_change":"2024-03-19T06:23:22.558146+0000","last_active":"2024-03-19T06:23:23.552977+0000","last_peered":"2024-03-19T06:23:23.552977+0000","last_clean":"2024-03-19T06:23:23.552977+0000","last_became_active":"2024-03-19T06:23:22.557844+0000","last_became_peered":"2024-03-19T06:23:22.557844+0000","last_unstale":"2024-03-19T06:23:23.552977+0000","last_undegraded":"2024-03-19T06:23:23.552977+0000","last_fullsized":"2024-03-19T06:23:23.552977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:15.576529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.526404+0000","last_change":"2024-03-19T06:23:20.526404+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.526404+0000","last_undegraded":"2024-03-19T06:23:20.526404+0000","last_fullsized":"2024-03-19T06:23:20.526404+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.523945+0000","last_change":"2024-03-19T06:23:20.523945+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.523945+0000","last_undegraded":"2024-03-19T06:23:20.523945+0000","last_fullsized":"2024-03-19T06:23:20.523945+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.524015+0000","last_change":"2024-03-19T06:23:20.524015+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.524015+0000","last_undegraded":"2024-03-19T06:23:20.524015+0000","last_fullsized":"2024-03-19T06:23:20.524015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552538+0000","last_change":"2024-03-19T06:23:22.564698+0000","last_active":"2024-03-19T06:23:23.552538+0000","last_peered":"2024-03-19T06:23:23.552538+0000","last_clean":"2024-03-19T06:23:23.552538+0000","last_became_active":"2024-03-19T06:23:22.564416+0000","last_became_peered":"2024-03-19T06:23:22.564416+0000","last_unstale":"2024-03-19T06:23:23.552538+0000","last_undegraded":"2024-03-19T06:23:23.552538+0000","last_fullsized":"2024-03-19T06:23:23.552538+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:33:17.743019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.522797+0000","last_change":"2024-03-19T06:23:20.522797+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.522797+0000","last_undegraded":"2024-03-19T06:23:20.522797+0000","last_fullsized":"2024-03-19T06:23:20.522797+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558898+0000","last_change":"2024-03-19T06:23:22.551285+0000","last_active":"2024-03-19T06:23:23.558898+0000","last_peered":"2024-03-19T06:23:23.558898+0000","last_clean":"2024-03-19T06:23:23.558898+0000","last_became_active":"2024-03-19T06:23:22.550894+0000","last_became_peered":"2024-03-19T06:23:22.550894+0000","last_unstale":"2024-03-19T06:23:23.558898+0000","last_undegraded":"2024-03-19T06:23:23.558898+0000","last_fullsized":"2024-03-19T06:23:23.558898+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:43:42.939501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.528173+0000","last_change":"2024-03-19T06:23:20.528173+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.528173+0000","last_undegraded":"2024-03-19T06:23:20.528173+0000","last_fullsized":"2024-03-19T06:23:20.528173+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558599+0000","last_change":"2024-03-19T06:23:21.539687+0000","last_active":"2024-03-19T06:23:23.558599+0000","last_peered":"2024-03-19T06:23:23.558599+0000","last_clean":"2024-03-19T06:23:23.558599+0000","last_became_active":"2024-03-19T06:23:21.539397+0000","last_became_peered":"2024-03-19T06:23:21.539397+0000","last_unstale":"2024-03-19T06:23:23.558599+0000","last_undegraded":"2024-03-19T06:23:23.558599+0000","last_fullsized":"2024-03-19T06:23:23.558599+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:49:51.133678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553125+0000","last_change":"2024-03-19T06:23:22.554006+0000","last_active":"2024-03-19T06:23:23.553125+0000","last_peered":"2024-03-19T06:23:23.553125+0000","last_clean":"2024-03-19T06:23:23.553125+0000","last_became_active":"2024-03-19T06:23:22.553707+0000","last_became_peered":"2024-03-19T06:23:22.553707+0000","last_unstale":"2024-03-19T06:23:23.553125+0000","last_undegraded":"2024-03-19T06:23:23.553125+0000","last_fullsized":"2024-03-19T06:23:23.553125+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:44:11.818406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.525431+0000","last_change":"2024-03-19T06:23:20.525431+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.525431+0000","last_undegraded":"2024-03-19T06:23:20.525431+0000","last_fullsized":"2024-03-19T06:23:20.525431+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.527374+0000","last_change":"2024-03-19T06:23:20.527374+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.527374+0000","last_undegraded":"2024-03-19T06:23:20.527374+0000","last_fullsized":"2024-03-19T06:23:20.527374+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558592+0000","last_change":"2024-03-19T06:23:22.551029+0000","last_active":"2024-03-19T06:23:23.558592+0000","last_peered":"2024-03-19T06:23:23.558592+0000","last_clean":"2024-03-19T06:23:23.558592+0000","last_became_active":"2024-03-19T06:23:22.550646+0000","last_became_peered":"2024-03-19T06:23:22.550646+0000","last_unstale":"2024-03-19T06:23:23.558592+0000","last_undegraded":"2024-03-19T06:23:23.558592+0000","last_fullsized":"2024-03-19T06:23:23.558592+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:01.579117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.523107+0000","last_change":"2024-03-19T06:23:20.523107+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.523107+0000","last_undegraded":"2024-03-19T06:23:20.523107+0000","last_fullsized":"2024-03-19T06:23:20.523107+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558908+0000","last_change":"2024-03-19T06:23:21.542594+0000","last_active":"2024-03-19T06:23:23.558908+0000","last_peered":"2024-03-19T06:23:23.558908+0000","last_clean":"2024-03-19T06:23:23.558908+0000","last_became_active":"2024-03-19T06:23:21.542322+0000","last_became_peered":"2024-03-19T06:23:21.542322+0000","last_unstale":"2024-03-19T06:23:23.558908+0000","last_undegraded":"2024-03-19T06:23:23.558908+0000","last_fullsized":"2024-03-19T06:23:23.558908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:19:51.590050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.523411+0000","last_change":"2024-03-19T06:23:20.523411+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.523411+0000","last_undegraded":"2024-03-19T06:23:20.523411+0000","last_fullsized":"2024-03-19T06:23:20.523411+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558784+0000","last_change":"2024-03-19T06:23:22.553289+0000","last_active":"2024-03-19T06:23:23.558784+0000","last_peered":"2024-03-19T06:23:23.558784+0000","last_clean":"2024-03-19T06:23:23.558784+0000","last_became_active":"2024-03-19T06:23:22.551860+0000","last_became_peered":"2024-03-19T06:23:22.551860+0000","last_unstale":"2024-03-19T06:23:23.558784+0000","last_undegraded":"2024-03-19T06:23:23.558784+0000","last_fullsized":"2024-03-19T06:23:23.558784+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:37:05.107267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553331+0000","last_change":"2024-03-19T06:23:21.548326+0000","last_active":"2024-03-19T06:23:23.553331+0000","last_peered":"2024-03-19T06:23:23.553331+0000","last_clean":"2024-03-19T06:23:23.553331+0000","last_became_active":"2024-03-19T06:23:21.548092+0000","last_became_peered":"2024-03-19T06:23:21.548092+0000","last_unstale":"2024-03-19T06:23:23.553331+0000","last_undegraded":"2024-03-19T06:23:23.553331+0000","last_fullsized":"2024-03-19T06:23:23.553331+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:45:56.923983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.527597+0000","last_change":"2024-03-19T06:23:20.527597+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.527597+0000","last_undegraded":"2024-03-19T06:23:20.527597+0000","last_fullsized":"2024-03-19T06:23:20.527597+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.525560+0000","last_change":"2024-03-19T06:23:20.525560+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.525560+0000","last_undegraded":"2024-03-19T06:23:20.525560+0000","last_fullsized":"2024-03-19T06:23:20.525560+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553003+0000","last_change":"2024-03-19T06:23:22.566485+0000","last_active":"2024-03-19T06:23:23.553003+0000","last_peered":"2024-03-19T06:23:23.553003+0000","last_clean":"2024-03-19T06:23:23.553003+0000","last_became_active":"2024-03-19T06:23:22.566083+0000","last_became_peered":"2024-03-19T06:23:22.566083+0000","last_unstale":"2024-03-19T06:23:23.553003+0000","last_undegraded":"2024-03-19T06:23:23.553003+0000","last_fullsized":"2024-03-19T06:23:23.553003+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:50.195310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.522810+0000","last_change":"2024-03-19T06:23:20.522810+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.522810+0000","last_undegraded":"2024-03-19T06:23:20.522810+0000","last_fullsized":"2024-03-19T06:23:20.522810+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552649+0000","last_change":"2024-03-19T06:23:21.549680+0000","last_active":"2024-03-19T06:23:23.552649+0000","last_peered":"2024-03-19T06:23:23.552649+0000","last_clean":"2024-03-19T06:23:23.552649+0000","last_became_active":"2024-03-19T06:23:21.549473+0000","last_became_peered":"2024-03-19T06:23:21.549473+0000","last_unstale":"2024-03-19T06:23:23.552649+0000","last_undegraded":"2024-03-19T06:23:23.552649+0000","last_fullsized":"2024-03-19T06:23:23.552649+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:53:59.801574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552575+0000","last_change":"2024-03-19T06:23:22.556479+0000","last_active":"2024-03-19T06:23:23.552575+0000","last_peered":"2024-03-19T06:23:23.552575+0000","last_clean":"2024-03-19T06:23:23.552575+0000","last_became_active":"2024-03-19T06:23:22.555831+0000","last_became_peered":"2024-03-19T06:23:22.555831+0000","last_unstale":"2024-03-19T06:23:23.552575+0000","last_undegraded":"2024-03-19T06:23:23.552575+0000","last_fullsized":"2024-03-19T06:23:23.552575+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:01:31.985264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.528087+0000","last_change":"2024-03-19T06:23:20.528087+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.528087+0000","last_undegraded":"2024-03-19T06:23:20.528087+0000","last_fullsized":"2024-03-19T06:23:20.528087+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.523919+0000","last_change":"2024-03-19T06:23:20.523919+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.523919+0000","last_undegraded":"2024-03-19T06:23:20.523919+0000","last_fullsized":"2024-03-19T06:23:20.523919+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558571+0000","last_change":"2024-03-19T06:23:22.554856+0000","last_active":"2024-03-19T06:23:23.558571+0000","last_peered":"2024-03-19T06:23:23.558571+0000","last_clean":"2024-03-19T06:23:23.558571+0000","last_became_active":"2024-03-19T06:23:22.551031+0000","last_became_peered":"2024-03-19T06:23:22.551031+0000","last_unstale":"2024-03-19T06:23:23.558571+0000","last_undegraded":"2024-03-19T06:23:23.558571+0000","last_fullsized":"2024-03-19T06:23:23.558571+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:23:14.309187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.525567+0000","last_change":"2024-03-19T06:23:20.525567+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.525567+0000","last_undegraded":"2024-03-19T06:23:20.525567+0000","last_fullsized":"2024-03-19T06:23:20.525567+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.525624+0000","last_change":"2024-03-19T06:23:20.525624+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.525624+0000","last_undegraded":"2024-03-19T06:23:20.525624+0000","last_fullsized":"2024-03-19T06:23:20.525624+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.524225+0000","last_change":"2024-03-19T06:23:20.524225+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.524225+0000","last_undegraded":"2024-03-19T06:23:20.524225+0000","last_fullsized":"2024-03-19T06:23:20.524225+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552481+0000","last_change":"2024-03-19T06:23:21.549897+0000","last_active":"2024-03-19T06:23:23.552481+0000","last_peered":"2024-03-19T06:23:23.552481+0000","last_clean":"2024-03-19T06:23:23.552481+0000","last_became_active":"2024-03-19T06:23:21.549123+0000","last_became_peered":"2024-03-19T06:23:21.549123+0000","last_unstale":"2024-03-19T06:23:23.552481+0000","last_undegraded":"2024-03-19T06:23:23.552481+0000","last_fullsized":"2024-03-19T06:23:23.552481+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:47:05.968667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.527545+0000","last_change":"2024-03-19T06:23:20.527545+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.527545+0000","last_undegraded":"2024-03-19T06:23:20.527545+0000","last_fullsized":"2024-03-19T06:23:20.527545+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.524063+0000","last_change":"2024-03-19T06:23:20.524063+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.524063+0000","last_undegraded":"2024-03-19T06:23:20.524063+0000","last_fullsized":"2024-03-19T06:23:20.524063+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.525492+0000","last_change":"2024-03-19T06:23:20.525492+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.525492+0000","last_undegraded":"2024-03-19T06:23:20.525492+0000","last_fullsized":"2024-03-19T06:23:20.525492+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.522805+0000","last_change":"2024-03-19T06:23:20.522805+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.522805+0000","last_undegraded":"2024-03-19T06:23:20.522805+0000","last_fullsized":"2024-03-19T06:23:20.522805+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552778+0000","last_change":"2024-03-19T06:23:22.556772+0000","last_active":"2024-03-19T06:23:23.552778+0000","last_peered":"2024-03-19T06:23:23.552778+0000","last_clean":"2024-03-19T06:23:23.552778+0000","last_became_active":"2024-03-19T06:23:22.556355+0000","last_became_peered":"2024-03-19T06:23:22.556355+0000","last_unstale":"2024-03-19T06:23:23.552778+0000","last_undegraded":"2024-03-19T06:23:23.552778+0000","last_fullsized":"2024-03-19T06:23:23.552778+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:52:40.416402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.527396+0000","last_change":"2024-03-19T06:23:20.527396+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.527396+0000","last_undegraded":"2024-03-19T06:23:20.527396+0000","last_fullsized":"2024-03-19T06:23:20.527396+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552726+0000","last_change":"2024-03-19T06:23:21.547044+0000","last_active":"2024-03-19T06:23:23.552726+0000","last_peered":"2024-03-19T06:23:23.552726+0000","last_clean":"2024-03-19T06:23:23.552726+0000","last_became_active":"2024-03-19T06:23:21.546743+0000","last_became_peered":"2024-03-19T06:23:21.546743+0000","last_unstale":"2024-03-19T06:23:23.552726+0000","last_undegraded":"2024-03-19T06:23:23.552726+0000","last_fullsized":"2024-03-19T06:23:23.552726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:22:22.051267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552571+0000","last_change":"2024-03-19T06:23:21.551791+0000","last_active":"2024-03-19T06:23:23.552571+0000","last_peered":"2024-03-19T06:23:23.552571+0000","last_clean":"2024-03-19T06:23:23.552571+0000","last_became_active":"2024-03-19T06:23:21.551224+0000","last_became_peered":"2024-03-19T06:23:21.551224+0000","last_unstale":"2024-03-19T06:23:23.552571+0000","last_undegraded":"2024-03-19T06:23:23.552571+0000","last_fullsized":"2024-03-19T06:23:23.552571+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:39.583966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558470+0000","last_change":"2024-03-19T06:23:21.543770+0000","last_active":"2024-03-19T06:23:23.558470+0000","last_peered":"2024-03-19T06:23:23.558470+0000","last_clean":"2024-03-19T06:23:23.558470+0000","last_became_active":"2024-03-19T06:23:21.543273+0000","last_became_peered":"2024-03-19T06:23:21.543273+0000","last_unstale":"2024-03-19T06:23:23.558470+0000","last_undegraded":"2024-03-19T06:23:23.558470+0000","last_fullsized":"2024-03-19T06:23:23.558470+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:46.322795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553275+0000","last_change":"2024-03-19T06:23:22.567278+0000","last_active":"2024-03-19T06:23:23.553275+0000","last_peered":"2024-03-19T06:23:23.553275+0000","last_clean":"2024-03-19T06:23:23.553275+0000","last_became_active":"2024-03-19T06:23:22.566993+0000","last_became_peered":"2024-03-19T06:23:22.566993+0000","last_unstale":"2024-03-19T06:23:23.553275+0000","last_undegraded":"2024-03-19T06:23:23.553275+0000","last_fullsized":"2024-03-19T06:23:23.553275+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:30:58.300360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.522810+0000","last_change":"2024-03-19T06:23:20.522810+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.522810+0000","last_undegraded":"2024-03-19T06:23:20.522810+0000","last_fullsized":"2024-03-19T06:23:20.522810+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.528152+0000","last_change":"2024-03-19T06:23:20.528152+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.528152+0000","last_undegraded":"2024-03-19T06:23:20.528152+0000","last_fullsized":"2024-03-19T06:23:20.528152+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":217,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-19T06:23:20.524007+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:23:20.524007+0000","last_peered":"2024-03-19T06:23:20.524007+0000","last_clean":"2024-03-19T06:23:20.524007+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:23:20.524007+0000","last_undegraded":"2024-03-19T06:23:20.524007+0000","last_fullsized":"2024-03-19T06:23:20.524007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1155072,"data_stored":818865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":222680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":548864,"data_stored":222680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":548864,"data_stored":222680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":548864,"data_stored":222680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1155072,"data_stored":818865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":602112,"data_stored":248429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":614400,"data_stored":249481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:23:26.650 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:23:26.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe722400640 1 Processor -- start 2024-03-19T06:23:26.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe722400640 1 -- start start 2024-03-19T06:23:26.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe722400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe71c161270 0x7fe71c0ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe722400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe71c0cfa70 0x7fe71c0cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe722400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71c06ad40 con 0x7fe71c0cb2d0 2024-03-19T06:23:26.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe722400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71c06b020 con 0x7fe71c161270 2024-03-19T06:23:26.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe722400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c06b300 con 0x7fe71c0cfa70 2024-03-19T06:23:26.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71be00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe71c0cb2d0 0x7fe71c0cb760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41572/0 (socket says 172.21.15.32:41572) 2024-03-19T06:23:26.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71be00640 1 -- 172.21.15.32:0/746209324 learned_addr learned my addr 172.21.15.32:0/746209324 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:26.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71b400640 1 --2- 172.21.15.32:0/746209324 >> v2:172.21.15.171:3300/0 conn(0x7fe71c161270 0x7fe71c0ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe713e00640 1 --2- 172.21.15.32:0/746209324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe71c0cfa70 0x7fe71c0cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71aa00640 1 -- 172.21.15.32:0/746209324 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074070009 0 0) 0x7fe71c06ad40 con 0x7fe71c0cb2d0 2024-03-19T06:23:26.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71aa00640 1 -- 172.21.15.32:0/746209324 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe700003530 con 0x7fe71c0cb2d0 2024-03-19T06:23:26.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71aa00640 1 -- 172.21.15.32:0/746209324 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4215447044 0 0) 0x7fe700003530 con 0x7fe71c0cb2d0 2024-03-19T06:23:26.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71aa00640 1 -- 172.21.15.32:0/746209324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe71c0cfa70 msgr2=0x7fe71c0cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:26.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71aa00640 1 --2- 172.21.15.32:0/746209324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe71c0cfa70 0x7fe71c0cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71aa00640 1 -- 172.21.15.32:0/746209324 >> v2:172.21.15.171:3300/0 conn(0x7fe71c161270 msgr2=0x7fe71c0ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:26.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71aa00640 1 --2- 172.21.15.32:0/746209324 >> v2:172.21.15.171:3300/0 conn(0x7fe71c161270 0x7fe71c0ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71aa00640 1 -- 172.21.15.32:0/746209324 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c06b5e0 con 0x7fe71c0cb2d0 2024-03-19T06:23:26.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71aa00640 1 -- 172.21.15.32:0/746209324 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fe714001a00 con 0x7fe71c0cb2d0 2024-03-19T06:23:26.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71aa00640 1 -- 172.21.15.32:0/746209324 >> v1:172.21.15.32:6789/0 conn(0x7fe71c0cb2d0 legacy=0x7fe71c0cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:26.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71aa00640 1 --2- 172.21.15.32:0/746209324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe71c0cfa70 0x7fe7000039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71aa00640 1 --2- 172.21.15.32:0/746209324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe700003f90 0x7fe700004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71aa00640 1 --2- 172.21.15.32:0/746209324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe700004d50 0x7fe7000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71aa00640 1 -- 172.21.15.32:0/746209324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c06b020 con 0x7fe700004d50 2024-03-19T06:23:26.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71aa00640 1 -- 172.21.15.32:0/746209324 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c06b300 con 0x7fe700003f90 2024-03-19T06:23:26.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71aa00640 1 -- 172.21.15.32:0/746209324 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70000b9d0 con 0x7fe71c0cfa70 2024-03-19T06:23:26.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71be00640 1 --2- 172.21.15.32:0/746209324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe700004d50 0x7fe7000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe713e00640 1 --2- 172.21.15.32:0/746209324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe700003f90 0x7fe700004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71b400640 1 --2- 172.21.15.32:0/746209324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe71c0cfa70 0x7fe7000039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71be00640 1 -- 172.21.15.32:0/746209324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe71c0cfa70 msgr2=0x7fe7000039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:26.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71be00640 1 --2- 172.21.15.32:0/746209324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe71c0cfa70 0x7fe7000039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71be00640 1 -- 172.21.15.32:0/746209324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe700003f90 msgr2=0x7fe700004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:26.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.847+0000 7fe71be00640 1 --2- 172.21.15.32:0/746209324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe700003f90 0x7fe700004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.851+0000 7fe71be00640 1 -- 172.21.15.32:0/746209324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe700003530 con 0x7fe700004d50 2024-03-19T06:23:26.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.851+0000 7fe71be00640 1 --2- 172.21.15.32:0/746209324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe700004d50 0x7fe7000051d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe71400a7e0 tx=0x7fe71401d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed1eeabd5d162fc server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:26.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.851+0000 7fe71aa00640 1 -- 172.21.15.32:0/746209324 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71400a3d0 con 0x7fe700004d50 2024-03-19T06:23:26.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.851+0000 7fe71aa00640 1 -- 172.21.15.32:0/746209324 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7140ad650 con 0x7fe700004d50 2024-03-19T06:23:26.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.851+0000 7fe71aa00640 1 -- 172.21.15.32:0/746209324 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7140ada80 con 0x7fe700004d50 2024-03-19T06:23:26.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.851+0000 7fe722400640 1 -- 172.21.15.32:0/746209324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe700004d50 msgr2=0x7fe7000051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:26.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.851+0000 7fe722400640 1 --2- 172.21.15.32:0/746209324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe700004d50 0x7fe7000051d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe71400a7e0 tx=0x7fe71401d2c0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.851+0000 7fe71be00640 1 -- 172.21.15.32:0/746209324 reap_dead start 2024-03-19T06:23:26.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.851+0000 7fe722400640 1 -- 172.21.15.32:0/746209324 shutdown_connections 2024-03-19T06:23:26.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.851+0000 7fe722400640 1 -- 172.21.15.32:0/746209324 >> 172.21.15.32:0/746209324 conn(0x7fe71c0b2250 msgr2=0x7fe71c0b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:26.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.851+0000 7fe722400640 1 -- 172.21.15.32:0/746209324 shutdown_connections 2024-03-19T06:23:26.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.851+0000 7fe722400640 1 -- 172.21.15.32:0/746209324 wait complete. 2024-03-19T06:23:26.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe722400640 1 Processor -- start 2024-03-19T06:23:26.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe722400640 1 -- start start 2024-03-19T06:23:26.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe722400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe700004d50 0x7fe71c0c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe722400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe71c0c71f0 0x7fe71c0c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe722400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe71c0c4730 0x7fe71c14a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe722400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0cd960 con 0x7fe71c0c71f0 2024-03-19T06:23:26.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe722400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0cadb0 con 0x7fe71c0c4730 2024-03-19T06:23:26.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe722400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0cdae0 con 0x7fe700004d50 2024-03-19T06:23:26.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe713e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe71c0c71f0 0x7fe71c0c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe713e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe71c0c71f0 0x7fe71c0c41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40876/0 (socket says 172.21.15.32:40876) 2024-03-19T06:23:26.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe713e00640 1 -- 172.21.15.32:0/2903136139 learned_addr learned my addr 172.21.15.32:0/2903136139 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:26.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe71be00640 1 --2- 172.21.15.32:0/2903136139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe71c0c4730 0x7fe71c14a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe71b400640 1 --2- 172.21.15.32:0/2903136139 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe700004d50 0x7fe71c0c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe713e00640 1 -- 172.21.15.32:0/2903136139 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe700004d50 msgr2=0x7fe71c0c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:26.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe713e00640 1 --2- 172.21.15.32:0/2903136139 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe700004d50 0x7fe71c0c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe713e00640 1 -- 172.21.15.32:0/2903136139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe71c0c4730 msgr2=0x7fe71c14a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:26.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe713e00640 1 --2- 172.21.15.32:0/2903136139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe71c0c4730 0x7fe71c14a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:26.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe713e00640 1 -- 172.21.15.32:0/2903136139 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c14b4e0 con 0x7fe71c0c71f0 2024-03-19T06:23:26.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe71be00640 1 --2- 172.21.15.32:0/2903136139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe71c0c4730 0x7fe71c14a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:26.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe71b400640 1 --2- 172.21.15.32:0/2903136139 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe700004d50 0x7fe71c0c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:26.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe713e00640 1 --2- 172.21.15.32:0/2903136139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe71c0c71f0 0x7fe71c0c41f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe704011a00 tx=0x7fe704011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:26.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe713400640 1 -- 172.21.15.32:0/2903136139 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70400fb50 con 0x7fe71c0c71f0 2024-03-19T06:23:26.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe713400640 1 -- 172.21.15.32:0/2903136139 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70400fcf0 con 0x7fe71c0c71f0 2024-03-19T06:23:26.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe713400640 1 -- 172.21.15.32:0/2903136139 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70400fea0 con 0x7fe71c0c71f0 2024-03-19T06:23:26.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe722400640 1 -- 172.21.15.32:0/2903136139 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71c0c6430 con 0x7fe71c0c71f0 2024-03-19T06:23:26.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.855+0000 7fe722400640 1 -- 172.21.15.32:0/2903136139 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71c0c69f0 con 0x7fe71c0c71f0 2024-03-19T06:23:26.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.859+0000 7fe722400640 1 -- 172.21.15.32:0/2903136139 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71c0c4b40 con 0x7fe71c0c71f0 2024-03-19T06:23:26.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.859+0000 7fe713400640 1 -- 172.21.15.32:0/2903136139 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe704012040 con 0x7fe71c0c71f0 2024-03-19T06:23:26.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.859+0000 7fe713400640 1 --2- 172.21.15.32:0/2903136139 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe6f8067690 0x7fe6f8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:26.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.859+0000 7fe713400640 1 -- 172.21.15.32:0/2903136139 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe704085f50 con 0x7fe71c0c71f0 2024-03-19T06:23:26.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.859+0000 7fe71b400640 1 --2- 172.21.15.32:0/2903136139 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe6f8067690 0x7fe6f8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:26.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.859+0000 7fe71b400640 1 --2- 172.21.15.32:0/2903136139 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe6f8067690 0x7fe6f8069b50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0d08a0 tx=0x7fe70c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:26.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:26.863+0000 7fe713400640 1 -- 172.21.15.32:0/2903136139 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fe71c0c4b40 con 0x7fe71c0c71f0 2024-03-19T06:23:27.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.023+0000 7fe722400640 1 -- 172.21.15.32:0/2903136139 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe71c0749e0 con 0x7fe6f8067690 2024-03-19T06:23:27.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.031+0000 7fe713400640 1 -- 172.21.15.32:0/2903136139 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243066 (secure 0 0 0) 0x7fe71c0749e0 con 0x7fe6f8067690 2024-03-19T06:23:27.021 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:27.022 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:23:27.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.035+0000 7fe722400640 1 -- 172.21.15.32:0/2903136139 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe6f8067690 msgr2=0x7fe6f8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:27.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.035+0000 7fe722400640 1 --2- 172.21.15.32:0/2903136139 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe6f8067690 0x7fe6f8069b50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0d08a0 tx=0x7fe70c008040 comp rx=0 tx=0).stop 2024-03-19T06:23:27.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.035+0000 7fe722400640 1 -- 172.21.15.32:0/2903136139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe71c0c71f0 msgr2=0x7fe71c0c41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:27.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.035+0000 7fe722400640 1 --2- 172.21.15.32:0/2903136139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe71c0c71f0 0x7fe71c0c41f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe704011a00 tx=0x7fe704011ec0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.035+0000 7fe722400640 1 -- 172.21.15.32:0/2903136139 shutdown_connections 2024-03-19T06:23:27.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.035+0000 7fe722400640 1 --2- 172.21.15.32:0/2903136139 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe6f8067690 0x7fe6f8069b50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.035+0000 7fe722400640 1 --2- 172.21.15.32:0/2903136139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe71c0c4730 0x7fe71c14a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.035+0000 7fe722400640 1 --2- 172.21.15.32:0/2903136139 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe71c0c71f0 0x7fe71c0c41f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.035+0000 7fe722400640 1 --2- 172.21.15.32:0/2903136139 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe700004d50 0x7fe71c0c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.035+0000 7fe722400640 1 -- 172.21.15.32:0/2903136139 >> 172.21.15.32:0/2903136139 conn(0x7fe71c0b2250 msgr2=0x7fe71c0cfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:27.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.035+0000 7fe722400640 1 -- 172.21.15.32:0/2903136139 shutdown_connections 2024-03-19T06:23:27.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.035+0000 7fe722400640 1 -- 172.21.15.32:0/2903136139 wait complete. 2024-03-19T06:23:27.041 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-03-19T06:23:25.952879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":177,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238432,"kb_used_data":5588,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736288,"statfs":{"total":773094113280,"available":772849958912,"internally_reserved":0,"allocated":5722112,"data_stored":3026360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.432084"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558640+0000","last_change":"2024-03-19T06:23:22.557767+0000","last_active":"2024-03-19T06:23:23.558640+0000","last_peered":"2024-03-19T06:23:23.558640+0000","last_clean":"2024-03-19T06:23:23.558640+0000","last_became_active":"2024-03-19T06:23:22.557450+0000","last_became_peered":"2024-03-19T06:23:22.557450+0000","last_unstale":"2024-03-19T06:23:23.558640+0000","last_undegraded":"2024-03-19T06:23:23.558640+0000","last_fullsized":"2024-03-19T06:23:23.558640+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:42:44.189385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552568+0000","last_change":"2024-03-19T06:23:22.553064+0000","last_active":"2024-03-19T06:23:23.552568+0000","last_peered":"2024-03-19T06:23:23.552568+0000","last_clean":"2024-03-19T06:23:23.552568+0000","last_became_active":"2024-03-19T06:23:22.552784+0000","last_became_peered":"2024-03-19T06:23:22.552784+0000","last_unstale":"2024-03-19T06:23:23.552568+0000","last_undegraded":"2024-03-19T06:23:23.552568+0000","last_fullsized":"2024-03-19T06:23:23.552568+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:28.771832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553240+0000","last_change":"2024-03-19T06:23:22.562187+0000","last_active":"2024-03-19T06:23:23.553240+0000","last_peered":"2024-03-19T06:23:23.553240+0000","last_clean":"2024-03-19T06:23:23.553240+0000","last_became_active":"2024-03-19T06:23:22.561713+0000","last_became_peered":"2024-03-19T06:23:22.561713+0000","last_unstale":"2024-03-19T06:23:23.553240+0000","last_undegraded":"2024-03-19T06:23:23.553240+0000","last_fullsized":"2024-03-19T06:23:23.553240+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:29:22.406290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553069+0000","last_change":"2024-03-19T06:23:22.556143+0000","last_active":"2024-03-19T06:23:23.553069+0000","last_peered":"2024-03-19T06:23:23.553069+0000","last_clean":"2024-03-19T06:23:23.553069+0000","last_became_active":"2024-03-19T06:23:22.555873+0000","last_became_peered":"2024-03-19T06:23:22.555873+0000","last_unstale":"2024-03-19T06:23:23.553069+0000","last_undegraded":"2024-03-19T06:23:23.553069+0000","last_fullsized":"2024-03-19T06:23:23.553069+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:37:24.117721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552509+0000","last_change":"2024-03-19T06:23:22.549825+0000","last_active":"2024-03-19T06:23:23.552509+0000","last_peered":"2024-03-19T06:23:23.552509+0000","last_clean":"2024-03-19T06:23:23.552509+0000","last_became_active":"2024-03-19T06:23:22.549560+0000","last_became_peered":"2024-03-19T06:23:22.549560+0000","last_unstale":"2024-03-19T06:23:23.552509+0000","last_undegraded":"2024-03-19T06:23:23.552509+0000","last_fullsized":"2024-03-19T06:23:23.552509+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:20:48.708717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552977+0000","last_change":"2024-03-19T06:23:22.558146+0000","last_active":"2024-03-19T06:23:23.552977+0000","last_peered":"2024-03-19T06:23:23.552977+0000","last_clean":"2024-03-19T06:23:23.552977+0000","last_became_active":"2024-03-19T06:23:22.557844+0000","last_became_peered":"2024-03-19T06:23:22.557844+0000","last_unstale":"2024-03-19T06:23:23.552977+0000","last_undegraded":"2024-03-19T06:23:23.552977+0000","last_fullsized":"2024-03-19T06:23:23.552977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:15.576529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.526404+0000","last_change":"2024-03-19T06:23:20.526404+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.526404+0000","last_undegraded":"2024-03-19T06:23:20.526404+0000","last_fullsized":"2024-03-19T06:23:20.526404+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.523945+0000","last_change":"2024-03-19T06:23:20.523945+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.523945+0000","last_undegraded":"2024-03-19T06:23:20.523945+0000","last_fullsized":"2024-03-19T06:23:20.523945+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.524015+0000","last_change":"2024-03-19T06:23:20.524015+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.524015+0000","last_undegraded":"2024-03-19T06:23:20.524015+0000","last_fullsized":"2024-03-19T06:23:20.524015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552538+0000","last_change":"2024-03-19T06:23:22.564698+0000","last_active":"2024-03-19T06:23:23.552538+0000","last_peered":"2024-03-19T06:23:23.552538+0000","last_clean":"2024-03-19T06:23:23.552538+0000","last_became_active":"2024-03-19T06:23:22.564416+0000","last_became_peered":"2024-03-19T06:23:22.564416+0000","last_unstale":"2024-03-19T06:23:23.552538+0000","last_undegraded":"2024-03-19T06:23:23.552538+0000","last_fullsized":"2024-03-19T06:23:23.552538+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:33:17.743019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.522797+0000","last_change":"2024-03-19T06:23:20.522797+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.522797+0000","last_undegraded":"2024-03-19T06:23:20.522797+0000","last_fullsized":"2024-03-19T06:23:20.522797+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558898+0000","last_change":"2024-03-19T06:23:22.551285+0000","last_active":"2024-03-19T06:23:23.558898+0000","last_peered":"2024-03-19T06:23:23.558898+0000","last_clean":"2024-03-19T06:23:23.558898+0000","last_became_active":"2024-03-19T06:23:22.550894+0000","last_became_peered":"2024-03-19T06:23:22.550894+0000","last_unstale":"2024-03-19T06:23:23.558898+0000","last_undegraded":"2024-03-19T06:23:23.558898+0000","last_fullsized":"2024-03-19T06:23:23.558898+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:43:42.939501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.528173+0000","last_change":"2024-03-19T06:23:20.528173+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.528173+0000","last_undegraded":"2024-03-19T06:23:20.528173+0000","last_fullsized":"2024-03-19T06:23:20.528173+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558599+0000","last_change":"2024-03-19T06:23:21.539687+0000","last_active":"2024-03-19T06:23:23.558599+0000","last_peered":"2024-03-19T06:23:23.558599+0000","last_clean":"2024-03-19T06:23:23.558599+0000","last_became_active":"2024-03-19T06:23:21.539397+0000","last_became_peered":"2024-03-19T06:23:21.539397+0000","last_unstale":"2024-03-19T06:23:23.558599+0000","last_undegraded":"2024-03-19T06:23:23.558599+0000","last_fullsized":"2024-03-19T06:23:23.558599+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:49:51.133678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553125+0000","last_change":"2024-03-19T06:23:22.554006+0000","last_active":"2024-03-19T06:23:23.553125+0000","last_peered":"2024-03-19T06:23:23.553125+0000","last_clean":"2024-03-19T06:23:23.553125+0000","last_became_active":"2024-03-19T06:23:22.553707+0000","last_became_peered":"2024-03-19T06:23:22.553707+0000","last_unstale":"2024-03-19T06:23:23.553125+0000","last_undegraded":"2024-03-19T06:23:23.553125+0000","last_fullsized":"2024-03-19T06:23:23.553125+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:44:11.818406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.525431+0000","last_change":"2024-03-19T06:23:20.525431+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.525431+0000","last_undegraded":"2024-03-19T06:23:20.525431+0000","last_fullsized":"2024-03-19T06:23:20.525431+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.527374+0000","last_change":"2024-03-19T06:23:20.527374+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.527374+0000","last_undegraded":"2024-03-19T06:23:20.527374+0000","last_fullsized":"2024-03-19T06:23:20.527374+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558592+0000","last_change":"2024-03-19T06:23:22.551029+0000","last_active":"2024-03-19T06:23:23.558592+0000","last_peered":"2024-03-19T06:23:23.558592+0000","last_clean":"2024-03-19T06:23:23.558592+0000","last_became_active":"2024-03-19T06:23:22.550646+0000","last_became_peered":"2024-03-19T06:23:22.550646+0000","last_unstale":"2024-03-19T06:23:23.558592+0000","last_undegraded":"2024-03-19T06:23:23.558592+0000","last_fullsized":"2024-03-19T06:23:23.558592+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:01.579117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.523107+0000","last_change":"2024-03-19T06:23:20.523107+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.523107+0000","last_undegraded":"2024-03-19T06:23:20.523107+0000","last_fullsized":"2024-03-19T06:23:20.523107+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558908+0000","last_change":"2024-03-19T06:23:21.542594+0000","last_active":"2024-03-19T06:23:23.558908+0000","last_peered":"2024-03-19T06:23:23.558908+0000","last_clean":"2024-03-19T06:23:23.558908+0000","last_became_active":"2024-03-19T06:23:21.542322+0000","last_became_peered":"2024-03-19T06:23:21.542322+0000","last_unstale":"2024-03-19T06:23:23.558908+0000","last_undegraded":"2024-03-19T06:23:23.558908+0000","last_fullsized":"2024-03-19T06:23:23.558908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:19:51.590050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.523411+0000","last_change":"2024-03-19T06:23:20.523411+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.523411+0000","last_undegraded":"2024-03-19T06:23:20.523411+0000","last_fullsized":"2024-03-19T06:23:20.523411+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558784+0000","last_change":"2024-03-19T06:23:22.553289+0000","last_active":"2024-03-19T06:23:23.558784+0000","last_peered":"2024-03-19T06:23:23.558784+0000","last_clean":"2024-03-19T06:23:23.558784+0000","last_became_active":"2024-03-19T06:23:22.551860+0000","last_became_peered":"2024-03-19T06:23:22.551860+0000","last_unstale":"2024-03-19T06:23:23.558784+0000","last_undegraded":"2024-03-19T06:23:23.558784+0000","last_fullsized":"2024-03-19T06:23:23.558784+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:37:05.107267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553331+0000","last_change":"2024-03-19T06:23:21.548326+0000","last_active":"2024-03-19T06:23:23.553331+0000","last_peered":"2024-03-19T06:23:23.553331+0000","last_clean":"2024-03-19T06:23:23.553331+0000","last_became_active":"2024-03-19T06:23:21.548092+0000","last_became_peered":"2024-03-19T06:23:21.548092+0000","last_unstale":"2024-03-19T06:23:23.553331+0000","last_undegraded":"2024-03-19T06:23:23.553331+0000","last_fullsized":"2024-03-19T06:23:23.553331+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:45:56.923983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.527597+0000","last_change":"2024-03-19T06:23:20.527597+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.527597+0000","last_undegraded":"2024-03-19T06:23:20.527597+0000","last_fullsized":"2024-03-19T06:23:20.527597+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.525560+0000","last_change":"2024-03-19T06:23:20.525560+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.525560+0000","last_undegraded":"2024-03-19T06:23:20.525560+0000","last_fullsized":"2024-03-19T06:23:20.525560+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553003+0000","last_change":"2024-03-19T06:23:22.566485+0000","last_active":"2024-03-19T06:23:23.553003+0000","last_peered":"2024-03-19T06:23:23.553003+0000","last_clean":"2024-03-19T06:23:23.553003+0000","last_became_active":"2024-03-19T06:23:22.566083+0000","last_became_peered":"2024-03-19T06:23:22.566083+0000","last_unstale":"2024-03-19T06:23:23.553003+0000","last_undegraded":"2024-03-19T06:23:23.553003+0000","last_fullsized":"2024-03-19T06:23:23.553003+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:50.195310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.522810+0000","last_change":"2024-03-19T06:23:20.522810+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.522810+0000","last_undegraded":"2024-03-19T06:23:20.522810+0000","last_fullsized":"2024-03-19T06:23:20.522810+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552649+0000","last_change":"2024-03-19T06:23:21.549680+0000","last_active":"2024-03-19T06:23:23.552649+0000","last_peered":"2024-03-19T06:23:23.552649+0000","last_clean":"2024-03-19T06:23:23.552649+0000","last_became_active":"2024-03-19T06:23:21.549473+0000","last_became_peered":"2024-03-19T06:23:21.549473+0000","last_unstale":"2024-03-19T06:23:23.552649+0000","last_undegraded":"2024-03-19T06:23:23.552649+0000","last_fullsized":"2024-03-19T06:23:23.552649+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:53:59.801574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552575+0000","last_change":"2024-03-19T06:23:22.556479+0000","last_active":"2024-03-19T06:23:23.552575+0000","last_peered":"2024-03-19T06:23:23.552575+0000","last_clean":"2024-03-19T06:23:23.552575+0000","last_became_active":"2024-03-19T06:23:22.555831+0000","last_became_peered":"2024-03-19T06:23:22.555831+0000","last_unstale":"2024-03-19T06:23:23.552575+0000","last_undegraded":"2024-03-19T06:23:23.552575+0000","last_fullsized":"2024-03-19T06:23:23.552575+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:01:31.985264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.528087+0000","last_change":"2024-03-19T06:23:20.528087+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.528087+0000","last_undegraded":"2024-03-19T06:23:20.528087+0000","last_fullsized":"2024-03-19T06:23:20.528087+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.523919+0000","last_change":"2024-03-19T06:23:20.523919+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.523919+0000","last_undegraded":"2024-03-19T06:23:20.523919+0000","last_fullsized":"2024-03-19T06:23:20.523919+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558571+0000","last_change":"2024-03-19T06:23:22.554856+0000","last_active":"2024-03-19T06:23:23.558571+0000","last_peered":"2024-03-19T06:23:23.558571+0000","last_clean":"2024-03-19T06:23:23.558571+0000","last_became_active":"2024-03-19T06:23:22.551031+0000","last_became_peered":"2024-03-19T06:23:22.551031+0000","last_unstale":"2024-03-19T06:23:23.558571+0000","last_undegraded":"2024-03-19T06:23:23.558571+0000","last_fullsized":"2024-03-19T06:23:23.558571+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:23:14.309187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.525567+0000","last_change":"2024-03-19T06:23:20.525567+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.525567+0000","last_undegraded":"2024-03-19T06:23:20.525567+0000","last_fullsized":"2024-03-19T06:23:20.525567+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.525624+0000","last_change":"2024-03-19T06:23:20.525624+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.525624+0000","last_undegraded":"2024-03-19T06:23:20.525624+0000","last_fullsized":"2024-03-19T06:23:20.525624+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.524225+0000","last_change":"2024-03-19T06:23:20.524225+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.524225+0000","last_undegraded":"2024-03-19T06:23:20.524225+0000","last_fullsized":"2024-03-19T06:23:20.524225+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552481+0000","last_change":"2024-03-19T06:23:21.549897+0000","last_active":"2024-03-19T06:23:23.552481+0000","last_peered":"2024-03-19T06:23:23.552481+0000","last_clean":"2024-03-19T06:23:23.552481+0000","last_became_active":"2024-03-19T06:23:21.549123+0000","last_became_peered":"2024-03-19T06:23:21.549123+0000","last_unstale":"2024-03-19T06:23:23.552481+0000","last_undegraded":"2024-03-19T06:23:23.552481+0000","last_fullsized":"2024-03-19T06:23:23.552481+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:47:05.968667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.527545+0000","last_change":"2024-03-19T06:23:20.527545+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.527545+0000","last_undegraded":"2024-03-19T06:23:20.527545+0000","last_fullsized":"2024-03-19T06:23:20.527545+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.524063+0000","last_change":"2024-03-19T06:23:20.524063+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.524063+0000","last_undegraded":"2024-03-19T06:23:20.524063+0000","last_fullsized":"2024-03-19T06:23:20.524063+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.525492+0000","last_change":"2024-03-19T06:23:20.525492+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.525492+0000","last_undegraded":"2024-03-19T06:23:20.525492+0000","last_fullsized":"2024-03-19T06:23:20.525492+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.522805+0000","last_change":"2024-03-19T06:23:20.522805+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.522805+0000","last_undegraded":"2024-03-19T06:23:20.522805+0000","last_fullsized":"2024-03-19T06:23:20.522805+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552778+0000","last_change":"2024-03-19T06:23:22.556772+0000","last_active":"2024-03-19T06:23:23.552778+0000","last_peered":"2024-03-19T06:23:23.552778+0000","last_clean":"2024-03-19T06:23:23.552778+0000","last_became_active":"2024-03-19T06:23:22.556355+0000","last_became_peered":"2024-03-19T06:23:22.556355+0000","last_unstale":"2024-03-19T06:23:23.552778+0000","last_undegraded":"2024-03-19T06:23:23.552778+0000","last_fullsized":"2024-03-19T06:23:23.552778+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:52:40.416402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.527396+0000","last_change":"2024-03-19T06:23:20.527396+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.527396+0000","last_undegraded":"2024-03-19T06:23:20.527396+0000","last_fullsized":"2024-03-19T06:23:20.527396+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552726+0000","last_change":"2024-03-19T06:23:21.547044+0000","last_active":"2024-03-19T06:23:23.552726+0000","last_peered":"2024-03-19T06:23:23.552726+0000","last_clean":"2024-03-19T06:23:23.552726+0000","last_became_active":"2024-03-19T06:23:21.546743+0000","last_became_peered":"2024-03-19T06:23:21.546743+0000","last_unstale":"2024-03-19T06:23:23.552726+0000","last_undegraded":"2024-03-19T06:23:23.552726+0000","last_fullsized":"2024-03-19T06:23:23.552726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:22:22.051267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552571+0000","last_change":"2024-03-19T06:23:21.551791+0000","last_active":"2024-03-19T06:23:23.552571+0000","last_peered":"2024-03-19T06:23:23.552571+0000","last_clean":"2024-03-19T06:23:23.552571+0000","last_became_active":"2024-03-19T06:23:21.551224+0000","last_became_peered":"2024-03-19T06:23:21.551224+0000","last_unstale":"2024-03-19T06:23:23.552571+0000","last_undegraded":"2024-03-19T06:23:23.552571+0000","last_fullsized":"2024-03-19T06:23:23.552571+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:39.583966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558470+0000","last_change":"2024-03-19T06:23:21.543770+0000","last_active":"2024-03-19T06:23:23.558470+0000","last_peered":"2024-03-19T06:23:23.558470+0000","last_clean":"2024-03-19T06:23:23.558470+0000","last_became_active":"2024-03-19T06:23:21.543273+0000","last_became_peered":"2024-03-19T06:23:21.543273+0000","last_unstale":"2024-03-19T06:23:23.558470+0000","last_undegraded":"2024-03-19T06:23:23.558470+0000","last_fullsized":"2024-03-19T06:23:23.558470+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:46.322795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553275+0000","last_change":"2024-03-19T06:23:22.567278+0000","last_active":"2024-03-19T06:23:23.553275+0000","last_peered":"2024-03-19T06:23:23.553275+0000","last_clean":"2024-03-19T06:23:23.553275+0000","last_became_active":"2024-03-19T06:23:22.566993+0000","last_became_peered":"2024-03-19T06:23:22.566993+0000","last_unstale":"2024-03-19T06:23:23.553275+0000","last_undegraded":"2024-03-19T06:23:23.553275+0000","last_fullsized":"2024-03-19T06:23:23.553275+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:30:58.300360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.522810+0000","last_change":"2024-03-19T06:23:20.522810+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.522810+0000","last_undegraded":"2024-03-19T06:23:20.522810+0000","last_fullsized":"2024-03-19T06:23:20.522810+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.528152+0000","last_change":"2024-03-19T06:23:20.528152+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.528152+0000","last_undegraded":"2024-03-19T06:23:20.528152+0000","last_fullsized":"2024-03-19T06:23:20.528152+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":217,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-19T06:23:20.524007+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:23:20.524007+0000","last_peered":"2024-03-19T06:23:20.524007+0000","last_clean":"2024-03-19T06:23:20.524007+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:23:20.524007+0000","last_undegraded":"2024-03-19T06:23:20.524007+0000","last_fullsized":"2024-03-19T06:23:20.524007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1155072,"data_stored":818865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":222680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":548864,"data_stored":222680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":548864,"data_stored":222680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":548864,"data_stored":222680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1155072,"data_stored":818865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":602112,"data_stored":248429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":614400,"data_stored":249481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:23:27.045 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:23:27.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.235+0000 7f5c86400640 1 Processor -- start 2024-03-19T06:23:27.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.235+0000 7f5c86400640 1 -- start start 2024-03-19T06:23:27.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c86400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c800710b0 0x7f5c80168bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:27.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c86400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c8006fbe0 con 0x7f5c8006c060 2024-03-19T06:23:27.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c86400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c8015e940 con 0x7f5c80099a70 2024-03-19T06:23:27.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c86400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8015e720 con 0x7f5c800710b0 2024-03-19T06:23:27.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c76a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5c8006c060 0x7f5c8015e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41574/0 (socket says 172.21.15.32:41574) 2024-03-19T06:23:27.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c76a00640 1 -- 172.21.15.32:0/1538718977 learned_addr learned my addr 172.21.15.32:0/1538718977 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:27.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7fe00640 1 --2- 172.21.15.32:0/1538718977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c800710b0 0x7f5c80168bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:27.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 -- 172.21.15.32:0/1538718977 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762085337 0 0) 0x7f5c68001120 con 0x7f5c8006c060 2024-03-19T06:23:27.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 -- 172.21.15.32:0/1538718977 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c64003530 con 0x7f5c8006c060 2024-03-19T06:23:27.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 -- 172.21.15.32:0/1538718977 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251142047 0 0) 0x7f5c8015e940 con 0x7f5c80099a70 2024-03-19T06:23:27.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 -- 172.21.15.32:0/1538718977 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c68001120 con 0x7f5c80099a70 2024-03-19T06:23:27.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 -- 172.21.15.32:0/1538718977 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 122827119 0 0) 0x7f5c64003530 con 0x7f5c8006c060 2024-03-19T06:23:27.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 -- 172.21.15.32:0/1538718977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c800710b0 msgr2=0x7f5c80168bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:27.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 --2- 172.21.15.32:0/1538718977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c800710b0 0x7f5c80168bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 -- 172.21.15.32:0/1538718977 >> v1:172.21.15.171:6789/0 conn(0x7f5c80099a70 legacy=0x7f5c80099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:27.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 -- 172.21.15.32:0/1538718977 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8015ec20 con 0x7f5c8006c060 2024-03-19T06:23:27.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 -- 172.21.15.32:0/1538718977 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f5c68001850 con 0x7f5c8006c060 2024-03-19T06:23:27.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 -- 172.21.15.32:0/1538718977 >> v1:172.21.15.32:6789/0 conn(0x7f5c8006c060 legacy=0x7f5c8015e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:27.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 --2- 172.21.15.32:0/1538718977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c800710b0 0x7f5c64003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:27.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 --2- 172.21.15.32:0/1538718977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c64004130 0x7f5c64004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:27.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 --2- 172.21.15.32:0/1538718977 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c64004d50 0x7f5c640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:27.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 -- 172.21.15.32:0/1538718977 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8015e720 con 0x7f5c64004d50 2024-03-19T06:23:27.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 -- 172.21.15.32:0/1538718977 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6400bb10 con 0x7f5c64004130 2024-03-19T06:23:27.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7ea00640 1 -- 172.21.15.32:0/1538718977 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6400bd10 con 0x7f5c800710b0 2024-03-19T06:23:27.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7fe00640 1 --2- 172.21.15.32:0/1538718977 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c64004d50 0x7f5c640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:27.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7f400640 1 --2- 172.21.15.32:0/1538718977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c800710b0 0x7f5c64003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:27.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c76a00640 1 --2- 172.21.15.32:0/1538718977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c64004130 0x7f5c64004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:27.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7fe00640 1 -- 172.21.15.32:0/1538718977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c800710b0 msgr2=0x7f5c64003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:27.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7fe00640 1 --2- 172.21.15.32:0/1538718977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c800710b0 0x7f5c64003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7fe00640 1 -- 172.21.15.32:0/1538718977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c64004130 msgr2=0x7f5c64004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:27.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7fe00640 1 --2- 172.21.15.32:0/1538718977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c64004130 0x7f5c64004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c7fe00640 1 -- 172.21.15.32:0/1538718977 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c64003530 con 0x7f5c64004d50 2024-03-19T06:23:27.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.239+0000 7f5c76a00640 1 --2- 172.21.15.32:0/1538718977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c64004130 0x7f5c64004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:27.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.243+0000 7f5c7fe00640 1 --2- 172.21.15.32:0/1538718977 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c64004d50 0x7f5c640051d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5c78009ab0 tx=0x7f5c7801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4bd0f685d8b623b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:27.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.243+0000 7f5c7ea00640 1 -- 172.21.15.32:0/1538718977 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c780b2070 con 0x7f5c64004d50 2024-03-19T06:23:27.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.243+0000 7f5c7ea00640 1 -- 172.21.15.32:0/1538718977 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c780a5640 con 0x7f5c64004d50 2024-03-19T06:23:27.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.243+0000 7f5c7ea00640 1 -- 172.21.15.32:0/1538718977 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c780096b0 con 0x7f5c64004d50 2024-03-19T06:23:27.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.243+0000 7f5c86400640 1 -- 172.21.15.32:0/1538718977 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c64004d50 msgr2=0x7f5c640051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:27.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.243+0000 7f5c86400640 1 --2- 172.21.15.32:0/1538718977 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c64004d50 0x7f5c640051d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5c78009ab0 tx=0x7f5c7801ca50 comp rx=0 tx=0).stop 2024-03-19T06:23:27.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.243+0000 7f5c7fe00640 1 -- 172.21.15.32:0/1538718977 reap_dead start 2024-03-19T06:23:27.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.243+0000 7f5c86400640 1 -- 172.21.15.32:0/1538718977 shutdown_connections 2024-03-19T06:23:27.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.243+0000 7f5c86400640 1 -- 172.21.15.32:0/1538718977 >> 172.21.15.32:0/1538718977 conn(0x7f5c800b3300 msgr2=0x7f5c800b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:27.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.243+0000 7f5c86400640 1 -- 172.21.15.32:0/1538718977 shutdown_connections 2024-03-19T06:23:27.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.243+0000 7f5c86400640 1 -- 172.21.15.32:0/1538718977 wait complete. 2024-03-19T06:23:27.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.243+0000 7f5c86400640 1 Processor -- start 2024-03-19T06:23:27.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.243+0000 7f5c86400640 1 -- start start 2024-03-19T06:23:27.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c86400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c800c6c10 0x7f5c800b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:27.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c86400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c801f5250 0x7f5c800b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:27.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c86400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c800b6640 0x7f5c800b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c86400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8009a760 con 0x7f5c800c6c10 2024-03-19T06:23:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c86400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8015f1e0 con 0x7f5c800b6640 2024-03-19T06:23:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c86400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c80166be0 con 0x7f5c801f5250 2024-03-19T06:23:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c7f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c800c6c10 0x7f5c800b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c7f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c800c6c10 0x7f5c800b5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40894/0 (socket says 172.21.15.32:40894) 2024-03-19T06:23:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c7f400640 1 -- 172.21.15.32:0/3303818964 learned_addr learned my addr 172.21.15.32:0/3303818964 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c7fe00640 1 --2- 172.21.15.32:0/3303818964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c800b6640 0x7f5c800b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c76a00640 1 --2- 172.21.15.32:0/3303818964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c801f5250 0x7f5c800b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c7f400640 1 -- 172.21.15.32:0/3303818964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c801f5250 msgr2=0x7f5c800b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c7f400640 1 --2- 172.21.15.32:0/3303818964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c801f5250 0x7f5c800b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c7f400640 1 -- 172.21.15.32:0/3303818964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c800b6640 msgr2=0x7f5c800b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c7f400640 1 --2- 172.21.15.32:0/3303818964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c800b6640 0x7f5c800b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c7f400640 1 -- 172.21.15.32:0/3303818964 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c800b45d0 con 0x7f5c800c6c10 2024-03-19T06:23:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c7fe00640 1 --2- 172.21.15.32:0/3303818964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c800b6640 0x7f5c800b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c76a00640 1 --2- 172.21.15.32:0/3303818964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c801f5250 0x7f5c800b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:27.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c7f400640 1 --2- 172.21.15.32:0/3303818964 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c800c6c10 0x7f5c800b5390 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000fb10 tx=0x7f5c7000d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:27.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c77e00640 1 -- 172.21.15.32:0/3303818964 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7001a070 con 0x7f5c800c6c10 2024-03-19T06:23:27.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c77e00640 1 -- 172.21.15.32:0/3303818964 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c70006d70 con 0x7f5c800c6c10 2024-03-19T06:23:27.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c77e00640 1 -- 172.21.15.32:0/3303818964 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70003bc0 con 0x7f5c800c6c10 2024-03-19T06:23:27.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c86400640 1 -- 172.21.15.32:0/3303818964 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c800b48b0 con 0x7f5c800c6c10 2024-03-19T06:23:27.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c86400640 1 -- 172.21.15.32:0/3303818964 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c800b4e70 con 0x7f5c800c6c10 2024-03-19T06:23:27.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c86400640 1 -- 172.21.15.32:0/3303818964 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c800b5070 con 0x7f5c800c6c10 2024-03-19T06:23:27.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.247+0000 7f5c77e00640 1 -- 172.21.15.32:0/3303818964 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5c7001d070 con 0x7f5c800c6c10 2024-03-19T06:23:27.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.251+0000 7f5c77e00640 1 --2- 172.21.15.32:0/3303818964 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5c5c067690 0x7f5c5c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:27.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.251+0000 7f5c77e00640 1 -- 172.21.15.32:0/3303818964 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c70085550 con 0x7f5c800c6c10 2024-03-19T06:23:27.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.251+0000 7f5c76a00640 1 --2- 172.21.15.32:0/3303818964 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5c5c067690 0x7f5c5c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:27.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.251+0000 7f5c76a00640 1 --2- 172.21.15.32:0/3303818964 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5c5c067690 0x7f5c5c069b50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5c680019c0 tx=0x7f5c680012f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:27.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.255+0000 7f5c77e00640 1 -- 172.21.15.32:0/3303818964 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f5c800b5070 con 0x7f5c800c6c10 2024-03-19T06:23:27.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.415+0000 7f5c86400640 1 -- 172.21.15.32:0/3303818964 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c800749e0 con 0x7f5c5c067690 2024-03-19T06:23:27.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.419+0000 7f5c77e00640 1 -- 172.21.15.32:0/3303818964 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243066 (secure 0 0 0) 0x7f5c800749e0 con 0x7f5c5c067690 2024-03-19T06:23:27.412 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:27.413 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:23:27.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.423+0000 7f5c86400640 1 -- 172.21.15.32:0/3303818964 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5c5c067690 msgr2=0x7f5c5c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:27.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.423+0000 7f5c86400640 1 --2- 172.21.15.32:0/3303818964 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5c5c067690 0x7f5c5c069b50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5c680019c0 tx=0x7f5c680012f0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.423+0000 7f5c86400640 1 -- 172.21.15.32:0/3303818964 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c800c6c10 msgr2=0x7f5c800b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:27.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.423+0000 7f5c86400640 1 --2- 172.21.15.32:0/3303818964 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c800c6c10 0x7f5c800b5390 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000fb10 tx=0x7f5c7000d150 comp rx=0 tx=0).stop 2024-03-19T06:23:27.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.423+0000 7f5c86400640 1 -- 172.21.15.32:0/3303818964 shutdown_connections 2024-03-19T06:23:27.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.423+0000 7f5c86400640 1 --2- 172.21.15.32:0/3303818964 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5c5c067690 0x7f5c5c069b50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.423+0000 7f5c86400640 1 --2- 172.21.15.32:0/3303818964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c800b6640 0x7f5c800b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.423+0000 7f5c86400640 1 --2- 172.21.15.32:0/3303818964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c801f5250 0x7f5c800b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.423+0000 7f5c86400640 1 --2- 172.21.15.32:0/3303818964 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c800c6c10 0x7f5c800b5390 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.423+0000 7f5c86400640 1 -- 172.21.15.32:0/3303818964 >> 172.21.15.32:0/3303818964 conn(0x7f5c800b3300 msgr2=0x7f5c8015cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:27.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.423+0000 7f5c86400640 1 -- 172.21.15.32:0/3303818964 shutdown_connections 2024-03-19T06:23:27.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.423+0000 7f5c86400640 1 -- 172.21.15.32:0/3303818964 wait complete. 2024-03-19T06:23:27.432 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-03-19T06:23:25.952879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":177,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238432,"kb_used_data":5588,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736288,"statfs":{"total":773094113280,"available":772849958912,"internally_reserved":0,"allocated":5722112,"data_stored":3026360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.432084"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558640+0000","last_change":"2024-03-19T06:23:22.557767+0000","last_active":"2024-03-19T06:23:23.558640+0000","last_peered":"2024-03-19T06:23:23.558640+0000","last_clean":"2024-03-19T06:23:23.558640+0000","last_became_active":"2024-03-19T06:23:22.557450+0000","last_became_peered":"2024-03-19T06:23:22.557450+0000","last_unstale":"2024-03-19T06:23:23.558640+0000","last_undegraded":"2024-03-19T06:23:23.558640+0000","last_fullsized":"2024-03-19T06:23:23.558640+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:42:44.189385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552568+0000","last_change":"2024-03-19T06:23:22.553064+0000","last_active":"2024-03-19T06:23:23.552568+0000","last_peered":"2024-03-19T06:23:23.552568+0000","last_clean":"2024-03-19T06:23:23.552568+0000","last_became_active":"2024-03-19T06:23:22.552784+0000","last_became_peered":"2024-03-19T06:23:22.552784+0000","last_unstale":"2024-03-19T06:23:23.552568+0000","last_undegraded":"2024-03-19T06:23:23.552568+0000","last_fullsized":"2024-03-19T06:23:23.552568+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:28.771832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553240+0000","last_change":"2024-03-19T06:23:22.562187+0000","last_active":"2024-03-19T06:23:23.553240+0000","last_peered":"2024-03-19T06:23:23.553240+0000","last_clean":"2024-03-19T06:23:23.553240+0000","last_became_active":"2024-03-19T06:23:22.561713+0000","last_became_peered":"2024-03-19T06:23:22.561713+0000","last_unstale":"2024-03-19T06:23:23.553240+0000","last_undegraded":"2024-03-19T06:23:23.553240+0000","last_fullsized":"2024-03-19T06:23:23.553240+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:29:22.406290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553069+0000","last_change":"2024-03-19T06:23:22.556143+0000","last_active":"2024-03-19T06:23:23.553069+0000","last_peered":"2024-03-19T06:23:23.553069+0000","last_clean":"2024-03-19T06:23:23.553069+0000","last_became_active":"2024-03-19T06:23:22.555873+0000","last_became_peered":"2024-03-19T06:23:22.555873+0000","last_unstale":"2024-03-19T06:23:23.553069+0000","last_undegraded":"2024-03-19T06:23:23.553069+0000","last_fullsized":"2024-03-19T06:23:23.553069+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:37:24.117721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552509+0000","last_change":"2024-03-19T06:23:22.549825+0000","last_active":"2024-03-19T06:23:23.552509+0000","last_peered":"2024-03-19T06:23:23.552509+0000","last_clean":"2024-03-19T06:23:23.552509+0000","last_became_active":"2024-03-19T06:23:22.549560+0000","last_became_peered":"2024-03-19T06:23:22.549560+0000","last_unstale":"2024-03-19T06:23:23.552509+0000","last_undegraded":"2024-03-19T06:23:23.552509+0000","last_fullsized":"2024-03-19T06:23:23.552509+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:20:48.708717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552977+0000","last_change":"2024-03-19T06:23:22.558146+0000","last_active":"2024-03-19T06:23:23.552977+0000","last_peered":"2024-03-19T06:23:23.552977+0000","last_clean":"2024-03-19T06:23:23.552977+0000","last_became_active":"2024-03-19T06:23:22.557844+0000","last_became_peered":"2024-03-19T06:23:22.557844+0000","last_unstale":"2024-03-19T06:23:23.552977+0000","last_undegraded":"2024-03-19T06:23:23.552977+0000","last_fullsized":"2024-03-19T06:23:23.552977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:15.576529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.526404+0000","last_change":"2024-03-19T06:23:20.526404+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.526404+0000","last_undegraded":"2024-03-19T06:23:20.526404+0000","last_fullsized":"2024-03-19T06:23:20.526404+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.523945+0000","last_change":"2024-03-19T06:23:20.523945+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.523945+0000","last_undegraded":"2024-03-19T06:23:20.523945+0000","last_fullsized":"2024-03-19T06:23:20.523945+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.524015+0000","last_change":"2024-03-19T06:23:20.524015+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.524015+0000","last_undegraded":"2024-03-19T06:23:20.524015+0000","last_fullsized":"2024-03-19T06:23:20.524015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552538+0000","last_change":"2024-03-19T06:23:22.564698+0000","last_active":"2024-03-19T06:23:23.552538+0000","last_peered":"2024-03-19T06:23:23.552538+0000","last_clean":"2024-03-19T06:23:23.552538+0000","last_became_active":"2024-03-19T06:23:22.564416+0000","last_became_peered":"2024-03-19T06:23:22.564416+0000","last_unstale":"2024-03-19T06:23:23.552538+0000","last_undegraded":"2024-03-19T06:23:23.552538+0000","last_fullsized":"2024-03-19T06:23:23.552538+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:33:17.743019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.522797+0000","last_change":"2024-03-19T06:23:20.522797+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.522797+0000","last_undegraded":"2024-03-19T06:23:20.522797+0000","last_fullsized":"2024-03-19T06:23:20.522797+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558898+0000","last_change":"2024-03-19T06:23:22.551285+0000","last_active":"2024-03-19T06:23:23.558898+0000","last_peered":"2024-03-19T06:23:23.558898+0000","last_clean":"2024-03-19T06:23:23.558898+0000","last_became_active":"2024-03-19T06:23:22.550894+0000","last_became_peered":"2024-03-19T06:23:22.550894+0000","last_unstale":"2024-03-19T06:23:23.558898+0000","last_undegraded":"2024-03-19T06:23:23.558898+0000","last_fullsized":"2024-03-19T06:23:23.558898+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:43:42.939501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.528173+0000","last_change":"2024-03-19T06:23:20.528173+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.528173+0000","last_undegraded":"2024-03-19T06:23:20.528173+0000","last_fullsized":"2024-03-19T06:23:20.528173+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558599+0000","last_change":"2024-03-19T06:23:21.539687+0000","last_active":"2024-03-19T06:23:23.558599+0000","last_peered":"2024-03-19T06:23:23.558599+0000","last_clean":"2024-03-19T06:23:23.558599+0000","last_became_active":"2024-03-19T06:23:21.539397+0000","last_became_peered":"2024-03-19T06:23:21.539397+0000","last_unstale":"2024-03-19T06:23:23.558599+0000","last_undegraded":"2024-03-19T06:23:23.558599+0000","last_fullsized":"2024-03-19T06:23:23.558599+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:49:51.133678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553125+0000","last_change":"2024-03-19T06:23:22.554006+0000","last_active":"2024-03-19T06:23:23.553125+0000","last_peered":"2024-03-19T06:23:23.553125+0000","last_clean":"2024-03-19T06:23:23.553125+0000","last_became_active":"2024-03-19T06:23:22.553707+0000","last_became_peered":"2024-03-19T06:23:22.553707+0000","last_unstale":"2024-03-19T06:23:23.553125+0000","last_undegraded":"2024-03-19T06:23:23.553125+0000","last_fullsized":"2024-03-19T06:23:23.553125+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:44:11.818406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.525431+0000","last_change":"2024-03-19T06:23:20.525431+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.525431+0000","last_undegraded":"2024-03-19T06:23:20.525431+0000","last_fullsized":"2024-03-19T06:23:20.525431+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.527374+0000","last_change":"2024-03-19T06:23:20.527374+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.527374+0000","last_undegraded":"2024-03-19T06:23:20.527374+0000","last_fullsized":"2024-03-19T06:23:20.527374+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558592+0000","last_change":"2024-03-19T06:23:22.551029+0000","last_active":"2024-03-19T06:23:23.558592+0000","last_peered":"2024-03-19T06:23:23.558592+0000","last_clean":"2024-03-19T06:23:23.558592+0000","last_became_active":"2024-03-19T06:23:22.550646+0000","last_became_peered":"2024-03-19T06:23:22.550646+0000","last_unstale":"2024-03-19T06:23:23.558592+0000","last_undegraded":"2024-03-19T06:23:23.558592+0000","last_fullsized":"2024-03-19T06:23:23.558592+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:01.579117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.523107+0000","last_change":"2024-03-19T06:23:20.523107+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.523107+0000","last_undegraded":"2024-03-19T06:23:20.523107+0000","last_fullsized":"2024-03-19T06:23:20.523107+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558908+0000","last_change":"2024-03-19T06:23:21.542594+0000","last_active":"2024-03-19T06:23:23.558908+0000","last_peered":"2024-03-19T06:23:23.558908+0000","last_clean":"2024-03-19T06:23:23.558908+0000","last_became_active":"2024-03-19T06:23:21.542322+0000","last_became_peered":"2024-03-19T06:23:21.542322+0000","last_unstale":"2024-03-19T06:23:23.558908+0000","last_undegraded":"2024-03-19T06:23:23.558908+0000","last_fullsized":"2024-03-19T06:23:23.558908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:19:51.590050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.523411+0000","last_change":"2024-03-19T06:23:20.523411+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.523411+0000","last_undegraded":"2024-03-19T06:23:20.523411+0000","last_fullsized":"2024-03-19T06:23:20.523411+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558784+0000","last_change":"2024-03-19T06:23:22.553289+0000","last_active":"2024-03-19T06:23:23.558784+0000","last_peered":"2024-03-19T06:23:23.558784+0000","last_clean":"2024-03-19T06:23:23.558784+0000","last_became_active":"2024-03-19T06:23:22.551860+0000","last_became_peered":"2024-03-19T06:23:22.551860+0000","last_unstale":"2024-03-19T06:23:23.558784+0000","last_undegraded":"2024-03-19T06:23:23.558784+0000","last_fullsized":"2024-03-19T06:23:23.558784+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:37:05.107267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553331+0000","last_change":"2024-03-19T06:23:21.548326+0000","last_active":"2024-03-19T06:23:23.553331+0000","last_peered":"2024-03-19T06:23:23.553331+0000","last_clean":"2024-03-19T06:23:23.553331+0000","last_became_active":"2024-03-19T06:23:21.548092+0000","last_became_peered":"2024-03-19T06:23:21.548092+0000","last_unstale":"2024-03-19T06:23:23.553331+0000","last_undegraded":"2024-03-19T06:23:23.553331+0000","last_fullsized":"2024-03-19T06:23:23.553331+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:45:56.923983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.527597+0000","last_change":"2024-03-19T06:23:20.527597+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.527597+0000","last_undegraded":"2024-03-19T06:23:20.527597+0000","last_fullsized":"2024-03-19T06:23:20.527597+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.525560+0000","last_change":"2024-03-19T06:23:20.525560+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.525560+0000","last_undegraded":"2024-03-19T06:23:20.525560+0000","last_fullsized":"2024-03-19T06:23:20.525560+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553003+0000","last_change":"2024-03-19T06:23:22.566485+0000","last_active":"2024-03-19T06:23:23.553003+0000","last_peered":"2024-03-19T06:23:23.553003+0000","last_clean":"2024-03-19T06:23:23.553003+0000","last_became_active":"2024-03-19T06:23:22.566083+0000","last_became_peered":"2024-03-19T06:23:22.566083+0000","last_unstale":"2024-03-19T06:23:23.553003+0000","last_undegraded":"2024-03-19T06:23:23.553003+0000","last_fullsized":"2024-03-19T06:23:23.553003+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:50.195310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.522810+0000","last_change":"2024-03-19T06:23:20.522810+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.522810+0000","last_undegraded":"2024-03-19T06:23:20.522810+0000","last_fullsized":"2024-03-19T06:23:20.522810+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552649+0000","last_change":"2024-03-19T06:23:21.549680+0000","last_active":"2024-03-19T06:23:23.552649+0000","last_peered":"2024-03-19T06:23:23.552649+0000","last_clean":"2024-03-19T06:23:23.552649+0000","last_became_active":"2024-03-19T06:23:21.549473+0000","last_became_peered":"2024-03-19T06:23:21.549473+0000","last_unstale":"2024-03-19T06:23:23.552649+0000","last_undegraded":"2024-03-19T06:23:23.552649+0000","last_fullsized":"2024-03-19T06:23:23.552649+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:53:59.801574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552575+0000","last_change":"2024-03-19T06:23:22.556479+0000","last_active":"2024-03-19T06:23:23.552575+0000","last_peered":"2024-03-19T06:23:23.552575+0000","last_clean":"2024-03-19T06:23:23.552575+0000","last_became_active":"2024-03-19T06:23:22.555831+0000","last_became_peered":"2024-03-19T06:23:22.555831+0000","last_unstale":"2024-03-19T06:23:23.552575+0000","last_undegraded":"2024-03-19T06:23:23.552575+0000","last_fullsized":"2024-03-19T06:23:23.552575+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:01:31.985264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.528087+0000","last_change":"2024-03-19T06:23:20.528087+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.528087+0000","last_undegraded":"2024-03-19T06:23:20.528087+0000","last_fullsized":"2024-03-19T06:23:20.528087+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.523919+0000","last_change":"2024-03-19T06:23:20.523919+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.523919+0000","last_undegraded":"2024-03-19T06:23:20.523919+0000","last_fullsized":"2024-03-19T06:23:20.523919+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558571+0000","last_change":"2024-03-19T06:23:22.554856+0000","last_active":"2024-03-19T06:23:23.558571+0000","last_peered":"2024-03-19T06:23:23.558571+0000","last_clean":"2024-03-19T06:23:23.558571+0000","last_became_active":"2024-03-19T06:23:22.551031+0000","last_became_peered":"2024-03-19T06:23:22.551031+0000","last_unstale":"2024-03-19T06:23:23.558571+0000","last_undegraded":"2024-03-19T06:23:23.558571+0000","last_fullsized":"2024-03-19T06:23:23.558571+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:23:14.309187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.525567+0000","last_change":"2024-03-19T06:23:20.525567+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.525567+0000","last_undegraded":"2024-03-19T06:23:20.525567+0000","last_fullsized":"2024-03-19T06:23:20.525567+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.525624+0000","last_change":"2024-03-19T06:23:20.525624+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.525624+0000","last_undegraded":"2024-03-19T06:23:20.525624+0000","last_fullsized":"2024-03-19T06:23:20.525624+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.524225+0000","last_change":"2024-03-19T06:23:20.524225+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.524225+0000","last_undegraded":"2024-03-19T06:23:20.524225+0000","last_fullsized":"2024-03-19T06:23:20.524225+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552481+0000","last_change":"2024-03-19T06:23:21.549897+0000","last_active":"2024-03-19T06:23:23.552481+0000","last_peered":"2024-03-19T06:23:23.552481+0000","last_clean":"2024-03-19T06:23:23.552481+0000","last_became_active":"2024-03-19T06:23:21.549123+0000","last_became_peered":"2024-03-19T06:23:21.549123+0000","last_unstale":"2024-03-19T06:23:23.552481+0000","last_undegraded":"2024-03-19T06:23:23.552481+0000","last_fullsized":"2024-03-19T06:23:23.552481+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:47:05.968667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.527545+0000","last_change":"2024-03-19T06:23:20.527545+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.527545+0000","last_undegraded":"2024-03-19T06:23:20.527545+0000","last_fullsized":"2024-03-19T06:23:20.527545+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.524063+0000","last_change":"2024-03-19T06:23:20.524063+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.524063+0000","last_undegraded":"2024-03-19T06:23:20.524063+0000","last_fullsized":"2024-03-19T06:23:20.524063+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.525492+0000","last_change":"2024-03-19T06:23:20.525492+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.525492+0000","last_undegraded":"2024-03-19T06:23:20.525492+0000","last_fullsized":"2024-03-19T06:23:20.525492+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.522805+0000","last_change":"2024-03-19T06:23:20.522805+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.522805+0000","last_undegraded":"2024-03-19T06:23:20.522805+0000","last_fullsized":"2024-03-19T06:23:20.522805+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552778+0000","last_change":"2024-03-19T06:23:22.556772+0000","last_active":"2024-03-19T06:23:23.552778+0000","last_peered":"2024-03-19T06:23:23.552778+0000","last_clean":"2024-03-19T06:23:23.552778+0000","last_became_active":"2024-03-19T06:23:22.556355+0000","last_became_peered":"2024-03-19T06:23:22.556355+0000","last_unstale":"2024-03-19T06:23:23.552778+0000","last_undegraded":"2024-03-19T06:23:23.552778+0000","last_fullsized":"2024-03-19T06:23:23.552778+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:52:40.416402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.527396+0000","last_change":"2024-03-19T06:23:20.527396+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.527396+0000","last_undegraded":"2024-03-19T06:23:20.527396+0000","last_fullsized":"2024-03-19T06:23:20.527396+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552726+0000","last_change":"2024-03-19T06:23:21.547044+0000","last_active":"2024-03-19T06:23:23.552726+0000","last_peered":"2024-03-19T06:23:23.552726+0000","last_clean":"2024-03-19T06:23:23.552726+0000","last_became_active":"2024-03-19T06:23:21.546743+0000","last_became_peered":"2024-03-19T06:23:21.546743+0000","last_unstale":"2024-03-19T06:23:23.552726+0000","last_undegraded":"2024-03-19T06:23:23.552726+0000","last_fullsized":"2024-03-19T06:23:23.552726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:22:22.051267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552571+0000","last_change":"2024-03-19T06:23:21.551791+0000","last_active":"2024-03-19T06:23:23.552571+0000","last_peered":"2024-03-19T06:23:23.552571+0000","last_clean":"2024-03-19T06:23:23.552571+0000","last_became_active":"2024-03-19T06:23:21.551224+0000","last_became_peered":"2024-03-19T06:23:21.551224+0000","last_unstale":"2024-03-19T06:23:23.552571+0000","last_undegraded":"2024-03-19T06:23:23.552571+0000","last_fullsized":"2024-03-19T06:23:23.552571+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:39.583966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558470+0000","last_change":"2024-03-19T06:23:21.543770+0000","last_active":"2024-03-19T06:23:23.558470+0000","last_peered":"2024-03-19T06:23:23.558470+0000","last_clean":"2024-03-19T06:23:23.558470+0000","last_became_active":"2024-03-19T06:23:21.543273+0000","last_became_peered":"2024-03-19T06:23:21.543273+0000","last_unstale":"2024-03-19T06:23:23.558470+0000","last_undegraded":"2024-03-19T06:23:23.558470+0000","last_fullsized":"2024-03-19T06:23:23.558470+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:46.322795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553275+0000","last_change":"2024-03-19T06:23:22.567278+0000","last_active":"2024-03-19T06:23:23.553275+0000","last_peered":"2024-03-19T06:23:23.553275+0000","last_clean":"2024-03-19T06:23:23.553275+0000","last_became_active":"2024-03-19T06:23:22.566993+0000","last_became_peered":"2024-03-19T06:23:22.566993+0000","last_unstale":"2024-03-19T06:23:23.553275+0000","last_undegraded":"2024-03-19T06:23:23.553275+0000","last_fullsized":"2024-03-19T06:23:23.553275+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:30:58.300360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.522810+0000","last_change":"2024-03-19T06:23:20.522810+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.522810+0000","last_undegraded":"2024-03-19T06:23:20.522810+0000","last_fullsized":"2024-03-19T06:23:20.522810+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-19T06:23:21.516002+0000","last_change":"2024-03-19T06:23:21.516002+0000","last_active":"2024-03-19T06:23:21.516002+0000","last_peered":"2024-03-19T06:23:21.516002+0000","last_clean":"2024-03-19T06:23:21.516002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:21.516002+0000","last_undegraded":"2024-03-19T06:23:21.516002+0000","last_fullsized":"2024-03-19T06:23:21.516002+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-03-19T06:23:20.528152+0000","last_change":"2024-03-19T06:23:20.528152+0000","last_active":"2024-03-19T06:23:20.509678+0000","last_peered":"2024-03-19T06:23:20.509678+0000","last_clean":"2024-03-19T06:23:20.509678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-19T06:23:20.528152+0000","last_undegraded":"2024-03-19T06:23:20.528152+0000","last_fullsized":"2024-03-19T06:23:20.528152+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":217,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-19T06:23:20.524007+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:23:20.524007+0000","last_peered":"2024-03-19T06:23:20.524007+0000","last_clean":"2024-03-19T06:23:20.524007+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:23:20.524007+0000","last_undegraded":"2024-03-19T06:23:20.524007+0000","last_fullsized":"2024-03-19T06:23:20.524007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1155072,"data_stored":818865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":222680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":548864,"data_stored":222680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":548864,"data_stored":222680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":548864,"data_stored":222680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1155072,"data_stored":818865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":602112,"data_stored":248429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":614400,"data_stored":249481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:23:27.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2024-03-19T06:23:27.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2024-03-19T06:23:27.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2024-03-19T06:23:27.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2024-03-19T06:23:27.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2024-03-19T06:23:27.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2024-03-19T06:23:27.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2024-03-19T06:23:27.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2024-03-19T06:23:27.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2024-03-19T06:23:27.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2024-03-19T06:23:27.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2024-03-19T06:23:27.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2024-03-19T06:23:27.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2024-03-19T06:23:27.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2024-03-19T06:23:27.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2024-03-19T06:23:27.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2024-03-19T06:23:27.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2024-03-19T06:23:27.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2024-03-19T06:23:27.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2024-03-19T06:23:27.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2024-03-19T06:23:27.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2024-03-19T06:23:27.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2024-03-19T06:23:27.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2024-03-19T06:23:27.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2024-03-19T06:23:27.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2024-03-19T06:23:27.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2024-03-19T06:23:27.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2024-03-19T06:23:27.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2024-03-19T06:23:27.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.526404+0000', 'last_change': '2024-03-19T06:23:20.526404+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.526404+0000', 'last_undegraded': '2024-03-19T06:23:20.526404+0000', 'last_fullsized': '2024-03-19T06:23:20.526404+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-19T06:23:27.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2024-03-19T06:23:27.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2024-03-19T06:23:27.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.523945+0000', 'last_change': '2024-03-19T06:23:20.523945+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.523945+0000', 'last_undegraded': '2024-03-19T06:23:20.523945+0000', 'last_fullsized': '2024-03-19T06:23:20.523945+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-19T06:23:27.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2024-03-19T06:23:27.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2024-03-19T06:23:27.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.524015+0000', 'last_change': '2024-03-19T06:23:20.524015+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.524015+0000', 'last_undegraded': '2024-03-19T06:23:20.524015+0000', 'last_fullsized': '2024-03-19T06:23:20.524015+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-19T06:23:27.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2024-03-19T06:23:27.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.522797+0000', 'last_change': '2024-03-19T06:23:20.522797+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.522797+0000', 'last_undegraded': '2024-03-19T06:23:20.522797+0000', 'last_fullsized': '2024-03-19T06:23:20.522797+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-19T06:23:27.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2024-03-19T06:23:27.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.528173+0000', 'last_change': '2024-03-19T06:23:20.528173+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.528173+0000', 'last_undegraded': '2024-03-19T06:23:20.528173+0000', 'last_fullsized': '2024-03-19T06:23:20.528173+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-19T06:23:27.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2024-03-19T06:23:27.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2024-03-19T06:23:27.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.525431+0000', 'last_change': '2024-03-19T06:23:20.525431+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.525431+0000', 'last_undegraded': '2024-03-19T06:23:20.525431+0000', 'last_fullsized': '2024-03-19T06:23:20.525431+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-19T06:23:27.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2024-03-19T06:23:27.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2024-03-19T06:23:27.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.527374+0000', 'last_change': '2024-03-19T06:23:20.527374+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.527374+0000', 'last_undegraded': '2024-03-19T06:23:20.527374+0000', 'last_fullsized': '2024-03-19T06:23:20.527374+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-19T06:23:27.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2024-03-19T06:23:27.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.523107+0000', 'last_change': '2024-03-19T06:23:20.523107+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.523107+0000', 'last_undegraded': '2024-03-19T06:23:20.523107+0000', 'last_fullsized': '2024-03-19T06:23:20.523107+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-19T06:23:27.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2024-03-19T06:23:27.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2024-03-19T06:23:27.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2024-03-19T06:23:27.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.523411+0000', 'last_change': '2024-03-19T06:23:20.523411+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.523411+0000', 'last_undegraded': '2024-03-19T06:23:20.523411+0000', 'last_fullsized': '2024-03-19T06:23:20.523411+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-19T06:23:27.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2024-03-19T06:23:27.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2024-03-19T06:23:27.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.527597+0000', 'last_change': '2024-03-19T06:23:20.527597+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.527597+0000', 'last_undegraded': '2024-03-19T06:23:20.527597+0000', 'last_fullsized': '2024-03-19T06:23:20.527597+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-19T06:23:27.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2024-03-19T06:23:27.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-03-19T06:23:27.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.525560+0000', 'last_change': '2024-03-19T06:23:20.525560+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.525560+0000', 'last_undegraded': '2024-03-19T06:23:20.525560+0000', 'last_fullsized': '2024-03-19T06:23:20.525560+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-19T06:23:27.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2024-03-19T06:23:27.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.522810+0000', 'last_change': '2024-03-19T06:23:20.522810+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.522810+0000', 'last_undegraded': '2024-03-19T06:23:20.522810+0000', 'last_fullsized': '2024-03-19T06:23:20.522810+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-19T06:23:27.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2024-03-19T06:23:27.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2024-03-19T06:23:27.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.528087+0000', 'last_change': '2024-03-19T06:23:20.528087+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.528087+0000', 'last_undegraded': '2024-03-19T06:23:20.528087+0000', 'last_fullsized': '2024-03-19T06:23:20.528087+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-19T06:23:27.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2024-03-19T06:23:27.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2024-03-19T06:23:27.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.523919+0000', 'last_change': '2024-03-19T06:23:20.523919+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.523919+0000', 'last_undegraded': '2024-03-19T06:23:20.523919+0000', 'last_fullsized': '2024-03-19T06:23:20.523919+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-19T06:23:27.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2024-03-19T06:23:27.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.525567+0000', 'last_change': '2024-03-19T06:23:20.525567+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.525567+0000', 'last_undegraded': '2024-03-19T06:23:20.525567+0000', 'last_fullsized': '2024-03-19T06:23:20.525567+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-19T06:23:27.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2024-03-19T06:23:27.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2024-03-19T06:23:27.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.525624+0000', 'last_change': '2024-03-19T06:23:20.525624+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.525624+0000', 'last_undegraded': '2024-03-19T06:23:20.525624+0000', 'last_fullsized': '2024-03-19T06:23:20.525624+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-19T06:23:27.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2024-03-19T06:23:27.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2024-03-19T06:23:27.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.524225+0000', 'last_change': '2024-03-19T06:23:20.524225+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.524225+0000', 'last_undegraded': '2024-03-19T06:23:20.524225+0000', 'last_fullsized': '2024-03-19T06:23:20.524225+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-19T06:23:27.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2024-03-19T06:23:27.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2024-03-19T06:23:27.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2024-03-19T06:23:27.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.527545+0000', 'last_change': '2024-03-19T06:23:20.527545+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.527545+0000', 'last_undegraded': '2024-03-19T06:23:20.527545+0000', 'last_fullsized': '2024-03-19T06:23:20.527545+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-19T06:23:27.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2024-03-19T06:23:27.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2024-03-19T06:23:27.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.524063+0000', 'last_change': '2024-03-19T06:23:20.524063+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.524063+0000', 'last_undegraded': '2024-03-19T06:23:20.524063+0000', 'last_fullsized': '2024-03-19T06:23:20.524063+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-19T06:23:27.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2024-03-19T06:23:27.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2024-03-19T06:23:27.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.525492+0000', 'last_change': '2024-03-19T06:23:20.525492+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.525492+0000', 'last_undegraded': '2024-03-19T06:23:20.525492+0000', 'last_fullsized': '2024-03-19T06:23:20.525492+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-19T06:23:27.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2024-03-19T06:23:27.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2024-03-19T06:23:27.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.522805+0000', 'last_change': '2024-03-19T06:23:20.522805+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.522805+0000', 'last_undegraded': '2024-03-19T06:23:20.522805+0000', 'last_fullsized': '2024-03-19T06:23:20.522805+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-19T06:23:27.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2024-03-19T06:23:27.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.527396+0000', 'last_change': '2024-03-19T06:23:20.527396+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.527396+0000', 'last_undegraded': '2024-03-19T06:23:20.527396+0000', 'last_fullsized': '2024-03-19T06:23:20.527396+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-19T06:23:27.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2024-03-19T06:23:27.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2024-03-19T06:23:27.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2024-03-19T06:23:27.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2024-03-19T06:23:27.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.522810+0000', 'last_change': '2024-03-19T06:23:20.522810+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.522810+0000', 'last_undegraded': '2024-03-19T06:23:20.522810+0000', 'last_fullsized': '2024-03-19T06:23:20.522810+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-19T06:23:27.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2024-03-19T06:23:27.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-19T06:23:21.516002+0000', 'last_change': '2024-03-19T06:23:21.516002+0000', 'last_active': '2024-03-19T06:23:21.516002+0000', 'last_peered': '2024-03-19T06:23:21.516002+0000', 'last_clean': '2024-03-19T06:23:21.516002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:21.516002+0000', 'last_undegraded': '2024-03-19T06:23:21.516002+0000', 'last_fullsized': '2024-03-19T06:23:21.516002+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:21.516002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-19T06:23:27.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2024-03-19T06:23:27.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-03-19T06:23:20.528152+0000', 'last_change': '2024-03-19T06:23:20.528152+0000', 'last_active': '2024-03-19T06:23:20.509678+0000', 'last_peered': '2024-03-19T06:23:20.509678+0000', 'last_clean': '2024-03-19T06:23:20.509678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-19T06:23:20.528152+0000', 'last_undegraded': '2024-03-19T06:23:20.528152+0000', 'last_fullsized': '2024-03-19T06:23:20.528152+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'last_clean_scrub_stamp': '2024-03-19T06:23:20.509678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-19T06:23:27.465 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-19T06:23:27.497 INFO:tasks.ceph.mds.b.smithi171.stderr:2024-03-19T06:23:27.511+0000 7f9bd3800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-19T06:23:27.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.627+0000 7fd22f400640 1 Processor -- start 2024-03-19T06:23:27.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.627+0000 7fd22f400640 1 -- start start 2024-03-19T06:23:27.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.631+0000 7fd22f400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd228099a70 0x7fd228099e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:27.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.631+0000 7fd22f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd22806c060 0x7fd22815e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:27.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.631+0000 7fd22f400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22806fbe0 con 0x7fd228161860 2024-03-19T06:23:27.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.631+0000 7fd22f400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22809a390 con 0x7fd22806c060 2024-03-19T06:23:27.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.631+0000 7fd22f400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22815e940 con 0x7fd228099a70 2024-03-19T06:23:27.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.631+0000 7fd21fe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd22806c060 0x7fd22815e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:27.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.631+0000 7fd21fe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd22806c060 0x7fd22815e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40904/0 (socket says 172.21.15.32:40904) 2024-03-19T06:23:27.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.631+0000 7fd21fe00640 1 -- 172.21.15.32:0/3975513064 learned_addr learned my addr 172.21.15.32:0/3975513064 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:27.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.631+0000 7fd22ca00640 1 --2- 172.21.15.32:0/3975513064 >> v2:172.21.15.171:3300/0 conn(0x7fd228099a70 0x7fd228099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:27.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.631+0000 7fd21fe00640 1 -- 172.21.15.32:0/3975513064 >> v2:172.21.15.171:3300/0 conn(0x7fd228099a70 msgr2=0x7fd228099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:27.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.631+0000 7fd21fe00640 1 --2- 172.21.15.32:0/3975513064 >> v2:172.21.15.171:3300/0 conn(0x7fd228099a70 0x7fd228099e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.631+0000 7fd21fe00640 1 -- 172.21.15.32:0/3975513064 >> v1:172.21.15.171:6789/0 conn(0x7fd228161860 legacy=0x7fd228161c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:27.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.631+0000 7fd21fe00640 1 -- 172.21.15.32:0/3975513064 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22815ec20 con 0x7fd22806c060 2024-03-19T06:23:27.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.635+0000 7fd21fe00640 1 --2- 172.21.15.32:0/3975513064 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd22806c060 0x7fd22815e010 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd2280725b0 tx=0x7fd21001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5b6750044d8fa7 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:27.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.635+0000 7fd227e00640 1 -- 172.21.15.32:0/3975513064 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2100ab610 con 0x7fd22806c060 2024-03-19T06:23:27.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.635+0000 7fd227e00640 1 -- 172.21.15.32:0/3975513064 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2100b0070 con 0x7fd22806c060 2024-03-19T06:23:27.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.635+0000 7fd227e00640 1 -- 172.21.15.32:0/3975513064 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2100ab9d0 con 0x7fd22806c060 2024-03-19T06:23:27.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.635+0000 7fd22f400640 1 -- 172.21.15.32:0/3975513064 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd22806c060 msgr2=0x7fd22815e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:27.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.635+0000 7fd22f400640 1 --2- 172.21.15.32:0/3975513064 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd22806c060 0x7fd22815e010 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd2280725b0 tx=0x7fd21001c520 comp rx=0 tx=0).stop 2024-03-19T06:23:27.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.635+0000 7fd22f400640 1 -- 172.21.15.32:0/3975513064 shutdown_connections 2024-03-19T06:23:27.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.635+0000 7fd22f400640 1 --2- 172.21.15.32:0/3975513064 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd22806c060 0x7fd22815e010 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.635+0000 7fd22f400640 1 --2- 172.21.15.32:0/3975513064 >> v2:172.21.15.171:3300/0 conn(0x7fd228099a70 0x7fd228099e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.635+0000 7fd22f400640 1 -- 172.21.15.32:0/3975513064 >> 172.21.15.32:0/3975513064 conn(0x7fd2280b3300 msgr2=0x7fd2280b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:27.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.635+0000 7fd22f400640 1 -- 172.21.15.32:0/3975513064 shutdown_connections 2024-03-19T06:23:27.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.635+0000 7fd22f400640 1 -- 172.21.15.32:0/3975513064 wait complete. 2024-03-19T06:23:27.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.635+0000 7fd22f400640 1 Processor -- start 2024-03-19T06:23:27.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.635+0000 7fd22f400640 1 -- start start 2024-03-19T06:23:27.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22f400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd22806c060 0x7fd2280c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:27.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22f400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd228099a70 0x7fd2280b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:27.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd228161860 0x7fd2280cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:27.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22f400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22815e6d0 con 0x7fd228161860 2024-03-19T06:23:27.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22f400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22815e550 con 0x7fd228099a70 2024-03-19T06:23:27.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22f400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22816b410 con 0x7fd22806c060 2024-03-19T06:23:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22d400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd228161860 0x7fd2280cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22d400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd228161860 0x7fd2280cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40910/0 (socket says 172.21.15.32:40910) 2024-03-19T06:23:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22d400640 1 -- 172.21.15.32:0/2749216993 learned_addr learned my addr 172.21.15.32:0/2749216993 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22ca00640 1 --2- 172.21.15.32:0/2749216993 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd22806c060 0x7fd2280c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd21fe00640 1 --2- 172.21.15.32:0/2749216993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd228099a70 0x7fd2280b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22d400640 1 -- 172.21.15.32:0/2749216993 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd22806c060 msgr2=0x7fd2280c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22d400640 1 --2- 172.21.15.32:0/2749216993 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd22806c060 0x7fd2280c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22d400640 1 -- 172.21.15.32:0/2749216993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd228099a70 msgr2=0x7fd2280b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22d400640 1 --2- 172.21.15.32:0/2749216993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd228099a70 0x7fd2280b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22d400640 1 -- 172.21.15.32:0/2749216993 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2280cc650 con 0x7fd228161860 2024-03-19T06:23:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22d400640 1 --2- 172.21.15.32:0/2749216993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd228161860 0x7fd2280cbe20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd22000c770 tx=0x7fd22000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd225600640 1 -- 172.21.15.32:0/2749216993 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220003b80 con 0x7fd228161860 2024-03-19T06:23:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd225600640 1 -- 172.21.15.32:0/2749216993 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd220003d20 con 0x7fd228161860 2024-03-19T06:23:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22f400640 1 -- 172.21.15.32:0/2749216993 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2280cc930 con 0x7fd228161860 2024-03-19T06:23:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd225600640 1 -- 172.21.15.32:0/2749216993 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000aa90 con 0x7fd228161860 2024-03-19T06:23:27.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22f400640 1 -- 172.21.15.32:0/2749216993 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2280ccef0 con 0x7fd228161860 2024-03-19T06:23:27.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd22f400640 1 -- 172.21.15.32:0/2749216993 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2280749e0 con 0x7fd228161860 2024-03-19T06:23:27.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.639+0000 7fd225600640 1 -- 172.21.15.32:0/2749216993 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd22000ac30 con 0x7fd228161860 2024-03-19T06:23:27.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.643+0000 7fd225600640 1 --2- 172.21.15.32:0/2749216993 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd204067690 0x7fd204069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:27.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.643+0000 7fd225600640 1 -- 172.21.15.32:0/2749216993 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2200857e0 con 0x7fd228161860 2024-03-19T06:23:27.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.643+0000 7fd22ca00640 1 --2- 172.21.15.32:0/2749216993 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd204067690 0x7fd204069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:27.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.643+0000 7fd22ca00640 1 --2- 172.21.15.32:0/2749216993 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd204067690 0x7fd204069b50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd2180079c0 tx=0x7fd218008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:27.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.647+0000 7fd225600640 1 -- 172.21.15.32:0/2749216993 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fd22806fbe0 con 0x7fd228161860 2024-03-19T06:23:27.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.863+0000 7fd22f400640 1 -- 172.21.15.32:0/2749216993 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd2280c8350 con 0x7fd228161860 2024-03-19T06:23:27.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.863+0000 7fd225600640 1 -- 172.21.15.32:0/2749216993 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1335 (secure 0 0 0) 0x7fd220055ce0 con 0x7fd228161860 2024-03-19T06:23:27.853 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:27.853 INFO:teuthology.orchestra.run.smithi032.stdout:{"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":163,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1710829255,"num_in_osds":8,"osd_in_since":1710829246,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":48},{"state_name":"active+clean","count":25},{"state_name":"creating+peering","count":24}],"num_pgs":97,"num_pools":3,"num_objects":10,"data_bytes":591980,"bytes_used":244154368,"bytes_avail":772849958912,"bytes_total":773094113280,"unknown_pgs_ratio":0.49484536051750183,"inactive_pgs_ratio":0.24742268025875092,"write_bytes_sec":565,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":26,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":5934}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-03-19T06:23:07.948937+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-03-19T06:23:27.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.867+0000 7fd22f400640 1 -- 172.21.15.32:0/2749216993 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd204067690 msgr2=0x7fd204069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:27.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.867+0000 7fd22f400640 1 --2- 172.21.15.32:0/2749216993 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd204067690 0x7fd204069b50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd2180079c0 tx=0x7fd218008040 comp rx=0 tx=0).stop 2024-03-19T06:23:27.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.867+0000 7fd22f400640 1 -- 172.21.15.32:0/2749216993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd228161860 msgr2=0x7fd2280cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:27.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.867+0000 7fd22f400640 1 --2- 172.21.15.32:0/2749216993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd228161860 0x7fd2280cbe20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd22000c770 tx=0x7fd22000cc30 comp rx=0 tx=0).stop 2024-03-19T06:23:27.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.867+0000 7fd22f400640 1 -- 172.21.15.32:0/2749216993 shutdown_connections 2024-03-19T06:23:27.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.867+0000 7fd22f400640 1 --2- 172.21.15.32:0/2749216993 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd204067690 0x7fd204069b50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.867+0000 7fd22f400640 1 --2- 172.21.15.32:0/2749216993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd228161860 0x7fd2280cbe20 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.867+0000 7fd22f400640 1 --2- 172.21.15.32:0/2749216993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd228099a70 0x7fd2280b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.867+0000 7fd22f400640 1 --2- 172.21.15.32:0/2749216993 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd22806c060 0x7fd2280c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:27.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.867+0000 7fd22f400640 1 -- 172.21.15.32:0/2749216993 >> 172.21.15.32:0/2749216993 conn(0x7fd2280b3300 msgr2=0x7fd2280b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:27.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.867+0000 7fd22f400640 1 -- 172.21.15.32:0/2749216993 shutdown_connections 2024-03-19T06:23:27.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:27.867+0000 7fd22f400640 1 -- 172.21.15.32:0/2749216993 wait complete. 2024-03-19T06:23:27.875 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-19T06:23:27.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:23:28.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.027+0000 7f2000000640 1 Processor -- start 2024-03-19T06:23:28.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.027+0000 7f2000000640 1 -- start start 2024-03-19T06:23:28.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.031+0000 7f2000000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1ff806c460 0x7f1ff80700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:28.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.031+0000 7f2000000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ff80cc150 0x7f1ff815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:28.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.031+0000 7f2000000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff806e550 con 0x7f1ff815bbf0 2024-03-19T06:23:28.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.031+0000 7f2000000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff806ece0 con 0x7f1ff806c460 2024-03-19T06:23:28.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.031+0000 7f2000000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff80cc5e0 con 0x7f1ff80cc150 2024-03-19T06:23:28.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.031+0000 7f1ffcc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1ff806c460 0x7f1ff80700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:28.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.031+0000 7f1ffcc00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1ff806c460 0x7f1ff80700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40920/0 (socket says 172.21.15.32:40920) 2024-03-19T06:23:28.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.031+0000 7f1ffcc00640 1 -- 172.21.15.32:0/3581856636 learned_addr learned my addr 172.21.15.32:0/3581856636 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:28.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.031+0000 7f1ffe000640 1 --2- 172.21.15.32:0/3581856636 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ff80cc150 0x7f1ff815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:28.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.031+0000 7f1ffcc00640 1 -- 172.21.15.32:0/3581856636 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ff80cc150 msgr2=0x7f1ff815bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:28.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.031+0000 7f1ffcc00640 1 --2- 172.21.15.32:0/3581856636 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ff80cc150 0x7f1ff815bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:28.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.031+0000 7f1ffcc00640 1 -- 172.21.15.32:0/3581856636 >> v1:172.21.15.171:6789/0 conn(0x7f1ff815bbf0 legacy=0x7f1ff806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:28.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.031+0000 7f1ffcc00640 1 -- 172.21.15.32:0/3581856636 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff80b49b0 con 0x7f1ff806c460 2024-03-19T06:23:28.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.031+0000 7f1ffe000640 1 --2- 172.21.15.32:0/3581856636 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ff80cc150 0x7f1ff815bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:28.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.035+0000 7f1ffcc00640 1 --2- 172.21.15.32:0/3581856636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ff806c460 0x7f1ff80700f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009870 tx=0x7f1fe401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c5bf2be5fe7862 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:28.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.035+0000 7f1ff7e00640 1 -- 172.21.15.32:0/3581856636 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40b0070 con 0x7f1ff806c460 2024-03-19T06:23:28.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.035+0000 7f1ff7e00640 1 -- 172.21.15.32:0/3581856636 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe40ab600 con 0x7f1ff806c460 2024-03-19T06:23:28.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.035+0000 7f1ff7e00640 1 -- 172.21.15.32:0/3581856636 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40ab9d0 con 0x7f1ff806c460 2024-03-19T06:23:28.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.035+0000 7f2000000640 1 -- 172.21.15.32:0/3581856636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ff806c460 msgr2=0x7f1ff80700f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:28.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.035+0000 7f2000000640 1 --2- 172.21.15.32:0/3581856636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ff806c460 0x7f1ff80700f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009870 tx=0x7f1fe401c4d0 comp rx=0 tx=0).stop 2024-03-19T06:23:28.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.035+0000 7f2000000640 1 -- 172.21.15.32:0/3581856636 shutdown_connections 2024-03-19T06:23:28.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.035+0000 7f2000000640 1 --2- 172.21.15.32:0/3581856636 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ff80cc150 0x7f1ff815bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:28.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.035+0000 7f2000000640 1 --2- 172.21.15.32:0/3581856636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ff806c460 0x7f1ff80700f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:28.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.035+0000 7f2000000640 1 -- 172.21.15.32:0/3581856636 >> 172.21.15.32:0/3581856636 conn(0x7f1ff8071c50 msgr2=0x7f1ff8072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:28.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.035+0000 7f2000000640 1 -- 172.21.15.32:0/3581856636 shutdown_connections 2024-03-19T06:23:28.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.035+0000 7f2000000640 1 -- 172.21.15.32:0/3581856636 wait complete. 2024-03-19T06:23:28.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.035+0000 7f2000000640 1 Processor -- start 2024-03-19T06:23:28.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.035+0000 7f2000000640 1 -- start start 2024-03-19T06:23:28.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f2000000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ff806c460 0x7f1ff8144c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:28.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f2000000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ff80cc150 0x7f1ff80ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:28.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f2000000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ff815bbf0 0x7f1ff80ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:28.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f2000000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff815d0f0 con 0x7f1ff815bbf0 2024-03-19T06:23:28.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f2000000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff815cf70 con 0x7f1ff80cc150 2024-03-19T06:23:28.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f2000000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff815d270 con 0x7f1ff806c460 2024-03-19T06:23:28.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f1ffe000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ff815bbf0 0x7f1ff80ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:28.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f1ffe000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ff815bbf0 0x7f1ff80ad050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40932/0 (socket says 172.21.15.32:40932) 2024-03-19T06:23:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f1ffe000640 1 -- 172.21.15.32:0/3079349785 learned_addr learned my addr 172.21.15.32:0/3079349785 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f1ffd600640 1 --2- 172.21.15.32:0/3079349785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ff806c460 0x7f1ff8144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f1ffcc00640 1 --2- 172.21.15.32:0/3079349785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ff80cc150 0x7f1ff80ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f1ffe000640 1 -- 172.21.15.32:0/3079349785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ff806c460 msgr2=0x7f1ff8144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f1ffe000640 1 --2- 172.21.15.32:0/3079349785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ff806c460 0x7f1ff8144c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f1ffe000640 1 -- 172.21.15.32:0/3079349785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ff80cc150 msgr2=0x7f1ff80ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f1ffe000640 1 --2- 172.21.15.32:0/3079349785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ff80cc150 0x7f1ff80ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f1ffe000640 1 -- 172.21.15.32:0/3079349785 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff80ad940 con 0x7f1ff815bbf0 2024-03-19T06:23:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f1ffe000640 1 --2- 172.21.15.32:0/3079349785 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ff815bbf0 0x7f1ff80ad050 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000cd80 tx=0x7f1ff000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f1ff5600640 1 -- 172.21.15.32:0/3079349785 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000f680 con 0x7f1ff815bbf0 2024-03-19T06:23:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f1ff5600640 1 -- 172.21.15.32:0/3079349785 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff000f840 con 0x7f1ff815bbf0 2024-03-19T06:23:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f1ff5600640 1 -- 172.21.15.32:0/3079349785 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000fc30 con 0x7f1ff815bbf0 2024-03-19T06:23:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f2000000640 1 -- 172.21.15.32:0/3079349785 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff80adc20 con 0x7f1ff815bbf0 2024-03-19T06:23:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f2000000640 1 -- 172.21.15.32:0/3079349785 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff80ae1e0 con 0x7f1ff815bbf0 2024-03-19T06:23:28.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f2000000640 1 -- 172.21.15.32:0/3079349785 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff80749e0 con 0x7f1ff815bbf0 2024-03-19T06:23:28.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.039+0000 7f1ff5600640 1 -- 172.21.15.32:0/3079349785 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1ff00213f0 con 0x7f1ff815bbf0 2024-03-19T06:23:28.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.043+0000 7f1ff5600640 1 --2- 172.21.15.32:0/3079349785 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1fd8067690 0x7f1fd8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:28.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.043+0000 7f1ff5600640 1 -- 172.21.15.32:0/3079349785 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ff00865b0 con 0x7f1ff815bbf0 2024-03-19T06:23:28.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.043+0000 7f1ffd600640 1 --2- 172.21.15.32:0/3079349785 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1fd8067690 0x7f1fd8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:28.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.043+0000 7f1ffd600640 1 --2- 172.21.15.32:0/3079349785 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1fd8067690 0x7f1fd8069b50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1ff815d660 tx=0x7f1fec009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:28.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.047+0000 7f1ff5600640 1 -- 172.21.15.32:0/3079349785 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f1ff0014030 con 0x7f1ff815bbf0 2024-03-19T06:23:28.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.207+0000 7f2000000640 1 -- 172.21.15.32:0/3079349785 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ff80722f0 con 0x7f1fd8067690 2024-03-19T06:23:28.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.211+0000 7f1ff5600640 1 -- 172.21.15.32:0/3079349785 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251956 (secure 0 0 0) 0x7f1ff80722f0 con 0x7f1fd8067690 2024-03-19T06:23:28.204 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:28.205 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:23:28.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.215+0000 7f2000000640 1 -- 172.21.15.32:0/3079349785 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1fd8067690 msgr2=0x7f1fd8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:28.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.215+0000 7f2000000640 1 --2- 172.21.15.32:0/3079349785 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1fd8067690 0x7f1fd8069b50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1ff815d660 tx=0x7f1fec009040 comp rx=0 tx=0).stop 2024-03-19T06:23:28.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.215+0000 7f2000000640 1 -- 172.21.15.32:0/3079349785 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ff815bbf0 msgr2=0x7f1ff80ad050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:28.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.215+0000 7f2000000640 1 --2- 172.21.15.32:0/3079349785 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ff815bbf0 0x7f1ff80ad050 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000cd80 tx=0x7f1ff000a650 comp rx=0 tx=0).stop 2024-03-19T06:23:28.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.215+0000 7f2000000640 1 -- 172.21.15.32:0/3079349785 shutdown_connections 2024-03-19T06:23:28.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.215+0000 7f2000000640 1 --2- 172.21.15.32:0/3079349785 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1fd8067690 0x7f1fd8069b50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:28.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.215+0000 7f2000000640 1 --2- 172.21.15.32:0/3079349785 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ff815bbf0 0x7f1ff80ad050 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:28.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.215+0000 7f2000000640 1 --2- 172.21.15.32:0/3079349785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ff80cc150 0x7f1ff80ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:28.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.215+0000 7f2000000640 1 --2- 172.21.15.32:0/3079349785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1ff806c460 0x7f1ff8144c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:28.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.215+0000 7f2000000640 1 -- 172.21.15.32:0/3079349785 >> 172.21.15.32:0/3079349785 conn(0x7f1ff8071c50 msgr2=0x7f1ff814d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:28.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.215+0000 7f2000000640 1 -- 172.21.15.32:0/3079349785 shutdown_connections 2024-03-19T06:23:28.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:28.215+0000 7f2000000640 1 -- 172.21.15.32:0/3079349785 wait complete. 2024-03-19T06:23:28.224 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-03-19T06:23:27.953443+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238732,"kb_used_data":5896,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735988,"statfs":{"total":773094113280,"available":772849651712,"internally_reserved":0,"allocated":6037504,"data_stored":3168332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.428678"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223358+0000","last_change":"2024-03-19T06:23:22.556006+0000","last_active":"2024-03-19T06:23:24.223358+0000","last_peered":"2024-03-19T06:23:24.223358+0000","last_clean":"2024-03-19T06:23:24.223358+0000","last_became_active":"2024-03-19T06:23:22.555739+0000","last_became_peered":"2024-03-19T06:23:22.555739+0000","last_unstale":"2024-03-19T06:23:24.223358+0000","last_undegraded":"2024-03-19T06:23:24.223358+0000","last_fullsized":"2024-03-19T06:23:24.223358+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:18:27.626345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573450+0000","last_change":"2024-03-19T06:23:22.564365+0000","last_active":"2024-03-19T06:23:23.573450+0000","last_peered":"2024-03-19T06:23:23.573450+0000","last_clean":"2024-03-19T06:23:23.573450+0000","last_became_active":"2024-03-19T06:23:22.564048+0000","last_became_peered":"2024-03-19T06:23:22.564048+0000","last_unstale":"2024-03-19T06:23:23.573450+0000","last_undegraded":"2024-03-19T06:23:23.573450+0000","last_fullsized":"2024-03-19T06:23:23.573450+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:27:24.967815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568202+0000","last_change":"2024-03-19T06:23:22.565721+0000","last_active":"2024-03-19T06:23:23.568202+0000","last_peered":"2024-03-19T06:23:23.568202+0000","last_clean":"2024-03-19T06:23:23.568202+0000","last_became_active":"2024-03-19T06:23:22.565219+0000","last_became_peered":"2024-03-19T06:23:22.565219+0000","last_unstale":"2024-03-19T06:23:23.568202+0000","last_undegraded":"2024-03-19T06:23:23.568202+0000","last_fullsized":"2024-03-19T06:23:23.568202+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:30:59.786364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573495+0000","last_change":"2024-03-19T06:23:22.568643+0000","last_active":"2024-03-19T06:23:23.573495+0000","last_peered":"2024-03-19T06:23:23.573495+0000","last_clean":"2024-03-19T06:23:23.573495+0000","last_became_active":"2024-03-19T06:23:22.567759+0000","last_became_peered":"2024-03-19T06:23:22.567759+0000","last_unstale":"2024-03-19T06:23:23.573495+0000","last_undegraded":"2024-03-19T06:23:23.573495+0000","last_fullsized":"2024-03-19T06:23:23.573495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:09:20.145820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558640+0000","last_change":"2024-03-19T06:23:22.557767+0000","last_active":"2024-03-19T06:23:23.558640+0000","last_peered":"2024-03-19T06:23:23.558640+0000","last_clean":"2024-03-19T06:23:23.558640+0000","last_became_active":"2024-03-19T06:23:22.557450+0000","last_became_peered":"2024-03-19T06:23:22.557450+0000","last_unstale":"2024-03-19T06:23:23.558640+0000","last_undegraded":"2024-03-19T06:23:23.558640+0000","last_fullsized":"2024-03-19T06:23:23.558640+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:42:44.189385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223031+0000","last_change":"2024-03-19T06:23:22.565105+0000","last_active":"2024-03-19T06:23:24.223031+0000","last_peered":"2024-03-19T06:23:24.223031+0000","last_clean":"2024-03-19T06:23:24.223031+0000","last_became_active":"2024-03-19T06:23:22.564552+0000","last_became_peered":"2024-03-19T06:23:22.564552+0000","last_unstale":"2024-03-19T06:23:24.223031+0000","last_undegraded":"2024-03-19T06:23:24.223031+0000","last_fullsized":"2024-03-19T06:23:24.223031+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:29:57.289951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.567724+0000","last_change":"2024-03-19T06:23:22.559440+0000","last_active":"2024-03-19T06:23:23.567724+0000","last_peered":"2024-03-19T06:23:23.567724+0000","last_clean":"2024-03-19T06:23:23.567724+0000","last_became_active":"2024-03-19T06:23:22.557049+0000","last_became_peered":"2024-03-19T06:23:22.557049+0000","last_unstale":"2024-03-19T06:23:23.567724+0000","last_undegraded":"2024-03-19T06:23:23.567724+0000","last_fullsized":"2024-03-19T06:23:23.567724+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:22:05.889382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552568+0000","last_change":"2024-03-19T06:23:22.553064+0000","last_active":"2024-03-19T06:23:23.552568+0000","last_peered":"2024-03-19T06:23:23.552568+0000","last_clean":"2024-03-19T06:23:23.552568+0000","last_became_active":"2024-03-19T06:23:22.552784+0000","last_became_peered":"2024-03-19T06:23:22.552784+0000","last_unstale":"2024-03-19T06:23:23.552568+0000","last_undegraded":"2024-03-19T06:23:23.552568+0000","last_fullsized":"2024-03-19T06:23:23.552568+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:28.771832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553240+0000","last_change":"2024-03-19T06:23:22.562187+0000","last_active":"2024-03-19T06:23:23.553240+0000","last_peered":"2024-03-19T06:23:23.553240+0000","last_clean":"2024-03-19T06:23:23.553240+0000","last_became_active":"2024-03-19T06:23:22.561713+0000","last_became_peered":"2024-03-19T06:23:22.561713+0000","last_unstale":"2024-03-19T06:23:23.553240+0000","last_undegraded":"2024-03-19T06:23:23.553240+0000","last_fullsized":"2024-03-19T06:23:23.553240+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:29:22.406290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223941+0000","last_change":"2024-03-19T06:23:22.561140+0000","last_active":"2024-03-19T06:23:24.223941+0000","last_peered":"2024-03-19T06:23:24.223941+0000","last_clean":"2024-03-19T06:23:24.223941+0000","last_became_active":"2024-03-19T06:23:22.560616+0000","last_became_peered":"2024-03-19T06:23:22.560616+0000","last_unstale":"2024-03-19T06:23:24.223941+0000","last_undegraded":"2024-03-19T06:23:24.223941+0000","last_fullsized":"2024-03-19T06:23:24.223941+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:30:39.146236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223730+0000","last_change":"2024-03-19T06:23:22.564446+0000","last_active":"2024-03-19T06:23:24.223730+0000","last_peered":"2024-03-19T06:23:24.223730+0000","last_clean":"2024-03-19T06:23:24.223730+0000","last_became_active":"2024-03-19T06:23:22.563708+0000","last_became_peered":"2024-03-19T06:23:22.563708+0000","last_unstale":"2024-03-19T06:23:24.223730+0000","last_undegraded":"2024-03-19T06:23:24.223730+0000","last_fullsized":"2024-03-19T06:23:24.223730+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:44:10.012000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553069+0000","last_change":"2024-03-19T06:23:22.556143+0000","last_active":"2024-03-19T06:23:23.553069+0000","last_peered":"2024-03-19T06:23:23.553069+0000","last_clean":"2024-03-19T06:23:23.553069+0000","last_became_active":"2024-03-19T06:23:22.555873+0000","last_became_peered":"2024-03-19T06:23:22.555873+0000","last_unstale":"2024-03-19T06:23:23.553069+0000","last_undegraded":"2024-03-19T06:23:23.553069+0000","last_fullsized":"2024-03-19T06:23:23.553069+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:37:24.117721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223498+0000","last_change":"2024-03-19T06:23:22.564190+0000","last_active":"2024-03-19T06:23:24.223498+0000","last_peered":"2024-03-19T06:23:24.223498+0000","last_clean":"2024-03-19T06:23:24.223498+0000","last_became_active":"2024-03-19T06:23:22.563678+0000","last_became_peered":"2024-03-19T06:23:22.563678+0000","last_unstale":"2024-03-19T06:23:24.223498+0000","last_undegraded":"2024-03-19T06:23:24.223498+0000","last_fullsized":"2024-03-19T06:23:24.223498+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:37:27.384192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568113+0000","last_change":"2024-03-19T06:23:22.550982+0000","last_active":"2024-03-19T06:23:23.568113+0000","last_peered":"2024-03-19T06:23:23.568113+0000","last_clean":"2024-03-19T06:23:23.568113+0000","last_became_active":"2024-03-19T06:23:22.550671+0000","last_became_peered":"2024-03-19T06:23:22.550671+0000","last_unstale":"2024-03-19T06:23:23.568113+0000","last_undegraded":"2024-03-19T06:23:23.568113+0000","last_fullsized":"2024-03-19T06:23:23.568113+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:57:42.655980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573114+0000","last_change":"2024-03-19T06:23:22.556917+0000","last_active":"2024-03-19T06:23:23.573114+0000","last_peered":"2024-03-19T06:23:23.573114+0000","last_clean":"2024-03-19T06:23:23.573114+0000","last_became_active":"2024-03-19T06:23:22.556651+0000","last_became_peered":"2024-03-19T06:23:22.556651+0000","last_unstale":"2024-03-19T06:23:23.573114+0000","last_undegraded":"2024-03-19T06:23:23.573114+0000","last_fullsized":"2024-03-19T06:23:23.573114+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:12:33.501231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223012+0000","last_change":"2024-03-19T06:23:22.561422+0000","last_active":"2024-03-19T06:23:24.223012+0000","last_peered":"2024-03-19T06:23:24.223012+0000","last_clean":"2024-03-19T06:23:24.223012+0000","last_became_active":"2024-03-19T06:23:22.560682+0000","last_became_peered":"2024-03-19T06:23:22.560682+0000","last_unstale":"2024-03-19T06:23:24.223012+0000","last_undegraded":"2024-03-19T06:23:24.223012+0000","last_fullsized":"2024-03-19T06:23:24.223012+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:57:39.130347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568549+0000","last_change":"2024-03-19T06:23:22.553404+0000","last_active":"2024-03-19T06:23:23.568549+0000","last_peered":"2024-03-19T06:23:23.568549+0000","last_clean":"2024-03-19T06:23:23.568549+0000","last_became_active":"2024-03-19T06:23:22.551422+0000","last_became_peered":"2024-03-19T06:23:22.551422+0000","last_unstale":"2024-03-19T06:23:23.568549+0000","last_undegraded":"2024-03-19T06:23:23.568549+0000","last_fullsized":"2024-03-19T06:23:23.568549+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:27:24.967815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573533+0000","last_change":"2024-03-19T06:23:22.564481+0000","last_active":"2024-03-19T06:23:23.573533+0000","last_peered":"2024-03-19T06:23:23.573533+0000","last_clean":"2024-03-19T06:23:23.573533+0000","last_became_active":"2024-03-19T06:23:22.564130+0000","last_became_peered":"2024-03-19T06:23:22.564130+0000","last_unstale":"2024-03-19T06:23:23.573533+0000","last_undegraded":"2024-03-19T06:23:23.573533+0000","last_fullsized":"2024-03-19T06:23:23.573533+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:01:19.343255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568259+0000","last_change":"2024-03-19T06:23:22.542721+0000","last_active":"2024-03-19T06:23:23.568259+0000","last_peered":"2024-03-19T06:23:23.568259+0000","last_clean":"2024-03-19T06:23:23.568259+0000","last_became_active":"2024-03-19T06:23:22.542437+0000","last_became_peered":"2024-03-19T06:23:22.542437+0000","last_unstale":"2024-03-19T06:23:23.568259+0000","last_undegraded":"2024-03-19T06:23:23.568259+0000","last_fullsized":"2024-03-19T06:23:23.568259+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:02:35.487477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225451+0000","last_change":"2024-03-19T06:23:22.552414+0000","last_active":"2024-03-19T06:23:24.225451+0000","last_peered":"2024-03-19T06:23:24.225451+0000","last_clean":"2024-03-19T06:23:24.225451+0000","last_became_active":"2024-03-19T06:23:22.552101+0000","last_became_peered":"2024-03-19T06:23:22.552101+0000","last_unstale":"2024-03-19T06:23:24.225451+0000","last_undegraded":"2024-03-19T06:23:24.225451+0000","last_fullsized":"2024-03-19T06:23:24.225451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:28:14.347499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225377+0000","last_change":"2024-03-19T06:23:22.561105+0000","last_active":"2024-03-19T06:23:24.225377+0000","last_peered":"2024-03-19T06:23:24.225377+0000","last_clean":"2024-03-19T06:23:24.225377+0000","last_became_active":"2024-03-19T06:23:22.560909+0000","last_became_peered":"2024-03-19T06:23:22.560909+0000","last_unstale":"2024-03-19T06:23:24.225377+0000","last_undegraded":"2024-03-19T06:23:24.225377+0000","last_fullsized":"2024-03-19T06:23:24.225377+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:01:57.316320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552509+0000","last_change":"2024-03-19T06:23:22.549825+0000","last_active":"2024-03-19T06:23:23.552509+0000","last_peered":"2024-03-19T06:23:23.552509+0000","last_clean":"2024-03-19T06:23:23.552509+0000","last_became_active":"2024-03-19T06:23:22.549560+0000","last_became_peered":"2024-03-19T06:23:22.549560+0000","last_unstale":"2024-03-19T06:23:23.552509+0000","last_undegraded":"2024-03-19T06:23:23.552509+0000","last_fullsized":"2024-03-19T06:23:23.552509+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:20:48.708717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223419+0000","last_change":"2024-03-19T06:23:22.559003+0000","last_active":"2024-03-19T06:23:24.223419+0000","last_peered":"2024-03-19T06:23:24.223419+0000","last_clean":"2024-03-19T06:23:24.223419+0000","last_became_active":"2024-03-19T06:23:22.558717+0000","last_became_peered":"2024-03-19T06:23:22.558717+0000","last_unstale":"2024-03-19T06:23:24.223419+0000","last_undegraded":"2024-03-19T06:23:24.223419+0000","last_fullsized":"2024-03-19T06:23:24.223419+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:57:00.991266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.567679+0000","last_change":"2024-03-19T06:23:22.551756+0000","last_active":"2024-03-19T06:23:23.567679+0000","last_peered":"2024-03-19T06:23:23.567679+0000","last_clean":"2024-03-19T06:23:23.567679+0000","last_became_active":"2024-03-19T06:23:22.550853+0000","last_became_peered":"2024-03-19T06:23:22.550853+0000","last_unstale":"2024-03-19T06:23:23.567679+0000","last_undegraded":"2024-03-19T06:23:23.567679+0000","last_fullsized":"2024-03-19T06:23:23.567679+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:30:39.146236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568582+0000","last_change":"2024-03-19T06:23:22.552829+0000","last_active":"2024-03-19T06:23:23.568582+0000","last_peered":"2024-03-19T06:23:23.568582+0000","last_clean":"2024-03-19T06:23:23.568582+0000","last_became_active":"2024-03-19T06:23:22.552149+0000","last_became_peered":"2024-03-19T06:23:22.552149+0000","last_unstale":"2024-03-19T06:23:23.568582+0000","last_undegraded":"2024-03-19T06:23:23.568582+0000","last_fullsized":"2024-03-19T06:23:23.568582+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:09:20.145820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552977+0000","last_change":"2024-03-19T06:23:22.558146+0000","last_active":"2024-03-19T06:23:23.552977+0000","last_peered":"2024-03-19T06:23:23.552977+0000","last_clean":"2024-03-19T06:23:23.552977+0000","last_became_active":"2024-03-19T06:23:22.557844+0000","last_became_peered":"2024-03-19T06:23:22.557844+0000","last_unstale":"2024-03-19T06:23:23.552977+0000","last_undegraded":"2024-03-19T06:23:23.552977+0000","last_fullsized":"2024-03-19T06:23:23.552977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:15.576529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223864+0000","last_change":"2024-03-19T06:23:22.561217+0000","last_active":"2024-03-19T06:23:24.223864+0000","last_peered":"2024-03-19T06:23:24.223864+0000","last_clean":"2024-03-19T06:23:24.223864+0000","last_became_active":"2024-03-19T06:23:22.560143+0000","last_became_peered":"2024-03-19T06:23:22.560143+0000","last_unstale":"2024-03-19T06:23:24.223864+0000","last_undegraded":"2024-03-19T06:23:24.223864+0000","last_fullsized":"2024-03-19T06:23:24.223864+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:04:53.083460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225509+0000","last_change":"2024-03-19T06:23:22.558069+0000","last_active":"2024-03-19T06:23:24.225509+0000","last_peered":"2024-03-19T06:23:24.225509+0000","last_clean":"2024-03-19T06:23:24.225509+0000","last_became_active":"2024-03-19T06:23:22.557707+0000","last_became_peered":"2024-03-19T06:23:22.557707+0000","last_unstale":"2024-03-19T06:23:24.225509+0000","last_undegraded":"2024-03-19T06:23:24.225509+0000","last_fullsized":"2024-03-19T06:23:24.225509+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:00:11.535021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.567930+0000","last_change":"2024-03-19T06:23:22.556610+0000","last_active":"2024-03-19T06:23:23.567930+0000","last_peered":"2024-03-19T06:23:23.567930+0000","last_clean":"2024-03-19T06:23:23.567930+0000","last_became_active":"2024-03-19T06:23:22.556248+0000","last_became_peered":"2024-03-19T06:23:22.556248+0000","last_unstale":"2024-03-19T06:23:23.567930+0000","last_undegraded":"2024-03-19T06:23:23.567930+0000","last_fullsized":"2024-03-19T06:23:23.567930+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:53:15.745172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573135+0000","last_change":"2024-03-19T06:23:22.558146+0000","last_active":"2024-03-19T06:23:23.573135+0000","last_peered":"2024-03-19T06:23:23.573135+0000","last_clean":"2024-03-19T06:23:23.573135+0000","last_became_active":"2024-03-19T06:23:22.557847+0000","last_became_peered":"2024-03-19T06:23:22.557847+0000","last_unstale":"2024-03-19T06:23:23.573135+0000","last_undegraded":"2024-03-19T06:23:23.573135+0000","last_fullsized":"2024-03-19T06:23:23.573135+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:07:49.805383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.567833+0000","last_change":"2024-03-19T06:23:22.551692+0000","last_active":"2024-03-19T06:23:23.567833+0000","last_peered":"2024-03-19T06:23:23.567833+0000","last_clean":"2024-03-19T06:23:23.567833+0000","last_became_active":"2024-03-19T06:23:22.551331+0000","last_became_peered":"2024-03-19T06:23:22.551331+0000","last_unstale":"2024-03-19T06:23:23.567833+0000","last_undegraded":"2024-03-19T06:23:23.567833+0000","last_fullsized":"2024-03-19T06:23:23.567833+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:33:41.315756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557293+0000","last_change":"2024-03-19T06:23:22.554941+0000","last_active":"2024-03-19T06:23:23.557293+0000","last_peered":"2024-03-19T06:23:23.557293+0000","last_clean":"2024-03-19T06:23:23.557293+0000","last_became_active":"2024-03-19T06:23:22.554414+0000","last_became_peered":"2024-03-19T06:23:22.554414+0000","last_unstale":"2024-03-19T06:23:23.557293+0000","last_undegraded":"2024-03-19T06:23:23.557293+0000","last_fullsized":"2024-03-19T06:23:23.557293+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:53:15.745172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573021+0000","last_change":"2024-03-19T06:23:22.561342+0000","last_active":"2024-03-19T06:23:23.573021+0000","last_peered":"2024-03-19T06:23:23.573021+0000","last_clean":"2024-03-19T06:23:23.573021+0000","last_became_active":"2024-03-19T06:23:22.561057+0000","last_became_peered":"2024-03-19T06:23:22.561057+0000","last_unstale":"2024-03-19T06:23:23.573021+0000","last_undegraded":"2024-03-19T06:23:23.573021+0000","last_fullsized":"2024-03-19T06:23:23.573021+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:02:35.487477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225475+0000","last_change":"2024-03-19T06:23:21.541498+0000","last_active":"2024-03-19T06:23:24.225475+0000","last_peered":"2024-03-19T06:23:24.225475+0000","last_clean":"2024-03-19T06:23:24.225475+0000","last_became_active":"2024-03-19T06:23:21.541244+0000","last_became_peered":"2024-03-19T06:23:21.541244+0000","last_unstale":"2024-03-19T06:23:24.225475+0000","last_undegraded":"2024-03-19T06:23:24.225475+0000","last_fullsized":"2024-03-19T06:23:24.225475+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:19:35.590492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557141+0000","last_change":"2024-03-19T06:23:22.555426+0000","last_active":"2024-03-19T06:23:23.557141+0000","last_peered":"2024-03-19T06:23:23.557141+0000","last_clean":"2024-03-19T06:23:23.557141+0000","last_became_active":"2024-03-19T06:23:22.555140+0000","last_became_peered":"2024-03-19T06:23:22.555140+0000","last_unstale":"2024-03-19T06:23:23.557141+0000","last_undegraded":"2024-03-19T06:23:23.557141+0000","last_fullsized":"2024-03-19T06:23:23.557141+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:22:05.889382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223919+0000","last_change":"2024-03-19T06:23:21.540448+0000","last_active":"2024-03-19T06:23:24.223919+0000","last_peered":"2024-03-19T06:23:24.223919+0000","last_clean":"2024-03-19T06:23:24.223919+0000","last_became_active":"2024-03-19T06:23:21.540108+0000","last_became_peered":"2024-03-19T06:23:21.540108+0000","last_unstale":"2024-03-19T06:23:24.223919+0000","last_undegraded":"2024-03-19T06:23:24.223919+0000","last_fullsized":"2024-03-19T06:23:24.223919+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:06:00.013901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225188+0000","last_change":"2024-03-19T06:23:22.563673+0000","last_active":"2024-03-19T06:23:24.225188+0000","last_peered":"2024-03-19T06:23:24.225188+0000","last_clean":"2024-03-19T06:23:24.225188+0000","last_became_active":"2024-03-19T06:23:22.563364+0000","last_became_peered":"2024-03-19T06:23:22.563364+0000","last_unstale":"2024-03-19T06:23:24.225188+0000","last_undegraded":"2024-03-19T06:23:24.225188+0000","last_fullsized":"2024-03-19T06:23:24.225188+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:47:22.856227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223766+0000","last_change":"2024-03-19T06:23:21.541004+0000","last_active":"2024-03-19T06:23:24.223766+0000","last_peered":"2024-03-19T06:23:24.223766+0000","last_clean":"2024-03-19T06:23:24.223766+0000","last_became_active":"2024-03-19T06:23:21.540092+0000","last_became_peered":"2024-03-19T06:23:21.540092+0000","last_unstale":"2024-03-19T06:23:24.223766+0000","last_undegraded":"2024-03-19T06:23:24.223766+0000","last_fullsized":"2024-03-19T06:23:24.223766+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:00:10.528696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552538+0000","last_change":"2024-03-19T06:23:22.564698+0000","last_active":"2024-03-19T06:23:23.552538+0000","last_peered":"2024-03-19T06:23:23.552538+0000","last_clean":"2024-03-19T06:23:23.552538+0000","last_became_active":"2024-03-19T06:23:22.564416+0000","last_became_peered":"2024-03-19T06:23:22.564416+0000","last_unstale":"2024-03-19T06:23:23.552538+0000","last_undegraded":"2024-03-19T06:23:23.552538+0000","last_fullsized":"2024-03-19T06:23:23.552538+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:33:17.743019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557412+0000","last_change":"2024-03-19T06:23:21.542555+0000","last_active":"2024-03-19T06:23:23.557412+0000","last_peered":"2024-03-19T06:23:23.557412+0000","last_clean":"2024-03-19T06:23:23.557412+0000","last_became_active":"2024-03-19T06:23:21.542296+0000","last_became_peered":"2024-03-19T06:23:21.542296+0000","last_unstale":"2024-03-19T06:23:23.557412+0000","last_undegraded":"2024-03-19T06:23:23.557412+0000","last_fullsized":"2024-03-19T06:23:23.557412+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:57:38.124022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558898+0000","last_change":"2024-03-19T06:23:22.551285+0000","last_active":"2024-03-19T06:23:23.558898+0000","last_peered":"2024-03-19T06:23:23.558898+0000","last_clean":"2024-03-19T06:23:23.558898+0000","last_became_active":"2024-03-19T06:23:22.550894+0000","last_became_peered":"2024-03-19T06:23:22.550894+0000","last_unstale":"2024-03-19T06:23:23.558898+0000","last_undegraded":"2024-03-19T06:23:23.558898+0000","last_fullsized":"2024-03-19T06:23:23.558898+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:43:42.939501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.567838+0000","last_change":"2024-03-19T06:23:21.545414+0000","last_active":"2024-03-19T06:23:23.567838+0000","last_peered":"2024-03-19T06:23:23.567838+0000","last_clean":"2024-03-19T06:23:23.567838+0000","last_became_active":"2024-03-19T06:23:21.545120+0000","last_became_peered":"2024-03-19T06:23:21.545120+0000","last_unstale":"2024-03-19T06:23:23.567838+0000","last_undegraded":"2024-03-19T06:23:23.567838+0000","last_fullsized":"2024-03-19T06:23:23.567838+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:06:00.013901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573273+0000","last_change":"2024-03-19T06:23:22.562383+0000","last_active":"2024-03-19T06:23:23.573273+0000","last_peered":"2024-03-19T06:23:23.573273+0000","last_clean":"2024-03-19T06:23:23.573273+0000","last_became_active":"2024-03-19T06:23:22.562003+0000","last_became_peered":"2024-03-19T06:23:22.562003+0000","last_unstale":"2024-03-19T06:23:23.573273+0000","last_undegraded":"2024-03-19T06:23:23.573273+0000","last_fullsized":"2024-03-19T06:23:23.573273+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:45:14.991721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558599+0000","last_change":"2024-03-19T06:23:21.539687+0000","last_active":"2024-03-19T06:23:23.558599+0000","last_peered":"2024-03-19T06:23:23.558599+0000","last_clean":"2024-03-19T06:23:23.558599+0000","last_became_active":"2024-03-19T06:23:21.539397+0000","last_became_peered":"2024-03-19T06:23:21.539397+0000","last_unstale":"2024-03-19T06:23:23.558599+0000","last_undegraded":"2024-03-19T06:23:23.558599+0000","last_fullsized":"2024-03-19T06:23:23.558599+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:49:51.133678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553125+0000","last_change":"2024-03-19T06:23:22.554006+0000","last_active":"2024-03-19T06:23:23.553125+0000","last_peered":"2024-03-19T06:23:23.553125+0000","last_clean":"2024-03-19T06:23:23.553125+0000","last_became_active":"2024-03-19T06:23:22.553707+0000","last_became_peered":"2024-03-19T06:23:22.553707+0000","last_unstale":"2024-03-19T06:23:23.553125+0000","last_undegraded":"2024-03-19T06:23:23.553125+0000","last_fullsized":"2024-03-19T06:23:23.553125+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:44:11.818406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225243+0000","last_change":"2024-03-19T06:23:21.543241+0000","last_active":"2024-03-19T06:23:24.225243+0000","last_peered":"2024-03-19T06:23:24.225243+0000","last_clean":"2024-03-19T06:23:24.225243+0000","last_became_active":"2024-03-19T06:23:21.542747+0000","last_became_peered":"2024-03-19T06:23:21.542747+0000","last_unstale":"2024-03-19T06:23:24.225243+0000","last_undegraded":"2024-03-19T06:23:24.225243+0000","last_fullsized":"2024-03-19T06:23:24.225243+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:56:59.984941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573305+0000","last_change":"2024-03-19T06:23:22.563468+0000","last_active":"2024-03-19T06:23:23.573305+0000","last_peered":"2024-03-19T06:23:23.573305+0000","last_clean":"2024-03-19T06:23:23.573305+0000","last_became_active":"2024-03-19T06:23:22.561494+0000","last_became_peered":"2024-03-19T06:23:22.561494+0000","last_unstale":"2024-03-19T06:23:23.573305+0000","last_undegraded":"2024-03-19T06:23:23.573305+0000","last_fullsized":"2024-03-19T06:23:23.573305+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:30:14.775072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.567619+0000","last_change":"2024-03-19T06:23:21.547867+0000","last_active":"2024-03-19T06:23:23.567619+0000","last_peered":"2024-03-19T06:23:23.567619+0000","last_clean":"2024-03-19T06:23:23.567619+0000","last_became_active":"2024-03-19T06:23:21.547588+0000","last_became_peered":"2024-03-19T06:23:21.547588+0000","last_unstale":"2024-03-19T06:23:23.567619+0000","last_undegraded":"2024-03-19T06:23:23.567619+0000","last_fullsized":"2024-03-19T06:23:23.567619+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:17:47.707742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558592+0000","last_change":"2024-03-19T06:23:22.551029+0000","last_active":"2024-03-19T06:23:23.558592+0000","last_peered":"2024-03-19T06:23:23.558592+0000","last_clean":"2024-03-19T06:23:23.558592+0000","last_became_active":"2024-03-19T06:23:22.550646+0000","last_became_peered":"2024-03-19T06:23:22.550646+0000","last_unstale":"2024-03-19T06:23:23.558592+0000","last_undegraded":"2024-03-19T06:23:23.558592+0000","last_fullsized":"2024-03-19T06:23:23.558592+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:01.579117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573308+0000","last_change":"2024-03-19T06:23:21.544993+0000","last_active":"2024-03-19T06:23:23.573308+0000","last_peered":"2024-03-19T06:23:23.573308+0000","last_clean":"2024-03-19T06:23:23.573308+0000","last_became_active":"2024-03-19T06:23:21.544658+0000","last_became_peered":"2024-03-19T06:23:21.544658+0000","last_unstale":"2024-03-19T06:23:23.573308+0000","last_undegraded":"2024-03-19T06:23:23.573308+0000","last_fullsized":"2024-03-19T06:23:23.573308+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:14:41.700835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557221+0000","last_change":"2024-03-19T06:23:22.542884+0000","last_active":"2024-03-19T06:23:23.557221+0000","last_peered":"2024-03-19T06:23:23.557221+0000","last_clean":"2024-03-19T06:23:23.557221+0000","last_became_active":"2024-03-19T06:23:22.542562+0000","last_became_peered":"2024-03-19T06:23:22.542562+0000","last_unstale":"2024-03-19T06:23:23.557221+0000","last_undegraded":"2024-03-19T06:23:23.557221+0000","last_fullsized":"2024-03-19T06:23:23.557221+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:33:41.315756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558908+0000","last_change":"2024-03-19T06:23:21.542594+0000","last_active":"2024-03-19T06:23:23.558908+0000","last_peered":"2024-03-19T06:23:23.558908+0000","last_clean":"2024-03-19T06:23:23.558908+0000","last_became_active":"2024-03-19T06:23:21.542322+0000","last_became_peered":"2024-03-19T06:23:21.542322+0000","last_unstale":"2024-03-19T06:23:23.558908+0000","last_undegraded":"2024-03-19T06:23:23.558908+0000","last_fullsized":"2024-03-19T06:23:23.558908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:19:51.590050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568159+0000","last_change":"2024-03-19T06:23:22.555783+0000","last_active":"2024-03-19T06:23:23.568159+0000","last_peered":"2024-03-19T06:23:23.568159+0000","last_clean":"2024-03-19T06:23:23.568159+0000","last_became_active":"2024-03-19T06:23:22.551779+0000","last_became_peered":"2024-03-19T06:23:22.551779+0000","last_unstale":"2024-03-19T06:23:23.568159+0000","last_undegraded":"2024-03-19T06:23:23.568159+0000","last_fullsized":"2024-03-19T06:23:23.568159+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:18:06.303146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573311+0000","last_change":"2024-03-19T06:23:21.548637+0000","last_active":"2024-03-19T06:23:23.573311+0000","last_peered":"2024-03-19T06:23:23.573311+0000","last_clean":"2024-03-19T06:23:23.573311+0000","last_became_active":"2024-03-19T06:23:21.548379+0000","last_became_peered":"2024-03-19T06:23:21.548379+0000","last_unstale":"2024-03-19T06:23:23.573311+0000","last_undegraded":"2024-03-19T06:23:23.573311+0000","last_fullsized":"2024-03-19T06:23:23.573311+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:37.638271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558784+0000","last_change":"2024-03-19T06:23:22.553289+0000","last_active":"2024-03-19T06:23:23.558784+0000","last_peered":"2024-03-19T06:23:23.558784+0000","last_clean":"2024-03-19T06:23:23.558784+0000","last_became_active":"2024-03-19T06:23:22.551860+0000","last_became_peered":"2024-03-19T06:23:22.551860+0000","last_unstale":"2024-03-19T06:23:23.558784+0000","last_undegraded":"2024-03-19T06:23:23.558784+0000","last_fullsized":"2024-03-19T06:23:23.558784+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:37:05.107267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553331+0000","last_change":"2024-03-19T06:23:21.548326+0000","last_active":"2024-03-19T06:23:23.553331+0000","last_peered":"2024-03-19T06:23:23.553331+0000","last_clean":"2024-03-19T06:23:23.553331+0000","last_became_active":"2024-03-19T06:23:21.548092+0000","last_became_peered":"2024-03-19T06:23:21.548092+0000","last_unstale":"2024-03-19T06:23:23.553331+0000","last_undegraded":"2024-03-19T06:23:23.553331+0000","last_fullsized":"2024-03-19T06:23:23.553331+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:45:56.923983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557657+0000","last_change":"2024-03-19T06:23:22.564834+0000","last_active":"2024-03-19T06:23:23.557657+0000","last_peered":"2024-03-19T06:23:23.557657+0000","last_clean":"2024-03-19T06:23:23.557657+0000","last_became_active":"2024-03-19T06:23:22.564460+0000","last_became_peered":"2024-03-19T06:23:22.564460+0000","last_unstale":"2024-03-19T06:23:23.557657+0000","last_undegraded":"2024-03-19T06:23:23.557657+0000","last_fullsized":"2024-03-19T06:23:23.557657+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:30:59.786364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.567946+0000","last_change":"2024-03-19T06:23:21.548017+0000","last_active":"2024-03-19T06:23:23.567946+0000","last_peered":"2024-03-19T06:23:23.567946+0000","last_clean":"2024-03-19T06:23:23.567946+0000","last_became_active":"2024-03-19T06:23:21.547733+0000","last_became_peered":"2024-03-19T06:23:21.547733+0000","last_unstale":"2024-03-19T06:23:23.567946+0000","last_undegraded":"2024-03-19T06:23:23.567946+0000","last_fullsized":"2024-03-19T06:23:23.567946+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:42:55.672130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568365+0000","last_change":"2024-03-19T06:23:22.555197+0000","last_active":"2024-03-19T06:23:23.568365+0000","last_peered":"2024-03-19T06:23:23.568365+0000","last_clean":"2024-03-19T06:23:23.568365+0000","last_became_active":"2024-03-19T06:23:22.554932+0000","last_became_peered":"2024-03-19T06:23:22.554932+0000","last_unstale":"2024-03-19T06:23:23.568365+0000","last_undegraded":"2024-03-19T06:23:23.568365+0000","last_fullsized":"2024-03-19T06:23:23.568365+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:07:49.805383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225279+0000","last_change":"2024-03-19T06:23:21.549835+0000","last_active":"2024-03-19T06:23:24.225279+0000","last_peered":"2024-03-19T06:23:24.225279+0000","last_clean":"2024-03-19T06:23:24.225279+0000","last_became_active":"2024-03-19T06:23:21.549529+0000","last_became_peered":"2024-03-19T06:23:21.549529+0000","last_unstale":"2024-03-19T06:23:24.225279+0000","last_undegraded":"2024-03-19T06:23:24.225279+0000","last_fullsized":"2024-03-19T06:23:24.225279+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:44:09.005676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553003+0000","last_change":"2024-03-19T06:23:22.566485+0000","last_active":"2024-03-19T06:23:23.553003+0000","last_peered":"2024-03-19T06:23:23.553003+0000","last_clean":"2024-03-19T06:23:23.553003+0000","last_became_active":"2024-03-19T06:23:22.566083+0000","last_became_peered":"2024-03-19T06:23:22.566083+0000","last_unstale":"2024-03-19T06:23:23.553003+0000","last_undegraded":"2024-03-19T06:23:23.553003+0000","last_fullsized":"2024-03-19T06:23:23.553003+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:50.195310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573293+0000","last_change":"2024-03-19T06:23:21.541312+0000","last_active":"2024-03-19T06:23:23.573293+0000","last_peered":"2024-03-19T06:23:23.573293+0000","last_clean":"2024-03-19T06:23:23.573293+0000","last_became_active":"2024-03-19T06:23:21.541016+0000","last_became_peered":"2024-03-19T06:23:21.541016+0000","last_unstale":"2024-03-19T06:23:23.573293+0000","last_undegraded":"2024-03-19T06:23:23.573293+0000","last_fullsized":"2024-03-19T06:23:23.573293+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:37:26.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568409+0000","last_change":"2024-03-19T06:23:22.552542+0000","last_active":"2024-03-19T06:23:23.568409+0000","last_peered":"2024-03-19T06:23:23.568409+0000","last_clean":"2024-03-19T06:23:23.568409+0000","last_became_active":"2024-03-19T06:23:22.551005+0000","last_became_peered":"2024-03-19T06:23:22.551005+0000","last_unstale":"2024-03-19T06:23:23.568409+0000","last_undegraded":"2024-03-19T06:23:23.568409+0000","last_fullsized":"2024-03-19T06:23:23.568409+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:30:14.775072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552649+0000","last_change":"2024-03-19T06:23:21.549680+0000","last_active":"2024-03-19T06:23:23.552649+0000","last_peered":"2024-03-19T06:23:23.552649+0000","last_clean":"2024-03-19T06:23:23.552649+0000","last_became_active":"2024-03-19T06:23:21.549473+0000","last_became_peered":"2024-03-19T06:23:21.549473+0000","last_unstale":"2024-03-19T06:23:23.552649+0000","last_undegraded":"2024-03-19T06:23:23.552649+0000","last_fullsized":"2024-03-19T06:23:23.552649+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:53:59.801574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552575+0000","last_change":"2024-03-19T06:23:22.556479+0000","last_active":"2024-03-19T06:23:23.552575+0000","last_peered":"2024-03-19T06:23:23.552575+0000","last_clean":"2024-03-19T06:23:23.552575+0000","last_became_active":"2024-03-19T06:23:22.555831+0000","last_became_peered":"2024-03-19T06:23:22.555831+0000","last_unstale":"2024-03-19T06:23:23.552575+0000","last_undegraded":"2024-03-19T06:23:23.552575+0000","last_fullsized":"2024-03-19T06:23:23.552575+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:01:31.985264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568600+0000","last_change":"2024-03-19T06:23:21.551863+0000","last_active":"2024-03-19T06:23:23.568600+0000","last_peered":"2024-03-19T06:23:23.568600+0000","last_clean":"2024-03-19T06:23:23.568600+0000","last_became_active":"2024-03-19T06:23:21.551286+0000","last_became_peered":"2024-03-19T06:23:21.551286+0000","last_unstale":"2024-03-19T06:23:23.568600+0000","last_undegraded":"2024-03-19T06:23:23.568600+0000","last_fullsized":"2024-03-19T06:23:23.568600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:54:25.077881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223038+0000","last_change":"2024-03-19T06:23:22.561221+0000","last_active":"2024-03-19T06:23:24.223038+0000","last_peered":"2024-03-19T06:23:24.223038+0000","last_clean":"2024-03-19T06:23:24.223038+0000","last_became_active":"2024-03-19T06:23:22.560627+0000","last_became_peered":"2024-03-19T06:23:22.560627+0000","last_unstale":"2024-03-19T06:23:24.223038+0000","last_undegraded":"2024-03-19T06:23:24.223038+0000","last_fullsized":"2024-03-19T06:23:24.223038+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:50:00.995737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223998+0000","last_change":"2024-03-19T06:23:21.542888+0000","last_active":"2024-03-19T06:23:24.223998+0000","last_peered":"2024-03-19T06:23:24.223998+0000","last_clean":"2024-03-19T06:23:24.223998+0000","last_became_active":"2024-03-19T06:23:21.542586+0000","last_became_peered":"2024-03-19T06:23:21.542586+0000","last_unstale":"2024-03-19T06:23:24.223998+0000","last_undegraded":"2024-03-19T06:23:24.223998+0000","last_fullsized":"2024-03-19T06:23:24.223998+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:32:43.663687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558571+0000","last_change":"2024-03-19T06:23:22.554856+0000","last_active":"2024-03-19T06:23:23.558571+0000","last_peered":"2024-03-19T06:23:23.558571+0000","last_clean":"2024-03-19T06:23:23.558571+0000","last_became_active":"2024-03-19T06:23:22.551031+0000","last_became_peered":"2024-03-19T06:23:22.551031+0000","last_unstale":"2024-03-19T06:23:23.558571+0000","last_undegraded":"2024-03-19T06:23:23.558571+0000","last_fullsized":"2024-03-19T06:23:23.558571+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:23:14.309187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225446+0000","last_change":"2024-03-19T06:23:21.548046+0000","last_active":"2024-03-19T06:23:24.225446+0000","last_peered":"2024-03-19T06:23:24.225446+0000","last_clean":"2024-03-19T06:23:24.225446+0000","last_became_active":"2024-03-19T06:23:21.547810+0000","last_became_peered":"2024-03-19T06:23:21.547810+0000","last_unstale":"2024-03-19T06:23:24.225446+0000","last_undegraded":"2024-03-19T06:23:24.225446+0000","last_fullsized":"2024-03-19T06:23:24.225446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:10:46.898112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223657+0000","last_change":"2024-03-19T06:23:22.549747+0000","last_active":"2024-03-19T06:23:24.223657+0000","last_peered":"2024-03-19T06:23:24.223657+0000","last_clean":"2024-03-19T06:23:24.223657+0000","last_became_active":"2024-03-19T06:23:22.548105+0000","last_became_peered":"2024-03-19T06:23:22.548105+0000","last_unstale":"2024-03-19T06:23:24.223657+0000","last_undegraded":"2024-03-19T06:23:24.223657+0000","last_fullsized":"2024-03-19T06:23:24.223657+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:38.644596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225551+0000","last_change":"2024-03-19T06:23:21.543062+0000","last_active":"2024-03-19T06:23:24.225551+0000","last_peered":"2024-03-19T06:23:24.225551+0000","last_clean":"2024-03-19T06:23:24.225551+0000","last_became_active":"2024-03-19T06:23:21.542760+0000","last_became_peered":"2024-03-19T06:23:21.542760+0000","last_unstale":"2024-03-19T06:23:24.225551+0000","last_undegraded":"2024-03-19T06:23:24.225551+0000","last_fullsized":"2024-03-19T06:23:24.225551+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:43:41.647038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557339+0000","last_change":"2024-03-19T06:23:22.543640+0000","last_active":"2024-03-19T06:23:23.557339+0000","last_peered":"2024-03-19T06:23:23.557339+0000","last_clean":"2024-03-19T06:23:23.557339+0000","last_became_active":"2024-03-19T06:23:22.543337+0000","last_became_peered":"2024-03-19T06:23:22.543337+0000","last_unstale":"2024-03-19T06:23:23.557339+0000","last_undegraded":"2024-03-19T06:23:23.557339+0000","last_fullsized":"2024-03-19T06:23:23.557339+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:52:23.986046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223710+0000","last_change":"2024-03-19T06:23:21.535188+0000","last_active":"2024-03-19T06:23:24.223710+0000","last_peered":"2024-03-19T06:23:24.223710+0000","last_clean":"2024-03-19T06:23:24.223710+0000","last_became_active":"2024-03-19T06:23:21.534892+0000","last_became_peered":"2024-03-19T06:23:21.534892+0000","last_unstale":"2024-03-19T06:23:24.223710+0000","last_undegraded":"2024-03-19T06:23:24.223710+0000","last_fullsized":"2024-03-19T06:23:24.223710+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:17:47.707742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225364+0000","last_change":"2024-03-19T06:23:22.552369+0000","last_active":"2024-03-19T06:23:24.225364+0000","last_peered":"2024-03-19T06:23:24.225364+0000","last_clean":"2024-03-19T06:23:24.225364+0000","last_became_active":"2024-03-19T06:23:22.552089+0000","last_became_peered":"2024-03-19T06:23:22.552089+0000","last_unstale":"2024-03-19T06:23:24.225364+0000","last_undegraded":"2024-03-19T06:23:24.225364+0000","last_fullsized":"2024-03-19T06:23:24.225364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:48:12.073996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552481+0000","last_change":"2024-03-19T06:23:21.549897+0000","last_active":"2024-03-19T06:23:23.552481+0000","last_peered":"2024-03-19T06:23:23.552481+0000","last_clean":"2024-03-19T06:23:23.552481+0000","last_became_active":"2024-03-19T06:23:21.549123+0000","last_became_peered":"2024-03-19T06:23:21.549123+0000","last_unstale":"2024-03-19T06:23:23.552481+0000","last_undegraded":"2024-03-19T06:23:23.552481+0000","last_fullsized":"2024-03-19T06:23:23.552481+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:47:05.968667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568411+0000","last_change":"2024-03-19T06:23:22.556291+0000","last_active":"2024-03-19T06:23:23.568411+0000","last_peered":"2024-03-19T06:23:23.568411+0000","last_clean":"2024-03-19T06:23:23.568411+0000","last_became_active":"2024-03-19T06:23:22.555973+0000","last_became_peered":"2024-03-19T06:23:22.555973+0000","last_unstale":"2024-03-19T06:23:23.568411+0000","last_undegraded":"2024-03-19T06:23:23.568411+0000","last_fullsized":"2024-03-19T06:23:23.568411+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:45:14.991721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.567790+0000","last_change":"2024-03-19T06:23:21.550728+0000","last_active":"2024-03-19T06:23:23.567790+0000","last_peered":"2024-03-19T06:23:23.567790+0000","last_clean":"2024-03-19T06:23:23.567790+0000","last_became_active":"2024-03-19T06:23:21.550266+0000","last_became_peered":"2024-03-19T06:23:21.550266+0000","last_unstale":"2024-03-19T06:23:23.567790+0000","last_undegraded":"2024-03-19T06:23:23.567790+0000","last_fullsized":"2024-03-19T06:23:23.567790+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:41:01.783538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223589+0000","last_change":"2024-03-19T06:23:22.554359+0000","last_active":"2024-03-19T06:23:24.223589+0000","last_peered":"2024-03-19T06:23:24.223589+0000","last_clean":"2024-03-19T06:23:24.223589+0000","last_became_active":"2024-03-19T06:23:22.554032+0000","last_became_peered":"2024-03-19T06:23:22.554032+0000","last_unstale":"2024-03-19T06:23:24.223589+0000","last_undegraded":"2024-03-19T06:23:24.223589+0000","last_fullsized":"2024-03-19T06:23:24.223589+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:14:42.707160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223204+0000","last_change":"2024-03-19T06:23:21.537099+0000","last_active":"2024-03-19T06:23:24.223204+0000","last_peered":"2024-03-19T06:23:24.223204+0000","last_clean":"2024-03-19T06:23:24.223204+0000","last_became_active":"2024-03-19T06:23:21.536843+0000","last_became_peered":"2024-03-19T06:23:21.536843+0000","last_unstale":"2024-03-19T06:23:24.223204+0000","last_undegraded":"2024-03-19T06:23:24.223204+0000","last_fullsized":"2024-03-19T06:23:24.223204+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:54:14.913115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557387+0000","last_change":"2024-03-19T06:23:22.554698+0000","last_active":"2024-03-19T06:23:23.557387+0000","last_peered":"2024-03-19T06:23:23.557387+0000","last_clean":"2024-03-19T06:23:23.557387+0000","last_became_active":"2024-03-19T06:23:22.554059+0000","last_became_peered":"2024-03-19T06:23:22.554059+0000","last_unstale":"2024-03-19T06:23:23.557387+0000","last_undegraded":"2024-03-19T06:23:23.557387+0000","last_fullsized":"2024-03-19T06:23:23.557387+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:57:42.655980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225480+0000","last_change":"2024-03-19T06:23:21.550006+0000","last_active":"2024-03-19T06:23:24.225480+0000","last_peered":"2024-03-19T06:23:24.225480+0000","last_clean":"2024-03-19T06:23:24.225480+0000","last_became_active":"2024-03-19T06:23:21.549629+0000","last_became_peered":"2024-03-19T06:23:21.549629+0000","last_unstale":"2024-03-19T06:23:24.225480+0000","last_undegraded":"2024-03-19T06:23:24.225480+0000","last_fullsized":"2024-03-19T06:23:24.225480+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:50:46.208966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223375+0000","last_change":"2024-03-19T06:23:22.555201+0000","last_active":"2024-03-19T06:23:24.223375+0000","last_peered":"2024-03-19T06:23:24.223375+0000","last_clean":"2024-03-19T06:23:24.223375+0000","last_became_active":"2024-03-19T06:23:22.554718+0000","last_became_peered":"2024-03-19T06:23:22.554718+0000","last_unstale":"2024-03-19T06:23:24.223375+0000","last_undegraded":"2024-03-19T06:23:24.223375+0000","last_fullsized":"2024-03-19T06:23:24.223375+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:50:18.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573343+0000","last_change":"2024-03-19T06:23:21.545957+0000","last_active":"2024-03-19T06:23:23.573343+0000","last_peered":"2024-03-19T06:23:23.573343+0000","last_clean":"2024-03-19T06:23:23.573343+0000","last_became_active":"2024-03-19T06:23:21.545605+0000","last_became_peered":"2024-03-19T06:23:21.545605+0000","last_unstale":"2024-03-19T06:23:23.573343+0000","last_undegraded":"2024-03-19T06:23:23.573343+0000","last_fullsized":"2024-03-19T06:23:23.573343+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:04:52.077136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552778+0000","last_change":"2024-03-19T06:23:22.556772+0000","last_active":"2024-03-19T06:23:23.552778+0000","last_peered":"2024-03-19T06:23:23.552778+0000","last_clean":"2024-03-19T06:23:23.552778+0000","last_became_active":"2024-03-19T06:23:22.556355+0000","last_became_peered":"2024-03-19T06:23:22.556355+0000","last_unstale":"2024-03-19T06:23:23.552778+0000","last_undegraded":"2024-03-19T06:23:23.552778+0000","last_fullsized":"2024-03-19T06:23:23.552778+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:52:40.416402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568003+0000","last_change":"2024-03-19T06:23:21.548228+0000","last_active":"2024-03-19T06:23:23.568003+0000","last_peered":"2024-03-19T06:23:23.568003+0000","last_clean":"2024-03-19T06:23:23.568003+0000","last_became_active":"2024-03-19T06:23:21.547436+0000","last_became_peered":"2024-03-19T06:23:21.547436+0000","last_unstale":"2024-03-19T06:23:23.568003+0000","last_undegraded":"2024-03-19T06:23:23.568003+0000","last_fullsized":"2024-03-19T06:23:23.568003+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:00:10.528696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568073+0000","last_change":"2024-03-19T06:23:22.548720+0000","last_active":"2024-03-19T06:23:23.568073+0000","last_peered":"2024-03-19T06:23:23.568073+0000","last_clean":"2024-03-19T06:23:23.568073+0000","last_became_active":"2024-03-19T06:23:22.548399+0000","last_became_peered":"2024-03-19T06:23:22.548399+0000","last_unstale":"2024-03-19T06:23:23.568073+0000","last_undegraded":"2024-03-19T06:23:23.568073+0000","last_fullsized":"2024-03-19T06:23:23.568073+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:52:23.986046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552726+0000","last_change":"2024-03-19T06:23:21.547044+0000","last_active":"2024-03-19T06:23:23.552726+0000","last_peered":"2024-03-19T06:23:23.552726+0000","last_clean":"2024-03-19T06:23:23.552726+0000","last_became_active":"2024-03-19T06:23:21.546743+0000","last_became_peered":"2024-03-19T06:23:21.546743+0000","last_unstale":"2024-03-19T06:23:23.552726+0000","last_undegraded":"2024-03-19T06:23:23.552726+0000","last_fullsized":"2024-03-19T06:23:23.552726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:22:22.051267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557539+0000","last_change":"2024-03-19T06:23:22.560436+0000","last_active":"2024-03-19T06:23:23.557539+0000","last_peered":"2024-03-19T06:23:23.557539+0000","last_clean":"2024-03-19T06:23:23.557539+0000","last_became_active":"2024-03-19T06:23:22.560109+0000","last_became_peered":"2024-03-19T06:23:22.560109+0000","last_unstale":"2024-03-19T06:23:23.557539+0000","last_undegraded":"2024-03-19T06:23:23.557539+0000","last_fullsized":"2024-03-19T06:23:23.557539+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:18:06.303146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552571+0000","last_change":"2024-03-19T06:23:21.551791+0000","last_active":"2024-03-19T06:23:23.552571+0000","last_peered":"2024-03-19T06:23:23.552571+0000","last_clean":"2024-03-19T06:23:23.552571+0000","last_became_active":"2024-03-19T06:23:21.551224+0000","last_became_peered":"2024-03-19T06:23:21.551224+0000","last_unstale":"2024-03-19T06:23:23.552571+0000","last_undegraded":"2024-03-19T06:23:23.552571+0000","last_fullsized":"2024-03-19T06:23:23.552571+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:39.583966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568305+0000","last_change":"2024-03-19T06:23:22.564211+0000","last_active":"2024-03-19T06:23:23.568305+0000","last_peered":"2024-03-19T06:23:23.568305+0000","last_clean":"2024-03-19T06:23:23.568305+0000","last_became_active":"2024-03-19T06:23:22.563883+0000","last_became_peered":"2024-03-19T06:23:22.563883+0000","last_unstale":"2024-03-19T06:23:23.568305+0000","last_undegraded":"2024-03-19T06:23:23.568305+0000","last_fullsized":"2024-03-19T06:23:23.568305+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:12:33.501231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558470+0000","last_change":"2024-03-19T06:23:21.543770+0000","last_active":"2024-03-19T06:23:23.558470+0000","last_peered":"2024-03-19T06:23:23.558470+0000","last_clean":"2024-03-19T06:23:23.558470+0000","last_became_active":"2024-03-19T06:23:21.543273+0000","last_became_peered":"2024-03-19T06:23:21.543273+0000","last_unstale":"2024-03-19T06:23:23.558470+0000","last_undegraded":"2024-03-19T06:23:23.558470+0000","last_fullsized":"2024-03-19T06:23:23.558470+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:46.322795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553275+0000","last_change":"2024-03-19T06:23:22.567278+0000","last_active":"2024-03-19T06:23:23.553275+0000","last_peered":"2024-03-19T06:23:23.553275+0000","last_clean":"2024-03-19T06:23:23.553275+0000","last_became_active":"2024-03-19T06:23:22.566993+0000","last_became_peered":"2024-03-19T06:23:22.566993+0000","last_unstale":"2024-03-19T06:23:23.553275+0000","last_undegraded":"2024-03-19T06:23:23.553275+0000","last_fullsized":"2024-03-19T06:23:23.553275+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:30:58.300360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557350+0000","last_change":"2024-03-19T06:23:21.549276+0000","last_active":"2024-03-19T06:23:23.557350+0000","last_peered":"2024-03-19T06:23:23.557350+0000","last_clean":"2024-03-19T06:23:23.557350+0000","last_became_active":"2024-03-19T06:23:21.549003+0000","last_became_peered":"2024-03-19T06:23:21.549003+0000","last_unstale":"2024-03-19T06:23:23.557350+0000","last_undegraded":"2024-03-19T06:23:23.557350+0000","last_fullsized":"2024-03-19T06:23:23.557350+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:29:56.283626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225492+0000","last_change":"2024-03-19T06:23:22.551245+0000","last_active":"2024-03-19T06:23:24.225492+0000","last_peered":"2024-03-19T06:23:24.225492+0000","last_clean":"2024-03-19T06:23:24.225492+0000","last_became_active":"2024-03-19T06:23:22.550877+0000","last_became_peered":"2024-03-19T06:23:22.550877+0000","last_unstale":"2024-03-19T06:23:24.225492+0000","last_undegraded":"2024-03-19T06:23:24.225492+0000","last_fullsized":"2024-03-19T06:23:24.225492+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:17:48.714067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568422+0000","last_change":"2024-03-19T06:23:21.548025+0000","last_active":"2024-03-19T06:23:23.568422+0000","last_peered":"2024-03-19T06:23:23.568422+0000","last_clean":"2024-03-19T06:23:23.568422+0000","last_became_active":"2024-03-19T06:23:21.547687+0000","last_became_peered":"2024-03-19T06:23:21.547687+0000","last_unstale":"2024-03-19T06:23:23.568422+0000","last_undegraded":"2024-03-19T06:23:23.568422+0000","last_fullsized":"2024-03-19T06:23:23.568422+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:47:25.663797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":223,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.572903+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:23:23.572903+0000","last_peered":"2024-03-19T06:23:23.572903+0000","last_clean":"2024-03-19T06:23:23.572903+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:23:23.572903+0000","last_undegraded":"2024-03-19T06:23:23.572903+0000","last_fullsized":"2024-03-19T06:23:23.572903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1200128,"data_stored":838339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":248499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":598016,"data_stored":247847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509473,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":610304,"data_stored":249459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":606208,"data_stored":248007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509473,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":838271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":602112,"data_stored":248429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":614400,"data_stored":249481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:23:31.228 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:23:31.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.391+0000 7f4188e00640 1 Processor -- start 2024-03-19T06:23:31.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.391+0000 7f4188e00640 1 -- start start 2024-03-19T06:23:31.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.395+0000 7f4188e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f41840aecf0 0x7f41840ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:31.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.395+0000 7f4188e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418415fe20 con 0x7f418406d6c0 2024-03-19T06:23:31.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.395+0000 7f4188e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4184160100 con 0x7f418415c010 2024-03-19T06:23:31.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.395+0000 7f4188e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41841603e0 con 0x7f41840aecf0 2024-03-19T06:23:31.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.395+0000 7f4181e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f41840aecf0 0x7f41840ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:31.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.395+0000 7f4182800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f418406d6c0 0x7f41840cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41588/0 (socket says 172.21.15.32:41588) 2024-03-19T06:23:31.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.395+0000 7f4181e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f41840aecf0 0x7f41840ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40944/0 (socket says 172.21.15.32:40944) 2024-03-19T06:23:31.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.395+0000 7f4182800640 1 -- 172.21.15.32:0/1816013955 learned_addr learned my addr 172.21.15.32:0/1816013955 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:31.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.395+0000 7f4181e00640 1 -- 172.21.15.32:0/1816013955 >> v1:172.21.15.171:6789/0 conn(0x7f418415c010 legacy=0x7f418415f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:31.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.395+0000 7f4181e00640 1 -- 172.21.15.32:0/1816013955 >> v1:172.21.15.32:6789/0 conn(0x7f418406d6c0 legacy=0x7f41840cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:31.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.395+0000 7f4181e00640 1 -- 172.21.15.32:0/1816013955 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41840ca1f0 con 0x7f41840aecf0 2024-03-19T06:23:31.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4181e00640 1 --2- 172.21.15.32:0/1816013955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840aecf0 0x7f41840ca9f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f41740097c0 tx=0x7f417401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0113af0365b2d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:31.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4181400640 1 -- 172.21.15.32:0/1816013955 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740b0070 con 0x7f41840aecf0 2024-03-19T06:23:31.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4181400640 1 -- 172.21.15.32:0/1816013955 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41740ab600 con 0x7f41840aecf0 2024-03-19T06:23:31.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4181400640 1 -- 172.21.15.32:0/1816013955 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740ab9d0 con 0x7f41840aecf0 2024-03-19T06:23:31.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4188e00640 1 -- 172.21.15.32:0/1816013955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840aecf0 msgr2=0x7f41840ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:31.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4188e00640 1 --2- 172.21.15.32:0/1816013955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840aecf0 0x7f41840ca9f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f41740097c0 tx=0x7f417401c410 comp rx=0 tx=0).stop 2024-03-19T06:23:31.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4188e00640 1 -- 172.21.15.32:0/1816013955 shutdown_connections 2024-03-19T06:23:31.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4188e00640 1 --2- 172.21.15.32:0/1816013955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840aecf0 0x7f41840ca9f0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:31.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4188e00640 1 -- 172.21.15.32:0/1816013955 >> 172.21.15.32:0/1816013955 conn(0x7f41840b1280 msgr2=0x7f41840b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:31.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4188e00640 1 -- 172.21.15.32:0/1816013955 shutdown_connections 2024-03-19T06:23:31.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4188e00640 1 -- 172.21.15.32:0/1816013955 wait complete. 2024-03-19T06:23:31.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4188e00640 1 Processor -- start 2024-03-19T06:23:31.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4188e00640 1 -- start start 2024-03-19T06:23:31.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4188e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f418406d6c0 0x7f418415b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:31.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4188e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840aecf0 0x7f4184154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:31.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4188e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f418415c010 0x7f4184152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:31.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4188e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418416a030 con 0x7f41840aecf0 2024-03-19T06:23:31.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4188e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4184169eb0 con 0x7f418406d6c0 2024-03-19T06:23:31.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.399+0000 7f4188e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418416a1b0 con 0x7f418415c010 2024-03-19T06:23:31.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f417be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840aecf0 0x7f4184154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:31.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f417be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840aecf0 0x7f4184154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40958/0 (socket says 172.21.15.32:40958) 2024-03-19T06:23:31.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f417be00640 1 -- 172.21.15.32:0/48100100 learned_addr learned my addr 172.21.15.32:0/48100100 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:31.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f4182800640 1 --2- 172.21.15.32:0/48100100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f418415c010 0x7f4184152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:31.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f4181e00640 1 --2- 172.21.15.32:0/48100100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f418406d6c0 0x7f418415b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:31.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f417be00640 1 -- 172.21.15.32:0/48100100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f418415c010 msgr2=0x7f4184152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:31.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f417be00640 1 --2- 172.21.15.32:0/48100100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f418415c010 0x7f4184152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:31.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f417be00640 1 -- 172.21.15.32:0/48100100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f418406d6c0 msgr2=0x7f418415b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:31.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f417be00640 1 --2- 172.21.15.32:0/48100100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f418406d6c0 0x7f418415b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:31.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f417be00640 1 -- 172.21.15.32:0/48100100 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41840cd180 con 0x7f41840aecf0 2024-03-19T06:23:31.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f4181e00640 1 --2- 172.21.15.32:0/48100100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f418406d6c0 0x7f418415b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:31.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f417be00640 1 --2- 172.21.15.32:0/48100100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840aecf0 0x7f4184154cb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f416c00c420 tx=0x7f416c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:31.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f417a000640 1 -- 172.21.15.32:0/48100100 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c0052d0 con 0x7f41840aecf0 2024-03-19T06:23:31.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f417a000640 1 -- 172.21.15.32:0/48100100 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c005470 con 0x7f41840aecf0 2024-03-19T06:23:31.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f417a000640 1 -- 172.21.15.32:0/48100100 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c007260 con 0x7f41840aecf0 2024-03-19T06:23:31.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f4188e00640 1 -- 172.21.15.32:0/48100100 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41840cd460 con 0x7f41840aecf0 2024-03-19T06:23:31.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f4188e00640 1 -- 172.21.15.32:0/48100100 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41840cda20 con 0x7f41840aecf0 2024-03-19T06:23:31.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f4188e00640 1 -- 172.21.15.32:0/48100100 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41840749e0 con 0x7f41840aecf0 2024-03-19T06:23:31.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.403+0000 7f417a000640 1 -- 172.21.15.32:0/48100100 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f416c007400 con 0x7f41840aecf0 2024-03-19T06:23:31.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.407+0000 7f417a000640 1 --2- 172.21.15.32:0/48100100 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4160067660 0x7f4160069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:31.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.407+0000 7f417a000640 1 -- 172.21.15.32:0/48100100 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f416c084d30 con 0x7f41840aecf0 2024-03-19T06:23:31.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.407+0000 7f4181e00640 1 --2- 172.21.15.32:0/48100100 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4160067660 0x7f4160069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:31.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.407+0000 7f4181e00640 1 --2- 172.21.15.32:0/48100100 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4160067660 0x7f4160069b20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f41740ad000 tx=0x7f4174008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:31.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.411+0000 7f417a000640 1 -- 172.21.15.32:0/48100100 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f416c055a20 con 0x7f41840aecf0 2024-03-19T06:23:31.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.571+0000 7f4188e00640 1 -- 172.21.15.32:0/48100100 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41840cb3f0 con 0x7f4160067660 2024-03-19T06:23:31.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.579+0000 7f417a000640 1 -- 172.21.15.32:0/48100100 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251956 (secure 0 0 0) 0x7f41840cb3f0 con 0x7f4160067660 2024-03-19T06:23:31.569 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:31.570 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:23:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.583+0000 7f4188e00640 1 -- 172.21.15.32:0/48100100 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4160067660 msgr2=0x7f4160069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.583+0000 7f4188e00640 1 --2- 172.21.15.32:0/48100100 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4160067660 0x7f4160069b20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f41740ad000 tx=0x7f4174008040 comp rx=0 tx=0).stop 2024-03-19T06:23:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.583+0000 7f4188e00640 1 -- 172.21.15.32:0/48100100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840aecf0 msgr2=0x7f4184154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.583+0000 7f4188e00640 1 --2- 172.21.15.32:0/48100100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840aecf0 0x7f4184154cb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f416c00c420 tx=0x7f416c00c8e0 comp rx=0 tx=0).stop 2024-03-19T06:23:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.583+0000 7f4188e00640 1 -- 172.21.15.32:0/48100100 shutdown_connections 2024-03-19T06:23:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.583+0000 7f4188e00640 1 --2- 172.21.15.32:0/48100100 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4160067660 0x7f4160069b20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.583+0000 7f4188e00640 1 --2- 172.21.15.32:0/48100100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f418415c010 0x7f4184152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.583+0000 7f4188e00640 1 --2- 172.21.15.32:0/48100100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840aecf0 0x7f4184154cb0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.583+0000 7f4188e00640 1 --2- 172.21.15.32:0/48100100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f418406d6c0 0x7f418415b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.583+0000 7f4188e00640 1 -- 172.21.15.32:0/48100100 >> 172.21.15.32:0/48100100 conn(0x7f41840b1280 msgr2=0x7f41840cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.583+0000 7f4188e00640 1 -- 172.21.15.32:0/48100100 shutdown_connections 2024-03-19T06:23:31.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.583+0000 7f4188e00640 1 -- 172.21.15.32:0/48100100 wait complete. 2024-03-19T06:23:31.590 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-03-19T06:23:29.954052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238732,"kb_used_data":5896,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735988,"statfs":{"total":773094113280,"available":772849651712,"internally_reserved":0,"allocated":6037504,"data_stored":3168332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002308"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223358+0000","last_change":"2024-03-19T06:23:22.556006+0000","last_active":"2024-03-19T06:23:24.223358+0000","last_peered":"2024-03-19T06:23:24.223358+0000","last_clean":"2024-03-19T06:23:24.223358+0000","last_became_active":"2024-03-19T06:23:22.555739+0000","last_became_peered":"2024-03-19T06:23:22.555739+0000","last_unstale":"2024-03-19T06:23:24.223358+0000","last_undegraded":"2024-03-19T06:23:24.223358+0000","last_fullsized":"2024-03-19T06:23:24.223358+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:18:27.626345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573450+0000","last_change":"2024-03-19T06:23:22.564365+0000","last_active":"2024-03-19T06:23:23.573450+0000","last_peered":"2024-03-19T06:23:23.573450+0000","last_clean":"2024-03-19T06:23:23.573450+0000","last_became_active":"2024-03-19T06:23:22.564048+0000","last_became_peered":"2024-03-19T06:23:22.564048+0000","last_unstale":"2024-03-19T06:23:23.573450+0000","last_undegraded":"2024-03-19T06:23:23.573450+0000","last_fullsized":"2024-03-19T06:23:23.573450+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:27:24.967815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568202+0000","last_change":"2024-03-19T06:23:22.565721+0000","last_active":"2024-03-19T06:23:23.568202+0000","last_peered":"2024-03-19T06:23:23.568202+0000","last_clean":"2024-03-19T06:23:23.568202+0000","last_became_active":"2024-03-19T06:23:22.565219+0000","last_became_peered":"2024-03-19T06:23:22.565219+0000","last_unstale":"2024-03-19T06:23:23.568202+0000","last_undegraded":"2024-03-19T06:23:23.568202+0000","last_fullsized":"2024-03-19T06:23:23.568202+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:30:59.786364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573495+0000","last_change":"2024-03-19T06:23:22.568643+0000","last_active":"2024-03-19T06:23:23.573495+0000","last_peered":"2024-03-19T06:23:23.573495+0000","last_clean":"2024-03-19T06:23:23.573495+0000","last_became_active":"2024-03-19T06:23:22.567759+0000","last_became_peered":"2024-03-19T06:23:22.567759+0000","last_unstale":"2024-03-19T06:23:23.573495+0000","last_undegraded":"2024-03-19T06:23:23.573495+0000","last_fullsized":"2024-03-19T06:23:23.573495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:09:20.145820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558640+0000","last_change":"2024-03-19T06:23:22.557767+0000","last_active":"2024-03-19T06:23:23.558640+0000","last_peered":"2024-03-19T06:23:23.558640+0000","last_clean":"2024-03-19T06:23:23.558640+0000","last_became_active":"2024-03-19T06:23:22.557450+0000","last_became_peered":"2024-03-19T06:23:22.557450+0000","last_unstale":"2024-03-19T06:23:23.558640+0000","last_undegraded":"2024-03-19T06:23:23.558640+0000","last_fullsized":"2024-03-19T06:23:23.558640+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:42:44.189385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223031+0000","last_change":"2024-03-19T06:23:22.565105+0000","last_active":"2024-03-19T06:23:24.223031+0000","last_peered":"2024-03-19T06:23:24.223031+0000","last_clean":"2024-03-19T06:23:24.223031+0000","last_became_active":"2024-03-19T06:23:22.564552+0000","last_became_peered":"2024-03-19T06:23:22.564552+0000","last_unstale":"2024-03-19T06:23:24.223031+0000","last_undegraded":"2024-03-19T06:23:24.223031+0000","last_fullsized":"2024-03-19T06:23:24.223031+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:29:57.289951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.567724+0000","last_change":"2024-03-19T06:23:22.559440+0000","last_active":"2024-03-19T06:23:23.567724+0000","last_peered":"2024-03-19T06:23:23.567724+0000","last_clean":"2024-03-19T06:23:23.567724+0000","last_became_active":"2024-03-19T06:23:22.557049+0000","last_became_peered":"2024-03-19T06:23:22.557049+0000","last_unstale":"2024-03-19T06:23:23.567724+0000","last_undegraded":"2024-03-19T06:23:23.567724+0000","last_fullsized":"2024-03-19T06:23:23.567724+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:22:05.889382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552568+0000","last_change":"2024-03-19T06:23:22.553064+0000","last_active":"2024-03-19T06:23:23.552568+0000","last_peered":"2024-03-19T06:23:23.552568+0000","last_clean":"2024-03-19T06:23:23.552568+0000","last_became_active":"2024-03-19T06:23:22.552784+0000","last_became_peered":"2024-03-19T06:23:22.552784+0000","last_unstale":"2024-03-19T06:23:23.552568+0000","last_undegraded":"2024-03-19T06:23:23.552568+0000","last_fullsized":"2024-03-19T06:23:23.552568+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:28.771832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553240+0000","last_change":"2024-03-19T06:23:22.562187+0000","last_active":"2024-03-19T06:23:23.553240+0000","last_peered":"2024-03-19T06:23:23.553240+0000","last_clean":"2024-03-19T06:23:23.553240+0000","last_became_active":"2024-03-19T06:23:22.561713+0000","last_became_peered":"2024-03-19T06:23:22.561713+0000","last_unstale":"2024-03-19T06:23:23.553240+0000","last_undegraded":"2024-03-19T06:23:23.553240+0000","last_fullsized":"2024-03-19T06:23:23.553240+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:29:22.406290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223941+0000","last_change":"2024-03-19T06:23:22.561140+0000","last_active":"2024-03-19T06:23:24.223941+0000","last_peered":"2024-03-19T06:23:24.223941+0000","last_clean":"2024-03-19T06:23:24.223941+0000","last_became_active":"2024-03-19T06:23:22.560616+0000","last_became_peered":"2024-03-19T06:23:22.560616+0000","last_unstale":"2024-03-19T06:23:24.223941+0000","last_undegraded":"2024-03-19T06:23:24.223941+0000","last_fullsized":"2024-03-19T06:23:24.223941+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:30:39.146236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223730+0000","last_change":"2024-03-19T06:23:22.564446+0000","last_active":"2024-03-19T06:23:24.223730+0000","last_peered":"2024-03-19T06:23:24.223730+0000","last_clean":"2024-03-19T06:23:24.223730+0000","last_became_active":"2024-03-19T06:23:22.563708+0000","last_became_peered":"2024-03-19T06:23:22.563708+0000","last_unstale":"2024-03-19T06:23:24.223730+0000","last_undegraded":"2024-03-19T06:23:24.223730+0000","last_fullsized":"2024-03-19T06:23:24.223730+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:44:10.012000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553069+0000","last_change":"2024-03-19T06:23:22.556143+0000","last_active":"2024-03-19T06:23:23.553069+0000","last_peered":"2024-03-19T06:23:23.553069+0000","last_clean":"2024-03-19T06:23:23.553069+0000","last_became_active":"2024-03-19T06:23:22.555873+0000","last_became_peered":"2024-03-19T06:23:22.555873+0000","last_unstale":"2024-03-19T06:23:23.553069+0000","last_undegraded":"2024-03-19T06:23:23.553069+0000","last_fullsized":"2024-03-19T06:23:23.553069+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:37:24.117721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223498+0000","last_change":"2024-03-19T06:23:22.564190+0000","last_active":"2024-03-19T06:23:24.223498+0000","last_peered":"2024-03-19T06:23:24.223498+0000","last_clean":"2024-03-19T06:23:24.223498+0000","last_became_active":"2024-03-19T06:23:22.563678+0000","last_became_peered":"2024-03-19T06:23:22.563678+0000","last_unstale":"2024-03-19T06:23:24.223498+0000","last_undegraded":"2024-03-19T06:23:24.223498+0000","last_fullsized":"2024-03-19T06:23:24.223498+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:37:27.384192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568113+0000","last_change":"2024-03-19T06:23:22.550982+0000","last_active":"2024-03-19T06:23:23.568113+0000","last_peered":"2024-03-19T06:23:23.568113+0000","last_clean":"2024-03-19T06:23:23.568113+0000","last_became_active":"2024-03-19T06:23:22.550671+0000","last_became_peered":"2024-03-19T06:23:22.550671+0000","last_unstale":"2024-03-19T06:23:23.568113+0000","last_undegraded":"2024-03-19T06:23:23.568113+0000","last_fullsized":"2024-03-19T06:23:23.568113+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:57:42.655980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573114+0000","last_change":"2024-03-19T06:23:22.556917+0000","last_active":"2024-03-19T06:23:23.573114+0000","last_peered":"2024-03-19T06:23:23.573114+0000","last_clean":"2024-03-19T06:23:23.573114+0000","last_became_active":"2024-03-19T06:23:22.556651+0000","last_became_peered":"2024-03-19T06:23:22.556651+0000","last_unstale":"2024-03-19T06:23:23.573114+0000","last_undegraded":"2024-03-19T06:23:23.573114+0000","last_fullsized":"2024-03-19T06:23:23.573114+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:12:33.501231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223012+0000","last_change":"2024-03-19T06:23:22.561422+0000","last_active":"2024-03-19T06:23:24.223012+0000","last_peered":"2024-03-19T06:23:24.223012+0000","last_clean":"2024-03-19T06:23:24.223012+0000","last_became_active":"2024-03-19T06:23:22.560682+0000","last_became_peered":"2024-03-19T06:23:22.560682+0000","last_unstale":"2024-03-19T06:23:24.223012+0000","last_undegraded":"2024-03-19T06:23:24.223012+0000","last_fullsized":"2024-03-19T06:23:24.223012+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:57:39.130347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568549+0000","last_change":"2024-03-19T06:23:22.553404+0000","last_active":"2024-03-19T06:23:23.568549+0000","last_peered":"2024-03-19T06:23:23.568549+0000","last_clean":"2024-03-19T06:23:23.568549+0000","last_became_active":"2024-03-19T06:23:22.551422+0000","last_became_peered":"2024-03-19T06:23:22.551422+0000","last_unstale":"2024-03-19T06:23:23.568549+0000","last_undegraded":"2024-03-19T06:23:23.568549+0000","last_fullsized":"2024-03-19T06:23:23.568549+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:27:24.967815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573533+0000","last_change":"2024-03-19T06:23:22.564481+0000","last_active":"2024-03-19T06:23:23.573533+0000","last_peered":"2024-03-19T06:23:23.573533+0000","last_clean":"2024-03-19T06:23:23.573533+0000","last_became_active":"2024-03-19T06:23:22.564130+0000","last_became_peered":"2024-03-19T06:23:22.564130+0000","last_unstale":"2024-03-19T06:23:23.573533+0000","last_undegraded":"2024-03-19T06:23:23.573533+0000","last_fullsized":"2024-03-19T06:23:23.573533+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:01:19.343255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568259+0000","last_change":"2024-03-19T06:23:22.542721+0000","last_active":"2024-03-19T06:23:23.568259+0000","last_peered":"2024-03-19T06:23:23.568259+0000","last_clean":"2024-03-19T06:23:23.568259+0000","last_became_active":"2024-03-19T06:23:22.542437+0000","last_became_peered":"2024-03-19T06:23:22.542437+0000","last_unstale":"2024-03-19T06:23:23.568259+0000","last_undegraded":"2024-03-19T06:23:23.568259+0000","last_fullsized":"2024-03-19T06:23:23.568259+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:02:35.487477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225451+0000","last_change":"2024-03-19T06:23:22.552414+0000","last_active":"2024-03-19T06:23:24.225451+0000","last_peered":"2024-03-19T06:23:24.225451+0000","last_clean":"2024-03-19T06:23:24.225451+0000","last_became_active":"2024-03-19T06:23:22.552101+0000","last_became_peered":"2024-03-19T06:23:22.552101+0000","last_unstale":"2024-03-19T06:23:24.225451+0000","last_undegraded":"2024-03-19T06:23:24.225451+0000","last_fullsized":"2024-03-19T06:23:24.225451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:28:14.347499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225377+0000","last_change":"2024-03-19T06:23:22.561105+0000","last_active":"2024-03-19T06:23:24.225377+0000","last_peered":"2024-03-19T06:23:24.225377+0000","last_clean":"2024-03-19T06:23:24.225377+0000","last_became_active":"2024-03-19T06:23:22.560909+0000","last_became_peered":"2024-03-19T06:23:22.560909+0000","last_unstale":"2024-03-19T06:23:24.225377+0000","last_undegraded":"2024-03-19T06:23:24.225377+0000","last_fullsized":"2024-03-19T06:23:24.225377+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:01:57.316320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552509+0000","last_change":"2024-03-19T06:23:22.549825+0000","last_active":"2024-03-19T06:23:23.552509+0000","last_peered":"2024-03-19T06:23:23.552509+0000","last_clean":"2024-03-19T06:23:23.552509+0000","last_became_active":"2024-03-19T06:23:22.549560+0000","last_became_peered":"2024-03-19T06:23:22.549560+0000","last_unstale":"2024-03-19T06:23:23.552509+0000","last_undegraded":"2024-03-19T06:23:23.552509+0000","last_fullsized":"2024-03-19T06:23:23.552509+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:20:48.708717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223419+0000","last_change":"2024-03-19T06:23:22.559003+0000","last_active":"2024-03-19T06:23:24.223419+0000","last_peered":"2024-03-19T06:23:24.223419+0000","last_clean":"2024-03-19T06:23:24.223419+0000","last_became_active":"2024-03-19T06:23:22.558717+0000","last_became_peered":"2024-03-19T06:23:22.558717+0000","last_unstale":"2024-03-19T06:23:24.223419+0000","last_undegraded":"2024-03-19T06:23:24.223419+0000","last_fullsized":"2024-03-19T06:23:24.223419+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:57:00.991266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.567679+0000","last_change":"2024-03-19T06:23:22.551756+0000","last_active":"2024-03-19T06:23:23.567679+0000","last_peered":"2024-03-19T06:23:23.567679+0000","last_clean":"2024-03-19T06:23:23.567679+0000","last_became_active":"2024-03-19T06:23:22.550853+0000","last_became_peered":"2024-03-19T06:23:22.550853+0000","last_unstale":"2024-03-19T06:23:23.567679+0000","last_undegraded":"2024-03-19T06:23:23.567679+0000","last_fullsized":"2024-03-19T06:23:23.567679+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:30:39.146236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568582+0000","last_change":"2024-03-19T06:23:22.552829+0000","last_active":"2024-03-19T06:23:23.568582+0000","last_peered":"2024-03-19T06:23:23.568582+0000","last_clean":"2024-03-19T06:23:23.568582+0000","last_became_active":"2024-03-19T06:23:22.552149+0000","last_became_peered":"2024-03-19T06:23:22.552149+0000","last_unstale":"2024-03-19T06:23:23.568582+0000","last_undegraded":"2024-03-19T06:23:23.568582+0000","last_fullsized":"2024-03-19T06:23:23.568582+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:09:20.145820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552977+0000","last_change":"2024-03-19T06:23:22.558146+0000","last_active":"2024-03-19T06:23:23.552977+0000","last_peered":"2024-03-19T06:23:23.552977+0000","last_clean":"2024-03-19T06:23:23.552977+0000","last_became_active":"2024-03-19T06:23:22.557844+0000","last_became_peered":"2024-03-19T06:23:22.557844+0000","last_unstale":"2024-03-19T06:23:23.552977+0000","last_undegraded":"2024-03-19T06:23:23.552977+0000","last_fullsized":"2024-03-19T06:23:23.552977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:15.576529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223864+0000","last_change":"2024-03-19T06:23:22.561217+0000","last_active":"2024-03-19T06:23:24.223864+0000","last_peered":"2024-03-19T06:23:24.223864+0000","last_clean":"2024-03-19T06:23:24.223864+0000","last_became_active":"2024-03-19T06:23:22.560143+0000","last_became_peered":"2024-03-19T06:23:22.560143+0000","last_unstale":"2024-03-19T06:23:24.223864+0000","last_undegraded":"2024-03-19T06:23:24.223864+0000","last_fullsized":"2024-03-19T06:23:24.223864+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:04:53.083460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225509+0000","last_change":"2024-03-19T06:23:22.558069+0000","last_active":"2024-03-19T06:23:24.225509+0000","last_peered":"2024-03-19T06:23:24.225509+0000","last_clean":"2024-03-19T06:23:24.225509+0000","last_became_active":"2024-03-19T06:23:22.557707+0000","last_became_peered":"2024-03-19T06:23:22.557707+0000","last_unstale":"2024-03-19T06:23:24.225509+0000","last_undegraded":"2024-03-19T06:23:24.225509+0000","last_fullsized":"2024-03-19T06:23:24.225509+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:00:11.535021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.567930+0000","last_change":"2024-03-19T06:23:22.556610+0000","last_active":"2024-03-19T06:23:23.567930+0000","last_peered":"2024-03-19T06:23:23.567930+0000","last_clean":"2024-03-19T06:23:23.567930+0000","last_became_active":"2024-03-19T06:23:22.556248+0000","last_became_peered":"2024-03-19T06:23:22.556248+0000","last_unstale":"2024-03-19T06:23:23.567930+0000","last_undegraded":"2024-03-19T06:23:23.567930+0000","last_fullsized":"2024-03-19T06:23:23.567930+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:53:15.745172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573135+0000","last_change":"2024-03-19T06:23:22.558146+0000","last_active":"2024-03-19T06:23:23.573135+0000","last_peered":"2024-03-19T06:23:23.573135+0000","last_clean":"2024-03-19T06:23:23.573135+0000","last_became_active":"2024-03-19T06:23:22.557847+0000","last_became_peered":"2024-03-19T06:23:22.557847+0000","last_unstale":"2024-03-19T06:23:23.573135+0000","last_undegraded":"2024-03-19T06:23:23.573135+0000","last_fullsized":"2024-03-19T06:23:23.573135+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:07:49.805383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.567833+0000","last_change":"2024-03-19T06:23:22.551692+0000","last_active":"2024-03-19T06:23:23.567833+0000","last_peered":"2024-03-19T06:23:23.567833+0000","last_clean":"2024-03-19T06:23:23.567833+0000","last_became_active":"2024-03-19T06:23:22.551331+0000","last_became_peered":"2024-03-19T06:23:22.551331+0000","last_unstale":"2024-03-19T06:23:23.567833+0000","last_undegraded":"2024-03-19T06:23:23.567833+0000","last_fullsized":"2024-03-19T06:23:23.567833+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:33:41.315756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557293+0000","last_change":"2024-03-19T06:23:22.554941+0000","last_active":"2024-03-19T06:23:23.557293+0000","last_peered":"2024-03-19T06:23:23.557293+0000","last_clean":"2024-03-19T06:23:23.557293+0000","last_became_active":"2024-03-19T06:23:22.554414+0000","last_became_peered":"2024-03-19T06:23:22.554414+0000","last_unstale":"2024-03-19T06:23:23.557293+0000","last_undegraded":"2024-03-19T06:23:23.557293+0000","last_fullsized":"2024-03-19T06:23:23.557293+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:53:15.745172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573021+0000","last_change":"2024-03-19T06:23:22.561342+0000","last_active":"2024-03-19T06:23:23.573021+0000","last_peered":"2024-03-19T06:23:23.573021+0000","last_clean":"2024-03-19T06:23:23.573021+0000","last_became_active":"2024-03-19T06:23:22.561057+0000","last_became_peered":"2024-03-19T06:23:22.561057+0000","last_unstale":"2024-03-19T06:23:23.573021+0000","last_undegraded":"2024-03-19T06:23:23.573021+0000","last_fullsized":"2024-03-19T06:23:23.573021+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:02:35.487477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225475+0000","last_change":"2024-03-19T06:23:21.541498+0000","last_active":"2024-03-19T06:23:24.225475+0000","last_peered":"2024-03-19T06:23:24.225475+0000","last_clean":"2024-03-19T06:23:24.225475+0000","last_became_active":"2024-03-19T06:23:21.541244+0000","last_became_peered":"2024-03-19T06:23:21.541244+0000","last_unstale":"2024-03-19T06:23:24.225475+0000","last_undegraded":"2024-03-19T06:23:24.225475+0000","last_fullsized":"2024-03-19T06:23:24.225475+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:19:35.590492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557141+0000","last_change":"2024-03-19T06:23:22.555426+0000","last_active":"2024-03-19T06:23:23.557141+0000","last_peered":"2024-03-19T06:23:23.557141+0000","last_clean":"2024-03-19T06:23:23.557141+0000","last_became_active":"2024-03-19T06:23:22.555140+0000","last_became_peered":"2024-03-19T06:23:22.555140+0000","last_unstale":"2024-03-19T06:23:23.557141+0000","last_undegraded":"2024-03-19T06:23:23.557141+0000","last_fullsized":"2024-03-19T06:23:23.557141+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:22:05.889382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223919+0000","last_change":"2024-03-19T06:23:21.540448+0000","last_active":"2024-03-19T06:23:24.223919+0000","last_peered":"2024-03-19T06:23:24.223919+0000","last_clean":"2024-03-19T06:23:24.223919+0000","last_became_active":"2024-03-19T06:23:21.540108+0000","last_became_peered":"2024-03-19T06:23:21.540108+0000","last_unstale":"2024-03-19T06:23:24.223919+0000","last_undegraded":"2024-03-19T06:23:24.223919+0000","last_fullsized":"2024-03-19T06:23:24.223919+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:06:00.013901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225188+0000","last_change":"2024-03-19T06:23:22.563673+0000","last_active":"2024-03-19T06:23:24.225188+0000","last_peered":"2024-03-19T06:23:24.225188+0000","last_clean":"2024-03-19T06:23:24.225188+0000","last_became_active":"2024-03-19T06:23:22.563364+0000","last_became_peered":"2024-03-19T06:23:22.563364+0000","last_unstale":"2024-03-19T06:23:24.225188+0000","last_undegraded":"2024-03-19T06:23:24.225188+0000","last_fullsized":"2024-03-19T06:23:24.225188+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:47:22.856227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223766+0000","last_change":"2024-03-19T06:23:21.541004+0000","last_active":"2024-03-19T06:23:24.223766+0000","last_peered":"2024-03-19T06:23:24.223766+0000","last_clean":"2024-03-19T06:23:24.223766+0000","last_became_active":"2024-03-19T06:23:21.540092+0000","last_became_peered":"2024-03-19T06:23:21.540092+0000","last_unstale":"2024-03-19T06:23:24.223766+0000","last_undegraded":"2024-03-19T06:23:24.223766+0000","last_fullsized":"2024-03-19T06:23:24.223766+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:00:10.528696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552538+0000","last_change":"2024-03-19T06:23:22.564698+0000","last_active":"2024-03-19T06:23:23.552538+0000","last_peered":"2024-03-19T06:23:23.552538+0000","last_clean":"2024-03-19T06:23:23.552538+0000","last_became_active":"2024-03-19T06:23:22.564416+0000","last_became_peered":"2024-03-19T06:23:22.564416+0000","last_unstale":"2024-03-19T06:23:23.552538+0000","last_undegraded":"2024-03-19T06:23:23.552538+0000","last_fullsized":"2024-03-19T06:23:23.552538+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:33:17.743019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557412+0000","last_change":"2024-03-19T06:23:21.542555+0000","last_active":"2024-03-19T06:23:23.557412+0000","last_peered":"2024-03-19T06:23:23.557412+0000","last_clean":"2024-03-19T06:23:23.557412+0000","last_became_active":"2024-03-19T06:23:21.542296+0000","last_became_peered":"2024-03-19T06:23:21.542296+0000","last_unstale":"2024-03-19T06:23:23.557412+0000","last_undegraded":"2024-03-19T06:23:23.557412+0000","last_fullsized":"2024-03-19T06:23:23.557412+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:57:38.124022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558898+0000","last_change":"2024-03-19T06:23:22.551285+0000","last_active":"2024-03-19T06:23:23.558898+0000","last_peered":"2024-03-19T06:23:23.558898+0000","last_clean":"2024-03-19T06:23:23.558898+0000","last_became_active":"2024-03-19T06:23:22.550894+0000","last_became_peered":"2024-03-19T06:23:22.550894+0000","last_unstale":"2024-03-19T06:23:23.558898+0000","last_undegraded":"2024-03-19T06:23:23.558898+0000","last_fullsized":"2024-03-19T06:23:23.558898+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:43:42.939501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.567838+0000","last_change":"2024-03-19T06:23:21.545414+0000","last_active":"2024-03-19T06:23:23.567838+0000","last_peered":"2024-03-19T06:23:23.567838+0000","last_clean":"2024-03-19T06:23:23.567838+0000","last_became_active":"2024-03-19T06:23:21.545120+0000","last_became_peered":"2024-03-19T06:23:21.545120+0000","last_unstale":"2024-03-19T06:23:23.567838+0000","last_undegraded":"2024-03-19T06:23:23.567838+0000","last_fullsized":"2024-03-19T06:23:23.567838+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:06:00.013901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573273+0000","last_change":"2024-03-19T06:23:22.562383+0000","last_active":"2024-03-19T06:23:23.573273+0000","last_peered":"2024-03-19T06:23:23.573273+0000","last_clean":"2024-03-19T06:23:23.573273+0000","last_became_active":"2024-03-19T06:23:22.562003+0000","last_became_peered":"2024-03-19T06:23:22.562003+0000","last_unstale":"2024-03-19T06:23:23.573273+0000","last_undegraded":"2024-03-19T06:23:23.573273+0000","last_fullsized":"2024-03-19T06:23:23.573273+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:45:14.991721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558599+0000","last_change":"2024-03-19T06:23:21.539687+0000","last_active":"2024-03-19T06:23:23.558599+0000","last_peered":"2024-03-19T06:23:23.558599+0000","last_clean":"2024-03-19T06:23:23.558599+0000","last_became_active":"2024-03-19T06:23:21.539397+0000","last_became_peered":"2024-03-19T06:23:21.539397+0000","last_unstale":"2024-03-19T06:23:23.558599+0000","last_undegraded":"2024-03-19T06:23:23.558599+0000","last_fullsized":"2024-03-19T06:23:23.558599+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:49:51.133678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553125+0000","last_change":"2024-03-19T06:23:22.554006+0000","last_active":"2024-03-19T06:23:23.553125+0000","last_peered":"2024-03-19T06:23:23.553125+0000","last_clean":"2024-03-19T06:23:23.553125+0000","last_became_active":"2024-03-19T06:23:22.553707+0000","last_became_peered":"2024-03-19T06:23:22.553707+0000","last_unstale":"2024-03-19T06:23:23.553125+0000","last_undegraded":"2024-03-19T06:23:23.553125+0000","last_fullsized":"2024-03-19T06:23:23.553125+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:44:11.818406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225243+0000","last_change":"2024-03-19T06:23:21.543241+0000","last_active":"2024-03-19T06:23:24.225243+0000","last_peered":"2024-03-19T06:23:24.225243+0000","last_clean":"2024-03-19T06:23:24.225243+0000","last_became_active":"2024-03-19T06:23:21.542747+0000","last_became_peered":"2024-03-19T06:23:21.542747+0000","last_unstale":"2024-03-19T06:23:24.225243+0000","last_undegraded":"2024-03-19T06:23:24.225243+0000","last_fullsized":"2024-03-19T06:23:24.225243+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:56:59.984941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573305+0000","last_change":"2024-03-19T06:23:22.563468+0000","last_active":"2024-03-19T06:23:23.573305+0000","last_peered":"2024-03-19T06:23:23.573305+0000","last_clean":"2024-03-19T06:23:23.573305+0000","last_became_active":"2024-03-19T06:23:22.561494+0000","last_became_peered":"2024-03-19T06:23:22.561494+0000","last_unstale":"2024-03-19T06:23:23.573305+0000","last_undegraded":"2024-03-19T06:23:23.573305+0000","last_fullsized":"2024-03-19T06:23:23.573305+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:30:14.775072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.567619+0000","last_change":"2024-03-19T06:23:21.547867+0000","last_active":"2024-03-19T06:23:23.567619+0000","last_peered":"2024-03-19T06:23:23.567619+0000","last_clean":"2024-03-19T06:23:23.567619+0000","last_became_active":"2024-03-19T06:23:21.547588+0000","last_became_peered":"2024-03-19T06:23:21.547588+0000","last_unstale":"2024-03-19T06:23:23.567619+0000","last_undegraded":"2024-03-19T06:23:23.567619+0000","last_fullsized":"2024-03-19T06:23:23.567619+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:17:47.707742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558592+0000","last_change":"2024-03-19T06:23:22.551029+0000","last_active":"2024-03-19T06:23:23.558592+0000","last_peered":"2024-03-19T06:23:23.558592+0000","last_clean":"2024-03-19T06:23:23.558592+0000","last_became_active":"2024-03-19T06:23:22.550646+0000","last_became_peered":"2024-03-19T06:23:22.550646+0000","last_unstale":"2024-03-19T06:23:23.558592+0000","last_undegraded":"2024-03-19T06:23:23.558592+0000","last_fullsized":"2024-03-19T06:23:23.558592+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:01.579117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573308+0000","last_change":"2024-03-19T06:23:21.544993+0000","last_active":"2024-03-19T06:23:23.573308+0000","last_peered":"2024-03-19T06:23:23.573308+0000","last_clean":"2024-03-19T06:23:23.573308+0000","last_became_active":"2024-03-19T06:23:21.544658+0000","last_became_peered":"2024-03-19T06:23:21.544658+0000","last_unstale":"2024-03-19T06:23:23.573308+0000","last_undegraded":"2024-03-19T06:23:23.573308+0000","last_fullsized":"2024-03-19T06:23:23.573308+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:14:41.700835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557221+0000","last_change":"2024-03-19T06:23:22.542884+0000","last_active":"2024-03-19T06:23:23.557221+0000","last_peered":"2024-03-19T06:23:23.557221+0000","last_clean":"2024-03-19T06:23:23.557221+0000","last_became_active":"2024-03-19T06:23:22.542562+0000","last_became_peered":"2024-03-19T06:23:22.542562+0000","last_unstale":"2024-03-19T06:23:23.557221+0000","last_undegraded":"2024-03-19T06:23:23.557221+0000","last_fullsized":"2024-03-19T06:23:23.557221+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:33:41.315756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558908+0000","last_change":"2024-03-19T06:23:21.542594+0000","last_active":"2024-03-19T06:23:23.558908+0000","last_peered":"2024-03-19T06:23:23.558908+0000","last_clean":"2024-03-19T06:23:23.558908+0000","last_became_active":"2024-03-19T06:23:21.542322+0000","last_became_peered":"2024-03-19T06:23:21.542322+0000","last_unstale":"2024-03-19T06:23:23.558908+0000","last_undegraded":"2024-03-19T06:23:23.558908+0000","last_fullsized":"2024-03-19T06:23:23.558908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:19:51.590050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568159+0000","last_change":"2024-03-19T06:23:22.555783+0000","last_active":"2024-03-19T06:23:23.568159+0000","last_peered":"2024-03-19T06:23:23.568159+0000","last_clean":"2024-03-19T06:23:23.568159+0000","last_became_active":"2024-03-19T06:23:22.551779+0000","last_became_peered":"2024-03-19T06:23:22.551779+0000","last_unstale":"2024-03-19T06:23:23.568159+0000","last_undegraded":"2024-03-19T06:23:23.568159+0000","last_fullsized":"2024-03-19T06:23:23.568159+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:18:06.303146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573311+0000","last_change":"2024-03-19T06:23:21.548637+0000","last_active":"2024-03-19T06:23:23.573311+0000","last_peered":"2024-03-19T06:23:23.573311+0000","last_clean":"2024-03-19T06:23:23.573311+0000","last_became_active":"2024-03-19T06:23:21.548379+0000","last_became_peered":"2024-03-19T06:23:21.548379+0000","last_unstale":"2024-03-19T06:23:23.573311+0000","last_undegraded":"2024-03-19T06:23:23.573311+0000","last_fullsized":"2024-03-19T06:23:23.573311+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:37.638271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558784+0000","last_change":"2024-03-19T06:23:22.553289+0000","last_active":"2024-03-19T06:23:23.558784+0000","last_peered":"2024-03-19T06:23:23.558784+0000","last_clean":"2024-03-19T06:23:23.558784+0000","last_became_active":"2024-03-19T06:23:22.551860+0000","last_became_peered":"2024-03-19T06:23:22.551860+0000","last_unstale":"2024-03-19T06:23:23.558784+0000","last_undegraded":"2024-03-19T06:23:23.558784+0000","last_fullsized":"2024-03-19T06:23:23.558784+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:37:05.107267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553331+0000","last_change":"2024-03-19T06:23:21.548326+0000","last_active":"2024-03-19T06:23:23.553331+0000","last_peered":"2024-03-19T06:23:23.553331+0000","last_clean":"2024-03-19T06:23:23.553331+0000","last_became_active":"2024-03-19T06:23:21.548092+0000","last_became_peered":"2024-03-19T06:23:21.548092+0000","last_unstale":"2024-03-19T06:23:23.553331+0000","last_undegraded":"2024-03-19T06:23:23.553331+0000","last_fullsized":"2024-03-19T06:23:23.553331+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:45:56.923983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557657+0000","last_change":"2024-03-19T06:23:22.564834+0000","last_active":"2024-03-19T06:23:23.557657+0000","last_peered":"2024-03-19T06:23:23.557657+0000","last_clean":"2024-03-19T06:23:23.557657+0000","last_became_active":"2024-03-19T06:23:22.564460+0000","last_became_peered":"2024-03-19T06:23:22.564460+0000","last_unstale":"2024-03-19T06:23:23.557657+0000","last_undegraded":"2024-03-19T06:23:23.557657+0000","last_fullsized":"2024-03-19T06:23:23.557657+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:30:59.786364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.567946+0000","last_change":"2024-03-19T06:23:21.548017+0000","last_active":"2024-03-19T06:23:23.567946+0000","last_peered":"2024-03-19T06:23:23.567946+0000","last_clean":"2024-03-19T06:23:23.567946+0000","last_became_active":"2024-03-19T06:23:21.547733+0000","last_became_peered":"2024-03-19T06:23:21.547733+0000","last_unstale":"2024-03-19T06:23:23.567946+0000","last_undegraded":"2024-03-19T06:23:23.567946+0000","last_fullsized":"2024-03-19T06:23:23.567946+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:42:55.672130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568365+0000","last_change":"2024-03-19T06:23:22.555197+0000","last_active":"2024-03-19T06:23:23.568365+0000","last_peered":"2024-03-19T06:23:23.568365+0000","last_clean":"2024-03-19T06:23:23.568365+0000","last_became_active":"2024-03-19T06:23:22.554932+0000","last_became_peered":"2024-03-19T06:23:22.554932+0000","last_unstale":"2024-03-19T06:23:23.568365+0000","last_undegraded":"2024-03-19T06:23:23.568365+0000","last_fullsized":"2024-03-19T06:23:23.568365+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:07:49.805383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225279+0000","last_change":"2024-03-19T06:23:21.549835+0000","last_active":"2024-03-19T06:23:24.225279+0000","last_peered":"2024-03-19T06:23:24.225279+0000","last_clean":"2024-03-19T06:23:24.225279+0000","last_became_active":"2024-03-19T06:23:21.549529+0000","last_became_peered":"2024-03-19T06:23:21.549529+0000","last_unstale":"2024-03-19T06:23:24.225279+0000","last_undegraded":"2024-03-19T06:23:24.225279+0000","last_fullsized":"2024-03-19T06:23:24.225279+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:44:09.005676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553003+0000","last_change":"2024-03-19T06:23:22.566485+0000","last_active":"2024-03-19T06:23:23.553003+0000","last_peered":"2024-03-19T06:23:23.553003+0000","last_clean":"2024-03-19T06:23:23.553003+0000","last_became_active":"2024-03-19T06:23:22.566083+0000","last_became_peered":"2024-03-19T06:23:22.566083+0000","last_unstale":"2024-03-19T06:23:23.553003+0000","last_undegraded":"2024-03-19T06:23:23.553003+0000","last_fullsized":"2024-03-19T06:23:23.553003+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:28:50.195310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573293+0000","last_change":"2024-03-19T06:23:21.541312+0000","last_active":"2024-03-19T06:23:23.573293+0000","last_peered":"2024-03-19T06:23:23.573293+0000","last_clean":"2024-03-19T06:23:23.573293+0000","last_became_active":"2024-03-19T06:23:21.541016+0000","last_became_peered":"2024-03-19T06:23:21.541016+0000","last_unstale":"2024-03-19T06:23:23.573293+0000","last_undegraded":"2024-03-19T06:23:23.573293+0000","last_fullsized":"2024-03-19T06:23:23.573293+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:37:26.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568409+0000","last_change":"2024-03-19T06:23:22.552542+0000","last_active":"2024-03-19T06:23:23.568409+0000","last_peered":"2024-03-19T06:23:23.568409+0000","last_clean":"2024-03-19T06:23:23.568409+0000","last_became_active":"2024-03-19T06:23:22.551005+0000","last_became_peered":"2024-03-19T06:23:22.551005+0000","last_unstale":"2024-03-19T06:23:23.568409+0000","last_undegraded":"2024-03-19T06:23:23.568409+0000","last_fullsized":"2024-03-19T06:23:23.568409+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:30:14.775072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552649+0000","last_change":"2024-03-19T06:23:21.549680+0000","last_active":"2024-03-19T06:23:23.552649+0000","last_peered":"2024-03-19T06:23:23.552649+0000","last_clean":"2024-03-19T06:23:23.552649+0000","last_became_active":"2024-03-19T06:23:21.549473+0000","last_became_peered":"2024-03-19T06:23:21.549473+0000","last_unstale":"2024-03-19T06:23:23.552649+0000","last_undegraded":"2024-03-19T06:23:23.552649+0000","last_fullsized":"2024-03-19T06:23:23.552649+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:53:59.801574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552575+0000","last_change":"2024-03-19T06:23:22.556479+0000","last_active":"2024-03-19T06:23:23.552575+0000","last_peered":"2024-03-19T06:23:23.552575+0000","last_clean":"2024-03-19T06:23:23.552575+0000","last_became_active":"2024-03-19T06:23:22.555831+0000","last_became_peered":"2024-03-19T06:23:22.555831+0000","last_unstale":"2024-03-19T06:23:23.552575+0000","last_undegraded":"2024-03-19T06:23:23.552575+0000","last_fullsized":"2024-03-19T06:23:23.552575+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:01:31.985264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568600+0000","last_change":"2024-03-19T06:23:21.551863+0000","last_active":"2024-03-19T06:23:23.568600+0000","last_peered":"2024-03-19T06:23:23.568600+0000","last_clean":"2024-03-19T06:23:23.568600+0000","last_became_active":"2024-03-19T06:23:21.551286+0000","last_became_peered":"2024-03-19T06:23:21.551286+0000","last_unstale":"2024-03-19T06:23:23.568600+0000","last_undegraded":"2024-03-19T06:23:23.568600+0000","last_fullsized":"2024-03-19T06:23:23.568600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:54:25.077881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223038+0000","last_change":"2024-03-19T06:23:22.561221+0000","last_active":"2024-03-19T06:23:24.223038+0000","last_peered":"2024-03-19T06:23:24.223038+0000","last_clean":"2024-03-19T06:23:24.223038+0000","last_became_active":"2024-03-19T06:23:22.560627+0000","last_became_peered":"2024-03-19T06:23:22.560627+0000","last_unstale":"2024-03-19T06:23:24.223038+0000","last_undegraded":"2024-03-19T06:23:24.223038+0000","last_fullsized":"2024-03-19T06:23:24.223038+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:50:00.995737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223998+0000","last_change":"2024-03-19T06:23:21.542888+0000","last_active":"2024-03-19T06:23:24.223998+0000","last_peered":"2024-03-19T06:23:24.223998+0000","last_clean":"2024-03-19T06:23:24.223998+0000","last_became_active":"2024-03-19T06:23:21.542586+0000","last_became_peered":"2024-03-19T06:23:21.542586+0000","last_unstale":"2024-03-19T06:23:24.223998+0000","last_undegraded":"2024-03-19T06:23:24.223998+0000","last_fullsized":"2024-03-19T06:23:24.223998+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:32:43.663687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558571+0000","last_change":"2024-03-19T06:23:22.554856+0000","last_active":"2024-03-19T06:23:23.558571+0000","last_peered":"2024-03-19T06:23:23.558571+0000","last_clean":"2024-03-19T06:23:23.558571+0000","last_became_active":"2024-03-19T06:23:22.551031+0000","last_became_peered":"2024-03-19T06:23:22.551031+0000","last_unstale":"2024-03-19T06:23:23.558571+0000","last_undegraded":"2024-03-19T06:23:23.558571+0000","last_fullsized":"2024-03-19T06:23:23.558571+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:23:14.309187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225446+0000","last_change":"2024-03-19T06:23:21.548046+0000","last_active":"2024-03-19T06:23:24.225446+0000","last_peered":"2024-03-19T06:23:24.225446+0000","last_clean":"2024-03-19T06:23:24.225446+0000","last_became_active":"2024-03-19T06:23:21.547810+0000","last_became_peered":"2024-03-19T06:23:21.547810+0000","last_unstale":"2024-03-19T06:23:24.225446+0000","last_undegraded":"2024-03-19T06:23:24.225446+0000","last_fullsized":"2024-03-19T06:23:24.225446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:10:46.898112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223657+0000","last_change":"2024-03-19T06:23:22.549747+0000","last_active":"2024-03-19T06:23:24.223657+0000","last_peered":"2024-03-19T06:23:24.223657+0000","last_clean":"2024-03-19T06:23:24.223657+0000","last_became_active":"2024-03-19T06:23:22.548105+0000","last_became_peered":"2024-03-19T06:23:22.548105+0000","last_unstale":"2024-03-19T06:23:24.223657+0000","last_undegraded":"2024-03-19T06:23:24.223657+0000","last_fullsized":"2024-03-19T06:23:24.223657+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:38.644596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225551+0000","last_change":"2024-03-19T06:23:21.543062+0000","last_active":"2024-03-19T06:23:24.225551+0000","last_peered":"2024-03-19T06:23:24.225551+0000","last_clean":"2024-03-19T06:23:24.225551+0000","last_became_active":"2024-03-19T06:23:21.542760+0000","last_became_peered":"2024-03-19T06:23:21.542760+0000","last_unstale":"2024-03-19T06:23:24.225551+0000","last_undegraded":"2024-03-19T06:23:24.225551+0000","last_fullsized":"2024-03-19T06:23:24.225551+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:43:41.647038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557339+0000","last_change":"2024-03-19T06:23:22.543640+0000","last_active":"2024-03-19T06:23:23.557339+0000","last_peered":"2024-03-19T06:23:23.557339+0000","last_clean":"2024-03-19T06:23:23.557339+0000","last_became_active":"2024-03-19T06:23:22.543337+0000","last_became_peered":"2024-03-19T06:23:22.543337+0000","last_unstale":"2024-03-19T06:23:23.557339+0000","last_undegraded":"2024-03-19T06:23:23.557339+0000","last_fullsized":"2024-03-19T06:23:23.557339+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:52:23.986046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223710+0000","last_change":"2024-03-19T06:23:21.535188+0000","last_active":"2024-03-19T06:23:24.223710+0000","last_peered":"2024-03-19T06:23:24.223710+0000","last_clean":"2024-03-19T06:23:24.223710+0000","last_became_active":"2024-03-19T06:23:21.534892+0000","last_became_peered":"2024-03-19T06:23:21.534892+0000","last_unstale":"2024-03-19T06:23:24.223710+0000","last_undegraded":"2024-03-19T06:23:24.223710+0000","last_fullsized":"2024-03-19T06:23:24.223710+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:17:47.707742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225364+0000","last_change":"2024-03-19T06:23:22.552369+0000","last_active":"2024-03-19T06:23:24.225364+0000","last_peered":"2024-03-19T06:23:24.225364+0000","last_clean":"2024-03-19T06:23:24.225364+0000","last_became_active":"2024-03-19T06:23:22.552089+0000","last_became_peered":"2024-03-19T06:23:22.552089+0000","last_unstale":"2024-03-19T06:23:24.225364+0000","last_undegraded":"2024-03-19T06:23:24.225364+0000","last_fullsized":"2024-03-19T06:23:24.225364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:48:12.073996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552481+0000","last_change":"2024-03-19T06:23:21.549897+0000","last_active":"2024-03-19T06:23:23.552481+0000","last_peered":"2024-03-19T06:23:23.552481+0000","last_clean":"2024-03-19T06:23:23.552481+0000","last_became_active":"2024-03-19T06:23:21.549123+0000","last_became_peered":"2024-03-19T06:23:21.549123+0000","last_unstale":"2024-03-19T06:23:23.552481+0000","last_undegraded":"2024-03-19T06:23:23.552481+0000","last_fullsized":"2024-03-19T06:23:23.552481+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:47:05.968667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568411+0000","last_change":"2024-03-19T06:23:22.556291+0000","last_active":"2024-03-19T06:23:23.568411+0000","last_peered":"2024-03-19T06:23:23.568411+0000","last_clean":"2024-03-19T06:23:23.568411+0000","last_became_active":"2024-03-19T06:23:22.555973+0000","last_became_peered":"2024-03-19T06:23:22.555973+0000","last_unstale":"2024-03-19T06:23:23.568411+0000","last_undegraded":"2024-03-19T06:23:23.568411+0000","last_fullsized":"2024-03-19T06:23:23.568411+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:45:14.991721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.567790+0000","last_change":"2024-03-19T06:23:21.550728+0000","last_active":"2024-03-19T06:23:23.567790+0000","last_peered":"2024-03-19T06:23:23.567790+0000","last_clean":"2024-03-19T06:23:23.567790+0000","last_became_active":"2024-03-19T06:23:21.550266+0000","last_became_peered":"2024-03-19T06:23:21.550266+0000","last_unstale":"2024-03-19T06:23:23.567790+0000","last_undegraded":"2024-03-19T06:23:23.567790+0000","last_fullsized":"2024-03-19T06:23:23.567790+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:41:01.783538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223589+0000","last_change":"2024-03-19T06:23:22.554359+0000","last_active":"2024-03-19T06:23:24.223589+0000","last_peered":"2024-03-19T06:23:24.223589+0000","last_clean":"2024-03-19T06:23:24.223589+0000","last_became_active":"2024-03-19T06:23:22.554032+0000","last_became_peered":"2024-03-19T06:23:22.554032+0000","last_unstale":"2024-03-19T06:23:24.223589+0000","last_undegraded":"2024-03-19T06:23:24.223589+0000","last_fullsized":"2024-03-19T06:23:24.223589+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:14:42.707160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223204+0000","last_change":"2024-03-19T06:23:21.537099+0000","last_active":"2024-03-19T06:23:24.223204+0000","last_peered":"2024-03-19T06:23:24.223204+0000","last_clean":"2024-03-19T06:23:24.223204+0000","last_became_active":"2024-03-19T06:23:21.536843+0000","last_became_peered":"2024-03-19T06:23:21.536843+0000","last_unstale":"2024-03-19T06:23:24.223204+0000","last_undegraded":"2024-03-19T06:23:24.223204+0000","last_fullsized":"2024-03-19T06:23:24.223204+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:54:14.913115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557387+0000","last_change":"2024-03-19T06:23:22.554698+0000","last_active":"2024-03-19T06:23:23.557387+0000","last_peered":"2024-03-19T06:23:23.557387+0000","last_clean":"2024-03-19T06:23:23.557387+0000","last_became_active":"2024-03-19T06:23:22.554059+0000","last_became_peered":"2024-03-19T06:23:22.554059+0000","last_unstale":"2024-03-19T06:23:23.557387+0000","last_undegraded":"2024-03-19T06:23:23.557387+0000","last_fullsized":"2024-03-19T06:23:23.557387+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:57:42.655980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225480+0000","last_change":"2024-03-19T06:23:21.550006+0000","last_active":"2024-03-19T06:23:24.225480+0000","last_peered":"2024-03-19T06:23:24.225480+0000","last_clean":"2024-03-19T06:23:24.225480+0000","last_became_active":"2024-03-19T06:23:21.549629+0000","last_became_peered":"2024-03-19T06:23:21.549629+0000","last_unstale":"2024-03-19T06:23:24.225480+0000","last_undegraded":"2024-03-19T06:23:24.225480+0000","last_fullsized":"2024-03-19T06:23:24.225480+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:50:46.208966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.223375+0000","last_change":"2024-03-19T06:23:22.555201+0000","last_active":"2024-03-19T06:23:24.223375+0000","last_peered":"2024-03-19T06:23:24.223375+0000","last_clean":"2024-03-19T06:23:24.223375+0000","last_became_active":"2024-03-19T06:23:22.554718+0000","last_became_peered":"2024-03-19T06:23:22.554718+0000","last_unstale":"2024-03-19T06:23:24.223375+0000","last_undegraded":"2024-03-19T06:23:24.223375+0000","last_fullsized":"2024-03-19T06:23:24.223375+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:50:18.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.573343+0000","last_change":"2024-03-19T06:23:21.545957+0000","last_active":"2024-03-19T06:23:23.573343+0000","last_peered":"2024-03-19T06:23:23.573343+0000","last_clean":"2024-03-19T06:23:23.573343+0000","last_became_active":"2024-03-19T06:23:21.545605+0000","last_became_peered":"2024-03-19T06:23:21.545605+0000","last_unstale":"2024-03-19T06:23:23.573343+0000","last_undegraded":"2024-03-19T06:23:23.573343+0000","last_fullsized":"2024-03-19T06:23:23.573343+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:04:52.077136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552778+0000","last_change":"2024-03-19T06:23:22.556772+0000","last_active":"2024-03-19T06:23:23.552778+0000","last_peered":"2024-03-19T06:23:23.552778+0000","last_clean":"2024-03-19T06:23:23.552778+0000","last_became_active":"2024-03-19T06:23:22.556355+0000","last_became_peered":"2024-03-19T06:23:22.556355+0000","last_unstale":"2024-03-19T06:23:23.552778+0000","last_undegraded":"2024-03-19T06:23:23.552778+0000","last_fullsized":"2024-03-19T06:23:23.552778+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:52:40.416402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568003+0000","last_change":"2024-03-19T06:23:21.548228+0000","last_active":"2024-03-19T06:23:23.568003+0000","last_peered":"2024-03-19T06:23:23.568003+0000","last_clean":"2024-03-19T06:23:23.568003+0000","last_became_active":"2024-03-19T06:23:21.547436+0000","last_became_peered":"2024-03-19T06:23:21.547436+0000","last_unstale":"2024-03-19T06:23:23.568003+0000","last_undegraded":"2024-03-19T06:23:23.568003+0000","last_fullsized":"2024-03-19T06:23:23.568003+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:00:10.528696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568073+0000","last_change":"2024-03-19T06:23:22.548720+0000","last_active":"2024-03-19T06:23:23.568073+0000","last_peered":"2024-03-19T06:23:23.568073+0000","last_clean":"2024-03-19T06:23:23.568073+0000","last_became_active":"2024-03-19T06:23:22.548399+0000","last_became_peered":"2024-03-19T06:23:22.548399+0000","last_unstale":"2024-03-19T06:23:23.568073+0000","last_undegraded":"2024-03-19T06:23:23.568073+0000","last_fullsized":"2024-03-19T06:23:23.568073+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:52:23.986046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552726+0000","last_change":"2024-03-19T06:23:21.547044+0000","last_active":"2024-03-19T06:23:23.552726+0000","last_peered":"2024-03-19T06:23:23.552726+0000","last_clean":"2024-03-19T06:23:23.552726+0000","last_became_active":"2024-03-19T06:23:21.546743+0000","last_became_peered":"2024-03-19T06:23:21.546743+0000","last_unstale":"2024-03-19T06:23:23.552726+0000","last_undegraded":"2024-03-19T06:23:23.552726+0000","last_fullsized":"2024-03-19T06:23:23.552726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:22:22.051267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557539+0000","last_change":"2024-03-19T06:23:22.560436+0000","last_active":"2024-03-19T06:23:23.557539+0000","last_peered":"2024-03-19T06:23:23.557539+0000","last_clean":"2024-03-19T06:23:23.557539+0000","last_became_active":"2024-03-19T06:23:22.560109+0000","last_became_peered":"2024-03-19T06:23:22.560109+0000","last_unstale":"2024-03-19T06:23:23.557539+0000","last_undegraded":"2024-03-19T06:23:23.557539+0000","last_fullsized":"2024-03-19T06:23:23.557539+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:18:06.303146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.552571+0000","last_change":"2024-03-19T06:23:21.551791+0000","last_active":"2024-03-19T06:23:23.552571+0000","last_peered":"2024-03-19T06:23:23.552571+0000","last_clean":"2024-03-19T06:23:23.552571+0000","last_became_active":"2024-03-19T06:23:21.551224+0000","last_became_peered":"2024-03-19T06:23:21.551224+0000","last_unstale":"2024-03-19T06:23:23.552571+0000","last_undegraded":"2024-03-19T06:23:23.552571+0000","last_fullsized":"2024-03-19T06:23:23.552571+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:39.583966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568305+0000","last_change":"2024-03-19T06:23:22.564211+0000","last_active":"2024-03-19T06:23:23.568305+0000","last_peered":"2024-03-19T06:23:23.568305+0000","last_clean":"2024-03-19T06:23:23.568305+0000","last_became_active":"2024-03-19T06:23:22.563883+0000","last_became_peered":"2024-03-19T06:23:22.563883+0000","last_unstale":"2024-03-19T06:23:23.568305+0000","last_undegraded":"2024-03-19T06:23:23.568305+0000","last_fullsized":"2024-03-19T06:23:23.568305+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:12:33.501231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.558470+0000","last_change":"2024-03-19T06:23:21.543770+0000","last_active":"2024-03-19T06:23:23.558470+0000","last_peered":"2024-03-19T06:23:23.558470+0000","last_clean":"2024-03-19T06:23:23.558470+0000","last_became_active":"2024-03-19T06:23:21.543273+0000","last_became_peered":"2024-03-19T06:23:21.543273+0000","last_unstale":"2024-03-19T06:23:23.558470+0000","last_undegraded":"2024-03-19T06:23:23.558470+0000","last_fullsized":"2024-03-19T06:23:23.558470+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:11:46.322795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.553275+0000","last_change":"2024-03-19T06:23:22.567278+0000","last_active":"2024-03-19T06:23:23.553275+0000","last_peered":"2024-03-19T06:23:23.553275+0000","last_clean":"2024-03-19T06:23:23.553275+0000","last_became_active":"2024-03-19T06:23:22.566993+0000","last_became_peered":"2024-03-19T06:23:22.566993+0000","last_unstale":"2024-03-19T06:23:23.553275+0000","last_undegraded":"2024-03-19T06:23:23.553275+0000","last_fullsized":"2024-03-19T06:23:23.553275+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:30:58.300360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.557350+0000","last_change":"2024-03-19T06:23:21.549276+0000","last_active":"2024-03-19T06:23:23.557350+0000","last_peered":"2024-03-19T06:23:23.557350+0000","last_clean":"2024-03-19T06:23:23.557350+0000","last_became_active":"2024-03-19T06:23:21.549003+0000","last_became_peered":"2024-03-19T06:23:21.549003+0000","last_unstale":"2024-03-19T06:23:23.557350+0000","last_undegraded":"2024-03-19T06:23:23.557350+0000","last_fullsized":"2024-03-19T06:23:23.557350+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:29:56.283626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:24.225492+0000","last_change":"2024-03-19T06:23:22.551245+0000","last_active":"2024-03-19T06:23:24.225492+0000","last_peered":"2024-03-19T06:23:24.225492+0000","last_clean":"2024-03-19T06:23:24.225492+0000","last_became_active":"2024-03-19T06:23:22.550877+0000","last_became_peered":"2024-03-19T06:23:22.550877+0000","last_unstale":"2024-03-19T06:23:24.225492+0000","last_undegraded":"2024-03-19T06:23:24.225492+0000","last_fullsized":"2024-03-19T06:23:24.225492+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:21.516002+0000","last_clean_scrub_stamp":"2024-03-19T06:23:21.516002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:17:48.714067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.568422+0000","last_change":"2024-03-19T06:23:21.548025+0000","last_active":"2024-03-19T06:23:23.568422+0000","last_peered":"2024-03-19T06:23:23.568422+0000","last_clean":"2024-03-19T06:23:23.568422+0000","last_became_active":"2024-03-19T06:23:21.547687+0000","last_became_peered":"2024-03-19T06:23:21.547687+0000","last_unstale":"2024-03-19T06:23:23.568422+0000","last_undegraded":"2024-03-19T06:23:23.568422+0000","last_fullsized":"2024-03-19T06:23:23.568422+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:23:20.509678+0000","last_clean_scrub_stamp":"2024-03-19T06:23:20.509678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:47:25.663797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":223,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-03-19T06:23:23.572903+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:23:23.572903+0000","last_peered":"2024-03-19T06:23:23.572903+0000","last_clean":"2024-03-19T06:23:23.572903+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:23:23.572903+0000","last_undegraded":"2024-03-19T06:23:23.572903+0000","last_fullsized":"2024-03-19T06:23:23.572903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1200128,"data_stored":838339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":248499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":598016,"data_stored":247847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509473,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":610304,"data_stored":249459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":606208,"data_stored":248007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509473,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":838271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":602112,"data_stored":248429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":614400,"data_stored":249481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:23:31.594 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-19T06:23:31.595 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-19T06:23:31.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.791+0000 7fa8b4400640 1 Processor -- start 2024-03-19T06:23:31.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.791+0000 7fa8b4400640 1 -- start start 2024-03-19T06:23:31.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8b4400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8ac0aea70 0x7fa8ac06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:31.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8b4400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ac0af2d0 con 0x7fa8ac15a840 2024-03-19T06:23:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8b4400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ac15eea0 con 0x7fa8ac06b450 2024-03-19T06:23:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8b4400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0cdc20 con 0x7fa8ac0aea70 2024-03-19T06:23:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8b1a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa8ac15a840 0x7fa8ac06ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41602/0 (socket says 172.21.15.32:41602) 2024-03-19T06:23:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8b1a00640 1 -- 172.21.15.32:0/1887083107 learned_addr learned my addr 172.21.15.32:0/1887083107 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8b2400640 1 --2- 172.21.15.32:0/1887083107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8ac0aea70 0x7fa8ac06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 -- 172.21.15.32:0/1887083107 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386412779 0 0) 0x7fa8ac0af2d0 con 0x7fa8ac15a840 2024-03-19T06:23:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 -- 172.21.15.32:0/1887083107 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa894005740 con 0x7fa8ac15a840 2024-03-19T06:23:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 -- 172.21.15.32:0/1887083107 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133295960 0 0) 0x7fa8ac15eea0 con 0x7fa8ac06b450 2024-03-19T06:23:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 -- 172.21.15.32:0/1887083107 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8ac0af2d0 con 0x7fa8ac06b450 2024-03-19T06:23:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 -- 172.21.15.32:0/1887083107 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2772648603 0 0) 0x7fa894005740 con 0x7fa8ac15a840 2024-03-19T06:23:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 -- 172.21.15.32:0/1887083107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8ac0aea70 msgr2=0x7fa8ac06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 --2- 172.21.15.32:0/1887083107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8ac0aea70 0x7fa8ac06f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 -- 172.21.15.32:0/1887083107 >> v1:172.21.15.171:6789/0 conn(0x7fa8ac06b450 legacy=0x7fa8ac0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:31.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 -- 172.21.15.32:0/1887083107 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac15f180 con 0x7fa8ac15a840 2024-03-19T06:23:31.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 -- 172.21.15.32:0/1887083107 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fa8a0001680 con 0x7fa8ac15a840 2024-03-19T06:23:31.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 -- 172.21.15.32:0/1887083107 >> v1:172.21.15.32:6789/0 conn(0x7fa8ac15a840 legacy=0x7fa8ac06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:31.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 --2- 172.21.15.32:0/1887083107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8ac0aea70 0x7fa894005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:31.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 --2- 172.21.15.32:0/1887083107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa894006340 0x7fa894006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:31.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 --2- 172.21.15.32:0/1887083107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa894006f60 0x7fa8940073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:31.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 -- 172.21.15.32:0/1887083107 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0cdc20 con 0x7fa894006f60 2024-03-19T06:23:31.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 -- 172.21.15.32:0/1887083107 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89400de40 con 0x7fa894006340 2024-03-19T06:23:31.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8abe00640 1 -- 172.21.15.32:0/1887083107 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89400e040 con 0x7fa8ac0aea70 2024-03-19T06:23:31.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8b2400640 1 --2- 172.21.15.32:0/1887083107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa894006f60 0x7fa8940073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:31.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8b1a00640 1 --2- 172.21.15.32:0/1887083107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8ac0aea70 0x7fa894005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:31.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8b1000640 1 --2- 172.21.15.32:0/1887083107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa894006340 0x7fa894006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:31.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8b2400640 1 -- 172.21.15.32:0/1887083107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8ac0aea70 msgr2=0x7fa894005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:31.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8b2400640 1 --2- 172.21.15.32:0/1887083107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8ac0aea70 0x7fa894005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:31.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8b2400640 1 -- 172.21.15.32:0/1887083107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa894006340 msgr2=0x7fa894006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:31.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8b2400640 1 --2- 172.21.15.32:0/1887083107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa894006340 0x7fa894006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:31.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.795+0000 7fa8b2400640 1 -- 172.21.15.32:0/1887083107 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa894005740 con 0x7fa894006f60 2024-03-19T06:23:31.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.799+0000 7fa8b2400640 1 --2- 172.21.15.32:0/1887083107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa894006f60 0x7fa8940073e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009fc0 tx=0x7fa8a401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66baacd538a56ce server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:31.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.799+0000 7fa8abe00640 1 -- 172.21.15.32:0/1887083107 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a40b2070 con 0x7fa894006f60 2024-03-19T06:23:31.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.799+0000 7fa8abe00640 1 -- 172.21.15.32:0/1887083107 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a40a5b80 con 0x7fa894006f60 2024-03-19T06:23:31.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.799+0000 7fa8abe00640 1 -- 172.21.15.32:0/1887083107 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4009c10 con 0x7fa894006f60 2024-03-19T06:23:31.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.799+0000 7fa8b4400640 1 -- 172.21.15.32:0/1887083107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa894006f60 msgr2=0x7fa8940073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:31.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.799+0000 7fa8b4400640 1 --2- 172.21.15.32:0/1887083107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa894006f60 0x7fa8940073e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009fc0 tx=0x7fa8a401cc40 comp rx=0 tx=0).stop 2024-03-19T06:23:31.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.799+0000 7fa8b2400640 1 -- 172.21.15.32:0/1887083107 reap_dead start 2024-03-19T06:23:31.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.799+0000 7fa8b4400640 1 -- 172.21.15.32:0/1887083107 shutdown_connections 2024-03-19T06:23:31.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.799+0000 7fa8b4400640 1 -- 172.21.15.32:0/1887083107 >> 172.21.15.32:0/1887083107 conn(0x7fa8ac0b1590 msgr2=0x7fa8ac0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:31.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.799+0000 7fa8b4400640 1 -- 172.21.15.32:0/1887083107 shutdown_connections 2024-03-19T06:23:31.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.799+0000 7fa8b4400640 1 -- 172.21.15.32:0/1887083107 wait complete. 2024-03-19T06:23:31.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.799+0000 7fa8b4400640 1 Processor -- start 2024-03-19T06:23:31.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.799+0000 7fa8b4400640 1 -- start start 2024-03-19T06:23:31.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b4400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa894006f60 0x7fa8ac1f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:31.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b4400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac15c890 0x7fa8ac14b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:31.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b4400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8ac071550 0x7fa8ac071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:31.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b4400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0cf150 con 0x7fa8ac15c890 2024-03-19T06:23:31.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b4400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0cefd0 con 0x7fa894006f60 2024-03-19T06:23:31.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b4400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0cf2d0 con 0x7fa8ac071550 2024-03-19T06:23:31.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b1000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac15c890 0x7fa8ac14b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:31.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b1000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac15c890 0x7fa8ac14b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40972/0 (socket says 172.21.15.32:40972) 2024-03-19T06:23:31.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b1000640 1 -- 172.21.15.32:0/3831759603 learned_addr learned my addr 172.21.15.32:0/3831759603 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:31.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b1a00640 1 --2- 172.21.15.32:0/3831759603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa894006f60 0x7fa8ac1f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:31.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b2400640 1 --2- 172.21.15.32:0/3831759603 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8ac071550 0x7fa8ac071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:31.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b1000640 1 -- 172.21.15.32:0/3831759603 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8ac071550 msgr2=0x7fa8ac071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:31.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b1000640 1 --2- 172.21.15.32:0/3831759603 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8ac071550 0x7fa8ac071a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:31.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b1000640 1 -- 172.21.15.32:0/3831759603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa894006f60 msgr2=0x7fa8ac1f6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:31.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b1000640 1 --2- 172.21.15.32:0/3831759603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa894006f60 0x7fa8ac1f6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:31.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b1000640 1 -- 172.21.15.32:0/3831759603 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac0a89f0 con 0x7fa8ac15c890 2024-03-19T06:23:31.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b1000640 1 --2- 172.21.15.32:0/3831759603 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac15c890 0x7fa8ac14b220 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa89800f6c0 tx=0x7fa89800fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:31.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8a9600640 1 -- 172.21.15.32:0/3831759603 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8980050d0 con 0x7fa8ac15c890 2024-03-19T06:23:31.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8a9600640 1 -- 172.21.15.32:0/3831759603 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa898018070 con 0x7fa8ac15c890 2024-03-19T06:23:31.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b4400640 1 -- 172.21.15.32:0/3831759603 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ac0a8cd0 con 0x7fa8ac15c890 2024-03-19T06:23:31.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8a9600640 1 -- 172.21.15.32:0/3831759603 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800d730 con 0x7fa8ac15c890 2024-03-19T06:23:31.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b4400640 1 -- 172.21.15.32:0/3831759603 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac0a9290 con 0x7fa8ac15c890 2024-03-19T06:23:31.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.803+0000 7fa8b4400640 1 -- 172.21.15.32:0/3831759603 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ac0749e0 con 0x7fa8ac15c890 2024-03-19T06:23:31.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.807+0000 7fa8a9600640 1 -- 172.21.15.32:0/3831759603 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa89800d8d0 con 0x7fa8ac15c890 2024-03-19T06:23:31.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.807+0000 7fa8a9600640 1 --2- 172.21.15.32:0/3831759603 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa88c067690 0x7fa88c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:31.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.807+0000 7fa8a9600640 1 -- 172.21.15.32:0/3831759603 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa898085880 con 0x7fa8ac15c890 2024-03-19T06:23:31.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.807+0000 7fa8b1a00640 1 --2- 172.21.15.32:0/3831759603 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa88c067690 0x7fa88c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:31.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.807+0000 7fa8b1a00640 1 --2- 172.21.15.32:0/3831759603 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa88c067690 0x7fa88c069b50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0007b30 tx=0x7fa8a0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:31.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:31.811+0000 7fa8a9600640 1 -- 172.21.15.32:0/3831759603 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fa89801a310 con 0x7fa8ac15c890 2024-03-19T06:23:32.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.031+0000 7fa8b4400640 1 -- 172.21.15.32:0/3831759603 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa8ac06e6c0 con 0x7fa8ac15c890 2024-03-19T06:23:32.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.031+0000 7fa8a9600640 1 -- 172.21.15.32:0/3831759603 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa898056470 con 0x7fa8ac15c890 2024-03-19T06:23:32.020 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-03-19T06:23:32.020 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCWLvll4jsFMxAAr4PzH6Djodh2O01vGYgxKA== 2024-03-19T06:23:32.020 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow" 2024-03-19T06:23:32.020 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2024-03-19T06:23:32.020 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-19T06:23:32.021 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.0 2024-03-19T06:23:32.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.035+0000 7fa8b4400640 1 -- 172.21.15.32:0/3831759603 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa88c067690 msgr2=0x7fa88c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:32.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.035+0000 7fa8b4400640 1 --2- 172.21.15.32:0/3831759603 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa88c067690 0x7fa88c069b50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0007b30 tx=0x7fa8a0009040 comp rx=0 tx=0).stop 2024-03-19T06:23:32.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.035+0000 7fa8b4400640 1 -- 172.21.15.32:0/3831759603 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac15c890 msgr2=0x7fa8ac14b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:32.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.035+0000 7fa8b4400640 1 --2- 172.21.15.32:0/3831759603 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac15c890 0x7fa8ac14b220 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa89800f6c0 tx=0x7fa89800fb80 comp rx=0 tx=0).stop 2024-03-19T06:23:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.035+0000 7fa8b4400640 1 -- 172.21.15.32:0/3831759603 shutdown_connections 2024-03-19T06:23:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.035+0000 7fa8b4400640 1 --2- 172.21.15.32:0/3831759603 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa88c067690 0x7fa88c069b50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.035+0000 7fa8b4400640 1 --2- 172.21.15.32:0/3831759603 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8ac071550 0x7fa8ac071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.035+0000 7fa8b4400640 1 --2- 172.21.15.32:0/3831759603 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac15c890 0x7fa8ac14b220 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.035+0000 7fa8b4400640 1 --2- 172.21.15.32:0/3831759603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa894006f60 0x7fa8ac1f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.035+0000 7fa8b4400640 1 -- 172.21.15.32:0/3831759603 >> 172.21.15.32:0/3831759603 conn(0x7fa8ac0b1590 msgr2=0x7fa8ac0b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.035+0000 7fa8b4400640 1 -- 172.21.15.32:0/3831759603 shutdown_connections 2024-03-19T06:23:32.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.035+0000 7fa8b4400640 1 -- 172.21.15.32:0/3831759603 wait complete. 2024-03-19T06:23:32.042 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:23:32.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe269600640 1 Processor -- start 2024-03-19T06:23:32.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe269600640 1 -- start start 2024-03-19T06:23:32.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe269600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe26415bb20 0x7fe26409a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe269600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe2640cf460 0x7fe2640c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe269600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26415bf00 con 0x7fe2640c5920 2024-03-19T06:23:32.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe269600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2640cc3a0 con 0x7fe2640cf460 2024-03-19T06:23:32.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe269600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640cfbb0 con 0x7fe26415bb20 2024-03-19T06:23:32.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe263400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe2640c5920 0x7fe2640cd390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41612/0 (socket says 172.21.15.32:41612) 2024-03-19T06:23:32.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe263400640 1 -- 172.21.15.32:0/79760610 learned_addr learned my addr 172.21.15.32:0/79760610 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:32.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe25be00640 1 --2- 172.21.15.32:0/79760610 >> v2:172.21.15.171:3300/0 conn(0x7fe2640cf460 0x7fe2640c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe262a00640 1 --2- 172.21.15.32:0/79760610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe26415bb20 0x7fe26409a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe262000640 1 -- 172.21.15.32:0/79760610 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619765963 0 0) 0x7fe26415bf00 con 0x7fe2640c5920 2024-03-19T06:23:32.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe262000640 1 -- 172.21.15.32:0/79760610 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe248003530 con 0x7fe2640c5920 2024-03-19T06:23:32.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe25be00640 1 -- 172.21.15.32:0/79760610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe26415bb20 msgr2=0x7fe26409a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:32.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe25be00640 1 --2- 172.21.15.32:0/79760610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe26415bb20 0x7fe26409a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe262000640 1 -- 172.21.15.32:0/79760610 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 368990114 0 0) 0x7fe248003530 con 0x7fe2640c5920 2024-03-19T06:23:32.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe25be00640 1 -- 172.21.15.32:0/79760610 >> v1:172.21.15.32:6789/0 conn(0x7fe2640c5920 legacy=0x7fe2640cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:32.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.195+0000 7fe25be00640 1 -- 172.21.15.32:0/79760610 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2640cc5d0 con 0x7fe2640cf460 2024-03-19T06:23:32.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.199+0000 7fe25be00640 1 --2- 172.21.15.32:0/79760610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2640cf460 0x7fe2640c53e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0097c0 tx=0x7fe24c01c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2c3dc2de673f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:32.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.199+0000 7fe262000640 1 -- 172.21.15.32:0/79760610 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c0b0070 con 0x7fe2640cf460 2024-03-19T06:23:32.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.199+0000 7fe262000640 1 -- 172.21.15.32:0/79760610 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24c0ab400 con 0x7fe2640cf460 2024-03-19T06:23:32.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.199+0000 7fe262000640 1 -- 172.21.15.32:0/79760610 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c001a00 con 0x7fe2640cf460 2024-03-19T06:23:32.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.199+0000 7fe269600640 1 -- 172.21.15.32:0/79760610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2640cf460 msgr2=0x7fe2640c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:32.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.199+0000 7fe269600640 1 --2- 172.21.15.32:0/79760610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2640cf460 0x7fe2640c53e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0097c0 tx=0x7fe24c01c390 comp rx=0 tx=0).stop 2024-03-19T06:23:32.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.199+0000 7fe269600640 1 -- 172.21.15.32:0/79760610 shutdown_connections 2024-03-19T06:23:32.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.199+0000 7fe269600640 1 --2- 172.21.15.32:0/79760610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2640cf460 0x7fe2640c53e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.199+0000 7fe269600640 1 --2- 172.21.15.32:0/79760610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe26415bb20 0x7fe26409a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.199+0000 7fe269600640 1 -- 172.21.15.32:0/79760610 >> 172.21.15.32:0/79760610 conn(0x7fe2640d1890 msgr2=0x7fe2640d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:32.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.199+0000 7fe269600640 1 -- 172.21.15.32:0/79760610 shutdown_connections 2024-03-19T06:23:32.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.199+0000 7fe269600640 1 -- 172.21.15.32:0/79760610 wait complete. 2024-03-19T06:23:32.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe269600640 1 Processor -- start 2024-03-19T06:23:32.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe269600640 1 -- start start 2024-03-19T06:23:32.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe269600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2640c5920 0x7fe2640b6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe269600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2640cf460 0x7fe2640cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe269600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe26415bb20 0x7fe26414d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe269600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe264168940 con 0x7fe26415bb20 2024-03-19T06:23:32.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe269600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640cf8a0 con 0x7fe2640c5920 2024-03-19T06:23:32.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe269600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe264168ac0 con 0x7fe2640cf460 2024-03-19T06:23:32.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe263400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe26415bb20 0x7fe26414d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe263400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe26415bb20 0x7fe26414d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40982/0 (socket says 172.21.15.32:40982) 2024-03-19T06:23:32.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe263400640 1 -- 172.21.15.32:0/3424491674 learned_addr learned my addr 172.21.15.32:0/3424491674 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:32.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe25be00640 1 --2- 172.21.15.32:0/3424491674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2640cf460 0x7fe2640cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe262a00640 1 --2- 172.21.15.32:0/3424491674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2640c5920 0x7fe2640b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe263400640 1 -- 172.21.15.32:0/3424491674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2640cf460 msgr2=0x7fe2640cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:32.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe263400640 1 --2- 172.21.15.32:0/3424491674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2640cf460 0x7fe2640cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe263400640 1 -- 172.21.15.32:0/3424491674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2640c5920 msgr2=0x7fe2640b6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:32.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe263400640 1 --2- 172.21.15.32:0/3424491674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2640c5920 0x7fe2640b6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe263400640 1 -- 172.21.15.32:0/3424491674 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2640c9850 con 0x7fe26415bb20 2024-03-19T06:23:32.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe262a00640 1 --2- 172.21.15.32:0/3424491674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2640c5920 0x7fe2640b6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:32.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe263400640 1 --2- 172.21.15.32:0/3424491674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe26415bb20 0x7fe26414d8e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0018a0 tx=0x7fe25c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:32.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe25aa00640 1 -- 172.21.15.32:0/3424491674 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c012400 con 0x7fe26415bb20 2024-03-19T06:23:32.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe25aa00640 1 -- 172.21.15.32:0/3424491674 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c0125c0 con 0x7fe26415bb20 2024-03-19T06:23:32.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe25aa00640 1 -- 172.21.15.32:0/3424491674 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c0129b0 con 0x7fe26415bb20 2024-03-19T06:23:32.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe269600640 1 -- 172.21.15.32:0/3424491674 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2640c9b30 con 0x7fe26415bb20 2024-03-19T06:23:32.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.203+0000 7fe269600640 1 -- 172.21.15.32:0/3424491674 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2640b6da0 con 0x7fe26415bb20 2024-03-19T06:23:32.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.207+0000 7fe269600640 1 -- 172.21.15.32:0/3424491674 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2640ca050 con 0x7fe26415bb20 2024-03-19T06:23:32.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.207+0000 7fe25aa00640 1 -- 172.21.15.32:0/3424491674 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe25c012b50 con 0x7fe26415bb20 2024-03-19T06:23:32.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.207+0000 7fe25aa00640 1 --2- 172.21.15.32:0/3424491674 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe240067660 0x7fe240069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.207+0000 7fe25aa00640 1 -- 172.21.15.32:0/3424491674 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe25c0862d0 con 0x7fe26415bb20 2024-03-19T06:23:32.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.207+0000 7fe262a00640 1 --2- 172.21.15.32:0/3424491674 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe240067660 0x7fe240069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.207+0000 7fe262a00640 1 --2- 172.21.15.32:0/3424491674 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe240067660 0x7fe240069b20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe254009a40 tx=0x7fe254008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:32.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.211+0000 7fe25aa00640 1 -- 172.21.15.32:0/3424491674 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fe25c056e30 con 0x7fe26415bb20 2024-03-19T06:23:32.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.407+0000 7fe269600640 1 -- 172.21.15.32:0/3424491674 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2640749e0 con 0x7fe26415bb20 2024-03-19T06:23:32.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.407+0000 7fe25aa00640 1 -- 172.21.15.32:0/3424491674 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fe25c056730 con 0x7fe26415bb20 2024-03-19T06:23:32.397 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:32.397 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3631486110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3631486110},{"type":"v1","addr":"172.21.15.171:6836","nonce":3631486110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/3410824978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3410824978},{"type":"v1","addr":"172.21.15.32:6833","nonce":3410824978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3585939515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3585939515},{"type":"v1","addr":"172.21.15.32:6835","nonce":3585939515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:23:21.920668+0000","modified":"2024-03-19T06:23:24.948860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5934},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5934":{"gid":5934,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/1907516739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1907516739},{"type":"v1","addr":"172.21.15.171:6837","nonce":1907516739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-03-19T06:23:32.397 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 26 2024-03-19T06:23:32.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.411+0000 7fe269600640 1 -- 172.21.15.32:0/3424491674 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe240067660 msgr2=0x7fe240069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:32.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.411+0000 7fe269600640 1 --2- 172.21.15.32:0/3424491674 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe240067660 0x7fe240069b20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe254009a40 tx=0x7fe254008040 comp rx=0 tx=0).stop 2024-03-19T06:23:32.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.411+0000 7fe269600640 1 -- 172.21.15.32:0/3424491674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe26415bb20 msgr2=0x7fe26414d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:32.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.411+0000 7fe269600640 1 --2- 172.21.15.32:0/3424491674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe26415bb20 0x7fe26414d8e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0018a0 tx=0x7fe25c00a430 comp rx=0 tx=0).stop 2024-03-19T06:23:32.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.411+0000 7fe269600640 1 -- 172.21.15.32:0/3424491674 shutdown_connections 2024-03-19T06:23:32.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.411+0000 7fe269600640 1 --2- 172.21.15.32:0/3424491674 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe240067660 0x7fe240069b20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.411+0000 7fe269600640 1 --2- 172.21.15.32:0/3424491674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe26415bb20 0x7fe26414d8e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.411+0000 7fe269600640 1 --2- 172.21.15.32:0/3424491674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2640cf460 0x7fe2640cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.411+0000 7fe269600640 1 --2- 172.21.15.32:0/3424491674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2640c5920 0x7fe2640b6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.411+0000 7fe269600640 1 -- 172.21.15.32:0/3424491674 >> 172.21.15.32:0/3424491674 conn(0x7fe2640d1890 msgr2=0x7fe2640cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:32.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.411+0000 7fe269600640 1 -- 172.21.15.32:0/3424491674 shutdown_connections 2024-03-19T06:23:32.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.411+0000 7fe269600640 1 -- 172.21.15.32:0/3424491674 wait complete. 2024-03-19T06:23:32.820 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-19T06:23:21.920668+0000', 'modified': '2024-03-19T06:23:24.948860+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5934}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5934': {'gid': 5934, 'name': 'b', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.171:6837/1907516739', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6835', 'nonce': 1907516739}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 1907516739}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-19T06:23:32.820 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-19T06:23:32.821 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-19T06:23:32.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.975+0000 7fd9ea800640 1 Processor -- start 2024-03-19T06:23:32.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.975+0000 7fd9ea800640 1 -- start start 2024-03-19T06:23:32.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.979+0000 7fd9ea800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9e40cc680 0x7fd9e415ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.979+0000 7fd9ea800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd9e40b4c50 0x7fd9e40b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.979+0000 7fd9ea800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e40cb670 con 0x7fd9e415a7c0 2024-03-19T06:23:32.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.979+0000 7fd9ea800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e415e860 con 0x7fd9e40b4c50 2024-03-19T06:23:32.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.979+0000 7fd9ea800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e40cb950 con 0x7fd9e40cc680 2024-03-19T06:23:32.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.979+0000 7fd9dbe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9e40cc680 0x7fd9e415ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.979+0000 7fd9dbe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9e40cc680 0x7fd9e415ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:47106/0 (socket says 172.21.15.32:47106) 2024-03-19T06:23:32.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.979+0000 7fd9dbe00640 1 -- 172.21.15.32:0/2796167976 learned_addr learned my addr 172.21.15.32:0/2796167976 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:32.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.979+0000 7fd9e3e00640 1 --2- 172.21.15.32:0/2796167976 >> v2:172.21.15.171:3300/0 conn(0x7fd9e40b4c50 0x7fd9e40b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.979+0000 7fd9dbe00640 1 -- 172.21.15.32:0/2796167976 >> v2:172.21.15.171:3300/0 conn(0x7fd9e40b4c50 msgr2=0x7fd9e40b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:32.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.979+0000 7fd9dbe00640 1 --2- 172.21.15.32:0/2796167976 >> v2:172.21.15.171:3300/0 conn(0x7fd9e40b4c50 0x7fd9e40b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.979+0000 7fd9dbe00640 1 -- 172.21.15.32:0/2796167976 >> v1:172.21.15.171:6789/0 conn(0x7fd9e415a7c0 legacy=0x7fd9e40cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:32.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.979+0000 7fd9dbe00640 1 -- 172.21.15.32:0/2796167976 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e415e4f0 con 0x7fd9e40cc680 2024-03-19T06:23:32.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.983+0000 7fd9dbe00640 1 --2- 172.21.15.32:0/2796167976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9e40cc680 0x7fd9e415ecf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009870 tx=0x7fd9cc01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c9a1f83e2af7036 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:32.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.983+0000 7fd9e2a00640 1 -- 172.21.15.32:0/2796167976 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0b1070 con 0x7fd9e40cc680 2024-03-19T06:23:32.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.983+0000 7fd9e2a00640 1 -- 172.21.15.32:0/2796167976 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc0a8050 con 0x7fd9e40cc680 2024-03-19T06:23:32.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.983+0000 7fd9e2a00640 1 -- 172.21.15.32:0/2796167976 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0ac860 con 0x7fd9e40cc680 2024-03-19T06:23:32.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.983+0000 7fd9ea800640 1 -- 172.21.15.32:0/2796167976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9e40cc680 msgr2=0x7fd9e415ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:32.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.983+0000 7fd9ea800640 1 --2- 172.21.15.32:0/2796167976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9e40cc680 0x7fd9e415ecf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009870 tx=0x7fd9cc01c4d0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.983+0000 7fd9ea800640 1 -- 172.21.15.32:0/2796167976 shutdown_connections 2024-03-19T06:23:32.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.983+0000 7fd9ea800640 1 --2- 172.21.15.32:0/2796167976 >> v2:172.21.15.171:3300/0 conn(0x7fd9e40b4c50 0x7fd9e40b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.983+0000 7fd9ea800640 1 --2- 172.21.15.32:0/2796167976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9e40cc680 0x7fd9e415ecf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.983+0000 7fd9ea800640 1 -- 172.21.15.32:0/2796167976 >> 172.21.15.32:0/2796167976 conn(0x7fd9e40b1280 msgr2=0x7fd9e40b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:32.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.983+0000 7fd9ea800640 1 -- 172.21.15.32:0/2796167976 shutdown_connections 2024-03-19T06:23:32.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.983+0000 7fd9ea800640 1 -- 172.21.15.32:0/2796167976 wait complete. 2024-03-19T06:23:32.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.983+0000 7fd9ea800640 1 Processor -- start 2024-03-19T06:23:32.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.983+0000 7fd9ea800640 1 -- start start 2024-03-19T06:23:32.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9ea800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9e40b4c50 0x7fd9e415c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9ea800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9e40cc680 0x7fd9e4159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9ea800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9e415a7c0 0x7fd9e4150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9ea800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e41677f0 con 0x7fd9e40b4c50 2024-03-19T06:23:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9ea800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e40cbe40 con 0x7fd9e40cc680 2024-03-19T06:23:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9ea800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e4167970 con 0x7fd9e415a7c0 2024-03-19T06:23:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9e3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9e40b4c50 0x7fd9e415c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9dbe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9e40cc680 0x7fd9e4159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9dbe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9e40cc680 0x7fd9e4159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.32:44242/0 (socket says 172.21.15.32:44242) 2024-03-19T06:23:32.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9e3e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9e415a7c0 0x7fd9e4150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9dbe00640 1 -- 172.21.15.32:0/847166511 learned_addr learned my addr 172.21.15.32:0/847166511 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9dbe00640 1 -- 172.21.15.32:0/847166511 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9e415a7c0 msgr2=0x7fd9e4150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9dbe00640 1 --2- 172.21.15.32:0/847166511 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9e415a7c0 0x7fd9e4150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9dbe00640 1 -- 172.21.15.32:0/847166511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9e40b4c50 msgr2=0x7fd9e415c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9dbe00640 1 --2- 172.21.15.32:0/847166511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9e40b4c50 0x7fd9e415c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9dbe00640 1 -- 172.21.15.32:0/847166511 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e4150f80 con 0x7fd9e40cc680 2024-03-19T06:23:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9dbe00640 1 --2- 172.21.15.32:0/847166511 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9e40cc680 0x7fd9e4159580 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc01a100 tx=0x7fd9cc01ad10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9db400640 1 -- 172.21.15.32:0/847166511 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0b1040 con 0x7fd9e40cc680 2024-03-19T06:23:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9db400640 1 -- 172.21.15.32:0/847166511 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc0acbf0 con 0x7fd9e40cc680 2024-03-19T06:23:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9db400640 1 -- 172.21.15.32:0/847166511 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0b7450 con 0x7fd9e40cc680 2024-03-19T06:23:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9ea800640 1 -- 172.21.15.32:0/847166511 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e415ca30 con 0x7fd9e40cc680 2024-03-19T06:23:32.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9ea800640 1 -- 172.21.15.32:0/847166511 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e415aed0 con 0x7fd9e40cc680 2024-03-19T06:23:32.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.987+0000 7fd9db400640 1 -- 172.21.15.32:0/847166511 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd9cc0be030 con 0x7fd9e40cc680 2024-03-19T06:23:32.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9db400640 1 --2- 172.21.15.32:0/847166511 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd9c0067660 0x7fd9c0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9db400640 1 -- 172.21.15.32:0/847166511 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9cc11f120 con 0x7fd9e40cc680 2024-03-19T06:23:32.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9e3400640 1 --2- 172.21.15.32:0/847166511 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd9c0067660 0x7fd9c0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9edc5b000 1 Processor -- start 2024-03-19T06:23:32.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9edc5b000 1 -- start start 2024-03-19T06:23:32.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9e3400640 1 --2- 172.21.15.32:0/847166511 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd9c0067660 0x7fd9c0069b20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4001810 tx=0x7fd9d4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:32.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9edc5b000 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f431140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9edc5b000 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f431680 0x55cf1f3e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9edc5b000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f3e7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9edc5b000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf1f2ce420 con 0x55cf1f3e6f90 2024-03-19T06:23:32.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9edc5b000 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf1f235fa0 con 0x55cf1f430d60 2024-03-19T06:23:32.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9edc5b000 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cf1f1bde00 con 0x55cf1f431680 2024-03-19T06:23:32.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9e3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f3e7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9e3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f3e7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40992/0 (socket says 172.21.15.32:40992) 2024-03-19T06:23:32.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9e3e00640 1 -- 172.21.15.32:0/2001010881 learned_addr learned my addr 172.21.15.32:0/2001010881 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:32.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9e3400640 1 --2- 172.21.15.32:0/2001010881 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f431140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9e3e00640 1 -- 172.21.15.32:0/2001010881 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f431680 msgr2=0x55cf1f3e6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:32.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9e3e00640 1 --2- 172.21.15.32:0/2001010881 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f431680 0x55cf1f3e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9e3e00640 1 -- 172.21.15.32:0/2001010881 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 msgr2=0x55cf1f431140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:32.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9e3e00640 1 --2- 172.21.15.32:0/2001010881 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f431140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9e3e00640 1 -- 172.21.15.32:0/2001010881 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf1f1c1cc0 con 0x55cf1f3e6f90 2024-03-19T06:23:32.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9e3400640 1 --2- 172.21.15.32:0/2001010881 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f431140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:32.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.991+0000 7fd9e3e00640 1 --2- 172.21.15.32:0/2001010881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f3e7370 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc011550 tx=0x7fd9dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc676137dcbe772 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:32.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9d3e00640 1 -- 172.21.15.32:0/2001010881 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc015840 con 0x55cf1f3e6f90 2024-03-19T06:23:32.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9d3e00640 1 -- 172.21.15.32:0/2001010881 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc0159e0 con 0x55cf1f3e6f90 2024-03-19T06:23:32.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9d3e00640 1 -- 172.21.15.32:0/2001010881 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc015d90 con 0x55cf1f3e6f90 2024-03-19T06:23:32.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 -- 172.21.15.32:0/2001010881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 msgr2=0x55cf1f3e7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:32.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/2001010881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f3e7370 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc011550 tx=0x7fd9dc009750 comp rx=0 tx=0).stop 2024-03-19T06:23:32.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 -- 172.21.15.32:0/2001010881 shutdown_connections 2024-03-19T06:23:32.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/2001010881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f3e7370 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/2001010881 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f431680 0x55cf1f3e6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/2001010881 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f431140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 -- 172.21.15.32:0/2001010881 >> 172.21.15.32:0/2001010881 conn(0x55cf1f3de310 msgr2=0x55cf1f3e5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:32.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 -- 172.21.15.32:0/2001010881 shutdown_connections 2024-03-19T06:23:32.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 -- 172.21.15.32:0/2001010881 wait complete. 2024-03-19T06:23:32.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 -- start start 2024-03-19T06:23:32.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 Processor -- start 2024-03-19T06:23:32.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3e6f90 0x55cf1f3f2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f3f2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f431680 0x55cf1f3f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf1f1f0b00 con 0x55cf1f431680 2024-03-19T06:23:32.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf1f232040 con 0x55cf1f430d60 2024-03-19T06:23:32.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cf1f23a5d0 con 0x55cf1f3e6f90 2024-03-19T06:23:32.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9edc5b000 10 client.0 _ll_register_callbacks cb 0x55cf1f1d7ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:23:32.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9e3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f431680 0x55cf1f3f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9e3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f431680 0x55cf1f3f2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41004/0 (socket says 172.21.15.32:41004) 2024-03-19T06:23:32.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9e3e00640 1 -- 172.21.15.32:0/2500819962 learned_addr learned my addr 172.21.15.32:0/2500819962 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:32.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9dbe00640 1 --2- 172.21.15.32:0/2500819962 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f3f2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9e3400640 1 --2- 172.21.15.32:0/2500819962 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3e6f90 0x55cf1f3f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9e3e00640 1 -- 172.21.15.32:0/2500819962 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3e6f90 msgr2=0x55cf1f3f2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:32.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9e3e00640 1 --2- 172.21.15.32:0/2500819962 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3e6f90 0x55cf1f3f2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9e3e00640 1 -- 172.21.15.32:0/2500819962 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 msgr2=0x55cf1f3f2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:32.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9e3e00640 1 --2- 172.21.15.32:0/2500819962 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f3f2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9e3e00640 1 -- 172.21.15.32:0/2500819962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf1f1fa380 con 0x55cf1f431680 2024-03-19T06:23:32.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9e3400640 1 --2- 172.21.15.32:0/2500819962 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3e6f90 0x55cf1f3f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:32.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9e3e00640 1 --2- 172.21.15.32:0/2500819962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f431680 0x55cf1f3f2b90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x55cf1f1dbac0 tx=0x7fd9dc004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01018f2816f0591 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:32.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9d0c00640 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-03-19T06:23:32.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.995+0000 7fd9d0c00640 1 -- 172.21.15.32:0/2500819962 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc02c060 con 0x55cf1f431680 2024-03-19T06:23:32.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9d0c00640 1 -- 172.21.15.32:0/2500819962 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9dc003db0 con 0x55cf1f431680 2024-03-19T06:23:32.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 1 -- 172.21.15.32:0/2500819962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd9dc0159e0 con 0x55cf1f431680 2024-03-19T06:23:32.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9d0c00640 1 -- 172.21.15.32:0/2500819962 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9dc032050 con 0x55cf1f431680 2024-03-19T06:23:32.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 10 client.6096 fetch_fsmap learned FSMap version 26 2024-03-19T06:23:32.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 1 -- 172.21.15.32:0/2500819962 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55cf1f209830 con 0x55cf1f431680 2024-03-19T06:23:32.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9d0c00640 1 -- 172.21.15.32:0/2500819962 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc0159e0 con 0x55cf1f431680 2024-03-19T06:23:32.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9d0c00640 1 -- 172.21.15.32:0/2500819962 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd9dc035020 con 0x55cf1f431680 2024-03-19T06:23:32.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 10 client.6096 fetch_fsmap finished waiting for FSMap version 26 2024-03-19T06:23:32.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 10 client.6096 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-19T06:23:32.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 20 client.6096 populate_metadata read hostname 'smithi032' 2024-03-19T06:23:32.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/2500819962 >> [v2:172.21.15.171:6835/1907516739,v1:172.21.15.171:6837/1907516739] conn(0x55cf1f3f3430 0x55cf1f4424e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:32.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 4 client.6096 mds_command: new command op to 5934 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-19T06:23:32.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 1 -- 172.21.15.32:0/2500819962 --> [v2:172.21.15.171:6835/1907516739,v1:172.21.15.171:6837/1907516739] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cf1f1d1b60 con 0x55cf1f3f3430 2024-03-19T06:23:32.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9e3400640 1 --2- 172.21.15.32:0/2500819962 >> [v2:172.21.15.171:6835/1907516739,v1:172.21.15.171:6837/1907516739] conn(0x55cf1f3f3430 0x55cf1f4424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:32.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9e3400640 1 --2- 172.21.15.32:0/2500819962 >> [v2:172.21.15.171:6835/1907516739,v1:172.21.15.171:6837/1907516739] conn(0x55cf1f3f3430 0x55cf1f4424e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f95f82d275915a47 server_cookie=cf22ab741dc5507d in_seq=0 out_seq=0 2024-03-19T06:23:32.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9d0c00640 10 client.6096 ms_handle_connect on v2:172.21.15.171:6835/1907516739 2024-03-19T06:23:32.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9d0c00640 1 -- 172.21.15.32:0/2500819962 <== mds.0 v2:172.21.15.171:6835/1907516739 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cf1f1d1b60 con 0x55cf1f3f3430 2024-03-19T06:23:32.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9d0c00640 10 client.6096 handle_command_reply: tid=0 2024-03-19T06:23:32.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 1 client.6096 shutdown 2024-03-19T06:23:32.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 1 -- 172.21.15.32:0/2500819962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f431680 msgr2=0x55cf1f3f2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:32.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/2500819962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f431680 0x55cf1f3f2b90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x55cf1f1dbac0 tx=0x7fd9dc004ac0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 1 -- 172.21.15.32:0/2500819962 shutdown_connections 2024-03-19T06:23:32.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/2500819962 >> [v2:172.21.15.171:6835/1907516739,v1:172.21.15.171:6837/1907516739] conn(0x55cf1f3f3430 0x55cf1f4424e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/2500819962 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f431680 0x55cf1f3f2b90 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/2500819962 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f3f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/2500819962 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3e6f90 0x55cf1f3f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:32.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9d0c00640 0 client.6096 ms_handle_reset on v2:172.21.15.171:6835/1907516739 2024-03-19T06:23:32.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 1 -- 172.21.15.32:0/2500819962 >> 172.21.15.32:0/2500819962 conn(0x55cf1f3de310 msgr2=0x55cf1f3e5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:32.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 1 -- 172.21.15.32:0/2500819962 shutdown_connections 2024-03-19T06:23:32.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 1 -- 172.21.15.32:0/2500819962 wait complete. 2024-03-19T06:23:32.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:32.999+0000 7fd9edc5b000 20 client.6096 trim_cache size 0 max 16384 2024-03-19T06:23:33.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.015+0000 7fd9edc5b000 1 Processor -- start 2024-03-19T06:23:33.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.015+0000 7fd9edc5b000 1 -- start start 2024-03-19T06:23:33.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.015+0000 7fd9edc5b000 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3de310 0x55cf1f48d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:33.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.015+0000 7fd9edc5b000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f48dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:33.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.015+0000 7fd9edc5b000 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f48e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:33.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.015+0000 7fd9edc5b000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e4203240 con 0x55cf1f3e6f90 2024-03-19T06:23:33.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.015+0000 7fd9edc5b000 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e4202530 con 0x55cf1f430d60 2024-03-19T06:23:33.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.015+0000 7fd9edc5b000 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e4156d60 con 0x55cf1f3de310 2024-03-19T06:23:33.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9dbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f48dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:33.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9dbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f48dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41016/0 (socket says 172.21.15.32:41016) 2024-03-19T06:23:33.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9dbe00640 1 -- 172.21.15.32:0/3875565727 learned_addr learned my addr 172.21.15.32:0/3875565727 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:33.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9e3e00640 1 --2- 172.21.15.32:0/3875565727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f48e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:33.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9e3400640 1 --2- 172.21.15.32:0/3875565727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3de310 0x55cf1f48d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:33.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9dbe00640 1 -- 172.21.15.32:0/3875565727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3de310 msgr2=0x55cf1f48d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:33.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9dbe00640 1 --2- 172.21.15.32:0/3875565727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3de310 0x55cf1f48d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9dbe00640 1 -- 172.21.15.32:0/3875565727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 msgr2=0x55cf1f48e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:33.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9dbe00640 1 --2- 172.21.15.32:0/3875565727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f48e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9dbe00640 1 -- 172.21.15.32:0/3875565727 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf1f203fb0 con 0x55cf1f3e6f90 2024-03-19T06:23:33.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9e3e00640 1 --2- 172.21.15.32:0/3875565727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f48e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:33.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9dbe00640 1 --2- 172.21.15.32:0/3875565727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f48dcd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0ebcc0 tx=0x7fd9cc0092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414ad4f42a9cbac server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:33.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9d3400640 1 -- 172.21.15.32:0/3875565727 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0edb60 con 0x55cf1f3e6f90 2024-03-19T06:23:33.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9d3400640 1 -- 172.21.15.32:0/3875565727 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc0a8070 con 0x55cf1f3e6f90 2024-03-19T06:23:33.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9d3400640 1 -- 172.21.15.32:0/3875565727 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0eecb0 con 0x55cf1f3e6f90 2024-03-19T06:23:33.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 -- 172.21.15.32:0/3875565727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 msgr2=0x55cf1f48dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:33.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/3875565727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f48dcd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0ebcc0 tx=0x7fd9cc0092c0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 -- 172.21.15.32:0/3875565727 shutdown_connections 2024-03-19T06:23:33.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/3875565727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f48e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/3875565727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f48dcd0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/3875565727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3de310 0x55cf1f48d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 -- 172.21.15.32:0/3875565727 >> 172.21.15.32:0/3875565727 conn(0x55cf1f4301c0 msgr2=0x55cf1f3eca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 -- 172.21.15.32:0/3875565727 shutdown_connections 2024-03-19T06:23:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 -- 172.21.15.32:0/3875565727 wait complete. 2024-03-19T06:23:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 -- start start 2024-03-19T06:23:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 Processor -- start 2024-03-19T06:23:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3de310 0x55cf1f444770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f44cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f44d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf1f3f04e0 con 0x55cf1f3e6f90 2024-03-19T06:23:33.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e4157360 con 0x55cf1f430d60 2024-03-19T06:23:33.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cf1f2f1b80 con 0x55cf1f3de310 2024-03-19T06:23:33.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9edc5b000 10 client.0 _ll_register_callbacks cb 0x7fd9dc009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:23:33.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9dbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f44cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:33.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9dbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f44cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41028/0 (socket says 172.21.15.32:41028) 2024-03-19T06:23:33.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9dbe00640 1 -- 172.21.15.32:0/3754183745 learned_addr learned my addr 172.21.15.32:0/3754183745 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:33.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9e3400640 1 --2- 172.21.15.32:0/3754183745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3de310 0x55cf1f444770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:33.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.019+0000 7fd9e3e00640 1 --2- 172.21.15.32:0/3754183745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f44d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:33.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9e3400640 1 -- 172.21.15.32:0/3754183745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 msgr2=0x55cf1f44d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:33.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9e3400640 1 --2- 172.21.15.32:0/3754183745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f44d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9e3400640 1 -- 172.21.15.32:0/3754183745 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 msgr2=0x55cf1f44cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:33.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9e3400640 1 --2- 172.21.15.32:0/3754183745 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f44cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9e3400640 1 -- 172.21.15.32:0/3754183745 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf1f2b72e0 con 0x55cf1f3de310 2024-03-19T06:23:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9dbe00640 1 --2- 172.21.15.32:0/3754183745 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f44cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:23:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9e3400640 1 --2- 172.21.15.32:0/3754183745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3de310 0x55cf1f444770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400fb40 tx=0x7fd9d4007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fb468135b69687e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9d0c00640 10 client.0 ms_handle_connect on v2:172.21.15.171:3301/0 2024-03-19T06:23:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9d0c00640 1 -- 172.21.15.32:0/3754183745 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4032060 con 0x55cf1f3de310 2024-03-19T06:23:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 1 -- 172.21.15.32:0/3754183745 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd9cc0a8070 con 0x55cf1f3de310 2024-03-19T06:23:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9d0c00640 1 -- 172.21.15.32:0/3754183745 <== mon.2 v2:172.21.15.171:3301/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9d4010040 con 0x55cf1f3de310 2024-03-19T06:23:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9d0c00640 1 -- 172.21.15.32:0/3754183745 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9d4038050 con 0x55cf1f3de310 2024-03-19T06:23:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 10 client.5453 fetch_fsmap learned FSMap version 26 2024-03-19T06:23:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 1 -- 172.21.15.32:0/3754183745 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55cf1f1dd0a0 con 0x55cf1f3de310 2024-03-19T06:23:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9d0c00640 1 -- 172.21.15.32:0/3754183745 <== mon.2 v2:172.21.15.171:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc0a8070 con 0x55cf1f3de310 2024-03-19T06:23:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9d0c00640 1 -- 172.21.15.32:0/3754183745 <== mon.2 v2:172.21.15.171:3301/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd9d403b020 con 0x55cf1f3de310 2024-03-19T06:23:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 10 client.5453 fetch_fsmap finished waiting for FSMap version 26 2024-03-19T06:23:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 10 client.5453 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-19T06:23:33.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 20 client.5453 populate_metadata read hostname 'smithi032' 2024-03-19T06:23:33.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/3754183745 >> [v2:172.21.15.171:6835/1907516739,v1:172.21.15.171:6837/1907516739] conn(0x55cf1f431680 0x55cf1f491040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:33.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 4 client.5453 mds_command: new command op to 5934 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-19T06:23:33.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 1 -- 172.21.15.32:0/3754183745 --> [v2:172.21.15.171:6835/1907516739,v1:172.21.15.171:6837/1907516739] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cf1f2434e0 con 0x55cf1f431680 2024-03-19T06:23:33.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9dbe00640 1 --2- 172.21.15.32:0/3754183745 >> [v2:172.21.15.171:6835/1907516739,v1:172.21.15.171:6837/1907516739] conn(0x55cf1f431680 0x55cf1f491040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:33.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9dbe00640 1 --2- 172.21.15.32:0/3754183745 >> [v2:172.21.15.171:6835/1907516739,v1:172.21.15.171:6837/1907516739] conn(0x55cf1f431680 0x55cf1f491040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce7ed6f098aa9752 server_cookie=af9ae16e842376c2 in_seq=0 out_seq=0 2024-03-19T06:23:33.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9d0c00640 10 client.5453 ms_handle_connect on v2:172.21.15.171:6835/1907516739 2024-03-19T06:23:33.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9d0c00640 1 -- 172.21.15.32:0/3754183745 <== mds.0 v2:172.21.15.171:6835/1907516739 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55cf1f2434e0 con 0x55cf1f431680 2024-03-19T06:23:33.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9d0c00640 10 client.5453 handle_command_reply: tid=0 2024-03-19T06:23:33.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 1 client.5453 shutdown 2024-03-19T06:23:33.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 1 -- 172.21.15.32:0/3754183745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3de310 msgr2=0x55cf1f444770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:33.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/3754183745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3de310 0x55cf1f444770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400fb40 tx=0x7fd9d4007f90 comp rx=0 tx=0).stop 2024-03-19T06:23:33.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 1 -- 172.21.15.32:0/3754183745 shutdown_connections 2024-03-19T06:23:33.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/3754183745 >> [v2:172.21.15.171:6835/1907516739,v1:172.21.15.171:6837/1907516739] conn(0x55cf1f431680 0x55cf1f491040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/3754183745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf1f430d60 0x55cf1f44d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/3754183745 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55cf1f3e6f90 0x55cf1f44cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 1 --2- 172.21.15.32:0/3754183745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55cf1f3de310 0x55cf1f444770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9d0c00640 0 client.5453 ms_handle_reset on v2:172.21.15.171:6835/1907516739 2024-03-19T06:23:33.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 1 -- 172.21.15.32:0/3754183745 >> 172.21.15.32:0/3754183745 conn(0x55cf1f4301c0 msgr2=0x55cf1f4404d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:33.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 1 -- 172.21.15.32:0/3754183745 shutdown_connections 2024-03-19T06:23:33.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 1 -- 172.21.15.32:0/3754183745 wait complete. 2024-03-19T06:23:33.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.023+0000 7fd9edc5b000 20 client.5453 trim_cache size 0 max 16384 2024-03-19T06:23:33.018 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:23:33.018 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "5b96820f-940f-489f-8b00-afd5c905fd95", 2024-03-19T06:23:33.018 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2024-03-19T06:23:33.018 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 5934, 2024-03-19T06:23:33.018 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2024-03-19T06:23:33.018 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2024-03-19T06:23:33.018 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2024-03-19T06:23:33.018 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 10.480168430999999, 2024-03-19T06:23:33.018 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 26, 2024-03-19T06:23:33.018 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 51, 2024-03-19T06:23:33.018 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 51, 2024-03-19T06:23:33.018 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 16.320739241999998 2024-03-19T06:23:33.019 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:23:33.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.027+0000 7fd9ea800640 1 -- 172.21.15.32:0/847166511 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd9c0067660 msgr2=0x7fd9c0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:33.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.027+0000 7fd9ea800640 1 --2- 172.21.15.32:0/847166511 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd9c0067660 0x7fd9c0069b20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4001810 tx=0x7fd9d4009040 comp rx=0 tx=0).stop 2024-03-19T06:23:33.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.027+0000 7fd9ea800640 1 -- 172.21.15.32:0/847166511 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9e40cc680 msgr2=0x7fd9e4159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:33.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.027+0000 7fd9ea800640 1 --2- 172.21.15.32:0/847166511 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9e40cc680 0x7fd9e4159580 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc01a100 tx=0x7fd9cc01ad10 comp rx=0 tx=0).stop 2024-03-19T06:23:33.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.027+0000 7fd9ea800640 1 -- 172.21.15.32:0/847166511 shutdown_connections 2024-03-19T06:23:33.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.027+0000 7fd9ea800640 1 --2- 172.21.15.32:0/847166511 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fd9c0067660 0x7fd9c0069b20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.027+0000 7fd9ea800640 1 --2- 172.21.15.32:0/847166511 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9e415a7c0 0x7fd9e4150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.027+0000 7fd9ea800640 1 --2- 172.21.15.32:0/847166511 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9e40cc680 0x7fd9e4159580 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.027+0000 7fd9ea800640 1 --2- 172.21.15.32:0/847166511 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9e40b4c50 0x7fd9e415c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.027+0000 7fd9ea800640 1 -- 172.21.15.32:0/847166511 >> 172.21.15.32:0/847166511 conn(0x7fd9e40b1280 msgr2=0x7fd9e40c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:33.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.027+0000 7fd9ea800640 1 -- 172.21.15.32:0/847166511 shutdown_connections 2024-03-19T06:23:33.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.027+0000 7fd9ea800640 1 -- 172.21.15.32:0/847166511 wait complete. 2024-03-19T06:23:33.033 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-19T06:23:33.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.187+0000 7f5ac7600640 1 Processor -- start 2024-03-19T06:23:33.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.187+0000 7f5ac7600640 1 -- start start 2024-03-19T06:23:33.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.187+0000 7f5ac7600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5ac015c010 0x7f5ac015f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:33.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.187+0000 7f5ac7600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac015fe20 con 0x7f5ac006d6c0 2024-03-19T06:23:33.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.187+0000 7f5ac7600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac0160100 con 0x7f5ac00aecf0 2024-03-19T06:23:33.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.187+0000 7f5ac7600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac01603e0 con 0x7f5ac015c010 2024-03-19T06:23:33.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.187+0000 7f5abfe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5ac015c010 0x7f5ac015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:33.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.187+0000 7f5ac5600640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5ac006d6c0 0x7f5ac00cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41626/0 (socket says 172.21.15.32:41626) 2024-03-19T06:23:33.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.187+0000 7f5abfe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5ac015c010 0x7f5ac015f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41034/0 (socket says 172.21.15.32:41034) 2024-03-19T06:23:33.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.187+0000 7f5ac5600640 1 -- 172.21.15.32:0/3373132563 learned_addr learned my addr 172.21.15.32:0/3373132563 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:33.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.187+0000 7f5abfe00640 1 -- 172.21.15.32:0/3373132563 >> v1:172.21.15.171:6789/0 conn(0x7f5ac00aecf0 legacy=0x7f5ac00ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:33.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.187+0000 7f5abfe00640 1 -- 172.21.15.32:0/3373132563 >> v1:172.21.15.32:6789/0 conn(0x7f5ac006d6c0 legacy=0x7f5ac00cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:33.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.187+0000 7f5abfe00640 1 -- 172.21.15.32:0/3373132563 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac00ca1f0 con 0x7f5ac015c010 2024-03-19T06:23:33.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.191+0000 7f5abfe00640 1 --2- 172.21.15.32:0/3373132563 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ac015c010 0x7f5ac015f520 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0097c0 tx=0x7f5aac01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9656ba46566651a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:33.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.191+0000 7f5abf400640 1 -- 172.21.15.32:0/3373132563 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac0b0070 con 0x7f5ac015c010 2024-03-19T06:23:33.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.191+0000 7f5abf400640 1 -- 172.21.15.32:0/3373132563 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aac0ab600 con 0x7f5ac015c010 2024-03-19T06:23:33.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.191+0000 7f5abf400640 1 -- 172.21.15.32:0/3373132563 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac0ab9d0 con 0x7f5ac015c010 2024-03-19T06:23:33.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.191+0000 7f5ac7600640 1 -- 172.21.15.32:0/3373132563 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ac015c010 msgr2=0x7f5ac015f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:33.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.191+0000 7f5ac7600640 1 --2- 172.21.15.32:0/3373132563 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ac015c010 0x7f5ac015f520 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0097c0 tx=0x7f5aac01c410 comp rx=0 tx=0).stop 2024-03-19T06:23:33.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.191+0000 7f5ac7600640 1 -- 172.21.15.32:0/3373132563 shutdown_connections 2024-03-19T06:23:33.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.191+0000 7f5ac7600640 1 --2- 172.21.15.32:0/3373132563 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ac015c010 0x7f5ac015f520 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.191+0000 7f5ac7600640 1 -- 172.21.15.32:0/3373132563 >> 172.21.15.32:0/3373132563 conn(0x7f5ac00b1280 msgr2=0x7f5ac00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:33.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.191+0000 7f5ac7600640 1 -- 172.21.15.32:0/3373132563 shutdown_connections 2024-03-19T06:23:33.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.191+0000 7f5ac7600640 1 -- 172.21.15.32:0/3373132563 wait complete. 2024-03-19T06:23:33.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac7600640 1 Processor -- start 2024-03-19T06:23:33.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac7600640 1 -- start start 2024-03-19T06:23:33.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac7600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ac006d6c0 0x7f5ac0153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:33.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac7600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ac00aecf0 0x7f5ac01fae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:33.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac7600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ac015c010 0x7f5ac0153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:33.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac7600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac016a030 con 0x7f5ac006d6c0 2024-03-19T06:23:33.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac7600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0169eb0 con 0x7f5ac015c010 2024-03-19T06:23:33.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac7600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac016a1b0 con 0x7f5ac00aecf0 2024-03-19T06:23:33.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac4c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ac006d6c0 0x7f5ac0153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:33.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac4c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ac006d6c0 0x7f5ac0153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41050/0 (socket says 172.21.15.32:41050) 2024-03-19T06:23:33.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac4c00640 1 -- 172.21.15.32:0/3876975171 learned_addr learned my addr 172.21.15.32:0/3876975171 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:33.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac5600640 1 --2- 172.21.15.32:0/3876975171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ac015c010 0x7f5ac0153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:33.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5abfe00640 1 --2- 172.21.15.32:0/3876975171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ac00aecf0 0x7f5ac01fae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:33.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac4c00640 1 -- 172.21.15.32:0/3876975171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ac00aecf0 msgr2=0x7f5ac01fae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:33.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac4c00640 1 --2- 172.21.15.32:0/3876975171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ac00aecf0 0x7f5ac01fae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac4c00640 1 -- 172.21.15.32:0/3876975171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ac015c010 msgr2=0x7f5ac0153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:33.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac4c00640 1 --2- 172.21.15.32:0/3876975171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ac015c010 0x7f5ac0153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac4c00640 1 -- 172.21.15.32:0/3876975171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac01542d0 con 0x7f5ac006d6c0 2024-03-19T06:23:33.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac4c00640 1 --2- 172.21.15.32:0/3876975171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ac006d6c0 0x7f5ac0153a50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c530 tx=0x7f5ab400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:33.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5abcc00640 1 -- 172.21.15.32:0/3876975171 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4016020 con 0x7f5ac006d6c0 2024-03-19T06:23:33.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5abcc00640 1 -- 172.21.15.32:0/3876975171 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab4005220 con 0x7f5ac006d6c0 2024-03-19T06:23:33.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac7600640 1 -- 172.21.15.32:0/3876975171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac0153840 con 0x7f5ac006d6c0 2024-03-19T06:23:33.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5abcc00640 1 -- 172.21.15.32:0/3876975171 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4007030 con 0x7f5ac006d6c0 2024-03-19T06:23:33.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac7600640 1 -- 172.21.15.32:0/3876975171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac0154dc0 con 0x7f5ac006d6c0 2024-03-19T06:23:33.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.195+0000 7f5ac7600640 1 -- 172.21.15.32:0/3876975171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac00749e0 con 0x7f5ac006d6c0 2024-03-19T06:23:33.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.199+0000 7f5abcc00640 1 -- 172.21.15.32:0/3876975171 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5ab40071d0 con 0x7f5ac006d6c0 2024-03-19T06:23:33.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.199+0000 7f5abcc00640 1 --2- 172.21.15.32:0/3876975171 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5aa0067660 0x7f5aa0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:33.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.199+0000 7f5abcc00640 1 -- 172.21.15.32:0/3876975171 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ab4085130 con 0x7f5ac006d6c0 2024-03-19T06:23:33.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.199+0000 7f5abfe00640 1 --2- 172.21.15.32:0/3876975171 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5aa0067660 0x7f5aa0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:33.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.199+0000 7f5abfe00640 1 --2- 172.21.15.32:0/3876975171 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5aa0067660 0x7f5aa0069b20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0ad000 tx=0x7f5aac008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:33.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.203+0000 7f5abcc00640 1 -- 172.21.15.32:0/3876975171 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f5ab4020020 con 0x7f5ac006d6c0 2024-03-19T06:23:33.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.399+0000 7f5ac7600640 1 -- 172.21.15.32:0/3876975171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5ac00b20d0 con 0x7f5ac006d6c0 2024-03-19T06:23:33.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.399+0000 7f5abcc00640 1 -- 172.21.15.32:0/3876975171 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5ac01542d0 con 0x7f5ac006d6c0 2024-03-19T06:23:33.387 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-19T06:23:33.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.399+0000 7f5ac7600640 1 -- 172.21.15.32:0/3876975171 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5aa0067660 msgr2=0x7f5aa0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:33.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.399+0000 7f5ac7600640 1 --2- 172.21.15.32:0/3876975171 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5aa0067660 0x7f5aa0069b20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0ad000 tx=0x7f5aac008040 comp rx=0 tx=0).stop 2024-03-19T06:23:33.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.399+0000 7f5ac7600640 1 -- 172.21.15.32:0/3876975171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ac006d6c0 msgr2=0x7f5ac0153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:33.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.399+0000 7f5ac7600640 1 --2- 172.21.15.32:0/3876975171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ac006d6c0 0x7f5ac0153a50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c530 tx=0x7f5ab400c9f0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.399+0000 7f5ac7600640 1 -- 172.21.15.32:0/3876975171 shutdown_connections 2024-03-19T06:23:33.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.399+0000 7f5ac7600640 1 --2- 172.21.15.32:0/3876975171 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5aa0067660 0x7f5aa0069b20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.399+0000 7f5ac7600640 1 --2- 172.21.15.32:0/3876975171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ac015c010 0x7f5ac0153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.399+0000 7f5ac7600640 1 --2- 172.21.15.32:0/3876975171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ac00aecf0 0x7f5ac01fae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.399+0000 7f5ac7600640 1 --2- 172.21.15.32:0/3876975171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ac006d6c0 0x7f5ac0153a50 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:33.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.399+0000 7f5ac7600640 1 -- 172.21.15.32:0/3876975171 >> 172.21.15.32:0/3876975171 conn(0x7f5ac00b1280 msgr2=0x7f5ac00cf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:33.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.399+0000 7f5ac7600640 1 -- 172.21.15.32:0/3876975171 shutdown_connections 2024-03-19T06:23:33.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:33.399+0000 7f5ac7600640 1 -- 172.21.15.32:0/3876975171 wait complete. 2024-03-19T06:23:33.408 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-19T06:23:33.408 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-19T06:23:33.408 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-03-19T06:23:33.408 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-19T06:23:33.408 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:33.408 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-19T06:23:33.409 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-19T06:23:33.409 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-19T06:23:33.409 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:23:33.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:33.409 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-03-19T06:23:33.421 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:23:33.421 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:23:33.421 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:23:33.421 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:33.421 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-03-19T06:23:33.421 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:33.421 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:23:33.421 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:33.421 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-03-19T06:23:33.421 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:23:33.422 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:33.422 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-03-19T06:23:33.422 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-19T06:23:33.422 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:33.422 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-03-19T06:23:33.422 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-03-19T06:23:33.422 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42284sec preferred_lft 42284sec 2024-03-19T06:23:33.422 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-03-19T06:23:33.422 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:33.422 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:23:33.422 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:33.422 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-03-19T06:23:33.422 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-19T06:23:33.423 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:f5:94:d0:dd brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:33.423 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-19T06:23:33.423 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:33.423 INFO:teuthology.orchestra.run.smithi032.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-19T06:23:33.423 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:33.423 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-19T06:23:33.423 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:33.423 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-03-19T06:23:33.423 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:33.423 INFO:teuthology.orchestra.run.smithi032.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-19T06:23:33.423 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:33.423 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-03-19T06:23:33.423 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:33.424 INFO:teuthology.orchestra.run.smithi032.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-19T06:23:33.424 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:33.424 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-03-19T06:23:33.424 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:33.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:33.424 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-19T06:23:33.478 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-03-19T06:23:33.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:33.481 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-03-19T06:23:33.534 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-03-19T06:23:33.534 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-19T06:23:33.534 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-03-19T06:23:33.534 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-19T06:23:33.534 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-03-19T06:23:33.534 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-19T06:23:33.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:33.535 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-03-19T06:23:33.535 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-03-19T06:23:33.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-19T06:23:33.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-19T06:23:33.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-19T06:23:33.535 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-03-19T06:23:33.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:33.629 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-03-19T06:23:33.639 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-19T06:23:33.639 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-19T06:23:33.639 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:23:33.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:33.639 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-03-19T06:23:33.700 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-19T06:23:33.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:23:33.701 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:33.749 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:23:33.749 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:23:33.749 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:33.800 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:23:33.861 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:23:33.918 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:23:33.919 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:23:33.919 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:23:33.919 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:23:33.919 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:23:33.919 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:23:33.919 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:23:33.919 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:23:33.919 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:23:33.919 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:23:33.919 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:23:33.920 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:23:33.921 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:23:33.921 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:33.921 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:33.921 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:33.921 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:33.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:33.922 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:23:33.973 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-19T06:23:33.973 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-19T06:23:34.019 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:23:34.040 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:23:34.090 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:23:34.091 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:23:34.091 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:23:34.091 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:23:34.091 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:23:34.091 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:23:34.091 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:23:34.092 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:23:34.092 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:23:34.092 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:23:34.092 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:23:34.092 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:23:34.092 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:23:34.092 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:23:34.093 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:23:34.093 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:23:34.093 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:23:34.093 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:23:34.093 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:23:34.093 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:23:34.094 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:23:34.094 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:23:34.094 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:23:34.094 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:23:34.094 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:23:34.094 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:23:34.095 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:23:34.095 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:23:34.095 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:23:34.095 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:34.095 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:34.095 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:34.096 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:34.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:34.097 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:23:34.115 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:2024-03-19T06:23:34.127+0000 7f0b36848580 -1 init, newargv = 0x55ee212f9070 newargc=15 2024-03-19T06:23:34.116 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[39180]: starting ceph client 2024-03-19T06:23:34.123 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[39180]: starting fuse 2024-03-19T06:23:34.124 INFO:teuthology.orchestra.run.smithi032.stdout:43 2024-03-19T06:23:34.124 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-03-19T06:23:34.124 DEBUG:teuthology.orchestra.run.smithi032:> sudo stdin-killer -- python3 -c ' 2024-03-19T06:23:34.124 DEBUG:teuthology.orchestra.run.smithi032:> import glob 2024-03-19T06:23:34.124 DEBUG:teuthology.orchestra.run.smithi032:> import re 2024-03-19T06:23:34.124 DEBUG:teuthology.orchestra.run.smithi032:> import os 2024-03-19T06:23:34.124 DEBUG:teuthology.orchestra.run.smithi032:> import subprocess 2024-03-19T06:23:34.125 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:23:34.125 DEBUG:teuthology.orchestra.run.smithi032:> def _find_admin_socket(client_name): 2024-03-19T06:23:34.125 DEBUG:teuthology.orchestra.run.smithi032:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-19T06:23:34.125 DEBUG:teuthology.orchestra.run.smithi032:> files = glob.glob(asok_path) 2024-03-19T06:23:34.125 DEBUG:teuthology.orchestra.run.smithi032:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-19T06:23:34.125 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:23:34.125 DEBUG:teuthology.orchestra.run.smithi032:> # Given a non-glob path, it better be there 2024-03-19T06:23:34.125 DEBUG:teuthology.orchestra.run.smithi032:> if "*" not in asok_path: 2024-03-19T06:23:34.126 DEBUG:teuthology.orchestra.run.smithi032:> assert(len(files) == 1) 2024-03-19T06:23:34.126 DEBUG:teuthology.orchestra.run.smithi032:> return files[0] 2024-03-19T06:23:34.126 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:23:34.126 DEBUG:teuthology.orchestra.run.smithi032:> for f in files: 2024-03-19T06:23:34.126 DEBUG:teuthology.orchestra.run.smithi032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-19T06:23:34.126 DEBUG:teuthology.orchestra.run.smithi032:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-19T06:23:34.126 DEBUG:teuthology.orchestra.run.smithi032:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-19T06:23:34.126 DEBUG:teuthology.orchestra.run.smithi032:> contents = proc_f.read() 2024-03-19T06:23:34.126 DEBUG:teuthology.orchestra.run.smithi032:> if mountpoint in contents: 2024-03-19T06:23:34.126 DEBUG:teuthology.orchestra.run.smithi032:> return f 2024-03-19T06:23:34.127 DEBUG:teuthology.orchestra.run.smithi032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-19T06:23:34.127 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:23:34.127 DEBUG:teuthology.orchestra.run.smithi032:> print(_find_admin_socket("client.0")) 2024-03-19T06:23:34.127 DEBUG:teuthology.orchestra.run.smithi032:> ' 2024-03-19T06:23:34.247 INFO:teuthology.orchestra.run.smithi032.stdout:/var/run/ceph/ceph-client.0.39180.asok 2024-03-19T06:23:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-19T06:23:34.258 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39180.asok 2024-03-19T06:23:34.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:34.259 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39180.asok status 2024-03-19T06:23:34.433 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:23:34.433 INFO:teuthology.orchestra.run.smithi032.stdout: "metadata": { 2024-03-19T06:23:34.433 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_sha1": "b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", 2024-03-19T06:23:34.434 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_version": "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)", 2024-03-19T06:23:34.434 INFO:teuthology.orchestra.run.smithi032.stdout: "entity_id": "0", 2024-03-19T06:23:34.434 INFO:teuthology.orchestra.run.smithi032.stdout: "hostname": "smithi032", 2024-03-19T06:23:34.434 INFO:teuthology.orchestra.run.smithi032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-19T06:23:34.434 INFO:teuthology.orchestra.run.smithi032.stdout: "pid": "39180", 2024-03-19T06:23:34.434 INFO:teuthology.orchestra.run.smithi032.stdout: "root": "/" 2024-03-19T06:23:34.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:34.434 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_count": 0, 2024-03-19T06:23:34.434 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_pinned_count": 0, 2024-03-19T06:23:34.434 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 6114, 2024-03-19T06:23:34.434 INFO:teuthology.orchestra.run.smithi032.stdout: "inst": { 2024-03-19T06:23:34.434 INFO:teuthology.orchestra.run.smithi032.stdout: "name": { 2024-03-19T06:23:34.434 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "client", 2024-03-19T06:23:34.434 INFO:teuthology.orchestra.run.smithi032.stdout: "num": 6114 2024-03-19T06:23:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-03-19T06:23:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-03-19T06:23:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:23:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2553246085 2024-03-19T06:23:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-03-19T06:23:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-03-19T06:23:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:23:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2553246085 2024-03-19T06:23:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: "inst_str": "client.6114 192.168.0.1:0/2553246085", 2024-03-19T06:23:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: "addr_str": "192.168.0.1:0/2553246085", 2024-03-19T06:23:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: "inode_count": 1, 2024-03-19T06:23:34.435 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_epoch": 26, 2024-03-19T06:23:34.436 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch": 51, 2024-03-19T06:23:34.436 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch_barrier": 0, 2024-03-19T06:23:34.436 INFO:teuthology.orchestra.run.smithi032.stdout: "blocklisted": false, 2024-03-19T06:23:34.436 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs" 2024-03-19T06:23:34.436 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:23:34.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:34.449 DEBUG:teuthology.orchestra.run.smithi032:> stat --file-system '--printf=%T 2024-03-19T06:23:34.450 DEBUG:teuthology.orchestra.run.smithi032:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:34.459 INFO:teuthology.orchestra.run.smithi032.stdout:fuseblk 2024-03-19T06:23:34.459 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:34.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:34.459 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:34.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:34.521 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file) 2024-03-19T06:23:34.587 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow r pool=cephfs_data' 2024-03-19T06:23:34.630 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:23:34.634 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:23:34.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.787+0000 7f3136a00640 1 Processor -- start 2024-03-19T06:23:34.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.787+0000 7f3136a00640 1 -- start start 2024-03-19T06:23:34.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.791+0000 7f3136a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f313006ad40 0x7f313006b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:34.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.791+0000 7f3136a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f313006e320 0x7f313015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:34.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.791+0000 7f3136a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313006b660 con 0x7f313006eed0 2024-03-19T06:23:34.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.791+0000 7f3136a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31300cd420 con 0x7f313006e320 2024-03-19T06:23:34.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.791+0000 7f3136a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313006dbb0 con 0x7f313006ad40 2024-03-19T06:23:34.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.791+0000 7f3134a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f313006e320 0x7f313015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:34.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.791+0000 7f3127400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f313006eed0 0x7f31300ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33148/0 (socket says 172.21.15.32:33148) 2024-03-19T06:23:34.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.791+0000 7f3127400640 1 -- 172.21.15.32:0/1592074435 learned_addr learned my addr 172.21.15.32:0/1592074435 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:34.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.791+0000 7f312fe00640 1 --2- 172.21.15.32:0/1592074435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f313006ad40 0x7f313006b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:34.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.791+0000 7f3134a00640 1 -- 172.21.15.32:0/1592074435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f313006ad40 msgr2=0x7f313006b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:34.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.791+0000 7f3134a00640 1 --2- 172.21.15.32:0/1592074435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f313006ad40 0x7f313006b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:34.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.791+0000 7f3134a00640 1 -- 172.21.15.32:0/1592074435 >> v1:172.21.15.32:6789/0 conn(0x7f313006eed0 legacy=0x7f31300ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:34.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.791+0000 7f3134a00640 1 -- 172.21.15.32:0/1592074435 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31300cc290 con 0x7f313006e320 2024-03-19T06:23:34.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.791+0000 7f312f400640 1 -- 172.21.15.32:0/1592074435 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706591819 0 0) 0x7f313006b660 con 0x7f313006eed0 2024-03-19T06:23:34.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3134a00640 1 --2- 172.21.15.32:0/1592074435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f313006e320 0x7f313015bc50 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3128009d90 tx=0x7f312801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93364189516e7dd server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:34.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f312f400640 1 -- 172.21.15.32:0/1592074435 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31280b2070 con 0x7f313006e320 2024-03-19T06:23:34.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f312f400640 1 -- 172.21.15.32:0/1592074435 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313015c9a0 con 0x7f313006e320 2024-03-19T06:23:34.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f312f400640 1 -- 172.21.15.32:0/1592074435 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31280a5b90 con 0x7f313006e320 2024-03-19T06:23:34.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3136a00640 1 -- 172.21.15.32:0/1592074435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f313006e320 msgr2=0x7f313015bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:34.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3136a00640 1 --2- 172.21.15.32:0/1592074435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f313006e320 0x7f313015bc50 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3128009d90 tx=0x7f312801c8b0 comp rx=0 tx=0).stop 2024-03-19T06:23:34.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3136a00640 1 -- 172.21.15.32:0/1592074435 shutdown_connections 2024-03-19T06:23:34.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3136a00640 1 --2- 172.21.15.32:0/1592074435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f313006e320 0x7f313015bc50 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:34.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3136a00640 1 --2- 172.21.15.32:0/1592074435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f313006ad40 0x7f313006b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:34.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3136a00640 1 -- 172.21.15.32:0/1592074435 >> 172.21.15.32:0/1592074435 conn(0x7f31300b1590 msgr2=0x7f31300b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:34.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3136a00640 1 -- 172.21.15.32:0/1592074435 shutdown_connections 2024-03-19T06:23:34.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3136a00640 1 -- 172.21.15.32:0/1592074435 wait complete. 2024-03-19T06:23:34.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3136a00640 1 Processor -- start 2024-03-19T06:23:34.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3136a00640 1 -- start start 2024-03-19T06:23:34.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3136a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f313006ad40 0x7f3130139bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:34.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3136a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f313006e320 0x7f31301553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:34.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3136a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f313006eed0 0x7f31301558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:34.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3136a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3130168690 con 0x7f313006e320 2024-03-19T06:23:34.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3136a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3130168510 con 0x7f313006ad40 2024-03-19T06:23:34.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3136a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3130168810 con 0x7f313006eed0 2024-03-19T06:23:34.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.795+0000 7f3127400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f313006e320 0x7f31301553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:34.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f3127400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f313006e320 0x7f31301553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39346/0 (socket says 172.21.15.32:39346) 2024-03-19T06:23:34.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f3127400640 1 -- 172.21.15.32:0/1471843647 learned_addr learned my addr 172.21.15.32:0/1471843647 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:34.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f312fe00640 1 --2- 172.21.15.32:0/1471843647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f313006ad40 0x7f3130139bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:34.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f3134a00640 1 --2- 172.21.15.32:0/1471843647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f313006eed0 0x7f31301558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:34.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f3127400640 1 -- 172.21.15.32:0/1471843647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f313006eed0 msgr2=0x7f31301558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:34.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f3127400640 1 --2- 172.21.15.32:0/1471843647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f313006eed0 0x7f31301558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:34.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f3127400640 1 -- 172.21.15.32:0/1471843647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f313006ad40 msgr2=0x7f3130139bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:34.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f3127400640 1 --2- 172.21.15.32:0/1471843647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f313006ad40 0x7f3130139bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:34.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f3127400640 1 -- 172.21.15.32:0/1471843647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31300b1020 con 0x7f313006e320 2024-03-19T06:23:34.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f3127400640 1 --2- 172.21.15.32:0/1471843647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f313006e320 0x7f31301553b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f311800c450 tx=0x7f311800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:34.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f312cc00640 1 -- 172.21.15.32:0/1471843647 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3118018070 con 0x7f313006e320 2024-03-19T06:23:34.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f312cc00640 1 -- 172.21.15.32:0/1471843647 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31180074e0 con 0x7f313006e320 2024-03-19T06:23:34.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f312cc00640 1 -- 172.21.15.32:0/1471843647 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31180049f0 con 0x7f313006e320 2024-03-19T06:23:34.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f3136a00640 1 -- 172.21.15.32:0/1471843647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31300b0780 con 0x7f313006e320 2024-03-19T06:23:34.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f3136a00640 1 -- 172.21.15.32:0/1471843647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31300b0d40 con 0x7f313006e320 2024-03-19T06:23:34.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f3136a00640 1 -- 172.21.15.32:0/1471843647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31300749e0 con 0x7f313006e320 2024-03-19T06:23:34.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.799+0000 7f312cc00640 1 -- 172.21.15.32:0/1471843647 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f311801b070 con 0x7f313006e320 2024-03-19T06:23:34.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.803+0000 7f312cc00640 1 --2- 172.21.15.32:0/1471843647 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f310c067660 0x7f310c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:34.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.803+0000 7f312cc00640 1 -- 172.21.15.32:0/1471843647 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3118084ba0 con 0x7f313006e320 2024-03-19T06:23:34.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.803+0000 7f312fe00640 1 --2- 172.21.15.32:0/1471843647 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f310c067660 0x7f310c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:34.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.803+0000 7f312fe00640 1 --2- 172.21.15.32:0/1471843647 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f310c067660 0x7f310c069b20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f31300af850 tx=0x7f3120008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:34.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:34.807+0000 7f312cc00640 1 -- 172.21.15.32:0/1471843647 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f31180551c0 con 0x7f313006e320 2024-03-19T06:23:35.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.023+0000 7f3136a00640 1 -- 172.21.15.32:0/1471843647 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]} v 0) v1 -- 0x7f313006d7b0 con 0x7f313006e320 2024-03-19T06:23:35.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.027+0000 7f312cc00640 1 -- 172.21.15.32:0/1471843647 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]}]=0 updated caps for client.0 v16) v1 ==== 183+0+140 (secure 0 0 0) 0x7f3118059260 con 0x7f313006e320 2024-03-19T06:23:35.015 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-03-19T06:23:35.015 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCWLvll4jsFMxAAr4PzH6Djodh2O01vGYgxKA== 2024-03-19T06:23:35.015 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow" 2024-03-19T06:23:35.015 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2024-03-19T06:23:35.015 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow r pool=cephfs_data" 2024-03-19T06:23:35.016 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.0 2024-03-19T06:23:35.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.027+0000 7f3136a00640 1 -- 172.21.15.32:0/1471843647 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f310c067660 msgr2=0x7f310c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.027+0000 7f3136a00640 1 --2- 172.21.15.32:0/1471843647 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f310c067660 0x7f310c069b20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f31300af850 tx=0x7f3120008040 comp rx=0 tx=0).stop 2024-03-19T06:23:35.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.027+0000 7f3136a00640 1 -- 172.21.15.32:0/1471843647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f313006e320 msgr2=0x7f31301553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.027+0000 7f3136a00640 1 --2- 172.21.15.32:0/1471843647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f313006e320 0x7f31301553b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f311800c450 tx=0x7f311800c910 comp rx=0 tx=0).stop 2024-03-19T06:23:35.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.027+0000 7f3136a00640 1 -- 172.21.15.32:0/1471843647 shutdown_connections 2024-03-19T06:23:35.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.027+0000 7f3136a00640 1 --2- 172.21.15.32:0/1471843647 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f310c067660 0x7f310c069b20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.027+0000 7f3136a00640 1 --2- 172.21.15.32:0/1471843647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f313006eed0 0x7f31301558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.027+0000 7f3136a00640 1 --2- 172.21.15.32:0/1471843647 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f313006e320 0x7f31301553b0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.027+0000 7f3136a00640 1 --2- 172.21.15.32:0/1471843647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f313006ad40 0x7f3130139bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.027+0000 7f3136a00640 1 -- 172.21.15.32:0/1471843647 >> 172.21.15.32:0/1471843647 conn(0x7f31300b1590 msgr2=0x7f31300cfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:35.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.031+0000 7f3136a00640 1 -- 172.21.15.32:0/1471843647 shutdown_connections 2024-03-19T06:23:35.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.031+0000 7f3136a00640 1 -- 172.21.15.32:0/1471843647 wait complete. 2024-03-19T06:23:35.036 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:23:35.036 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:23:35.045 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:23:35.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.243+0000 7fb744e00640 1 Processor -- start 2024-03-19T06:23:35.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.243+0000 7fb744e00640 1 -- start start 2024-03-19T06:23:35.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.243+0000 7fb744e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb740162050 0x7fb7400c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.243+0000 7fb744e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb74006d590 0x7fb7400cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.243+0000 7fb744e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7400cdcf0 con 0x7fb74006d9f0 2024-03-19T06:23:35.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.243+0000 7fb744e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb740165c40 con 0x7fb740162050 2024-03-19T06:23:35.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.243+0000 7fb744e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400cdfd0 con 0x7fb74006d590 2024-03-19T06:23:35.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73e800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb74006d9f0 0x7fb7401660d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33152/0 (socket says 172.21.15.32:33152) 2024-03-19T06:23:35.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73e800640 1 -- 172.21.15.32:0/5680970 learned_addr learned my addr 172.21.15.32:0/5680970 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:35.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73de00640 1 --2- 172.21.15.32:0/5680970 >> v2:172.21.15.171:3300/0 conn(0x7fb740162050 0x7fb7400c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb737e00640 1 --2- 172.21.15.32:0/5680970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb74006d590 0x7fb7400cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73d400640 1 -- 172.21.15.32:0/5680970 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742069336 0 0) 0x7fb7400cdcf0 con 0x7fb74006d9f0 2024-03-19T06:23:35.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73d400640 1 -- 172.21.15.32:0/5680970 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb724003530 con 0x7fb74006d9f0 2024-03-19T06:23:35.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73d400640 1 -- 172.21.15.32:0/5680970 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4041489042 0 0) 0x7fb724003530 con 0x7fb74006d9f0 2024-03-19T06:23:35.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73d400640 1 -- 172.21.15.32:0/5680970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb74006d590 msgr2=0x7fb7400cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:35.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73d400640 1 --2- 172.21.15.32:0/5680970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb74006d590 0x7fb7400cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73d400640 1 -- 172.21.15.32:0/5680970 >> v2:172.21.15.171:3300/0 conn(0x7fb740162050 msgr2=0x7fb7400c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:35.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73d400640 1 --2- 172.21.15.32:0/5680970 >> v2:172.21.15.171:3300/0 conn(0x7fb740162050 0x7fb7400c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73d400640 1 -- 172.21.15.32:0/5680970 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7400ce2b0 con 0x7fb74006d9f0 2024-03-19T06:23:35.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73de00640 1 --2- 172.21.15.32:0/5680970 >> v2:172.21.15.171:3300/0 conn(0x7fb740162050 0x7fb7400c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:23:35.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73d400640 1 -- 172.21.15.32:0/5680970 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fb738001a00 con 0x7fb74006d9f0 2024-03-19T06:23:35.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73d400640 1 -- 172.21.15.32:0/5680970 >> v1:172.21.15.32:6789/0 conn(0x7fb74006d9f0 legacy=0x7fb7401660d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73d400640 1 --2- 172.21.15.32:0/5680970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb74006d590 0x7fb7240039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73d400640 1 --2- 172.21.15.32:0/5680970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb724003f40 0x7fb724004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73d400640 1 --2- 172.21.15.32:0/5680970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb724004d50 0x7fb7240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73d400640 1 -- 172.21.15.32:0/5680970 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb740165c40 con 0x7fb724003f40 2024-03-19T06:23:35.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73d400640 1 -- 172.21.15.32:0/5680970 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400cdfd0 con 0x7fb724004d50 2024-03-19T06:23:35.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73d400640 1 -- 172.21.15.32:0/5680970 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72400b9d0 con 0x7fb74006d590 2024-03-19T06:23:35.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb737e00640 1 --2- 172.21.15.32:0/5680970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb724003f40 0x7fb724004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73de00640 1 --2- 172.21.15.32:0/5680970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb74006d590 0x7fb7240039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73e800640 1 --2- 172.21.15.32:0/5680970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb724004d50 0x7fb7240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb737e00640 1 -- 172.21.15.32:0/5680970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb74006d590 msgr2=0x7fb7240039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:35.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb737e00640 1 --2- 172.21.15.32:0/5680970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb74006d590 0x7fb7240039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb737e00640 1 -- 172.21.15.32:0/5680970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb724004d50 msgr2=0x7fb7240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:35.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb737e00640 1 --2- 172.21.15.32:0/5680970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb724004d50 0x7fb7240051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb737e00640 1 -- 172.21.15.32:0/5680970 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb724003530 con 0x7fb724003f40 2024-03-19T06:23:35.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.247+0000 7fb73e800640 1 --2- 172.21.15.32:0/5680970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb724004d50 0x7fb7240051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:35.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.251+0000 7fb737e00640 1 --2- 172.21.15.32:0/5680970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb724003f40 0x7fb724004810 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb728009ae0 tx=0x7fb72801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3833b57034cbc0f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:35.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.251+0000 7fb73d400640 1 -- 172.21.15.32:0/5680970 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7280b2070 con 0x7fb724003f40 2024-03-19T06:23:35.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.251+0000 7fb73d400640 1 -- 172.21.15.32:0/5680970 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7280a5660 con 0x7fb724003f40 2024-03-19T06:23:35.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.251+0000 7fb73d400640 1 -- 172.21.15.32:0/5680970 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7280096b0 con 0x7fb724003f40 2024-03-19T06:23:35.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.251+0000 7fb744e00640 1 -- 172.21.15.32:0/5680970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb724003f40 msgr2=0x7fb724004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.251+0000 7fb744e00640 1 --2- 172.21.15.32:0/5680970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb724003f40 0x7fb724004810 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb728009ae0 tx=0x7fb72801ca10 comp rx=0 tx=0).stop 2024-03-19T06:23:35.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.251+0000 7fb73e800640 1 -- 172.21.15.32:0/5680970 reap_dead start 2024-03-19T06:23:35.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.251+0000 7fb744e00640 1 -- 172.21.15.32:0/5680970 shutdown_connections 2024-03-19T06:23:35.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.251+0000 7fb744e00640 1 -- 172.21.15.32:0/5680970 >> 172.21.15.32:0/5680970 conn(0x7fb7400b1280 msgr2=0x7fb7400b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:35.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.251+0000 7fb744e00640 1 -- 172.21.15.32:0/5680970 shutdown_connections 2024-03-19T06:23:35.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.251+0000 7fb744e00640 1 -- 172.21.15.32:0/5680970 wait complete. 2024-03-19T06:23:35.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.251+0000 7fb744e00640 1 Processor -- start 2024-03-19T06:23:35.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.251+0000 7fb744e00640 1 -- start start 2024-03-19T06:23:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb744e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb724003f40 0x7fb74014f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb744e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb740164780 0x7fb7401607c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb744e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7400b1690 0x7fb7400b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb744e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400cd910 con 0x7fb7400b1690 2024-03-19T06:23:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb744e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb740162430 con 0x7fb740164780 2024-03-19T06:23:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb744e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400cda90 con 0x7fb724003f40 2024-03-19T06:23:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb73e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7400b1690 0x7fb7400b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb73de00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb724003f40 0x7fb74014f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb73e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7400b1690 0x7fb7400b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39366/0 (socket says 172.21.15.32:39366) 2024-03-19T06:23:35.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb73e800640 1 -- 172.21.15.32:0/1408791530 learned_addr learned my addr 172.21.15.32:0/1408791530 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:35.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb737e00640 1 --2- 172.21.15.32:0/1408791530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb740164780 0x7fb7401607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb73e800640 1 -- 172.21.15.32:0/1408791530 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb724003f40 msgr2=0x7fb74014f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb73e800640 1 --2- 172.21.15.32:0/1408791530 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb724003f40 0x7fb74014f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb73e800640 1 -- 172.21.15.32:0/1408791530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb740164780 msgr2=0x7fb7401607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb73e800640 1 --2- 172.21.15.32:0/1408791530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb740164780 0x7fb7401607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb73e800640 1 -- 172.21.15.32:0/1408791530 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb740164cd0 con 0x7fb7400b1690 2024-03-19T06:23:35.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb73e800640 1 --2- 172.21.15.32:0/1408791530 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7400b1690 0x7fb7400b1b10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb738002240 tx=0x7fb738011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:35.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb736000640 1 -- 172.21.15.32:0/1408791530 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738010040 con 0x7fb7400b1690 2024-03-19T06:23:35.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb736000640 1 -- 172.21.15.32:0/1408791530 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73801a070 con 0x7fb7400b1690 2024-03-19T06:23:35.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb736000640 1 -- 172.21.15.32:0/1408791530 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73800faa0 con 0x7fb7400b1690 2024-03-19T06:23:35.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb744e00640 1 -- 172.21.15.32:0/1408791530 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb740164fb0 con 0x7fb7400b1690 2024-03-19T06:23:35.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb744e00640 1 -- 172.21.15.32:0/1408791530 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb740165570 con 0x7fb7400b1690 2024-03-19T06:23:35.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb744e00640 1 -- 172.21.15.32:0/1408791530 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7400749e0 con 0x7fb7400b1690 2024-03-19T06:23:35.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.255+0000 7fb736000640 1 -- 172.21.15.32:0/1408791530 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb73800fc40 con 0x7fb7400b1690 2024-03-19T06:23:35.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.259+0000 7fb736000640 1 --2- 172.21.15.32:0/1408791530 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb71c067660 0x7fb71c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.259+0000 7fb736000640 1 -- 172.21.15.32:0/1408791530 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb738088610 con 0x7fb7400b1690 2024-03-19T06:23:35.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.259+0000 7fb73de00640 1 --2- 172.21.15.32:0/1408791530 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb71c067660 0x7fb71c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.259+0000 7fb73de00640 1 --2- 172.21.15.32:0/1408791530 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb71c067660 0x7fb71c069b20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb730009de0 tx=0x7fb730009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:35.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.263+0000 7fb736000640 1 -- 172.21.15.32:0/1408791530 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fb738058ba0 con 0x7fb7400b1690 2024-03-19T06:23:35.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.423+0000 7fb744e00640 1 -- 172.21.15.32:0/1408791530 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7400cd1e0 con 0x7fb7400b1690 2024-03-19T06:23:35.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.423+0000 7fb736000640 1 -- 172.21.15.32:0/1408791530 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16681 (secure 0 0 0) 0x7fb73805cc40 con 0x7fb7400b1690 2024-03-19T06:23:35.413 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:35.413 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":51,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:23:23.544172+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:23:19.707249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-19T06:23:20.926932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:23:35.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.427+0000 7fb744e00640 1 -- 172.21.15.32:0/1408791530 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb71c067660 msgr2=0x7fb71c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.427+0000 7fb744e00640 1 --2- 172.21.15.32:0/1408791530 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb71c067660 0x7fb71c069b20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb730009de0 tx=0x7fb730009190 comp rx=0 tx=0).stop 2024-03-19T06:23:35.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.427+0000 7fb744e00640 1 -- 172.21.15.32:0/1408791530 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7400b1690 msgr2=0x7fb7400b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.427+0000 7fb744e00640 1 --2- 172.21.15.32:0/1408791530 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7400b1690 0x7fb7400b1b10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb738002240 tx=0x7fb738011c20 comp rx=0 tx=0).stop 2024-03-19T06:23:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.427+0000 7fb744e00640 1 -- 172.21.15.32:0/1408791530 shutdown_connections 2024-03-19T06:23:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.427+0000 7fb744e00640 1 --2- 172.21.15.32:0/1408791530 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb71c067660 0x7fb71c069b20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.427+0000 7fb744e00640 1 --2- 172.21.15.32:0/1408791530 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7400b1690 0x7fb7400b1b10 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.427+0000 7fb744e00640 1 --2- 172.21.15.32:0/1408791530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb740164780 0x7fb7401607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.427+0000 7fb744e00640 1 --2- 172.21.15.32:0/1408791530 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb724003f40 0x7fb74014f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.427+0000 7fb744e00640 1 -- 172.21.15.32:0/1408791530 >> 172.21.15.32:0/1408791530 conn(0x7fb7400b1280 msgr2=0x7fb740071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.427+0000 7fb744e00640 1 -- 172.21.15.32:0/1408791530 shutdown_connections 2024-03-19T06:23:35.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.427+0000 7fb744e00640 1 -- 172.21.15.32:0/1408791530 wait complete. 2024-03-19T06:23:35.434 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:23:19.707249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:23:20.926932+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:23:35.435 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:23:35.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f9711000640 1 Processor -- start 2024-03-19T06:23:35.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f9711000640 1 -- start start 2024-03-19T06:23:35.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f9711000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f970c071550 0x7f970c071930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f9711000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f970c0b3690 0x7f970c150f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f9711000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970c071e70 con 0x7f970c150ad0 2024-03-19T06:23:35.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f9711000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970c1514a0 con 0x7f970c071550 2024-03-19T06:23:35.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f9711000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c0b3c00 con 0x7f970c0b3690 2024-03-19T06:23:35.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f9703e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f970c150ad0 0x7f970c0b2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33158/0 (socket says 172.21.15.32:33158) 2024-03-19T06:23:35.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f9703e00640 1 -- 172.21.15.32:0/976373833 learned_addr learned my addr 172.21.15.32:0/976373833 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:35.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f9709e00640 1 --2- 172.21.15.32:0/976373833 >> v2:172.21.15.171:3300/0 conn(0x7f970c071550 0x7f970c071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f970a800640 1 --2- 172.21.15.32:0/976373833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f970c0b3690 0x7f970c150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f9709400640 1 -- 172.21.15.32:0/976373833 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679472769 0 0) 0x7f970c071e70 con 0x7f970c150ad0 2024-03-19T06:23:35.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f9709400640 1 -- 172.21.15.32:0/976373833 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96f0003530 con 0x7f970c150ad0 2024-03-19T06:23:35.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f9709e00640 1 -- 172.21.15.32:0/976373833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f970c0b3690 msgr2=0x7f970c150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:35.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f9709e00640 1 --2- 172.21.15.32:0/976373833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f970c0b3690 0x7f970c150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f9709e00640 1 -- 172.21.15.32:0/976373833 >> v1:172.21.15.32:6789/0 conn(0x7f970c150ad0 legacy=0x7f970c0b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.591+0000 7f9709e00640 1 -- 172.21.15.32:0/976373833 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c0b3ee0 con 0x7f970c071550 2024-03-19T06:23:35.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.595+0000 7f9709e00640 1 --2- 172.21.15.32:0/976373833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f970c071550 0x7f970c071930 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00ba60 tx=0x7f96fc01eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a08ed5d980d1a20 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:35.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.599+0000 7f9709400640 1 -- 172.21.15.32:0/976373833 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc0b4070 con 0x7f970c071550 2024-03-19T06:23:35.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9709400640 1 -- 172.21.15.32:0/976373833 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc0a7ab0 con 0x7f970c071550 2024-03-19T06:23:35.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9709400640 1 -- 172.21.15.32:0/976373833 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc0af440 con 0x7f970c071550 2024-03-19T06:23:35.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9711000640 1 -- 172.21.15.32:0/976373833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f970c071550 msgr2=0x7f970c071930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9711000640 1 --2- 172.21.15.32:0/976373833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f970c071550 0x7f970c071930 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00ba60 tx=0x7f96fc01eb70 comp rx=0 tx=0).stop 2024-03-19T06:23:35.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9711000640 1 -- 172.21.15.32:0/976373833 shutdown_connections 2024-03-19T06:23:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9711000640 1 --2- 172.21.15.32:0/976373833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f970c0b3690 0x7f970c150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9711000640 1 --2- 172.21.15.32:0/976373833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f970c071550 0x7f970c071930 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9711000640 1 -- 172.21.15.32:0/976373833 >> 172.21.15.32:0/976373833 conn(0x7f970c0b1590 msgr2=0x7f970c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9711000640 1 -- 172.21.15.32:0/976373833 shutdown_connections 2024-03-19T06:23:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9711000640 1 -- 172.21.15.32:0/976373833 wait complete. 2024-03-19T06:23:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9711000640 1 Processor -- start 2024-03-19T06:23:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9711000640 1 -- start start 2024-03-19T06:23:35.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9711000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f970c071550 0x7f970c1456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9711000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f970c0b3690 0x7f970c0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9711000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f970c150ad0 0x7f970c147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9711000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c15adc0 con 0x7f970c071550 2024-03-19T06:23:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9711000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c15ac40 con 0x7f970c0b3690 2024-03-19T06:23:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9711000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c15af40 con 0x7f970c150ad0 2024-03-19T06:23:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9709e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f970c071550 0x7f970c1456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9709e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f970c071550 0x7f970c1456a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39370/0 (socket says 172.21.15.32:39370) 2024-03-19T06:23:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9709e00640 1 -- 172.21.15.32:0/285900166 learned_addr learned my addr 172.21.15.32:0/285900166 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f970a800640 1 --2- 172.21.15.32:0/285900166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f970c150ad0 0x7f970c147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.603+0000 7f9703e00640 1 --2- 172.21.15.32:0/285900166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f970c0b3690 0x7f970c0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.607+0000 7f9709e00640 1 -- 172.21.15.32:0/285900166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f970c150ad0 msgr2=0x7f970c147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.607+0000 7f9709e00640 1 --2- 172.21.15.32:0/285900166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f970c150ad0 0x7f970c147520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.607+0000 7f9709e00640 1 -- 172.21.15.32:0/285900166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f970c0b3690 msgr2=0x7f970c0cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.607+0000 7f9709e00640 1 --2- 172.21.15.32:0/285900166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f970c0b3690 0x7f970c0cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.607+0000 7f9709e00640 1 -- 172.21.15.32:0/285900166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c15b8a0 con 0x7f970c071550 2024-03-19T06:23:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.607+0000 7f9709e00640 1 --2- 172.21.15.32:0/285900166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f970c071550 0x7f970c1456a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00ba60 tx=0x7f96fc01b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:35.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.607+0000 7f9702000640 1 -- 172.21.15.32:0/285900166 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc0b4040 con 0x7f970c071550 2024-03-19T06:23:35.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.607+0000 7f9702000640 1 -- 172.21.15.32:0/285900166 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc0afcf0 con 0x7f970c071550 2024-03-19T06:23:35.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.607+0000 7f9702000640 1 -- 172.21.15.32:0/285900166 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc0b8810 con 0x7f970c071550 2024-03-19T06:23:35.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.607+0000 7f9711000640 1 -- 172.21.15.32:0/285900166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970c15bb80 con 0x7f970c071550 2024-03-19T06:23:35.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.607+0000 7f9711000640 1 -- 172.21.15.32:0/285900166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c15c140 con 0x7f970c071550 2024-03-19T06:23:35.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.607+0000 7f9711000640 1 -- 172.21.15.32:0/285900166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970c0749e0 con 0x7f970c071550 2024-03-19T06:23:35.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.607+0000 7f9702000640 1 -- 172.21.15.32:0/285900166 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f96fc0b89b0 con 0x7f970c071550 2024-03-19T06:23:35.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.607+0000 7f9702000640 1 --2- 172.21.15.32:0/285900166 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96e8067660 0x7f96e8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.611+0000 7f9702000640 1 -- 172.21.15.32:0/285900166 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96fc124550 con 0x7f970c071550 2024-03-19T06:23:35.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.611+0000 7f9703e00640 1 --2- 172.21.15.32:0/285900166 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96e8067660 0x7f96e8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.611+0000 7f9703e00640 1 --2- 172.21.15.32:0/285900166 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96e8067660 0x7f96e8069b20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f96f4007fd0 tx=0x7f96f4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:35.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.611+0000 7f9702000640 1 -- 172.21.15.32:0/285900166 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f96fc018760 con 0x7f970c071550 2024-03-19T06:23:35.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.775+0000 7f9711000640 1 -- 172.21.15.32:0/285900166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f970c0722a0 con 0x7f970c071550 2024-03-19T06:23:35.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.775+0000 7f9702000640 1 -- 172.21.15.32:0/285900166 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96fc0f4ae0 con 0x7f970c071550 2024-03-19T06:23:35.762 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:23:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.775+0000 7f9711000640 1 -- 172.21.15.32:0/285900166 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96e8067660 msgr2=0x7f96e8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.775+0000 7f9711000640 1 --2- 172.21.15.32:0/285900166 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96e8067660 0x7f96e8069b20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f96f4007fd0 tx=0x7f96f4009040 comp rx=0 tx=0).stop 2024-03-19T06:23:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.775+0000 7f9711000640 1 -- 172.21.15.32:0/285900166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f970c071550 msgr2=0x7f970c1456a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.775+0000 7f9711000640 1 --2- 172.21.15.32:0/285900166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f970c071550 0x7f970c1456a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00ba60 tx=0x7f96fc01b910 comp rx=0 tx=0).stop 2024-03-19T06:23:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.775+0000 7f9711000640 1 -- 172.21.15.32:0/285900166 shutdown_connections 2024-03-19T06:23:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.775+0000 7f9711000640 1 --2- 172.21.15.32:0/285900166 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f96e8067660 0x7f96e8069b20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.775+0000 7f9711000640 1 --2- 172.21.15.32:0/285900166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f970c150ad0 0x7f970c147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.775+0000 7f9711000640 1 --2- 172.21.15.32:0/285900166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f970c0b3690 0x7f970c0cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.775+0000 7f9711000640 1 --2- 172.21.15.32:0/285900166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f970c071550 0x7f970c1456a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.775+0000 7f9711000640 1 -- 172.21.15.32:0/285900166 >> 172.21.15.32:0/285900166 conn(0x7f970c0b1590 msgr2=0x7f970c152b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:35.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.775+0000 7f9711000640 1 -- 172.21.15.32:0/285900166 shutdown_connections 2024-03-19T06:23:35.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.775+0000 7f9711000640 1 -- 172.21.15.32:0/285900166 wait complete. 2024-03-19T06:23:35.783 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:23:35.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.939+0000 7fb465a00640 1 Processor -- start 2024-03-19T06:23:35.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.939+0000 7fb465a00640 1 -- start start 2024-03-19T06:23:35.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.939+0000 7fb465a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb46006ad40 0x7fb46006b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.939+0000 7fb465a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46006b660 con 0x7fb46006eed0 2024-03-19T06:23:35.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.939+0000 7fb465a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4600cc290 con 0x7fb46006e320 2024-03-19T06:23:35.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.939+0000 7fb465a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4600cd420 con 0x7fb46006ad40 2024-03-19T06:23:35.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.939+0000 7fb457e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb46006eed0 0x7fb4600ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33168/0 (socket says 172.21.15.32:33168) 2024-03-19T06:23:35.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.939+0000 7fb457e00640 1 -- 172.21.15.32:0/452089680 learned_addr learned my addr 172.21.15.32:0/452089680 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:35.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.939+0000 7fb45ea00640 1 --2- 172.21.15.32:0/452089680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb46006ad40 0x7fb46006b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.939+0000 7fb45e000640 1 -- 172.21.15.32:0/452089680 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90346306 0 0) 0x7fb46006b660 con 0x7fb46006eed0 2024-03-19T06:23:35.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.939+0000 7fb45e000640 1 -- 172.21.15.32:0/452089680 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb444003530 con 0x7fb46006eed0 2024-03-19T06:23:35.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.939+0000 7fb45e000640 1 -- 172.21.15.32:0/452089680 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130633704 0 0) 0x7fb4600cc290 con 0x7fb46006e320 2024-03-19T06:23:35.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.939+0000 7fb45e000640 1 -- 172.21.15.32:0/452089680 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb46006b660 con 0x7fb46006e320 2024-03-19T06:23:35.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.939+0000 7fb45ea00640 1 -- 172.21.15.32:0/452089680 >> v1:172.21.15.171:6789/0 conn(0x7fb46006e320 legacy=0x7fb46015bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.939+0000 7fb45ea00640 1 -- 172.21.15.32:0/452089680 >> v1:172.21.15.32:6789/0 conn(0x7fb46006eed0 legacy=0x7fb4600ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.939+0000 7fb45ea00640 1 -- 172.21.15.32:0/452089680 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4600cc570 con 0x7fb46006ad40 2024-03-19T06:23:35.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.943+0000 7fb45ea00640 1 --2- 172.21.15.32:0/452089680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb46006ad40 0x7fb46006b120 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb4500097f0 tx=0x7fb45001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2839a73d21673c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:35.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.943+0000 7fb45e000640 1 -- 172.21.15.32:0/452089680 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4500b0070 con 0x7fb46006ad40 2024-03-19T06:23:35.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.943+0000 7fb45e000640 1 -- 172.21.15.32:0/452089680 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4500ab600 con 0x7fb46006ad40 2024-03-19T06:23:35.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.943+0000 7fb45e000640 1 -- 172.21.15.32:0/452089680 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4500ab9d0 con 0x7fb46006ad40 2024-03-19T06:23:35.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.943+0000 7fb465a00640 1 -- 172.21.15.32:0/452089680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb46006ad40 msgr2=0x7fb46006b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.943+0000 7fb465a00640 1 --2- 172.21.15.32:0/452089680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb46006ad40 0x7fb46006b120 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb4500097f0 tx=0x7fb45001c450 comp rx=0 tx=0).stop 2024-03-19T06:23:35.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.943+0000 7fb465a00640 1 -- 172.21.15.32:0/452089680 shutdown_connections 2024-03-19T06:23:35.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.943+0000 7fb465a00640 1 --2- 172.21.15.32:0/452089680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb46006ad40 0x7fb46006b120 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.943+0000 7fb465a00640 1 -- 172.21.15.32:0/452089680 >> 172.21.15.32:0/452089680 conn(0x7fb4600b1590 msgr2=0x7fb4600b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:35.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.943+0000 7fb465a00640 1 -- 172.21.15.32:0/452089680 shutdown_connections 2024-03-19T06:23:35.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.943+0000 7fb465a00640 1 -- 172.21.15.32:0/452089680 wait complete. 2024-03-19T06:23:35.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb465a00640 1 Processor -- start 2024-03-19T06:23:35.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb465a00640 1 -- start start 2024-03-19T06:23:35.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb465a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb46006ad40 0x7fb4600b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb465a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb46006e320 0x7fb460154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb465a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb46006eed0 0x7fb46014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb465a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb460169d30 con 0x7fb46006eed0 2024-03-19T06:23:35.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb465a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46015c980 con 0x7fb46006ad40 2024-03-19T06:23:35.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb465a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb460169eb0 con 0x7fb46006e320 2024-03-19T06:23:35.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb45f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb46006eed0 0x7fb46014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb45f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb46006eed0 0x7fb46014b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39382/0 (socket says 172.21.15.32:39382) 2024-03-19T06:23:35.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb45f400640 1 -- 172.21.15.32:0/3734420290 learned_addr learned my addr 172.21.15.32:0/3734420290 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:35.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb45ea00640 1 --2- 172.21.15.32:0/3734420290 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb46006ad40 0x7fb4600b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb457e00640 1 --2- 172.21.15.32:0/3734420290 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb46006e320 0x7fb460154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb45f400640 1 -- 172.21.15.32:0/3734420290 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb46006e320 msgr2=0x7fb460154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb45f400640 1 --2- 172.21.15.32:0/3734420290 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb46006e320 0x7fb460154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb45f400640 1 -- 172.21.15.32:0/3734420290 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb46006ad40 msgr2=0x7fb4600b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:35.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb45f400640 1 --2- 172.21.15.32:0/3734420290 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb46006ad40 0x7fb4600b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:35.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb45f400640 1 -- 172.21.15.32:0/3734420290 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb460159b80 con 0x7fb46006eed0 2024-03-19T06:23:35.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb45f400640 1 --2- 172.21.15.32:0/3734420290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb46006eed0 0x7fb46014b2f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb45800c730 tx=0x7fb45800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:35.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb456a00640 1 -- 172.21.15.32:0/3734420290 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb458003b80 con 0x7fb46006eed0 2024-03-19T06:23:35.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb456a00640 1 -- 172.21.15.32:0/3734420290 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb458003d20 con 0x7fb46006eed0 2024-03-19T06:23:35.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb465a00640 1 -- 172.21.15.32:0/3734420290 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb460159e60 con 0x7fb46006eed0 2024-03-19T06:23:35.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb456a00640 1 -- 172.21.15.32:0/3734420290 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45800aa90 con 0x7fb46006eed0 2024-03-19T06:23:35.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.947+0000 7fb465a00640 1 -- 172.21.15.32:0/3734420290 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46015a420 con 0x7fb46006eed0 2024-03-19T06:23:35.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.951+0000 7fb465a00640 1 -- 172.21.15.32:0/3734420290 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4600749e0 con 0x7fb46006eed0 2024-03-19T06:23:35.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.951+0000 7fb456a00640 1 -- 172.21.15.32:0/3734420290 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb45800ac30 con 0x7fb46006eed0 2024-03-19T06:23:35.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.951+0000 7fb456a00640 1 --2- 172.21.15.32:0/3734420290 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb43c067660 0x7fb43c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:35.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.951+0000 7fb456a00640 1 -- 172.21.15.32:0/3734420290 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4580857f0 con 0x7fb46006eed0 2024-03-19T06:23:35.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.951+0000 7fb45ea00640 1 --2- 172.21.15.32:0/3734420290 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb43c067660 0x7fb43c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:35.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.955+0000 7fb45ea00640 1 --2- 172.21.15.32:0/3734420290 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb43c067660 0x7fb43c069b20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb4600b4c50 tx=0x7fb4500a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:35.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:35.955+0000 7fb456a00640 1 -- 172.21.15.32:0/3734420290 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fb458056460 con 0x7fb46006eed0 2024-03-19T06:23:36.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.119+0000 7fb465a00640 1 -- 172.21.15.32:0/3734420290 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4600cfa90 con 0x7fb46006eed0 2024-03-19T06:23:36.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.119+0000 7fb456a00640 1 -- 172.21.15.32:0/3734420290 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb458055d60 con 0x7fb46006eed0 2024-03-19T06:23:36.107 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:23:36.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.119+0000 7fb465a00640 1 -- 172.21.15.32:0/3734420290 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb43c067660 msgr2=0x7fb43c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:36.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.119+0000 7fb465a00640 1 --2- 172.21.15.32:0/3734420290 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb43c067660 0x7fb43c069b20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb4600b4c50 tx=0x7fb4500a6000 comp rx=0 tx=0).stop 2024-03-19T06:23:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.119+0000 7fb465a00640 1 -- 172.21.15.32:0/3734420290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb46006eed0 msgr2=0x7fb46014b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.119+0000 7fb465a00640 1 --2- 172.21.15.32:0/3734420290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb46006eed0 0x7fb46014b2f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb45800c730 tx=0x7fb45800cbf0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.119+0000 7fb465a00640 1 -- 172.21.15.32:0/3734420290 shutdown_connections 2024-03-19T06:23:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.119+0000 7fb465a00640 1 --2- 172.21.15.32:0/3734420290 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb43c067660 0x7fb43c069b20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.119+0000 7fb465a00640 1 --2- 172.21.15.32:0/3734420290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb46006eed0 0x7fb46014b2f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.119+0000 7fb465a00640 1 --2- 172.21.15.32:0/3734420290 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb46006e320 0x7fb460154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.119+0000 7fb465a00640 1 --2- 172.21.15.32:0/3734420290 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb46006ad40 0x7fb4600b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.119+0000 7fb465a00640 1 -- 172.21.15.32:0/3734420290 >> 172.21.15.32:0/3734420290 conn(0x7fb4600b1590 msgr2=0x7fb4600cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.123+0000 7fb465a00640 1 -- 172.21.15.32:0/3734420290 shutdown_connections 2024-03-19T06:23:36.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.123+0000 7fb465a00640 1 -- 172.21.15.32:0/3734420290 wait complete. 2024-03-19T06:23:36.128 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:23:36.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.283+0000 7ff468e00640 1 Processor -- start 2024-03-19T06:23:36.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.283+0000 7ff468e00640 1 -- start start 2024-03-19T06:23:36.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.283+0000 7ff468e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff4640cf7c0 0x7ff4640b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:36.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.283+0000 7ff468e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46406ec30 con 0x7ff46406be50 2024-03-19T06:23:36.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.283+0000 7ff468e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46406ef10 con 0x7ff464161650 2024-03-19T06:23:36.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.283+0000 7ff468e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46406f1f0 con 0x7ff4640cf7c0 2024-03-19T06:23:36.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.283+0000 7ff461e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff4640cf7c0 0x7ff4640b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:36.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.283+0000 7ff462800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff46406be50 0x7ff46415e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33184/0 (socket says 172.21.15.32:33184) 2024-03-19T06:23:36.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.283+0000 7ff462800640 1 -- 172.21.15.32:0/3311354154 learned_addr learned my addr 172.21.15.32:0/3311354154 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:36.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.287+0000 7ff461e00640 1 -- 172.21.15.32:0/3311354154 >> v1:172.21.15.171:6789/0 conn(0x7ff464161650 legacy=0x7ff46415e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:36.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.287+0000 7ff461e00640 1 -- 172.21.15.32:0/3311354154 >> v1:172.21.15.32:6789/0 conn(0x7ff46406be50 legacy=0x7ff46415e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:36.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.287+0000 7ff461e00640 1 -- 172.21.15.32:0/3311354154 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46406f4d0 con 0x7ff4640cf7c0 2024-03-19T06:23:36.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.287+0000 7ff461400640 1 -- 172.21.15.32:0/3311354154 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229961502 0 0) 0x7ff46406ec30 con 0x7ff46406be50 2024-03-19T06:23:36.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.287+0000 7ff461e00640 1 --2- 172.21.15.32:0/3311354154 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4640cf7c0 0x7ff4640b3850 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff454009820 tx=0x7ff45401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef8e524d136171 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:36.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.287+0000 7ff461400640 1 -- 172.21.15.32:0/3311354154 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4540a7070 con 0x7ff4640cf7c0 2024-03-19T06:23:36.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.287+0000 7ff461400640 1 -- 172.21.15.32:0/3311354154 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4540b0070 con 0x7ff4640cf7c0 2024-03-19T06:23:36.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.287+0000 7ff461400640 1 -- 172.21.15.32:0/3311354154 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4540ab890 con 0x7ff4640cf7c0 2024-03-19T06:23:36.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff468e00640 1 -- 172.21.15.32:0/3311354154 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4640cf7c0 msgr2=0x7ff4640b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:36.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff468e00640 1 --2- 172.21.15.32:0/3311354154 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4640cf7c0 0x7ff4640b3850 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff454009820 tx=0x7ff45401c450 comp rx=0 tx=0).stop 2024-03-19T06:23:36.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff468e00640 1 -- 172.21.15.32:0/3311354154 shutdown_connections 2024-03-19T06:23:36.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff468e00640 1 --2- 172.21.15.32:0/3311354154 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4640cf7c0 0x7ff4640b3850 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff468e00640 1 -- 172.21.15.32:0/3311354154 >> 172.21.15.32:0/3311354154 conn(0x7ff4640b2480 msgr2=0x7ff4640cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:36.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff468e00640 1 -- 172.21.15.32:0/3311354154 shutdown_connections 2024-03-19T06:23:36.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff468e00640 1 -- 172.21.15.32:0/3311354154 wait complete. 2024-03-19T06:23:36.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff468e00640 1 Processor -- start 2024-03-19T06:23:36.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff468e00640 1 -- start start 2024-03-19T06:23:36.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff468e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff46406be50 0x7ff4640acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:36.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff468e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4640cf7c0 0x7ff4641407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:36.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff468e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff464161650 0x7ff464153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:36.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff468e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff464161e70 con 0x7ff46406be50 2024-03-19T06:23:36.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff468e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4640b2f80 con 0x7ff464161650 2024-03-19T06:23:36.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff468e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff464141500 con 0x7ff4640cf7c0 2024-03-19T06:23:36.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff461e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff46406be50 0x7ff4640acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:36.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff461e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff46406be50 0x7ff4640acdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39412/0 (socket says 172.21.15.32:39412) 2024-03-19T06:23:36.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff461e00640 1 -- 172.21.15.32:0/264941783 learned_addr learned my addr 172.21.15.32:0/264941783 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:36.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff462800640 1 --2- 172.21.15.32:0/264941783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff464161650 0x7ff464153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:36.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff45be00640 1 --2- 172.21.15.32:0/264941783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4640cf7c0 0x7ff4641407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:36.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff461e00640 1 -- 172.21.15.32:0/264941783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4640cf7c0 msgr2=0x7ff4641407c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:36.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff461e00640 1 --2- 172.21.15.32:0/264941783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4640cf7c0 0x7ff4641407c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff461e00640 1 -- 172.21.15.32:0/264941783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff464161650 msgr2=0x7ff464153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:36.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff461e00640 1 --2- 172.21.15.32:0/264941783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff464161650 0x7ff464153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff461e00640 1 -- 172.21.15.32:0/264941783 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4641417e0 con 0x7ff46406be50 2024-03-19T06:23:36.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff45be00640 1 --2- 172.21.15.32:0/264941783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4640cf7c0 0x7ff4641407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:36.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.291+0000 7ff461e00640 1 --2- 172.21.15.32:0/264941783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff46406be50 0x7ff4640acdb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff4540ad040 tx=0x7ff45401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:36.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.295+0000 7ff45a000640 1 -- 172.21.15.32:0/264941783 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4540bf610 con 0x7ff46406be50 2024-03-19T06:23:36.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.295+0000 7ff45a000640 1 -- 172.21.15.32:0/264941783 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4540bf7d0 con 0x7ff46406be50 2024-03-19T06:23:36.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.295+0000 7ff45a000640 1 -- 172.21.15.32:0/264941783 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4540bfbc0 con 0x7ff46406be50 2024-03-19T06:23:36.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.295+0000 7ff468e00640 1 -- 172.21.15.32:0/264941783 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff464141ac0 con 0x7ff46406be50 2024-03-19T06:23:36.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.295+0000 7ff468e00640 1 -- 172.21.15.32:0/264941783 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff464142080 con 0x7ff46406be50 2024-03-19T06:23:36.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.295+0000 7ff468e00640 1 -- 172.21.15.32:0/264941783 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4640749e0 con 0x7ff46406be50 2024-03-19T06:23:36.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.295+0000 7ff45a000640 1 -- 172.21.15.32:0/264941783 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff4540bd020 con 0x7ff46406be50 2024-03-19T06:23:36.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.295+0000 7ff45a000640 1 --2- 172.21.15.32:0/264941783 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff440067660 0x7ff440069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:36.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.295+0000 7ff45a000640 1 -- 172.21.15.32:0/264941783 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4541200e0 con 0x7ff46406be50 2024-03-19T06:23:36.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.295+0000 7ff45be00640 1 --2- 172.21.15.32:0/264941783 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff440067660 0x7ff440069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:36.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.299+0000 7ff45be00640 1 --2- 172.21.15.32:0/264941783 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff440067660 0x7ff440069b20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff464151580 tx=0x7ff44c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:36.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.299+0000 7ff45a000640 1 -- 172.21.15.32:0/264941783 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7ff4540c6030 con 0x7ff46406be50 2024-03-19T06:23:36.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.463+0000 7ff468e00640 1 -- 172.21.15.32:0/264941783 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff464142250 con 0x7ff46406be50 2024-03-19T06:23:36.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.463+0000 7ff45a000640 1 -- 172.21.15.32:0/264941783 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff454016070 con 0x7ff46406be50 2024-03-19T06:23:36.452 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:23:36.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.467+0000 7ff468e00640 1 -- 172.21.15.32:0/264941783 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff440067660 msgr2=0x7ff440069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:36.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.467+0000 7ff468e00640 1 --2- 172.21.15.32:0/264941783 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff440067660 0x7ff440069b20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff464151580 tx=0x7ff44c009040 comp rx=0 tx=0).stop 2024-03-19T06:23:36.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.467+0000 7ff468e00640 1 -- 172.21.15.32:0/264941783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff46406be50 msgr2=0x7ff4640acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:36.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.467+0000 7ff468e00640 1 --2- 172.21.15.32:0/264941783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff46406be50 0x7ff4640acdb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff4540ad040 tx=0x7ff45401ac90 comp rx=0 tx=0).stop 2024-03-19T06:23:36.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.467+0000 7ff468e00640 1 -- 172.21.15.32:0/264941783 shutdown_connections 2024-03-19T06:23:36.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.467+0000 7ff468e00640 1 --2- 172.21.15.32:0/264941783 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff440067660 0x7ff440069b20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.467+0000 7ff468e00640 1 --2- 172.21.15.32:0/264941783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff464161650 0x7ff464153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.467+0000 7ff468e00640 1 --2- 172.21.15.32:0/264941783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4640cf7c0 0x7ff4641407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.467+0000 7ff468e00640 1 --2- 172.21.15.32:0/264941783 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff46406be50 0x7ff4640acdb0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.467+0000 7ff468e00640 1 -- 172.21.15.32:0/264941783 >> 172.21.15.32:0/264941783 conn(0x7ff4640b2480 msgr2=0x7ff464071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:36.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.467+0000 7ff468e00640 1 -- 172.21.15.32:0/264941783 shutdown_connections 2024-03-19T06:23:36.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.467+0000 7ff468e00640 1 -- 172.21.15.32:0/264941783 wait complete. 2024-03-19T06:23:36.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:23:36.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.627+0000 7fe5d6800640 1 Processor -- start 2024-03-19T06:23:36.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.627+0000 7fe5d6800640 1 -- start start 2024-03-19T06:23:36.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.627+0000 7fe5d6800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5d015a7c0 0x7fe5d00cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:36.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.627+0000 7fe5d6800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe5d00cc680 0x7fe5d015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:36.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.627+0000 7fe5d6800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d00cb670 con 0x7fe5d00b4c50 2024-03-19T06:23:36.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.627+0000 7fe5d6800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d015e860 con 0x7fe5d00cc680 2024-03-19T06:23:36.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.627+0000 7fe5d6800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d00cb950 con 0x7fe5d015a7c0 2024-03-19T06:23:36.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.631+0000 7fe5cf400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5d015a7c0 0x7fe5d00cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:36.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.631+0000 7fe5cfe00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fe5d00b4c50 0x7fe5d00cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:57012/0 (socket says 172.21.15.32:57012) 2024-03-19T06:23:36.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.631+0000 7fe5cfe00640 1 -- 172.21.15.32:0/2754102375 learned_addr learned my addr 172.21.15.32:0/2754102375 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:36.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.631+0000 7fe5c7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe5d00cc680 0x7fe5d015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:36.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.631+0000 7fe5cf400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5d015a7c0 0x7fe5d00cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:33860/0 (socket says 172.21.15.32:33860) 2024-03-19T06:23:36.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.631+0000 7fe5c7e00640 1 -- 172.21.15.32:0/2754102375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5d015a7c0 msgr2=0x7fe5d00cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:36.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.631+0000 7fe5c7e00640 1 --2- 172.21.15.32:0/2754102375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5d015a7c0 0x7fe5d00cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.631+0000 7fe5c7e00640 1 -- 172.21.15.32:0/2754102375 >> v1:172.21.15.171:6789/0 conn(0x7fe5d00b4c50 legacy=0x7fe5d00cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:36.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.631+0000 7fe5c7e00640 1 -- 172.21.15.32:0/2754102375 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d015e4f0 con 0x7fe5d00cc680 2024-03-19T06:23:36.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.631+0000 7fe5cf400640 1 --2- 172.21.15.32:0/2754102375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5d015a7c0 0x7fe5d00cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:23:36.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.631+0000 7fe5c7e00640 1 --2- 172.21.15.32:0/2754102375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5d00cc680 0x7fe5d015ecf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80097c0 tx=0x7fe5b801c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50e410b8967c9867 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.631+0000 7fe5cea00640 1 -- 172.21.15.32:0/2754102375 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b80b1070 con 0x7fe5d00cc680 2024-03-19T06:23:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5cea00640 1 -- 172.21.15.32:0/2754102375 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b80ac630 con 0x7fe5d00cc680 2024-03-19T06:23:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5cea00640 1 -- 172.21.15.32:0/2754102375 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b80a8050 con 0x7fe5d00cc680 2024-03-19T06:23:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5d6800640 1 -- 172.21.15.32:0/2754102375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5d00cc680 msgr2=0x7fe5d015ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5d6800640 1 --2- 172.21.15.32:0/2754102375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5d00cc680 0x7fe5d015ecf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80097c0 tx=0x7fe5b801c3b0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5d6800640 1 -- 172.21.15.32:0/2754102375 shutdown_connections 2024-03-19T06:23:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5d6800640 1 --2- 172.21.15.32:0/2754102375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5d00cc680 0x7fe5d015ecf0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5d6800640 1 --2- 172.21.15.32:0/2754102375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5d015a7c0 0x7fe5d00cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5d6800640 1 -- 172.21.15.32:0/2754102375 >> 172.21.15.32:0/2754102375 conn(0x7fe5d00b1280 msgr2=0x7fe5d00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5d6800640 1 -- 172.21.15.32:0/2754102375 shutdown_connections 2024-03-19T06:23:36.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5d6800640 1 -- 172.21.15.32:0/2754102375 wait complete. 2024-03-19T06:23:36.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5d6800640 1 Processor -- start 2024-03-19T06:23:36.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5d6800640 1 -- start start 2024-03-19T06:23:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5d6800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5d00b4c50 0x7fe5d0153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5d6800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5d00cc680 0x7fe5d015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5d6800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5d015a7c0 0x7fe5d013cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5d6800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d015f3b0 con 0x7fe5d015a7c0 2024-03-19T06:23:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5d6800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d015f230 con 0x7fe5d00cc680 2024-03-19T06:23:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5d6800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d00cbc30 con 0x7fe5d00b4c50 2024-03-19T06:23:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5cfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5d015a7c0 0x7fe5d013cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5cfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5d015a7c0 0x7fe5d013cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39414/0 (socket says 172.21.15.32:39414) 2024-03-19T06:23:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5cfe00640 1 -- 172.21.15.32:0/2428254184 learned_addr learned my addr 172.21.15.32:0/2428254184 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5c7e00640 1 --2- 172.21.15.32:0/2428254184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5d00cc680 0x7fe5d015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.635+0000 7fe5cf400640 1 --2- 172.21.15.32:0/2428254184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5d00b4c50 0x7fe5d0153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.639+0000 7fe5cfe00640 1 -- 172.21.15.32:0/2428254184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5d00b4c50 msgr2=0x7fe5d0153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:36.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.639+0000 7fe5cfe00640 1 --2- 172.21.15.32:0/2428254184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5d00b4c50 0x7fe5d0153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.639+0000 7fe5cfe00640 1 -- 172.21.15.32:0/2428254184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5d00cc680 msgr2=0x7fe5d015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:36.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.639+0000 7fe5cfe00640 1 --2- 172.21.15.32:0/2428254184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5d00cc680 0x7fe5d015aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.639+0000 7fe5cfe00640 1 -- 172.21.15.32:0/2428254184 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d015b640 con 0x7fe5d015a7c0 2024-03-19T06:23:36.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.639+0000 7fe5cfe00640 1 --2- 172.21.15.32:0/2428254184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5d015a7c0 0x7fe5d013cf10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800ca80 tx=0x7fe5c800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:36.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.639+0000 7fe5c7400640 1 -- 172.21.15.32:0/2428254184 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8017070 con 0x7fe5d015a7c0 2024-03-19T06:23:36.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.639+0000 7fe5c7400640 1 -- 172.21.15.32:0/2428254184 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c800ac30 con 0x7fe5d015a7c0 2024-03-19T06:23:36.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.639+0000 7fe5c7400640 1 -- 172.21.15.32:0/2428254184 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8012400 con 0x7fe5d015a7c0 2024-03-19T06:23:36.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.639+0000 7fe5d6800640 1 -- 172.21.15.32:0/2428254184 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d015b920 con 0x7fe5d015a7c0 2024-03-19T06:23:36.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.639+0000 7fe5d6800640 1 -- 172.21.15.32:0/2428254184 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d015bee0 con 0x7fe5d015a7c0 2024-03-19T06:23:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.639+0000 7fe5d6800640 1 -- 172.21.15.32:0/2428254184 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d00749e0 con 0x7fe5d015a7c0 2024-03-19T06:23:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.639+0000 7fe5c7400640 1 -- 172.21.15.32:0/2428254184 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe5c801a070 con 0x7fe5d015a7c0 2024-03-19T06:23:36.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.639+0000 7fe5c7400640 1 --2- 172.21.15.32:0/2428254184 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5ac067660 0x7fe5ac069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:36.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.639+0000 7fe5c7400640 1 -- 172.21.15.32:0/2428254184 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5c8085440 con 0x7fe5d015a7c0 2024-03-19T06:23:36.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.643+0000 7fe5cf400640 1 --2- 172.21.15.32:0/2428254184 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5ac067660 0x7fe5ac069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:36.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.643+0000 7fe5cf400640 1 --2- 172.21.15.32:0/2428254184 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5ac067660 0x7fe5ac069b20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0009580 tx=0x7fe5c0009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:36.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.643+0000 7fe5c7400640 1 -- 172.21.15.32:0/2428254184 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fe5c8055a60 con 0x7fe5d015a7c0 2024-03-19T06:23:36.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.823+0000 7fe5d6800640 1 -- 172.21.15.32:0/2428254184 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe5d00cc270 con 0x7fe5d015a7c0 2024-03-19T06:23:36.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.823+0000 7fe5c7400640 1 -- 172.21.15.32:0/2428254184 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe5c8059b00 con 0x7fe5d015a7c0 2024-03-19T06:23:36.811 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:23:36.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.823+0000 7fe5d6800640 1 -- 172.21.15.32:0/2428254184 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5ac067660 msgr2=0x7fe5ac069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:36.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.823+0000 7fe5d6800640 1 --2- 172.21.15.32:0/2428254184 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5ac067660 0x7fe5ac069b20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0009580 tx=0x7fe5c0009190 comp rx=0 tx=0).stop 2024-03-19T06:23:36.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.823+0000 7fe5d6800640 1 -- 172.21.15.32:0/2428254184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5d015a7c0 msgr2=0x7fe5d013cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:36.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.823+0000 7fe5d6800640 1 --2- 172.21.15.32:0/2428254184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5d015a7c0 0x7fe5d013cf10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800ca80 tx=0x7fe5c800cf40 comp rx=0 tx=0).stop 2024-03-19T06:23:36.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.823+0000 7fe5d6800640 1 -- 172.21.15.32:0/2428254184 shutdown_connections 2024-03-19T06:23:36.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.823+0000 7fe5d6800640 1 --2- 172.21.15.32:0/2428254184 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5ac067660 0x7fe5ac069b20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.823+0000 7fe5d6800640 1 --2- 172.21.15.32:0/2428254184 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5d015a7c0 0x7fe5d013cf10 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.823+0000 7fe5d6800640 1 --2- 172.21.15.32:0/2428254184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5d00cc680 0x7fe5d015aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.823+0000 7fe5d6800640 1 --2- 172.21.15.32:0/2428254184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5d00b4c50 0x7fe5d0153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:36.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.823+0000 7fe5d6800640 1 -- 172.21.15.32:0/2428254184 >> 172.21.15.32:0/2428254184 conn(0x7fe5d00b1280 msgr2=0x7fe5d00b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:36.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.823+0000 7fe5d6800640 1 -- 172.21.15.32:0/2428254184 shutdown_connections 2024-03-19T06:23:36.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:36.823+0000 7fe5d6800640 1 -- 172.21.15.32:0/2428254184 wait complete. 2024-03-19T06:23:36.832 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:23:36.832 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:23:36.840 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:23:37.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.031+0000 7ff0aea00640 1 Processor -- start 2024-03-19T06:23:37.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.031+0000 7ff0aea00640 1 -- start start 2024-03-19T06:23:37.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.035+0000 7ff0aea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a815a7c0 0x7ff0a80cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.035+0000 7ff0aea00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a80cb670 con 0x7ff0a80cc680 2024-03-19T06:23:37.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.035+0000 7ff0aea00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a80cb950 con 0x7ff0a80b4c50 2024-03-19T06:23:37.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.035+0000 7ff0aea00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a815f400 con 0x7ff0a815a7c0 2024-03-19T06:23:37.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.035+0000 7ff09fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff0a80cc680 0x7ff0a815ecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33198/0 (socket says 172.21.15.32:33198) 2024-03-19T06:23:37.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.035+0000 7ff09fe00640 1 -- 172.21.15.32:0/1330622870 learned_addr learned my addr 172.21.15.32:0/1330622870 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:37.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.035+0000 7ff0a7e00640 1 --2- 172.21.15.32:0/1330622870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a815a7c0 0x7ff0a80cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.035+0000 7ff0a7400640 1 -- 172.21.15.32:0/1330622870 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539217832 0 0) 0x7ff0a80cb670 con 0x7ff0a80cc680 2024-03-19T06:23:37.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.035+0000 7ff0a7400640 1 -- 172.21.15.32:0/1330622870 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff08c003530 con 0x7ff0a80cc680 2024-03-19T06:23:37.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.035+0000 7ff0a7400640 1 -- 172.21.15.32:0/1330622870 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956392401 0 0) 0x7ff0a80cb950 con 0x7ff0a80b4c50 2024-03-19T06:23:37.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.035+0000 7ff0a7400640 1 -- 172.21.15.32:0/1330622870 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0a80cb670 con 0x7ff0a80b4c50 2024-03-19T06:23:37.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.035+0000 7ff0a7400640 1 -- 172.21.15.32:0/1330622870 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 721959025 0 0) 0x7ff08c003530 con 0x7ff0a80cc680 2024-03-19T06:23:37.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.035+0000 7ff0a7e00640 1 -- 172.21.15.32:0/1330622870 >> v1:172.21.15.171:6789/0 conn(0x7ff0a80b4c50 legacy=0x7ff0a80cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.035+0000 7ff0a7e00640 1 -- 172.21.15.32:0/1330622870 >> v1:172.21.15.32:6789/0 conn(0x7ff0a80cc680 legacy=0x7ff0a815ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.035+0000 7ff0a7e00640 1 -- 172.21.15.32:0/1330622870 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a815e4f0 con 0x7ff0a815a7c0 2024-03-19T06:23:37.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.039+0000 7ff0a7e00640 1 --2- 172.21.15.32:0/1330622870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a815a7c0 0x7ff0a80cae20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff0980097f0 tx=0x7ff09801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ab647e09f795781 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:37.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.039+0000 7ff0a7400640 1 -- 172.21.15.32:0/1330622870 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0980b0070 con 0x7ff0a815a7c0 2024-03-19T06:23:37.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.039+0000 7ff0a7400640 1 -- 172.21.15.32:0/1330622870 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0980ab400 con 0x7ff0a815a7c0 2024-03-19T06:23:37.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.039+0000 7ff0a7400640 1 -- 172.21.15.32:0/1330622870 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090001680 con 0x7ff0a815a7c0 2024-03-19T06:23:37.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.039+0000 7ff0aea00640 1 -- 172.21.15.32:0/1330622870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a815a7c0 msgr2=0x7ff0a80cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.039+0000 7ff0aea00640 1 --2- 172.21.15.32:0/1330622870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a815a7c0 0x7ff0a80cae20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff0980097f0 tx=0x7ff09801c370 comp rx=0 tx=0).stop 2024-03-19T06:23:37.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.039+0000 7ff0aea00640 1 -- 172.21.15.32:0/1330622870 shutdown_connections 2024-03-19T06:23:37.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.039+0000 7ff0aea00640 1 --2- 172.21.15.32:0/1330622870 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a815a7c0 0x7ff0a80cae20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.039+0000 7ff0aea00640 1 -- 172.21.15.32:0/1330622870 >> 172.21.15.32:0/1330622870 conn(0x7ff0a80b1280 msgr2=0x7ff0a80b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:37.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.039+0000 7ff0aea00640 1 -- 172.21.15.32:0/1330622870 shutdown_connections 2024-03-19T06:23:37.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.039+0000 7ff0aea00640 1 -- 172.21.15.32:0/1330622870 wait complete. 2024-03-19T06:23:37.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.039+0000 7ff0aea00640 1 Processor -- start 2024-03-19T06:23:37.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.039+0000 7ff0aea00640 1 -- start start 2024-03-19T06:23:37.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0aea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0a80b4c50 0x7ff0a815cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0aea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a80cc680 0x7ff0a8147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0aea00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0a815a7c0 0x7ff0a80b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0aea00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80cbdb0 con 0x7ff0a80b4c50 2024-03-19T06:23:37.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0aea00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80cbc30 con 0x7ff0a815a7c0 2024-03-19T06:23:37.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0aea00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a8169010 con 0x7ff0a80cc680 2024-03-19T06:23:37.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0a7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0a80b4c50 0x7ff0a815cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0a7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0a80b4c50 0x7ff0a815cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39422/0 (socket says 172.21.15.32:39422) 2024-03-19T06:23:37.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0a7e00640 1 -- 172.21.15.32:0/3448819902 learned_addr learned my addr 172.21.15.32:0/3448819902 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:37.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff09fe00640 1 --2- 172.21.15.32:0/3448819902 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a80cc680 0x7ff0a8147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0aca00640 1 --2- 172.21.15.32:0/3448819902 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0a815a7c0 0x7ff0a80b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0a7e00640 1 -- 172.21.15.32:0/3448819902 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a80cc680 msgr2=0x7ff0a8147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0a7e00640 1 --2- 172.21.15.32:0/3448819902 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a80cc680 0x7ff0a8147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0a7e00640 1 -- 172.21.15.32:0/3448819902 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0a815a7c0 msgr2=0x7ff0a80b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0a7e00640 1 --2- 172.21.15.32:0/3448819902 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0a815a7c0 0x7ff0a80b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0a7e00640 1 -- 172.21.15.32:0/3448819902 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a815d2a0 con 0x7ff0a80b4c50 2024-03-19T06:23:37.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0a7e00640 1 --2- 172.21.15.32:0/3448819902 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0a80b4c50 0x7ff0a815cd60 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff098009740 tx=0x7ff098019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:37.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0a4c00640 1 -- 172.21.15.32:0/3448819902 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0980bb070 con 0x7ff0a80b4c50 2024-03-19T06:23:37.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0a4c00640 1 -- 172.21.15.32:0/3448819902 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff098004020 con 0x7ff0a80b4c50 2024-03-19T06:23:37.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0aea00640 1 -- 172.21.15.32:0/3448819902 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a80af5d0 con 0x7ff0a80b4c50 2024-03-19T06:23:37.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0a4c00640 1 -- 172.21.15.32:0/3448819902 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0980b0040 con 0x7ff0a80b4c50 2024-03-19T06:23:37.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0aea00640 1 -- 172.21.15.32:0/3448819902 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a80afb90 con 0x7ff0a80b4c50 2024-03-19T06:23:37.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0aea00640 1 -- 172.21.15.32:0/3448819902 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a80749e0 con 0x7ff0a80b4c50 2024-03-19T06:23:37.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.043+0000 7ff0a4c00640 1 -- 172.21.15.32:0/3448819902 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff0980b3040 con 0x7ff0a80b4c50 2024-03-19T06:23:37.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.047+0000 7ff0a4c00640 1 --2- 172.21.15.32:0/3448819902 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff084067690 0x7ff084069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.047+0000 7ff0a4c00640 1 -- 172.21.15.32:0/3448819902 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff09811f720 con 0x7ff0a80b4c50 2024-03-19T06:23:37.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.047+0000 7ff09fe00640 1 --2- 172.21.15.32:0/3448819902 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff084067690 0x7ff084069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.047+0000 7ff09fe00640 1 --2- 172.21.15.32:0/3448819902 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff084067690 0x7ff084069b50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff090001000 tx=0x7ff090001700 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:37.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.051+0000 7ff0a4c00640 1 -- 172.21.15.32:0/3448819902 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7ff098015ff0 con 0x7ff0a80b4c50 2024-03-19T06:23:37.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.215+0000 7ff0aea00640 1 -- 172.21.15.32:0/3448819902 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0a8152880 con 0x7ff0a80b4c50 2024-03-19T06:23:37.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.215+0000 7ff0a4c00640 1 -- 172.21.15.32:0/3448819902 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16681 (secure 0 0 0) 0x7ff0980efd40 con 0x7ff0a80b4c50 2024-03-19T06:23:37.204 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:37.204 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":51,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:23:23.544172+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:23:19.707249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-19T06:23:20.926932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:23:37.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.219+0000 7ff0aea00640 1 -- 172.21.15.32:0/3448819902 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff084067690 msgr2=0x7ff084069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.219+0000 7ff0aea00640 1 --2- 172.21.15.32:0/3448819902 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff084067690 0x7ff084069b50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff090001000 tx=0x7ff090001700 comp rx=0 tx=0).stop 2024-03-19T06:23:37.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.219+0000 7ff0aea00640 1 -- 172.21.15.32:0/3448819902 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0a80b4c50 msgr2=0x7ff0a815cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.219+0000 7ff0aea00640 1 --2- 172.21.15.32:0/3448819902 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0a80b4c50 0x7ff0a815cd60 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff098009740 tx=0x7ff098019110 comp rx=0 tx=0).stop 2024-03-19T06:23:37.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.219+0000 7ff0aea00640 1 -- 172.21.15.32:0/3448819902 shutdown_connections 2024-03-19T06:23:37.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.219+0000 7ff0aea00640 1 --2- 172.21.15.32:0/3448819902 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff084067690 0x7ff084069b50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.219+0000 7ff0aea00640 1 --2- 172.21.15.32:0/3448819902 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0a815a7c0 0x7ff0a80b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.219+0000 7ff0aea00640 1 --2- 172.21.15.32:0/3448819902 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a80cc680 0x7ff0a8147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.219+0000 7ff0aea00640 1 --2- 172.21.15.32:0/3448819902 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0a80b4c50 0x7ff0a815cd60 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.219+0000 7ff0aea00640 1 -- 172.21.15.32:0/3448819902 >> 172.21.15.32:0/3448819902 conn(0x7ff0a80b1280 msgr2=0x7ff0a80ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:37.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.219+0000 7ff0aea00640 1 -- 172.21.15.32:0/3448819902 shutdown_connections 2024-03-19T06:23:37.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.219+0000 7ff0aea00640 1 -- 172.21.15.32:0/3448819902 wait complete. 2024-03-19T06:23:37.225 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:23:19.707249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:23:20.926932+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:23:37.225 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:23:37.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.379+0000 7fdd49c00640 1 Processor -- start 2024-03-19T06:23:37.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.379+0000 7fdd49c00640 1 -- start start 2024-03-19T06:23:37.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.383+0000 7fdd49c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4415bc60 0x7fdd4406d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.383+0000 7fdd49c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdd4406d6a0 0x7fdd440cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.383+0000 7fdd49c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4415faa0 con 0x7fdd4415c6d0 2024-03-19T06:23:37.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.383+0000 7fdd49c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4415d190 con 0x7fdd4406d6a0 2024-03-19T06:23:37.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.383+0000 7fdd49c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4415fd80 con 0x7fdd4415bc60 2024-03-19T06:23:37.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.383+0000 7fdd49200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdd4406d6a0 0x7fdd440cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.383+0000 7fdd49200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdd4406d6a0 0x7fdd440cb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39426/0 (socket says 172.21.15.32:39426) 2024-03-19T06:23:37.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.383+0000 7fdd49200640 1 -- 172.21.15.32:0/2139166157 learned_addr learned my addr 172.21.15.32:0/2139166157 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:37.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.383+0000 7fdd3be00640 1 --2- 172.21.15.32:0/2139166157 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4415bc60 0x7fdd4406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.383+0000 7fdd49200640 1 -- 172.21.15.32:0/2139166157 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4415bc60 msgr2=0x7fdd4406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:37.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.383+0000 7fdd49200640 1 --2- 172.21.15.32:0/2139166157 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4415bc60 0x7fdd4406d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.383+0000 7fdd49200640 1 -- 172.21.15.32:0/2139166157 >> v1:172.21.15.171:6789/0 conn(0x7fdd4415c6d0 legacy=0x7fdd4415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.383+0000 7fdd49200640 1 -- 172.21.15.32:0/2139166157 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd44160060 con 0x7fdd4406d6a0 2024-03-19T06:23:37.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49200640 1 --2- 172.21.15.32:0/2139166157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4406d6a0 0x7fdd440cb9f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009e50 tx=0x7fdd3c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72715e2317f2dcc0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:37.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd43400640 1 -- 172.21.15.32:0/2139166157 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0a5700 con 0x7fdd4406d6a0 2024-03-19T06:23:37.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd43400640 1 -- 172.21.15.32:0/2139166157 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c0a58a0 con 0x7fdd4406d6a0 2024-03-19T06:23:37.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd43400640 1 -- 172.21.15.32:0/2139166157 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0a5c70 con 0x7fdd4406d6a0 2024-03-19T06:23:37.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49c00640 1 -- 172.21.15.32:0/2139166157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4406d6a0 msgr2=0x7fdd440cb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49c00640 1 --2- 172.21.15.32:0/2139166157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4406d6a0 0x7fdd440cb9f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009e50 tx=0x7fdd3c01ca30 comp rx=0 tx=0).stop 2024-03-19T06:23:37.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49c00640 1 -- 172.21.15.32:0/2139166157 shutdown_connections 2024-03-19T06:23:37.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49c00640 1 --2- 172.21.15.32:0/2139166157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4406d6a0 0x7fdd440cb9f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49c00640 1 --2- 172.21.15.32:0/2139166157 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4415bc60 0x7fdd4406d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49c00640 1 -- 172.21.15.32:0/2139166157 >> 172.21.15.32:0/2139166157 conn(0x7fdd440b16b0 msgr2=0x7fdd4406ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:37.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49c00640 1 -- 172.21.15.32:0/2139166157 shutdown_connections 2024-03-19T06:23:37.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49c00640 1 -- 172.21.15.32:0/2139166157 wait complete. 2024-03-19T06:23:37.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49c00640 1 Processor -- start 2024-03-19T06:23:37.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49c00640 1 -- start start 2024-03-19T06:23:37.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4406d6a0 0x7fdd440ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4415bc60 0x7fdd440b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd4415c6d0 0x7fdd440c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4415d990 con 0x7fdd4415bc60 2024-03-19T06:23:37.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4415d810 con 0x7fdd4415c6d0 2024-03-19T06:23:37.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd49c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4415db10 con 0x7fdd4406d6a0 2024-03-19T06:23:37.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.387+0000 7fdd3be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4415bc60 0x7fdd440b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd3be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4415bc60 0x7fdd440b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39428/0 (socket says 172.21.15.32:39428) 2024-03-19T06:23:37.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd3be00640 1 -- 172.21.15.32:0/46987090 learned_addr learned my addr 172.21.15.32:0/46987090 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:37.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd43e00640 1 --2- 172.21.15.32:0/46987090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4406d6a0 0x7fdd440ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd49200640 1 --2- 172.21.15.32:0/46987090 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd4415c6d0 0x7fdd440c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd3be00640 1 -- 172.21.15.32:0/46987090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4406d6a0 msgr2=0x7fdd440ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd3be00640 1 --2- 172.21.15.32:0/46987090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4406d6a0 0x7fdd440ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd3be00640 1 -- 172.21.15.32:0/46987090 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd4415c6d0 msgr2=0x7fdd440c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd3be00640 1 --2- 172.21.15.32:0/46987090 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd4415c6d0 0x7fdd440c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd3be00640 1 -- 172.21.15.32:0/46987090 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd440cde90 con 0x7fdd4415bc60 2024-03-19T06:23:37.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd3be00640 1 --2- 172.21.15.32:0/46987090 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4415bc60 0x7fdd440b24e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00d830 tx=0x7fdd2c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:37.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd40c00640 1 -- 172.21.15.32:0/46987090 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c00b6c0 con 0x7fdd4415bc60 2024-03-19T06:23:37.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd40c00640 1 -- 172.21.15.32:0/46987090 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c019070 con 0x7fdd4415bc60 2024-03-19T06:23:37.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd49c00640 1 -- 172.21.15.32:0/46987090 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd440cd5f0 con 0x7fdd4415bc60 2024-03-19T06:23:37.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd40c00640 1 -- 172.21.15.32:0/46987090 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c00ba60 con 0x7fdd4415bc60 2024-03-19T06:23:37.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd49c00640 1 -- 172.21.15.32:0/46987090 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd440cdbb0 con 0x7fdd4415bc60 2024-03-19T06:23:37.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd49c00640 1 -- 172.21.15.32:0/46987090 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd44075090 con 0x7fdd4415bc60 2024-03-19T06:23:37.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd40c00640 1 -- 172.21.15.32:0/46987090 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fdd2c01e460 con 0x7fdd4415bc60 2024-03-19T06:23:37.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.391+0000 7fdd40c00640 1 --2- 172.21.15.32:0/46987090 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdd20067660 0x7fdd20069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.395+0000 7fdd40c00640 1 -- 172.21.15.32:0/46987090 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd2c085e60 con 0x7fdd4415bc60 2024-03-19T06:23:37.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.395+0000 7fdd43e00640 1 --2- 172.21.15.32:0/46987090 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdd20067660 0x7fdd20069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.395+0000 7fdd43e00640 1 --2- 172.21.15.32:0/46987090 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdd20067660 0x7fdd20069b20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdd34001770 tx=0x7fdd34009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:37.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.399+0000 7fdd40c00640 1 -- 172.21.15.32:0/46987090 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fdd2c056480 con 0x7fdd4415bc60 2024-03-19T06:23:37.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.559+0000 7fdd49c00640 1 -- 172.21.15.32:0/46987090 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd4406baa0 con 0x7fdd4415bc60 2024-03-19T06:23:37.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.563+0000 7fdd40c00640 1 -- 172.21.15.32:0/46987090 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd2c05a520 con 0x7fdd4415bc60 2024-03-19T06:23:37.550 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:23:37.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.563+0000 7fdd49c00640 1 -- 172.21.15.32:0/46987090 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdd20067660 msgr2=0x7fdd20069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.563+0000 7fdd49c00640 1 --2- 172.21.15.32:0/46987090 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdd20067660 0x7fdd20069b20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdd34001770 tx=0x7fdd34009040 comp rx=0 tx=0).stop 2024-03-19T06:23:37.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.563+0000 7fdd49c00640 1 -- 172.21.15.32:0/46987090 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4415bc60 msgr2=0x7fdd440b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.563+0000 7fdd49c00640 1 --2- 172.21.15.32:0/46987090 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4415bc60 0x7fdd440b24e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00d830 tx=0x7fdd2c00dcf0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.563+0000 7fdd49c00640 1 -- 172.21.15.32:0/46987090 shutdown_connections 2024-03-19T06:23:37.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.563+0000 7fdd49c00640 1 --2- 172.21.15.32:0/46987090 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fdd20067660 0x7fdd20069b20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.563+0000 7fdd49c00640 1 --2- 172.21.15.32:0/46987090 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd4415c6d0 0x7fdd440c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.563+0000 7fdd49c00640 1 --2- 172.21.15.32:0/46987090 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd4415bc60 0x7fdd440b24e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.563+0000 7fdd49c00640 1 --2- 172.21.15.32:0/46987090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4406d6a0 0x7fdd440ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.563+0000 7fdd49c00640 1 -- 172.21.15.32:0/46987090 >> 172.21.15.32:0/46987090 conn(0x7fdd440b16b0 msgr2=0x7fdd440c9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:37.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.563+0000 7fdd49c00640 1 -- 172.21.15.32:0/46987090 shutdown_connections 2024-03-19T06:23:37.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.563+0000 7fdd49c00640 1 -- 172.21.15.32:0/46987090 wait complete. 2024-03-19T06:23:37.570 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:23:37.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7f1800640 1 Processor -- start 2024-03-19T06:23:37.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7f1800640 1 -- start start 2024-03-19T06:23:37.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7f1800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe7ec15ba00 0x7fe7ec0b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7f1800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7ec0b3de0 0x7fe7ec0cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7f1800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7ec0d14b0 con 0x7fe7ec0b7530 2024-03-19T06:23:37.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7f1800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7ec0d20c0 con 0x7fe7ec15ba00 2024-03-19T06:23:37.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7f1800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec0d1790 con 0x7fe7ec0b3de0 2024-03-19T06:23:37.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7e3e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe7ec0b7530 0x7fe7ec0b36d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33206/0 (socket says 172.21.15.32:33206) 2024-03-19T06:23:37.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7e3e00640 1 -- 172.21.15.32:0/2648461757 learned_addr learned my addr 172.21.15.32:0/2648461757 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:37.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7eb400640 1 --2- 172.21.15.32:0/2648461757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7ec0b3de0 0x7fe7ec0cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7ea000640 1 -- 172.21.15.32:0/2648461757 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316061419 0 0) 0x7fe7ec0d14b0 con 0x7fe7ec0b7530 2024-03-19T06:23:37.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7eaa00640 1 --2- 172.21.15.32:0/2648461757 >> v2:172.21.15.171:3300/0 conn(0x7fe7ec15ba00 0x7fe7ec0b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7ea000640 1 -- 172.21.15.32:0/2648461757 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7d0003530 con 0x7fe7ec0b7530 2024-03-19T06:23:37.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7ea000640 1 -- 172.21.15.32:0/2648461757 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3808012419 0 0) 0x7fe7d0003530 con 0x7fe7ec0b7530 2024-03-19T06:23:37.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7ea000640 1 -- 172.21.15.32:0/2648461757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7ec0b3de0 msgr2=0x7fe7ec0cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:37.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7ea000640 1 --2- 172.21.15.32:0/2648461757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7ec0b3de0 0x7fe7ec0cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7ea000640 1 -- 172.21.15.32:0/2648461757 >> v2:172.21.15.171:3300/0 conn(0x7fe7ec15ba00 msgr2=0x7fe7ec0b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:37.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7ea000640 1 --2- 172.21.15.32:0/2648461757 >> v2:172.21.15.171:3300/0 conn(0x7fe7ec15ba00 0x7fe7ec0b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7ea000640 1 -- 172.21.15.32:0/2648461757 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ec0d1a70 con 0x7fe7ec0b7530 2024-03-19T06:23:37.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7ea000640 1 -- 172.21.15.32:0/2648461757 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fe7d40016a0 con 0x7fe7ec0b7530 2024-03-19T06:23:37.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7ea000640 1 -- 172.21.15.32:0/2648461757 >> v1:172.21.15.32:6789/0 conn(0x7fe7ec0b7530 legacy=0x7fe7ec0b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7ea000640 1 --2- 172.21.15.32:0/2648461757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7ec0b3de0 0x7fe7d00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7ea000640 1 --2- 172.21.15.32:0/2648461757 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d0003f40 0x7fe7d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7ea000640 1 --2- 172.21.15.32:0/2648461757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7d0004d50 0x7fe7d00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7ea000640 1 -- 172.21.15.32:0/2648461757 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec0d20c0 con 0x7fe7d0003f40 2024-03-19T06:23:37.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7ea000640 1 -- 172.21.15.32:0/2648461757 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec0d1790 con 0x7fe7d0004d50 2024-03-19T06:23:37.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7ea000640 1 -- 172.21.15.32:0/2648461757 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d000ba00 con 0x7fe7ec0b3de0 2024-03-19T06:23:37.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7e3e00640 1 --2- 172.21.15.32:0/2648461757 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d0003f40 0x7fe7d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7eaa00640 1 --2- 172.21.15.32:0/2648461757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7ec0b3de0 0x7fe7d00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7eb400640 1 --2- 172.21.15.32:0/2648461757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7d0004d50 0x7fe7d00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.727+0000 7fe7e3e00640 1 -- 172.21.15.32:0/2648461757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7ec0b3de0 msgr2=0x7fe7d00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:37.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.731+0000 7fe7e3e00640 1 --2- 172.21.15.32:0/2648461757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7ec0b3de0 0x7fe7d00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.731+0000 7fe7e3e00640 1 -- 172.21.15.32:0/2648461757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7d0004d50 msgr2=0x7fe7d00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:37.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.731+0000 7fe7e3e00640 1 --2- 172.21.15.32:0/2648461757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7d0004d50 0x7fe7d00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.731+0000 7fe7e3e00640 1 -- 172.21.15.32:0/2648461757 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d0003530 con 0x7fe7d0003f40 2024-03-19T06:23:37.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.731+0000 7fe7eb400640 1 --2- 172.21.15.32:0/2648461757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7d0004d50 0x7fe7d00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:37.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.731+0000 7fe7e3e00640 1 --2- 172.21.15.32:0/2648461757 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d0003f40 0x7fe7d0004810 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400c210 tx=0x7fe7d401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c7972c6c0faf7 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:37.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.731+0000 7fe7ea000640 1 -- 172.21.15.32:0/2648461757 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4007d60 con 0x7fe7d0003f40 2024-03-19T06:23:37.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.731+0000 7fe7ea000640 1 -- 172.21.15.32:0/2648461757 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d40a9020 con 0x7fe7d0003f40 2024-03-19T06:23:37.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.731+0000 7fe7ea000640 1 -- 172.21.15.32:0/2648461757 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d40a5bc0 con 0x7fe7d0003f40 2024-03-19T06:23:37.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.731+0000 7fe7f1800640 1 -- 172.21.15.32:0/2648461757 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d0003f40 msgr2=0x7fe7d0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.731+0000 7fe7f1800640 1 --2- 172.21.15.32:0/2648461757 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d0003f40 0x7fe7d0004810 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400c210 tx=0x7fe7d401cc80 comp rx=0 tx=0).stop 2024-03-19T06:23:37.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.731+0000 7fe7eb400640 1 -- 172.21.15.32:0/2648461757 reap_dead start 2024-03-19T06:23:37.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.731+0000 7fe7f1800640 1 -- 172.21.15.32:0/2648461757 shutdown_connections 2024-03-19T06:23:37.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.731+0000 7fe7f1800640 1 -- 172.21.15.32:0/2648461757 >> 172.21.15.32:0/2648461757 conn(0x7fe7ec066ca0 msgr2=0x7fe7ec0670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:37.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.731+0000 7fe7f1800640 1 -- 172.21.15.32:0/2648461757 shutdown_connections 2024-03-19T06:23:37.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.731+0000 7fe7f1800640 1 -- 172.21.15.32:0/2648461757 wait complete. 2024-03-19T06:23:37.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7f1800640 1 Processor -- start 2024-03-19T06:23:37.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7f1800640 1 -- start start 2024-03-19T06:23:37.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7f1800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7d0003f40 0x7fe7ec1f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7f1800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7ec0b5280 0x7fe7ec0b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7f1800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7ec14d490 0x7fe7ec14d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7f1800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec15bf60 con 0x7fe7ec14d490 2024-03-19T06:23:37.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7f1800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec15bde0 con 0x7fe7d0003f40 2024-03-19T06:23:37.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7f1800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec0d10f0 con 0x7fe7ec0b5280 2024-03-19T06:23:37.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7eb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7ec14d490 0x7fe7ec14d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7eb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7ec14d490 0x7fe7ec14d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39446/0 (socket says 172.21.15.32:39446) 2024-03-19T06:23:37.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7eb400640 1 -- 172.21.15.32:0/4048283630 learned_addr learned my addr 172.21.15.32:0/4048283630 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:37.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7eaa00640 1 --2- 172.21.15.32:0/4048283630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7d0003f40 0x7fe7ec1f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7e3e00640 1 --2- 172.21.15.32:0/4048283630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7ec0b5280 0x7fe7ec0b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7eb400640 1 -- 172.21.15.32:0/4048283630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7ec0b5280 msgr2=0x7fe7ec0b56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7eb400640 1 --2- 172.21.15.32:0/4048283630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7ec0b5280 0x7fe7ec0b56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7eb400640 1 -- 172.21.15.32:0/4048283630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7d0003f40 msgr2=0x7fe7ec1f6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7eb400640 1 --2- 172.21.15.32:0/4048283630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7d0003f40 0x7fe7ec1f6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7eb400640 1 -- 172.21.15.32:0/4048283630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ec0b5d30 con 0x7fe7ec14d490 2024-03-19T06:23:37.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7eb400640 1 --2- 172.21.15.32:0/4048283630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7ec14d490 0x7fe7ec14d910 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0cbde0 tx=0x7fe7e4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:37.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7e2a00640 1 -- 172.21.15.32:0/4048283630 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4007e40 con 0x7fe7ec14d490 2024-03-19T06:23:37.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7e2a00640 1 -- 172.21.15.32:0/4048283630 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e4010d20 con 0x7fe7ec14d490 2024-03-19T06:23:37.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7f1800640 1 -- 172.21.15.32:0/4048283630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ec0b6010 con 0x7fe7ec14d490 2024-03-19T06:23:37.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7e2a00640 1 -- 172.21.15.32:0/4048283630 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4003be0 con 0x7fe7ec14d490 2024-03-19T06:23:37.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.735+0000 7fe7f1800640 1 -- 172.21.15.32:0/4048283630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ec151710 con 0x7fe7ec14d490 2024-03-19T06:23:37.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.739+0000 7fe7f1800640 1 -- 172.21.15.32:0/4048283630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ec0749e0 con 0x7fe7ec14d490 2024-03-19T06:23:37.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.739+0000 7fe7e2a00640 1 -- 172.21.15.32:0/4048283630 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe7e401e020 con 0x7fe7ec14d490 2024-03-19T06:23:37.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.739+0000 7fe7e2a00640 1 --2- 172.21.15.32:0/4048283630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe7c8067660 0x7fe7c8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:37.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.739+0000 7fe7e2a00640 1 -- 172.21.15.32:0/4048283630 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7e4085d40 con 0x7fe7ec14d490 2024-03-19T06:23:37.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.739+0000 7fe7eaa00640 1 --2- 172.21.15.32:0/4048283630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe7c8067660 0x7fe7c8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:37.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.739+0000 7fe7eaa00640 1 --2- 172.21.15.32:0/4048283630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe7c8067660 0x7fe7c8069b20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009c60 tx=0x7fe7dc009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:37.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.743+0000 7fe7e2a00640 1 -- 172.21.15.32:0/4048283630 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fe7e4025020 con 0x7fe7ec14d490 2024-03-19T06:23:37.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.907+0000 7fe7f1800640 1 -- 172.21.15.32:0/4048283630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe7ec0cf0b0 con 0x7fe7ec14d490 2024-03-19T06:23:37.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.907+0000 7fe7e2a00640 1 -- 172.21.15.32:0/4048283630 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe7e4056920 con 0x7fe7ec14d490 2024-03-19T06:23:37.895 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:23:37.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.907+0000 7fe7f1800640 1 -- 172.21.15.32:0/4048283630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe7c8067660 msgr2=0x7fe7c8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.907+0000 7fe7f1800640 1 --2- 172.21.15.32:0/4048283630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe7c8067660 0x7fe7c8069b20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009c60 tx=0x7fe7dc009190 comp rx=0 tx=0).stop 2024-03-19T06:23:37.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.907+0000 7fe7f1800640 1 -- 172.21.15.32:0/4048283630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7ec14d490 msgr2=0x7fe7ec14d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:37.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.907+0000 7fe7f1800640 1 --2- 172.21.15.32:0/4048283630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7ec14d490 0x7fe7ec14d910 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0cbde0 tx=0x7fe7e4010590 comp rx=0 tx=0).stop 2024-03-19T06:23:37.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.907+0000 7fe7f1800640 1 -- 172.21.15.32:0/4048283630 shutdown_connections 2024-03-19T06:23:37.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.907+0000 7fe7f1800640 1 --2- 172.21.15.32:0/4048283630 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe7c8067660 0x7fe7c8069b20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.907+0000 7fe7f1800640 1 --2- 172.21.15.32:0/4048283630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7ec14d490 0x7fe7ec14d910 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.907+0000 7fe7f1800640 1 --2- 172.21.15.32:0/4048283630 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7ec0b5280 0x7fe7ec0b56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.907+0000 7fe7f1800640 1 --2- 172.21.15.32:0/4048283630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7d0003f40 0x7fe7ec1f6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:37.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.907+0000 7fe7f1800640 1 -- 172.21.15.32:0/4048283630 >> 172.21.15.32:0/4048283630 conn(0x7fe7ec066ca0 msgr2=0x7fe7ec0cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:37.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.907+0000 7fe7f1800640 1 -- 172.21.15.32:0/4048283630 shutdown_connections 2024-03-19T06:23:37.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:37.907+0000 7fe7f1800640 1 -- 172.21.15.32:0/4048283630 wait complete. 2024-03-19T06:23:37.915 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:23:38.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.071+0000 7fa934e00640 1 Processor -- start 2024-03-19T06:23:38.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.071+0000 7fa934e00640 1 -- start start 2024-03-19T06:23:38.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.071+0000 7fa934e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa93015dbb0 0x7fa93006c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:38.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.071+0000 7fa934e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa9300b3d30 0x7fa9300cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:38.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.071+0000 7fa934e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9300cbf00 con 0x7fa93006c5a0 2024-03-19T06:23:38.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.071+0000 7fa934e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93006cb20 con 0x7fa9300b3d30 2024-03-19T06:23:38.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.071+0000 7fa934e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93006ce00 con 0x7fa93015dbb0 2024-03-19T06:23:38.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.071+0000 7fa92e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa9300b3d30 0x7fa9300cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:38.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.071+0000 7fa92e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa9300b3d30 0x7fa9300cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39460/0 (socket says 172.21.15.32:39460) 2024-03-19T06:23:38.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.071+0000 7fa92e800640 1 -- 172.21.15.32:0/305901966 learned_addr learned my addr 172.21.15.32:0/305901966 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:38.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.071+0000 7fa92de00640 1 --2- 172.21.15.32:0/305901966 >> v2:172.21.15.171:3300/0 conn(0x7fa93015dbb0 0x7fa93006c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:38.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.071+0000 7fa92e800640 1 -- 172.21.15.32:0/305901966 >> v2:172.21.15.171:3300/0 conn(0x7fa93015dbb0 msgr2=0x7fa93006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:38.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.071+0000 7fa92e800640 1 --2- 172.21.15.32:0/305901966 >> v2:172.21.15.171:3300/0 conn(0x7fa93015dbb0 0x7fa93006c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.071+0000 7fa92e800640 1 -- 172.21.15.32:0/305901966 >> v1:172.21.15.171:6789/0 conn(0x7fa93006c5a0 legacy=0x7fa9300b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.071+0000 7fa92e800640 1 -- 172.21.15.32:0/305901966 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93006d0e0 con 0x7fa9300b3d30 2024-03-19T06:23:38.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.075+0000 7fa92e800640 1 --2- 172.21.15.32:0/305901966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9300b3d30 0x7fa9300cc6c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa930072f00 tx=0x7fa92801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252fee99c6f42e50 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:38.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.075+0000 7fa92d400640 1 -- 172.21.15.32:0/305901966 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9280b4070 con 0x7fa9300b3d30 2024-03-19T06:23:38.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.075+0000 7fa92d400640 1 -- 172.21.15.32:0/305901966 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9280af400 con 0x7fa9300b3d30 2024-03-19T06:23:38.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.075+0000 7fa92d400640 1 -- 172.21.15.32:0/305901966 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9280af7d0 con 0x7fa9300b3d30 2024-03-19T06:23:38.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.075+0000 7fa934e00640 1 -- 172.21.15.32:0/305901966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9300b3d30 msgr2=0x7fa9300cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.075+0000 7fa934e00640 1 --2- 172.21.15.32:0/305901966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9300b3d30 0x7fa9300cc6c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa930072f00 tx=0x7fa92801f1e0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.075+0000 7fa934e00640 1 -- 172.21.15.32:0/305901966 shutdown_connections 2024-03-19T06:23:38.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.075+0000 7fa934e00640 1 --2- 172.21.15.32:0/305901966 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9300b3d30 0x7fa9300cc6c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.075+0000 7fa934e00640 1 --2- 172.21.15.32:0/305901966 >> v2:172.21.15.171:3300/0 conn(0x7fa93015dbb0 0x7fa93006c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.075+0000 7fa934e00640 1 -- 172.21.15.32:0/305901966 >> 172.21.15.32:0/305901966 conn(0x7fa930066ca0 msgr2=0x7fa9300670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:38.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.075+0000 7fa934e00640 1 -- 172.21.15.32:0/305901966 shutdown_connections 2024-03-19T06:23:38.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.075+0000 7fa934e00640 1 -- 172.21.15.32:0/305901966 wait complete. 2024-03-19T06:23:38.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa934e00640 1 Processor -- start 2024-03-19T06:23:38.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa934e00640 1 -- start start 2024-03-19T06:23:38.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa934e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa93006c5a0 0x7fa9300ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:38.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa934e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9300b3d30 0x7fa930151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:38.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa934e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa93015dbb0 0x7fa93015c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:38.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa934e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93015df90 con 0x7fa9300b3d30 2024-03-19T06:23:38.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa934e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93006d910 con 0x7fa93006c5a0 2024-03-19T06:23:38.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa934e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9300ccc00 con 0x7fa93015dbb0 2024-03-19T06:23:38.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa925400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9300b3d30 0x7fa930151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:38.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa925400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9300b3d30 0x7fa930151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39468/0 (socket says 172.21.15.32:39468) 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa925400640 1 -- 172.21.15.32:0/50403331 learned_addr learned my addr 172.21.15.32:0/50403331 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa92e800640 1 --2- 172.21.15.32:0/50403331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa93015dbb0 0x7fa93015c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa92de00640 1 --2- 172.21.15.32:0/50403331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa93006c5a0 0x7fa9300ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa925400640 1 -- 172.21.15.32:0/50403331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa93015dbb0 msgr2=0x7fa93015c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa925400640 1 --2- 172.21.15.32:0/50403331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa93015dbb0 0x7fa93015c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa925400640 1 -- 172.21.15.32:0/50403331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa93006c5a0 msgr2=0x7fa9300ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa925400640 1 --2- 172.21.15.32:0/50403331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa93006c5a0 0x7fa9300ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa925400640 1 -- 172.21.15.32:0/50403331 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9300cab50 con 0x7fa9300b3d30 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa92e800640 1 --2- 172.21.15.32:0/50403331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa93015dbb0 0x7fa93015c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa92de00640 1 --2- 172.21.15.32:0/50403331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa93006c5a0 0x7fa9300ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa925400640 1 --2- 172.21.15.32:0/50403331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9300b3d30 0x7fa930151b60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa918007fd0 tx=0x7fa91800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa926a00640 1 -- 172.21.15.32:0/50403331 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918017070 con 0x7fa9300b3d30 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa926a00640 1 -- 172.21.15.32:0/50403331 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9180052d0 con 0x7fa9300b3d30 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa926a00640 1 -- 172.21.15.32:0/50403331 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918003840 con 0x7fa9300b3d30 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa934e00640 1 -- 172.21.15.32:0/50403331 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9300cbaf0 con 0x7fa9300b3d30 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.079+0000 7fa934e00640 1 -- 172.21.15.32:0/50403331 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9300c9e10 con 0x7fa9300b3d30 2024-03-19T06:23:38.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.083+0000 7fa934e00640 1 -- 172.21.15.32:0/50403331 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9300749e0 con 0x7fa9300b3d30 2024-03-19T06:23:38.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.083+0000 7fa926a00640 1 -- 172.21.15.32:0/50403331 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa91801a070 con 0x7fa9300b3d30 2024-03-19T06:23:38.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.083+0000 7fa926a00640 1 --2- 172.21.15.32:0/50403331 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa90c067660 0x7fa90c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:38.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.083+0000 7fa926a00640 1 -- 172.21.15.32:0/50403331 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa918084c40 con 0x7fa9300b3d30 2024-03-19T06:23:38.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.083+0000 7fa92de00640 1 --2- 172.21.15.32:0/50403331 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa90c067660 0x7fa90c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:38.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.083+0000 7fa92de00640 1 --2- 172.21.15.32:0/50403331 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa90c067660 0x7fa90c069b20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa9200097a0 tx=0x7fa920008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:38.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.087+0000 7fa926a00640 1 -- 172.21.15.32:0/50403331 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fa918005480 con 0x7fa9300b3d30 2024-03-19T06:23:38.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.247+0000 7fa934e00640 1 -- 172.21.15.32:0/50403331 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9300cf050 con 0x7fa9300b3d30 2024-03-19T06:23:38.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.251+0000 7fa926a00640 1 -- 172.21.15.32:0/50403331 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa9180558b0 con 0x7fa9300b3d30 2024-03-19T06:23:38.237 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:23:38.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.251+0000 7fa934e00640 1 -- 172.21.15.32:0/50403331 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa90c067660 msgr2=0x7fa90c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.251+0000 7fa934e00640 1 --2- 172.21.15.32:0/50403331 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa90c067660 0x7fa90c069b20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa9200097a0 tx=0x7fa920008040 comp rx=0 tx=0).stop 2024-03-19T06:23:38.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.251+0000 7fa934e00640 1 -- 172.21.15.32:0/50403331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9300b3d30 msgr2=0x7fa930151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.251+0000 7fa934e00640 1 --2- 172.21.15.32:0/50403331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9300b3d30 0x7fa930151b60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa918007fd0 tx=0x7fa91800c890 comp rx=0 tx=0).stop 2024-03-19T06:23:38.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.251+0000 7fa934e00640 1 -- 172.21.15.32:0/50403331 shutdown_connections 2024-03-19T06:23:38.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.251+0000 7fa934e00640 1 --2- 172.21.15.32:0/50403331 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa90c067660 0x7fa90c069b20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.251+0000 7fa934e00640 1 --2- 172.21.15.32:0/50403331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa93015dbb0 0x7fa93015c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.251+0000 7fa934e00640 1 --2- 172.21.15.32:0/50403331 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa9300b3d30 0x7fa930151b60 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.251+0000 7fa934e00640 1 --2- 172.21.15.32:0/50403331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa93006c5a0 0x7fa9300ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.251+0000 7fa934e00640 1 -- 172.21.15.32:0/50403331 >> 172.21.15.32:0/50403331 conn(0x7fa930066ca0 msgr2=0x7fa93006f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:38.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.251+0000 7fa934e00640 1 -- 172.21.15.32:0/50403331 shutdown_connections 2024-03-19T06:23:38.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.251+0000 7fa934e00640 1 -- 172.21.15.32:0/50403331 wait complete. 2024-03-19T06:23:38.259 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:23:38.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.411+0000 7f006ec00640 1 Processor -- start 2024-03-19T06:23:38.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.411+0000 7f006ec00640 1 -- start start 2024-03-19T06:23:38.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.411+0000 7f006ec00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f00680b4c50 0x7f00680b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:38.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.411+0000 7f006ec00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00680cb670 con 0x7f00680cc680 2024-03-19T06:23:38.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.411+0000 7f006ec00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00680cb950 con 0x7f006815a7c0 2024-03-19T06:23:38.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.411+0000 7f006ec00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006815f400 con 0x7f00680b4c50 2024-03-19T06:23:38.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.411+0000 7f005fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f00680cc680 0x7f006815ecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33222/0 (socket says 172.21.15.32:33222) 2024-03-19T06:23:38.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.411+0000 7f005fe00640 1 -- 172.21.15.32:0/1473810122 learned_addr learned my addr 172.21.15.32:0/1473810122 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:38.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.411+0000 7f006cc00640 1 --2- 172.21.15.32:0/1473810122 >> v2:172.21.15.32:3300/0 conn(0x7f00680b4c50 0x7f00680b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:38.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.415+0000 7f0067400640 1 -- 172.21.15.32:0/1473810122 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410239731 0 0) 0x7f00680cb670 con 0x7f00680cc680 2024-03-19T06:23:38.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.415+0000 7f0067400640 1 -- 172.21.15.32:0/1473810122 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f004c003530 con 0x7f00680cc680 2024-03-19T06:23:38.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.415+0000 7f006cc00640 1 -- 172.21.15.32:0/1473810122 >> v1:172.21.15.171:6789/0 conn(0x7f006815a7c0 legacy=0x7f00680cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.415+0000 7f006cc00640 1 -- 172.21.15.32:0/1473810122 >> v1:172.21.15.32:6789/0 conn(0x7f00680cc680 legacy=0x7f006815ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.415+0000 7f006cc00640 1 -- 172.21.15.32:0/1473810122 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006815e4f0 con 0x7f00680b4c50 2024-03-19T06:23:38.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.415+0000 7f006cc00640 1 --2- 172.21.15.32:0/1473810122 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00680b4c50 0x7f00680b5080 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0060009d90 tx=0x7f006001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9dfda132765cd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:38.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.415+0000 7f0067400640 1 -- 172.21.15.32:0/1473810122 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00600b2070 con 0x7f00680b4c50 2024-03-19T06:23:38.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.415+0000 7f0067400640 1 -- 172.21.15.32:0/1473810122 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00600a5940 con 0x7f00680b4c50 2024-03-19T06:23:38.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.415+0000 7f0067400640 1 -- 172.21.15.32:0/1473810122 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00600a5d10 con 0x7f00680b4c50 2024-03-19T06:23:38.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.415+0000 7f006ec00640 1 -- 172.21.15.32:0/1473810122 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00680b4c50 msgr2=0x7f00680b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.415+0000 7f006ec00640 1 --2- 172.21.15.32:0/1473810122 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00680b4c50 0x7f00680b5080 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0060009d90 tx=0x7f006001c970 comp rx=0 tx=0).stop 2024-03-19T06:23:38.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f006ec00640 1 -- 172.21.15.32:0/1473810122 shutdown_connections 2024-03-19T06:23:38.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f006ec00640 1 --2- 172.21.15.32:0/1473810122 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00680b4c50 0x7f00680b5080 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f006ec00640 1 -- 172.21.15.32:0/1473810122 >> 172.21.15.32:0/1473810122 conn(0x7f00680b1280 msgr2=0x7f00680b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:38.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f006ec00640 1 -- 172.21.15.32:0/1473810122 shutdown_connections 2024-03-19T06:23:38.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f006ec00640 1 -- 172.21.15.32:0/1473810122 wait complete. 2024-03-19T06:23:38.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f006ec00640 1 Processor -- start 2024-03-19T06:23:38.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f006ec00640 1 -- start start 2024-03-19T06:23:38.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f006ec00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00680b4c50 0x7f006814b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:38.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f006ec00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00680cc680 0x7f00680b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:38.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f006ec00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f006815a7c0 0x7f00680b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:38.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f006ec00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680b55c0 con 0x7f00680b4c50 2024-03-19T06:23:38.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f006ec00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680cbe40 con 0x7f006815a7c0 2024-03-19T06:23:38.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f006ec00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0068168a10 con 0x7f00680cc680 2024-03-19T06:23:38.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f0067e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00680b4c50 0x7f006814b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:38.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f0067e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00680b4c50 0x7f006814b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39482/0 (socket says 172.21.15.32:39482) 2024-03-19T06:23:38.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f0067e00640 1 -- 172.21.15.32:0/1238884580 learned_addr learned my addr 172.21.15.32:0/1238884580 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:38.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f006cc00640 1 --2- 172.21.15.32:0/1238884580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f006815a7c0 0x7f00680b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:38.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f005fe00640 1 --2- 172.21.15.32:0/1238884580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00680cc680 0x7f00680b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:38.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f0067e00640 1 -- 172.21.15.32:0/1238884580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00680cc680 msgr2=0x7f00680b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f0067e00640 1 --2- 172.21.15.32:0/1238884580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00680cc680 0x7f00680b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f0067e00640 1 -- 172.21.15.32:0/1238884580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f006815a7c0 msgr2=0x7f00680b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f0067e00640 1 --2- 172.21.15.32:0/1238884580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f006815a7c0 0x7f00680b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f0067e00640 1 -- 172.21.15.32:0/1238884580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00680af170 con 0x7f00680b4c50 2024-03-19T06:23:38.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.419+0000 7f0067e00640 1 --2- 172.21.15.32:0/1238884580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00680b4c50 0x7f006814b980 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f005800c420 tx=0x7f005800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:38.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.423+0000 7f0064c00640 1 -- 172.21.15.32:0/1238884580 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00580052d0 con 0x7f00680b4c50 2024-03-19T06:23:38.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.423+0000 7f0064c00640 1 -- 172.21.15.32:0/1238884580 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0058005470 con 0x7f00680b4c50 2024-03-19T06:23:38.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.423+0000 7f0064c00640 1 -- 172.21.15.32:0/1238884580 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058007260 con 0x7f00680b4c50 2024-03-19T06:23:38.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.423+0000 7f006ec00640 1 -- 172.21.15.32:0/1238884580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00680b34b0 con 0x7f00680b4c50 2024-03-19T06:23:38.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.423+0000 7f006ec00640 1 -- 172.21.15.32:0/1238884580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00680b3a70 con 0x7f00680b4c50 2024-03-19T06:23:38.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.423+0000 7f006ec00640 1 -- 172.21.15.32:0/1238884580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00680749e0 con 0x7f00680b4c50 2024-03-19T06:23:38.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.423+0000 7f0064c00640 1 -- 172.21.15.32:0/1238884580 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0058007400 con 0x7f00680b4c50 2024-03-19T06:23:38.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.423+0000 7f0064c00640 1 --2- 172.21.15.32:0/1238884580 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0044067660 0x7f0044069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:38.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.423+0000 7f0064c00640 1 -- 172.21.15.32:0/1238884580 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0058084cf0 con 0x7f00680b4c50 2024-03-19T06:23:38.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.423+0000 7f005fe00640 1 --2- 172.21.15.32:0/1238884580 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0044067660 0x7f0044069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:38.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.423+0000 7f005fe00640 1 --2- 172.21.15.32:0/1238884580 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0044067660 0x7f0044069b20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f00681fa2a0 tx=0x7f0050007d40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:38.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.427+0000 7f0064c00640 1 -- 172.21.15.32:0/1238884580 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f0058089070 con 0x7f00680b4c50 2024-03-19T06:23:38.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.603+0000 7f006ec00640 1 -- 172.21.15.32:0/1238884580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f00680ce2d0 con 0x7f00680b4c50 2024-03-19T06:23:38.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.603+0000 7f0064c00640 1 -- 172.21.15.32:0/1238884580 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0058055320 con 0x7f00680b4c50 2024-03-19T06:23:38.593 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:23:38.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.607+0000 7f006ec00640 1 -- 172.21.15.32:0/1238884580 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0044067660 msgr2=0x7f0044069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.607+0000 7f006ec00640 1 --2- 172.21.15.32:0/1238884580 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0044067660 0x7f0044069b20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f00681fa2a0 tx=0x7f0050007d40 comp rx=0 tx=0).stop 2024-03-19T06:23:38.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.607+0000 7f006ec00640 1 -- 172.21.15.32:0/1238884580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00680b4c50 msgr2=0x7f006814b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.607+0000 7f006ec00640 1 --2- 172.21.15.32:0/1238884580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00680b4c50 0x7f006814b980 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f005800c420 tx=0x7f005800c8e0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.607+0000 7f006ec00640 1 -- 172.21.15.32:0/1238884580 shutdown_connections 2024-03-19T06:23:38.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.607+0000 7f006ec00640 1 --2- 172.21.15.32:0/1238884580 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0044067660 0x7f0044069b20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.607+0000 7f006ec00640 1 --2- 172.21.15.32:0/1238884580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f006815a7c0 0x7f00680b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.607+0000 7f006ec00640 1 --2- 172.21.15.32:0/1238884580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00680cc680 0x7f00680b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.607+0000 7f006ec00640 1 --2- 172.21.15.32:0/1238884580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00680b4c50 0x7f006814b980 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.607+0000 7f006ec00640 1 -- 172.21.15.32:0/1238884580 >> 172.21.15.32:0/1238884580 conn(0x7f00680b1280 msgr2=0x7f00680caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:38.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.607+0000 7f006ec00640 1 -- 172.21.15.32:0/1238884580 shutdown_connections 2024-03-19T06:23:38.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.607+0000 7f006ec00640 1 -- 172.21.15.32:0/1238884580 wait complete. 2024-03-19T06:23:38.614 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi032.front.sepia.ceph.com... 2024-03-19T06:23:38.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:38.615 DEBUG:teuthology.orchestra.run.smithi032:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:38.632 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[39180]: fuse finished with error 0 and tester_r 0 2024-03-19T06:23:38.635 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:23:38.702 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:23:38.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:38.702 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-19T06:23:38.712 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-19T06:23:38.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.907+0000 7f3165400640 1 Processor -- start 2024-03-19T06:23:38.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.907+0000 7f3165400640 1 -- start start 2024-03-19T06:23:38.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.911+0000 7f3165400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f31600cc680 0x7f316015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:38.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.911+0000 7f3165400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31600cb670 con 0x7f316015a7c0 2024-03-19T06:23:38.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.911+0000 7f3165400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31600cb950 con 0x7f31600b4c50 2024-03-19T06:23:38.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.911+0000 7f3165400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316015e860 con 0x7f31600cc680 2024-03-19T06:23:38.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.911+0000 7f315e800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f316015a7c0 0x7f31600cae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33228/0 (socket says 172.21.15.32:33228) 2024-03-19T06:23:38.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.911+0000 7f315e800640 1 -- 172.21.15.32:0/2006552199 learned_addr learned my addr 172.21.15.32:0/2006552199 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:38.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.911+0000 7f3157e00640 1 --2- 172.21.15.32:0/2006552199 >> v2:172.21.15.32:3300/0 conn(0x7f31600cc680 0x7f316015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:38.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.911+0000 7f315de00640 1 -- 172.21.15.32:0/2006552199 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882680033 0 0) 0x7f31600cb670 con 0x7f316015a7c0 2024-03-19T06:23:38.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.911+0000 7f315de00640 1 -- 172.21.15.32:0/2006552199 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3144005740 con 0x7f316015a7c0 2024-03-19T06:23:38.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.911+0000 7f3157e00640 1 -- 172.21.15.32:0/2006552199 >> v1:172.21.15.171:6789/0 conn(0x7f31600b4c50 legacy=0x7f31600cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.911+0000 7f3157e00640 1 -- 172.21.15.32:0/2006552199 >> v1:172.21.15.32:6789/0 conn(0x7f316015a7c0 legacy=0x7f31600cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.911+0000 7f3157e00640 1 -- 172.21.15.32:0/2006552199 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316015e4f0 con 0x7f31600cc680 2024-03-19T06:23:38.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.911+0000 7f3157e00640 1 --2- 172.21.15.32:0/2006552199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600cc680 0x7f316015ecf0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f31480097c0 tx=0x7f314801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3b6da41c4aa7c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:38.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.911+0000 7f315de00640 1 -- 172.21.15.32:0/2006552199 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31480b1070 con 0x7f31600cc680 2024-03-19T06:23:38.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f315de00640 1 -- 172.21.15.32:0/2006552199 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31480ac620 con 0x7f31600cc680 2024-03-19T06:23:38.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f315de00640 1 -- 172.21.15.32:0/2006552199 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31480ac9d0 con 0x7f31600cc680 2024-03-19T06:23:38.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f3165400640 1 -- 172.21.15.32:0/2006552199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600cc680 msgr2=0x7f316015ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f3165400640 1 --2- 172.21.15.32:0/2006552199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600cc680 0x7f316015ecf0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f31480097c0 tx=0x7f314801c4a0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f3165400640 1 -- 172.21.15.32:0/2006552199 shutdown_connections 2024-03-19T06:23:38.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f3165400640 1 --2- 172.21.15.32:0/2006552199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600cc680 0x7f316015ecf0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f3165400640 1 -- 172.21.15.32:0/2006552199 >> 172.21.15.32:0/2006552199 conn(0x7f31600b1280 msgr2=0x7f31600b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:38.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f3165400640 1 -- 172.21.15.32:0/2006552199 shutdown_connections 2024-03-19T06:23:38.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f3165400640 1 -- 172.21.15.32:0/2006552199 wait complete. 2024-03-19T06:23:38.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f3165400640 1 Processor -- start 2024-03-19T06:23:38.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f3165400640 1 -- start start 2024-03-19T06:23:38.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f3165400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600b4c50 0x7f3160142080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:38.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f3165400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31600cc680 0x7f31601560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:38.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f3165400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f316015a7c0 0x7f3160154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:38.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f3165400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31600cbdb0 con 0x7f31600b4c50 2024-03-19T06:23:38.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f3165400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31600cbc30 con 0x7f316015a7c0 2024-03-19T06:23:38.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f3165400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3160071b60 con 0x7f31600cc680 2024-03-19T06:23:38.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f315e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600b4c50 0x7f3160142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:38.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f315e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600b4c50 0x7f3160142080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39502/0 (socket says 172.21.15.32:39502) 2024-03-19T06:23:38.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.915+0000 7f315e800640 1 -- 172.21.15.32:0/3349497825 learned_addr learned my addr 172.21.15.32:0/3349497825 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:38.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f3157e00640 1 --2- 172.21.15.32:0/3349497825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31600cc680 0x7f31601560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:38.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f315e800640 1 -- 172.21.15.32:0/3349497825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31600cc680 msgr2=0x7f31601560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f315e800640 1 --2- 172.21.15.32:0/3349497825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31600cc680 0x7f31601560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f315f200640 1 --2- 172.21.15.32:0/3349497825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f316015a7c0 0x7f3160154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:38.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f315e800640 1 -- 172.21.15.32:0/3349497825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f316015a7c0 msgr2=0x7f3160154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:38.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f315e800640 1 --2- 172.21.15.32:0/3349497825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f316015a7c0 0x7f3160154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:38.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f315e800640 1 -- 172.21.15.32:0/3349497825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31601591c0 con 0x7f31600b4c50 2024-03-19T06:23:38.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f3157e00640 1 --2- 172.21.15.32:0/3349497825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31600cc680 0x7f31601560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:38.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f315f200640 1 --2- 172.21.15.32:0/3349497825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f316015a7c0 0x7f3160154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:38.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f315e800640 1 --2- 172.21.15.32:0/3349497825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600b4c50 0x7f3160142080 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f315000c450 tx=0x7f315000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:38.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f3156a00640 1 -- 172.21.15.32:0/3349497825 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150017070 con 0x7f31600b4c50 2024-03-19T06:23:38.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f3156a00640 1 -- 172.21.15.32:0/3349497825 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3150005cf0 con 0x7f31600b4c50 2024-03-19T06:23:38.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f3156a00640 1 -- 172.21.15.32:0/3349497825 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150007270 con 0x7f31600b4c50 2024-03-19T06:23:38.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f3165400640 1 -- 172.21.15.32:0/3349497825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31601594a0 con 0x7f31600b4c50 2024-03-19T06:23:38.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f3165400640 1 -- 172.21.15.32:0/3349497825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31601425c0 con 0x7f31600b4c50 2024-03-19T06:23:38.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f3165400640 1 -- 172.21.15.32:0/3349497825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31600749e0 con 0x7f31600b4c50 2024-03-19T06:23:38.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f3156a00640 1 -- 172.21.15.32:0/3349497825 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f315001a070 con 0x7f31600b4c50 2024-03-19T06:23:38.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f3156a00640 1 --2- 172.21.15.32:0/3349497825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f313c067660 0x7f313c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:38.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f3156a00640 1 -- 172.21.15.32:0/3349497825 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3150084b20 con 0x7f31600b4c50 2024-03-19T06:23:38.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.919+0000 7f3157e00640 1 --2- 172.21.15.32:0/3349497825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f313c067660 0x7f313c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:38.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.923+0000 7f3157e00640 1 --2- 172.21.15.32:0/3349497825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f313c067660 0x7f313c069b20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f31480ae000 tx=0x7f3148008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:38.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:38.927+0000 7f3156a00640 1 -- 172.21.15.32:0/3349497825 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f3150055130 con 0x7f31600b4c50 2024-03-19T06:23:39.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:39.123+0000 7f3165400640 1 -- 172.21.15.32:0/3349497825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f31600cc270 con 0x7f31600b4c50 2024-03-19T06:23:39.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:39.123+0000 7f3156a00640 1 -- 172.21.15.32:0/3349497825 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f31500591d0 con 0x7f31600b4c50 2024-03-19T06:23:39.112 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-19T06:23:39.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:39.123+0000 7f3165400640 1 -- 172.21.15.32:0/3349497825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f313c067660 msgr2=0x7f313c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:39.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:39.123+0000 7f3165400640 1 --2- 172.21.15.32:0/3349497825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f313c067660 0x7f313c069b20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f31480ae000 tx=0x7f3148008040 comp rx=0 tx=0).stop 2024-03-19T06:23:39.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:39.123+0000 7f3165400640 1 -- 172.21.15.32:0/3349497825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600b4c50 msgr2=0x7f3160142080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:39.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:39.123+0000 7f3165400640 1 --2- 172.21.15.32:0/3349497825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600b4c50 0x7f3160142080 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f315000c450 tx=0x7f315000c910 comp rx=0 tx=0).stop 2024-03-19T06:23:39.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:39.127+0000 7f3165400640 1 -- 172.21.15.32:0/3349497825 shutdown_connections 2024-03-19T06:23:39.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:39.127+0000 7f3165400640 1 --2- 172.21.15.32:0/3349497825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f313c067660 0x7f313c069b20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:39.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:39.127+0000 7f3165400640 1 --2- 172.21.15.32:0/3349497825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f316015a7c0 0x7f3160154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:39.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:39.127+0000 7f3165400640 1 --2- 172.21.15.32:0/3349497825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31600cc680 0x7f31601560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:39.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:39.127+0000 7f3165400640 1 --2- 172.21.15.32:0/3349497825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31600b4c50 0x7f3160142080 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:39.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:39.127+0000 7f3165400640 1 -- 172.21.15.32:0/3349497825 >> 172.21.15.32:0/3349497825 conn(0x7f31600b1280 msgr2=0x7f316006e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:39.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:39.127+0000 7f3165400640 1 -- 172.21.15.32:0/3349497825 shutdown_connections 2024-03-19T06:23:39.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:39.127+0000 7f3165400640 1 -- 172.21.15.32:0/3349497825 wait complete. 2024-03-19T06:23:39.133 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-19T06:23:39.133 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-19T06:23:39.133 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-03-19T06:23:39.133 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-19T06:23:39.133 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:39.133 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-19T06:23:39.133 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-19T06:23:39.134 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-19T06:23:39.134 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:23:39.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:39.134 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-03-19T06:23:39.143 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:23:39.144 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:23:39.144 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:23:39.144 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:39.144 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-03-19T06:23:39.144 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:39.144 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:23:39.144 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:39.144 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-03-19T06:23:39.144 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:23:39.144 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:39.145 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-03-19T06:23:39.145 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-19T06:23:39.145 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:39.145 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-03-19T06:23:39.145 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-03-19T06:23:39.145 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42278sec preferred_lft 42278sec 2024-03-19T06:23:39.145 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-03-19T06:23:39.145 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:39.145 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:23:39.145 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:39.145 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-03-19T06:23:39.145 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-19T06:23:39.146 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:f5:94:d0:dd brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:39.146 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-19T06:23:39.146 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:39.146 INFO:teuthology.orchestra.run.smithi032.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-19T06:23:39.146 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:39.146 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-19T06:23:39.146 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:39.146 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-03-19T06:23:39.146 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:39.146 INFO:teuthology.orchestra.run.smithi032.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-19T06:23:39.146 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:39.146 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-03-19T06:23:39.146 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:39.147 INFO:teuthology.orchestra.run.smithi032.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-19T06:23:39.147 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:39.147 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-03-19T06:23:39.147 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:39.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:39.147 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-19T06:23:39.203 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-03-19T06:23:39.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:39.205 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-03-19T06:23:39.258 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-03-19T06:23:39.258 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-19T06:23:39.258 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-03-19T06:23:39.258 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-19T06:23:39.258 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-03-19T06:23:39.258 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-19T06:23:39.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:39.259 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-03-19T06:23:39.259 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-03-19T06:23:39.259 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-19T06:23:39.259 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-19T06:23:39.259 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-19T06:23:39.259 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-03-19T06:23:39.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:39.350 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-03-19T06:23:39.359 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-19T06:23:39.359 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-19T06:23:39.359 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:23:39.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:39.360 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-03-19T06:23:39.420 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-19T06:23:39.421 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:23:39.421 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:39.473 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:23:39.473 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:23:39.474 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:39.524 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:23:39.585 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:23:39.638 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:23:39.638 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:23:39.639 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:23:39.639 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:23:39.639 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:23:39.639 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:23:39.639 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:23:39.639 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:23:39.639 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:23:39.639 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:23:39.639 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:23:39.639 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:23:39.639 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:23:39.639 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:23:39.639 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:23:39.639 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:23:39.639 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:23:39.640 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:23:39.640 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:23:39.640 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:23:39.640 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:23:39.640 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:23:39.640 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:23:39.640 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:23:39.640 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:23:39.640 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:23:39.640 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:23:39.640 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:23:39.640 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:23:39.640 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:39.640 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:39.641 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:39.641 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:39.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:39.642 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:23:39.692 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-19T06:23:39.692 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-19T06:23:39.735 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:23:39.756 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:23:39.810 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:23:39.810 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:23:39.810 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:23:39.810 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:23:39.810 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:23:39.811 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:23:39.811 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:23:39.811 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:23:39.811 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:23:39.811 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:23:39.811 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:23:39.811 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:23:39.811 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:23:39.811 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:23:39.811 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:23:39.811 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:23:39.811 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:23:39.811 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:23:39.811 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:23:39.812 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:23:39.812 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:23:39.812 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:23:39.812 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:23:39.812 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:23:39.812 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:23:39.812 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:23:39.812 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:23:39.812 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:23:39.812 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:23:39.812 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:39.812 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:39.812 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:39.812 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:39.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:39.813 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:23:39.831 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:2024-03-19T06:23:39.843+0000 7fa383c46580 -1 init, newargv = 0x55a8e5047c10 newargc=15 2024-03-19T06:23:39.831 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[39580]: starting ceph client 2024-03-19T06:23:39.838 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[39580]: starting fuse 2024-03-19T06:23:39.839 INFO:teuthology.orchestra.run.smithi032.stdout:43 2024-03-19T06:23:39.839 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-03-19T06:23:39.840 DEBUG:teuthology.orchestra.run.smithi032:> sudo stdin-killer -- python3 -c ' 2024-03-19T06:23:39.840 DEBUG:teuthology.orchestra.run.smithi032:> import glob 2024-03-19T06:23:39.840 DEBUG:teuthology.orchestra.run.smithi032:> import re 2024-03-19T06:23:39.840 DEBUG:teuthology.orchestra.run.smithi032:> import os 2024-03-19T06:23:39.840 DEBUG:teuthology.orchestra.run.smithi032:> import subprocess 2024-03-19T06:23:39.840 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:23:39.840 DEBUG:teuthology.orchestra.run.smithi032:> def _find_admin_socket(client_name): 2024-03-19T06:23:39.840 DEBUG:teuthology.orchestra.run.smithi032:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-19T06:23:39.840 DEBUG:teuthology.orchestra.run.smithi032:> files = glob.glob(asok_path) 2024-03-19T06:23:39.840 DEBUG:teuthology.orchestra.run.smithi032:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-19T06:23:39.840 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:23:39.841 DEBUG:teuthology.orchestra.run.smithi032:> # Given a non-glob path, it better be there 2024-03-19T06:23:39.841 DEBUG:teuthology.orchestra.run.smithi032:> if "*" not in asok_path: 2024-03-19T06:23:39.841 DEBUG:teuthology.orchestra.run.smithi032:> assert(len(files) == 1) 2024-03-19T06:23:39.841 DEBUG:teuthology.orchestra.run.smithi032:> return files[0] 2024-03-19T06:23:39.841 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:23:39.841 DEBUG:teuthology.orchestra.run.smithi032:> for f in files: 2024-03-19T06:23:39.841 DEBUG:teuthology.orchestra.run.smithi032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-19T06:23:39.842 DEBUG:teuthology.orchestra.run.smithi032:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-19T06:23:39.842 DEBUG:teuthology.orchestra.run.smithi032:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-19T06:23:39.842 DEBUG:teuthology.orchestra.run.smithi032:> contents = proc_f.read() 2024-03-19T06:23:39.842 DEBUG:teuthology.orchestra.run.smithi032:> if mountpoint in contents: 2024-03-19T06:23:39.842 DEBUG:teuthology.orchestra.run.smithi032:> return f 2024-03-19T06:23:39.842 DEBUG:teuthology.orchestra.run.smithi032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-19T06:23:39.842 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:23:39.842 DEBUG:teuthology.orchestra.run.smithi032:> print(_find_admin_socket("client.0")) 2024-03-19T06:23:39.842 DEBUG:teuthology.orchestra.run.smithi032:> ' 2024-03-19T06:23:39.967 INFO:teuthology.orchestra.run.smithi032.stdout:/var/run/ceph/ceph-client.0.39580.asok 2024-03-19T06:23:39.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-19T06:23:39.979 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39580.asok 2024-03-19T06:23:39.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:39.979 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39580.asok status 2024-03-19T06:23:40.154 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:23:40.154 INFO:teuthology.orchestra.run.smithi032.stdout: "metadata": { 2024-03-19T06:23:40.154 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_sha1": "b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", 2024-03-19T06:23:40.154 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_version": "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)", 2024-03-19T06:23:40.154 INFO:teuthology.orchestra.run.smithi032.stdout: "entity_id": "0", 2024-03-19T06:23:40.154 INFO:teuthology.orchestra.run.smithi032.stdout: "hostname": "smithi032", 2024-03-19T06:23:40.154 INFO:teuthology.orchestra.run.smithi032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-19T06:23:40.155 INFO:teuthology.orchestra.run.smithi032.stdout: "pid": "39580", 2024-03-19T06:23:40.155 INFO:teuthology.orchestra.run.smithi032.stdout: "root": "/" 2024-03-19T06:23:40.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:40.155 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_count": 0, 2024-03-19T06:23:40.155 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_pinned_count": 0, 2024-03-19T06:23:40.155 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 6201, 2024-03-19T06:23:40.155 INFO:teuthology.orchestra.run.smithi032.stdout: "inst": { 2024-03-19T06:23:40.155 INFO:teuthology.orchestra.run.smithi032.stdout: "name": { 2024-03-19T06:23:40.155 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "client", 2024-03-19T06:23:40.155 INFO:teuthology.orchestra.run.smithi032.stdout: "num": 6201 2024-03-19T06:23:40.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:40.155 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-03-19T06:23:40.155 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-03-19T06:23:40.156 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:23:40.156 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4114592196 2024-03-19T06:23:40.156 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:40.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:40.156 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-03-19T06:23:40.156 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-03-19T06:23:40.156 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:23:40.156 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4114592196 2024-03-19T06:23:40.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:40.156 INFO:teuthology.orchestra.run.smithi032.stdout: "inst_str": "client.6201 192.168.0.1:0/4114592196", 2024-03-19T06:23:40.156 INFO:teuthology.orchestra.run.smithi032.stdout: "addr_str": "192.168.0.1:0/4114592196", 2024-03-19T06:23:40.156 INFO:teuthology.orchestra.run.smithi032.stdout: "inode_count": 1, 2024-03-19T06:23:40.157 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_epoch": 26, 2024-03-19T06:23:40.157 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch": 51, 2024-03-19T06:23:40.157 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch_barrier": 0, 2024-03-19T06:23:40.157 INFO:teuthology.orchestra.run.smithi032.stdout: "blocklisted": false, 2024-03-19T06:23:40.157 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs" 2024-03-19T06:23:40.157 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:23:40.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:40.169 DEBUG:teuthology.orchestra.run.smithi032:> stat --file-system '--printf=%T 2024-03-19T06:23:40.169 DEBUG:teuthology.orchestra.run.smithi032:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:40.179 INFO:teuthology.orchestra.run.smithi032.stdout:fuseblk 2024-03-19T06:23:40.179 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:40.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:40.179 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:40.240 DEBUG:teuthology.orchestra.run.smithi032:> stdin-killer -- python3 -c ' 2024-03-19T06:23:40.241 DEBUG:teuthology.orchestra.run.smithi032:> import os 2024-03-19T06:23:40.241 DEBUG:teuthology.orchestra.run.smithi032:> import errno 2024-03-19T06:23:40.241 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:23:40.241 DEBUG:teuthology.orchestra.run.smithi032:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2024-03-19T06:23:40.241 DEBUG:teuthology.orchestra.run.smithi032:> try: 2024-03-19T06:23:40.241 DEBUG:teuthology.orchestra.run.smithi032:> if False: 2024-03-19T06:23:40.241 DEBUG:teuthology.orchestra.run.smithi032:> ret = os.read(fd, 1024) 2024-03-19T06:23:40.241 DEBUG:teuthology.orchestra.run.smithi032:> else: 2024-03-19T06:23:40.241 DEBUG:teuthology.orchestra.run.smithi032:> os.write(fd, b'"'"'content'"'"') 2024-03-19T06:23:40.241 DEBUG:teuthology.orchestra.run.smithi032:> except OSError as e: 2024-03-19T06:23:40.241 DEBUG:teuthology.orchestra.run.smithi032:> if e.errno != errno.EPERM: 2024-03-19T06:23:40.242 DEBUG:teuthology.orchestra.run.smithi032:> raise 2024-03-19T06:23:40.242 DEBUG:teuthology.orchestra.run.smithi032:> else: 2024-03-19T06:23:40.242 DEBUG:teuthology.orchestra.run.smithi032:> raise RuntimeError("client does not check permission of data pool") 2024-03-19T06:23:40.242 DEBUG:teuthology.orchestra.run.smithi032:> ' 2024-03-19T06:23:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-19T06:23:40.365 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow w pool=cephfs_data' 2024-03-19T06:23:40.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.567+0000 7ff205600640 1 Processor -- start 2024-03-19T06:23:40.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.567+0000 7ff205600640 1 -- start start 2024-03-19T06:23:40.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff205600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff200161560 0x7ff2000b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:40.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff205600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2000b2280 0x7ff200161940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:40.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff205600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2000b1310 con 0x7ff200161e80 2024-03-19T06:23:40.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff205600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff20006be50 con 0x7ff200161560 2024-03-19T06:23:40.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff205600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2000d04e0 con 0x7ff2000b2280 2024-03-19T06:23:40.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff1ffe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff200161560 0x7ff2000b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:40.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff1ffe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff200161560 0x7ff2000b0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39504/0 (socket says 172.21.15.32:39504) 2024-03-19T06:23:40.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff1ffe00640 1 -- 172.21.15.32:0/1907797984 learned_addr learned my addr 172.21.15.32:0/1907797984 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:40.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff1ff400640 1 --2- 172.21.15.32:0/1907797984 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2000b2280 0x7ff200161940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:40.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff1ffe00640 1 -- 172.21.15.32:0/1907797984 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2000b2280 msgr2=0x7ff200161940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:40.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff1ffe00640 1 --2- 172.21.15.32:0/1907797984 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2000b2280 0x7ff200161940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:40.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff1ffe00640 1 -- 172.21.15.32:0/1907797984 >> v1:172.21.15.32:6789/0 conn(0x7ff200161e80 legacy=0x7ff20006c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:40.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff1ffe00640 1 -- 172.21.15.32:0/1907797984 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2000d07c0 con 0x7ff200161560 2024-03-19T06:23:40.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff1ffe00640 1 --2- 172.21.15.32:0/1907797984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff200161560 0x7ff2000b0dd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009870 tx=0x7ff1f001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42086f5367a7004 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:40.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff1fea00640 1 -- 172.21.15.32:0/1907797984 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f00b2070 con 0x7ff200161560 2024-03-19T06:23:40.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff1fea00640 1 -- 172.21.15.32:0/1907797984 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f00a9070 con 0x7ff200161560 2024-03-19T06:23:40.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.571+0000 7ff1fea00640 1 -- 172.21.15.32:0/1907797984 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f00ad880 con 0x7ff200161560 2024-03-19T06:23:40.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff205600640 1 -- 172.21.15.32:0/1907797984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff200161560 msgr2=0x7ff2000b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:40.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff205600640 1 --2- 172.21.15.32:0/1907797984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff200161560 0x7ff2000b0dd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009870 tx=0x7ff1f001c560 comp rx=0 tx=0).stop 2024-03-19T06:23:40.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff205600640 1 -- 172.21.15.32:0/1907797984 shutdown_connections 2024-03-19T06:23:40.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff205600640 1 --2- 172.21.15.32:0/1907797984 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2000b2280 0x7ff200161940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:40.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff205600640 1 --2- 172.21.15.32:0/1907797984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff200161560 0x7ff2000b0dd0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:40.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff205600640 1 -- 172.21.15.32:0/1907797984 >> 172.21.15.32:0/1907797984 conn(0x7ff2000b3120 msgr2=0x7ff2000b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:40.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff205600640 1 -- 172.21.15.32:0/1907797984 shutdown_connections 2024-03-19T06:23:40.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff205600640 1 -- 172.21.15.32:0/1907797984 wait complete. 2024-03-19T06:23:40.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff205600640 1 Processor -- start 2024-03-19T06:23:40.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff205600640 1 -- start start 2024-03-19T06:23:40.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff205600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2000b2280 0x7ff20009d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:40.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff205600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff200161560 0x7ff2000b6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:40.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff205600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff200161e80 0x7ff20015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:40.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff205600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2000b27e0 con 0x7ff2000b2280 2024-03-19T06:23:40.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff205600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2000b2660 con 0x7ff200161e80 2024-03-19T06:23:40.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff205600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff200162290 con 0x7ff200161560 2024-03-19T06:23:40.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff1ffe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2000b2280 0x7ff20009d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:40.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff1ffe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2000b2280 0x7ff20009d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39508/0 (socket says 172.21.15.32:39508) 2024-03-19T06:23:40.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff1ffe00640 1 -- 172.21.15.32:0/3924100367 learned_addr learned my addr 172.21.15.32:0/3924100367 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:40.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff1ffe00640 1 -- 172.21.15.32:0/3924100367 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff200161560 msgr2=0x7ff2000b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:40.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff1ffe00640 1 --2- 172.21.15.32:0/3924100367 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff200161560 0x7ff2000b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:40.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff1ffe00640 1 -- 172.21.15.32:0/3924100367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff200161e80 msgr2=0x7ff20015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:40.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff1ffe00640 1 --2- 172.21.15.32:0/3924100367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff200161e80 0x7ff20015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:40.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.575+0000 7ff1ffe00640 1 -- 172.21.15.32:0/3924100367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2000b4250 con 0x7ff2000b2280 2024-03-19T06:23:40.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.579+0000 7ff1ffe00640 1 --2- 172.21.15.32:0/3924100367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2000b2280 0x7ff20009d510 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00b0040 tx=0x7ff1f0019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:40.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.579+0000 7ff1f7e00640 1 -- 172.21.15.32:0/3924100367 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f00b2040 con 0x7ff2000b2280 2024-03-19T06:23:40.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.579+0000 7ff1f7e00640 1 -- 172.21.15.32:0/3924100367 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f00adb90 con 0x7ff2000b2280 2024-03-19T06:23:40.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.579+0000 7ff205600640 1 -- 172.21.15.32:0/3924100367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2000b4530 con 0x7ff2000b2280 2024-03-19T06:23:40.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.579+0000 7ff1f7e00640 1 -- 172.21.15.32:0/3924100367 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f00b6440 con 0x7ff2000b2280 2024-03-19T06:23:40.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.579+0000 7ff205600640 1 -- 172.21.15.32:0/3924100367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2000b4af0 con 0x7ff2000b2280 2024-03-19T06:23:40.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.579+0000 7ff205600640 1 -- 172.21.15.32:0/3924100367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff200075090 con 0x7ff2000b2280 2024-03-19T06:23:40.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.579+0000 7ff1f7e00640 1 -- 172.21.15.32:0/3924100367 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff1f00bd020 con 0x7ff2000b2280 2024-03-19T06:23:40.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.579+0000 7ff1f7e00640 1 --2- 172.21.15.32:0/3924100367 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff1e0067660 0x7ff1e0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:40.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.579+0000 7ff1f7e00640 1 -- 172.21.15.32:0/3924100367 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1f011ed90 con 0x7ff2000b2280 2024-03-19T06:23:40.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.579+0000 7ff1ff400640 1 --2- 172.21.15.32:0/3924100367 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff1e0067660 0x7ff1e0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:40.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.583+0000 7ff1ff400640 1 --2- 172.21.15.32:0/3924100367 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff1e0067660 0x7ff1e0069b20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff20015ed00 tx=0x7ff1ec008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:40.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.583+0000 7ff1f7e00640 1 -- 172.21.15.32:0/3924100367 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7ff1f00c4020 con 0x7ff2000b2280 2024-03-19T06:23:40.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.807+0000 7ff205600640 1 -- 172.21.15.32:0/3924100367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]} v 0) v1 -- 0x7ff2000b2f00 con 0x7ff2000b2280 2024-03-19T06:23:40.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.807+0000 7ff1f7e00640 1 -- 172.21.15.32:0/3924100367 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]}]=0 updated caps for client.0 v17) v1 ==== 183+0+140 (secure 0 0 0) 0x7ff1f0016150 con 0x7ff2000b2280 2024-03-19T06:23:40.796 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-03-19T06:23:40.796 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCWLvll4jsFMxAAr4PzH6Djodh2O01vGYgxKA== 2024-03-19T06:23:40.796 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow" 2024-03-19T06:23:40.796 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2024-03-19T06:23:40.797 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow w pool=cephfs_data" 2024-03-19T06:23:40.797 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.0 2024-03-19T06:23:40.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.811+0000 7ff205600640 1 -- 172.21.15.32:0/3924100367 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff1e0067660 msgr2=0x7ff1e0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:40.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.811+0000 7ff205600640 1 --2- 172.21.15.32:0/3924100367 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff1e0067660 0x7ff1e0069b20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff20015ed00 tx=0x7ff1ec008040 comp rx=0 tx=0).stop 2024-03-19T06:23:40.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.811+0000 7ff205600640 1 -- 172.21.15.32:0/3924100367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2000b2280 msgr2=0x7ff20009d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:40.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.811+0000 7ff205600640 1 --2- 172.21.15.32:0/3924100367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2000b2280 0x7ff20009d510 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00b0040 tx=0x7ff1f0019300 comp rx=0 tx=0).stop 2024-03-19T06:23:40.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.811+0000 7ff205600640 1 -- 172.21.15.32:0/3924100367 shutdown_connections 2024-03-19T06:23:40.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.811+0000 7ff205600640 1 --2- 172.21.15.32:0/3924100367 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff1e0067660 0x7ff1e0069b20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:40.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.811+0000 7ff205600640 1 --2- 172.21.15.32:0/3924100367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff200161e80 0x7ff20015a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:40.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.811+0000 7ff205600640 1 --2- 172.21.15.32:0/3924100367 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff200161560 0x7ff2000b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:40.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.811+0000 7ff205600640 1 --2- 172.21.15.32:0/3924100367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2000b2280 0x7ff20009d510 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:40.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.811+0000 7ff205600640 1 -- 172.21.15.32:0/3924100367 >> 172.21.15.32:0/3924100367 conn(0x7ff2000b3120 msgr2=0x7ff200160d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:40.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.811+0000 7ff205600640 1 -- 172.21.15.32:0/3924100367 shutdown_connections 2024-03-19T06:23:40.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:40.811+0000 7ff205600640 1 -- 172.21.15.32:0/3924100367 wait complete. 2024-03-19T06:23:40.819 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:23:40.819 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:23:40.828 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:23:41.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.023+0000 7fc2fd400640 1 Processor -- start 2024-03-19T06:23:41.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.023+0000 7fc2fd400640 1 -- start start 2024-03-19T06:23:41.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.027+0000 7fc2fd400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc2f8159ed0 0x7fc2f80cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.027+0000 7fc2fd400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc2f815a2b0 0x7fc2f80caf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.027+0000 7fc2fd400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f80ce3e0 con 0x7fc2f80cdb40 2024-03-19T06:23:41.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.027+0000 7fc2fd400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f80ca1d0 con 0x7fc2f8159ed0 2024-03-19T06:23:41.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.027+0000 7fc2fd400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80ca4b0 con 0x7fc2f815a2b0 2024-03-19T06:23:41.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.027+0000 7fc2ede00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc2f815a2b0 0x7fc2f80caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.027+0000 7fc2ede00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc2f815a2b0 0x7fc2f80caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:34020/0 (socket says 172.21.15.32:34020) 2024-03-19T06:23:41.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.027+0000 7fc2f6800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc2f8159ed0 0x7fc2f80cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.027+0000 7fc2ede00640 1 -- 172.21.15.32:0/833804206 learned_addr learned my addr 172.21.15.32:0/833804206 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:41.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.027+0000 7fc2f7200640 1 --1- 172.21.15.32:0/833804206 >> v1:172.21.15.171:6789/0 conn(0x7fc2f80cdb40 0x7fc2f8071350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:57080/0 (socket says 172.21.15.32:57080) 2024-03-19T06:23:41.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.027+0000 7fc2f6800640 1 -- 172.21.15.32:0/833804206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc2f815a2b0 msgr2=0x7fc2f80caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:41.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.027+0000 7fc2f6800640 1 --2- 172.21.15.32:0/833804206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc2f815a2b0 0x7fc2f80caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.027+0000 7fc2f6800640 1 -- 172.21.15.32:0/833804206 >> v1:172.21.15.171:6789/0 conn(0x7fc2f80cdb40 legacy=0x7fc2f8071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.027+0000 7fc2f6800640 1 -- 172.21.15.32:0/833804206 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f80ca790 con 0x7fc2f8159ed0 2024-03-19T06:23:41.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.027+0000 7fc2f5e00640 1 -- 172.21.15.32:0/833804206 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375705321 0 0) 0x7fc2f80ce3e0 con 0x7fc2f80cdb40 2024-03-19T06:23:41.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.031+0000 7fc2f6800640 1 --2- 172.21.15.32:0/833804206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2f8159ed0 0x7fc2f80cea60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80097c0 tx=0x7fc2e801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c1e7d0f5acfc589 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:41.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.031+0000 7fc2f5e00640 1 -- 172.21.15.32:0/833804206 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80b2070 con 0x7fc2f8159ed0 2024-03-19T06:23:41.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.031+0000 7fc2f5e00640 1 -- 172.21.15.32:0/833804206 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e80ad680 con 0x7fc2f8159ed0 2024-03-19T06:23:41.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.031+0000 7fc2f5e00640 1 -- 172.21.15.32:0/833804206 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80ada50 con 0x7fc2f8159ed0 2024-03-19T06:23:41.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.031+0000 7fc2fd400640 1 -- 172.21.15.32:0/833804206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2f8159ed0 msgr2=0x7fc2f80cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.031+0000 7fc2fd400640 1 --2- 172.21.15.32:0/833804206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2f8159ed0 0x7fc2f80cea60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80097c0 tx=0x7fc2e801c3e0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.031+0000 7fc2fd400640 1 -- 172.21.15.32:0/833804206 shutdown_connections 2024-03-19T06:23:41.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.031+0000 7fc2fd400640 1 --2- 172.21.15.32:0/833804206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc2f815a2b0 0x7fc2f80caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.031+0000 7fc2fd400640 1 --2- 172.21.15.32:0/833804206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2f8159ed0 0x7fc2f80cea60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.031+0000 7fc2fd400640 1 -- 172.21.15.32:0/833804206 >> 172.21.15.32:0/833804206 conn(0x7fc2f80b1280 msgr2=0x7fc2f80b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:41.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.031+0000 7fc2fd400640 1 -- 172.21.15.32:0/833804206 shutdown_connections 2024-03-19T06:23:41.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.031+0000 7fc2fd400640 1 -- 172.21.15.32:0/833804206 wait complete. 2024-03-19T06:23:41.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.031+0000 7fc2fd400640 1 Processor -- start 2024-03-19T06:23:41.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.031+0000 7fc2fd400640 1 -- start start 2024-03-19T06:23:41.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2fd400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2f80cdb40 0x7fc2f8155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2fd400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc2f8159ed0 0x7fc2f815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2fd400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2f815a2b0 0x7fc2f815bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2fd400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f8071a60 con 0x7fc2f80cdb40 2024-03-19T06:23:41.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2fd400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80ce160 con 0x7fc2f815a2b0 2024-03-19T06:23:41.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2fd400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f8071be0 con 0x7fc2f8159ed0 2024-03-19T06:23:41.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2f6800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2f80cdb40 0x7fc2f8155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2f6800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2f80cdb40 0x7fc2f8155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39520/0 (socket says 172.21.15.32:39520) 2024-03-19T06:23:41.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2f6800640 1 -- 172.21.15.32:0/977938051 learned_addr learned my addr 172.21.15.32:0/977938051 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:41.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2ede00640 1 --2- 172.21.15.32:0/977938051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc2f8159ed0 0x7fc2f815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2f7200640 1 --2- 172.21.15.32:0/977938051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2f815a2b0 0x7fc2f815bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2f6800640 1 -- 172.21.15.32:0/977938051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc2f8159ed0 msgr2=0x7fc2f815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2f6800640 1 --2- 172.21.15.32:0/977938051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc2f8159ed0 0x7fc2f815b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2f6800640 1 -- 172.21.15.32:0/977938051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2f815a2b0 msgr2=0x7fc2f815bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2f6800640 1 --2- 172.21.15.32:0/977938051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2f815a2b0 0x7fc2f815bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2f6800640 1 -- 172.21.15.32:0/977938051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f80b33d0 con 0x7fc2f80cdb40 2024-03-19T06:23:41.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2ede00640 1 --2- 172.21.15.32:0/977938051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc2f8159ed0 0x7fc2f815b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:41.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2f7200640 1 --2- 172.21.15.32:0/977938051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2f815a2b0 0x7fc2f815bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:41.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2f6800640 1 --2- 172.21.15.32:0/977938051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2f80cdb40 0x7fc2f8155100 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc2e801aa90 tx=0x7fc2e801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:41.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2ef400640 1 -- 172.21.15.32:0/977938051 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80bc020 con 0x7fc2f80cdb40 2024-03-19T06:23:41.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2ef400640 1 -- 172.21.15.32:0/977938051 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e80adb90 con 0x7fc2f80cdb40 2024-03-19T06:23:41.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2ef400640 1 -- 172.21.15.32:0/977938051 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80b2040 con 0x7fc2f80cdb40 2024-03-19T06:23:41.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2fd400640 1 -- 172.21.15.32:0/977938051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f80b36b0 con 0x7fc2f80cdb40 2024-03-19T06:23:41.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2fd400640 1 -- 172.21.15.32:0/977938051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f80b3c70 con 0x7fc2f80cdb40 2024-03-19T06:23:41.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2fd400640 1 -- 172.21.15.32:0/977938051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f8072600 con 0x7fc2f80cdb40 2024-03-19T06:23:41.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.035+0000 7fc2ef400640 1 -- 172.21.15.32:0/977938051 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc2e80bf020 con 0x7fc2f80cdb40 2024-03-19T06:23:41.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.039+0000 7fc2ef400640 1 --2- 172.21.15.32:0/977938051 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc2d4067690 0x7fc2d4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.039+0000 7fc2ef400640 1 -- 172.21.15.32:0/977938051 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2e811f8e0 con 0x7fc2f80cdb40 2024-03-19T06:23:41.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.039+0000 7fc2ede00640 1 --2- 172.21.15.32:0/977938051 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc2d4067690 0x7fc2d4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.039+0000 7fc2ede00640 1 --2- 172.21.15.32:0/977938051 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc2d4067690 0x7fc2d4069b50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc2f806eb10 tx=0x7fc2e0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:41.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.043+0000 7fc2ef400640 1 -- 172.21.15.32:0/977938051 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fc2e80c6030 con 0x7fc2f80cdb40 2024-03-19T06:23:41.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.215+0000 7fc2fd400640 1 -- 172.21.15.32:0/977938051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2f80ae980 con 0x7fc2f80cdb40 2024-03-19T06:23:41.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.215+0000 7fc2ef400640 1 -- 172.21.15.32:0/977938051 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16681 (secure 0 0 0) 0x7fc2e8016090 con 0x7fc2f80cdb40 2024-03-19T06:23:41.203 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:41.204 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":51,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:23:23.544172+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:23:19.707249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-19T06:23:20.926932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:23:41.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.219+0000 7fc2fd400640 1 -- 172.21.15.32:0/977938051 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc2d4067690 msgr2=0x7fc2d4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.219+0000 7fc2fd400640 1 --2- 172.21.15.32:0/977938051 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc2d4067690 0x7fc2d4069b50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc2f806eb10 tx=0x7fc2e0008040 comp rx=0 tx=0).stop 2024-03-19T06:23:41.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.219+0000 7fc2fd400640 1 -- 172.21.15.32:0/977938051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2f80cdb40 msgr2=0x7fc2f8155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.219+0000 7fc2fd400640 1 --2- 172.21.15.32:0/977938051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2f80cdb40 0x7fc2f8155100 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc2e801aa90 tx=0x7fc2e801ac20 comp rx=0 tx=0).stop 2024-03-19T06:23:41.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.219+0000 7fc2fd400640 1 -- 172.21.15.32:0/977938051 shutdown_connections 2024-03-19T06:23:41.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.219+0000 7fc2fd400640 1 --2- 172.21.15.32:0/977938051 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc2d4067690 0x7fc2d4069b50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.219+0000 7fc2fd400640 1 --2- 172.21.15.32:0/977938051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2f815a2b0 0x7fc2f815bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.219+0000 7fc2fd400640 1 --2- 172.21.15.32:0/977938051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc2f8159ed0 0x7fc2f815b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.219+0000 7fc2fd400640 1 --2- 172.21.15.32:0/977938051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2f80cdb40 0x7fc2f8155100 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.219+0000 7fc2fd400640 1 -- 172.21.15.32:0/977938051 >> 172.21.15.32:0/977938051 conn(0x7fc2f80b1280 msgr2=0x7fc2f806ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:41.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.219+0000 7fc2fd400640 1 -- 172.21.15.32:0/977938051 shutdown_connections 2024-03-19T06:23:41.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.219+0000 7fc2fd400640 1 -- 172.21.15.32:0/977938051 wait complete. 2024-03-19T06:23:41.226 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:23:19.707249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:23:20.926932+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:23:41.226 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:23:41.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.383+0000 7f131f800640 1 Processor -- start 2024-03-19T06:23:41.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.383+0000 7f131f800640 1 -- start start 2024-03-19T06:23:41.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.383+0000 7f131f800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f131815a840 0x7f131806f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.383+0000 7f131f800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f131806b450 0x7f13180ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.383+0000 7f131f800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13180af2d0 con 0x7f13180aea70 2024-03-19T06:23:41.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.383+0000 7f131f800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13180cdc20 con 0x7f131815a840 2024-03-19T06:23:41.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.383+0000 7f131f800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131815eea0 con 0x7f131806b450 2024-03-19T06:23:41.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.383+0000 7f131ce00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f131815a840 0x7f131806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.383+0000 7f131ce00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f131815a840 0x7f131806f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39536/0 (socket says 172.21.15.32:39536) 2024-03-19T06:23:41.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.383+0000 7f131ce00640 1 -- 172.21.15.32:0/1294020004 learned_addr learned my addr 172.21.15.32:0/1294020004 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:41.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.383+0000 7f131ce00640 1 -- 172.21.15.32:0/1294020004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f131806b450 msgr2=0x7f13180ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:41.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.383+0000 7f131d800640 1 --2- 172.21.15.32:0/1294020004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f131806b450 0x7f13180ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.383+0000 7f131ce00640 1 --2- 172.21.15.32:0/1294020004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f131806b450 0x7f13180ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.383+0000 7f131ce00640 1 -- 172.21.15.32:0/1294020004 >> v1:172.21.15.171:6789/0 conn(0x7f13180aea70 legacy=0x7f131806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:41.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.383+0000 7f131ce00640 1 -- 172.21.15.32:0/1294020004 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131815f180 con 0x7f131815a840 2024-03-19T06:23:41.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.383+0000 7f131d800640 1 --2- 172.21.15.32:0/1294020004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f131806b450 0x7f13180ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:41.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.387+0000 7f131ce00640 1 --2- 172.21.15.32:0/1294020004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f131815a840 0x7f131806f040 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f1308009870 tx=0x7f130801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ae95782ef64577 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:41.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.387+0000 7f1317e00640 1 -- 172.21.15.32:0/1294020004 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080b1070 con 0x7f131815a840 2024-03-19T06:23:41.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.387+0000 7f1317e00640 1 -- 172.21.15.32:0/1294020004 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13080a8050 con 0x7f131815a840 2024-03-19T06:23:41.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.387+0000 7f1317e00640 1 -- 172.21.15.32:0/1294020004 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080ac860 con 0x7f131815a840 2024-03-19T06:23:41.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.387+0000 7f131f800640 1 -- 172.21.15.32:0/1294020004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f131815a840 msgr2=0x7f131806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.387+0000 7f131f800640 1 --2- 172.21.15.32:0/1294020004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f131815a840 0x7f131806f040 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f1308009870 tx=0x7f130801c3c0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.387+0000 7f131f800640 1 -- 172.21.15.32:0/1294020004 shutdown_connections 2024-03-19T06:23:41.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.387+0000 7f131f800640 1 --2- 172.21.15.32:0/1294020004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f131806b450 0x7f13180ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.387+0000 7f131f800640 1 --2- 172.21.15.32:0/1294020004 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f131815a840 0x7f131806f040 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.387+0000 7f131f800640 1 -- 172.21.15.32:0/1294020004 >> 172.21.15.32:0/1294020004 conn(0x7f13180b1590 msgr2=0x7f13180b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:41.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.387+0000 7f131f800640 1 -- 172.21.15.32:0/1294020004 shutdown_connections 2024-03-19T06:23:41.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.387+0000 7f131f800640 1 -- 172.21.15.32:0/1294020004 wait complete. 2024-03-19T06:23:41.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f131f800640 1 Processor -- start 2024-03-19T06:23:41.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f131f800640 1 -- start start 2024-03-19T06:23:41.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f131f800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f131806b450 0x7f131814a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f131f800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13180aea70 0x7f1318145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f131f800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f131815a840 0x7f13181460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f131f800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13180cef80 con 0x7f13180aea70 2024-03-19T06:23:41.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f131f800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13180cee00 con 0x7f131815a840 2024-03-19T06:23:41.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f131f800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13180cf100 con 0x7f131806b450 2024-03-19T06:23:41.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f130fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13180aea70 0x7f1318145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f130fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13180aea70 0x7f1318145bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39550/0 (socket says 172.21.15.32:39550) 2024-03-19T06:23:41.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f130fe00640 1 -- 172.21.15.32:0/2729906074 learned_addr learned my addr 172.21.15.32:0/2729906074 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:41.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f131ce00640 1 --2- 172.21.15.32:0/2729906074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f131806b450 0x7f131814a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f131d800640 1 --2- 172.21.15.32:0/2729906074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f131815a840 0x7f13181460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f130fe00640 1 -- 172.21.15.32:0/2729906074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f131806b450 msgr2=0x7f131814a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f130fe00640 1 --2- 172.21.15.32:0/2729906074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f131806b450 0x7f131814a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f130fe00640 1 -- 172.21.15.32:0/2729906074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f131815a840 msgr2=0x7f13181460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f130fe00640 1 --2- 172.21.15.32:0/2729906074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f131815a840 0x7f13181460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f130fe00640 1 -- 172.21.15.32:0/2729906074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1318145600 con 0x7f13180aea70 2024-03-19T06:23:41.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f131d800640 1 --2- 172.21.15.32:0/2729906074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f131815a840 0x7f13181460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:41.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f130fe00640 1 --2- 172.21.15.32:0/2729906074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13180aea70 0x7f1318145bb0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f130000c440 tx=0x7f130000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:41.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f1315600640 1 -- 172.21.15.32:0/2729906074 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300016020 con 0x7f13180aea70 2024-03-19T06:23:41.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f1315600640 1 -- 172.21.15.32:0/2729906074 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1300012830 con 0x7f13180aea70 2024-03-19T06:23:41.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f131f800640 1 -- 172.21.15.32:0/2729906074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13181492b0 con 0x7f13180aea70 2024-03-19T06:23:41.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f1315600640 1 -- 172.21.15.32:0/2729906074 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300012c20 con 0x7f13180aea70 2024-03-19T06:23:41.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.391+0000 7f131f800640 1 -- 172.21.15.32:0/2729906074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1318149870 con 0x7f13180aea70 2024-03-19T06:23:41.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.395+0000 7f131f800640 1 -- 172.21.15.32:0/2729906074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13180749e0 con 0x7f13180aea70 2024-03-19T06:23:41.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.395+0000 7f1315600640 1 -- 172.21.15.32:0/2729906074 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1300019020 con 0x7f13180aea70 2024-03-19T06:23:41.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.395+0000 7f1315600640 1 --2- 172.21.15.32:0/2729906074 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f12f4067660 0x7f12f4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.395+0000 7f1315600640 1 -- 172.21.15.32:0/2729906074 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1300085520 con 0x7f13180aea70 2024-03-19T06:23:41.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.395+0000 7f131ce00640 1 --2- 172.21.15.32:0/2729906074 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f12f4067660 0x7f12f4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.395+0000 7f131ce00640 1 --2- 172.21.15.32:0/2729906074 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f12f4067660 0x7f12f4069b20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f13080ae000 tx=0x7f13080a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:41.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.399+0000 7f1315600640 1 -- 172.21.15.32:0/2729906074 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f1300020030 con 0x7f13180aea70 2024-03-19T06:23:41.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.563+0000 7f131f800640 1 -- 172.21.15.32:0/2729906074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13180af880 con 0x7f13180aea70 2024-03-19T06:23:41.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.563+0000 7f1315600640 1 -- 172.21.15.32:0/2729906074 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1300056180 con 0x7f13180aea70 2024-03-19T06:23:41.552 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:23:41.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.567+0000 7f131f800640 1 -- 172.21.15.32:0/2729906074 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f12f4067660 msgr2=0x7f12f4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.567+0000 7f131f800640 1 --2- 172.21.15.32:0/2729906074 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f12f4067660 0x7f12f4069b20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f13080ae000 tx=0x7f13080a7000 comp rx=0 tx=0).stop 2024-03-19T06:23:41.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.567+0000 7f131f800640 1 -- 172.21.15.32:0/2729906074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13180aea70 msgr2=0x7f1318145bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.567+0000 7f131f800640 1 --2- 172.21.15.32:0/2729906074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13180aea70 0x7f1318145bb0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f130000c440 tx=0x7f130000c900 comp rx=0 tx=0).stop 2024-03-19T06:23:41.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.567+0000 7f131f800640 1 -- 172.21.15.32:0/2729906074 shutdown_connections 2024-03-19T06:23:41.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.567+0000 7f131f800640 1 --2- 172.21.15.32:0/2729906074 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f12f4067660 0x7f12f4069b20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.567+0000 7f131f800640 1 --2- 172.21.15.32:0/2729906074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f131815a840 0x7f13181460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.567+0000 7f131f800640 1 --2- 172.21.15.32:0/2729906074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13180aea70 0x7f1318145bb0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.567+0000 7f131f800640 1 --2- 172.21.15.32:0/2729906074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f131806b450 0x7f131814a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.567+0000 7f131f800640 1 -- 172.21.15.32:0/2729906074 >> 172.21.15.32:0/2729906074 conn(0x7f13180b1590 msgr2=0x7f131814eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:41.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.567+0000 7f131f800640 1 -- 172.21.15.32:0/2729906074 shutdown_connections 2024-03-19T06:23:41.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.567+0000 7f131f800640 1 -- 172.21.15.32:0/2729906074 wait complete. 2024-03-19T06:23:41.573 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:23:41.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.727+0000 7f433e400640 1 Processor -- start 2024-03-19T06:23:41.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.731+0000 7f433e400640 1 -- start start 2024-03-19T06:23:41.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.731+0000 7f433e400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f433815a840 0x7f433806f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.731+0000 7f433e400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f43380aea70 0x7f433806ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.731+0000 7f433e400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43380af2d0 con 0x7f433806b280 2024-03-19T06:23:41.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.731+0000 7f433e400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433806b6d0 con 0x7f433815a840 2024-03-19T06:23:41.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.731+0000 7f433e400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43380cdc20 con 0x7f43380aea70 2024-03-19T06:23:41.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.731+0000 7f4337400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f433815a840 0x7f433806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.731+0000 7f4337400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f433815a840 0x7f433806f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39552/0 (socket says 172.21.15.32:39552) 2024-03-19T06:23:41.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.731+0000 7f4337400640 1 -- 172.21.15.32:0/4238012158 learned_addr learned my addr 172.21.15.32:0/4238012158 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:41.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.731+0000 7f432ea00640 1 --2- 172.21.15.32:0/4238012158 >> v2:172.21.15.171:3300/0 conn(0x7f43380aea70 0x7f433806ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.731+0000 7f4337400640 1 -- 172.21.15.32:0/4238012158 >> v2:172.21.15.171:3300/0 conn(0x7f43380aea70 msgr2=0x7f433806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:41.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.731+0000 7f4337400640 1 --2- 172.21.15.32:0/4238012158 >> v2:172.21.15.171:3300/0 conn(0x7f43380aea70 0x7f433806ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.731+0000 7f4337400640 1 -- 172.21.15.32:0/4238012158 >> v1:172.21.15.171:6789/0 conn(0x7f433806b280 legacy=0x7f433806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.731+0000 7f4337400640 1 -- 172.21.15.32:0/4238012158 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433815eea0 con 0x7f433815a840 2024-03-19T06:23:41.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.735+0000 7f4337400640 1 --2- 172.21.15.32:0/4238012158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f433815a840 0x7f433806f040 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f433806ed40 tx=0x7f432801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de84e9c9d6116721 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:41.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.735+0000 7f4336a00640 1 -- 172.21.15.32:0/4238012158 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280b1070 con 0x7f433815a840 2024-03-19T06:23:41.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.735+0000 7f4336a00640 1 -- 172.21.15.32:0/4238012158 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43280ac410 con 0x7f433815a840 2024-03-19T06:23:41.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.735+0000 7f4336a00640 1 -- 172.21.15.32:0/4238012158 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280ac7e0 con 0x7f433815a840 2024-03-19T06:23:41.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.735+0000 7f433e400640 1 -- 172.21.15.32:0/4238012158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f433815a840 msgr2=0x7f433806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.735+0000 7f433e400640 1 --2- 172.21.15.32:0/4238012158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f433815a840 0x7f433806f040 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f433806ed40 tx=0x7f432801c3d0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.735+0000 7f433e400640 1 -- 172.21.15.32:0/4238012158 shutdown_connections 2024-03-19T06:23:41.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.735+0000 7f433e400640 1 --2- 172.21.15.32:0/4238012158 >> v2:172.21.15.171:3300/0 conn(0x7f43380aea70 0x7f433806ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.735+0000 7f433e400640 1 --2- 172.21.15.32:0/4238012158 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f433815a840 0x7f433806f040 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.735+0000 7f433e400640 1 -- 172.21.15.32:0/4238012158 >> 172.21.15.32:0/4238012158 conn(0x7f43380b1590 msgr2=0x7f43380b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:41.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.735+0000 7f433e400640 1 -- 172.21.15.32:0/4238012158 shutdown_connections 2024-03-19T06:23:41.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.735+0000 7f433e400640 1 -- 172.21.15.32:0/4238012158 wait complete. 2024-03-19T06:23:41.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.735+0000 7f433e400640 1 Processor -- start 2024-03-19T06:23:41.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.735+0000 7f433e400640 1 -- start start 2024-03-19T06:23:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f433e400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f433806b280 0x7f433814c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f433e400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43380aea70 0x7f43381601e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f433e400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f433815a840 0x7f4338162990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f433e400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43380af0b0 con 0x7f433806b280 2024-03-19T06:23:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f433e400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43380aef30 con 0x7f43380aea70 2024-03-19T06:23:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f433e400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4338167790 con 0x7f433815a840 2024-03-19T06:23:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f4337400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f433806b280 0x7f433814c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f4337400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f433806b280 0x7f433814c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39560/0 (socket says 172.21.15.32:39560) 2024-03-19T06:23:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f4337400640 1 -- 172.21.15.32:0/1766994234 learned_addr learned my addr 172.21.15.32:0/1766994234 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f432ea00640 1 --2- 172.21.15.32:0/1766994234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43380aea70 0x7f43381601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f4337e00640 1 --2- 172.21.15.32:0/1766994234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f433815a840 0x7f4338162990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f4337400640 1 -- 172.21.15.32:0/1766994234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f433815a840 msgr2=0x7f4338162990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f4337400640 1 --2- 172.21.15.32:0/1766994234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f433815a840 0x7f4338162990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f4337400640 1 -- 172.21.15.32:0/1766994234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43380aea70 msgr2=0x7f43381601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f4337400640 1 --2- 172.21.15.32:0/1766994234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43380aea70 0x7f43381601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f4337400640 1 -- 172.21.15.32:0/1766994234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4338160720 con 0x7f433806b280 2024-03-19T06:23:41.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f4337400640 1 --2- 172.21.15.32:0/1766994234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f433806b280 0x7f433814c2d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f43280af040 tx=0x7f4328019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:41.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f432fe00640 1 -- 172.21.15.32:0/1766994234 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280bc070 con 0x7f433806b280 2024-03-19T06:23:41.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f432fe00640 1 -- 172.21.15.32:0/1766994234 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43280ace00 con 0x7f433806b280 2024-03-19T06:23:41.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f432fe00640 1 -- 172.21.15.32:0/1766994234 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280b1070 con 0x7f433806b280 2024-03-19T06:23:41.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f433e400640 1 -- 172.21.15.32:0/1766994234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4338160f50 con 0x7f433806b280 2024-03-19T06:23:41.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f433e400640 1 -- 172.21.15.32:0/1766994234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4338161510 con 0x7f433806b280 2024-03-19T06:23:41.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f433e400640 1 -- 172.21.15.32:0/1766994234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43380749e0 con 0x7f433806b280 2024-03-19T06:23:41.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.739+0000 7f432fe00640 1 -- 172.21.15.32:0/1766994234 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f43280bf070 con 0x7f433806b280 2024-03-19T06:23:41.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.743+0000 7f432fe00640 1 --2- 172.21.15.32:0/1766994234 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4314067660 0x7f4314069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:41.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.743+0000 7f432fe00640 1 -- 172.21.15.32:0/1766994234 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f432811f150 con 0x7f433806b280 2024-03-19T06:23:41.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.743+0000 7f432ea00640 1 --2- 172.21.15.32:0/1766994234 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4314067660 0x7f4314069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:41.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.743+0000 7f432ea00640 1 --2- 172.21.15.32:0/1766994234 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4314067660 0x7f4314069b20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f433806ec30 tx=0x7f4320008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:41.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.747+0000 7f432fe00640 1 -- 172.21.15.32:0/1766994234 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f4338160720 con 0x7f433806b280 2024-03-19T06:23:41.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.907+0000 7f433e400640 1 -- 172.21.15.32:0/1766994234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f43380b27b0 con 0x7f433806b280 2024-03-19T06:23:41.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.907+0000 7f432fe00640 1 -- 172.21.15.32:0/1766994234 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4328016110 con 0x7f433806b280 2024-03-19T06:23:41.895 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:23:41.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.911+0000 7f433e400640 1 -- 172.21.15.32:0/1766994234 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4314067660 msgr2=0x7f4314069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.911+0000 7f433e400640 1 --2- 172.21.15.32:0/1766994234 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4314067660 0x7f4314069b20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f433806ec30 tx=0x7f4320008040 comp rx=0 tx=0).stop 2024-03-19T06:23:41.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.911+0000 7f433e400640 1 -- 172.21.15.32:0/1766994234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f433806b280 msgr2=0x7f433814c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:41.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.911+0000 7f433e400640 1 --2- 172.21.15.32:0/1766994234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f433806b280 0x7f433814c2d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f43280af040 tx=0x7f4328019170 comp rx=0 tx=0).stop 2024-03-19T06:23:41.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.911+0000 7f433e400640 1 -- 172.21.15.32:0/1766994234 shutdown_connections 2024-03-19T06:23:41.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.911+0000 7f433e400640 1 --2- 172.21.15.32:0/1766994234 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4314067660 0x7f4314069b20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.911+0000 7f433e400640 1 --2- 172.21.15.32:0/1766994234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f433815a840 0x7f4338162990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.911+0000 7f433e400640 1 --2- 172.21.15.32:0/1766994234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43380aea70 0x7f43381601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.911+0000 7f433e400640 1 --2- 172.21.15.32:0/1766994234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f433806b280 0x7f433814c2d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:41.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.911+0000 7f433e400640 1 -- 172.21.15.32:0/1766994234 >> 172.21.15.32:0/1766994234 conn(0x7f43380b1590 msgr2=0x7f43380afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:41.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.911+0000 7f433e400640 1 -- 172.21.15.32:0/1766994234 shutdown_connections 2024-03-19T06:23:41.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:41.911+0000 7f433e400640 1 -- 172.21.15.32:0/1766994234 wait complete. 2024-03-19T06:23:41.917 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:23:42.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d12400640 1 Processor -- start 2024-03-19T06:23:42.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d12400640 1 -- start start 2024-03-19T06:23:42.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d12400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3d0c06b450 0x7f3d0c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d12400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3d0c0aea70 0x7f3d0c0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d12400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d0c0af2d0 con 0x7f3d0c15a840 2024-03-19T06:23:42.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d12400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0c0cdc20 con 0x7f3d0c0aea70 2024-03-19T06:23:42.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d12400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0c15eea0 con 0x7f3d0c06b450 2024-03-19T06:23:42.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d0b400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3d0c15a840 0x7f3d0c06ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33242/0 (socket says 172.21.15.32:33242) 2024-03-19T06:23:42.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d0b400640 1 -- 172.21.15.32:0/176206260 learned_addr learned my addr 172.21.15.32:0/176206260 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:42.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d0be00640 1 --2- 172.21.15.32:0/176206260 >> v2:172.21.15.32:3300/0 conn(0x7f3d0c0aea70 0x7f3d0c0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d0aa00640 1 --2- 172.21.15.32:0/176206260 >> v2:172.21.15.171:3300/0 conn(0x7f3d0c06b450 0x7f3d0c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d0a000640 1 -- 172.21.15.32:0/176206260 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650580189 0 0) 0x7f3d0c0af2d0 con 0x7f3d0c15a840 2024-03-19T06:23:42.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d0a000640 1 -- 172.21.15.32:0/176206260 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cf0005740 con 0x7f3d0c15a840 2024-03-19T06:23:42.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d0be00640 1 -- 172.21.15.32:0/176206260 >> v2:172.21.15.171:3300/0 conn(0x7f3d0c06b450 msgr2=0x7f3d0c06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:42.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d0be00640 1 --2- 172.21.15.32:0/176206260 >> v2:172.21.15.171:3300/0 conn(0x7f3d0c06b450 0x7f3d0c06f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d0be00640 1 -- 172.21.15.32:0/176206260 >> v1:172.21.15.32:6789/0 conn(0x7f3d0c15a840 legacy=0x7f3d0c06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.075+0000 7f3d0be00640 1 -- 172.21.15.32:0/176206260 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c15f180 con 0x7f3d0c0aea70 2024-03-19T06:23:42.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.079+0000 7f3d0be00640 1 --2- 172.21.15.32:0/176206260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d0c0aea70 0x7f3d0c0ce0b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c06ed40 tx=0x7f3d0401c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea900b5b8376ddb0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:42.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.079+0000 7f3d0a000640 1 -- 172.21.15.32:0/176206260 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d040b2070 con 0x7f3d0c0aea70 2024-03-19T06:23:42.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.079+0000 7f3d0a000640 1 -- 172.21.15.32:0/176206260 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d040a5980 con 0x7f3d0c0aea70 2024-03-19T06:23:42.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.079+0000 7f3d0a000640 1 -- 172.21.15.32:0/176206260 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d040a5d50 con 0x7f3d0c0aea70 2024-03-19T06:23:42.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.079+0000 7f3d12400640 1 -- 172.21.15.32:0/176206260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d0c0aea70 msgr2=0x7f3d0c0ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.079+0000 7f3d12400640 1 --2- 172.21.15.32:0/176206260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d0c0aea70 0x7f3d0c0ce0b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c06ed40 tx=0x7f3d0401c860 comp rx=0 tx=0).stop 2024-03-19T06:23:42.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.079+0000 7f3d12400640 1 -- 172.21.15.32:0/176206260 shutdown_connections 2024-03-19T06:23:42.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.079+0000 7f3d12400640 1 --2- 172.21.15.32:0/176206260 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d0c0aea70 0x7f3d0c0ce0b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.079+0000 7f3d12400640 1 --2- 172.21.15.32:0/176206260 >> v2:172.21.15.171:3300/0 conn(0x7f3d0c06b450 0x7f3d0c06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.079+0000 7f3d12400640 1 -- 172.21.15.32:0/176206260 >> 172.21.15.32:0/176206260 conn(0x7f3d0c0b1590 msgr2=0x7f3d0c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:42.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.079+0000 7f3d12400640 1 -- 172.21.15.32:0/176206260 shutdown_connections 2024-03-19T06:23:42.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.079+0000 7f3d12400640 1 -- 172.21.15.32:0/176206260 wait complete. 2024-03-19T06:23:42.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.079+0000 7f3d12400640 1 Processor -- start 2024-03-19T06:23:42.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d12400640 1 -- start start 2024-03-19T06:23:42.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d12400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d0c06b450 0x7f3d0c1f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d12400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d0c0aea70 0x7f3d0c15d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d12400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d0c15a840 0x7f3d0c150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d12400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0cef80 con 0x7f3d0c06b450 2024-03-19T06:23:42.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d12400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0cee00 con 0x7f3d0c0aea70 2024-03-19T06:23:42.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d12400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0cf100 con 0x7f3d0c15a840 2024-03-19T06:23:42.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d0b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d0c06b450 0x7f3d0c1f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d0b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d0c06b450 0x7f3d0c1f5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39574/0 (socket says 172.21.15.32:39574) 2024-03-19T06:23:42.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d0b400640 1 -- 172.21.15.32:0/2848529402 learned_addr learned my addr 172.21.15.32:0/2848529402 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:42.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d0aa00640 1 --2- 172.21.15.32:0/2848529402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d0c0aea70 0x7f3d0c15d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d0be00640 1 --2- 172.21.15.32:0/2848529402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d0c15a840 0x7f3d0c150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d0b400640 1 -- 172.21.15.32:0/2848529402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d0c15a840 msgr2=0x7f3d0c150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d0b400640 1 --2- 172.21.15.32:0/2848529402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d0c15a840 0x7f3d0c150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d0b400640 1 -- 172.21.15.32:0/2848529402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d0c0aea70 msgr2=0x7f3d0c15d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d0b400640 1 --2- 172.21.15.32:0/2848529402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d0c0aea70 0x7f3d0c15d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d0b400640 1 -- 172.21.15.32:0/2848529402 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c15c020 con 0x7f3d0c06b450 2024-03-19T06:23:42.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d0be00640 1 --2- 172.21.15.32:0/2848529402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d0c15a840 0x7f3d0c150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:42.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d0aa00640 1 --2- 172.21.15.32:0/2848529402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d0c0aea70 0x7f3d0c15d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:42.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d0b400640 1 --2- 172.21.15.32:0/2848529402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d0c06b450 0x7f3d0c1f5d80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00c3c0 tx=0x7f3cfc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:42.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d03400640 1 -- 172.21.15.32:0/2848529402 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc017070 con 0x7f3d0c06b450 2024-03-19T06:23:42.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d03400640 1 -- 172.21.15.32:0/2848529402 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cfc005cf0 con 0x7f3d0c06b450 2024-03-19T06:23:42.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d12400640 1 -- 172.21.15.32:0/2848529402 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c15c2c0 con 0x7f3d0c06b450 2024-03-19T06:23:42.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d03400640 1 -- 172.21.15.32:0/2848529402 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc0072f0 con 0x7f3d0c06b450 2024-03-19T06:23:42.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d12400640 1 -- 172.21.15.32:0/2848529402 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c15c880 con 0x7f3d0c06b450 2024-03-19T06:23:42.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.083+0000 7f3d12400640 1 -- 172.21.15.32:0/2848529402 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0c0749e0 con 0x7f3d0c06b450 2024-03-19T06:23:42.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.087+0000 7f3d03400640 1 -- 172.21.15.32:0/2848529402 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3cfc01a070 con 0x7f3d0c06b450 2024-03-19T06:23:42.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.087+0000 7f3d03400640 1 --2- 172.21.15.32:0/2848529402 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3cec067690 0x7f3cec069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.087+0000 7f3d03400640 1 -- 172.21.15.32:0/2848529402 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cfc084d40 con 0x7f3d0c06b450 2024-03-19T06:23:42.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.087+0000 7f3d0aa00640 1 --2- 172.21.15.32:0/2848529402 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3cec067690 0x7f3cec069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.087+0000 7f3d0aa00640 1 --2- 172.21.15.32:0/2848529402 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3cec067690 0x7f3cec069b50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0ae440 tx=0x7f3cf8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:42.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.091+0000 7f3d03400640 1 -- 172.21.15.32:0/2848529402 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f3cfc055920 con 0x7f3d0c06b450 2024-03-19T06:23:42.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.255+0000 7f3d12400640 1 -- 172.21.15.32:0/2848529402 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d0c06e6c0 con 0x7f3d0c06b450 2024-03-19T06:23:42.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.255+0000 7f3d03400640 1 -- 172.21.15.32:0/2848529402 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3cfc055220 con 0x7f3d0c06b450 2024-03-19T06:23:42.244 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:23:42.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.259+0000 7f3d12400640 1 -- 172.21.15.32:0/2848529402 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3cec067690 msgr2=0x7f3cec069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.259+0000 7f3d12400640 1 --2- 172.21.15.32:0/2848529402 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3cec067690 0x7f3cec069b50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0ae440 tx=0x7f3cf8008040 comp rx=0 tx=0).stop 2024-03-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.259+0000 7f3d12400640 1 -- 172.21.15.32:0/2848529402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d0c06b450 msgr2=0x7f3d0c1f5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.259+0000 7f3d12400640 1 --2- 172.21.15.32:0/2848529402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d0c06b450 0x7f3d0c1f5d80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00c3c0 tx=0x7f3cfc00c880 comp rx=0 tx=0).stop 2024-03-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.259+0000 7f3d12400640 1 -- 172.21.15.32:0/2848529402 shutdown_connections 2024-03-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.259+0000 7f3d12400640 1 --2- 172.21.15.32:0/2848529402 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f3cec067690 0x7f3cec069b50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.259+0000 7f3d12400640 1 --2- 172.21.15.32:0/2848529402 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d0c15a840 0x7f3d0c150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.259+0000 7f3d12400640 1 --2- 172.21.15.32:0/2848529402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d0c0aea70 0x7f3d0c15d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.259+0000 7f3d12400640 1 --2- 172.21.15.32:0/2848529402 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d0c06b450 0x7f3d0c1f5d80 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.259+0000 7f3d12400640 1 -- 172.21.15.32:0/2848529402 >> 172.21.15.32:0/2848529402 conn(0x7f3d0c0b1590 msgr2=0x7f3d0c0b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.259+0000 7f3d12400640 1 -- 172.21.15.32:0/2848529402 shutdown_connections 2024-03-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.259+0000 7f3d12400640 1 -- 172.21.15.32:0/2848529402 wait complete. 2024-03-19T06:23:42.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:23:42.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.419+0000 7efe62600640 1 Processor -- start 2024-03-19T06:23:42.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.419+0000 7efe62600640 1 -- start start 2024-03-19T06:23:42.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.419+0000 7efe62600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efe5c0aecf0 0x7efe5c0ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.419+0000 7efe62600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efe5c06d6c0 0x7efe5c06daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.419+0000 7efe62600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5c15fe20 con 0x7efe5c15c010 2024-03-19T06:23:42.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.419+0000 7efe62600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5c1603e0 con 0x7efe5c06d6c0 2024-03-19T06:23:42.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.419+0000 7efe62600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5c06e030 con 0x7efe5c0aecf0 2024-03-19T06:23:42.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.419+0000 7efe52a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7efe5c15c010 0x7efe5c15f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33250/0 (socket says 172.21.15.32:33250) 2024-03-19T06:23:42.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.419+0000 7efe5be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efe5c06d6c0 0x7efe5c06daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.419+0000 7efe52a00640 1 -- 172.21.15.32:0/69581324 learned_addr learned my addr 172.21.15.32:0/69581324 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:42.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.419+0000 7efe5b400640 1 --2- 172.21.15.32:0/69581324 >> v2:172.21.15.171:3300/0 conn(0x7efe5c0aecf0 0x7efe5c0ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.423+0000 7efe5be00640 1 -- 172.21.15.32:0/69581324 >> v2:172.21.15.171:3300/0 conn(0x7efe5c0aecf0 msgr2=0x7efe5c0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:42.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.423+0000 7efe5be00640 1 --2- 172.21.15.32:0/69581324 >> v2:172.21.15.171:3300/0 conn(0x7efe5c0aecf0 0x7efe5c0ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.423+0000 7efe5be00640 1 -- 172.21.15.32:0/69581324 >> v1:172.21.15.32:6789/0 conn(0x7efe5c15c010 legacy=0x7efe5c15f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.423+0000 7efe5be00640 1 -- 172.21.15.32:0/69581324 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c160100 con 0x7efe5c06d6c0 2024-03-19T06:23:42.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.423+0000 7efe5b400640 1 --2- 172.21.15.32:0/69581324 >> v2:172.21.15.171:3300/0 conn(0x7efe5c0aecf0 0x7efe5c0ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:42.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.423+0000 7efe5be00640 1 --2- 172.21.15.32:0/69581324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe5c06d6c0 0x7efe5c06daf0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7efe5c068870 tx=0x7efe5401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4213a16f2549c176 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:42.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.423+0000 7efe5aa00640 1 -- 172.21.15.32:0/69581324 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe540b2070 con 0x7efe5c06d6c0 2024-03-19T06:23:42.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.423+0000 7efe5aa00640 1 -- 172.21.15.32:0/69581324 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe540a5870 con 0x7efe5c06d6c0 2024-03-19T06:23:42.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.423+0000 7efe5aa00640 1 -- 172.21.15.32:0/69581324 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe540a5c40 con 0x7efe5c06d6c0 2024-03-19T06:23:42.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.423+0000 7efe62600640 1 -- 172.21.15.32:0/69581324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe5c06d6c0 msgr2=0x7efe5c06daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.423+0000 7efe62600640 1 --2- 172.21.15.32:0/69581324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe5c06d6c0 0x7efe5c06daf0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7efe5c068870 tx=0x7efe5401c8a0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe62600640 1 -- 172.21.15.32:0/69581324 shutdown_connections 2024-03-19T06:23:42.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe62600640 1 --2- 172.21.15.32:0/69581324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe5c06d6c0 0x7efe5c06daf0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe62600640 1 --2- 172.21.15.32:0/69581324 >> v2:172.21.15.171:3300/0 conn(0x7efe5c0aecf0 0x7efe5c0ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe62600640 1 -- 172.21.15.32:0/69581324 >> 172.21.15.32:0/69581324 conn(0x7efe5c0b1280 msgr2=0x7efe5c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:42.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe62600640 1 -- 172.21.15.32:0/69581324 shutdown_connections 2024-03-19T06:23:42.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe62600640 1 -- 172.21.15.32:0/69581324 wait complete. 2024-03-19T06:23:42.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe62600640 1 Processor -- start 2024-03-19T06:23:42.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe62600640 1 -- start start 2024-03-19T06:23:42.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe62600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe5c06d6c0 0x7efe5c143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe62600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe5c0aecf0 0x7efe5c146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe62600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe5c15c010 0x7efe5c144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe62600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c0cbde0 con 0x7efe5c06d6c0 2024-03-19T06:23:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe62600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c0cbc60 con 0x7efe5c0aecf0 2024-03-19T06:23:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe62600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c168690 con 0x7efe5c15c010 2024-03-19T06:23:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe5b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe5c06d6c0 0x7efe5c143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe5b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe5c06d6c0 0x7efe5c143190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39606/0 (socket says 172.21.15.32:39606) 2024-03-19T06:23:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe5b400640 1 -- 172.21.15.32:0/4260976238 learned_addr learned my addr 172.21.15.32:0/4260976238 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe5b400640 1 -- 172.21.15.32:0/4260976238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe5c15c010 msgr2=0x7efe5c144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe5be00640 1 --2- 172.21.15.32:0/4260976238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe5c15c010 0x7efe5c144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe5b400640 1 --2- 172.21.15.32:0/4260976238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe5c15c010 0x7efe5c144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe5b400640 1 -- 172.21.15.32:0/4260976238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe5c0aecf0 msgr2=0x7efe5c146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe52a00640 1 --2- 172.21.15.32:0/4260976238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe5c0aecf0 0x7efe5c146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe5b400640 1 --2- 172.21.15.32:0/4260976238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe5c0aecf0 0x7efe5c146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe5b400640 1 -- 172.21.15.32:0/4260976238 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c144e50 con 0x7efe5c06d6c0 2024-03-19T06:23:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe5be00640 1 --2- 172.21.15.32:0/4260976238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe5c15c010 0x7efe5c144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe52a00640 1 --2- 172.21.15.32:0/4260976238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe5c0aecf0 0x7efe5c146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:42.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.427+0000 7efe5b400640 1 --2- 172.21.15.32:0/4260976238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe5c06d6c0 0x7efe5c143190 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00e810 tx=0x7efe4c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:42.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.431+0000 7efe53e00640 1 -- 172.21.15.32:0/4260976238 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c017070 con 0x7efe5c06d6c0 2024-03-19T06:23:42.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.431+0000 7efe53e00640 1 -- 172.21.15.32:0/4260976238 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c00c8d0 con 0x7efe5c06d6c0 2024-03-19T06:23:42.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.431+0000 7efe53e00640 1 -- 172.21.15.32:0/4260976238 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c00f040 con 0x7efe5c06d6c0 2024-03-19T06:23:42.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.431+0000 7efe62600640 1 -- 172.21.15.32:0/4260976238 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5c145130 con 0x7efe5c06d6c0 2024-03-19T06:23:42.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.431+0000 7efe62600640 1 -- 172.21.15.32:0/4260976238 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5c1456f0 con 0x7efe5c06d6c0 2024-03-19T06:23:42.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.431+0000 7efe62600640 1 -- 172.21.15.32:0/4260976238 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5c0749e0 con 0x7efe5c06d6c0 2024-03-19T06:23:42.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.431+0000 7efe53e00640 1 -- 172.21.15.32:0/4260976238 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7efe4c01a070 con 0x7efe5c06d6c0 2024-03-19T06:23:42.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.431+0000 7efe53e00640 1 --2- 172.21.15.32:0/4260976238 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efe38067660 0x7efe38069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.431+0000 7efe53e00640 1 -- 172.21.15.32:0/4260976238 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe4c085550 con 0x7efe5c06d6c0 2024-03-19T06:23:42.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.431+0000 7efe52a00640 1 --2- 172.21.15.32:0/4260976238 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efe38067660 0x7efe38069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.435+0000 7efe52a00640 1 --2- 172.21.15.32:0/4260976238 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efe38067660 0x7efe38069b20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7efe44007fd0 tx=0x7efe44009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:42.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.435+0000 7efe53e00640 1 -- 172.21.15.32:0/4260976238 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7efe4c056130 con 0x7efe5c06d6c0 2024-03-19T06:23:42.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.611+0000 7efe62600640 1 -- 172.21.15.32:0/4260976238 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efe5c0cc350 con 0x7efe5c06d6c0 2024-03-19T06:23:42.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.611+0000 7efe53e00640 1 -- 172.21.15.32:0/4260976238 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) v1 ==== 80+0+0 (secure 0 0 0) 0x7efe4c055a30 con 0x7efe5c06d6c0 2024-03-19T06:23:42.598 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.611+0000 7efe62600640 1 -- 172.21.15.32:0/4260976238 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efe38067660 msgr2=0x7efe38069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.611+0000 7efe62600640 1 --2- 172.21.15.32:0/4260976238 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efe38067660 0x7efe38069b20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7efe44007fd0 tx=0x7efe44009040 comp rx=0 tx=0).stop 2024-03-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.611+0000 7efe62600640 1 -- 172.21.15.32:0/4260976238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe5c06d6c0 msgr2=0x7efe5c143190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.611+0000 7efe62600640 1 --2- 172.21.15.32:0/4260976238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe5c06d6c0 0x7efe5c143190 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00e810 tx=0x7efe4c00ecd0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.611+0000 7efe62600640 1 -- 172.21.15.32:0/4260976238 shutdown_connections 2024-03-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.611+0000 7efe62600640 1 --2- 172.21.15.32:0/4260976238 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efe38067660 0x7efe38069b20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.611+0000 7efe62600640 1 --2- 172.21.15.32:0/4260976238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe5c15c010 0x7efe5c144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.611+0000 7efe62600640 1 --2- 172.21.15.32:0/4260976238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe5c0aecf0 0x7efe5c146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.611+0000 7efe62600640 1 --2- 172.21.15.32:0/4260976238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe5c06d6c0 0x7efe5c143190 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.611+0000 7efe62600640 1 -- 172.21.15.32:0/4260976238 >> 172.21.15.32:0/4260976238 conn(0x7efe5c0b1280 msgr2=0x7efe5c15e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.611+0000 7efe62600640 1 -- 172.21.15.32:0/4260976238 shutdown_connections 2024-03-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.611+0000 7efe62600640 1 -- 172.21.15.32:0/4260976238 wait complete. 2024-03-19T06:23:42.621 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:23:42.621 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:23:42.630 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:23:42.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5dbe00640 1 Processor -- start 2024-03-19T06:23:42.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5dbe00640 1 -- start start 2024-03-19T06:23:42.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5dbe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe5dc0cd5f0 0x7fe5dc06f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5dbe00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5dc06e2e0 con 0x7fe5dc15de70 2024-03-19T06:23:42.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5dbe00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5dc06e5c0 con 0x7fe5dc0ca680 2024-03-19T06:23:42.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5dbe00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5dc06e8a0 con 0x7fe5dc0cd5f0 2024-03-19T06:23:42.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5daa00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe5dc15de70 0x7fe5dc0caf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33260/0 (socket says 172.21.15.32:33260) 2024-03-19T06:23:42.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5daa00640 1 -- 172.21.15.32:0/1769889426 learned_addr learned my addr 172.21.15.32:0/1769889426 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:42.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5db400640 1 --2- 172.21.15.32:0/1769889426 >> v2:172.21.15.171:3300/0 conn(0x7fe5dc0cd5f0 0x7fe5dc06f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5d9600640 1 -- 172.21.15.32:0/1769889426 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719155234 0 0) 0x7fe5dc06e2e0 con 0x7fe5dc15de70 2024-03-19T06:23:42.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5d9600640 1 -- 172.21.15.32:0/1769889426 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5c0003530 con 0x7fe5dc15de70 2024-03-19T06:23:42.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5d9600640 1 -- 172.21.15.32:0/1769889426 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1700524541 0 0) 0x7fe5c0003530 con 0x7fe5dc15de70 2024-03-19T06:23:42.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5d9600640 1 -- 172.21.15.32:0/1769889426 >> v2:172.21.15.171:3300/0 conn(0x7fe5dc0cd5f0 msgr2=0x7fe5dc06f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:42.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5d9600640 1 --2- 172.21.15.32:0/1769889426 >> v2:172.21.15.171:3300/0 conn(0x7fe5dc0cd5f0 0x7fe5dc06f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5d9600640 1 -- 172.21.15.32:0/1769889426 >> v1:172.21.15.171:6789/0 conn(0x7fe5dc0ca680 legacy=0x7fe5dc0ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5d9600640 1 -- 172.21.15.32:0/1769889426 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc06eb80 con 0x7fe5dc15de70 2024-03-19T06:23:42.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5d9600640 1 -- 172.21.15.32:0/1769889426 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7fe5cc001680 con 0x7fe5dc15de70 2024-03-19T06:23:42.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5d9600640 1 -- 172.21.15.32:0/1769889426 >> v1:172.21.15.32:6789/0 conn(0x7fe5dc15de70 legacy=0x7fe5dc0caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5d9600640 1 --2- 172.21.15.32:0/1769889426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5c0003a10 0x7fe5c0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5d9600640 1 --2- 172.21.15.32:0/1769889426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5c0004810 0x7fe5c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5d9600640 1 --2- 172.21.15.32:0/1769889426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c0005220 0x7fe5c000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5d9600640 1 -- 172.21.15.32:0/1769889426 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc06e8a0 con 0x7fe5c0004810 2024-03-19T06:23:42.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5d9600640 1 -- 172.21.15.32:0/1769889426 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c000c170 con 0x7fe5c0005220 2024-03-19T06:23:42.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5d9600640 1 -- 172.21.15.32:0/1769889426 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c000c370 con 0x7fe5c0003a10 2024-03-19T06:23:42.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5da000640 1 --2- 172.21.15.32:0/1769889426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5c0004810 0x7fe5c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5db400640 1 --2- 172.21.15.32:0/1769889426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c0005220 0x7fe5c000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5daa00640 1 --2- 172.21.15.32:0/1769889426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5c0003a10 0x7fe5c0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5da000640 1 -- 172.21.15.32:0/1769889426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5c0003a10 msgr2=0x7fe5c0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:42.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5da000640 1 --2- 172.21.15.32:0/1769889426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5c0003a10 0x7fe5c0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5da000640 1 -- 172.21.15.32:0/1769889426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c0005220 msgr2=0x7fe5c000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:42.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5da000640 1 --2- 172.21.15.32:0/1769889426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c0005220 0x7fe5c000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5da000640 1 -- 172.21.15.32:0/1769889426 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c0003530 con 0x7fe5c0004810 2024-03-19T06:23:42.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.827+0000 7fe5db400640 1 -- 172.21.15.32:0/1769889426 reap_dead start 2024-03-19T06:23:42.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.831+0000 7fe5da000640 1 --2- 172.21.15.32:0/1769889426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5c0004810 0x7fe5c0004c90 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8001750 tx=0x7fe5c801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4316348b414f9c97 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:42.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.831+0000 7fe5d9600640 1 -- 172.21.15.32:0/1769889426 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80013a0 con 0x7fe5c0004810 2024-03-19T06:23:42.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.831+0000 7fe5d9600640 1 -- 172.21.15.32:0/1769889426 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c80052f0 con 0x7fe5c0004810 2024-03-19T06:23:42.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.831+0000 7fe5d9600640 1 -- 172.21.15.32:0/1769889426 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8003840 con 0x7fe5c0004810 2024-03-19T06:23:42.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.831+0000 7fe5dbe00640 1 -- 172.21.15.32:0/1769889426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5c0004810 msgr2=0x7fe5c0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.831+0000 7fe5dbe00640 1 --2- 172.21.15.32:0/1769889426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5c0004810 0x7fe5c0004c90 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8001750 tx=0x7fe5c801c3c0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.831+0000 7fe5dbe00640 1 -- 172.21.15.32:0/1769889426 shutdown_connections 2024-03-19T06:23:42.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.831+0000 7fe5dbe00640 1 --2- 172.21.15.32:0/1769889426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5c0004810 0x7fe5c0004c90 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.831+0000 7fe5dbe00640 1 -- 172.21.15.32:0/1769889426 >> 172.21.15.32:0/1769889426 conn(0x7fe5dc0d04f0 msgr2=0x7fe5dc0d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:42.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.831+0000 7fe5dbe00640 1 -- 172.21.15.32:0/1769889426 shutdown_connections 2024-03-19T06:23:42.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.831+0000 7fe5dbe00640 1 -- 172.21.15.32:0/1769889426 wait complete. 2024-03-19T06:23:42.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5dbe00640 1 Processor -- start 2024-03-19T06:23:42.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5dbe00640 1 -- start start 2024-03-19T06:23:42.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5dbe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c0004810 0x7fe5dc1f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5dbe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5dc0c75c0 0x7fe5dc1f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5dbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5dc0c9800 0x7fe5dc0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5dbe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc0ccee0 con 0x7fe5dc0c9800 2024-03-19T06:23:42.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5dbe00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc15e460 con 0x7fe5c0004810 2024-03-19T06:23:42.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5dbe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc0cd060 con 0x7fe5dc0c75c0 2024-03-19T06:23:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5db400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5dc0c9800 0x7fe5dc0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5db400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5dc0c9800 0x7fe5dc0c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39620/0 (socket says 172.21.15.32:39620) 2024-03-19T06:23:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5db400640 1 -- 172.21.15.32:0/2586184092 learned_addr learned my addr 172.21.15.32:0/2586184092 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5daa00640 1 --2- 172.21.15.32:0/2586184092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c0004810 0x7fe5dc1f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5da000640 1 --2- 172.21.15.32:0/2586184092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5dc0c75c0 0x7fe5dc1f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5db400640 1 -- 172.21.15.32:0/2586184092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5dc0c75c0 msgr2=0x7fe5dc1f3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5db400640 1 --2- 172.21.15.32:0/2586184092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5dc0c75c0 0x7fe5dc1f3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5db400640 1 -- 172.21.15.32:0/2586184092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c0004810 msgr2=0x7fe5dc1f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5db400640 1 --2- 172.21.15.32:0/2586184092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c0004810 0x7fe5dc1f50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5db400640 1 -- 172.21.15.32:0/2586184092 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc1f7de0 con 0x7fe5dc0c9800 2024-03-19T06:23:42.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5db400640 1 --2- 172.21.15.32:0/2586184092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5dc0c9800 0x7fe5dc0c9c80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc0aff20 tx=0x7fe5d400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:42.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5d3400640 1 -- 172.21.15.32:0/2586184092 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4019070 con 0x7fe5dc0c9800 2024-03-19T06:23:42.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5d3400640 1 -- 172.21.15.32:0/2586184092 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d4011e90 con 0x7fe5dc0c9800 2024-03-19T06:23:42.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5d3400640 1 -- 172.21.15.32:0/2586184092 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4003be0 con 0x7fe5dc0c9800 2024-03-19T06:23:42.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5dbe00640 1 -- 172.21.15.32:0/2586184092 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5dc1f80c0 con 0x7fe5dc0c9800 2024-03-19T06:23:42.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.835+0000 7fe5dbe00640 1 -- 172.21.15.32:0/2586184092 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5dc1f8680 con 0x7fe5dc0c9800 2024-03-19T06:23:42.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.839+0000 7fe5dbe00640 1 -- 172.21.15.32:0/2586184092 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5dc075090 con 0x7fe5dc0c9800 2024-03-19T06:23:42.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.839+0000 7fe5d3400640 1 -- 172.21.15.32:0/2586184092 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe5d401c070 con 0x7fe5dc0c9800 2024-03-19T06:23:42.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.839+0000 7fe5d3400640 1 --2- 172.21.15.32:0/2586184092 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5bc067690 0x7fe5bc069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:42.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.839+0000 7fe5d3400640 1 -- 172.21.15.32:0/2586184092 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5d4086340 con 0x7fe5dc0c9800 2024-03-19T06:23:42.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.839+0000 7fe5daa00640 1 --2- 172.21.15.32:0/2586184092 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5bc067690 0x7fe5bc069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:42.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.839+0000 7fe5daa00640 1 --2- 172.21.15.32:0/2586184092 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5bc067690 0x7fe5bc069b50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc000c10 tx=0x7fe5cc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:42.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:42.843+0000 7fe5d3400640 1 -- 172.21.15.32:0/2586184092 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fe5d4010040 con 0x7fe5dc0c9800 2024-03-19T06:23:42.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.007+0000 7fe5dbe00640 1 -- 172.21.15.32:0/2586184092 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5dc0ce510 con 0x7fe5dc0c9800 2024-03-19T06:23:42.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.011+0000 7fe5d3400640 1 -- 172.21.15.32:0/2586184092 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16681 (secure 0 0 0) 0x7fe5d4056fb0 con 0x7fe5dc0c9800 2024-03-19T06:23:42.998 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:42.998 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":51,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:23:23.544172+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:23:19.707249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-19T06:23:20.926932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:23:43.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.011+0000 7fe5dbe00640 1 -- 172.21.15.32:0/2586184092 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5bc067690 msgr2=0x7fe5bc069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.011+0000 7fe5dbe00640 1 --2- 172.21.15.32:0/2586184092 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5bc067690 0x7fe5bc069b50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc000c10 tx=0x7fe5cc009040 comp rx=0 tx=0).stop 2024-03-19T06:23:43.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.011+0000 7fe5dbe00640 1 -- 172.21.15.32:0/2586184092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5dc0c9800 msgr2=0x7fe5dc0c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.011+0000 7fe5dbe00640 1 --2- 172.21.15.32:0/2586184092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5dc0c9800 0x7fe5dc0c9c80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc0aff20 tx=0x7fe5d400f580 comp rx=0 tx=0).stop 2024-03-19T06:23:43.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.011+0000 7fe5dbe00640 1 -- 172.21.15.32:0/2586184092 shutdown_connections 2024-03-19T06:23:43.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.011+0000 7fe5dbe00640 1 --2- 172.21.15.32:0/2586184092 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe5bc067690 0x7fe5bc069b50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.011+0000 7fe5dbe00640 1 --2- 172.21.15.32:0/2586184092 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe5dc0c9800 0x7fe5dc0c9c80 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.011+0000 7fe5dbe00640 1 --2- 172.21.15.32:0/2586184092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5dc0c75c0 0x7fe5dc1f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.011+0000 7fe5dbe00640 1 --2- 172.21.15.32:0/2586184092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5c0004810 0x7fe5dc1f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.011+0000 7fe5dbe00640 1 -- 172.21.15.32:0/2586184092 >> 172.21.15.32:0/2586184092 conn(0x7fe5dc0d04f0 msgr2=0x7fe5dc0b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:43.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.011+0000 7fe5dbe00640 1 -- 172.21.15.32:0/2586184092 shutdown_connections 2024-03-19T06:23:43.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.011+0000 7fe5dbe00640 1 -- 172.21.15.32:0/2586184092 wait complete. 2024-03-19T06:23:43.020 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:23:19.707249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:23:20.926932+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:23:43.020 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:23:43.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.175+0000 7f8595600640 1 Processor -- start 2024-03-19T06:23:43.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.175+0000 7f8595600640 1 -- start start 2024-03-19T06:23:43.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.179+0000 7f8595600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8590146700 0x7f85900b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:43.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.179+0000 7f8595600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85900b2dd0 con 0x7f859006b450 2024-03-19T06:23:43.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.179+0000 7f8595600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85900b30a0 con 0x7f8590146ae0 2024-03-19T06:23:43.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.179+0000 7f8595600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85900b3380 con 0x7f8590146700 2024-03-19T06:23:43.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.179+0000 7f858f400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f859006b450 0x7f859006d990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33270/0 (socket says 172.21.15.32:33270) 2024-03-19T06:23:43.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.179+0000 7f858f400640 1 -- 172.21.15.32:0/3868178500 learned_addr learned my addr 172.21.15.32:0/3868178500 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:43.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.179+0000 7f858ea00640 1 --2- 172.21.15.32:0/3868178500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8590146700 0x7f85900b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:43.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.179+0000 7f858e000640 1 -- 172.21.15.32:0/3868178500 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009798022 0 0) 0x7f85900b2dd0 con 0x7f859006b450 2024-03-19T06:23:43.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.179+0000 7f858ea00640 1 -- 172.21.15.32:0/3868178500 >> v1:172.21.15.171:6789/0 conn(0x7f8590146ae0 legacy=0x7f859006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.179+0000 7f858ea00640 1 -- 172.21.15.32:0/3868178500 >> v1:172.21.15.32:6789/0 conn(0x7f859006b450 legacy=0x7f859006d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.179+0000 7f858ea00640 1 -- 172.21.15.32:0/3868178500 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85900b3660 con 0x7f8590146700 2024-03-19T06:23:43.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f858ea00640 1 --2- 172.21.15.32:0/3868178500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8590146700 0x7f85900b2890 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8580009770 tx=0x7f858001c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9ccf64b174a5e74 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:43.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f858e000640 1 -- 172.21.15.32:0/3868178500 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85800b0070 con 0x7f8590146700 2024-03-19T06:23:43.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f858e000640 1 -- 172.21.15.32:0/3868178500 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85800ab600 con 0x7f8590146700 2024-03-19T06:23:43.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f858e000640 1 -- 172.21.15.32:0/3868178500 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85800ab9d0 con 0x7f8590146700 2024-03-19T06:23:43.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f8595600640 1 -- 172.21.15.32:0/3868178500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8590146700 msgr2=0x7f85900b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f8595600640 1 --2- 172.21.15.32:0/3868178500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8590146700 0x7f85900b2890 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8580009770 tx=0x7f858001c310 comp rx=0 tx=0).stop 2024-03-19T06:23:43.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f8595600640 1 -- 172.21.15.32:0/3868178500 shutdown_connections 2024-03-19T06:23:43.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f8595600640 1 --2- 172.21.15.32:0/3868178500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8590146700 0x7f85900b2890 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f8595600640 1 -- 172.21.15.32:0/3868178500 >> 172.21.15.32:0/3868178500 conn(0x7f85900b1590 msgr2=0x7f85900b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:43.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f8595600640 1 -- 172.21.15.32:0/3868178500 shutdown_connections 2024-03-19T06:23:43.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f8595600640 1 -- 172.21.15.32:0/3868178500 wait complete. 2024-03-19T06:23:43.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f8595600640 1 Processor -- start 2024-03-19T06:23:43.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f8595600640 1 -- start start 2024-03-19T06:23:43.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f8595600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f859006b450 0x7f85901f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:43.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f8595600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8590146700 0x7f8590142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:43.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f8595600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8590146ae0 0x7f859006e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:43.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f8595600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8590072200 con 0x7f859006b450 2024-03-19T06:23:43.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f8595600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85900b3c20 con 0x7f8590146ae0 2024-03-19T06:23:43.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.183+0000 7f8595600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8590072380 con 0x7f8590146700 2024-03-19T06:23:43.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f858ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f859006b450 0x7f85901f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:43.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f858ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f859006b450 0x7f85901f2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39634/0 (socket says 172.21.15.32:39634) 2024-03-19T06:23:43.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f858ea00640 1 -- 172.21.15.32:0/3721882234 learned_addr learned my addr 172.21.15.32:0/3721882234 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:43.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f858ea00640 1 -- 172.21.15.32:0/3721882234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8590146700 msgr2=0x7f8590142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f858ea00640 1 --2- 172.21.15.32:0/3721882234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8590146700 0x7f8590142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f858ea00640 1 -- 172.21.15.32:0/3721882234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8590146ae0 msgr2=0x7f859006e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f858ea00640 1 --2- 172.21.15.32:0/3721882234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8590146ae0 0x7f859006e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f858ea00640 1 -- 172.21.15.32:0/3721882234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85901455c0 con 0x7f859006b450 2024-03-19T06:23:43.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f858ea00640 1 --2- 172.21.15.32:0/3721882234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f859006b450 0x7f85901f2f40 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8580019f40 tx=0x7f858001ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:43.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f8587400640 1 -- 172.21.15.32:0/3721882234 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85800b0050 con 0x7f859006b450 2024-03-19T06:23:43.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f8587400640 1 -- 172.21.15.32:0/3721882234 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85800bc070 con 0x7f859006b450 2024-03-19T06:23:43.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f8595600640 1 -- 172.21.15.32:0/3721882234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85901458a0 con 0x7f859006b450 2024-03-19T06:23:43.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f8587400640 1 -- 172.21.15.32:0/3721882234 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85800aae20 con 0x7f859006b450 2024-03-19T06:23:43.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f8595600640 1 -- 172.21.15.32:0/3721882234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8590145e60 con 0x7f859006b450 2024-03-19T06:23:43.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f8595600640 1 -- 172.21.15.32:0/3721882234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85900749e0 con 0x7f859006b450 2024-03-19T06:23:43.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f8587400640 1 -- 172.21.15.32:0/3721882234 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f85800ab4c0 con 0x7f859006b450 2024-03-19T06:23:43.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f8587400640 1 --2- 172.21.15.32:0/3721882234 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f856c067690 0x7f856c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:43.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.187+0000 7f8587400640 1 -- 172.21.15.32:0/3721882234 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f858011fff0 con 0x7f859006b450 2024-03-19T06:23:43.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.191+0000 7f8586000640 1 --2- 172.21.15.32:0/3721882234 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f856c067690 0x7f856c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:43.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.191+0000 7f8586000640 1 --2- 172.21.15.32:0/3721882234 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f856c067690 0x7f856c069b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f85901f69e0 tx=0x7f8578001ca0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:43.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.191+0000 7f8587400640 1 -- 172.21.15.32:0/3721882234 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f85800c5020 con 0x7f859006b450 2024-03-19T06:23:43.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.359+0000 7f8595600640 1 -- 172.21.15.32:0/3721882234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85900b1aa0 con 0x7f859006b450 2024-03-19T06:23:43.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.359+0000 7f8587400640 1 -- 172.21.15.32:0/3721882234 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8580015f90 con 0x7f859006b450 2024-03-19T06:23:43.349 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:23:43.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.363+0000 7f8595600640 1 -- 172.21.15.32:0/3721882234 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f856c067690 msgr2=0x7f856c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.363+0000 7f8595600640 1 --2- 172.21.15.32:0/3721882234 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f856c067690 0x7f856c069b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f85901f69e0 tx=0x7f8578001ca0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.363+0000 7f8595600640 1 -- 172.21.15.32:0/3721882234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f859006b450 msgr2=0x7f85901f2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.363+0000 7f8595600640 1 --2- 172.21.15.32:0/3721882234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f859006b450 0x7f85901f2f40 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8580019f40 tx=0x7f858001ab50 comp rx=0 tx=0).stop 2024-03-19T06:23:43.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.363+0000 7f8595600640 1 -- 172.21.15.32:0/3721882234 shutdown_connections 2024-03-19T06:23:43.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.363+0000 7f8595600640 1 --2- 172.21.15.32:0/3721882234 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f856c067690 0x7f856c069b50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.363+0000 7f8595600640 1 --2- 172.21.15.32:0/3721882234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8590146ae0 0x7f859006e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.363+0000 7f8595600640 1 --2- 172.21.15.32:0/3721882234 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8590146700 0x7f8590142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.363+0000 7f8595600640 1 --2- 172.21.15.32:0/3721882234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f859006b450 0x7f85901f2f40 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.363+0000 7f8595600640 1 -- 172.21.15.32:0/3721882234 >> 172.21.15.32:0/3721882234 conn(0x7f85900b1590 msgr2=0x7f859006d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:43.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.363+0000 7f8595600640 1 -- 172.21.15.32:0/3721882234 shutdown_connections 2024-03-19T06:23:43.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.363+0000 7f8595600640 1 -- 172.21.15.32:0/3721882234 wait complete. 2024-03-19T06:23:43.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:23:43.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.527+0000 7f6c28400640 1 Processor -- start 2024-03-19T06:23:43.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.527+0000 7f6c28400640 1 -- start start 2024-03-19T06:23:43.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.527+0000 7f6c28400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2006b450 0x7f6c2006f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:43.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.527+0000 7f6c28400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6c200aea70 0x7f6c200ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:43.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.527+0000 7f6c28400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c200af2d0 con 0x7f6c2015a840 2024-03-19T06:23:43.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.527+0000 7f6c28400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c200cdc20 con 0x7f6c200aea70 2024-03-19T06:23:43.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.527+0000 7f6c28400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2015eea0 con 0x7f6c2006b450 2024-03-19T06:23:43.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.527+0000 7f6c26400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6c200aea70 0x7f6c200ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:43.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.527+0000 7f6c26400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6c200aea70 0x7f6c200ce0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39636/0 (socket says 172.21.15.32:39636) 2024-03-19T06:23:43.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.527+0000 7f6c26400640 1 -- 172.21.15.32:0/3385419224 learned_addr learned my addr 172.21.15.32:0/3385419224 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:43.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.527+0000 7f6c25000640 1 --2- 172.21.15.32:0/3385419224 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2006b450 0x7f6c2006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:43.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.527+0000 7f6c26400640 1 -- 172.21.15.32:0/3385419224 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2006b450 msgr2=0x7f6c2006f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:43.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.527+0000 7f6c26400640 1 --2- 172.21.15.32:0/3385419224 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2006b450 0x7f6c2006f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.527+0000 7f6c26400640 1 -- 172.21.15.32:0/3385419224 >> v1:172.21.15.171:6789/0 conn(0x7f6c2015a840 legacy=0x7f6c2006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.527+0000 7f6c26400640 1 -- 172.21.15.32:0/3385419224 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2015f180 con 0x7f6c200aea70 2024-03-19T06:23:43.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.531+0000 7f6c26400640 1 --2- 172.21.15.32:0/3385419224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c200aea70 0x7f6c200ce0b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009e50 tx=0x7f6c1801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18bad8ecc331ba5 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:43.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.531+0000 7f6c1fe00640 1 -- 172.21.15.32:0/3385419224 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c180a57f0 con 0x7f6c200aea70 2024-03-19T06:23:43.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.531+0000 7f6c1fe00640 1 -- 172.21.15.32:0/3385419224 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c180a5990 con 0x7f6c200aea70 2024-03-19T06:23:43.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.531+0000 7f6c1fe00640 1 -- 172.21.15.32:0/3385419224 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c180a5d60 con 0x7f6c200aea70 2024-03-19T06:23:43.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.531+0000 7f6c28400640 1 -- 172.21.15.32:0/3385419224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c200aea70 msgr2=0x7f6c200ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.531+0000 7f6c28400640 1 --2- 172.21.15.32:0/3385419224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c200aea70 0x7f6c200ce0b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009e50 tx=0x7f6c1801c8d0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.531+0000 7f6c28400640 1 -- 172.21.15.32:0/3385419224 shutdown_connections 2024-03-19T06:23:43.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.531+0000 7f6c28400640 1 --2- 172.21.15.32:0/3385419224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c200aea70 0x7f6c200ce0b0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.531+0000 7f6c28400640 1 --2- 172.21.15.32:0/3385419224 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2006b450 0x7f6c2006f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.531+0000 7f6c28400640 1 -- 172.21.15.32:0/3385419224 >> 172.21.15.32:0/3385419224 conn(0x7f6c200b1590 msgr2=0x7f6c200b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:43.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.531+0000 7f6c28400640 1 -- 172.21.15.32:0/3385419224 shutdown_connections 2024-03-19T06:23:43.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.531+0000 7f6c28400640 1 -- 172.21.15.32:0/3385419224 wait complete. 2024-03-19T06:23:43.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c28400640 1 Processor -- start 2024-03-19T06:23:43.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c28400640 1 -- start start 2024-03-19T06:23:43.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c28400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c2006b450 0x7f6c200acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:43.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c28400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c200aea70 0x7f6c201574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:43.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c28400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2015a840 0x7f6c20144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:43.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c28400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200cef80 con 0x7f6c2006b450 2024-03-19T06:23:43.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c28400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200cee00 con 0x7f6c200aea70 2024-03-19T06:23:43.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c28400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200cf100 con 0x7f6c2015a840 2024-03-19T06:23:43.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c25a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c2006b450 0x7f6c200acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:43.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c25a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c2006b450 0x7f6c200acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39642/0 (socket says 172.21.15.32:39642) 2024-03-19T06:23:43.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c25a00640 1 -- 172.21.15.32:0/438346126 learned_addr learned my addr 172.21.15.32:0/438346126 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:43.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c25000640 1 --2- 172.21.15.32:0/438346126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c200aea70 0x7f6c201574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:43.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c26400640 1 --2- 172.21.15.32:0/438346126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2015a840 0x7f6c20144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:43.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c25a00640 1 -- 172.21.15.32:0/438346126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2015a840 msgr2=0x7f6c20144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c25a00640 1 --2- 172.21.15.32:0/438346126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2015a840 0x7f6c20144ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c25a00640 1 -- 172.21.15.32:0/438346126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c200aea70 msgr2=0x7f6c201574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c25a00640 1 --2- 172.21.15.32:0/438346126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c200aea70 0x7f6c201574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c25a00640 1 -- 172.21.15.32:0/438346126 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c20157f80 con 0x7f6c2006b450 2024-03-19T06:23:43.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c25a00640 1 --2- 172.21.15.32:0/438346126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c2006b450 0x7f6c200acb40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c370 tx=0x7f6c1400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:43.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c1d600640 1 -- 172.21.15.32:0/438346126 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c140052d0 con 0x7f6c2006b450 2024-03-19T06:23:43.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c1d600640 1 -- 172.21.15.32:0/438346126 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c14005470 con 0x7f6c2006b450 2024-03-19T06:23:43.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c1d600640 1 -- 172.21.15.32:0/438346126 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14007260 con 0x7f6c2006b450 2024-03-19T06:23:43.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c28400640 1 -- 172.21.15.32:0/438346126 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c2015c2d0 con 0x7f6c2006b450 2024-03-19T06:23:43.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c28400640 1 -- 172.21.15.32:0/438346126 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2015c890 con 0x7f6c2006b450 2024-03-19T06:23:43.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.535+0000 7f6c28400640 1 -- 172.21.15.32:0/438346126 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2015ca90 con 0x7f6c2006b450 2024-03-19T06:23:43.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.539+0000 7f6c1d600640 1 -- 172.21.15.32:0/438346126 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6c14007400 con 0x7f6c2006b450 2024-03-19T06:23:43.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.539+0000 7f6c1d600640 1 --2- 172.21.15.32:0/438346126 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6c000676b0 0x7f6c00069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:43.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.539+0000 7f6c1d600640 1 -- 172.21.15.32:0/438346126 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c14084bf0 con 0x7f6c2006b450 2024-03-19T06:23:43.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.539+0000 7f6c25000640 1 --2- 172.21.15.32:0/438346126 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6c000676b0 0x7f6c00069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:43.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.539+0000 7f6c25000640 1 --2- 172.21.15.32:0/438346126 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6c000676b0 0x7f6c00069b70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6c201f9c20 tx=0x7f6c0c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:43.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.543+0000 7f6c1d600640 1 -- 172.21.15.32:0/438346126 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f6c2015ca90 con 0x7f6c2006b450 2024-03-19T06:23:43.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.707+0000 7f6c28400640 1 -- 172.21.15.32:0/438346126 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c200749e0 con 0x7f6c2006b450 2024-03-19T06:23:43.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.707+0000 7f6c1d600640 1 -- 172.21.15.32:0/438346126 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c14055290 con 0x7f6c2006b450 2024-03-19T06:23:43.695 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:23:43.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.707+0000 7f6c28400640 1 -- 172.21.15.32:0/438346126 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6c000676b0 msgr2=0x7f6c00069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.707+0000 7f6c28400640 1 --2- 172.21.15.32:0/438346126 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6c000676b0 0x7f6c00069b70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6c201f9c20 tx=0x7f6c0c008040 comp rx=0 tx=0).stop 2024-03-19T06:23:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.707+0000 7f6c28400640 1 -- 172.21.15.32:0/438346126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c2006b450 msgr2=0x7f6c200acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.707+0000 7f6c28400640 1 --2- 172.21.15.32:0/438346126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c2006b450 0x7f6c200acb40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c370 tx=0x7f6c1400c830 comp rx=0 tx=0).stop 2024-03-19T06:23:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.707+0000 7f6c28400640 1 -- 172.21.15.32:0/438346126 shutdown_connections 2024-03-19T06:23:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.707+0000 7f6c28400640 1 --2- 172.21.15.32:0/438346126 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6c000676b0 0x7f6c00069b70 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.707+0000 7f6c28400640 1 --2- 172.21.15.32:0/438346126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2015a840 0x7f6c20144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.707+0000 7f6c28400640 1 --2- 172.21.15.32:0/438346126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c200aea70 0x7f6c201574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.707+0000 7f6c28400640 1 --2- 172.21.15.32:0/438346126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c2006b450 0x7f6c200acb40 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.707+0000 7f6c28400640 1 -- 172.21.15.32:0/438346126 >> 172.21.15.32:0/438346126 conn(0x7f6c200b1590 msgr2=0x7f6c200af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.707+0000 7f6c28400640 1 -- 172.21.15.32:0/438346126 shutdown_connections 2024-03-19T06:23:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.707+0000 7f6c28400640 1 -- 172.21.15.32:0/438346126 wait complete. 2024-03-19T06:23:43.716 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:23:43.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.871+0000 7f9ac1600640 1 Processor -- start 2024-03-19T06:23:43.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.871+0000 7f9ac1600640 1 -- start start 2024-03-19T06:23:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.871+0000 7f9ac1600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9abc15ba00 0x7f9abc0b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.871+0000 7f9ac1600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9abc0d14b0 con 0x7f9abc0b3de0 2024-03-19T06:23:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.871+0000 7f9ac1600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9abc0d1790 con 0x7f9abc0b7530 2024-03-19T06:23:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.871+0000 7f9ac1600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9abc0d20c0 con 0x7f9abc15ba00 2024-03-19T06:23:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.871+0000 7f9abaa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9abc15ba00 0x7f9abc0b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:43.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.871+0000 7f9abaa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9abc15ba00 0x7f9abc0b6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54792/0 (socket says 172.21.15.32:54792) 2024-03-19T06:23:43.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.871+0000 7f9abaa00640 1 -- 172.21.15.32:0/2758103046 learned_addr learned my addr 172.21.15.32:0/2758103046 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:43.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.871+0000 7f9abb400640 1 --1- 172.21.15.32:0/2758103046 >> v1:172.21.15.32:6789/0 conn(0x7f9abc0b3de0 0x7f9abc0cf8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33554/0 (socket says 172.21.15.32:33554) 2024-03-19T06:23:43.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.871+0000 7f9abaa00640 1 -- 172.21.15.32:0/2758103046 >> v1:172.21.15.171:6789/0 conn(0x7f9abc0b7530 legacy=0x7f9abc0b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.871+0000 7f9abaa00640 1 -- 172.21.15.32:0/2758103046 >> v1:172.21.15.32:6789/0 conn(0x7f9abc0b3de0 legacy=0x7f9abc0cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.871+0000 7f9abaa00640 1 -- 172.21.15.32:0/2758103046 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc0d1a70 con 0x7f9abc15ba00 2024-03-19T06:23:43.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.875+0000 7f9abaa00640 1 --2- 172.21.15.32:0/2758103046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9abc15ba00 0x7f9abc0b6ff0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009870 tx=0x7f9aac01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b55dfb73853832 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:43.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.875+0000 7f9aba000640 1 -- 172.21.15.32:0/2758103046 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac0b5070 con 0x7f9abc15ba00 2024-03-19T06:23:43.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.875+0000 7f9aba000640 1 -- 172.21.15.32:0/2758103046 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac0a8a50 con 0x7f9abc15ba00 2024-03-19T06:23:43.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.875+0000 7f9aba000640 1 -- 172.21.15.32:0/2758103046 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac0a8e20 con 0x7f9abc15ba00 2024-03-19T06:23:43.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.875+0000 7f9ac1600640 1 -- 172.21.15.32:0/2758103046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9abc15ba00 msgr2=0x7f9abc0b6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.875+0000 7f9ac1600640 1 --2- 172.21.15.32:0/2758103046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9abc15ba00 0x7f9abc0b6ff0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009870 tx=0x7f9aac01ed50 comp rx=0 tx=0).stop 2024-03-19T06:23:43.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.875+0000 7f9ac1600640 1 -- 172.21.15.32:0/2758103046 shutdown_connections 2024-03-19T06:23:43.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.875+0000 7f9ac1600640 1 --2- 172.21.15.32:0/2758103046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9abc15ba00 0x7f9abc0b6ff0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.875+0000 7f9ac1600640 1 -- 172.21.15.32:0/2758103046 >> 172.21.15.32:0/2758103046 conn(0x7f9abc066ca0 msgr2=0x7f9abc0670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:43.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.875+0000 7f9ac1600640 1 -- 172.21.15.32:0/2758103046 shutdown_connections 2024-03-19T06:23:43.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.875+0000 7f9ac1600640 1 -- 172.21.15.32:0/2758103046 wait complete. 2024-03-19T06:23:43.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ac1600640 1 Processor -- start 2024-03-19T06:23:43.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ac1600640 1 -- start start 2024-03-19T06:23:43.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ac1600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9abc0b3de0 0x7f9abc15e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:43.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ac1600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9abc0b7530 0x7f9abc156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:43.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ac1600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9abc15ba00 0x7f9abc1f7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:43.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ac1600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc15bf60 con 0x7f9abc0b7530 2024-03-19T06:23:43.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ac1600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc15bde0 con 0x7f9abc15ba00 2024-03-19T06:23:43.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ac1600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc0d10f0 con 0x7f9abc0b3de0 2024-03-19T06:23:43.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ab3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9abc0b7530 0x7f9abc156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:43.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ab3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9abc0b7530 0x7f9abc156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54806/0 (socket says 172.21.15.32:54806) 2024-03-19T06:23:43.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ab3e00640 1 -- 172.21.15.32:0/876761754 learned_addr learned my addr 172.21.15.32:0/876761754 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:43.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9abb400640 1 --2- 172.21.15.32:0/876761754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9abc15ba00 0x7f9abc1f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:43.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9abaa00640 1 --2- 172.21.15.32:0/876761754 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9abc0b3de0 0x7f9abc15e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:43.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ab3e00640 1 -- 172.21.15.32:0/876761754 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9abc0b3de0 msgr2=0x7f9abc15e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ab3e00640 1 --2- 172.21.15.32:0/876761754 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9abc0b3de0 0x7f9abc15e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ab3e00640 1 -- 172.21.15.32:0/876761754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9abc15ba00 msgr2=0x7f9abc1f7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:43.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ab3e00640 1 --2- 172.21.15.32:0/876761754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9abc15ba00 0x7f9abc1f7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:43.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ab3e00640 1 -- 172.21.15.32:0/876761754 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc15f020 con 0x7f9abc0b7530 2024-03-19T06:23:43.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ab3e00640 1 --2- 172.21.15.32:0/876761754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9abc0b7530 0x7f9abc156770 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400c420 tx=0x7f9aa400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:43.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ab2a00640 1 -- 172.21.15.32:0/876761754 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40052d0 con 0x7f9abc0b7530 2024-03-19T06:23:43.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ab2a00640 1 -- 172.21.15.32:0/876761754 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa4005470 con 0x7f9abc0b7530 2024-03-19T06:23:43.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ab2a00640 1 -- 172.21.15.32:0/876761754 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4007260 con 0x7f9abc0b7530 2024-03-19T06:23:43.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ac1600640 1 -- 172.21.15.32:0/876761754 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9abc0c72a0 con 0x7f9abc0b7530 2024-03-19T06:23:43.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.879+0000 7f9ac1600640 1 -- 172.21.15.32:0/876761754 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9abc0c7860 con 0x7f9abc0b7530 2024-03-19T06:23:43.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.883+0000 7f9ac1600640 1 -- 172.21.15.32:0/876761754 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9abc0749e0 con 0x7f9abc0b7530 2024-03-19T06:23:43.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.883+0000 7f9ab2a00640 1 -- 172.21.15.32:0/876761754 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9aa4007400 con 0x7f9abc0b7530 2024-03-19T06:23:43.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.883+0000 7f9ab2a00640 1 --2- 172.21.15.32:0/876761754 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9a98067660 0x7f9a98069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:43.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.883+0000 7f9ab2a00640 1 -- 172.21.15.32:0/876761754 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9aa4084c60 con 0x7f9abc0b7530 2024-03-19T06:23:43.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.883+0000 7f9abaa00640 1 --2- 172.21.15.32:0/876761754 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9a98067660 0x7f9a98069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:43.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.883+0000 7f9abaa00640 1 --2- 172.21.15.32:0/876761754 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9a98067660 0x7f9a98069b20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0b2000 tx=0x7f9aac009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:43.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:43.887+0000 7f9ab2a00640 1 -- 172.21.15.32:0/876761754 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f9aa4055320 con 0x7f9abc0b7530 2024-03-19T06:23:44.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.051+0000 7f9ac1600640 1 -- 172.21.15.32:0/876761754 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9abc0c7a30 con 0x7f9abc0b7530 2024-03-19T06:23:44.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.051+0000 7f9ab2a00640 1 -- 172.21.15.32:0/876761754 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9aa40593c0 con 0x7f9abc0b7530 2024-03-19T06:23:44.038 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:23:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.051+0000 7f9ac1600640 1 -- 172.21.15.32:0/876761754 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9a98067660 msgr2=0x7f9a98069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.051+0000 7f9ac1600640 1 --2- 172.21.15.32:0/876761754 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9a98067660 0x7f9a98069b20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0b2000 tx=0x7f9aac009040 comp rx=0 tx=0).stop 2024-03-19T06:23:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.051+0000 7f9ac1600640 1 -- 172.21.15.32:0/876761754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9abc0b7530 msgr2=0x7f9abc156770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.051+0000 7f9ac1600640 1 --2- 172.21.15.32:0/876761754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9abc0b7530 0x7f9abc156770 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400c420 tx=0x7f9aa400c8e0 comp rx=0 tx=0).stop 2024-03-19T06:23:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.051+0000 7f9ac1600640 1 -- 172.21.15.32:0/876761754 shutdown_connections 2024-03-19T06:23:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.051+0000 7f9ac1600640 1 --2- 172.21.15.32:0/876761754 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9a98067660 0x7f9a98069b20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.051+0000 7f9ac1600640 1 --2- 172.21.15.32:0/876761754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9abc15ba00 0x7f9abc1f7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.051+0000 7f9ac1600640 1 --2- 172.21.15.32:0/876761754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9abc0b7530 0x7f9abc156770 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.051+0000 7f9ac1600640 1 --2- 172.21.15.32:0/876761754 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9abc0b3de0 0x7f9abc15e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.051+0000 7f9ac1600640 1 -- 172.21.15.32:0/876761754 >> 172.21.15.32:0/876761754 conn(0x7f9abc066ca0 msgr2=0x7f9abc0cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.051+0000 7f9ac1600640 1 -- 172.21.15.32:0/876761754 shutdown_connections 2024-03-19T06:23:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.051+0000 7f9ac1600640 1 -- 172.21.15.32:0/876761754 wait complete. 2024-03-19T06:23:44.060 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:23:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.215+0000 7fe4f8a00640 1 Processor -- start 2024-03-19T06:23:44.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.215+0000 7fe4f8a00640 1 -- start start 2024-03-19T06:23:44.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.215+0000 7fe4f8a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe4f40c53a0 0x7fe4f415b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:44.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.215+0000 7fe4f8a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f4066b70 con 0x7fe4f40c5dc0 2024-03-19T06:23:44.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.215+0000 7fe4f8a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f4066e50 con 0x7fe4f40c4fc0 2024-03-19T06:23:44.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.215+0000 7fe4f8a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f4067130 con 0x7fe4f40c53a0 2024-03-19T06:23:44.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.215+0000 7fe4ebe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe4f40c53a0 0x7fe4f415b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:44.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.215+0000 7fe4f3e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe4f40c5dc0 0x7fe4f40ca2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33556/0 (socket says 172.21.15.32:33556) 2024-03-19T06:23:44.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.215+0000 7fe4f3e00640 1 -- 172.21.15.32:0/1542699802 learned_addr learned my addr 172.21.15.32:0/1542699802 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:44.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.215+0000 7fe4ebe00640 1 -- 172.21.15.32:0/1542699802 >> v1:172.21.15.171:6789/0 conn(0x7fe4f40c4fc0 legacy=0x7fe4f40cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:44.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.215+0000 7fe4ebe00640 1 -- 172.21.15.32:0/1542699802 >> v1:172.21.15.32:6789/0 conn(0x7fe4f40c5dc0 legacy=0x7fe4f40ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:44.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.215+0000 7fe4ebe00640 1 -- 172.21.15.32:0/1542699802 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f415ad50 con 0x7fe4f40c53a0 2024-03-19T06:23:44.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.215+0000 7fe4f2a00640 1 -- 172.21.15.32:0/1542699802 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716881346 0 0) 0x7fe4f4066b70 con 0x7fe4f40c5dc0 2024-03-19T06:23:44.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.219+0000 7fe4ebe00640 1 --2- 172.21.15.32:0/1542699802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f40c53a0 0x7fe4f415b550 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0097c0 tx=0x7fe4dc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb385259f06fafd7 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:44.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.219+0000 7fe4f2a00640 1 -- 172.21.15.32:0/1542699802 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc0aa5f0 con 0x7fe4f40c53a0 2024-03-19T06:23:44.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.219+0000 7fe4f2a00640 1 -- 172.21.15.32:0/1542699802 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4dc0af070 con 0x7fe4f40c53a0 2024-03-19T06:23:44.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.219+0000 7fe4f2a00640 1 -- 172.21.15.32:0/1542699802 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc0aa9b0 con 0x7fe4f40c53a0 2024-03-19T06:23:44.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.219+0000 7fe4f8a00640 1 -- 172.21.15.32:0/1542699802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f40c53a0 msgr2=0x7fe4f415b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:44.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.219+0000 7fe4f8a00640 1 --2- 172.21.15.32:0/1542699802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f40c53a0 0x7fe4f415b550 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0097c0 tx=0x7fe4dc01c470 comp rx=0 tx=0).stop 2024-03-19T06:23:44.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.219+0000 7fe4f8a00640 1 -- 172.21.15.32:0/1542699802 shutdown_connections 2024-03-19T06:23:44.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.219+0000 7fe4f8a00640 1 --2- 172.21.15.32:0/1542699802 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f40c53a0 0x7fe4f415b550 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:44.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.219+0000 7fe4f8a00640 1 -- 172.21.15.32:0/1542699802 >> 172.21.15.32:0/1542699802 conn(0x7fe4f40cc710 msgr2=0x7fe4f40ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:44.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.219+0000 7fe4f8a00640 1 -- 172.21.15.32:0/1542699802 shutdown_connections 2024-03-19T06:23:44.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.219+0000 7fe4f8a00640 1 -- 172.21.15.32:0/1542699802 wait complete. 2024-03-19T06:23:44.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f8a00640 1 Processor -- start 2024-03-19T06:23:44.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f8a00640 1 -- start start 2024-03-19T06:23:44.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f8a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f40c4fc0 0x7fe4f4143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:44.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f8a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f40c53a0 0x7fe4f40c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:44.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f8a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4f40c5dc0 0x7fe4f4152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:44.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f8a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f40c5990 con 0x7fe4f40c4fc0 2024-03-19T06:23:44.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f8a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f40c5810 con 0x7fe4f40c53a0 2024-03-19T06:23:44.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f8a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f4168aa0 con 0x7fe4f40c5dc0 2024-03-19T06:23:44.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f40c4fc0 0x7fe4f4143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:44.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f3400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f40c4fc0 0x7fe4f4143750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54820/0 (socket says 172.21.15.32:54820) 2024-03-19T06:23:44.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f3400640 1 -- 172.21.15.32:0/348745671 learned_addr learned my addr 172.21.15.32:0/348745671 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:44.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4ebe00640 1 --2- 172.21.15.32:0/348745671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f40c53a0 0x7fe4f40c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:44.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f3e00640 1 --2- 172.21.15.32:0/348745671 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4f40c5dc0 0x7fe4f4152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:44.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f3400640 1 -- 172.21.15.32:0/348745671 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4f40c5dc0 msgr2=0x7fe4f4152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:44.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f3400640 1 --2- 172.21.15.32:0/348745671 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4f40c5dc0 0x7fe4f4152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:44.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f3400640 1 -- 172.21.15.32:0/348745671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f40c53a0 msgr2=0x7fe4f40c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:44.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f3400640 1 --2- 172.21.15.32:0/348745671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f40c53a0 0x7fe4f40c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:44.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f3400640 1 -- 172.21.15.32:0/348745671 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f40c7660 con 0x7fe4f40c4fc0 2024-03-19T06:23:44.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f3400640 1 --2- 172.21.15.32:0/348745671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f40c4fc0 0x7fe4f4143750 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400c500 tx=0x7fe4e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:44.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4eb400640 1 -- 172.21.15.32:0/348745671 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4016020 con 0x7fe4f40c4fc0 2024-03-19T06:23:44.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4eb400640 1 -- 172.21.15.32:0/348745671 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e4005220 con 0x7fe4f40c4fc0 2024-03-19T06:23:44.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4eb400640 1 -- 172.21.15.32:0/348745671 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4007030 con 0x7fe4f40c4fc0 2024-03-19T06:23:44.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f8a00640 1 -- 172.21.15.32:0/348745671 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f40c7940 con 0x7fe4f40c4fc0 2024-03-19T06:23:44.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.223+0000 7fe4f8a00640 1 -- 172.21.15.32:0/348745671 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f40c7f00 con 0x7fe4f40c4fc0 2024-03-19T06:23:44.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.227+0000 7fe4f8a00640 1 -- 172.21.15.32:0/348745671 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f4075090 con 0x7fe4f40c4fc0 2024-03-19T06:23:44.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.227+0000 7fe4eb400640 1 -- 172.21.15.32:0/348745671 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe4e40071f0 con 0x7fe4f40c4fc0 2024-03-19T06:23:44.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.227+0000 7fe4eb400640 1 --2- 172.21.15.32:0/348745671 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe4d0067660 0x7fe4d0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:44.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.227+0000 7fe4eb400640 1 -- 172.21.15.32:0/348745671 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4e4085240 con 0x7fe4f40c4fc0 2024-03-19T06:23:44.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.227+0000 7fe4ebe00640 1 --2- 172.21.15.32:0/348745671 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe4d0067660 0x7fe4d0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:44.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.227+0000 7fe4ebe00640 1 --2- 172.21.15.32:0/348745671 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe4d0067660 0x7fe4d0069b20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0ae000 tx=0x7fe4dc0a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:44.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.231+0000 7fe4eb400640 1 -- 172.21.15.32:0/348745671 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fe4e4020020 con 0x7fe4f40c4fc0 2024-03-19T06:23:44.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.411+0000 7fe4f8a00640 1 -- 172.21.15.32:0/348745671 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe4f406c610 con 0x7fe4f40c4fc0 2024-03-19T06:23:44.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.411+0000 7fe4eb400640 1 -- 172.21.15.32:0/348745671 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe4e4055e30 con 0x7fe4f40c4fc0 2024-03-19T06:23:44.399 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:23:44.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.411+0000 7fe4f8a00640 1 -- 172.21.15.32:0/348745671 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe4d0067660 msgr2=0x7fe4d0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:44.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.411+0000 7fe4f8a00640 1 --2- 172.21.15.32:0/348745671 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe4d0067660 0x7fe4d0069b20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0ae000 tx=0x7fe4dc0a7000 comp rx=0 tx=0).stop 2024-03-19T06:23:44.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.411+0000 7fe4f8a00640 1 -- 172.21.15.32:0/348745671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f40c4fc0 msgr2=0x7fe4f4143750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:44.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.411+0000 7fe4f8a00640 1 --2- 172.21.15.32:0/348745671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f40c4fc0 0x7fe4f4143750 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400c500 tx=0x7fe4e400c9c0 comp rx=0 tx=0).stop 2024-03-19T06:23:44.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.415+0000 7fe4f8a00640 1 -- 172.21.15.32:0/348745671 shutdown_connections 2024-03-19T06:23:44.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.415+0000 7fe4f8a00640 1 --2- 172.21.15.32:0/348745671 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe4d0067660 0x7fe4d0069b20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:44.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.415+0000 7fe4f8a00640 1 --2- 172.21.15.32:0/348745671 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4f40c5dc0 0x7fe4f4152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:44.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.415+0000 7fe4f8a00640 1 --2- 172.21.15.32:0/348745671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f40c53a0 0x7fe4f40c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:44.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.415+0000 7fe4f8a00640 1 --2- 172.21.15.32:0/348745671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f40c4fc0 0x7fe4f4143750 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:44.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.415+0000 7fe4f8a00640 1 -- 172.21.15.32:0/348745671 >> 172.21.15.32:0/348745671 conn(0x7fe4f40cc710 msgr2=0x7fe4f40b58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:44.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.415+0000 7fe4f8a00640 1 -- 172.21.15.32:0/348745671 shutdown_connections 2024-03-19T06:23:44.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:44.415+0000 7fe4f8a00640 1 -- 172.21.15.32:0/348745671 wait complete. 2024-03-19T06:23:44.420 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi032.front.sepia.ceph.com... 2024-03-19T06:23:44.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:44.421 DEBUG:teuthology.orchestra.run.smithi032:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:44.439 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[39580]: fuse finished with error 0 and tester_r 0 2024-03-19T06:23:44.441 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:23:50.544 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:23:50.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:50.544 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-19T06:23:50.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-19T06:23:50.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.751+0000 7fe9f7600640 1 Processor -- start 2024-03-19T06:23:50.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.751+0000 7fe9f7600640 1 -- start start 2024-03-19T06:23:50.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.755+0000 7fe9f7600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9f015a7c0 0x7fe9f00cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:50.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.755+0000 7fe9f7600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe9f00cc680 0x7fe9f015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:50.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.755+0000 7fe9f7600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f00cb670 con 0x7fe9f00b4c50 2024-03-19T06:23:50.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.755+0000 7fe9f7600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f015e860 con 0x7fe9f00cc680 2024-03-19T06:23:50.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.755+0000 7fe9f7600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f00cb950 con 0x7fe9f015a7c0 2024-03-19T06:23:50.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.755+0000 7fe9e7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe9f00cc680 0x7fe9f015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:50.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.755+0000 7fe9e7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe9f00cc680 0x7fe9f015ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54834/0 (socket says 172.21.15.32:54834) 2024-03-19T06:23:50.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.755+0000 7fe9e7e00640 1 -- 172.21.15.32:0/2687505014 learned_addr learned my addr 172.21.15.32:0/2687505014 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:50.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.755+0000 7fe9f4c00640 1 --2- 172.21.15.32:0/2687505014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9f015a7c0 0x7fe9f00cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:50.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.755+0000 7fe9e7e00640 1 -- 172.21.15.32:0/2687505014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9f015a7c0 msgr2=0x7fe9f00cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:50.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.755+0000 7fe9e7e00640 1 --2- 172.21.15.32:0/2687505014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9f015a7c0 0x7fe9f00cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:50.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.755+0000 7fe9e7e00640 1 -- 172.21.15.32:0/2687505014 >> v1:172.21.15.32:6789/0 conn(0x7fe9f00b4c50 legacy=0x7fe9f00cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:50.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.755+0000 7fe9e7e00640 1 -- 172.21.15.32:0/2687505014 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f015e4f0 con 0x7fe9f00cc680 2024-03-19T06:23:50.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.755+0000 7fe9f4c00640 1 --2- 172.21.15.32:0/2687505014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9f015a7c0 0x7fe9f00cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:50.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.755+0000 7fe9efe00640 1 -- 172.21.15.32:0/2687505014 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383133288 0 0) 0x7fe9f00cb670 con 0x7fe9f00b4c50 2024-03-19T06:23:50.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9e7e00640 1 --2- 172.21.15.32:0/2687505014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f00cc680 0x7fe9f015ecf0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009870 tx=0x7fe9d801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e8cf317953840a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:50.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9efe00640 1 -- 172.21.15.32:0/2687505014 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80aa5f0 con 0x7fe9f00cc680 2024-03-19T06:23:50.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9efe00640 1 -- 172.21.15.32:0/2687505014 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d80af070 con 0x7fe9f00cc680 2024-03-19T06:23:50.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9efe00640 1 -- 172.21.15.32:0/2687505014 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80aa9b0 con 0x7fe9f00cc680 2024-03-19T06:23:50.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9f7600640 1 -- 172.21.15.32:0/2687505014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f00cc680 msgr2=0x7fe9f015ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9f7600640 1 --2- 172.21.15.32:0/2687505014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f00cc680 0x7fe9f015ecf0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009870 tx=0x7fe9d801c470 comp rx=0 tx=0).stop 2024-03-19T06:23:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9f7600640 1 -- 172.21.15.32:0/2687505014 shutdown_connections 2024-03-19T06:23:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9f7600640 1 --2- 172.21.15.32:0/2687505014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f00cc680 0x7fe9f015ecf0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9f7600640 1 --2- 172.21.15.32:0/2687505014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9f015a7c0 0x7fe9f00cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9f7600640 1 -- 172.21.15.32:0/2687505014 >> 172.21.15.32:0/2687505014 conn(0x7fe9f00b1280 msgr2=0x7fe9f00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9f7600640 1 -- 172.21.15.32:0/2687505014 shutdown_connections 2024-03-19T06:23:50.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9f7600640 1 -- 172.21.15.32:0/2687505014 wait complete. 2024-03-19T06:23:50.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9f7600640 1 Processor -- start 2024-03-19T06:23:50.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9f7600640 1 -- start start 2024-03-19T06:23:50.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9f7600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9f00b4c50 0x7fe9f0152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:50.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9f7600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f00cc680 0x7fe9f013fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:50.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.759+0000 7fe9f7600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9f015a7c0 0x7fe9f014fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:50.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9f7600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f015f3b0 con 0x7fe9f00cc680 2024-03-19T06:23:50.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9f7600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f015f230 con 0x7fe9f015a7c0 2024-03-19T06:23:50.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9f7600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f00cbc30 con 0x7fe9f00b4c50 2024-03-19T06:23:50.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9e7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f00cc680 0x7fe9f013fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:50.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9e7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f00cc680 0x7fe9f013fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54838/0 (socket says 172.21.15.32:54838) 2024-03-19T06:23:50.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9e7e00640 1 -- 172.21.15.32:0/3388719044 learned_addr learned my addr 172.21.15.32:0/3388719044 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:50.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9f4c00640 1 --2- 172.21.15.32:0/3388719044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9f00b4c50 0x7fe9f0152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:50.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9f5600640 1 --2- 172.21.15.32:0/3388719044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9f015a7c0 0x7fe9f014fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:50.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9e7e00640 1 -- 172.21.15.32:0/3388719044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9f00b4c50 msgr2=0x7fe9f0152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:50.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9e7e00640 1 --2- 172.21.15.32:0/3388719044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9f00b4c50 0x7fe9f0152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:50.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9e7e00640 1 -- 172.21.15.32:0/3388719044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9f015a7c0 msgr2=0x7fe9f014fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:50.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9e7e00640 1 --2- 172.21.15.32:0/3388719044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9f015a7c0 0x7fe9f014fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:50.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9e7e00640 1 -- 172.21.15.32:0/3388719044 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f0152a00 con 0x7fe9f00cc680 2024-03-19T06:23:50.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9e7e00640 1 --2- 172.21.15.32:0/3388719044 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f00cc680 0x7fe9f013fea0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fe9d801a100 tx=0x7fe9d801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:50.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9ed600640 1 -- 172.21.15.32:0/3388719044 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80bd5f0 con 0x7fe9f00cc680 2024-03-19T06:23:50.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9ed600640 1 -- 172.21.15.32:0/3388719044 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d80bd7b0 con 0x7fe9f00cc680 2024-03-19T06:23:50.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9ed600640 1 -- 172.21.15.32:0/3388719044 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80bdba0 con 0x7fe9f00cc680 2024-03-19T06:23:50.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9f7600640 1 -- 172.21.15.32:0/3388719044 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f0152ce0 con 0x7fe9f00cc680 2024-03-19T06:23:50.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9f7600640 1 -- 172.21.15.32:0/3388719044 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f01403e0 con 0x7fe9f00cc680 2024-03-19T06:23:50.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9f7600640 1 -- 172.21.15.32:0/3388719044 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f00749e0 con 0x7fe9f00cc680 2024-03-19T06:23:50.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.763+0000 7fe9ed600640 1 -- 172.21.15.32:0/3388719044 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe9d80b33f0 con 0x7fe9f00cc680 2024-03-19T06:23:50.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.767+0000 7fe9ed600640 1 --2- 172.21.15.32:0/3388719044 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe9cc067660 0x7fe9cc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:50.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.767+0000 7fe9ed600640 1 -- 172.21.15.32:0/3388719044 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe9d8120540 con 0x7fe9f00cc680 2024-03-19T06:23:50.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.767+0000 7fe9f4c00640 1 --2- 172.21.15.32:0/3388719044 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe9cc067660 0x7fe9cc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:50.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.767+0000 7fe9f4c00640 1 --2- 172.21.15.32:0/3388719044 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe9cc067660 0x7fe9cc069b20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000c900 tx=0x7fe9e0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:50.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.771+0000 7fe9ed600640 1 -- 172.21.15.32:0/3388719044 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fe9d80c3060 con 0x7fe9f00cc680 2024-03-19T06:23:50.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.967+0000 7fe9f7600640 1 -- 172.21.15.32:0/3388719044 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe9f00cd3b0 con 0x7fe9f00cc680 2024-03-19T06:23:50.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.967+0000 7fe9ed600640 1 -- 172.21.15.32:0/3388719044 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe9d8016150 con 0x7fe9f00cc680 2024-03-19T06:23:50.956 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-19T06:23:50.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.971+0000 7fe9f7600640 1 -- 172.21.15.32:0/3388719044 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe9cc067660 msgr2=0x7fe9cc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:50.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.971+0000 7fe9f7600640 1 --2- 172.21.15.32:0/3388719044 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe9cc067660 0x7fe9cc069b20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000c900 tx=0x7fe9e0008040 comp rx=0 tx=0).stop 2024-03-19T06:23:50.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.971+0000 7fe9f7600640 1 -- 172.21.15.32:0/3388719044 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f00cc680 msgr2=0x7fe9f013fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:50.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.971+0000 7fe9f7600640 1 --2- 172.21.15.32:0/3388719044 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f00cc680 0x7fe9f013fea0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fe9d801a100 tx=0x7fe9d801ad10 comp rx=0 tx=0).stop 2024-03-19T06:23:50.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.971+0000 7fe9f7600640 1 -- 172.21.15.32:0/3388719044 shutdown_connections 2024-03-19T06:23:50.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.971+0000 7fe9f7600640 1 --2- 172.21.15.32:0/3388719044 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe9cc067660 0x7fe9cc069b20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:50.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.971+0000 7fe9f7600640 1 --2- 172.21.15.32:0/3388719044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9f015a7c0 0x7fe9f014fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:50.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.971+0000 7fe9f7600640 1 --2- 172.21.15.32:0/3388719044 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f00cc680 0x7fe9f013fea0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:50.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.971+0000 7fe9f7600640 1 --2- 172.21.15.32:0/3388719044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9f00b4c50 0x7fe9f0152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:50.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.971+0000 7fe9f7600640 1 -- 172.21.15.32:0/3388719044 >> 172.21.15.32:0/3388719044 conn(0x7fe9f00b1280 msgr2=0x7fe9f00cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:50.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.971+0000 7fe9f7600640 1 -- 172.21.15.32:0/3388719044 shutdown_connections 2024-03-19T06:23:50.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:50.971+0000 7fe9f7600640 1 -- 172.21.15.32:0/3388719044 wait complete. 2024-03-19T06:23:50.977 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-19T06:23:50.977 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-19T06:23:50.977 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-03-19T06:23:50.977 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-19T06:23:50.977 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:50.977 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-19T06:23:50.978 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-19T06:23:50.978 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-19T06:23:50.978 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:23:50.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:50.978 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-03-19T06:23:50.988 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:23:50.988 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:23:50.988 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:23:50.988 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:50.988 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-03-19T06:23:50.988 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:50.988 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:23:50.988 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:50.988 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-03-19T06:23:50.988 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:23:50.988 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:50.989 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-03-19T06:23:50.989 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-19T06:23:50.989 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:50.989 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-03-19T06:23:50.989 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-03-19T06:23:50.989 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42266sec preferred_lft 42266sec 2024-03-19T06:23:50.989 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-03-19T06:23:50.989 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:50.989 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-19T06:23:50.989 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:50.989 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-03-19T06:23:50.989 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-19T06:23:50.989 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:f5:94:d0:dd brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:50.989 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-19T06:23:50.989 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:50.990 INFO:teuthology.orchestra.run.smithi032.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-19T06:23:50.990 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-03-19T06:23:50.990 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-19T06:23:50.990 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:50.990 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-03-19T06:23:50.990 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:50.990 INFO:teuthology.orchestra.run.smithi032.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-19T06:23:50.990 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:50.990 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-03-19T06:23:50.990 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:50.990 INFO:teuthology.orchestra.run.smithi032.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-19T06:23:50.990 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:50.990 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-03-19T06:23:50.990 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:23:50.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:50.991 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-19T06:23:51.050 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-03-19T06:23:51.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:51.053 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-03-19T06:23:51.110 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-03-19T06:23:51.110 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-19T06:23:51.110 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-03-19T06:23:51.110 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-19T06:23:51.110 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-03-19T06:23:51.110 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-19T06:23:51.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:51.111 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-03-19T06:23:51.111 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-03-19T06:23:51.111 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-19T06:23:51.111 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-19T06:23:51.111 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-19T06:23:51.111 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-03-19T06:23:51.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:51.206 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-03-19T06:23:51.216 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-19T06:23:51.216 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-19T06:23:51.216 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:23:51.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:51.216 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-03-19T06:23:51.276 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-19T06:23:51.276 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:23:51.276 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:51.325 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:23:51.325 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:23:51.325 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:51.380 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:23:51.441 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:23:51.494 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:23:51.494 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:23:51.494 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:23:51.494 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:23:51.494 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:23:51.495 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:23:51.496 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:23:51.496 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:23:51.496 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:23:51.496 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:23:51.496 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:23:51.496 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:23:51.496 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:23:51.496 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:51.496 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:51.496 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:51.496 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:51.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:51.497 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:23:51.548 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-19T06:23:51.549 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-19T06:23:51.595 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:23:51.617 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:23:51.670 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:23:51.670 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:23:51.670 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:23:51.670 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:23:51.670 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:23:51.670 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:23:51.671 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:23:51.671 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:23:51.671 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:23:51.671 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:23:51.671 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:23:51.671 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:23:51.671 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:23:51.671 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:23:51.671 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:23:51.671 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:23:51.671 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:23:51.671 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:23:51.671 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:23:51.672 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:23:51.672 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:23:51.672 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:23:51.672 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:23:51.672 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:23:51.672 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:23:51.672 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:23:51.672 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:23:51.672 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:23:51.672 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:23:51.672 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:51.672 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:51.672 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:51.672 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:51.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:51.673 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:23:51.696 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:2024-03-19T06:23:51.707+0000 7f12f29d2580 -1 init, newargv = 0x562709cba390 newargc=15 2024-03-19T06:23:51.696 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[39978]: starting ceph client 2024-03-19T06:23:51.705 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[39978]: starting fuse 2024-03-19T06:23:52.806 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-03-19T06:23:52.831 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:23:52.883 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2024-03-19T06:23:52.883 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2024-03-19T06:23:52.884 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2024-03-19T06:23:52.884 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2024-03-19T06:23:52.884 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2024-03-19T06:23:52.884 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2024-03-19T06:23:52.884 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2024-03-19T06:23:52.884 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2024-03-19T06:23:52.884 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2024-03-19T06:23:52.884 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2024-03-19T06:23:52.884 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2024-03-19T06:23:52.884 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2024-03-19T06:23:52.884 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:23:52.884 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2024-03-19T06:23:52.884 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2024-03-19T06:23:52.885 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2024-03-19T06:23:52.885 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2024-03-19T06:23:52.885 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2024-03-19T06:23:52.885 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2024-03-19T06:23:52.885 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2024-03-19T06:23:52.885 INFO:teuthology.orchestra.run.smithi032.stdout:/run/credentials/systemd-sysusers.service 2024-03-19T06:23:52.885 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2024-03-19T06:23:52.885 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2024-03-19T06:23:52.885 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2024-03-19T06:23:52.885 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:23:52.885 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:23:52.885 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:23:52.885 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:23:52.885 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2024-03-19T06:23:52.885 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:52.885 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:23:52.886 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:52.886 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:23:52.886 INFO:teuthology.orchestra.run.smithi032.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:52.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:52.887 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-03-19T06:23:52.941 INFO:teuthology.orchestra.run.smithi032.stdout:43 2024-03-19T06:23:52.941 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-03-19T06:23:52.941 DEBUG:teuthology.orchestra.run.smithi032:> sudo stdin-killer -- python3 -c ' 2024-03-19T06:23:52.941 DEBUG:teuthology.orchestra.run.smithi032:> import glob 2024-03-19T06:23:52.942 DEBUG:teuthology.orchestra.run.smithi032:> import re 2024-03-19T06:23:52.942 DEBUG:teuthology.orchestra.run.smithi032:> import os 2024-03-19T06:23:52.942 DEBUG:teuthology.orchestra.run.smithi032:> import subprocess 2024-03-19T06:23:52.942 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:23:52.942 DEBUG:teuthology.orchestra.run.smithi032:> def _find_admin_socket(client_name): 2024-03-19T06:23:52.942 DEBUG:teuthology.orchestra.run.smithi032:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-19T06:23:52.942 DEBUG:teuthology.orchestra.run.smithi032:> files = glob.glob(asok_path) 2024-03-19T06:23:52.942 DEBUG:teuthology.orchestra.run.smithi032:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-19T06:23:52.942 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:23:52.942 DEBUG:teuthology.orchestra.run.smithi032:> # Given a non-glob path, it better be there 2024-03-19T06:23:52.942 DEBUG:teuthology.orchestra.run.smithi032:> if "*" not in asok_path: 2024-03-19T06:23:52.942 DEBUG:teuthology.orchestra.run.smithi032:> assert(len(files) == 1) 2024-03-19T06:23:52.942 DEBUG:teuthology.orchestra.run.smithi032:> return files[0] 2024-03-19T06:23:52.942 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:23:52.942 DEBUG:teuthology.orchestra.run.smithi032:> for f in files: 2024-03-19T06:23:52.943 DEBUG:teuthology.orchestra.run.smithi032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-19T06:23:52.943 DEBUG:teuthology.orchestra.run.smithi032:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-19T06:23:52.943 DEBUG:teuthology.orchestra.run.smithi032:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-19T06:23:52.943 DEBUG:teuthology.orchestra.run.smithi032:> contents = proc_f.read() 2024-03-19T06:23:52.943 DEBUG:teuthology.orchestra.run.smithi032:> if mountpoint in contents: 2024-03-19T06:23:52.943 DEBUG:teuthology.orchestra.run.smithi032:> return f 2024-03-19T06:23:52.943 DEBUG:teuthology.orchestra.run.smithi032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-19T06:23:52.943 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:23:52.943 DEBUG:teuthology.orchestra.run.smithi032:> print(_find_admin_socket("client.0")) 2024-03-19T06:23:52.943 DEBUG:teuthology.orchestra.run.smithi032:> ' 2024-03-19T06:23:53.081 INFO:teuthology.orchestra.run.smithi032.stdout:/var/run/ceph/ceph-client.0.39978.asok 2024-03-19T06:23:53.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-19T06:23:53.093 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39978.asok 2024-03-19T06:23:53.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:53.093 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39978.asok status 2024-03-19T06:23:53.271 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:23:53.271 INFO:teuthology.orchestra.run.smithi032.stdout: "metadata": { 2024-03-19T06:23:53.271 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_sha1": "b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", 2024-03-19T06:23:53.271 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_version": "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)", 2024-03-19T06:23:53.271 INFO:teuthology.orchestra.run.smithi032.stdout: "entity_id": "0", 2024-03-19T06:23:53.271 INFO:teuthology.orchestra.run.smithi032.stdout: "hostname": "smithi032", 2024-03-19T06:23:53.271 INFO:teuthology.orchestra.run.smithi032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-19T06:23:53.271 INFO:teuthology.orchestra.run.smithi032.stdout: "pid": "39978", 2024-03-19T06:23:53.271 INFO:teuthology.orchestra.run.smithi032.stdout: "root": "/" 2024-03-19T06:23:53.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:53.271 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_count": 0, 2024-03-19T06:23:53.272 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_pinned_count": 0, 2024-03-19T06:23:53.272 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 6297, 2024-03-19T06:23:53.272 INFO:teuthology.orchestra.run.smithi032.stdout: "inst": { 2024-03-19T06:23:53.272 INFO:teuthology.orchestra.run.smithi032.stdout: "name": { 2024-03-19T06:23:53.272 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "client", 2024-03-19T06:23:53.272 INFO:teuthology.orchestra.run.smithi032.stdout: "num": 6297 2024-03-19T06:23:53.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:53.272 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-03-19T06:23:53.272 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-03-19T06:23:53.272 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:23:53.272 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3511590983 2024-03-19T06:23:53.272 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-03-19T06:23:53.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:53.272 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-03-19T06:23:53.272 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-03-19T06:23:53.273 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:23:53.273 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3511590983 2024-03-19T06:23:53.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-03-19T06:23:53.273 INFO:teuthology.orchestra.run.smithi032.stdout: "inst_str": "client.6297 192.168.0.1:0/3511590983", 2024-03-19T06:23:53.273 INFO:teuthology.orchestra.run.smithi032.stdout: "addr_str": "192.168.0.1:0/3511590983", 2024-03-19T06:23:53.273 INFO:teuthology.orchestra.run.smithi032.stdout: "inode_count": 1, 2024-03-19T06:23:53.273 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_epoch": 26, 2024-03-19T06:23:53.273 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch": 53, 2024-03-19T06:23:53.273 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch_barrier": 0, 2024-03-19T06:23:53.273 INFO:teuthology.orchestra.run.smithi032.stdout: "blocklisted": false, 2024-03-19T06:23:53.273 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs" 2024-03-19T06:23:53.273 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:23:53.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:53.287 DEBUG:teuthology.orchestra.run.smithi032:> stat --file-system '--printf=%T 2024-03-19T06:23:53.287 DEBUG:teuthology.orchestra.run.smithi032:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:53.296 INFO:teuthology.orchestra.run.smithi032.stdout:fuseblk 2024-03-19T06:23:53.296 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:53.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:53.296 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:53.356 DEBUG:teuthology.orchestra.run.smithi032:> stdin-killer -- python3 -c ' 2024-03-19T06:23:53.356 DEBUG:teuthology.orchestra.run.smithi032:> import os 2024-03-19T06:23:53.356 DEBUG:teuthology.orchestra.run.smithi032:> import errno 2024-03-19T06:23:53.356 DEBUG:teuthology.orchestra.run.smithi032:> 2024-03-19T06:23:53.356 DEBUG:teuthology.orchestra.run.smithi032:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2024-03-19T06:23:53.356 DEBUG:teuthology.orchestra.run.smithi032:> try: 2024-03-19T06:23:53.356 DEBUG:teuthology.orchestra.run.smithi032:> if True: 2024-03-19T06:23:53.356 DEBUG:teuthology.orchestra.run.smithi032:> ret = os.read(fd, 1024) 2024-03-19T06:23:53.356 DEBUG:teuthology.orchestra.run.smithi032:> else: 2024-03-19T06:23:53.356 DEBUG:teuthology.orchestra.run.smithi032:> os.write(fd, b'"'"'content'"'"') 2024-03-19T06:23:53.357 DEBUG:teuthology.orchestra.run.smithi032:> except OSError as e: 2024-03-19T06:23:53.357 DEBUG:teuthology.orchestra.run.smithi032:> if e.errno != errno.EPERM: 2024-03-19T06:23:53.357 DEBUG:teuthology.orchestra.run.smithi032:> raise 2024-03-19T06:23:53.357 DEBUG:teuthology.orchestra.run.smithi032:> else: 2024-03-19T06:23:53.357 DEBUG:teuthology.orchestra.run.smithi032:> raise RuntimeError("client does not check permission of data pool") 2024-03-19T06:23:53.357 DEBUG:teuthology.orchestra.run.smithi032:> ' 2024-03-19T06:23:53.465 INFO:teuthology.orchestra.run.smithi032.stderr:Traceback (most recent call last): 2024-03-19T06:23:53.465 INFO:teuthology.orchestra.run.smithi032.stderr: File "", line 15, in 2024-03-19T06:23:53.465 INFO:teuthology.orchestra.run.smithi032.stderr:RuntimeError: client does not check permission of data pool 2024-03-19T06:23:53.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2024-03-19T06:23:53.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:23:53.477 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2024-03-19T06:23:53.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.679+0000 7fec07000640 1 Processor -- start 2024-03-19T06:23:53.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.679+0000 7fec07000640 1 -- start start 2024-03-19T06:23:53.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.679+0000 7fec07000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec0006ad40 0x7fec0006b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:53.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.679+0000 7fec07000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fec0006eed0 0x7fec000ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:53.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.679+0000 7fec07000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0006b660 con 0x7fec0006e320 2024-03-19T06:23:53.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.679+0000 7fec07000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0006dbb0 con 0x7fec0006eed0 2024-03-19T06:23:53.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.679+0000 7fec07000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec000cc290 con 0x7fec0006ad40 2024-03-19T06:23:53.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.679+0000 7febff400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fec0006eed0 0x7fec000ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:53.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.679+0000 7febff400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fec0006eed0 0x7fec000ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42174/0 (socket says 172.21.15.32:42174) 2024-03-19T06:23:53.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.679+0000 7febff400640 1 -- 172.21.15.32:0/2546094895 learned_addr learned my addr 172.21.15.32:0/2546094895 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:53.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.679+0000 7febffe00640 1 --2- 172.21.15.32:0/2546094895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec0006ad40 0x7fec0006b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:53.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.679+0000 7febff400640 1 -- 172.21.15.32:0/2546094895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec0006ad40 msgr2=0x7fec0006b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:53.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.679+0000 7febff400640 1 --2- 172.21.15.32:0/2546094895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec0006ad40 0x7fec0006b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:53.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.679+0000 7febff400640 1 -- 172.21.15.32:0/2546094895 >> v1:172.21.15.171:6789/0 conn(0x7fec0006e320 legacy=0x7fec0015bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:53.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.679+0000 7febff400640 1 -- 172.21.15.32:0/2546094895 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec000cc570 con 0x7fec0006eed0 2024-03-19T06:23:53.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.683+0000 7febff400640 1 --2- 172.21.15.32:0/2546094895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0006eed0 0x7fec000ccd10 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7febec009870 tx=0x7febec01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb3939a2e744086 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:53.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.683+0000 7febfea00640 1 -- 172.21.15.32:0/2546094895 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec0aa600 con 0x7fec0006eed0 2024-03-19T06:23:53.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.683+0000 7febfea00640 1 -- 172.21.15.32:0/2546094895 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec0af070 con 0x7fec0006eed0 2024-03-19T06:23:53.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.683+0000 7febfea00640 1 -- 172.21.15.32:0/2546094895 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec0aa9c0 con 0x7fec0006eed0 2024-03-19T06:23:53.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.683+0000 7fec07000640 1 -- 172.21.15.32:0/2546094895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0006eed0 msgr2=0x7fec000ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:53.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.683+0000 7fec07000640 1 --2- 172.21.15.32:0/2546094895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0006eed0 0x7fec000ccd10 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7febec009870 tx=0x7febec01c4a0 comp rx=0 tx=0).stop 2024-03-19T06:23:53.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.683+0000 7fec07000640 1 -- 172.21.15.32:0/2546094895 shutdown_connections 2024-03-19T06:23:53.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.683+0000 7fec07000640 1 --2- 172.21.15.32:0/2546094895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0006eed0 0x7fec000ccd10 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:53.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.683+0000 7fec07000640 1 --2- 172.21.15.32:0/2546094895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec0006ad40 0x7fec0006b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:53.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.683+0000 7fec07000640 1 -- 172.21.15.32:0/2546094895 >> 172.21.15.32:0/2546094895 conn(0x7fec000b1590 msgr2=0x7fec000b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:53.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.683+0000 7fec07000640 1 -- 172.21.15.32:0/2546094895 shutdown_connections 2024-03-19T06:23:53.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.683+0000 7fec07000640 1 -- 172.21.15.32:0/2546094895 wait complete. 2024-03-19T06:23:53.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.683+0000 7fec07000640 1 Processor -- start 2024-03-19T06:23:53.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.683+0000 7fec07000640 1 -- start start 2024-03-19T06:23:53.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7fec07000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec0006ad40 0x7fec000b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:53.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7fec07000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0006e320 0x7fec001474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:53.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7fec07000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec0006eed0 0x7fec000b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:53.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7fec07000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0015c8f0 con 0x7fec0006e320 2024-03-19T06:23:53.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7fec07000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0015c770 con 0x7fec0006ad40 2024-03-19T06:23:53.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7fec07000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec00168d20 con 0x7fec0006eed0 2024-03-19T06:23:53.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7febff400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0006e320 0x7fec001474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:53.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7febff400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0006e320 0x7fec001474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42180/0 (socket says 172.21.15.32:42180) 2024-03-19T06:23:53.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7febff400640 1 -- 172.21.15.32:0/1828850854 learned_addr learned my addr 172.21.15.32:0/1828850854 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:53.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7febffe00640 1 --2- 172.21.15.32:0/1828850854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec0006ad40 0x7fec000b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:53.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7fec05000640 1 --2- 172.21.15.32:0/1828850854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec0006eed0 0x7fec000b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:53.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7febff400640 1 -- 172.21.15.32:0/1828850854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec0006eed0 msgr2=0x7fec000b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:53.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7febff400640 1 --2- 172.21.15.32:0/1828850854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec0006eed0 0x7fec000b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:53.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7febff400640 1 -- 172.21.15.32:0/1828850854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec0006ad40 msgr2=0x7fec000b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:53.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7febff400640 1 --2- 172.21.15.32:0/1828850854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec0006ad40 0x7fec000b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:53.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7febff400640 1 -- 172.21.15.32:0/1828850854 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec000af540 con 0x7fec0006e320 2024-03-19T06:23:53.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7fec05000640 1 --2- 172.21.15.32:0/1828850854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec0006eed0 0x7fec000b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:53.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7febff400640 1 --2- 172.21.15.32:0/1828850854 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0006e320 0x7fec001474a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7febec0ac040 tx=0x7febec019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:53.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7febf7e00640 1 -- 172.21.15.32:0/1828850854 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec0be610 con 0x7fec0006e320 2024-03-19T06:23:53.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7febf7e00640 1 -- 172.21.15.32:0/1828850854 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec0be7d0 con 0x7fec0006e320 2024-03-19T06:23:53.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7febf7e00640 1 -- 172.21.15.32:0/1828850854 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec0bebc0 con 0x7fec0006e320 2024-03-19T06:23:53.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7fec07000640 1 -- 172.21.15.32:0/1828850854 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec000af820 con 0x7fec0006e320 2024-03-19T06:23:53.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7fec07000640 1 -- 172.21.15.32:0/1828850854 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec000afde0 con 0x7fec0006e320 2024-03-19T06:23:53.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.687+0000 7fec07000640 1 -- 172.21.15.32:0/1828850854 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec000749e0 con 0x7fec0006e320 2024-03-19T06:23:53.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.691+0000 7febf7e00640 1 -- 172.21.15.32:0/1828850854 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7febec0bc020 con 0x7fec0006e320 2024-03-19T06:23:53.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.691+0000 7febf7e00640 1 --2- 172.21.15.32:0/1828850854 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7febe0067660 0x7febe0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:53.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.691+0000 7febf7e00640 1 -- 172.21.15.32:0/1828850854 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7febec11fc10 con 0x7fec0006e320 2024-03-19T06:23:53.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.691+0000 7febffe00640 1 --2- 172.21.15.32:0/1828850854 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7febe0067660 0x7febe0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:53.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.691+0000 7febffe00640 1 --2- 172.21.15.32:0/1828850854 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7febe0067660 0x7febe0069b20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7febf0007a60 tx=0x7febf0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:53.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.695+0000 7febf7e00640 1 -- 172.21.15.32:0/1828850854 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7febec0c5030 con 0x7fec0006e320 2024-03-19T06:23:53.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.915+0000 7fec07000640 1 -- 172.21.15.32:0/1828850854 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fec000cf610 con 0x7fec0006e320 2024-03-19T06:23:53.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.915+0000 7febf7e00640 1 -- 172.21.15.32:0/1828850854 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v18) v1 ==== 184+0+141 (secure 0 0 0) 0x7febec016150 con 0x7fec0006e320 2024-03-19T06:23:53.905 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-03-19T06:23:53.906 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQCWLvll4jsFMxAAr4PzH6Djodh2O01vGYgxKA== 2024-03-19T06:23:53.906 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow" 2024-03-19T06:23:53.906 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2024-03-19T06:23:53.906 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw pool=cephfs_data" 2024-03-19T06:23:53.907 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.0 2024-03-19T06:23:53.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.919+0000 7fec07000640 1 -- 172.21.15.32:0/1828850854 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7febe0067660 msgr2=0x7febe0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:53.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.919+0000 7fec07000640 1 --2- 172.21.15.32:0/1828850854 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7febe0067660 0x7febe0069b20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7febf0007a60 tx=0x7febf0008040 comp rx=0 tx=0).stop 2024-03-19T06:23:53.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.919+0000 7fec07000640 1 -- 172.21.15.32:0/1828850854 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0006e320 msgr2=0x7fec001474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:53.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.919+0000 7fec07000640 1 --2- 172.21.15.32:0/1828850854 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0006e320 0x7fec001474a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7febec0ac040 tx=0x7febec019240 comp rx=0 tx=0).stop 2024-03-19T06:23:53.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.919+0000 7fec07000640 1 -- 172.21.15.32:0/1828850854 shutdown_connections 2024-03-19T06:23:53.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.919+0000 7fec07000640 1 --2- 172.21.15.32:0/1828850854 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7febe0067660 0x7febe0069b20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:53.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.919+0000 7fec07000640 1 --2- 172.21.15.32:0/1828850854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec0006eed0 0x7fec000b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:53.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.919+0000 7fec07000640 1 --2- 172.21.15.32:0/1828850854 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fec0006e320 0x7fec001474a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:53.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.919+0000 7fec07000640 1 --2- 172.21.15.32:0/1828850854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec0006ad40 0x7fec000b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:53.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.919+0000 7fec07000640 1 -- 172.21.15.32:0/1828850854 >> 172.21.15.32:0/1828850854 conn(0x7fec000b1590 msgr2=0x7fec000cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:53.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.919+0000 7fec07000640 1 -- 172.21.15.32:0/1828850854 shutdown_connections 2024-03-19T06:23:53.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:53.919+0000 7fec07000640 1 -- 172.21.15.32:0/1828850854 wait complete. 2024-03-19T06:23:53.926 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-19T06:23:53.927 DEBUG:teuthology.orchestra.run.smithi032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-19T06:23:54.027 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-19T06:23:54.117 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-19T06:23:54.117 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:23:54.117 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:23:54.126 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:23:54.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.319+0000 7f3444600640 1 Processor -- start 2024-03-19T06:23:54.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.319+0000 7f3444600640 1 -- start start 2024-03-19T06:23:54.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.323+0000 7f3444600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f343c15c010 0x7f343c15f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:54.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.323+0000 7f3444600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343c15fe20 con 0x7f343c0aecf0 2024-03-19T06:23:54.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.323+0000 7f3444600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343c160100 con 0x7f343c06d6c0 2024-03-19T06:23:54.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.323+0000 7f3444600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343c1603e0 con 0x7f343c15c010 2024-03-19T06:23:54.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.323+0000 7f3441c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f343c0aecf0 0x7f343c0ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43662/0 (socket says 172.21.15.32:43662) 2024-03-19T06:23:54.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.323+0000 7f3441c00640 1 -- 172.21.15.32:0/548128060 learned_addr learned my addr 172.21.15.32:0/548128060 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:54.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.323+0000 7f3441200640 1 --2- 172.21.15.32:0/548128060 >> v2:172.21.15.32:3300/0 conn(0x7f343c15c010 0x7f343c15f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:54.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.323+0000 7f343be00640 1 -- 172.21.15.32:0/548128060 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573800209 0 0) 0x7f343c15fe20 con 0x7f343c0aecf0 2024-03-19T06:23:54.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.323+0000 7f343be00640 1 -- 172.21.15.32:0/548128060 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3424003530 con 0x7f343c0aecf0 2024-03-19T06:23:54.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.323+0000 7f3441200640 1 -- 172.21.15.32:0/548128060 >> v1:172.21.15.171:6789/0 conn(0x7f343c06d6c0 legacy=0x7f343c0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:54.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.323+0000 7f3441200640 1 -- 172.21.15.32:0/548128060 >> v1:172.21.15.32:6789/0 conn(0x7f343c0aecf0 legacy=0x7f343c0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:54.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.323+0000 7f3441200640 1 -- 172.21.15.32:0/548128060 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c0ca1f0 con 0x7f343c15c010 2024-03-19T06:23:54.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.327+0000 7f3441200640 1 --2- 172.21.15.32:0/548128060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f343c15c010 0x7f343c15f520 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f34280097c0 tx=0x7f342801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0a12eaee9a84f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:54.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.327+0000 7f343be00640 1 -- 172.21.15.32:0/548128060 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34280b0070 con 0x7f343c15c010 2024-03-19T06:23:54.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.327+0000 7f343be00640 1 -- 172.21.15.32:0/548128060 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34280ab600 con 0x7f343c15c010 2024-03-19T06:23:54.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.327+0000 7f343be00640 1 -- 172.21.15.32:0/548128060 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34280ab9d0 con 0x7f343c15c010 2024-03-19T06:23:54.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.327+0000 7f3444600640 1 -- 172.21.15.32:0/548128060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f343c15c010 msgr2=0x7f343c15f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:54.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.327+0000 7f3444600640 1 --2- 172.21.15.32:0/548128060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f343c15c010 0x7f343c15f520 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f34280097c0 tx=0x7f342801c410 comp rx=0 tx=0).stop 2024-03-19T06:23:54.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.327+0000 7f3444600640 1 -- 172.21.15.32:0/548128060 shutdown_connections 2024-03-19T06:23:54.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.327+0000 7f3444600640 1 --2- 172.21.15.32:0/548128060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f343c15c010 0x7f343c15f520 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.327+0000 7f3444600640 1 -- 172.21.15.32:0/548128060 >> 172.21.15.32:0/548128060 conn(0x7f343c0b1280 msgr2=0x7f343c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:54.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.327+0000 7f3444600640 1 -- 172.21.15.32:0/548128060 shutdown_connections 2024-03-19T06:23:54.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.327+0000 7f3444600640 1 -- 172.21.15.32:0/548128060 wait complete. 2024-03-19T06:23:54.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.327+0000 7f3444600640 1 Processor -- start 2024-03-19T06:23:54.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.327+0000 7f3444600640 1 -- start start 2024-03-19T06:23:54.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.327+0000 7f3444600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f343c06d6c0 0x7f343c0b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:54.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.327+0000 7f3444600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f343c0aecf0 0x7f343c149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:54.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3444600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f343c15c010 0x7f343c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:54.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3444600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c16a030 con 0x7f343c15c010 2024-03-19T06:23:54.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3444600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c169eb0 con 0x7f343c0aecf0 2024-03-19T06:23:54.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3444600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343c16a1b0 con 0x7f343c06d6c0 2024-03-19T06:23:54.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3442600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f343c15c010 0x7f343c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:54.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3442600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f343c15c010 0x7f343c0ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42200/0 (socket says 172.21.15.32:42200) 2024-03-19T06:23:54.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3442600640 1 -- 172.21.15.32:0/1245520354 learned_addr learned my addr 172.21.15.32:0/1245520354 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:54.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3441c00640 1 --2- 172.21.15.32:0/1245520354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f343c06d6c0 0x7f343c0b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:54.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3441200640 1 --2- 172.21.15.32:0/1245520354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f343c0aecf0 0x7f343c149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:54.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3442600640 1 -- 172.21.15.32:0/1245520354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f343c06d6c0 msgr2=0x7f343c0b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:54.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3442600640 1 --2- 172.21.15.32:0/1245520354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f343c06d6c0 0x7f343c0b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3442600640 1 -- 172.21.15.32:0/1245520354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f343c0aecf0 msgr2=0x7f343c149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:54.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3442600640 1 --2- 172.21.15.32:0/1245520354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f343c0aecf0 0x7f343c149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3442600640 1 -- 172.21.15.32:0/1245520354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c0b2860 con 0x7f343c15c010 2024-03-19T06:23:54.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3442600640 1 --2- 172.21.15.32:0/1245520354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f343c15c010 0x7f343c0ce7f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f343400c730 tx=0x7f343400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:54.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3439600640 1 -- 172.21.15.32:0/1245520354 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434003b80 con 0x7f343c15c010 2024-03-19T06:23:54.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3439600640 1 -- 172.21.15.32:0/1245520354 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3434003d20 con 0x7f343c15c010 2024-03-19T06:23:54.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3439600640 1 -- 172.21.15.32:0/1245520354 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343400aa30 con 0x7f343c15c010 2024-03-19T06:23:54.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3444600640 1 -- 172.21.15.32:0/1245520354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343c0b2b40 con 0x7f343c15c010 2024-03-19T06:23:54.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3444600640 1 -- 172.21.15.32:0/1245520354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343c0b3100 con 0x7f343c15c010 2024-03-19T06:23:54.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3444600640 1 -- 172.21.15.32:0/1245520354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343c0749e0 con 0x7f343c15c010 2024-03-19T06:23:54.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.331+0000 7f3439600640 1 -- 172.21.15.32:0/1245520354 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f343400abd0 con 0x7f343c15c010 2024-03-19T06:23:54.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.335+0000 7f3439600640 1 --2- 172.21.15.32:0/1245520354 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f341c067660 0x7f341c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:54.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.335+0000 7f3439600640 1 -- 172.21.15.32:0/1245520354 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3434085700 con 0x7f343c15c010 2024-03-19T06:23:54.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.335+0000 7f3441c00640 1 --2- 172.21.15.32:0/1245520354 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f341c067660 0x7f341c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:54.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.335+0000 7f3441c00640 1 --2- 172.21.15.32:0/1245520354 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f341c067660 0x7f341c069b20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f34300011f0 tx=0x7f3430009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:54.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.339+0000 7f3439600640 1 -- 172.21.15.32:0/1245520354 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f34340563b0 con 0x7f343c15c010 2024-03-19T06:23:54.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.499+0000 7f3444600640 1 -- 172.21.15.32:0/1245520354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f343c0b5610 con 0x7f343c15c010 2024-03-19T06:23:54.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.499+0000 7f3439600640 1 -- 172.21.15.32:0/1245520354 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16721 (secure 0 0 0) 0x7f3434055cb0 con 0x7f343c15c010 2024-03-19T06:23:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:54.489 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":53,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:23:51.649760+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:23:19.707249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-19T06:23:20.926932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1d","mappings":[{"from":0,"to":6}]},{"pgid":"8.25","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:23:54.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.503+0000 7f3444600640 1 -- 172.21.15.32:0/1245520354 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f341c067660 msgr2=0x7f341c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:54.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.503+0000 7f3444600640 1 --2- 172.21.15.32:0/1245520354 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f341c067660 0x7f341c069b20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f34300011f0 tx=0x7f3430009040 comp rx=0 tx=0).stop 2024-03-19T06:23:54.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.503+0000 7f3444600640 1 -- 172.21.15.32:0/1245520354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f343c15c010 msgr2=0x7f343c0ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:54.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.503+0000 7f3444600640 1 --2- 172.21.15.32:0/1245520354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f343c15c010 0x7f343c0ce7f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f343400c730 tx=0x7f343400cbf0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.503+0000 7f3444600640 1 -- 172.21.15.32:0/1245520354 shutdown_connections 2024-03-19T06:23:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.503+0000 7f3444600640 1 --2- 172.21.15.32:0/1245520354 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f341c067660 0x7f341c069b20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.503+0000 7f3444600640 1 --2- 172.21.15.32:0/1245520354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f343c15c010 0x7f343c0ce7f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.503+0000 7f3444600640 1 --2- 172.21.15.32:0/1245520354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f343c0aecf0 0x7f343c149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.503+0000 7f3444600640 1 --2- 172.21.15.32:0/1245520354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f343c06d6c0 0x7f343c0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.503+0000 7f3444600640 1 -- 172.21.15.32:0/1245520354 >> 172.21.15.32:0/1245520354 conn(0x7f343c0b1280 msgr2=0x7f343c15d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.503+0000 7f3444600640 1 -- 172.21.15.32:0/1245520354 shutdown_connections 2024-03-19T06:23:54.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.503+0000 7f3444600640 1 -- 172.21.15.32:0/1245520354 wait complete. 2024-03-19T06:23:54.510 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:23:19.707249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:23:20.926932+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:23:54.510 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:23:54.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.671+0000 7f92b5400640 1 Processor -- start 2024-03-19T06:23:54.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.671+0000 7f92b5400640 1 -- start start 2024-03-19T06:23:54.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.671+0000 7f92b5400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92b015dbb0 0x7f92b006c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:54.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.671+0000 7f92b5400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f92b006c5a0 0x7f92b00b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:54.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.671+0000 7f92b5400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b00cbf00 con 0x7f92b00b3b60 2024-03-19T06:23:54.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.671+0000 7f92b5400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b00b3fb0 con 0x7f92b006c5a0 2024-03-19T06:23:54.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.671+0000 7f92b5400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b006cb20 con 0x7f92b015dbb0 2024-03-19T06:23:54.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.671+0000 7f92a5e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f92b006c5a0 0x7f92b00b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:54.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.671+0000 7f92af200640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f92b00b3b60 0x7f92b00d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43678/0 (socket says 172.21.15.32:43678) 2024-03-19T06:23:54.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.671+0000 7f92af200640 1 -- 172.21.15.32:0/2176330058 learned_addr learned my addr 172.21.15.32:0/2176330058 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:54.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.671+0000 7f92ae800640 1 --2- 172.21.15.32:0/2176330058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92b015dbb0 0x7f92b006c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:54.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.671+0000 7f92a5e00640 1 -- 172.21.15.32:0/2176330058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92b015dbb0 msgr2=0x7f92b006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:54.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.671+0000 7f92a5e00640 1 --2- 172.21.15.32:0/2176330058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92b015dbb0 0x7f92b006c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.671+0000 7f92a5e00640 1 -- 172.21.15.32:0/2176330058 >> v1:172.21.15.32:6789/0 conn(0x7f92b00b3b60 legacy=0x7f92b00d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:54.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.671+0000 7f92a5e00640 1 -- 172.21.15.32:0/2176330058 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b006ce00 con 0x7f92b006c5a0 2024-03-19T06:23:54.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.671+0000 7f92ade00640 1 -- 172.21.15.32:0/2176330058 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949805218 0 0) 0x7f92b00cbf00 con 0x7f92b00b3b60 2024-03-19T06:23:54.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.675+0000 7f92a5e00640 1 --2- 172.21.15.32:0/2176330058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92b006c5a0 0x7f92b00b3620 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f92980097c0 tx=0x7f929801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2520822f5e0457f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:54.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.675+0000 7f92ade00640 1 -- 172.21.15.32:0/2176330058 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92980b5070 con 0x7f92b006c5a0 2024-03-19T06:23:54.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.675+0000 7f92ade00640 1 -- 172.21.15.32:0/2176330058 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92980a8990 con 0x7f92b006c5a0 2024-03-19T06:23:54.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.675+0000 7f92ade00640 1 -- 172.21.15.32:0/2176330058 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92980a8d60 con 0x7f92b006c5a0 2024-03-19T06:23:54.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.675+0000 7f92b5400640 1 -- 172.21.15.32:0/2176330058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92b006c5a0 msgr2=0x7f92b00b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:54.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.675+0000 7f92b5400640 1 --2- 172.21.15.32:0/2176330058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92b006c5a0 0x7f92b00b3620 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f92980097c0 tx=0x7f929801ec90 comp rx=0 tx=0).stop 2024-03-19T06:23:54.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.675+0000 7f92b5400640 1 -- 172.21.15.32:0/2176330058 shutdown_connections 2024-03-19T06:23:54.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.675+0000 7f92b5400640 1 --2- 172.21.15.32:0/2176330058 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92b006c5a0 0x7f92b00b3620 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.675+0000 7f92b5400640 1 --2- 172.21.15.32:0/2176330058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92b015dbb0 0x7f92b006c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.675+0000 7f92b5400640 1 -- 172.21.15.32:0/2176330058 >> 172.21.15.32:0/2176330058 conn(0x7f92b0066ca0 msgr2=0x7f92b00670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:54.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.675+0000 7f92b5400640 1 -- 172.21.15.32:0/2176330058 shutdown_connections 2024-03-19T06:23:54.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.675+0000 7f92b5400640 1 -- 172.21.15.32:0/2176330058 wait complete. 2024-03-19T06:23:54.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92b5400640 1 Processor -- start 2024-03-19T06:23:54.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92b5400640 1 -- start start 2024-03-19T06:23:54.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92b5400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92b006c5a0 0x7f92b015bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:54.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92b5400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92b00b3b60 0x7f92b01f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:54.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92b5400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92b015dbb0 0x7f92b00cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:54.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92b5400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b006d910 con 0x7f92b015dbb0 2024-03-19T06:23:54.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92b5400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00cc1a0 con 0x7f92b006c5a0 2024-03-19T06:23:54.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92b5400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b015df90 con 0x7f92b00b3b60 2024-03-19T06:23:54.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92af200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92b015dbb0 0x7f92b00cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:54.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92af200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92b015dbb0 0x7f92b00cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42220/0 (socket says 172.21.15.32:42220) 2024-03-19T06:23:54.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92af200640 1 -- 172.21.15.32:0/738187885 learned_addr learned my addr 172.21.15.32:0/738187885 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:54.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92ae800640 1 --2- 172.21.15.32:0/738187885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92b006c5a0 0x7f92b015bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:54.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92a5e00640 1 --2- 172.21.15.32:0/738187885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92b00b3b60 0x7f92b01f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:54.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92af200640 1 -- 172.21.15.32:0/738187885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92b00b3b60 msgr2=0x7f92b01f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:54.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92af200640 1 --2- 172.21.15.32:0/738187885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92b00b3b60 0x7f92b01f3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92af200640 1 -- 172.21.15.32:0/738187885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92b006c5a0 msgr2=0x7f92b015bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:54.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92af200640 1 --2- 172.21.15.32:0/738187885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92b006c5a0 0x7f92b015bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92af200640 1 -- 172.21.15.32:0/738187885 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b01f78c0 con 0x7f92b015dbb0 2024-03-19T06:23:54.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92af200640 1 --2- 172.21.15.32:0/738187885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92b015dbb0 0x7f92b00cccd0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f92a800c450 tx=0x7f92a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:54.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92a7400640 1 -- 172.21.15.32:0/738187885 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a8017070 con 0x7f92b015dbb0 2024-03-19T06:23:54.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92a7400640 1 -- 172.21.15.32:0/738187885 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a8005cf0 con 0x7f92b015dbb0 2024-03-19T06:23:54.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92a7400640 1 -- 172.21.15.32:0/738187885 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a8007310 con 0x7f92b015dbb0 2024-03-19T06:23:54.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92b5400640 1 -- 172.21.15.32:0/738187885 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b00b55f0 con 0x7f92b015dbb0 2024-03-19T06:23:54.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92b5400640 1 -- 172.21.15.32:0/738187885 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b00b5bb0 con 0x7f92b015dbb0 2024-03-19T06:23:54.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.679+0000 7f92b5400640 1 -- 172.21.15.32:0/738187885 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b00749e0 con 0x7f92b015dbb0 2024-03-19T06:23:54.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.683+0000 7f92a7400640 1 -- 172.21.15.32:0/738187885 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f92a801a070 con 0x7f92b015dbb0 2024-03-19T06:23:54.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.683+0000 7f92a7400640 1 --2- 172.21.15.32:0/738187885 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f928c067660 0x7f928c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:54.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.683+0000 7f92a7400640 1 -- 172.21.15.32:0/738187885 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f92a8084c60 con 0x7f92b015dbb0 2024-03-19T06:23:54.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.683+0000 7f92ae800640 1 --2- 172.21.15.32:0/738187885 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f928c067660 0x7f928c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:54.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.683+0000 7f92ae800640 1 --2- 172.21.15.32:0/738187885 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f928c067660 0x7f928c069b20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f92a00113e0 tx=0x7f92a000b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:54.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.687+0000 7f92a7400640 1 -- 172.21.15.32:0/738187885 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f92a8055250 con 0x7f92b015dbb0 2024-03-19T06:23:54.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.851+0000 7f92b5400640 1 -- 172.21.15.32:0/738187885 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92b0160db0 con 0x7f92b015dbb0 2024-03-19T06:23:54.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.851+0000 7f92a7400640 1 -- 172.21.15.32:0/738187885 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92a80592f0 con 0x7f92b015dbb0 2024-03-19T06:23:54.839 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:23:54.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.851+0000 7f92b5400640 1 -- 172.21.15.32:0/738187885 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f928c067660 msgr2=0x7f928c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:54.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.851+0000 7f92b5400640 1 --2- 172.21.15.32:0/738187885 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f928c067660 0x7f928c069b20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f92a00113e0 tx=0x7f92a000b040 comp rx=0 tx=0).stop 2024-03-19T06:23:54.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.851+0000 7f92b5400640 1 -- 172.21.15.32:0/738187885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92b015dbb0 msgr2=0x7f92b00cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:54.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.851+0000 7f92b5400640 1 --2- 172.21.15.32:0/738187885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92b015dbb0 0x7f92b00cccd0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f92a800c450 tx=0x7f92a800c910 comp rx=0 tx=0).stop 2024-03-19T06:23:54.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.851+0000 7f92b5400640 1 -- 172.21.15.32:0/738187885 shutdown_connections 2024-03-19T06:23:54.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.851+0000 7f92b5400640 1 --2- 172.21.15.32:0/738187885 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f928c067660 0x7f928c069b20 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.851+0000 7f92b5400640 1 --2- 172.21.15.32:0/738187885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f92b015dbb0 0x7f92b00cccd0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.851+0000 7f92b5400640 1 --2- 172.21.15.32:0/738187885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92b00b3b60 0x7f92b01f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.851+0000 7f92b5400640 1 --2- 172.21.15.32:0/738187885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92b006c5a0 0x7f92b015bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:54.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.851+0000 7f92b5400640 1 -- 172.21.15.32:0/738187885 >> 172.21.15.32:0/738187885 conn(0x7f92b0066ca0 msgr2=0x7f92b0067080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:54.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.851+0000 7f92b5400640 1 -- 172.21.15.32:0/738187885 shutdown_connections 2024-03-19T06:23:54.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:54.851+0000 7f92b5400640 1 -- 172.21.15.32:0/738187885 wait complete. 2024-03-19T06:23:54.860 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:23:55.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.015+0000 7f03f0a00640 1 Processor -- start 2024-03-19T06:23:55.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.015+0000 7f03f0a00640 1 -- start start 2024-03-19T06:23:55.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.019+0000 7f03f0a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f03ec15c6d0 0x7f03ec15bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.019+0000 7f03f0a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03ec15f250 0x7f03ec06d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.019+0000 7f03f0a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ec15faa0 con 0x7f03ec06d6a0 2024-03-19T06:23:55.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.019+0000 7f03f0a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ec15d190 con 0x7f03ec15c6d0 2024-03-19T06:23:55.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.019+0000 7f03f0a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec15fd80 con 0x7f03ec15f250 2024-03-19T06:23:55.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.019+0000 7f03ebe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f03ec06d6a0 0x7f03ec0cb9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43686/0 (socket says 172.21.15.32:43686) 2024-03-19T06:23:55.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.019+0000 7f03ebe00640 1 -- 172.21.15.32:0/3771699025 learned_addr learned my addr 172.21.15.32:0/3771699025 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:55.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.019+0000 7f03eb400640 1 --2- 172.21.15.32:0/3771699025 >> v2:172.21.15.171:3300/0 conn(0x7f03ec15c6d0 0x7f03ec15bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:55.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.019+0000 7f03e2a00640 1 --2- 172.21.15.32:0/3771699025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03ec15f250 0x7f03ec06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:55.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.019+0000 7f03eaa00640 1 -- 172.21.15.32:0/3771699025 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698042775 0 0) 0x7f03ec15faa0 con 0x7f03ec06d6a0 2024-03-19T06:23:55.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.019+0000 7f03eaa00640 1 -- 172.21.15.32:0/3771699025 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d0003530 con 0x7f03ec06d6a0 2024-03-19T06:23:55.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.019+0000 7f03e2a00640 1 -- 172.21.15.32:0/3771699025 >> v2:172.21.15.171:3300/0 conn(0x7f03ec15c6d0 msgr2=0x7f03ec15bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:55.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.019+0000 7f03e2a00640 1 --2- 172.21.15.32:0/3771699025 >> v2:172.21.15.171:3300/0 conn(0x7f03ec15c6d0 0x7f03ec15bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.019+0000 7f03e2a00640 1 -- 172.21.15.32:0/3771699025 >> v1:172.21.15.32:6789/0 conn(0x7f03ec06d6a0 legacy=0x7f03ec0cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.019+0000 7f03e2a00640 1 -- 172.21.15.32:0/3771699025 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec160060 con 0x7f03ec15f250 2024-03-19T06:23:55.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.019+0000 7f03eb400640 1 --2- 172.21.15.32:0/3771699025 >> v2:172.21.15.171:3300/0 conn(0x7f03ec15c6d0 0x7f03ec15bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:23:55.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.023+0000 7f03e2a00640 1 --2- 172.21.15.32:0/3771699025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03ec15f250 0x7f03ec06d160 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f03d40097c0 tx=0x7f03d401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad76033987c61a3d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:55.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.023+0000 7f03eaa00640 1 -- 172.21.15.32:0/3771699025 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d40b1070 con 0x7f03ec15f250 2024-03-19T06:23:55.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.023+0000 7f03eaa00640 1 -- 172.21.15.32:0/3771699025 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d40ac410 con 0x7f03ec15f250 2024-03-19T06:23:55.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.023+0000 7f03eaa00640 1 -- 172.21.15.32:0/3771699025 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d40ac7e0 con 0x7f03ec15f250 2024-03-19T06:23:55.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.023+0000 7f03f0a00640 1 -- 172.21.15.32:0/3771699025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03ec15f250 msgr2=0x7f03ec06d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.023+0000 7f03f0a00640 1 --2- 172.21.15.32:0/3771699025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03ec15f250 0x7f03ec06d160 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f03d40097c0 tx=0x7f03d401c4a0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.023+0000 7f03f0a00640 1 -- 172.21.15.32:0/3771699025 shutdown_connections 2024-03-19T06:23:55.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.023+0000 7f03f0a00640 1 --2- 172.21.15.32:0/3771699025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03ec15f250 0x7f03ec06d160 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.023+0000 7f03f0a00640 1 --2- 172.21.15.32:0/3771699025 >> v2:172.21.15.171:3300/0 conn(0x7f03ec15c6d0 0x7f03ec15bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.023+0000 7f03f0a00640 1 -- 172.21.15.32:0/3771699025 >> 172.21.15.32:0/3771699025 conn(0x7f03ec0b16b0 msgr2=0x7f03ec06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:55.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.023+0000 7f03f0a00640 1 -- 172.21.15.32:0/3771699025 shutdown_connections 2024-03-19T06:23:55.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.023+0000 7f03f0a00640 1 -- 172.21.15.32:0/3771699025 wait complete. 2024-03-19T06:23:55.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.023+0000 7f03f0a00640 1 Processor -- start 2024-03-19T06:23:55.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.023+0000 7f03f0a00640 1 -- start start 2024-03-19T06:23:55.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03f0a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03ec06d6a0 0x7f03ec14c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03f0a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03ec15c6d0 0x7f03ec0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03f0a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03ec15f250 0x7f03ec0b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03f0a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec15d780 con 0x7f03ec06d6a0 2024-03-19T06:23:55.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03f0a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec15d600 con 0x7f03ec15c6d0 2024-03-19T06:23:55.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03f0a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec15d900 con 0x7f03ec15f250 2024-03-19T06:23:55.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03eb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03ec06d6a0 0x7f03ec14c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:55.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03eb400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03ec06d6a0 0x7f03ec14c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42234/0 (socket says 172.21.15.32:42234) 2024-03-19T06:23:55.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03eb400640 1 -- 172.21.15.32:0/2019823954 learned_addr learned my addr 172.21.15.32:0/2019823954 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:55.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03eb400640 1 -- 172.21.15.32:0/2019823954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03ec15f250 msgr2=0x7f03ec0b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03eb400640 1 --2- 172.21.15.32:0/2019823954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03ec15f250 0x7f03ec0b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03eb400640 1 -- 172.21.15.32:0/2019823954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03ec15c6d0 msgr2=0x7f03ec0718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03eb400640 1 --2- 172.21.15.32:0/2019823954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03ec15c6d0 0x7f03ec0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03eb400640 1 -- 172.21.15.32:0/2019823954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec0ca4d0 con 0x7f03ec06d6a0 2024-03-19T06:23:55.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03eb400640 1 --2- 172.21.15.32:0/2019823954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03ec06d6a0 0x7f03ec14c7f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00ebe0 tx=0x7f03dc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:55.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03e3e00640 1 -- 172.21.15.32:0/2019823954 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc017070 con 0x7f03ec06d6a0 2024-03-19T06:23:55.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03e3e00640 1 -- 172.21.15.32:0/2019823954 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc00cc30 con 0x7f03ec06d6a0 2024-03-19T06:23:55.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03e3e00640 1 -- 172.21.15.32:0/2019823954 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc013470 con 0x7f03ec06d6a0 2024-03-19T06:23:55.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03f0a00640 1 -- 172.21.15.32:0/2019823954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ec0ca7b0 con 0x7f03ec06d6a0 2024-03-19T06:23:55.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03f0a00640 1 -- 172.21.15.32:0/2019823954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ec0cad70 con 0x7f03ec06d6a0 2024-03-19T06:23:55.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03f0a00640 1 -- 172.21.15.32:0/2019823954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ec075090 con 0x7f03ec06d6a0 2024-03-19T06:23:55.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.027+0000 7f03e3e00640 1 -- 172.21.15.32:0/2019823954 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f03dc01a070 con 0x7f03ec06d6a0 2024-03-19T06:23:55.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.031+0000 7f03e3e00640 1 --2- 172.21.15.32:0/2019823954 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f03c8067660 0x7f03c8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.031+0000 7f03e3e00640 1 -- 172.21.15.32:0/2019823954 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f03dc085bf0 con 0x7f03ec06d6a0 2024-03-19T06:23:55.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.031+0000 7f03e2a00640 1 --2- 172.21.15.32:0/2019823954 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f03c8067660 0x7f03c8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:55.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.031+0000 7f03e2a00640 1 --2- 172.21.15.32:0/2019823954 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f03c8067660 0x7f03c8069b20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f03d40ae000 tx=0x7f03d4004740 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:55.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.035+0000 7f03e3e00640 1 -- 172.21.15.32:0/2019823954 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f03dc056820 con 0x7f03ec06d6a0 2024-03-19T06:23:55.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.199+0000 7f03f0a00640 1 -- 172.21.15.32:0/2019823954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f03ec150ae0 con 0x7f03ec06d6a0 2024-03-19T06:23:55.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.199+0000 7f03e3e00640 1 -- 172.21.15.32:0/2019823954 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f03dc056120 con 0x7f03ec06d6a0 2024-03-19T06:23:55.185 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.199+0000 7f03f0a00640 1 -- 172.21.15.32:0/2019823954 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f03c8067660 msgr2=0x7f03c8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.199+0000 7f03f0a00640 1 --2- 172.21.15.32:0/2019823954 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f03c8067660 0x7f03c8069b20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f03d40ae000 tx=0x7f03d4004740 comp rx=0 tx=0).stop 2024-03-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.199+0000 7f03f0a00640 1 -- 172.21.15.32:0/2019823954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03ec06d6a0 msgr2=0x7f03ec14c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.199+0000 7f03f0a00640 1 --2- 172.21.15.32:0/2019823954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03ec06d6a0 0x7f03ec14c7f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00ebe0 tx=0x7f03dc00c520 comp rx=0 tx=0).stop 2024-03-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.199+0000 7f03f0a00640 1 -- 172.21.15.32:0/2019823954 shutdown_connections 2024-03-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.199+0000 7f03f0a00640 1 --2- 172.21.15.32:0/2019823954 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f03c8067660 0x7f03c8069b20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.199+0000 7f03f0a00640 1 --2- 172.21.15.32:0/2019823954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03ec15f250 0x7f03ec0b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.199+0000 7f03f0a00640 1 --2- 172.21.15.32:0/2019823954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03ec15c6d0 0x7f03ec0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.199+0000 7f03f0a00640 1 --2- 172.21.15.32:0/2019823954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03ec06d6a0 0x7f03ec14c7f0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.199+0000 7f03f0a00640 1 -- 172.21.15.32:0/2019823954 >> 172.21.15.32:0/2019823954 conn(0x7f03ec0b16b0 msgr2=0x7f03ec155920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.199+0000 7f03f0a00640 1 -- 172.21.15.32:0/2019823954 shutdown_connections 2024-03-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.199+0000 7f03f0a00640 1 -- 172.21.15.32:0/2019823954 wait complete. 2024-03-19T06:23:55.206 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:23:55.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba3be00640 1 Processor -- start 2024-03-19T06:23:55.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba3be00640 1 -- start start 2024-03-19T06:23:55.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba3be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fba34071550 0x7fba34071930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba3be00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba340b3690 0x7fba34150f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba3be00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba34071e70 con 0x7fba34150ad0 2024-03-19T06:23:55.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba3be00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba341514a0 con 0x7fba34071550 2024-03-19T06:23:55.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba3be00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba340b3c00 con 0x7fba340b3690 2024-03-19T06:23:55.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba38a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fba34150ad0 0x7fba340b2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43696/0 (socket says 172.21.15.32:43696) 2024-03-19T06:23:55.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba38a00640 1 -- 172.21.15.32:0/200567388 learned_addr learned my addr 172.21.15.32:0/200567388 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:55.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba39400640 1 --2- 172.21.15.32:0/200567388 >> v2:172.21.15.32:3300/0 conn(0x7fba34071550 0x7fba34071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:55.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba39e00640 1 --2- 172.21.15.32:0/200567388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba340b3690 0x7fba34150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:55.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba33e00640 1 -- 172.21.15.32:0/200567388 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362374411 0 0) 0x7fba34071e70 con 0x7fba34150ad0 2024-03-19T06:23:55.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba33e00640 1 -- 172.21.15.32:0/200567388 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba1c003530 con 0x7fba34150ad0 2024-03-19T06:23:55.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba39400640 1 -- 172.21.15.32:0/200567388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba340b3690 msgr2=0x7fba34150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:55.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba39400640 1 --2- 172.21.15.32:0/200567388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba340b3690 0x7fba34150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba39400640 1 -- 172.21.15.32:0/200567388 >> v1:172.21.15.32:6789/0 conn(0x7fba34150ad0 legacy=0x7fba340b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba39400640 1 -- 172.21.15.32:0/200567388 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba340b3ee0 con 0x7fba34071550 2024-03-19T06:23:55.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.363+0000 7fba39e00640 1 --2- 172.21.15.32:0/200567388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba340b3690 0x7fba34150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:55.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.367+0000 7fba39400640 1 --2- 172.21.15.32:0/200567388 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba34071550 0x7fba34071930 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fba280097c0 tx=0x7fba2801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7060830de2010c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:55.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.367+0000 7fba33e00640 1 -- 172.21.15.32:0/200567388 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba280b2070 con 0x7fba34071550 2024-03-19T06:23:55.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.367+0000 7fba33e00640 1 -- 172.21.15.32:0/200567388 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba280ad640 con 0x7fba34071550 2024-03-19T06:23:55.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.367+0000 7fba33e00640 1 -- 172.21.15.32:0/200567388 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba280ada10 con 0x7fba34071550 2024-03-19T06:23:55.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.367+0000 7fba3be00640 1 -- 172.21.15.32:0/200567388 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba34071550 msgr2=0x7fba34071930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.367+0000 7fba3be00640 1 --2- 172.21.15.32:0/200567388 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba34071550 0x7fba34071930 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fba280097c0 tx=0x7fba2801c4a0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.367+0000 7fba3be00640 1 -- 172.21.15.32:0/200567388 shutdown_connections 2024-03-19T06:23:55.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.367+0000 7fba3be00640 1 --2- 172.21.15.32:0/200567388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba340b3690 0x7fba34150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.367+0000 7fba3be00640 1 --2- 172.21.15.32:0/200567388 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba34071550 0x7fba34071930 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.367+0000 7fba3be00640 1 -- 172.21.15.32:0/200567388 >> 172.21.15.32:0/200567388 conn(0x7fba340b1590 msgr2=0x7fba340b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:55.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.367+0000 7fba3be00640 1 -- 172.21.15.32:0/200567388 shutdown_connections 2024-03-19T06:23:55.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.367+0000 7fba3be00640 1 -- 172.21.15.32:0/200567388 wait complete. 2024-03-19T06:23:55.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba3be00640 1 Processor -- start 2024-03-19T06:23:55.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba3be00640 1 -- start start 2024-03-19T06:23:55.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba3be00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba34071550 0x7fba341fa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba3be00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba340b3690 0x7fba3413a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba3be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba34150ad0 0x7fba340cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba3be00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3406ad40 con 0x7fba34150ad0 2024-03-19T06:23:55.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba3be00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3415b450 con 0x7fba34071550 2024-03-19T06:23:55.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba3be00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3406aec0 con 0x7fba340b3690 2024-03-19T06:23:55.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba39e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba34150ad0 0x7fba340cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:55.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba39e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba34150ad0 0x7fba340cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42244/0 (socket says 172.21.15.32:42244) 2024-03-19T06:23:55.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba39e00640 1 -- 172.21.15.32:0/687936939 learned_addr learned my addr 172.21.15.32:0/687936939 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:55.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba39e00640 1 -- 172.21.15.32:0/687936939 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba340b3690 msgr2=0x7fba3413a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba39400640 1 --2- 172.21.15.32:0/687936939 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba34071550 0x7fba341fa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:55.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba38a00640 1 --2- 172.21.15.32:0/687936939 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba340b3690 0x7fba3413a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:55.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba39e00640 1 --2- 172.21.15.32:0/687936939 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba340b3690 0x7fba3413a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba39e00640 1 -- 172.21.15.32:0/687936939 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba34071550 msgr2=0x7fba341fa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba39e00640 1 --2- 172.21.15.32:0/687936939 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba34071550 0x7fba341fa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba39e00640 1 -- 172.21.15.32:0/687936939 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba341fae60 con 0x7fba34150ad0 2024-03-19T06:23:55.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba39400640 1 --2- 172.21.15.32:0/687936939 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba34071550 0x7fba341fa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:55.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba38a00640 1 --2- 172.21.15.32:0/687936939 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba340b3690 0x7fba3413a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:55.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba39e00640 1 --2- 172.21.15.32:0/687936939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba34150ad0 0x7fba340cd350 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fba2c007ef0 tx=0x7fba2c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:55.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba31600640 1 -- 172.21.15.32:0/687936939 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c01a070 con 0x7fba34150ad0 2024-03-19T06:23:55.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba31600640 1 -- 172.21.15.32:0/687936939 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2c003ba0 con 0x7fba34150ad0 2024-03-19T06:23:55.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba31600640 1 -- 172.21.15.32:0/687936939 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c004030 con 0x7fba34150ad0 2024-03-19T06:23:55.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba3be00640 1 -- 172.21.15.32:0/687936939 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba34154660 con 0x7fba34150ad0 2024-03-19T06:23:55.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba3be00640 1 -- 172.21.15.32:0/687936939 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3413e620 con 0x7fba34150ad0 2024-03-19T06:23:55.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.371+0000 7fba3be00640 1 -- 172.21.15.32:0/687936939 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba340749e0 con 0x7fba34150ad0 2024-03-19T06:23:55.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.375+0000 7fba31600640 1 -- 172.21.15.32:0/687936939 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fba2c01d070 con 0x7fba34150ad0 2024-03-19T06:23:55.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.375+0000 7fba31600640 1 --2- 172.21.15.32:0/687936939 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba14067660 0x7fba14069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.375+0000 7fba31600640 1 -- 172.21.15.32:0/687936939 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fba2c085a00 con 0x7fba34150ad0 2024-03-19T06:23:55.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.375+0000 7fba39400640 1 --2- 172.21.15.32:0/687936939 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba14067660 0x7fba14069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:55.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.375+0000 7fba39400640 1 --2- 172.21.15.32:0/687936939 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba14067660 0x7fba14069b20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fba280af000 tx=0x7fba28008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:55.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.379+0000 7fba31600640 1 -- 172.21.15.32:0/687936939 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fba341fae60 con 0x7fba34150ad0 2024-03-19T06:23:55.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.539+0000 7fba3be00640 1 -- 172.21.15.32:0/687936939 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fba340722a0 con 0x7fba34150ad0 2024-03-19T06:23:55.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.539+0000 7fba31600640 1 -- 172.21.15.32:0/687936939 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7fba2c010070 con 0x7fba34150ad0 2024-03-19T06:23:55.528 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:23:55.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.543+0000 7fba3be00640 1 -- 172.21.15.32:0/687936939 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba14067660 msgr2=0x7fba14069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.543+0000 7fba3be00640 1 --2- 172.21.15.32:0/687936939 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba14067660 0x7fba14069b20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fba280af000 tx=0x7fba28008040 comp rx=0 tx=0).stop 2024-03-19T06:23:55.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.543+0000 7fba3be00640 1 -- 172.21.15.32:0/687936939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba34150ad0 msgr2=0x7fba340cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.543+0000 7fba3be00640 1 --2- 172.21.15.32:0/687936939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba34150ad0 0x7fba340cd350 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fba2c007ef0 tx=0x7fba2c00d4a0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.543+0000 7fba3be00640 1 -- 172.21.15.32:0/687936939 shutdown_connections 2024-03-19T06:23:55.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.543+0000 7fba3be00640 1 --2- 172.21.15.32:0/687936939 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fba14067660 0x7fba14069b20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.543+0000 7fba3be00640 1 --2- 172.21.15.32:0/687936939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba34150ad0 0x7fba340cd350 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.543+0000 7fba3be00640 1 --2- 172.21.15.32:0/687936939 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba340b3690 0x7fba3413a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.543+0000 7fba3be00640 1 --2- 172.21.15.32:0/687936939 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba34071550 0x7fba341fa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.543+0000 7fba3be00640 1 -- 172.21.15.32:0/687936939 >> 172.21.15.32:0/687936939 conn(0x7fba340b1590 msgr2=0x7fba34150330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:55.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.543+0000 7fba3be00640 1 -- 172.21.15.32:0/687936939 shutdown_connections 2024-03-19T06:23:55.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.543+0000 7fba3be00640 1 -- 172.21.15.32:0/687936939 wait complete. 2024-03-19T06:23:55.549 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:23:55.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.703+0000 7fabf4a00640 1 Processor -- start 2024-03-19T06:23:55.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.703+0000 7fabf4a00640 1 -- start start 2024-03-19T06:23:55.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.707+0000 7fabf4a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fabf006d6c0 0x7fabf006daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.707+0000 7fabf4a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf015fe20 con 0x7fabf00aecf0 2024-03-19T06:23:55.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.707+0000 7fabf4a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf0160100 con 0x7fabf015c010 2024-03-19T06:23:55.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.707+0000 7fabf4a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf01603e0 con 0x7fabf006d6c0 2024-03-19T06:23:55.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.707+0000 7fabede00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fabf00aecf0 0x7fabf00ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43710/0 (socket says 172.21.15.32:43710) 2024-03-19T06:23:55.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.707+0000 7fabede00640 1 -- 172.21.15.32:0/2431855664 learned_addr learned my addr 172.21.15.32:0/2431855664 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:55.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.707+0000 7fabee800640 1 --2- 172.21.15.32:0/2431855664 >> v2:172.21.15.32:3300/0 conn(0x7fabf006d6c0 0x7fabf006daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:55.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.707+0000 7fabed400640 1 -- 172.21.15.32:0/2431855664 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202650521 0 0) 0x7fabf015fe20 con 0x7fabf00aecf0 2024-03-19T06:23:55.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.707+0000 7fabed400640 1 -- 172.21.15.32:0/2431855664 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabd4003530 con 0x7fabf00aecf0 2024-03-19T06:23:55.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.707+0000 7fabee800640 1 -- 172.21.15.32:0/2431855664 >> v1:172.21.15.171:6789/0 conn(0x7fabf015c010 legacy=0x7fabf015f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.707+0000 7fabee800640 1 -- 172.21.15.32:0/2431855664 >> v1:172.21.15.32:6789/0 conn(0x7fabf00aecf0 legacy=0x7fabf00ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.707+0000 7fabee800640 1 -- 172.21.15.32:0/2431855664 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf00ca1f0 con 0x7fabf006d6c0 2024-03-19T06:23:55.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.711+0000 7fabee800640 1 --2- 172.21.15.32:0/2431855664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf006d6c0 0x7fabf006daf0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009d90 tx=0x7fabe801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24cc67a13c5b8d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:55.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.711+0000 7fabed400640 1 -- 172.21.15.32:0/2431855664 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe80b2070 con 0x7fabf006d6c0 2024-03-19T06:23:55.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.711+0000 7fabed400640 1 -- 172.21.15.32:0/2431855664 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe80a58b0 con 0x7fabf006d6c0 2024-03-19T06:23:55.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.711+0000 7fabed400640 1 -- 172.21.15.32:0/2431855664 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe80a5c80 con 0x7fabf006d6c0 2024-03-19T06:23:55.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.711+0000 7fabf4a00640 1 -- 172.21.15.32:0/2431855664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf006d6c0 msgr2=0x7fabf006daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.711+0000 7fabf4a00640 1 --2- 172.21.15.32:0/2431855664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf006d6c0 0x7fabf006daf0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009d90 tx=0x7fabe801c8e0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.711+0000 7fabf4a00640 1 -- 172.21.15.32:0/2431855664 shutdown_connections 2024-03-19T06:23:55.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.711+0000 7fabf4a00640 1 --2- 172.21.15.32:0/2431855664 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf006d6c0 0x7fabf006daf0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.711+0000 7fabf4a00640 1 -- 172.21.15.32:0/2431855664 >> 172.21.15.32:0/2431855664 conn(0x7fabf00b1280 msgr2=0x7fabf00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:55.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.711+0000 7fabf4a00640 1 -- 172.21.15.32:0/2431855664 shutdown_connections 2024-03-19T06:23:55.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.711+0000 7fabf4a00640 1 -- 172.21.15.32:0/2431855664 wait complete. 2024-03-19T06:23:55.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.711+0000 7fabf4a00640 1 Processor -- start 2024-03-19T06:23:55.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.711+0000 7fabf4a00640 1 -- start start 2024-03-19T06:23:55.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabf4a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabf006d6c0 0x7fabf0154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabf4a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf00aecf0 0x7fabf00ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabf4a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fabf015c010 0x7fabf0153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabf4a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf006e030 con 0x7fabf00aecf0 2024-03-19T06:23:55.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabf4a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00cbe70 con 0x7fabf006d6c0 2024-03-19T06:23:55.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabf4a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf01696a0 con 0x7fabf015c010 2024-03-19T06:23:55.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabe7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf00aecf0 0x7fabf00ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:55.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabe7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf00aecf0 0x7fabf00ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42256/0 (socket says 172.21.15.32:42256) 2024-03-19T06:23:55.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabe7e00640 1 -- 172.21.15.32:0/513891149 learned_addr learned my addr 172.21.15.32:0/513891149 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:55.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabede00640 1 --2- 172.21.15.32:0/513891149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabf006d6c0 0x7fabf0154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:55.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabe7e00640 1 -- 172.21.15.32:0/513891149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fabf015c010 msgr2=0x7fabf0153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabee800640 1 --2- 172.21.15.32:0/513891149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fabf015c010 0x7fabf0153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:55.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabe7e00640 1 --2- 172.21.15.32:0/513891149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fabf015c010 0x7fabf0153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabe7e00640 1 -- 172.21.15.32:0/513891149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabf006d6c0 msgr2=0x7fabf0154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabe7e00640 1 --2- 172.21.15.32:0/513891149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabf006d6c0 0x7fabf0154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabe7e00640 1 -- 172.21.15.32:0/513891149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf00cf0a0 con 0x7fabf00aecf0 2024-03-19T06:23:55.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabede00640 1 --2- 172.21.15.32:0/513891149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabf006d6c0 0x7fabf0154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:55.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabee800640 1 --2- 172.21.15.32:0/513891149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fabf015c010 0x7fabf0153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:55.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabe7e00640 1 --2- 172.21.15.32:0/513891149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf00aecf0 0x7fabf00ceb60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fabd800c370 tx=0x7fabd800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:55.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabe6000640 1 -- 172.21.15.32:0/513891149 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80052d0 con 0x7fabf00aecf0 2024-03-19T06:23:55.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabe6000640 1 -- 172.21.15.32:0/513891149 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd8005470 con 0x7fabf00aecf0 2024-03-19T06:23:55.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabe6000640 1 -- 172.21.15.32:0/513891149 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8007260 con 0x7fabf00aecf0 2024-03-19T06:23:55.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabf4a00640 1 -- 172.21.15.32:0/513891149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf00ce1d0 con 0x7fabf00aecf0 2024-03-19T06:23:55.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabf4a00640 1 -- 172.21.15.32:0/513891149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf01566f0 con 0x7fabf00aecf0 2024-03-19T06:23:55.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabf4a00640 1 -- 172.21.15.32:0/513891149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf00749e0 con 0x7fabf00aecf0 2024-03-19T06:23:55.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.715+0000 7fabe6000640 1 -- 172.21.15.32:0/513891149 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fabd8007400 con 0x7fabf00aecf0 2024-03-19T06:23:55.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.719+0000 7fabe6000640 1 --2- 172.21.15.32:0/513891149 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fabcc067660 0x7fabcc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:55.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.719+0000 7fabe6000640 1 -- 172.21.15.32:0/513891149 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fabd8084d50 con 0x7fabf00aecf0 2024-03-19T06:23:55.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.719+0000 7fabede00640 1 --2- 172.21.15.32:0/513891149 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fabcc067660 0x7fabcc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:55.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.719+0000 7fabede00640 1 --2- 172.21.15.32:0/513891149 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fabcc067660 0x7fabcc069b20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fabe00011f0 tx=0x7fabe0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:55.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.723+0000 7fabe6000640 1 -- 172.21.15.32:0/513891149 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fabd8088030 con 0x7fabf00aecf0 2024-03-19T06:23:55.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.895+0000 7fabf4a00640 1 -- 172.21.15.32:0/513891149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fabf00c8a30 con 0x7fabf00aecf0 2024-03-19T06:23:55.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.895+0000 7fabe6000640 1 -- 172.21.15.32:0/513891149 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) v1 ==== 80+0+0 (secure 0 0 0) 0x7fabd8055990 con 0x7fabf00aecf0 2024-03-19T06:23:55.884 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-03-19T06:23:55.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.899+0000 7fabf4a00640 1 -- 172.21.15.32:0/513891149 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fabcc067660 msgr2=0x7fabcc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.899+0000 7fabf4a00640 1 --2- 172.21.15.32:0/513891149 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fabcc067660 0x7fabcc069b20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fabe00011f0 tx=0x7fabe0009040 comp rx=0 tx=0).stop 2024-03-19T06:23:55.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.899+0000 7fabf4a00640 1 -- 172.21.15.32:0/513891149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf00aecf0 msgr2=0x7fabf00ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:55.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.899+0000 7fabf4a00640 1 --2- 172.21.15.32:0/513891149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf00aecf0 0x7fabf00ceb60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fabd800c370 tx=0x7fabd800c830 comp rx=0 tx=0).stop 2024-03-19T06:23:55.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.899+0000 7fabf4a00640 1 -- 172.21.15.32:0/513891149 shutdown_connections 2024-03-19T06:23:55.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.899+0000 7fabf4a00640 1 --2- 172.21.15.32:0/513891149 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fabcc067660 0x7fabcc069b20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.899+0000 7fabf4a00640 1 --2- 172.21.15.32:0/513891149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fabf015c010 0x7fabf0153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.899+0000 7fabf4a00640 1 --2- 172.21.15.32:0/513891149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabf00aecf0 0x7fabf00ceb60 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.899+0000 7fabf4a00640 1 --2- 172.21.15.32:0/513891149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabf006d6c0 0x7fabf0154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:55.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.899+0000 7fabf4a00640 1 -- 172.21.15.32:0/513891149 >> 172.21.15.32:0/513891149 conn(0x7fabf00b1280 msgr2=0x7fabf00ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:55.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.899+0000 7fabf4a00640 1 -- 172.21.15.32:0/513891149 shutdown_connections 2024-03-19T06:23:55.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:55.899+0000 7fabf4a00640 1 -- 172.21.15.32:0/513891149 wait complete. 2024-03-19T06:23:55.906 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi032.front.sepia.ceph.com... 2024-03-19T06:23:55.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:55.906 DEBUG:teuthology.orchestra.run.smithi032:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-19T06:23:55.923 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[39978]: fuse finished with error 0 and tester_r 0 2024-03-19T06:23:55.926 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:23:55.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:55.926 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-19T06:23:56.082 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:23:56.082 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:23:56.092 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-19T06:23:56.092 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:23:56.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:56.092 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-19T06:23:56.142 INFO:teuthology.orchestra.run.smithi171.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-03-19T06:23:56.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:23:56.143 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:23:56.143 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:23:56.152 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357716k,nr_inodes=4089429,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4371 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-19T06:23:56.152 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:23:56.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:56.152 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-19T06:23:56.200 INFO:teuthology.orchestra.run.smithi032.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-03-19T06:23:56.200 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:23:56.201 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:23:56.201 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:23:56.209 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-19T06:23:56.209 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:23:56.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:23:56.209 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-19T06:23:56.257 INFO:teuthology.orchestra.run.smithi171.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-03-19T06:23:56.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:23:56.258 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:23:56.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.411+0000 7fa198600640 1 Processor -- start 2024-03-19T06:23:56.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.411+0000 7fa198600640 1 -- start start 2024-03-19T06:23:56.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.415+0000 7fa198600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa19015c010 0x7fa19015f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:56.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.415+0000 7fa198600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19015fe20 con 0x7fa1900aecf0 2024-03-19T06:23:56.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.415+0000 7fa198600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa190160100 con 0x7fa19006d6c0 2024-03-19T06:23:56.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.415+0000 7fa198600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1901603e0 con 0x7fa19015c010 2024-03-19T06:23:56.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.415+0000 7fa195200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa19015c010 0x7fa19015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:56.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.415+0000 7fa195c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa1900aecf0 0x7fa1900ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43720/0 (socket says 172.21.15.32:43720) 2024-03-19T06:23:56.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.415+0000 7fa195c00640 1 -- 172.21.15.32:0/4003485001 learned_addr learned my addr 172.21.15.32:0/4003485001 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:56.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.415+0000 7fa195200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa19015c010 0x7fa19015f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42272/0 (socket says 172.21.15.32:42272) 2024-03-19T06:23:56.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.415+0000 7fa195200640 1 -- 172.21.15.32:0/4003485001 >> v1:172.21.15.171:6789/0 conn(0x7fa19006d6c0 legacy=0x7fa1900cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:56.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.415+0000 7fa195200640 1 -- 172.21.15.32:0/4003485001 >> v1:172.21.15.32:6789/0 conn(0x7fa1900aecf0 legacy=0x7fa1900ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:56.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.415+0000 7fa18fe00640 1 -- 172.21.15.32:0/4003485001 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786566815 0 0) 0x7fa19015fe20 con 0x7fa1900aecf0 2024-03-19T06:23:56.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.415+0000 7fa195200640 1 -- 172.21.15.32:0/4003485001 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900ca1f0 con 0x7fa19015c010 2024-03-19T06:23:56.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.415+0000 7fa195200640 1 --2- 172.21.15.32:0/4003485001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa19015c010 0x7fa19015f520 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0097c0 tx=0x7fa17c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb64ec9d706f327 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:56.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa18fe00640 1 -- 172.21.15.32:0/4003485001 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0b0070 con 0x7fa19015c010 2024-03-19T06:23:56.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa18fe00640 1 -- 172.21.15.32:0/4003485001 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c0ab600 con 0x7fa19015c010 2024-03-19T06:23:56.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa18fe00640 1 -- 172.21.15.32:0/4003485001 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0ab9d0 con 0x7fa19015c010 2024-03-19T06:23:56.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa198600640 1 -- 172.21.15.32:0/4003485001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa19015c010 msgr2=0x7fa19015f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:56.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa198600640 1 --2- 172.21.15.32:0/4003485001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa19015c010 0x7fa19015f520 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0097c0 tx=0x7fa17c01c3d0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa198600640 1 -- 172.21.15.32:0/4003485001 shutdown_connections 2024-03-19T06:23:56.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa198600640 1 --2- 172.21.15.32:0/4003485001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa19015c010 0x7fa19015f520 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa198600640 1 -- 172.21.15.32:0/4003485001 >> 172.21.15.32:0/4003485001 conn(0x7fa1900b1280 msgr2=0x7fa1900b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:56.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa198600640 1 -- 172.21.15.32:0/4003485001 shutdown_connections 2024-03-19T06:23:56.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa198600640 1 -- 172.21.15.32:0/4003485001 wait complete. 2024-03-19T06:23:56.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa198600640 1 Processor -- start 2024-03-19T06:23:56.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa198600640 1 -- start start 2024-03-19T06:23:56.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa198600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa19006d6c0 0x7fa190155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:56.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa198600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1900aecf0 0x7fa190155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:56.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa198600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa19015c010 0x7fa1900ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:56.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa198600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19016a030 con 0x7fa1900aecf0 2024-03-19T06:23:56.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa198600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa190169eb0 con 0x7fa19015c010 2024-03-19T06:23:56.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa198600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19016a1b0 con 0x7fa19006d6c0 2024-03-19T06:23:56.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa195200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1900aecf0 0x7fa190155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:56.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa195200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1900aecf0 0x7fa190155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42280/0 (socket says 172.21.15.32:42280) 2024-03-19T06:23:56.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa195200640 1 -- 172.21.15.32:0/3740245712 learned_addr learned my addr 172.21.15.32:0/3740245712 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:56.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa195c00640 1 --2- 172.21.15.32:0/3740245712 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa19006d6c0 0x7fa190155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:56.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.419+0000 7fa196600640 1 --2- 172.21.15.32:0/3740245712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa19015c010 0x7fa1900ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:56.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.423+0000 7fa195200640 1 -- 172.21.15.32:0/3740245712 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa19006d6c0 msgr2=0x7fa190155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:56.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.423+0000 7fa195200640 1 --2- 172.21.15.32:0/3740245712 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa19006d6c0 0x7fa190155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.423+0000 7fa195200640 1 -- 172.21.15.32:0/3740245712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa19015c010 msgr2=0x7fa1900ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:56.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.423+0000 7fa195200640 1 --2- 172.21.15.32:0/3740245712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa19015c010 0x7fa1900ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.423+0000 7fa195200640 1 -- 172.21.15.32:0/3740245712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900adf60 con 0x7fa1900aecf0 2024-03-19T06:23:56.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.423+0000 7fa195200640 1 --2- 172.21.15.32:0/3740245712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1900aecf0 0x7fa190155cf0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa17c018fe0 tx=0x7fa17c01ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:56.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.423+0000 7fa18d600640 1 -- 172.21.15.32:0/3740245712 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0b0050 con 0x7fa1900aecf0 2024-03-19T06:23:56.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.423+0000 7fa18d600640 1 -- 172.21.15.32:0/3740245712 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c0bc070 con 0x7fa1900aecf0 2024-03-19T06:23:56.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.423+0000 7fa18d600640 1 -- 172.21.15.32:0/3740245712 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0b5830 con 0x7fa1900aecf0 2024-03-19T06:23:56.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.423+0000 7fa198600640 1 -- 172.21.15.32:0/3740245712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1900ae200 con 0x7fa1900aecf0 2024-03-19T06:23:56.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.423+0000 7fa198600640 1 -- 172.21.15.32:0/3740245712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa190155960 con 0x7fa1900aecf0 2024-03-19T06:23:56.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.423+0000 7fa198600640 1 -- 172.21.15.32:0/3740245712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1900749e0 con 0x7fa1900aecf0 2024-03-19T06:23:56.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.423+0000 7fa18d600640 1 -- 172.21.15.32:0/3740245712 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa17c0b59d0 con 0x7fa1900aecf0 2024-03-19T06:23:56.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.423+0000 7fa18d600640 1 --2- 172.21.15.32:0/3740245712 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa170067660 0x7fa170069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:56.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.423+0000 7fa18d600640 1 -- 172.21.15.32:0/3740245712 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa17c120070 con 0x7fa1900aecf0 2024-03-19T06:23:56.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.427+0000 7fa195c00640 1 --2- 172.21.15.32:0/3740245712 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa170067660 0x7fa170069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:56.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.427+0000 7fa195c00640 1 --2- 172.21.15.32:0/3740245712 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa170067660 0x7fa170069b20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa184000f70 tx=0x7fa184007c10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:56.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.427+0000 7fa18d600640 1 -- 172.21.15.32:0/3740245712 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fa17c016050 con 0x7fa1900aecf0 2024-03-19T06:23:56.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.627+0000 7fa198600640 1 -- 172.21.15.32:0/3740245712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa190156da0 con 0x7fa1900aecf0 2024-03-19T06:23:56.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.627+0000 7fa18d600640 1 -- 172.21.15.32:0/3740245712 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fa17c0f0cb0 con 0x7fa1900aecf0 2024-03-19T06:23:56.614 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:56.614 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3631486110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3631486110},{"type":"v1","addr":"172.21.15.171:6836","nonce":3631486110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/3410824978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3410824978},{"type":"v1","addr":"172.21.15.32:6833","nonce":3410824978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3585939515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3585939515},{"type":"v1","addr":"172.21.15.32:6835","nonce":3585939515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:23:21.920668+0000","modified":"2024-03-19T06:23:24.948860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5934},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5934":{"gid":5934,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/1907516739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1907516739},{"type":"v1","addr":"172.21.15.171:6837","nonce":1907516739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-03-19T06:23:56.614 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 26 2024-03-19T06:23:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.627+0000 7fa198600640 1 -- 172.21.15.32:0/3740245712 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa170067660 msgr2=0x7fa170069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.627+0000 7fa198600640 1 --2- 172.21.15.32:0/3740245712 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa170067660 0x7fa170069b20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa184000f70 tx=0x7fa184007c10 comp rx=0 tx=0).stop 2024-03-19T06:23:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.627+0000 7fa198600640 1 -- 172.21.15.32:0/3740245712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1900aecf0 msgr2=0x7fa190155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.627+0000 7fa198600640 1 --2- 172.21.15.32:0/3740245712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1900aecf0 0x7fa190155cf0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa17c018fe0 tx=0x7fa17c01ac10 comp rx=0 tx=0).stop 2024-03-19T06:23:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.627+0000 7fa198600640 1 -- 172.21.15.32:0/3740245712 shutdown_connections 2024-03-19T06:23:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.627+0000 7fa198600640 1 --2- 172.21.15.32:0/3740245712 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fa170067660 0x7fa170069b20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.627+0000 7fa198600640 1 --2- 172.21.15.32:0/3740245712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa19015c010 0x7fa1900ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.627+0000 7fa198600640 1 --2- 172.21.15.32:0/3740245712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1900aecf0 0x7fa190155cf0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.627+0000 7fa198600640 1 --2- 172.21.15.32:0/3740245712 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa19006d6c0 0x7fa190155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.627+0000 7fa198600640 1 -- 172.21.15.32:0/3740245712 >> 172.21.15.32:0/3740245712 conn(0x7fa1900b1280 msgr2=0x7fa1900c93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:56.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.627+0000 7fa198600640 1 -- 172.21.15.32:0/3740245712 shutdown_connections 2024-03-19T06:23:56.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.627+0000 7fa198600640 1 -- 172.21.15.32:0/3740245712 wait complete. 2024-03-19T06:23:56.635 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:23:56.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.787+0000 7f6ec5c00640 1 Processor -- start 2024-03-19T06:23:56.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.787+0000 7f6ec5c00640 1 -- start start 2024-03-19T06:23:56.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.791+0000 7f6ec5c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ec015c010 0x7f6ec015f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:56.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.791+0000 7f6ec5c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6ec006d6c0 0x7f6ec006db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:56.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.791+0000 7f6ec5c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec015fe20 con 0x7f6ec00aecf0 2024-03-19T06:23:56.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.791+0000 7f6ec5c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec006e070 con 0x7f6ec006d6c0 2024-03-19T06:23:56.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.791+0000 7f6ec5c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec01603e0 con 0x7f6ec015c010 2024-03-19T06:23:56.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.791+0000 7f6eb7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ec015c010 0x7f6ec015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:56.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.791+0000 7f6eb7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ec015c010 0x7f6ec015f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:60090/0 (socket says 172.21.15.32:60090) 2024-03-19T06:23:56.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.791+0000 7f6ebf400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6ec006d6c0 0x7f6ec006db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:56.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.791+0000 7f6eb7e00640 1 -- 172.21.15.32:0/1883228096 learned_addr learned my addr 172.21.15.32:0/1883228096 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:56.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.791+0000 7f6ebea00640 1 --1- 172.21.15.32:0/1883228096 >> v1:172.21.15.171:6789/0 conn(0x7f6ec00aecf0 0x7f6ec00ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:42990/0 (socket says 172.21.15.32:42990) 2024-03-19T06:23:56.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.791+0000 7f6eb7e00640 1 -- 172.21.15.32:0/1883228096 >> v2:172.21.15.171:3300/0 conn(0x7f6ec006d6c0 msgr2=0x7f6ec006db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:56.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.791+0000 7f6eb7e00640 1 --2- 172.21.15.32:0/1883228096 >> v2:172.21.15.171:3300/0 conn(0x7f6ec006d6c0 0x7f6ec006db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.791+0000 7f6eb7e00640 1 -- 172.21.15.32:0/1883228096 >> v1:172.21.15.171:6789/0 conn(0x7f6ec00aecf0 legacy=0x7f6ec00ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:56.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.791+0000 7f6eb7e00640 1 -- 172.21.15.32:0/1883228096 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec0160100 con 0x7f6ec015c010 2024-03-19T06:23:56.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.791+0000 7f6ebf400640 1 --2- 172.21.15.32:0/1883228096 >> v2:172.21.15.171:3300/0 conn(0x7f6ec006d6c0 0x7f6ec006db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:23:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.795+0000 7f6eb7e00640 1 --2- 172.21.15.32:0/1883228096 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ec015c010 0x7f6ec015f520 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009870 tx=0x7f6ea801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3d7aee8dadd969c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:56.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.795+0000 7f6ebe000640 1 -- 172.21.15.32:0/1883228096 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea80b1070 con 0x7f6ec015c010 2024-03-19T06:23:56.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.795+0000 7f6ebe000640 1 -- 172.21.15.32:0/1883228096 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea80a8050 con 0x7f6ec015c010 2024-03-19T06:23:56.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.795+0000 7f6ebe000640 1 -- 172.21.15.32:0/1883228096 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea80ac860 con 0x7f6ec015c010 2024-03-19T06:23:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.795+0000 7f6ec5c00640 1 -- 172.21.15.32:0/1883228096 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ec015c010 msgr2=0x7f6ec015f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.795+0000 7f6ec5c00640 1 --2- 172.21.15.32:0/1883228096 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ec015c010 0x7f6ec015f520 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009870 tx=0x7f6ea801c4d0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.795+0000 7f6ec5c00640 1 -- 172.21.15.32:0/1883228096 shutdown_connections 2024-03-19T06:23:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.795+0000 7f6ec5c00640 1 --2- 172.21.15.32:0/1883228096 >> v2:172.21.15.171:3300/0 conn(0x7f6ec006d6c0 0x7f6ec006db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.795+0000 7f6ec5c00640 1 --2- 172.21.15.32:0/1883228096 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ec015c010 0x7f6ec015f520 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.795+0000 7f6ec5c00640 1 -- 172.21.15.32:0/1883228096 >> 172.21.15.32:0/1883228096 conn(0x7f6ec00b1280 msgr2=0x7f6ec00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:56.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.795+0000 7f6ec5c00640 1 -- 172.21.15.32:0/1883228096 shutdown_connections 2024-03-19T06:23:56.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.795+0000 7f6ec5c00640 1 -- 172.21.15.32:0/1883228096 wait complete. 2024-03-19T06:23:56.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.795+0000 7f6ec5c00640 1 Processor -- start 2024-03-19T06:23:56.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.795+0000 7f6ec5c00640 1 -- start start 2024-03-19T06:23:56.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ec5c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ec006d6c0 0x7f6ec015e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:56.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ec5c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ec00aecf0 0x7f6ec0144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:56.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ec5c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ec015c010 0x7f6ec0145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:56.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ec5c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec00cbde0 con 0x7f6ec006d6c0 2024-03-19T06:23:56.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ec5c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec00cbc60 con 0x7f6ec00aecf0 2024-03-19T06:23:56.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ec5c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec0168690 con 0x7f6ec015c010 2024-03-19T06:23:56.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ebea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ec006d6c0 0x7f6ec015e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ebea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ec006d6c0 0x7f6ec015e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42284/0 (socket says 172.21.15.32:42284) 2024-03-19T06:23:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ebea00640 1 -- 172.21.15.32:0/2100245457 learned_addr learned my addr 172.21.15.32:0/2100245457 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ebf400640 1 --2- 172.21.15.32:0/2100245457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ec015c010 0x7f6ec0145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6eb7e00640 1 --2- 172.21.15.32:0/2100245457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ec00aecf0 0x7f6ec0144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ebea00640 1 -- 172.21.15.32:0/2100245457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ec015c010 msgr2=0x7f6ec0145160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ebea00640 1 --2- 172.21.15.32:0/2100245457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ec015c010 0x7f6ec0145160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ebea00640 1 -- 172.21.15.32:0/2100245457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ec00aecf0 msgr2=0x7f6ec0144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ebea00640 1 --2- 172.21.15.32:0/2100245457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ec00aecf0 0x7f6ec0144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ebea00640 1 -- 172.21.15.32:0/2100245457 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec00b3040 con 0x7f6ec006d6c0 2024-03-19T06:23:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ebea00640 1 --2- 172.21.15.32:0/2100245457 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ec006d6c0 0x7f6ec015e390 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000c370 tx=0x7f6eb000c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6eb6a00640 1 -- 172.21.15.32:0/2100245457 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00074e0 con 0x7f6ec006d6c0 2024-03-19T06:23:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6eb6a00640 1 -- 172.21.15.32:0/2100245457 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb0007680 con 0x7f6ec006d6c0 2024-03-19T06:23:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6eb6a00640 1 -- 172.21.15.32:0/2100245457 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0004a30 con 0x7f6ec006d6c0 2024-03-19T06:23:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ec5c00640 1 -- 172.21.15.32:0/2100245457 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec00b3320 con 0x7f6ec006d6c0 2024-03-19T06:23:56.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ec5c00640 1 -- 172.21.15.32:0/2100245457 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec015e8d0 con 0x7f6ec006d6c0 2024-03-19T06:23:56.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.799+0000 7f6ec5c00640 1 -- 172.21.15.32:0/2100245457 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec00749e0 con 0x7f6ec006d6c0 2024-03-19T06:23:56.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.803+0000 7f6eb6a00640 1 -- 172.21.15.32:0/2100245457 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6eb001a020 con 0x7f6ec006d6c0 2024-03-19T06:23:56.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.803+0000 7f6eb6a00640 1 --2- 172.21.15.32:0/2100245457 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6e9c067660 0x7f6e9c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:56.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.803+0000 7f6eb6a00640 1 -- 172.21.15.32:0/2100245457 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6eb0084ff0 con 0x7f6ec006d6c0 2024-03-19T06:23:56.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.803+0000 7f6eb7e00640 1 --2- 172.21.15.32:0/2100245457 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6e9c067660 0x7f6e9c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:56.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.803+0000 7f6eb7e00640 1 --2- 172.21.15.32:0/2100245457 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6e9c067660 0x7f6e9c069b20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6ea80ae000 tx=0x7f6ea80a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:56.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.807+0000 7f6eb6a00640 1 -- 172.21.15.32:0/2100245457 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f6eb0055b60 con 0x7f6ec006d6c0 2024-03-19T06:23:56.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.971+0000 7f6ec5c00640 1 -- 172.21.15.32:0/2100245457 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ec00680d0 con 0x7f6ec006d6c0 2024-03-19T06:23:56.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.971+0000 7f6eb6a00640 1 -- 172.21.15.32:0/2100245457 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16721 (secure 0 0 0) 0x7f6eb0055460 con 0x7f6ec006d6c0 2024-03-19T06:23:56.959 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:56.959 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":53,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:23:51.649760+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:23:19.707249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-19T06:23:20.926932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1d","mappings":[{"from":0,"to":6}]},{"pgid":"8.25","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:23:56.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.971+0000 7f6ec5c00640 1 -- 172.21.15.32:0/2100245457 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6e9c067660 msgr2=0x7f6e9c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:56.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.971+0000 7f6ec5c00640 1 --2- 172.21.15.32:0/2100245457 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6e9c067660 0x7f6e9c069b20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6ea80ae000 tx=0x7f6ea80a7000 comp rx=0 tx=0).stop 2024-03-19T06:23:56.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.971+0000 7f6ec5c00640 1 -- 172.21.15.32:0/2100245457 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ec006d6c0 msgr2=0x7f6ec015e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:56.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.971+0000 7f6ec5c00640 1 --2- 172.21.15.32:0/2100245457 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ec006d6c0 0x7f6ec015e390 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000c370 tx=0x7f6eb000c770 comp rx=0 tx=0).stop 2024-03-19T06:23:56.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.971+0000 7f6ec5c00640 1 -- 172.21.15.32:0/2100245457 shutdown_connections 2024-03-19T06:23:56.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.971+0000 7f6ec5c00640 1 --2- 172.21.15.32:0/2100245457 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f6e9c067660 0x7f6e9c069b20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.971+0000 7f6ec5c00640 1 --2- 172.21.15.32:0/2100245457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ec015c010 0x7f6ec0145160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.971+0000 7f6ec5c00640 1 --2- 172.21.15.32:0/2100245457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ec00aecf0 0x7f6ec0144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.971+0000 7f6ec5c00640 1 --2- 172.21.15.32:0/2100245457 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ec006d6c0 0x7f6ec015e390 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:56.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.971+0000 7f6ec5c00640 1 -- 172.21.15.32:0/2100245457 >> 172.21.15.32:0/2100245457 conn(0x7f6ec00b1280 msgr2=0x7f6ec00ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:56.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.971+0000 7f6ec5c00640 1 -- 172.21.15.32:0/2100245457 shutdown_connections 2024-03-19T06:23:56.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:56.971+0000 7f6ec5c00640 1 -- 172.21.15.32:0/2100245457 wait complete. 2024-03-19T06:23:56.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:20:55.980374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:23:19.707249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:23:20.926932+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:23:56.981 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:23:57.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.139+0000 7fedfae00640 1 Processor -- start 2024-03-19T06:23:57.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.139+0000 7fedfae00640 1 -- start start 2024-03-19T06:23:57.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.139+0000 7fedfae00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fedf415a840 0x7fedf406f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.139+0000 7fedfae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedf40aea70 0x7fedf406ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.139+0000 7fedfae00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf40af2d0 con 0x7fedf406b280 2024-03-19T06:23:57.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.139+0000 7fedfae00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf40cdc20 con 0x7fedf415a840 2024-03-19T06:23:57.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.139+0000 7fedfae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf415eea0 con 0x7fedf40aea70 2024-03-19T06:23:57.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.139+0000 7fedf3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fedf415a840 0x7fedf406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.139+0000 7fedf3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fedf415a840 0x7fedf406f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42286/0 (socket says 172.21.15.32:42286) 2024-03-19T06:23:57.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.139+0000 7fedf3e00640 1 -- 172.21.15.32:0/3657997173 learned_addr learned my addr 172.21.15.32:0/3657997173 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:57.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.139+0000 7fedf3400640 1 --2- 172.21.15.32:0/3657997173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedf40aea70 0x7fedf406ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.139+0000 7fedf3e00640 1 -- 172.21.15.32:0/3657997173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedf40aea70 msgr2=0x7fedf406ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:57.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.139+0000 7fedf3e00640 1 --2- 172.21.15.32:0/3657997173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedf40aea70 0x7fedf406ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.139+0000 7fedf3e00640 1 -- 172.21.15.32:0/3657997173 >> v1:172.21.15.171:6789/0 conn(0x7fedf406b280 legacy=0x7fedf406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.139+0000 7fedf3e00640 1 -- 172.21.15.32:0/3657997173 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf415f180 con 0x7fedf415a840 2024-03-19T06:23:57.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.143+0000 7fedf3e00640 1 --2- 172.21.15.32:0/3657997173 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedf415a840 0x7fedf406f040 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fede4009870 tx=0x7fede401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b1398201a9d415 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:57.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.143+0000 7fedf2a00640 1 -- 172.21.15.32:0/3657997173 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede40b0070 con 0x7fedf415a840 2024-03-19T06:23:57.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.143+0000 7fedf2a00640 1 -- 172.21.15.32:0/3657997173 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede4004230 con 0x7fedf415a840 2024-03-19T06:23:57.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.143+0000 7fedf2a00640 1 -- 172.21.15.32:0/3657997173 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4003620 con 0x7fedf415a840 2024-03-19T06:23:57.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.143+0000 7fedfae00640 1 -- 172.21.15.32:0/3657997173 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedf415a840 msgr2=0x7fedf406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.143+0000 7fedfae00640 1 --2- 172.21.15.32:0/3657997173 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedf415a840 0x7fedf406f040 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fede4009870 tx=0x7fede401c440 comp rx=0 tx=0).stop 2024-03-19T06:23:57.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.143+0000 7fedfae00640 1 -- 172.21.15.32:0/3657997173 shutdown_connections 2024-03-19T06:23:57.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.143+0000 7fedfae00640 1 --2- 172.21.15.32:0/3657997173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedf40aea70 0x7fedf406ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.143+0000 7fedfae00640 1 --2- 172.21.15.32:0/3657997173 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedf415a840 0x7fedf406f040 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.143+0000 7fedfae00640 1 -- 172.21.15.32:0/3657997173 >> 172.21.15.32:0/3657997173 conn(0x7fedf40b1590 msgr2=0x7fedf40b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:57.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.143+0000 7fedfae00640 1 -- 172.21.15.32:0/3657997173 shutdown_connections 2024-03-19T06:23:57.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.143+0000 7fedfae00640 1 -- 172.21.15.32:0/3657997173 wait complete. 2024-03-19T06:23:57.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.143+0000 7fedfae00640 1 Processor -- start 2024-03-19T06:23:57.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.143+0000 7fedfae00640 1 -- start start 2024-03-19T06:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedfae00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedf406b280 0x7fedf4151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedfae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedf40aea70 0x7fedf40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedfae00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedf415a840 0x7fedf40b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedfae00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf40716d0 con 0x7fedf415a840 2024-03-19T06:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedfae00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf4071550 con 0x7fedf406b280 2024-03-19T06:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedfae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf4071850 con 0x7fedf40aea70 2024-03-19T06:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedf8e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedf415a840 0x7fedf40b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedf8e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedf415a840 0x7fedf40b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42288/0 (socket says 172.21.15.32:42288) 2024-03-19T06:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedf8e00640 1 -- 172.21.15.32:0/341677261 learned_addr learned my addr 172.21.15.32:0/341677261 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedf3400640 1 --2- 172.21.15.32:0/341677261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedf40aea70 0x7fedf40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedf3e00640 1 --2- 172.21.15.32:0/341677261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedf406b280 0x7fedf4151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedf8e00640 1 -- 172.21.15.32:0/341677261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedf40aea70 msgr2=0x7fedf40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedf8e00640 1 --2- 172.21.15.32:0/341677261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedf40aea70 0x7fedf40b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedf8e00640 1 -- 172.21.15.32:0/341677261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedf406b280 msgr2=0x7fedf4151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedf8e00640 1 --2- 172.21.15.32:0/341677261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedf406b280 0x7fedf4151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedf8e00640 1 -- 172.21.15.32:0/341677261 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf41507d0 con 0x7fedf415a840 2024-03-19T06:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedf8e00640 1 --2- 172.21.15.32:0/341677261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedf415a840 0x7fedf40b3e80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fedec00c770 tx=0x7fedec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedebe00640 1 -- 172.21.15.32:0/341677261 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec003b80 con 0x7fedf415a840 2024-03-19T06:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedebe00640 1 -- 172.21.15.32:0/341677261 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec003d20 con 0x7fedf415a840 2024-03-19T06:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedebe00640 1 -- 172.21.15.32:0/341677261 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec00aa90 con 0x7fedf415a840 2024-03-19T06:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedfae00640 1 -- 172.21.15.32:0/341677261 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf4150ab0 con 0x7fedf415a840 2024-03-19T06:23:57.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedfae00640 1 -- 172.21.15.32:0/341677261 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf4151070 con 0x7fedf415a840 2024-03-19T06:23:57.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.147+0000 7fedfae00640 1 -- 172.21.15.32:0/341677261 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf40749e0 con 0x7fedf415a840 2024-03-19T06:23:57.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.151+0000 7fedebe00640 1 -- 172.21.15.32:0/341677261 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fedec00ac30 con 0x7fedf415a840 2024-03-19T06:23:57.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.151+0000 7fedebe00640 1 --2- 172.21.15.32:0/341677261 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fedd4067660 0x7fedd4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.151+0000 7fedebe00640 1 -- 172.21.15.32:0/341677261 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fedec0856d0 con 0x7fedf415a840 2024-03-19T06:23:57.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.151+0000 7fedf3e00640 1 --2- 172.21.15.32:0/341677261 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fedd4067660 0x7fedd4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.151+0000 7fedf3e00640 1 --2- 172.21.15.32:0/341677261 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fedd4067660 0x7fedd4069b20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fede40ad000 tx=0x7fede40a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:57.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.155+0000 7fedebe00640 1 -- 172.21.15.32:0/341677261 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fedec055cb0 con 0x7fedf415a840 2024-03-19T06:23:57.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.319+0000 7fedfae00640 1 -- 172.21.15.32:0/341677261 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedf40af840 con 0x7fedf415a840 2024-03-19T06:23:57.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.319+0000 7fedebe00640 1 -- 172.21.15.32:0/341677261 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedec059d50 con 0x7fedf415a840 2024-03-19T06:23:57.306 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-03-19T06:23:57.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.319+0000 7fedfae00640 1 -- 172.21.15.32:0/341677261 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fedd4067660 msgr2=0x7fedd4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.319+0000 7fedfae00640 1 --2- 172.21.15.32:0/341677261 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fedd4067660 0x7fedd4069b20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fede40ad000 tx=0x7fede40a6000 comp rx=0 tx=0).stop 2024-03-19T06:23:57.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.319+0000 7fedfae00640 1 -- 172.21.15.32:0/341677261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedf415a840 msgr2=0x7fedf40b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.319+0000 7fedfae00640 1 --2- 172.21.15.32:0/341677261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedf415a840 0x7fedf40b3e80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fedec00c770 tx=0x7fedec00cc30 comp rx=0 tx=0).stop 2024-03-19T06:23:57.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.319+0000 7fedfae00640 1 -- 172.21.15.32:0/341677261 shutdown_connections 2024-03-19T06:23:57.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.319+0000 7fedfae00640 1 --2- 172.21.15.32:0/341677261 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fedd4067660 0x7fedd4069b20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.319+0000 7fedfae00640 1 --2- 172.21.15.32:0/341677261 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedf415a840 0x7fedf40b3e80 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.319+0000 7fedfae00640 1 --2- 172.21.15.32:0/341677261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedf40aea70 0x7fedf40b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.319+0000 7fedfae00640 1 --2- 172.21.15.32:0/341677261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedf406b280 0x7fedf4151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.319+0000 7fedfae00640 1 -- 172.21.15.32:0/341677261 >> 172.21.15.32:0/341677261 conn(0x7fedf40b1590 msgr2=0x7fedf414a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:57.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.319+0000 7fedfae00640 1 -- 172.21.15.32:0/341677261 shutdown_connections 2024-03-19T06:23:57.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.319+0000 7fedfae00640 1 -- 172.21.15.32:0/341677261 wait complete. 2024-03-19T06:23:57.326 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:23:57.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb36400640 1 Processor -- start 2024-03-19T06:23:57.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb36400640 1 -- start start 2024-03-19T06:23:57.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb36400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcb3015b9b0 0x7fcb300ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb36400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb3006ad40 0x7fcb3006b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb36400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb300ad6b0 con 0x7fcb3015f420 2024-03-19T06:23:57.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb36400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3015bd90 con 0x7fcb3015b9b0 2024-03-19T06:23:57.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb36400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3006b6e0 con 0x7fcb3006ad40 2024-03-19T06:23:57.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb2f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcb3015b9b0 0x7fcb300ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb2f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcb3015b9b0 0x7fcb300ccd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42300/0 (socket says 172.21.15.32:42300) 2024-03-19T06:23:57.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb2f400640 1 -- 172.21.15.32:0/4126396419 learned_addr learned my addr 172.21.15.32:0/4126396419 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:57.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb2fe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcb3015f420 0x7fcb3015f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43734/0 (socket says 172.21.15.32:43734) 2024-03-19T06:23:57.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb27e00640 1 --2- 172.21.15.32:0/4126396419 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb3006ad40 0x7fcb3006b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb2f400640 1 -- 172.21.15.32:0/4126396419 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb3006ad40 msgr2=0x7fcb3006b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:57.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb2f400640 1 --2- 172.21.15.32:0/4126396419 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb3006ad40 0x7fcb3006b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb2f400640 1 -- 172.21.15.32:0/4126396419 >> v1:172.21.15.32:6789/0 conn(0x7fcb3015f420 legacy=0x7fcb3015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb2f400640 1 -- 172.21.15.32:0/4126396419 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb300ad950 con 0x7fcb3015b9b0 2024-03-19T06:23:57.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.483+0000 7fcb27e00640 1 --2- 172.21.15.32:0/4126396419 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb3006ad40 0x7fcb3006b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:57.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.487+0000 7fcb2f400640 1 --2- 172.21.15.32:0/4126396419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3015b9b0 0x7fcb300ccd20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009870 tx=0x7fcb2001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978af3c068e85e22 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:57.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.487+0000 7fcb2ea00640 1 -- 172.21.15.32:0/4126396419 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb200ab650 con 0x7fcb3015b9b0 2024-03-19T06:23:57.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.487+0000 7fcb2ea00640 1 -- 172.21.15.32:0/4126396419 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb200b0070 con 0x7fcb3015b9b0 2024-03-19T06:23:57.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.487+0000 7fcb2ea00640 1 -- 172.21.15.32:0/4126396419 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb200aba10 con 0x7fcb3015b9b0 2024-03-19T06:23:57.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.487+0000 7fcb36400640 1 -- 172.21.15.32:0/4126396419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3015b9b0 msgr2=0x7fcb300ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.487+0000 7fcb36400640 1 --2- 172.21.15.32:0/4126396419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3015b9b0 0x7fcb300ccd20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009870 tx=0x7fcb2001c560 comp rx=0 tx=0).stop 2024-03-19T06:23:57.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.487+0000 7fcb36400640 1 -- 172.21.15.32:0/4126396419 shutdown_connections 2024-03-19T06:23:57.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.487+0000 7fcb36400640 1 --2- 172.21.15.32:0/4126396419 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb3006ad40 0x7fcb3006b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.487+0000 7fcb36400640 1 --2- 172.21.15.32:0/4126396419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3015b9b0 0x7fcb300ccd20 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.487+0000 7fcb36400640 1 -- 172.21.15.32:0/4126396419 >> 172.21.15.32:0/4126396419 conn(0x7fcb30099a70 msgr2=0x7fcb30099e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:57.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.487+0000 7fcb36400640 1 -- 172.21.15.32:0/4126396419 shutdown_connections 2024-03-19T06:23:57.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.487+0000 7fcb36400640 1 -- 172.21.15.32:0/4126396419 wait complete. 2024-03-19T06:23:57.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb36400640 1 Processor -- start 2024-03-19T06:23:57.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb36400640 1 -- start start 2024-03-19T06:23:57.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb36400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3006ad40 0x7fcb300d0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb36400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb3015b9b0 0x7fcb300c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb36400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb3015f420 0x7fcb300b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb36400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300cd260 con 0x7fcb3006ad40 2024-03-19T06:23:57.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb36400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300cde80 con 0x7fcb3015f420 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb36400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300cd3e0 con 0x7fcb3015b9b0 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb2f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3006ad40 0x7fcb300d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb2f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3006ad40 0x7fcb300d0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42310/0 (socket says 172.21.15.32:42310) 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb2f400640 1 -- 172.21.15.32:0/1273975719 learned_addr learned my addr 172.21.15.32:0/1273975719 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb2fe00640 1 --2- 172.21.15.32:0/1273975719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb3015f420 0x7fcb300b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb27e00640 1 --2- 172.21.15.32:0/1273975719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb3015b9b0 0x7fcb300c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb2f400640 1 -- 172.21.15.32:0/1273975719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb3015b9b0 msgr2=0x7fcb300c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb2f400640 1 --2- 172.21.15.32:0/1273975719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb3015b9b0 0x7fcb300c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb2f400640 1 -- 172.21.15.32:0/1273975719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb3015f420 msgr2=0x7fcb300b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb2f400640 1 --2- 172.21.15.32:0/1273975719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb3015f420 0x7fcb300b5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb2f400640 1 -- 172.21.15.32:0/1273975719 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb300d0d50 con 0x7fcb3006ad40 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb27e00640 1 --2- 172.21.15.32:0/1273975719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb3015b9b0 0x7fcb300c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb2fe00640 1 --2- 172.21.15.32:0/1273975719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb3015f420 0x7fcb300b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb2f400640 1 --2- 172.21.15.32:0/1273975719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3006ad40 0x7fcb300d0810 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fcb200ad040 tx=0x7fcb2001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb27400640 1 -- 172.21.15.32:0/1273975719 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb200be5f0 con 0x7fcb3006ad40 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb27400640 1 -- 172.21.15.32:0/1273975719 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb200be7b0 con 0x7fcb3006ad40 2024-03-19T06:23:57.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb27400640 1 -- 172.21.15.32:0/1273975719 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb200beba0 con 0x7fcb3006ad40 2024-03-19T06:23:57.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb36400640 1 -- 172.21.15.32:0/1273975719 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb300b4dd0 con 0x7fcb3006ad40 2024-03-19T06:23:57.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.491+0000 7fcb36400640 1 -- 172.21.15.32:0/1273975719 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb300b5390 con 0x7fcb3006ad40 2024-03-19T06:23:57.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.495+0000 7fcb36400640 1 -- 172.21.15.32:0/1273975719 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb300749e0 con 0x7fcb3006ad40 2024-03-19T06:23:57.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.495+0000 7fcb27400640 1 -- 172.21.15.32:0/1273975719 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fcb200b43f0 con 0x7fcb3006ad40 2024-03-19T06:23:57.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.495+0000 7fcb27400640 1 --2- 172.21.15.32:0/1273975719 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcb0c067660 0x7fcb0c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.495+0000 7fcb27400640 1 -- 172.21.15.32:0/1273975719 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcb2011fd70 con 0x7fcb3006ad40 2024-03-19T06:23:57.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.495+0000 7fcb27e00640 1 --2- 172.21.15.32:0/1273975719 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcb0c067660 0x7fcb0c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.495+0000 7fcb27e00640 1 --2- 172.21.15.32:0/1273975719 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcb0c067660 0x7fcb0c069b20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcb3009ea00 tx=0x7fcb18008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:57.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.499+0000 7fcb27400640 1 -- 172.21.15.32:0/1273975719 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fcb20016150 con 0x7fcb3006ad40 2024-03-19T06:23:57.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.663+0000 7fcb36400640 1 -- 172.21.15.32:0/1273975719 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb3015fbe0 con 0x7fcb3006ad40 2024-03-19T06:23:57.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.663+0000 7fcb27400640 1 -- 172.21.15.32:0/1273975719 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb200f0350 con 0x7fcb3006ad40 2024-03-19T06:23:57.652 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-03-19T06:23:57.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.667+0000 7fcb36400640 1 -- 172.21.15.32:0/1273975719 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcb0c067660 msgr2=0x7fcb0c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.667+0000 7fcb36400640 1 --2- 172.21.15.32:0/1273975719 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcb0c067660 0x7fcb0c069b20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcb3009ea00 tx=0x7fcb18008040 comp rx=0 tx=0).stop 2024-03-19T06:23:57.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.667+0000 7fcb36400640 1 -- 172.21.15.32:0/1273975719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3006ad40 msgr2=0x7fcb300d0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.667+0000 7fcb36400640 1 --2- 172.21.15.32:0/1273975719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3006ad40 0x7fcb300d0810 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fcb200ad040 tx=0x7fcb2001ada0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.667+0000 7fcb36400640 1 -- 172.21.15.32:0/1273975719 shutdown_connections 2024-03-19T06:23:57.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.667+0000 7fcb36400640 1 --2- 172.21.15.32:0/1273975719 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fcb0c067660 0x7fcb0c069b20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.667+0000 7fcb36400640 1 --2- 172.21.15.32:0/1273975719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcb3015f420 0x7fcb300b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.667+0000 7fcb36400640 1 --2- 172.21.15.32:0/1273975719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcb3015b9b0 0x7fcb300c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.667+0000 7fcb36400640 1 --2- 172.21.15.32:0/1273975719 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcb3006ad40 0x7fcb300d0810 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.667+0000 7fcb36400640 1 -- 172.21.15.32:0/1273975719 >> 172.21.15.32:0/1273975719 conn(0x7fcb30099a70 msgr2=0x7fcb300ca3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:57.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.667+0000 7fcb36400640 1 -- 172.21.15.32:0/1273975719 shutdown_connections 2024-03-19T06:23:57.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.667+0000 7fcb36400640 1 -- 172.21.15.32:0/1273975719 wait complete. 2024-03-19T06:23:57.673 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:23:57.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.827+0000 7f369f200640 1 Processor -- start 2024-03-19T06:23:57.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.827+0000 7f369f200640 1 -- start start 2024-03-19T06:23:57.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369f200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f36a00b2960 0x7f36a00cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369f200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a015dfc0 con 0x7f36a006c550 2024-03-19T06:23:57.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369f200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a00ce760 con 0x7f36a015dbe0 2024-03-19T06:23:57.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369f200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a00b1220 con 0x7f36a00b2960 2024-03-19T06:23:57.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369e800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f36a006c550 0x7f36a00b16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43736/0 (socket says 172.21.15.32:43736) 2024-03-19T06:23:57.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369e800640 1 -- 172.21.15.32:0/1851735156 learned_addr learned my addr 172.21.15.32:0/1851735156 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:57.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f3695400640 1 --2- 172.21.15.32:0/1851735156 >> v2:172.21.15.171:3300/0 conn(0x7f36a00b2960 0x7f36a00cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 -- 172.21.15.32:0/1851735156 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934706175 0 0) 0x7f36a015dfc0 con 0x7f36a006c550 2024-03-19T06:23:57.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 -- 172.21.15.32:0/1851735156 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3684003530 con 0x7f36a006c550 2024-03-19T06:23:57.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 -- 172.21.15.32:0/1851735156 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524839248 0 0) 0x7f36a00ce760 con 0x7f36a015dbe0 2024-03-19T06:23:57.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 -- 172.21.15.32:0/1851735156 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36a015dfc0 con 0x7f36a015dbe0 2024-03-19T06:23:57.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 -- 172.21.15.32:0/1851735156 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3015574397 0 0) 0x7f3684003530 con 0x7f36a006c550 2024-03-19T06:23:57.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 -- 172.21.15.32:0/1851735156 >> v2:172.21.15.171:3300/0 conn(0x7f36a00b2960 msgr2=0x7f36a00cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:57.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 --2- 172.21.15.32:0/1851735156 >> v2:172.21.15.171:3300/0 conn(0x7f36a00b2960 0x7f36a00cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 -- 172.21.15.32:0/1851735156 >> v1:172.21.15.171:6789/0 conn(0x7f36a015dbe0 legacy=0x7f36a00cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 -- 172.21.15.32:0/1851735156 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a00cea40 con 0x7f36a006c550 2024-03-19T06:23:57.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 -- 172.21.15.32:0/1851735156 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f3698001680 con 0x7f36a006c550 2024-03-19T06:23:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 -- 172.21.15.32:0/1851735156 >> v1:172.21.15.32:6789/0 conn(0x7f36a006c550 legacy=0x7f36a00b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 --2- 172.21.15.32:0/1851735156 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3684003ba0 0x7f3684003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 --2- 172.21.15.32:0/1851735156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3684004810 0x7f3684004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 --2- 172.21.15.32:0/1851735156 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36840051d0 0x7f368400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 -- 172.21.15.32:0/1851735156 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00b1220 con 0x7f3684004810 2024-03-19T06:23:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 -- 172.21.15.32:0/1851735156 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368400c0a0 con 0x7f3684003ba0 2024-03-19T06:23:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369d400640 1 -- 172.21.15.32:0/1851735156 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368400c2a0 con 0x7f36840051d0 2024-03-19T06:23:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f3695400640 1 --2- 172.21.15.32:0/1851735156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3684004810 0x7f3684004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369de00640 1 --2- 172.21.15.32:0/1851735156 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3684003ba0 0x7f3684003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369e800640 1 --2- 172.21.15.32:0/1851735156 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36840051d0 0x7f368400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f3695400640 1 -- 172.21.15.32:0/1851735156 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36840051d0 msgr2=0x7f368400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f3695400640 1 --2- 172.21.15.32:0/1851735156 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36840051d0 0x7f368400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f3695400640 1 -- 172.21.15.32:0/1851735156 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3684003ba0 msgr2=0x7f3684003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:57.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f3695400640 1 --2- 172.21.15.32:0/1851735156 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3684003ba0 0x7f3684003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f3695400640 1 -- 172.21.15.32:0/1851735156 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3684003530 con 0x7f3684004810 2024-03-19T06:23:57.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369de00640 1 --2- 172.21.15.32:0/1851735156 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3684003ba0 0x7f3684003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:57.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.831+0000 7f369e800640 1 -- 172.21.15.32:0/1851735156 reap_dead start 2024-03-19T06:23:57.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.835+0000 7f3695400640 1 --2- 172.21.15.32:0/1851735156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3684004810 0x7f3684004c90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3688009ae0 tx=0x7f368801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d0067f5f77ea1e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:57.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.835+0000 7f369d400640 1 -- 172.21.15.32:0/1851735156 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880b2070 con 0x7f3684004810 2024-03-19T06:23:57.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.835+0000 7f369d400640 1 -- 172.21.15.32:0/1851735156 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36880a5660 con 0x7f3684004810 2024-03-19T06:23:57.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.835+0000 7f369d400640 1 -- 172.21.15.32:0/1851735156 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880096b0 con 0x7f3684004810 2024-03-19T06:23:57.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.835+0000 7f369f200640 1 -- 172.21.15.32:0/1851735156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3684004810 msgr2=0x7f3684004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.835+0000 7f369f200640 1 --2- 172.21.15.32:0/1851735156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3684004810 0x7f3684004c90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3688009ae0 tx=0x7f368801ca70 comp rx=0 tx=0).stop 2024-03-19T06:23:57.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.835+0000 7f369f200640 1 -- 172.21.15.32:0/1851735156 shutdown_connections 2024-03-19T06:23:57.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.835+0000 7f369f200640 1 --2- 172.21.15.32:0/1851735156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3684004810 0x7f3684004c90 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.835+0000 7f369f200640 1 -- 172.21.15.32:0/1851735156 >> 172.21.15.32:0/1851735156 conn(0x7f36a008b000 msgr2=0x7f36a008b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:57.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.835+0000 7f369f200640 1 -- 172.21.15.32:0/1851735156 shutdown_connections 2024-03-19T06:23:57.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.835+0000 7f369f200640 1 -- 172.21.15.32:0/1851735156 wait complete. 2024-03-19T06:23:57.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.835+0000 7f369f200640 1 Processor -- start 2024-03-19T06:23:57.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.835+0000 7f369f200640 1 -- start start 2024-03-19T06:23:57.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369f200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3684004810 0x7f36a0158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369f200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36a006f2b0 0x7f36a006f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369f200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36a00c51a0 0x7f36a00c5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369f200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00ce090 con 0x7f36a00c51a0 2024-03-19T06:23:57.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369f200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00cdf10 con 0x7f3684004810 2024-03-19T06:23:57.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369f200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00ce210 con 0x7f36a006f2b0 2024-03-19T06:23:57.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36a00c51a0 0x7f36a00c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369e800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36a00c51a0 0x7f36a00c5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42326/0 (socket says 172.21.15.32:42326) 2024-03-19T06:23:57.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369e800640 1 -- 172.21.15.32:0/1889813240 learned_addr learned my addr 172.21.15.32:0/1889813240 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:57.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369de00640 1 --2- 172.21.15.32:0/1889813240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3684004810 0x7f36a0158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f3695400640 1 --2- 172.21.15.32:0/1889813240 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36a006f2b0 0x7f36a006f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369e800640 1 -- 172.21.15.32:0/1889813240 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36a006f2b0 msgr2=0x7f36a006f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369e800640 1 --2- 172.21.15.32:0/1889813240 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36a006f2b0 0x7f36a006f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369e800640 1 -- 172.21.15.32:0/1889813240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3684004810 msgr2=0x7f36a0158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369e800640 1 --2- 172.21.15.32:0/1889813240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3684004810 0x7f36a0158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369e800640 1 -- 172.21.15.32:0/1889813240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a015cec0 con 0x7f36a00c51a0 2024-03-19T06:23:57.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369de00640 1 --2- 172.21.15.32:0/1889813240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3684004810 0x7f36a0158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:57.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369e800640 1 --2- 172.21.15.32:0/1889813240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36a00c51a0 0x7f36a00c5650 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f36a00b0f40 tx=0x7f369800e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:57.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f3696a00640 1 -- 172.21.15.32:0/1889813240 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698010510 con 0x7f36a00c51a0 2024-03-19T06:23:57.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f3696a00640 1 -- 172.21.15.32:0/1889813240 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36980106d0 con 0x7f36a00c51a0 2024-03-19T06:23:57.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369f200640 1 -- 172.21.15.32:0/1889813240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a01590b0 con 0x7f36a00c51a0 2024-03-19T06:23:57.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f3696a00640 1 -- 172.21.15.32:0/1889813240 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698010ac0 con 0x7f36a00c51a0 2024-03-19T06:23:57.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369f200640 1 -- 172.21.15.32:0/1889813240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a00c6170 con 0x7f36a00c51a0 2024-03-19T06:23:57.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f369f200640 1 -- 172.21.15.32:0/1889813240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a006fc70 con 0x7f36a00c51a0 2024-03-19T06:23:57.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.839+0000 7f3696a00640 1 -- 172.21.15.32:0/1889813240 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f369801b020 con 0x7f36a00c51a0 2024-03-19T06:23:57.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.843+0000 7f3696a00640 1 --2- 172.21.15.32:0/1889813240 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f367c067690 0x7f367c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:57.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.843+0000 7f3696a00640 1 -- 172.21.15.32:0/1889813240 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3698084d90 con 0x7f36a00c51a0 2024-03-19T06:23:57.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.843+0000 7f369de00640 1 --2- 172.21.15.32:0/1889813240 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f367c067690 0x7f367c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:57.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.843+0000 7f369de00640 1 --2- 172.21.15.32:0/1889813240 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f367c067690 0x7f367c069b50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f36a00c9900 tx=0x7f3690009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:57.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:57.847+0000 7f3696a00640 1 -- 172.21.15.32:0/1889813240 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f36a01590b0 con 0x7f36a00c51a0 2024-03-19T06:23:57.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.007+0000 7f369f200640 1 -- 172.21.15.32:0/1889813240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36a00c5b90 con 0x7f36a00c51a0 2024-03-19T06:23:57.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.007+0000 7f3696a00640 1 -- 172.21.15.32:0/1889813240 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3698055930 con 0x7f36a00c51a0 2024-03-19T06:23:57.997 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-03-19T06:23:57.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.011+0000 7f369f200640 1 -- 172.21.15.32:0/1889813240 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f367c067690 msgr2=0x7f367c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.011+0000 7f369f200640 1 --2- 172.21.15.32:0/1889813240 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f367c067690 0x7f367c069b50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f36a00c9900 tx=0x7f3690009040 comp rx=0 tx=0).stop 2024-03-19T06:23:57.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.011+0000 7f369f200640 1 -- 172.21.15.32:0/1889813240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36a00c51a0 msgr2=0x7f36a00c5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:57.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.011+0000 7f369f200640 1 --2- 172.21.15.32:0/1889813240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36a00c51a0 0x7f36a00c5650 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f36a00b0f40 tx=0x7f369800e960 comp rx=0 tx=0).stop 2024-03-19T06:23:57.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.011+0000 7f369f200640 1 -- 172.21.15.32:0/1889813240 shutdown_connections 2024-03-19T06:23:57.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.011+0000 7f369f200640 1 --2- 172.21.15.32:0/1889813240 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f367c067690 0x7f367c069b50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.011+0000 7f369f200640 1 --2- 172.21.15.32:0/1889813240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f36a00c51a0 0x7f36a00c5650 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.011+0000 7f369f200640 1 --2- 172.21.15.32:0/1889813240 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36a006f2b0 0x7f36a006f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.011+0000 7f369f200640 1 --2- 172.21.15.32:0/1889813240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3684004810 0x7f36a0158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:57.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.011+0000 7f369f200640 1 -- 172.21.15.32:0/1889813240 >> 172.21.15.32:0/1889813240 conn(0x7f36a008b000 msgr2=0x7f36a0070a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:57.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.011+0000 7f369f200640 1 -- 172.21.15.32:0/1889813240 shutdown_connections 2024-03-19T06:23:57.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.011+0000 7f369f200640 1 -- 172.21.15.32:0/1889813240 wait complete. 2024-03-19T06:23:58.018 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:23:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.171+0000 7f9015600640 1 Processor -- start 2024-03-19T06:23:58.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.171+0000 7f9015600640 1 -- start start 2024-03-19T06:23:58.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.171+0000 7f9015600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f90100cda20 0x7f90100cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.171+0000 7f9015600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90100c4760 0x7f90100c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.171+0000 7f9015600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90100cc190 con 0x7f90100ccf30 2024-03-19T06:23:58.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.171+0000 7f9015600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90100cc470 con 0x7f90100cda20 2024-03-19T06:23:58.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.171+0000 7f9015600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90100cc750 con 0x7f90100c4760 2024-03-19T06:23:58.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.171+0000 7f9007e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f90100cda20 0x7f90100cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.171+0000 7f9007e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f90100cda20 0x7f90100cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42336/0 (socket says 172.21.15.32:42336) 2024-03-19T06:23:58.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.171+0000 7f9007e00640 1 -- 172.21.15.32:0/3175727885 learned_addr learned my addr 172.21.15.32:0/3175727885 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:58.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.171+0000 7f9014c00640 1 --2- 172.21.15.32:0/3175727885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90100c4760 0x7f90100c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.171+0000 7f9007e00640 1 -- 172.21.15.32:0/3175727885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90100c4760 msgr2=0x7f90100c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:58.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.171+0000 7f9007e00640 1 --2- 172.21.15.32:0/3175727885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90100c4760 0x7f90100c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.171+0000 7f9007e00640 1 -- 172.21.15.32:0/3175727885 >> v1:172.21.15.171:6789/0 conn(0x7f90100ccf30 legacy=0x7f90100cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.171+0000 7f9007e00640 1 -- 172.21.15.32:0/3175727885 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90100c4240 con 0x7f90100cda20 2024-03-19T06:23:58.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.175+0000 7f9007e00640 1 --2- 172.21.15.32:0/3175727885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100cda20 0x7f90100cbb00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009870 tx=0x7f8ff801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c51f534805935b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:58.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.175+0000 7f900f400640 1 -- 172.21.15.32:0/3175727885 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80b1070 con 0x7f90100cda20 2024-03-19T06:23:58.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.175+0000 7f900f400640 1 -- 172.21.15.32:0/3175727885 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff80a8050 con 0x7f90100cda20 2024-03-19T06:23:58.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.175+0000 7f900f400640 1 -- 172.21.15.32:0/3175727885 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80ac860 con 0x7f90100cda20 2024-03-19T06:23:58.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.175+0000 7f9015600640 1 -- 172.21.15.32:0/3175727885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100cda20 msgr2=0x7f90100cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.175+0000 7f9015600640 1 --2- 172.21.15.32:0/3175727885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100cda20 0x7f90100cbb00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009870 tx=0x7f8ff801c4d0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.175+0000 7f9015600640 1 -- 172.21.15.32:0/3175727885 shutdown_connections 2024-03-19T06:23:58.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.175+0000 7f9015600640 1 --2- 172.21.15.32:0/3175727885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90100c4760 0x7f90100c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.175+0000 7f9015600640 1 --2- 172.21.15.32:0/3175727885 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100cda20 0x7f90100cbb00 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.175+0000 7f9015600640 1 -- 172.21.15.32:0/3175727885 >> 172.21.15.32:0/3175727885 conn(0x7f9010099a70 msgr2=0x7f90100b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:58.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.175+0000 7f9015600640 1 -- 172.21.15.32:0/3175727885 shutdown_connections 2024-03-19T06:23:58.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.175+0000 7f9015600640 1 -- 172.21.15.32:0/3175727885 wait complete. 2024-03-19T06:23:58.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9015600640 1 Processor -- start 2024-03-19T06:23:58.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9015600640 1 -- start start 2024-03-19T06:23:58.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9015600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90100c4760 0x7f90100b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9015600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90100ccf30 0x7f901015cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9015600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100cda20 0x7f901015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9015600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9010167600 con 0x7f90100cda20 2024-03-19T06:23:58.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9015600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9010167480 con 0x7f90100ccf30 2024-03-19T06:23:58.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9015600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9010167780 con 0x7f90100c4760 2024-03-19T06:23:58.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9014c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100cda20 0x7f901015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9014c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100cda20 0x7f901015d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42342/0 (socket says 172.21.15.32:42342) 2024-03-19T06:23:58.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9014c00640 1 -- 172.21.15.32:0/3135195513 learned_addr learned my addr 172.21.15.32:0/3135195513 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:58.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9007e00640 1 --2- 172.21.15.32:0/3135195513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90100ccf30 0x7f901015cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f900fe00640 1 --2- 172.21.15.32:0/3135195513 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90100c4760 0x7f90100b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9014c00640 1 -- 172.21.15.32:0/3135195513 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90100c4760 msgr2=0x7f90100b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9014c00640 1 --2- 172.21.15.32:0/3135195513 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90100c4760 0x7f90100b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9014c00640 1 -- 172.21.15.32:0/3135195513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90100ccf30 msgr2=0x7f901015cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9014c00640 1 --2- 172.21.15.32:0/3135195513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90100ccf30 0x7f901015cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9014c00640 1 -- 172.21.15.32:0/3135195513 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90100b5f20 con 0x7f90100cda20 2024-03-19T06:23:58.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9014c00640 1 --2- 172.21.15.32:0/3135195513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100cda20 0x7f901015d2e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9008007e60 tx=0x7f900800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:58.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f900cc00640 1 -- 172.21.15.32:0/3135195513 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9008014420 con 0x7f90100cda20 2024-03-19T06:23:58.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f900cc00640 1 -- 172.21.15.32:0/3135195513 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9008019070 con 0x7f90100cda20 2024-03-19T06:23:58.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f900cc00640 1 -- 172.21.15.32:0/3135195513 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9008014820 con 0x7f90100cda20 2024-03-19T06:23:58.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9015600640 1 -- 172.21.15.32:0/3135195513 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901015d920 con 0x7f90100cda20 2024-03-19T06:23:58.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9015600640 1 -- 172.21.15.32:0/3135195513 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9010162660 con 0x7f90100cda20 2024-03-19T06:23:58.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.179+0000 7f9015600640 1 -- 172.21.15.32:0/3135195513 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9010075090 con 0x7f90100cda20 2024-03-19T06:23:58.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.183+0000 7f900cc00640 1 -- 172.21.15.32:0/3135195513 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f90080149c0 con 0x7f90100cda20 2024-03-19T06:23:58.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.183+0000 7f900cc00640 1 --2- 172.21.15.32:0/3135195513 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8fec067660 0x7f8fec069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.183+0000 7f900cc00640 1 -- 172.21.15.32:0/3135195513 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9008085ff0 con 0x7f90100cda20 2024-03-19T06:23:58.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.183+0000 7f900fe00640 1 --2- 172.21.15.32:0/3135195513 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8fec067660 0x7f8fec069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.183+0000 7f900fe00640 1 --2- 172.21.15.32:0/3135195513 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8fec067660 0x7f8fec069b20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9000007fd0 tx=0x7f9000009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:58.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.187+0000 7f900cc00640 1 -- 172.21.15.32:0/3135195513 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f9008056580 con 0x7f90100cda20 2024-03-19T06:23:58.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.379+0000 7f9015600640 1 -- 172.21.15.32:0/3135195513 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90100cb0b0 con 0x7f90100cda20 2024-03-19T06:23:58.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.383+0000 7f900cc00640 1 -- 172.21.15.32:0/3135195513 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f900805a620 con 0x7f90100cda20 2024-03-19T06:23:58.369 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:58.369 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3631486110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3631486110},{"type":"v1","addr":"172.21.15.171:6836","nonce":3631486110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/3410824978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3410824978},{"type":"v1","addr":"172.21.15.32:6833","nonce":3410824978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3585939515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3585939515},{"type":"v1","addr":"172.21.15.32:6835","nonce":3585939515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:23:21.920668+0000","modified":"2024-03-19T06:23:24.948860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5934},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5934":{"gid":5934,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/1907516739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1907516739},{"type":"v1","addr":"172.21.15.171:6837","nonce":1907516739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-03-19T06:23:58.370 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 26 2024-03-19T06:23:58.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.383+0000 7f9015600640 1 -- 172.21.15.32:0/3135195513 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8fec067660 msgr2=0x7f8fec069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.383+0000 7f9015600640 1 --2- 172.21.15.32:0/3135195513 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8fec067660 0x7f8fec069b20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9000007fd0 tx=0x7f9000009040 comp rx=0 tx=0).stop 2024-03-19T06:23:58.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.383+0000 7f9015600640 1 -- 172.21.15.32:0/3135195513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100cda20 msgr2=0x7f901015d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.383+0000 7f9015600640 1 --2- 172.21.15.32:0/3135195513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100cda20 0x7f901015d2e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9008007e60 tx=0x7f900800e4b0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.383+0000 7f9015600640 1 -- 172.21.15.32:0/3135195513 shutdown_connections 2024-03-19T06:23:58.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.383+0000 7f9015600640 1 --2- 172.21.15.32:0/3135195513 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8fec067660 0x7f8fec069b20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.383+0000 7f9015600640 1 --2- 172.21.15.32:0/3135195513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100cda20 0x7f901015d2e0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.383+0000 7f9015600640 1 --2- 172.21.15.32:0/3135195513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90100ccf30 0x7f901015cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.383+0000 7f9015600640 1 --2- 172.21.15.32:0/3135195513 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90100c4760 0x7f90100b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.383+0000 7f9015600640 1 -- 172.21.15.32:0/3135195513 >> 172.21.15.32:0/3135195513 conn(0x7f9010099a70 msgr2=0x7f90100c5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:58.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.383+0000 7f9015600640 1 -- 172.21.15.32:0/3135195513 shutdown_connections 2024-03-19T06:23:58.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.383+0000 7f9015600640 1 -- 172.21.15.32:0/3135195513 wait complete. 2024-03-19T06:23:58.390 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:23:58.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.543+0000 7fc8f8400640 1 Processor -- start 2024-03-19T06:23:58.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.543+0000 7fc8f8400640 1 -- start start 2024-03-19T06:23:58.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.543+0000 7fc8f8400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc8f006c460 0x7fc8f00acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.543+0000 7fc8f8400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc8f015dff0 0x7fc8f0154130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.543+0000 7fc8f8400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f015e520 con 0x7fc8f00ae0b0 2024-03-19T06:23:58.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.543+0000 7fc8f8400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f015f1b0 con 0x7fc8f015dff0 2024-03-19T06:23:58.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.543+0000 7fc8f8400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f015e800 con 0x7fc8f006c460 2024-03-19T06:23:58.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.543+0000 7fc8f6400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc8f015dff0 0x7fc8f0154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.543+0000 7fc8f6400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc8f015dff0 0x7fc8f0154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42352/0 (socket says 172.21.15.32:42352) 2024-03-19T06:23:58.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.543+0000 7fc8f6400640 1 -- 172.21.15.32:0/3598977292 learned_addr learned my addr 172.21.15.32:0/3598977292 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:58.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.543+0000 7fc8f5000640 1 --2- 172.21.15.32:0/3598977292 >> v2:172.21.15.171:3300/0 conn(0x7fc8f006c460 0x7fc8f00acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.543+0000 7fc8f6400640 1 -- 172.21.15.32:0/3598977292 >> v2:172.21.15.171:3300/0 conn(0x7fc8f006c460 msgr2=0x7fc8f00acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:58.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.547+0000 7fc8f6400640 1 --2- 172.21.15.32:0/3598977292 >> v2:172.21.15.171:3300/0 conn(0x7fc8f006c460 0x7fc8f00acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.547+0000 7fc8f6400640 1 -- 172.21.15.32:0/3598977292 >> v1:172.21.15.171:6789/0 conn(0x7fc8f00ae0b0 legacy=0x7fc8f006bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.547+0000 7fc8f6400640 1 -- 172.21.15.32:0/3598977292 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f015eae0 con 0x7fc8f015dff0 2024-03-19T06:23:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.547+0000 7fc8f6400640 1 --2- 172.21.15.32:0/3598977292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f015dff0 0x7fc8f0154130 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00af180 tx=0x7fc8e801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f3c25b72ed6962 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.547+0000 7fc8efe00640 1 -- 172.21.15.32:0/3598977292 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e80a56c0 con 0x7fc8f015dff0 2024-03-19T06:23:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.547+0000 7fc8efe00640 1 -- 172.21.15.32:0/3598977292 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e80a5860 con 0x7fc8f015dff0 2024-03-19T06:23:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.547+0000 7fc8efe00640 1 -- 172.21.15.32:0/3598977292 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e80a5c30 con 0x7fc8f015dff0 2024-03-19T06:23:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.547+0000 7fc8f8400640 1 -- 172.21.15.32:0/3598977292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f015dff0 msgr2=0x7fc8f0154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.547+0000 7fc8f8400640 1 --2- 172.21.15.32:0/3598977292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f015dff0 0x7fc8f0154130 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00af180 tx=0x7fc8e801c9f0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.547+0000 7fc8f8400640 1 -- 172.21.15.32:0/3598977292 shutdown_connections 2024-03-19T06:23:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.547+0000 7fc8f8400640 1 --2- 172.21.15.32:0/3598977292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f015dff0 0x7fc8f0154130 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.547+0000 7fc8f8400640 1 --2- 172.21.15.32:0/3598977292 >> v2:172.21.15.171:3300/0 conn(0x7fc8f006c460 0x7fc8f00acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.547+0000 7fc8f8400640 1 -- 172.21.15.32:0/3598977292 >> 172.21.15.32:0/3598977292 conn(0x7fc8f0071c50 msgr2=0x7fc8f0072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.547+0000 7fc8f8400640 1 -- 172.21.15.32:0/3598977292 shutdown_connections 2024-03-19T06:23:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.547+0000 7fc8f8400640 1 -- 172.21.15.32:0/3598977292 wait complete. 2024-03-19T06:23:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f8400640 1 Processor -- start 2024-03-19T06:23:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f8400640 1 -- start start 2024-03-19T06:23:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f8400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8f006c460 0x7fc8f0157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f8400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f00ae0b0 0x7fc8f014fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f8400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8f015dff0 0x7fc8f006eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f8400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f015f7c0 con 0x7fc8f00ae0b0 2024-03-19T06:23:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f8400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f015f640 con 0x7fc8f006c460 2024-03-19T06:23:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f8400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f015f940 con 0x7fc8f015dff0 2024-03-19T06:23:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f5000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f00ae0b0 0x7fc8f014fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f5000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f00ae0b0 0x7fc8f014fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42354/0 (socket says 172.21.15.32:42354) 2024-03-19T06:23:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f6400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8f015dff0 0x7fc8f006eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f5a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8f006c460 0x7fc8f0157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f5000640 1 -- 172.21.15.32:0/1089912930 learned_addr learned my addr 172.21.15.32:0/1089912930 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f5000640 1 -- 172.21.15.32:0/1089912930 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8f015dff0 msgr2=0x7fc8f006eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f5000640 1 --2- 172.21.15.32:0/1089912930 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8f015dff0 0x7fc8f006eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f5000640 1 -- 172.21.15.32:0/1089912930 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8f006c460 msgr2=0x7fc8f0157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f5000640 1 --2- 172.21.15.32:0/1089912930 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8f006c460 0x7fc8f0157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f5000640 1 -- 172.21.15.32:0/1089912930 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f0150340 con 0x7fc8f00ae0b0 2024-03-19T06:23:58.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f5000640 1 --2- 172.21.15.32:0/1089912930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f00ae0b0 0x7fc8f014fa60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc00d830 tx=0x7fc8dc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:58.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8ed600640 1 -- 172.21.15.32:0/1089912930 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc00b6c0 con 0x7fc8f00ae0b0 2024-03-19T06:23:58.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8ed600640 1 -- 172.21.15.32:0/1089912930 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8dc019070 con 0x7fc8f00ae0b0 2024-03-19T06:23:58.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f8400640 1 -- 172.21.15.32:0/1089912930 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f0150620 con 0x7fc8f00ae0b0 2024-03-19T06:23:58.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8ed600640 1 -- 172.21.15.32:0/1089912930 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc00ba60 con 0x7fc8f00ae0b0 2024-03-19T06:23:58.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.551+0000 7fc8f8400640 1 -- 172.21.15.32:0/1089912930 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f014c440 con 0x7fc8f00ae0b0 2024-03-19T06:23:58.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.555+0000 7fc8f8400640 1 -- 172.21.15.32:0/1089912930 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f00749e0 con 0x7fc8f00ae0b0 2024-03-19T06:23:58.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.555+0000 7fc8ed600640 1 -- 172.21.15.32:0/1089912930 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc8dc01e460 con 0x7fc8f00ae0b0 2024-03-19T06:23:58.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.555+0000 7fc8ed600640 1 --2- 172.21.15.32:0/1089912930 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc8d0067660 0x7fc8d0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.555+0000 7fc8ed600640 1 -- 172.21.15.32:0/1089912930 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc8dc085ea0 con 0x7fc8f00ae0b0 2024-03-19T06:23:58.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.555+0000 7fc8f5a00640 1 --2- 172.21.15.32:0/1089912930 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc8d0067660 0x7fc8d0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.555+0000 7fc8f5a00640 1 --2- 172.21.15.32:0/1089912930 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc8d0067660 0x7fc8d0069b20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4000f70 tx=0x7fc8e4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:58.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.559+0000 7fc8ed600640 1 -- 172.21.15.32:0/1089912930 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fc8dc056480 con 0x7fc8f00ae0b0 2024-03-19T06:23:58.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.723+0000 7fc8f8400640 1 -- 172.21.15.32:0/1089912930 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8f00728b0 con 0x7fc8f00ae0b0 2024-03-19T06:23:58.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.723+0000 7fc8ed600640 1 -- 172.21.15.32:0/1089912930 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16721 (secure 0 0 0) 0x7fc8dc05a520 con 0x7fc8f00ae0b0 2024-03-19T06:23:58.712 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:58.713 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":53,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:23:51.649760+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:23:19.707249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-19T06:23:20.926932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1d","mappings":[{"from":0,"to":6}]},{"pgid":"8.25","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:23:58.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.727+0000 7fc8f8400640 1 -- 172.21.15.32:0/1089912930 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc8d0067660 msgr2=0x7fc8d0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.727+0000 7fc8f8400640 1 --2- 172.21.15.32:0/1089912930 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc8d0067660 0x7fc8d0069b20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4000f70 tx=0x7fc8e4009040 comp rx=0 tx=0).stop 2024-03-19T06:23:58.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.727+0000 7fc8f8400640 1 -- 172.21.15.32:0/1089912930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f00ae0b0 msgr2=0x7fc8f014fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.727+0000 7fc8f8400640 1 --2- 172.21.15.32:0/1089912930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f00ae0b0 0x7fc8f014fa60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc00d830 tx=0x7fc8dc00dcf0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.727+0000 7fc8f8400640 1 -- 172.21.15.32:0/1089912930 shutdown_connections 2024-03-19T06:23:58.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.727+0000 7fc8f8400640 1 --2- 172.21.15.32:0/1089912930 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc8d0067660 0x7fc8d0069b20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.727+0000 7fc8f8400640 1 --2- 172.21.15.32:0/1089912930 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8f015dff0 0x7fc8f006eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.727+0000 7fc8f8400640 1 --2- 172.21.15.32:0/1089912930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8f00ae0b0 0x7fc8f014fa60 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.727+0000 7fc8f8400640 1 --2- 172.21.15.32:0/1089912930 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8f006c460 0x7fc8f0157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.727+0000 7fc8f8400640 1 -- 172.21.15.32:0/1089912930 >> 172.21.15.32:0/1089912930 conn(0x7fc8f0071c50 msgr2=0x7fc8f00b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:58.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.727+0000 7fc8f8400640 1 -- 172.21.15.32:0/1089912930 shutdown_connections 2024-03-19T06:23:58.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.727+0000 7fc8f8400640 1 -- 172.21.15.32:0/1089912930 wait complete. 2024-03-19T06:23:58.734 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-19T06:23:58.734 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:23:58.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.887+0000 7efd6f200640 1 Processor -- start 2024-03-19T06:23:58.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.887+0000 7efd6f200640 1 -- start start 2024-03-19T06:23:58.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.887+0000 7efd6f200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efd680aecf0 0x7efd680ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.887+0000 7efd6f200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6815fe20 con 0x7efd6815c010 2024-03-19T06:23:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.887+0000 7efd6f200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd68160100 con 0x7efd6806d6c0 2024-03-19T06:23:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.887+0000 7efd6f200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd681603e0 con 0x7efd680aecf0 2024-03-19T06:23:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.887+0000 7efd5f400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7efd6815c010 0x7efd6815f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43738/0 (socket says 172.21.15.32:43738) 2024-03-19T06:23:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.887+0000 7efd5f400640 1 -- 172.21.15.32:0/2388160161 learned_addr learned my addr 172.21.15.32:0/2388160161 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:23:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.887+0000 7efd67e00640 1 --2- 172.21.15.32:0/2388160161 >> v2:172.21.15.171:3300/0 conn(0x7efd680aecf0 0x7efd680ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.887+0000 7efd67400640 1 -- 172.21.15.32:0/2388160161 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290147085 0 0) 0x7efd6815fe20 con 0x7efd6815c010 2024-03-19T06:23:58.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.891+0000 7efd67400640 1 -- 172.21.15.32:0/2388160161 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd4c003530 con 0x7efd6815c010 2024-03-19T06:23:58.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.891+0000 7efd67e00640 1 -- 172.21.15.32:0/2388160161 >> v1:172.21.15.171:6789/0 conn(0x7efd6806d6c0 legacy=0x7efd680cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.891+0000 7efd67e00640 1 -- 172.21.15.32:0/2388160161 >> v1:172.21.15.32:6789/0 conn(0x7efd6815c010 legacy=0x7efd6815f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.891+0000 7efd67e00640 1 -- 172.21.15.32:0/2388160161 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680ca1f0 con 0x7efd680aecf0 2024-03-19T06:23:58.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.891+0000 7efd67e00640 1 --2- 172.21.15.32:0/2388160161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd680aecf0 0x7efd680ca9f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efd580097c0 tx=0x7efd5801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e454eba97548ee3 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:58.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.891+0000 7efd67400640 1 -- 172.21.15.32:0/2388160161 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd580b0070 con 0x7efd680aecf0 2024-03-19T06:23:58.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.891+0000 7efd67400640 1 -- 172.21.15.32:0/2388160161 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd580ab600 con 0x7efd680aecf0 2024-03-19T06:23:58.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.891+0000 7efd67400640 1 -- 172.21.15.32:0/2388160161 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd580ab9d0 con 0x7efd680aecf0 2024-03-19T06:23:58.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.891+0000 7efd6f200640 1 -- 172.21.15.32:0/2388160161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd680aecf0 msgr2=0x7efd680ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.891+0000 7efd6f200640 1 --2- 172.21.15.32:0/2388160161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd680aecf0 0x7efd680ca9f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efd580097c0 tx=0x7efd5801c410 comp rx=0 tx=0).stop 2024-03-19T06:23:58.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd6f200640 1 -- 172.21.15.32:0/2388160161 shutdown_connections 2024-03-19T06:23:58.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd6f200640 1 --2- 172.21.15.32:0/2388160161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd680aecf0 0x7efd680ca9f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd6f200640 1 -- 172.21.15.32:0/2388160161 >> 172.21.15.32:0/2388160161 conn(0x7efd680b1280 msgr2=0x7efd680b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:58.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd6f200640 1 -- 172.21.15.32:0/2388160161 shutdown_connections 2024-03-19T06:23:58.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd6f200640 1 -- 172.21.15.32:0/2388160161 wait complete. 2024-03-19T06:23:58.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd6f200640 1 Processor -- start 2024-03-19T06:23:58.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd6f200640 1 -- start start 2024-03-19T06:23:58.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd6f200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd6806d6c0 0x7efd680b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd6f200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd680aecf0 0x7efd6813f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd6f200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd6815c010 0x7efd6815d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd6f200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6816a030 con 0x7efd680aecf0 2024-03-19T06:23:58.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd6f200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd68169eb0 con 0x7efd6806d6c0 2024-03-19T06:23:58.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd6f200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6816a1b0 con 0x7efd6815c010 2024-03-19T06:23:58.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd5f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd680aecf0 0x7efd6813f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd5f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd680aecf0 0x7efd6813f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42368/0 (socket says 172.21.15.32:42368) 2024-03-19T06:23:58.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd5f400640 1 -- 172.21.15.32:0/2898446237 learned_addr learned my addr 172.21.15.32:0/2898446237 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:58.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd67e00640 1 --2- 172.21.15.32:0/2898446237 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd6806d6c0 0x7efd680b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd6d200640 1 --2- 172.21.15.32:0/2898446237 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd6815c010 0x7efd6815d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd5f400640 1 -- 172.21.15.32:0/2898446237 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd6815c010 msgr2=0x7efd6815d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd5f400640 1 --2- 172.21.15.32:0/2898446237 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd6815c010 0x7efd6815d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd5f400640 1 -- 172.21.15.32:0/2898446237 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd6806d6c0 msgr2=0x7efd680b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:58.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd5f400640 1 --2- 172.21.15.32:0/2898446237 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd6806d6c0 0x7efd680b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:58.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd5f400640 1 -- 172.21.15.32:0/2898446237 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680b0730 con 0x7efd680aecf0 2024-03-19T06:23:58.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd6d200640 1 --2- 172.21.15.32:0/2898446237 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd6815c010 0x7efd6815d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:23:58.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd67e00640 1 --2- 172.21.15.32:0/2898446237 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd6806d6c0 0x7efd680b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:58.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.895+0000 7efd5f400640 1 --2- 172.21.15.32:0/2898446237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd680aecf0 0x7efd6813f0c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7efd5000c4d0 tx=0x7efd5000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:58.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.899+0000 7efd64c00640 1 -- 172.21.15.32:0/2898446237 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd50017070 con 0x7efd680aecf0 2024-03-19T06:23:58.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.899+0000 7efd64c00640 1 -- 172.21.15.32:0/2898446237 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd50005cf0 con 0x7efd680aecf0 2024-03-19T06:23:58.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.899+0000 7efd64c00640 1 -- 172.21.15.32:0/2898446237 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd50007270 con 0x7efd680aecf0 2024-03-19T06:23:58.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.899+0000 7efd6f200640 1 -- 172.21.15.32:0/2898446237 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd681548e0 con 0x7efd680aecf0 2024-03-19T06:23:58.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.899+0000 7efd6f200640 1 -- 172.21.15.32:0/2898446237 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd68154ea0 con 0x7efd680aecf0 2024-03-19T06:23:58.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.899+0000 7efd6f200640 1 -- 172.21.15.32:0/2898446237 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd680749e0 con 0x7efd680aecf0 2024-03-19T06:23:58.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.899+0000 7efd64c00640 1 -- 172.21.15.32:0/2898446237 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7efd5001a070 con 0x7efd680aecf0 2024-03-19T06:23:58.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.899+0000 7efd64c00640 1 --2- 172.21.15.32:0/2898446237 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efd44067660 0x7efd44069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:58.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.899+0000 7efd64c00640 1 -- 172.21.15.32:0/2898446237 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efd50084c10 con 0x7efd680aecf0 2024-03-19T06:23:58.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.899+0000 7efd67e00640 1 --2- 172.21.15.32:0/2898446237 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efd44067660 0x7efd44069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:58.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.903+0000 7efd67e00640 1 --2- 172.21.15.32:0/2898446237 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efd44067660 0x7efd44069b20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efd580ad000 tx=0x7efd58008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:58.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:58.903+0000 7efd64c00640 1 -- 172.21.15.32:0/2898446237 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7efd50055160 con 0x7efd680aecf0 2024-03-19T06:23:59.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.099+0000 7efd6f200640 1 -- 172.21.15.32:0/2898446237 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd68166c30 con 0x7efd680aecf0 2024-03-19T06:23:59.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.099+0000 7efd64c00640 1 -- 172.21.15.32:0/2898446237 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4944 (secure 0 0 0) 0x7efd50059200 con 0x7efd680aecf0 2024-03-19T06:23:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:59.087 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3631486110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3631486110},{"type":"v1","addr":"172.21.15.171:6836","nonce":3631486110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/3410824978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3410824978},{"type":"v1","addr":"172.21.15.32:6833","nonce":3410824978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3585939515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3585939515},{"type":"v1","addr":"172.21.15.32:6835","nonce":3585939515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:23:21.920668+0000","modified":"2024-03-19T06:23:24.948860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5934},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5934":{"gid":5934,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/1907516739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1907516739},{"type":"v1","addr":"172.21.15.171:6837","nonce":1907516739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-03-19T06:23:59.087 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 26 2024-03-19T06:23:59.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.099+0000 7efd6f200640 1 -- 172.21.15.32:0/2898446237 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efd44067660 msgr2=0x7efd44069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.099+0000 7efd6f200640 1 --2- 172.21.15.32:0/2898446237 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efd44067660 0x7efd44069b20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efd580ad000 tx=0x7efd58008040 comp rx=0 tx=0).stop 2024-03-19T06:23:59.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.099+0000 7efd6f200640 1 -- 172.21.15.32:0/2898446237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd680aecf0 msgr2=0x7efd6813f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.099+0000 7efd6f200640 1 --2- 172.21.15.32:0/2898446237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd680aecf0 0x7efd6813f0c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7efd5000c4d0 tx=0x7efd5000c990 comp rx=0 tx=0).stop 2024-03-19T06:23:59.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.099+0000 7efd6f200640 1 -- 172.21.15.32:0/2898446237 shutdown_connections 2024-03-19T06:23:59.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.099+0000 7efd6f200640 1 --2- 172.21.15.32:0/2898446237 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7efd44067660 0x7efd44069b20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.099+0000 7efd6f200640 1 --2- 172.21.15.32:0/2898446237 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd6815c010 0x7efd6815d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.099+0000 7efd6f200640 1 --2- 172.21.15.32:0/2898446237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efd680aecf0 0x7efd6813f0c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.099+0000 7efd6f200640 1 --2- 172.21.15.32:0/2898446237 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd6806d6c0 0x7efd680b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.099+0000 7efd6f200640 1 -- 172.21.15.32:0/2898446237 >> 172.21.15.32:0/2898446237 conn(0x7efd680b1280 msgr2=0x7efd681591b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:59.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.103+0000 7efd6f200640 1 -- 172.21.15.32:0/2898446237 shutdown_connections 2024-03-19T06:23:59.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.103+0000 7efd6f200640 1 -- 172.21.15.32:0/2898446237 wait complete. 2024-03-19T06:23:59.108 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:23:59.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.259+0000 7fc222200640 1 Processor -- start 2024-03-19T06:23:59.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.259+0000 7fc222200640 1 -- start start 2024-03-19T06:23:59.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.263+0000 7fc222200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc21c099a70 0x7fc21c099e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.263+0000 7fc222200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc21c06c060 0x7fc21c15e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.263+0000 7fc222200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c06fbe0 con 0x7fc21c161860 2024-03-19T06:23:59.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.263+0000 7fc222200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c09a390 con 0x7fc21c099a70 2024-03-19T06:23:59.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.263+0000 7fc222200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c15e940 con 0x7fc21c06c060 2024-03-19T06:23:59.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.263+0000 7fc212a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc21c06c060 0x7fc21c15e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.263+0000 7fc21b400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc21c099a70 0x7fc21c099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.263+0000 7fc212a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc21c06c060 0x7fc21c15e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:60214/0 (socket says 172.21.15.32:60214) 2024-03-19T06:23:59.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.263+0000 7fc212a00640 1 -- 172.21.15.32:0/1425244340 learned_addr learned my addr 172.21.15.32:0/1425244340 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:59.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.263+0000 7fc21be00640 1 --1- 172.21.15.32:0/1425244340 >> v1:172.21.15.171:6789/0 conn(0x7fc21c161860 0x7fc21c161cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:43062/0 (socket says 172.21.15.32:43062) 2024-03-19T06:23:59.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.263+0000 7fc212a00640 1 -- 172.21.15.32:0/1425244340 >> v2:172.21.15.171:3300/0 conn(0x7fc21c099a70 msgr2=0x7fc21c099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:59.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.263+0000 7fc212a00640 1 --2- 172.21.15.32:0/1425244340 >> v2:172.21.15.171:3300/0 conn(0x7fc21c099a70 0x7fc21c099e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.263+0000 7fc212a00640 1 -- 172.21.15.32:0/1425244340 >> v1:172.21.15.171:6789/0 conn(0x7fc21c161860 legacy=0x7fc21c161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.263+0000 7fc212a00640 1 -- 172.21.15.32:0/1425244340 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c15ec20 con 0x7fc21c06c060 2024-03-19T06:23:59.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.263+0000 7fc21b400640 1 --2- 172.21.15.32:0/1425244340 >> v2:172.21.15.171:3300/0 conn(0x7fc21c099a70 0x7fc21c099e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:23:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.267+0000 7fc212a00640 1 --2- 172.21.15.32:0/1425244340 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc21c06c060 0x7fc21c15e010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc204009e50 tx=0x7fc20401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed789071d6c7dcad server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:59.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.267+0000 7fc21aa00640 1 -- 172.21.15.32:0/1425244340 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2040a57f0 con 0x7fc21c06c060 2024-03-19T06:23:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.267+0000 7fc21aa00640 1 -- 172.21.15.32:0/1425244340 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2040a5990 con 0x7fc21c06c060 2024-03-19T06:23:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.267+0000 7fc21aa00640 1 -- 172.21.15.32:0/1425244340 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2040a5d60 con 0x7fc21c06c060 2024-03-19T06:23:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.267+0000 7fc222200640 1 -- 172.21.15.32:0/1425244340 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc21c06c060 msgr2=0x7fc21c15e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.267+0000 7fc222200640 1 --2- 172.21.15.32:0/1425244340 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc21c06c060 0x7fc21c15e010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc204009e50 tx=0x7fc20401ca30 comp rx=0 tx=0).stop 2024-03-19T06:23:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.267+0000 7fc222200640 1 -- 172.21.15.32:0/1425244340 shutdown_connections 2024-03-19T06:23:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.267+0000 7fc222200640 1 --2- 172.21.15.32:0/1425244340 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc21c06c060 0x7fc21c15e010 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.267+0000 7fc222200640 1 --2- 172.21.15.32:0/1425244340 >> v2:172.21.15.171:3300/0 conn(0x7fc21c099a70 0x7fc21c099e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.267+0000 7fc222200640 1 -- 172.21.15.32:0/1425244340 >> 172.21.15.32:0/1425244340 conn(0x7fc21c0b3300 msgr2=0x7fc21c0b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.267+0000 7fc222200640 1 -- 172.21.15.32:0/1425244340 shutdown_connections 2024-03-19T06:23:59.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.267+0000 7fc222200640 1 -- 172.21.15.32:0/1425244340 wait complete. 2024-03-19T06:23:59.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.267+0000 7fc222200640 1 Processor -- start 2024-03-19T06:23:59.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.267+0000 7fc222200640 1 -- start start 2024-03-19T06:23:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc222200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc21c06c060 0x7fc21c1509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc222200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc21c099a70 0x7fc21c0cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc222200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc21c161860 0x7fc21c151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc222200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c15e6d0 con 0x7fc21c161860 2024-03-19T06:23:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc222200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c15e550 con 0x7fc21c06c060 2024-03-19T06:23:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc222200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c16b410 con 0x7fc21c099a70 2024-03-19T06:23:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc21be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc21c161860 0x7fc21c151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc21be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc21c161860 0x7fc21c151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42382/0 (socket says 172.21.15.32:42382) 2024-03-19T06:23:59.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc21be00640 1 -- 172.21.15.32:0/3002756916 learned_addr learned my addr 172.21.15.32:0/3002756916 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:59.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc21b400640 1 --2- 172.21.15.32:0/3002756916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc21c06c060 0x7fc21c1509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc212a00640 1 --2- 172.21.15.32:0/3002756916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc21c099a70 0x7fc21c0cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc21be00640 1 -- 172.21.15.32:0/3002756916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc21c099a70 msgr2=0x7fc21c0cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc21be00640 1 --2- 172.21.15.32:0/3002756916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc21c099a70 0x7fc21c0cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc21be00640 1 -- 172.21.15.32:0/3002756916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc21c06c060 msgr2=0x7fc21c1509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc21be00640 1 --2- 172.21.15.32:0/3002756916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc21c06c060 0x7fc21c1509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc21be00640 1 -- 172.21.15.32:0/3002756916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c0c88e0 con 0x7fc21c161860 2024-03-19T06:23:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc21be00640 1 --2- 172.21.15.32:0/3002756916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc21c161860 0x7fc21c151ad0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc21400c440 tx=0x7fc21400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc213e00640 1 -- 172.21.15.32:0/3002756916 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc214018070 con 0x7fc21c161860 2024-03-19T06:23:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc213e00640 1 -- 172.21.15.32:0/3002756916 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc214007480 con 0x7fc21c161860 2024-03-19T06:23:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc213e00640 1 -- 172.21.15.32:0/3002756916 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2140047f0 con 0x7fc21c161860 2024-03-19T06:23:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc222200640 1 -- 172.21.15.32:0/3002756916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c0c8bc0 con 0x7fc21c161860 2024-03-19T06:23:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc222200640 1 -- 172.21.15.32:0/3002756916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c0ae810 con 0x7fc21c161860 2024-03-19T06:23:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.271+0000 7fc222200640 1 -- 172.21.15.32:0/3002756916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c0749e0 con 0x7fc21c161860 2024-03-19T06:23:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.275+0000 7fc213e00640 1 -- 172.21.15.32:0/3002756916 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc214004990 con 0x7fc21c161860 2024-03-19T06:23:59.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.275+0000 7fc213e00640 1 --2- 172.21.15.32:0/3002756916 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc1f8067660 0x7fc1f8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.275+0000 7fc213e00640 1 -- 172.21.15.32:0/3002756916 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc214084b60 con 0x7fc21c161860 2024-03-19T06:23:59.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.275+0000 7fc21b400640 1 --2- 172.21.15.32:0/3002756916 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc1f8067660 0x7fc1f8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.275+0000 7fc21b400640 1 --2- 172.21.15.32:0/3002756916 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc1f8067660 0x7fc1f8069b20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009580 tx=0x7fc20c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:59.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.279+0000 7fc213e00640 1 -- 172.21.15.32:0/3002756916 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fc21c06fbe0 con 0x7fc21c161860 2024-03-19T06:23:59.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.479+0000 7fc222200640 1 -- 172.21.15.32:0/3002756916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc21c0b4100 con 0x7fc21c161860 2024-03-19T06:23:59.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.479+0000 7fc213e00640 1 -- 172.21.15.32:0/3002756916 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fc2140550b0 con 0x7fc21c161860 2024-03-19T06:23:59.466 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:59.467 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3631486110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3631486110},{"type":"v1","addr":"172.21.15.171:6836","nonce":3631486110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/3410824978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3410824978},{"type":"v1","addr":"172.21.15.32:6833","nonce":3410824978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3585939515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3585939515},{"type":"v1","addr":"172.21.15.32:6835","nonce":3585939515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:23:21.920668+0000","modified":"2024-03-19T06:23:24.948860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5934},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5934":{"gid":5934,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6837/1907516739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1907516739},{"type":"v1","addr":"172.21.15.171:6837","nonce":1907516739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-03-19T06:23:59.467 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 26 2024-03-19T06:23:59.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.479+0000 7fc222200640 1 -- 172.21.15.32:0/3002756916 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc1f8067660 msgr2=0x7fc1f8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.479+0000 7fc222200640 1 --2- 172.21.15.32:0/3002756916 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc1f8067660 0x7fc1f8069b20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009580 tx=0x7fc20c009190 comp rx=0 tx=0).stop 2024-03-19T06:23:59.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.479+0000 7fc222200640 1 -- 172.21.15.32:0/3002756916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc21c161860 msgr2=0x7fc21c151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.479+0000 7fc222200640 1 --2- 172.21.15.32:0/3002756916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc21c161860 0x7fc21c151ad0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc21400c440 tx=0x7fc21400c900 comp rx=0 tx=0).stop 2024-03-19T06:23:59.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.479+0000 7fc222200640 1 -- 172.21.15.32:0/3002756916 shutdown_connections 2024-03-19T06:23:59.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.479+0000 7fc222200640 1 --2- 172.21.15.32:0/3002756916 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc1f8067660 0x7fc1f8069b20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.479+0000 7fc222200640 1 --2- 172.21.15.32:0/3002756916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc21c161860 0x7fc21c151ad0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.479+0000 7fc222200640 1 --2- 172.21.15.32:0/3002756916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc21c099a70 0x7fc21c0cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.479+0000 7fc222200640 1 --2- 172.21.15.32:0/3002756916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc21c06c060 0x7fc21c1509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.479+0000 7fc222200640 1 -- 172.21.15.32:0/3002756916 >> 172.21.15.32:0/3002756916 conn(0x7fc21c0b3300 msgr2=0x7fc21c161cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:59.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.479+0000 7fc222200640 1 -- 172.21.15.32:0/3002756916 shutdown_connections 2024-03-19T06:23:59.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.479+0000 7fc222200640 1 -- 172.21.15.32:0/3002756916 wait complete. 2024-03-19T06:23:59.488 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:23:59.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.643+0000 7f91c1a00640 1 Processor -- start 2024-03-19T06:23:59.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.643+0000 7f91c1a00640 1 -- start start 2024-03-19T06:23:59.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.643+0000 7f91c1a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f91bc15bbf0 0x7f91bc0700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.643+0000 7f91c1a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f91bc06c460 0x7f91bc15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.643+0000 7f91c1a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91bc06e550 con 0x7f91bc0cc150 2024-03-19T06:23:59.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.643+0000 7f91c1a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91bc06ece0 con 0x7f91bc06c460 2024-03-19T06:23:59.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.643+0000 7f91c1a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91bc0b49b0 con 0x7f91bc15bbf0 2024-03-19T06:23:59.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.643+0000 7f91bb400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f91bc06c460 0x7f91bc15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.643+0000 7f91bb400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f91bc06c460 0x7f91bc15bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42384/0 (socket says 172.21.15.32:42384) 2024-03-19T06:23:59.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.643+0000 7f91bb400640 1 -- 172.21.15.32:0/3515790453 learned_addr learned my addr 172.21.15.32:0/3515790453 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:59.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.643+0000 7f91baa00640 1 --2- 172.21.15.32:0/3515790453 >> v2:172.21.15.171:3300/0 conn(0x7f91bc15bbf0 0x7f91bc0700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.643+0000 7f91bb400640 1 -- 172.21.15.32:0/3515790453 >> v2:172.21.15.171:3300/0 conn(0x7f91bc15bbf0 msgr2=0x7f91bc0700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:59.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.643+0000 7f91bb400640 1 --2- 172.21.15.32:0/3515790453 >> v2:172.21.15.171:3300/0 conn(0x7f91bc15bbf0 0x7f91bc0700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.643+0000 7f91bb400640 1 -- 172.21.15.32:0/3515790453 >> v1:172.21.15.171:6789/0 conn(0x7f91bc0cc150 legacy=0x7f91bc06bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.643+0000 7f91bb400640 1 -- 172.21.15.32:0/3515790453 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc0b4c90 con 0x7f91bc06c460 2024-03-19T06:23:59.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.647+0000 7f91bb400640 1 --2- 172.21.15.32:0/3515790453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91bc06c460 0x7f91bc15bfd0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f91bc06c880 tx=0x7f91b401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7afa8101bc6f16f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:59.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.647+0000 7f91ba000640 1 -- 172.21.15.32:0/3515790453 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40b0070 con 0x7f91bc06c460 2024-03-19T06:23:59.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.647+0000 7f91ba000640 1 -- 172.21.15.32:0/3515790453 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b40ab600 con 0x7f91bc06c460 2024-03-19T06:23:59.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.647+0000 7f91ba000640 1 -- 172.21.15.32:0/3515790453 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40ab9d0 con 0x7f91bc06c460 2024-03-19T06:23:59.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.647+0000 7f91c1a00640 1 -- 172.21.15.32:0/3515790453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91bc06c460 msgr2=0x7f91bc15bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.647+0000 7f91c1a00640 1 --2- 172.21.15.32:0/3515790453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91bc06c460 0x7f91bc15bfd0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f91bc06c880 tx=0x7f91b401c490 comp rx=0 tx=0).stop 2024-03-19T06:23:59.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.647+0000 7f91c1a00640 1 -- 172.21.15.32:0/3515790453 shutdown_connections 2024-03-19T06:23:59.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.647+0000 7f91c1a00640 1 --2- 172.21.15.32:0/3515790453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91bc06c460 0x7f91bc15bfd0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.647+0000 7f91c1a00640 1 --2- 172.21.15.32:0/3515790453 >> v2:172.21.15.171:3300/0 conn(0x7f91bc15bbf0 0x7f91bc0700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.647+0000 7f91c1a00640 1 -- 172.21.15.32:0/3515790453 >> 172.21.15.32:0/3515790453 conn(0x7f91bc071c50 msgr2=0x7f91bc072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:59.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.647+0000 7f91c1a00640 1 -- 172.21.15.32:0/3515790453 shutdown_connections 2024-03-19T06:23:59.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.647+0000 7f91c1a00640 1 -- 172.21.15.32:0/3515790453 wait complete. 2024-03-19T06:23:59.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91c1a00640 1 Processor -- start 2024-03-19T06:23:59.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91c1a00640 1 -- start start 2024-03-19T06:23:59.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91c1a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91bc06c460 0x7f91bc14a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91c1a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91bc0cc150 0x7f91bc1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91c1a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91bc15bbf0 0x7f91bc158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91c1a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc15d0b0 con 0x7f91bc06c460 2024-03-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91c1a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc15cf30 con 0x7f91bc0cc150 2024-03-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91c1a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc15d230 con 0x7f91bc15bbf0 2024-03-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91baa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91bc06c460 0x7f91bc14a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91baa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91bc06c460 0x7f91bc14a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42396/0 (socket says 172.21.15.32:42396) 2024-03-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91baa00640 1 -- 172.21.15.32:0/3645628981 learned_addr learned my addr 172.21.15.32:0/3645628981 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91b2000640 1 --2- 172.21.15.32:0/3645628981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91bc0cc150 0x7f91bc1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91bb400640 1 --2- 172.21.15.32:0/3645628981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91bc15bbf0 0x7f91bc158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91baa00640 1 -- 172.21.15.32:0/3645628981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91bc15bbf0 msgr2=0x7f91bc158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91baa00640 1 --2- 172.21.15.32:0/3645628981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91bc15bbf0 0x7f91bc158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91baa00640 1 -- 172.21.15.32:0/3645628981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91bc0cc150 msgr2=0x7f91bc1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91baa00640 1 --2- 172.21.15.32:0/3645628981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91bc0cc150 0x7f91bc1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91baa00640 1 -- 172.21.15.32:0/3645628981 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc156d90 con 0x7f91bc06c460 2024-03-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91baa00640 1 --2- 172.21.15.32:0/3645628981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91bc06c460 0x7f91bc14a500 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00d5f0 tx=0x7f91ac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91b3400640 1 -- 172.21.15.32:0/3645628981 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac0125f0 con 0x7f91bc06c460 2024-03-19T06:23:59.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91b3400640 1 -- 172.21.15.32:0/3645628981 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ac019070 con 0x7f91bc06c460 2024-03-19T06:23:59.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91b3400640 1 -- 172.21.15.32:0/3645628981 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac0129d0 con 0x7f91bc06c460 2024-03-19T06:23:59.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91c1a00640 1 -- 172.21.15.32:0/3645628981 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91bc157070 con 0x7f91bc06c460 2024-03-19T06:23:59.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.651+0000 7f91c1a00640 1 -- 172.21.15.32:0/3645628981 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91bc157630 con 0x7f91bc06c460 2024-03-19T06:23:59.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.655+0000 7f91c1a00640 1 -- 172.21.15.32:0/3645628981 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91bc0749e0 con 0x7f91bc06c460 2024-03-19T06:23:59.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.655+0000 7f91b3400640 1 -- 172.21.15.32:0/3645628981 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f91ac012b70 con 0x7f91bc06c460 2024-03-19T06:23:59.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.655+0000 7f91b3400640 1 --2- 172.21.15.32:0/3645628981 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9198067660 0x7f9198069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.655+0000 7f91b3400640 1 -- 172.21.15.32:0/3645628981 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f91ac085e30 con 0x7f91bc06c460 2024-03-19T06:23:59.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.655+0000 7f91b2000640 1 --2- 172.21.15.32:0/3645628981 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9198067660 0x7f9198069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.655+0000 7f91b2000640 1 --2- 172.21.15.32:0/3645628981 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9198067660 0x7f9198069b20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f91bc068080 tx=0x7f91a4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:59.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.659+0000 7f91b3400640 1 -- 172.21.15.32:0/3645628981 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f91ac0569d0 con 0x7f91bc06c460 2024-03-19T06:23:59.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.827+0000 7f91c1a00640 1 -- 172.21.15.32:0/3645628981 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91bc0680d0 con 0x7f91bc06c460 2024-03-19T06:23:59.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.827+0000 7f91b3400640 1 -- 172.21.15.32:0/3645628981 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16721 (secure 0 0 0) 0x7f91ac0562d0 con 0x7f91bc06c460 2024-03-19T06:23:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:23:59.815 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":53,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:23:51.649760+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:23:19.707249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-03-19T06:23:20.926932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1d","mappings":[{"from":0,"to":6}]},{"pgid":"8.25","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:23:59.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.827+0000 7f91c1a00640 1 -- 172.21.15.32:0/3645628981 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9198067660 msgr2=0x7f9198069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.827+0000 7f91c1a00640 1 --2- 172.21.15.32:0/3645628981 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9198067660 0x7f9198069b20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f91bc068080 tx=0x7f91a4009040 comp rx=0 tx=0).stop 2024-03-19T06:23:59.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.827+0000 7f91c1a00640 1 -- 172.21.15.32:0/3645628981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91bc06c460 msgr2=0x7f91bc14a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.827+0000 7f91c1a00640 1 --2- 172.21.15.32:0/3645628981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91bc06c460 0x7f91bc14a500 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00d5f0 tx=0x7f91ac00dab0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.827+0000 7f91c1a00640 1 -- 172.21.15.32:0/3645628981 shutdown_connections 2024-03-19T06:23:59.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.827+0000 7f91c1a00640 1 --2- 172.21.15.32:0/3645628981 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9198067660 0x7f9198069b20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.827+0000 7f91c1a00640 1 --2- 172.21.15.32:0/3645628981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91bc15bbf0 0x7f91bc158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.827+0000 7f91c1a00640 1 --2- 172.21.15.32:0/3645628981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91bc0cc150 0x7f91bc1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.827+0000 7f91c1a00640 1 --2- 172.21.15.32:0/3645628981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91bc06c460 0x7f91bc14a500 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.827+0000 7f91c1a00640 1 -- 172.21.15.32:0/3645628981 >> 172.21.15.32:0/3645628981 conn(0x7f91bc071c50 msgr2=0x7f91bc14fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:59.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.827+0000 7f91c1a00640 1 -- 172.21.15.32:0/3645628981 shutdown_connections 2024-03-19T06:23:59.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.827+0000 7f91c1a00640 1 -- 172.21.15.32:0/3645628981 wait complete. 2024-03-19T06:23:59.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-19T06:23:59.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f35c00640 1 Processor -- start 2024-03-19T06:23:59.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f35c00640 1 -- start start 2024-03-19T06:23:59.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f35c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3015a7c0 0x7f9f300cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f35c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9f300cc680 0x7f9f3015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f35c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f300cb670 con 0x7f9f300b4c50 2024-03-19T06:23:59.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f35c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f3015e860 con 0x7f9f300cc680 2024-03-19T06:23:59.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f35c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300cb950 con 0x7f9f3015a7c0 2024-03-19T06:23:59.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f2ea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3015a7c0 0x7f9f300cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f2ea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3015a7c0 0x7f9f300cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:60248/0 (socket says 172.21.15.32:60248) 2024-03-19T06:23:59.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f2ea00640 1 -- 172.21.15.32:0/2659795368 learned_addr learned my addr 172.21.15.32:0/2659795368 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:59.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f2f400640 1 --1- 172.21.15.32:0/2659795368 >> v1:172.21.15.171:6789/0 conn(0x7f9f300b4c50 0x7f9f300cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:43092/0 (socket says 172.21.15.32:43092) 2024-03-19T06:23:59.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f27e00640 1 --2- 172.21.15.32:0/2659795368 >> v2:172.21.15.171:3300/0 conn(0x7f9f300cc680 0x7f9f3015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f27e00640 1 -- 172.21.15.32:0/2659795368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3015a7c0 msgr2=0x7f9f300cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:23:59.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f27e00640 1 --2- 172.21.15.32:0/2659795368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3015a7c0 0x7f9f300cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f2e000640 1 -- 172.21.15.32:0/2659795368 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89713241 0 0) 0x7f9f300cb670 con 0x7f9f300b4c50 2024-03-19T06:23:59.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f27e00640 1 -- 172.21.15.32:0/2659795368 >> v1:172.21.15.171:6789/0 conn(0x7f9f300b4c50 legacy=0x7f9f300cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f27e00640 1 -- 172.21.15.32:0/2659795368 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3015e4f0 con 0x7f9f300cc680 2024-03-19T06:23:59.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.991+0000 7f9f2ea00640 1 --2- 172.21.15.32:0/2659795368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3015a7c0 0x7f9f300cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:23:59.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.995+0000 7f9f27e00640 1 --2- 172.21.15.32:0/2659795368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f300cc680 0x7f9f3015ecf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9f180097c0 tx=0x7f9f1801c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e22c9aac340e73da server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:59.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.995+0000 7f9f2e000640 1 -- 172.21.15.32:0/2659795368 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f180b1070 con 0x7f9f300cc680 2024-03-19T06:23:59.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.995+0000 7f9f2e000640 1 -- 172.21.15.32:0/2659795368 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f180ac630 con 0x7f9f300cc680 2024-03-19T06:23:59.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.995+0000 7f9f2e000640 1 -- 172.21.15.32:0/2659795368 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f180a8050 con 0x7f9f300cc680 2024-03-19T06:23:59.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f35c00640 1 -- 172.21.15.32:0/2659795368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f300cc680 msgr2=0x7f9f3015ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f35c00640 1 --2- 172.21.15.32:0/2659795368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f300cc680 0x7f9f3015ecf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9f180097c0 tx=0x7f9f1801c3b0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f35c00640 1 -- 172.21.15.32:0/2659795368 shutdown_connections 2024-03-19T06:23:59.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f35c00640 1 --2- 172.21.15.32:0/2659795368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f300cc680 0x7f9f3015ecf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f35c00640 1 --2- 172.21.15.32:0/2659795368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3015a7c0 0x7f9f300cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f35c00640 1 -- 172.21.15.32:0/2659795368 >> 172.21.15.32:0/2659795368 conn(0x7f9f300b1280 msgr2=0x7f9f300b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:23:59.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f35c00640 1 -- 172.21.15.32:0/2659795368 shutdown_connections 2024-03-19T06:23:59.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f35c00640 1 -- 172.21.15.32:0/2659795368 wait complete. 2024-03-19T06:23:59.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f35c00640 1 Processor -- start 2024-03-19T06:23:59.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f35c00640 1 -- start start 2024-03-19T06:23:59.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f35c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f300b4c50 0x7f9f3015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f35c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f300cc680 0x7f9f3015d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f35c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3015a7c0 0x7f9f3015c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f35c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3015f3b0 con 0x7f9f3015a7c0 2024-03-19T06:23:59.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f35c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3015f230 con 0x7f9f300cc680 2024-03-19T06:23:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f35c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300cbc30 con 0x7f9f300b4c50 2024-03-19T06:23:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f2f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3015a7c0 0x7f9f3015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f2f400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3015a7c0 0x7f9f3015c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42406/0 (socket says 172.21.15.32:42406) 2024-03-19T06:23:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f2f400640 1 -- 172.21.15.32:0/3072199545 learned_addr learned my addr 172.21.15.32:0/3072199545 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:23:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f2ea00640 1 --2- 172.21.15.32:0/3072199545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f300b4c50 0x7f9f3015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f27e00640 1 --2- 172.21.15.32:0/3072199545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f300cc680 0x7f9f3015d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f2f400640 1 -- 172.21.15.32:0/3072199545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f300b4c50 msgr2=0x7f9f3015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f2f400640 1 --2- 172.21.15.32:0/3072199545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f300b4c50 0x7f9f3015aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f2f400640 1 -- 172.21.15.32:0/3072199545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f300cc680 msgr2=0x7f9f3015d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:23:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f2f400640 1 --2- 172.21.15.32:0/3072199545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f300cc680 0x7f9f3015d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:23:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:23:59.999+0000 7f9f2f400640 1 -- 172.21.15.32:0/3072199545 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3015b4b0 con 0x7f9f3015a7c0 2024-03-19T06:23:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.003+0000 7f9f27e00640 1 --2- 172.21.15.32:0/3072199545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f300cc680 0x7f9f3015d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:23:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.003+0000 7f9f2f400640 1 --2- 172.21.15.32:0/3072199545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3015a7c0 0x7f9f3015c550 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800c730 tx=0x7f9f2800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.003+0000 7f9f26a00640 1 -- 172.21.15.32:0/3072199545 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28018070 con 0x7f9f3015a7c0 2024-03-19T06:23:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.003+0000 7f9f26a00640 1 -- 172.21.15.32:0/3072199545 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2800ce40 con 0x7f9f3015a7c0 2024-03-19T06:23:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.003+0000 7f9f26a00640 1 -- 172.21.15.32:0/3072199545 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2800a860 con 0x7f9f3015a7c0 2024-03-19T06:23:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.003+0000 7f9f35c00640 1 -- 172.21.15.32:0/3072199545 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3015b790 con 0x7f9f3015a7c0 2024-03-19T06:23:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.003+0000 7f9f35c00640 1 -- 172.21.15.32:0/3072199545 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3015bd50 con 0x7f9f3015a7c0 2024-03-19T06:23:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.003+0000 7f9f35c00640 1 -- 172.21.15.32:0/3072199545 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f300749e0 con 0x7f9f3015a7c0 2024-03-19T06:23:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.003+0000 7f9f26a00640 1 -- 172.21.15.32:0/3072199545 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9f2800aa00 con 0x7f9f3015a7c0 2024-03-19T06:23:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.003+0000 7f9f26a00640 1 --2- 172.21.15.32:0/3072199545 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9f0c067660 0x7f9f0c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:23:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.003+0000 7f9f26a00640 1 -- 172.21.15.32:0/3072199545 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9f28084e90 con 0x7f9f3015a7c0 2024-03-19T06:23:59.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.007+0000 7f9f2ea00640 1 --2- 172.21.15.32:0/3072199545 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9f0c067660 0x7f9f0c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:23:59.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.007+0000 7f9f2ea00640 1 --2- 172.21.15.32:0/3072199545 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9f0c067660 0x7f9f0c069b20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9f20006cb0 tx=0x7f9f20009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:23:59.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.007+0000 7f9f26a00640 1 -- 172.21.15.32:0/3072199545 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f9f280553e0 con 0x7f9f3015a7c0 2024-03-19T06:24:00.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.207+0000 7f9f35c00640 1 -- 172.21.15.32:0/3072199545 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9f300cc270 con 0x7f9f3015a7c0 2024-03-19T06:24:00.193 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-03-19T06:24:00.207+0000 7f6650800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-19T06:24:00.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.207+0000 7f9f26a00640 1 -- 172.21.15.32:0/3072199545 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9f28086020 con 0x7f9f3015a7c0 2024-03-19T06:24:00.195 INFO:teuthology.orchestra.run.smithi032.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-19T06:24:00.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.211+0000 7f9f35c00640 1 -- 172.21.15.32:0/3072199545 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9f0c067660 msgr2=0x7f9f0c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:00.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.211+0000 7f9f35c00640 1 --2- 172.21.15.32:0/3072199545 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9f0c067660 0x7f9f0c069b20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9f20006cb0 tx=0x7f9f20009240 comp rx=0 tx=0).stop 2024-03-19T06:24:00.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.211+0000 7f9f35c00640 1 -- 172.21.15.32:0/3072199545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3015a7c0 msgr2=0x7f9f3015c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:00.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.211+0000 7f9f35c00640 1 --2- 172.21.15.32:0/3072199545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3015a7c0 0x7f9f3015c550 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800c730 tx=0x7f9f2800cbf0 comp rx=0 tx=0).stop 2024-03-19T06:24:00.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.211+0000 7f9f35c00640 1 -- 172.21.15.32:0/3072199545 shutdown_connections 2024-03-19T06:24:00.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.211+0000 7f9f35c00640 1 --2- 172.21.15.32:0/3072199545 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f9f0c067660 0x7f9f0c069b20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:00.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.211+0000 7f9f35c00640 1 --2- 172.21.15.32:0/3072199545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3015a7c0 0x7f9f3015c550 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:00.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.211+0000 7f9f35c00640 1 --2- 172.21.15.32:0/3072199545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f300cc680 0x7f9f3015d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:00.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.211+0000 7f9f35c00640 1 --2- 172.21.15.32:0/3072199545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f300b4c50 0x7f9f3015aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:00.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.211+0000 7f9f35c00640 1 -- 172.21.15.32:0/3072199545 >> 172.21.15.32:0/3072199545 conn(0x7f9f300b1280 msgr2=0x7f9f3006e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:00.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.211+0000 7f9f35c00640 1 -- 172.21.15.32:0/3072199545 shutdown_connections 2024-03-19T06:24:00.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.211+0000 7f9f35c00640 1 -- 172.21.15.32:0/3072199545 wait complete. 2024-03-19T06:24:00.205 INFO:tasks.ceph.mds.b.smithi171.stderr: -3018> 2024-03-19T06:23:27.511+0000 7f9bd3800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-19T06:24:00.218 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-19T06:24:00.251 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-03-19T06:24:00.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.371+0000 7f18b1000640 1 Processor -- start 2024-03-19T06:24:00.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.371+0000 7f18b1000640 1 -- start start 2024-03-19T06:24:00.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.375+0000 7f18b1000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f18ac150ad0 0x7f18ac150f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:00.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.375+0000 7f18b1000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f18ac0b2f80 0x7f18ac0b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:00.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.375+0000 7f18b1000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ac0b3930 con 0x7f18ac071550 2024-03-19T06:24:00.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.375+0000 7f18b1000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ac1514a0 con 0x7f18ac0b2f80 2024-03-19T06:24:00.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.375+0000 7f18b1000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ac0b3c00 con 0x7f18ac150ad0 2024-03-19T06:24:00.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.375+0000 7f18aa800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f18ac0b2f80 0x7f18ac0b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:00.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.375+0000 7f18aa800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f18ac0b2f80 0x7f18ac0b33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42412/0 (socket says 172.21.15.32:42412) 2024-03-19T06:24:00.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.375+0000 7f18aa800640 1 -- 172.21.15.32:0/3398211506 learned_addr learned my addr 172.21.15.32:0/3398211506 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:00.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.375+0000 7f18a1400640 1 --2- 172.21.15.32:0/3398211506 >> v2:172.21.15.171:3300/0 conn(0x7f18ac150ad0 0x7f18ac150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:00.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.375+0000 7f18aa800640 1 -- 172.21.15.32:0/3398211506 >> v2:172.21.15.171:3300/0 conn(0x7f18ac150ad0 msgr2=0x7f18ac150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:00.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.375+0000 7f18aa800640 1 --2- 172.21.15.32:0/3398211506 >> v2:172.21.15.171:3300/0 conn(0x7f18ac150ad0 0x7f18ac150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:00.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.375+0000 7f18aa800640 1 -- 172.21.15.32:0/3398211506 >> v1:172.21.15.171:6789/0 conn(0x7f18ac071550 legacy=0x7f18ac071930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:00.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.375+0000 7f18aa800640 1 -- 172.21.15.32:0/3398211506 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac0b3ee0 con 0x7f18ac0b2f80 2024-03-19T06:24:00.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.379+0000 7f18aa800640 1 --2- 172.21.15.32:0/3398211506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac0b2f80 0x7f18ac0b33f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f18ac06bc10 tx=0x7f18a401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249d563f189dd411 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:00.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.379+0000 7f18a9400640 1 -- 172.21.15.32:0/3398211506 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a40b1070 con 0x7f18ac0b2f80 2024-03-19T06:24:00.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.379+0000 7f18a9400640 1 -- 172.21.15.32:0/3398211506 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a40ac5f0 con 0x7f18ac0b2f80 2024-03-19T06:24:00.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.379+0000 7f18a9400640 1 -- 172.21.15.32:0/3398211506 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a40ac9c0 con 0x7f18ac0b2f80 2024-03-19T06:24:00.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.379+0000 7f18b1000640 1 -- 172.21.15.32:0/3398211506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac0b2f80 msgr2=0x7f18ac0b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:00.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.379+0000 7f18b1000640 1 --2- 172.21.15.32:0/3398211506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac0b2f80 0x7f18ac0b33f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f18ac06bc10 tx=0x7f18a401c520 comp rx=0 tx=0).stop 2024-03-19T06:24:00.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.379+0000 7f18b1000640 1 -- 172.21.15.32:0/3398211506 shutdown_connections 2024-03-19T06:24:00.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.379+0000 7f18b1000640 1 --2- 172.21.15.32:0/3398211506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac0b2f80 0x7f18ac0b33f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:00.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.379+0000 7f18b1000640 1 --2- 172.21.15.32:0/3398211506 >> v2:172.21.15.171:3300/0 conn(0x7f18ac150ad0 0x7f18ac150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:00.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.379+0000 7f18b1000640 1 -- 172.21.15.32:0/3398211506 >> 172.21.15.32:0/3398211506 conn(0x7f18ac0b1590 msgr2=0x7f18ac0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:00.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.379+0000 7f18b1000640 1 -- 172.21.15.32:0/3398211506 shutdown_connections 2024-03-19T06:24:00.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.379+0000 7f18b1000640 1 -- 172.21.15.32:0/3398211506 wait complete. 2024-03-19T06:24:00.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.379+0000 7f18b1000640 1 Processor -- start 2024-03-19T06:24:00.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.379+0000 7f18b1000640 1 -- start start 2024-03-19T06:24:00.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18b1000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac071550 0x7f18ac0cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:00.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18b1000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18ac0b2f80 0x7f18ac0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:00.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18b1000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f18ac150ad0 0x7f18ac0c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:00.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18b1000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac15adc0 con 0x7f18ac071550 2024-03-19T06:24:00.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18b1000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac15ac40 con 0x7f18ac0b2f80 2024-03-19T06:24:00.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18b1000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac15af40 con 0x7f18ac150ad0 2024-03-19T06:24:00.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18a9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac071550 0x7f18ac0cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:00.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18a9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac071550 0x7f18ac0cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42424/0 (socket says 172.21.15.32:42424) 2024-03-19T06:24:00.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18a9e00640 1 -- 172.21.15.32:0/787672187 learned_addr learned my addr 172.21.15.32:0/787672187 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:00.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18aa800640 1 --2- 172.21.15.32:0/787672187 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f18ac150ad0 0x7f18ac0c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:00.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18a1400640 1 --2- 172.21.15.32:0/787672187 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18ac0b2f80 0x7f18ac0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:00.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18a9e00640 1 -- 172.21.15.32:0/787672187 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f18ac150ad0 msgr2=0x7f18ac0c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:00.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18a9e00640 1 --2- 172.21.15.32:0/787672187 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f18ac150ad0 0x7f18ac0c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:00.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18a9e00640 1 -- 172.21.15.32:0/787672187 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18ac0b2f80 msgr2=0x7f18ac0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:00.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18a9e00640 1 --2- 172.21.15.32:0/787672187 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18ac0b2f80 0x7f18ac0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:00.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18a9e00640 1 -- 172.21.15.32:0/787672187 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac0cd6e0 con 0x7f18ac071550 2024-03-19T06:24:00.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18a9e00640 1 --2- 172.21.15.32:0/787672187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac071550 0x7f18ac0cd020 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f189c00c7c0 tx=0x7f189c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:00.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18a2a00640 1 -- 172.21.15.32:0/787672187 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c016020 con 0x7f18ac071550 2024-03-19T06:24:00.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18a2a00640 1 -- 172.21.15.32:0/787672187 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189c006d60 con 0x7f18ac071550 2024-03-19T06:24:00.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18a2a00640 1 -- 172.21.15.32:0/787672187 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c003bc0 con 0x7f18ac071550 2024-03-19T06:24:00.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18b1000640 1 -- 172.21.15.32:0/787672187 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ac0cd9c0 con 0x7f18ac071550 2024-03-19T06:24:00.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18b1000640 1 -- 172.21.15.32:0/787672187 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ac0cdf80 con 0x7f18ac071550 2024-03-19T06:24:00.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18b1000640 1 -- 172.21.15.32:0/787672187 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ac0749e0 con 0x7f18ac071550 2024-03-19T06:24:00.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.383+0000 7f18a2a00640 1 -- 172.21.15.32:0/787672187 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f189c00a850 con 0x7f18ac071550 2024-03-19T06:24:00.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.387+0000 7f18a2a00640 1 --2- 172.21.15.32:0/787672187 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1888067690 0x7f1888069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:00.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.387+0000 7f18a2a00640 1 -- 172.21.15.32:0/787672187 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f189c0854f0 con 0x7f18ac071550 2024-03-19T06:24:00.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.387+0000 7f18a1400640 1 --2- 172.21.15.32:0/787672187 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1888067690 0x7f1888069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:00.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.387+0000 7f18a1400640 1 --2- 172.21.15.32:0/787672187 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1888067690 0x7f1888069b50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0cf8e0 tx=0x7f1894009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:00.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.391+0000 7f18a2a00640 1 -- 172.21.15.32:0/787672187 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f189c020020 con 0x7f18ac071550 2024-03-19T06:24:00.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:00.587+0000 7f18b1000640 1 -- 172.21.15.32:0/787672187 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f18ac0722a0 con 0x7f18ac071550 2024-03-19T06:24:01.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.211+0000 7f18a2a00640 1 -- 172.21.15.32:0/787672187 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f189c055a80 con 0x7f18ac071550 2024-03-19T06:24:01.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.211+0000 7f18b1000640 1 -- 172.21.15.32:0/787672187 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1888067690 msgr2=0x7f1888069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:01.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.211+0000 7f18b1000640 1 --2- 172.21.15.32:0/787672187 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1888067690 0x7f1888069b50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0cf8e0 tx=0x7f1894009190 comp rx=0 tx=0).stop 2024-03-19T06:24:01.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.211+0000 7f18b1000640 1 -- 172.21.15.32:0/787672187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac071550 msgr2=0x7f18ac0cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:01.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.211+0000 7f18b1000640 1 --2- 172.21.15.32:0/787672187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac071550 0x7f18ac0cd020 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f189c00c7c0 tx=0x7f189c00cc80 comp rx=0 tx=0).stop 2024-03-19T06:24:01.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.211+0000 7f18b1000640 1 -- 172.21.15.32:0/787672187 shutdown_connections 2024-03-19T06:24:01.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.211+0000 7f18b1000640 1 --2- 172.21.15.32:0/787672187 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f1888067690 0x7f1888069b50 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:01.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.211+0000 7f18b1000640 1 --2- 172.21.15.32:0/787672187 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f18ac150ad0 0x7f18ac0c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:01.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.211+0000 7f18b1000640 1 --2- 172.21.15.32:0/787672187 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18ac0b2f80 0x7f18ac0c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:01.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.211+0000 7f18b1000640 1 --2- 172.21.15.32:0/787672187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac071550 0x7f18ac0cd020 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:01.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.211+0000 7f18b1000640 1 -- 172.21.15.32:0/787672187 >> 172.21.15.32:0/787672187 conn(0x7f18ac0b1590 msgr2=0x7f18ac0b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:01.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.211+0000 7f18b1000640 1 -- 172.21.15.32:0/787672187 shutdown_connections 2024-03-19T06:24:01.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.215+0000 7f18b1000640 1 -- 172.21.15.32:0/787672187 wait complete. 2024-03-19T06:24:01.225 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-19T06:24:01.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.387+0000 7f007b400640 1 Processor -- start 2024-03-19T06:24:01.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.387+0000 7f007b400640 1 -- start start 2024-03-19T06:24:01.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f007b400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0074071eb0 0x7f007415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:01.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f007b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0074072290 0x7f00740aed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:01.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f007b400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f00740cdf30 0x7f00740ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:01.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f007b400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007415b460 con 0x7f0074071eb0 2024-03-19T06:24:01.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f007b400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00740af280 con 0x7f00740cdf30 2024-03-19T06:24:01.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f007b400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00740ccaa0 con 0x7f0074072290 2024-03-19T06:24:01.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f0078a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0074071eb0 0x7f007415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:01.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f0078a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0074071eb0 0x7f007415a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42430/0 (socket says 172.21.15.32:42430) 2024-03-19T06:24:01.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f0078a00640 1 -- 172.21.15.32:0/2043306673 learned_addr learned my addr 172.21.15.32:0/2043306673 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:01.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f006be00640 1 --2- 172.21.15.32:0/2043306673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0074072290 0x7f00740aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:01.378 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f0079400640 1 --2- 172.21.15.32:0/2043306673 >> v2:172.21.15.171:3300/0 conn(0x7f00740cdf30 0x7f00740ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:01.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f0078a00640 1 -- 172.21.15.32:0/2043306673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0074072290 msgr2=0x7f00740aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:01.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f0078a00640 1 --2- 172.21.15.32:0/2043306673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0074072290 0x7f00740aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:01.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f0078a00640 1 -- 172.21.15.32:0/2043306673 >> v2:172.21.15.171:3300/0 conn(0x7f00740cdf30 msgr2=0x7f00740ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:01.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f0078a00640 1 --2- 172.21.15.32:0/2043306673 >> v2:172.21.15.171:3300/0 conn(0x7f00740cdf30 0x7f00740ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:01.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f0078a00640 1 -- 172.21.15.32:0/2043306673 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007415abc0 con 0x7f0074071eb0 2024-03-19T06:24:01.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f0079400640 1 --2- 172.21.15.32:0/2043306673 >> v2:172.21.15.171:3300/0 conn(0x7f00740cdf30 0x7f00740ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:24:01.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f006be00640 1 --2- 172.21.15.32:0/2043306673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0074072290 0x7f00740aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:24:01.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f0078a00640 1 --2- 172.21.15.32:0/2043306673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0074071eb0 0x7f007415a4b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0064009870 tx=0x7f006401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a79373c4e4f60cd server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.391+0000 7f0073e00640 1 -- 172.21.15.32:0/2043306673 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00640b0070 con 0x7f0074071eb0 2024-03-19T06:24:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f0073e00640 1 -- 172.21.15.32:0/2043306673 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00640ab600 con 0x7f0074071eb0 2024-03-19T06:24:01.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f0073e00640 1 -- 172.21.15.32:0/2043306673 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00640ab9d0 con 0x7f0074071eb0 2024-03-19T06:24:01.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 -- 172.21.15.32:0/2043306673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0074071eb0 msgr2=0x7f007415a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:01.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 --2- 172.21.15.32:0/2043306673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0074071eb0 0x7f007415a4b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0064009870 tx=0x7f006401c520 comp rx=0 tx=0).stop 2024-03-19T06:24:01.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 -- 172.21.15.32:0/2043306673 shutdown_connections 2024-03-19T06:24:01.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 --2- 172.21.15.32:0/2043306673 >> v2:172.21.15.171:3300/0 conn(0x7f00740cdf30 0x7f00740ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:01.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 --2- 172.21.15.32:0/2043306673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0074072290 0x7f00740aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:01.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 --2- 172.21.15.32:0/2043306673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0074071eb0 0x7f007415a4b0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:01.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 -- 172.21.15.32:0/2043306673 >> 172.21.15.32:0/2043306673 conn(0x7f00740671f0 msgr2=0x7f007406ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:01.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 -- 172.21.15.32:0/2043306673 shutdown_connections 2024-03-19T06:24:01.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 -- 172.21.15.32:0/2043306673 wait complete. 2024-03-19T06:24:01.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 Processor -- start 2024-03-19T06:24:01.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 -- start start 2024-03-19T06:24:01.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0074071eb0 0x7f00740ae400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:01.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0074072290 0x7f007415c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:01.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00740cdf30 0x7f007413ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:01.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007406dc60 con 0x7f0074072290 2024-03-19T06:24:01.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007406dae0 con 0x7f00740cdf30 2024-03-19T06:24:01.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f007b400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007406dde0 con 0x7f0074071eb0 2024-03-19T06:24:01.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f006be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0074072290 0x7f007415c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:01.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f006be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0074072290 0x7f007415c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42442/0 (socket says 172.21.15.32:42442) 2024-03-19T06:24:01.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f006be00640 1 -- 172.21.15.32:0/3567714594 learned_addr learned my addr 172.21.15.32:0/3567714594 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:01.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f0079400640 1 --2- 172.21.15.32:0/3567714594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00740cdf30 0x7f007413ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:01.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.395+0000 7f0078a00640 1 --2- 172.21.15.32:0/3567714594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0074071eb0 0x7f00740ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:01.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.399+0000 7f006be00640 1 -- 172.21.15.32:0/3567714594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0074071eb0 msgr2=0x7f00740ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:01.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.399+0000 7f006be00640 1 --2- 172.21.15.32:0/3567714594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0074071eb0 0x7f00740ae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:01.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.399+0000 7f006be00640 1 -- 172.21.15.32:0/3567714594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00740cdf30 msgr2=0x7f007413ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:01.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.399+0000 7f006be00640 1 --2- 172.21.15.32:0/3567714594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00740cdf30 0x7f007413ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:01.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.399+0000 7f006be00640 1 -- 172.21.15.32:0/3567714594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007415cb70 con 0x7f0074072290 2024-03-19T06:24:01.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.399+0000 7f006be00640 1 --2- 172.21.15.32:0/3567714594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0074072290 0x7f007415c630 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c7c0 tx=0x7f005c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:01.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.399+0000 7f0071600640 1 -- 172.21.15.32:0/3567714594 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c015070 con 0x7f0074072290 2024-03-19T06:24:01.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.399+0000 7f0071600640 1 -- 172.21.15.32:0/3567714594 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c007a30 con 0x7f0074072290 2024-03-19T06:24:01.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.399+0000 7f007b400640 1 -- 172.21.15.32:0/3567714594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007415ce10 con 0x7f0074072290 2024-03-19T06:24:01.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.399+0000 7f0071600640 1 -- 172.21.15.32:0/3567714594 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c007e00 con 0x7f0074072290 2024-03-19T06:24:01.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.399+0000 7f007b400640 1 -- 172.21.15.32:0/3567714594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007415d3d0 con 0x7f0074072290 2024-03-19T06:24:01.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.399+0000 7f007b400640 1 -- 172.21.15.32:0/3567714594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00740749e0 con 0x7f0074072290 2024-03-19T06:24:01.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.399+0000 7f0071600640 1 -- 172.21.15.32:0/3567714594 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f005c018070 con 0x7f0074072290 2024-03-19T06:24:01.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.399+0000 7f0071600640 1 --2- 172.21.15.32:0/3567714594 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0050067660 0x7f0050069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:01.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.399+0000 7f0071600640 1 -- 172.21.15.32:0/3567714594 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f005c085800 con 0x7f0074072290 2024-03-19T06:24:01.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.399+0000 7f0078a00640 1 --2- 172.21.15.32:0/3567714594 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0050067660 0x7f0050069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:01.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.403+0000 7f0078a00640 1 --2- 172.21.15.32:0/3567714594 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0050067660 0x7f0050069b20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f00640ad000 tx=0x7f0064008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:01.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.403+0000 7f0071600640 1 -- 172.21.15.32:0/3567714594 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f005c055d00 con 0x7f0074072290 2024-03-19T06:24:01.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:01.571+0000 7f007b400640 1 -- 172.21.15.32:0/3567714594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f00740b4c50 con 0x7f0074072290 2024-03-19T06:24:02.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.211+0000 7f0071600640 1 -- 172.21.15.32:0/3567714594 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 181+0+0 (secure 0 0 0) 0x7f005c059da0 con 0x7f0074072290 2024-03-19T06:24:02.200 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' removed 2024-03-19T06:24:02.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.215+0000 7f007b400640 1 -- 172.21.15.32:0/3567714594 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0050067660 msgr2=0x7f0050069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:02.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.215+0000 7f007b400640 1 --2- 172.21.15.32:0/3567714594 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0050067660 0x7f0050069b20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f00640ad000 tx=0x7f0064008040 comp rx=0 tx=0).stop 2024-03-19T06:24:02.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.215+0000 7f007b400640 1 -- 172.21.15.32:0/3567714594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0074072290 msgr2=0x7f007415c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:02.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.215+0000 7f007b400640 1 --2- 172.21.15.32:0/3567714594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0074072290 0x7f007415c630 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c7c0 tx=0x7f005c00cc80 comp rx=0 tx=0).stop 2024-03-19T06:24:02.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.215+0000 7f007b400640 1 -- 172.21.15.32:0/3567714594 shutdown_connections 2024-03-19T06:24:02.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.215+0000 7f007b400640 1 --2- 172.21.15.32:0/3567714594 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0050067660 0x7f0050069b20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:02.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.215+0000 7f007b400640 1 --2- 172.21.15.32:0/3567714594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00740cdf30 0x7f007413ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:02.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.215+0000 7f007b400640 1 --2- 172.21.15.32:0/3567714594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0074072290 0x7f007415c630 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:02.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.215+0000 7f007b400640 1 --2- 172.21.15.32:0/3567714594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0074071eb0 0x7f00740ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:02.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.215+0000 7f007b400640 1 -- 172.21.15.32:0/3567714594 >> 172.21.15.32:0/3567714594 conn(0x7f00740671f0 msgr2=0x7f00741536e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:02.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.215+0000 7f007b400640 1 -- 172.21.15.32:0/3567714594 shutdown_connections 2024-03-19T06:24:02.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.215+0000 7f007b400640 1 -- 172.21.15.32:0/3567714594 wait complete. 2024-03-19T06:24:02.228 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-19T06:24:02.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.387+0000 7fc80e200640 1 Processor -- start 2024-03-19T06:24:02.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.387+0000 7fc80e200640 1 -- start start 2024-03-19T06:24:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.391+0000 7fc80e200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8080713c0 0x7fc8080717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.391+0000 7fc80e200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc80815ea90 0x7fc80806d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.391+0000 7fc80e200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc808071ce0 con 0x7fc8080aefd0 2024-03-19T06:24:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.391+0000 7fc80e200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8080aeb40 con 0x7fc80815ea90 2024-03-19T06:24:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.391+0000 7fc80e200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080ae210 con 0x7fc8080713c0 2024-03-19T06:24:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.391+0000 7fc807e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc80815ea90 0x7fc80806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.391+0000 7fc7fea00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc8080aefd0 0x7fc80815e380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43746/0 (socket says 172.21.15.32:43746) 2024-03-19T06:24:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.391+0000 7fc7fea00640 1 -- 172.21.15.32:0/3495497376 learned_addr learned my addr 172.21.15.32:0/3495497376 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:24:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.391+0000 7fc807e00640 1 -- 172.21.15.32:0/3495497376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8080713c0 msgr2=0x7fc8080717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.391+0000 7fc807e00640 1 --2- 172.21.15.32:0/3495497376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8080713c0 0x7fc8080717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.391+0000 7fc807e00640 1 -- 172.21.15.32:0/3495497376 >> v1:172.21.15.32:6789/0 conn(0x7fc8080aefd0 legacy=0x7fc80815e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.391+0000 7fc807e00640 1 -- 172.21.15.32:0/3495497376 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8080ae4f0 con 0x7fc80815ea90 2024-03-19T06:24:02.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.391+0000 7fc806a00640 1 -- 172.21.15.32:0/3495497376 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187183625 0 0) 0x7fc808071ce0 con 0x7fc8080aefd0 2024-03-19T06:24:02.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.395+0000 7fc807e00640 1 --2- 172.21.15.32:0/3495497376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc80815ea90 0x7fc80806d420 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc800009d90 tx=0x7fc80001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3070668504f4666e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:02.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.395+0000 7fc806a00640 1 -- 172.21.15.32:0/3495497376 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8000b2070 con 0x7fc80815ea90 2024-03-19T06:24:02.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.395+0000 7fc806a00640 1 -- 172.21.15.32:0/3495497376 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8000a5940 con 0x7fc80815ea90 2024-03-19T06:24:02.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.395+0000 7fc806a00640 1 -- 172.21.15.32:0/3495497376 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8000a5d10 con 0x7fc80815ea90 2024-03-19T06:24:02.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.395+0000 7fc80e200640 1 -- 172.21.15.32:0/3495497376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc80815ea90 msgr2=0x7fc80806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:02.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.395+0000 7fc80e200640 1 --2- 172.21.15.32:0/3495497376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc80815ea90 0x7fc80806d420 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc800009d90 tx=0x7fc80001c970 comp rx=0 tx=0).stop 2024-03-19T06:24:02.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.395+0000 7fc80e200640 1 -- 172.21.15.32:0/3495497376 shutdown_connections 2024-03-19T06:24:02.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.395+0000 7fc80e200640 1 --2- 172.21.15.32:0/3495497376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc80815ea90 0x7fc80806d420 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:02.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.395+0000 7fc80e200640 1 --2- 172.21.15.32:0/3495497376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8080713c0 0x7fc8080717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:02.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.395+0000 7fc80e200640 1 -- 172.21.15.32:0/3495497376 >> 172.21.15.32:0/3495497376 conn(0x7fc8080671f0 msgr2=0x7fc80806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:02.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.395+0000 7fc80e200640 1 -- 172.21.15.32:0/3495497376 shutdown_connections 2024-03-19T06:24:02.383 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.395+0000 7fc80e200640 1 -- 172.21.15.32:0/3495497376 wait complete. 2024-03-19T06:24:02.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.395+0000 7fc80e200640 1 Processor -- start 2024-03-19T06:24:02.384 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.395+0000 7fc80e200640 1 -- start start 2024-03-19T06:24:02.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc80e200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8080713c0 0x7fc80815d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:02.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc80e200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8080aefd0 0x7fc808142b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:02.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc80e200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc80815ea90 0x7fc808161d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:02.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc80e200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80816a680 con 0x7fc80815ea90 2024-03-19T06:24:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc80e200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc808147660 con 0x7fc8080713c0 2024-03-19T06:24:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc80e200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80816a800 con 0x7fc8080aefd0 2024-03-19T06:24:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc807e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc80815ea90 0x7fc808161d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc807e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc80815ea90 0x7fc808161d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42470/0 (socket says 172.21.15.32:42470) 2024-03-19T06:24:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc807e00640 1 -- 172.21.15.32:0/1482393732 learned_addr learned my addr 172.21.15.32:0/1482393732 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc7fea00640 1 --2- 172.21.15.32:0/1482393732 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8080aefd0 0x7fc808142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc807400640 1 --2- 172.21.15.32:0/1482393732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8080713c0 0x7fc80815d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc807e00640 1 -- 172.21.15.32:0/1482393732 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8080aefd0 msgr2=0x7fc808142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc807e00640 1 --2- 172.21.15.32:0/1482393732 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8080aefd0 0x7fc808142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc807e00640 1 -- 172.21.15.32:0/1482393732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8080713c0 msgr2=0x7fc80815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:02.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc807e00640 1 --2- 172.21.15.32:0/1482393732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8080713c0 0x7fc80815d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:02.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc807e00640 1 -- 172.21.15.32:0/1482393732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc808143570 con 0x7fc80815ea90 2024-03-19T06:24:02.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc807e00640 1 --2- 172.21.15.32:0/1482393732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc80815ea90 0x7fc808161d60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc800009d90 tx=0x7fc800019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:02.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc7ffe00640 1 -- 172.21.15.32:0/1482393732 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8000b2040 con 0x7fc80815ea90 2024-03-19T06:24:02.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc7ffe00640 1 -- 172.21.15.32:0/1482393732 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8000bf070 con 0x7fc80815ea90 2024-03-19T06:24:02.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc7ffe00640 1 -- 172.21.15.32:0/1482393732 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8000ad980 con 0x7fc80815ea90 2024-03-19T06:24:02.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc80e200640 1 -- 172.21.15.32:0/1482393732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc808143850 con 0x7fc80815ea90 2024-03-19T06:24:02.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc80e200640 1 -- 172.21.15.32:0/1482393732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80815d910 con 0x7fc80815ea90 2024-03-19T06:24:02.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc80e200640 1 -- 172.21.15.32:0/1482393732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8080749e0 con 0x7fc80815ea90 2024-03-19T06:24:02.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.399+0000 7fc7ffe00640 1 -- 172.21.15.32:0/1482393732 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc8000adb20 con 0x7fc80815ea90 2024-03-19T06:24:02.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.403+0000 7fc7ffe00640 1 --2- 172.21.15.32:0/1482393732 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc7e4067690 0x7fc7e4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:02.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.403+0000 7fc7ffe00640 1 -- 172.21.15.32:0/1482393732 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5415+0+0 (secure 0 0 0) 0x7fc800120390 con 0x7fc80815ea90 2024-03-19T06:24:02.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.403+0000 7fc807400640 1 --2- 172.21.15.32:0/1482393732 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc7e4067690 0x7fc7e4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:02.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.403+0000 7fc807400640 1 --2- 172.21.15.32:0/1482393732 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc7e4067690 0x7fc7e4069b50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8006fd0 tx=0x7fc7f8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:02.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.407+0000 7fc7ffe00640 1 -- 172.21.15.32:0/1482393732 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fc8000c8020 con 0x7fc80815ea90 2024-03-19T06:24:02.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:02.579+0000 7fc80e200640 1 -- 172.21.15.32:0/1482393732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc8080affb0 con 0x7fc80815ea90 2024-03-19T06:24:03.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.219+0000 7fc7ffe00640 1 -- 172.21.15.32:0/1482393732 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc800016560 con 0x7fc80815ea90 2024-03-19T06:24:03.208 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' removed 2024-03-19T06:24:03.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.223+0000 7fc80e200640 1 -- 172.21.15.32:0/1482393732 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc7e4067690 msgr2=0x7fc7e4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:03.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.223+0000 7fc80e200640 1 --2- 172.21.15.32:0/1482393732 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc7e4067690 0x7fc7e4069b50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8006fd0 tx=0x7fc7f8008040 comp rx=0 tx=0).stop 2024-03-19T06:24:03.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.223+0000 7fc80e200640 1 -- 172.21.15.32:0/1482393732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc80815ea90 msgr2=0x7fc808161d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:03.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.223+0000 7fc80e200640 1 --2- 172.21.15.32:0/1482393732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc80815ea90 0x7fc808161d60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc800009d90 tx=0x7fc800019710 comp rx=0 tx=0).stop 2024-03-19T06:24:03.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.223+0000 7fc80e200640 1 -- 172.21.15.32:0/1482393732 shutdown_connections 2024-03-19T06:24:03.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.223+0000 7fc80e200640 1 --2- 172.21.15.32:0/1482393732 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fc7e4067690 0x7fc7e4069b50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.223+0000 7fc80e200640 1 --2- 172.21.15.32:0/1482393732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc80815ea90 0x7fc808161d60 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.223+0000 7fc80e200640 1 --2- 172.21.15.32:0/1482393732 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8080aefd0 0x7fc808142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.223+0000 7fc80e200640 1 --2- 172.21.15.32:0/1482393732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8080713c0 0x7fc80815d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.223+0000 7fc80e200640 1 -- 172.21.15.32:0/1482393732 >> 172.21.15.32:0/1482393732 conn(0x7fc8080671f0 msgr2=0x7fc8080b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:03.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.223+0000 7fc80e200640 1 -- 172.21.15.32:0/1482393732 shutdown_connections 2024-03-19T06:24:03.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.223+0000 7fc80e200640 1 -- 172.21.15.32:0/1482393732 wait complete. 2024-03-19T06:24:03.238 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-19T06:24:03.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.395+0000 7f5879400640 1 Processor -- start 2024-03-19T06:24:03.385 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5879400640 1 -- start start 2024-03-19T06:24:03.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5879400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58740d1620 0x7f58740d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:03.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5879400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f58740c51e0 0x7f58740cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:03.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5879400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58740ccdb0 con 0x7f58740cc920 2024-03-19T06:24:03.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5879400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58740d1f40 con 0x7f58740c51e0 2024-03-19T06:24:03.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5879400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58740cd050 con 0x7f58740d1620 2024-03-19T06:24:03.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5878a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f58740cc920 0x7f587415f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43756/0 (socket says 172.21.15.32:43756) 2024-03-19T06:24:03.387 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5878a00640 1 -- 172.21.15.32:0/911322368 learned_addr learned my addr 172.21.15.32:0/911322368 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:24:03.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f586b400640 1 --2- 172.21.15.32:0/911322368 >> v2:172.21.15.171:3300/0 conn(0x7f58740c51e0 0x7f58740cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:03.388 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873e00640 1 --2- 172.21.15.32:0/911322368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58740d1620 0x7f58740d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:03.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873400640 1 -- 172.21.15.32:0/911322368 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163262082 0 0) 0x7f58740ccdb0 con 0x7f58740cc920 2024-03-19T06:24:03.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873400640 1 -- 172.21.15.32:0/911322368 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5858003530 con 0x7f58740cc920 2024-03-19T06:24:03.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873400640 1 -- 172.21.15.32:0/911322368 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 775029069 0 0) 0x7f5858003530 con 0x7f58740cc920 2024-03-19T06:24:03.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873400640 1 -- 172.21.15.32:0/911322368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58740d1620 msgr2=0x7f58740d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:03.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873400640 1 --2- 172.21.15.32:0/911322368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58740d1620 0x7f58740d1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873400640 1 -- 172.21.15.32:0/911322368 >> v2:172.21.15.171:3300/0 conn(0x7f58740c51e0 msgr2=0x7f58740cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:03.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873400640 1 --2- 172.21.15.32:0/911322368 >> v2:172.21.15.171:3300/0 conn(0x7f58740c51e0 0x7f58740cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873400640 1 -- 172.21.15.32:0/911322368 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58740cd330 con 0x7f58740cc920 2024-03-19T06:24:03.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873400640 1 -- 172.21.15.32:0/911322368 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f586c001680 con 0x7f58740cc920 2024-03-19T06:24:03.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873400640 1 -- 172.21.15.32:0/911322368 >> v1:172.21.15.32:6789/0 conn(0x7f58740cc920 legacy=0x7f587415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:03.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873400640 1 --2- 172.21.15.32:0/911322368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58580039c0 0x7f5858003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:03.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873400640 1 --2- 172.21.15.32:0/911322368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58740d1620 0x7f5858004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:03.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873400640 1 --2- 172.21.15.32:0/911322368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5858004d50 0x7f58580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:03.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873400640 1 -- 172.21.15.32:0/911322368 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58740d1f40 con 0x7f5858004d50 2024-03-19T06:24:03.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873400640 1 -- 172.21.15.32:0/911322368 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58740cd050 con 0x7f58580039c0 2024-03-19T06:24:03.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873400640 1 -- 172.21.15.32:0/911322368 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585800b9d0 con 0x7f58740d1620 2024-03-19T06:24:03.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5878a00640 1 --2- 172.21.15.32:0/911322368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5858004d50 0x7f58580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:03.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f586b400640 1 --2- 172.21.15.32:0/911322368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58740d1620 0x7f5858004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:03.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5873e00640 1 --2- 172.21.15.32:0/911322368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58580039c0 0x7f5858003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:03.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5878a00640 1 -- 172.21.15.32:0/911322368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58740d1620 msgr2=0x7f5858004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:03.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5878a00640 1 --2- 172.21.15.32:0/911322368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58740d1620 0x7f5858004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5878a00640 1 -- 172.21.15.32:0/911322368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58580039c0 msgr2=0x7f5858003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:03.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5878a00640 1 --2- 172.21.15.32:0/911322368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58580039c0 0x7f5858003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.399+0000 7f5878a00640 1 -- 172.21.15.32:0/911322368 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5858003530 con 0x7f5858004d50 2024-03-19T06:24:03.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.403+0000 7f5878a00640 1 --2- 172.21.15.32:0/911322368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5858004d50 0x7f58580051d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c240 tx=0x7f586c01f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f780d70b794cdbd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:03.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.403+0000 7f5873400640 1 -- 172.21.15.32:0/911322368 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c007d60 con 0x7f5858004d50 2024-03-19T06:24:03.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.403+0000 7f5873400640 1 -- 172.21.15.32:0/911322368 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c005b00 con 0x7f5858004d50 2024-03-19T06:24:03.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.403+0000 7f5873400640 1 -- 172.21.15.32:0/911322368 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c007070 con 0x7f5858004d50 2024-03-19T06:24:03.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.403+0000 7f5879400640 1 -- 172.21.15.32:0/911322368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5858004d50 msgr2=0x7f58580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:03.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.403+0000 7f5879400640 1 --2- 172.21.15.32:0/911322368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5858004d50 0x7f58580051d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c240 tx=0x7f586c01f430 comp rx=0 tx=0).stop 2024-03-19T06:24:03.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.403+0000 7f5878a00640 1 -- 172.21.15.32:0/911322368 reap_dead start 2024-03-19T06:24:03.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.403+0000 7f5879400640 1 -- 172.21.15.32:0/911322368 shutdown_connections 2024-03-19T06:24:03.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.403+0000 7f5879400640 1 -- 172.21.15.32:0/911322368 >> 172.21.15.32:0/911322368 conn(0x7f587408b000 msgr2=0x7f587408b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:03.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.403+0000 7f5879400640 1 -- 172.21.15.32:0/911322368 shutdown_connections 2024-03-19T06:24:03.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.403+0000 7f5879400640 1 -- 172.21.15.32:0/911322368 wait complete. 2024-03-19T06:24:03.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f5879400640 1 Processor -- start 2024-03-19T06:24:03.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f5879400640 1 -- start start 2024-03-19T06:24:03.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f5879400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5858004d50 0x7f58740c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:03.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f5879400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5874155fa0 0x7f58741587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:03.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f5879400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5874158cf0 0x7f58741f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:03.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f5879400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58740cdbd0 con 0x7f5874155fa0 2024-03-19T06:24:03.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f5879400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58740cd8f0 con 0x7f5874158cf0 2024-03-19T06:24:03.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f5879400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58740cf850 con 0x7f5858004d50 2024-03-19T06:24:03.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f586b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5874155fa0 0x7f58741587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:03.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f586b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5874155fa0 0x7f58741587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42498/0 (socket says 172.21.15.32:42498) 2024-03-19T06:24:03.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f586b400640 1 -- 172.21.15.32:0/3991117716 learned_addr learned my addr 172.21.15.32:0/3991117716 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:03.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f5878a00640 1 --2- 172.21.15.32:0/3991117716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5874158cf0 0x7f58741f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:03.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f5873e00640 1 --2- 172.21.15.32:0/3991117716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5858004d50 0x7f58740c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:03.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f586b400640 1 -- 172.21.15.32:0/3991117716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5858004d50 msgr2=0x7f58740c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:03.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f586b400640 1 --2- 172.21.15.32:0/3991117716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5858004d50 0x7f58740c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f586b400640 1 -- 172.21.15.32:0/3991117716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5874158cf0 msgr2=0x7f58741f6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:03.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f586b400640 1 --2- 172.21.15.32:0/3991117716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5874158cf0 0x7f58741f6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f586b400640 1 -- 172.21.15.32:0/3991117716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5874157710 con 0x7f5874155fa0 2024-03-19T06:24:03.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f586b400640 1 --2- 172.21.15.32:0/3991117716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5874155fa0 0x7f58741587b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f585c0119b0 tx=0x7f585c011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:03.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f5870c00640 1 -- 172.21.15.32:0/3991117716 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c00fa70 con 0x7f5874155fa0 2024-03-19T06:24:03.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f5870c00640 1 -- 172.21.15.32:0/3991117716 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c00fc10 con 0x7f5874155fa0 2024-03-19T06:24:03.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f5870c00640 1 -- 172.21.15.32:0/3991117716 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c014440 con 0x7f5874155fa0 2024-03-19T06:24:03.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f5879400640 1 -- 172.21.15.32:0/3991117716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58741579f0 con 0x7f5874155fa0 2024-03-19T06:24:03.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.407+0000 7f5879400640 1 -- 172.21.15.32:0/3991117716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5874157fb0 con 0x7f5874155fa0 2024-03-19T06:24:03.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.411+0000 7f5879400640 1 -- 172.21.15.32:0/3991117716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5874075090 con 0x7f5874155fa0 2024-03-19T06:24:03.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.411+0000 7f5870c00640 1 -- 172.21.15.32:0/3991117716 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f585c012040 con 0x7f5874155fa0 2024-03-19T06:24:03.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.411+0000 7f5870c00640 1 --2- 172.21.15.32:0/3991117716 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5850067660 0x7f5850069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:03.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.411+0000 7f5870c00640 1 -- 172.21.15.32:0/3991117716 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f585c085ba0 con 0x7f5874155fa0 2024-03-19T06:24:03.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.411+0000 7f5873e00640 1 --2- 172.21.15.32:0/3991117716 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5850067660 0x7f5850069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:03.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.411+0000 7f5873e00640 1 --2- 172.21.15.32:0/3991117716 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5850067660 0x7f5850069b20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5864007520 tx=0x7f586400b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:03.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.415+0000 7f5870c00640 1 -- 172.21.15.32:0/3991117716 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f585c019030 con 0x7f5874155fa0 2024-03-19T06:24:03.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.583+0000 7f5879400640 1 -- 172.21.15.32:0/3991117716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f587408bc80 con 0x7f5874155fa0 2024-03-19T06:24:03.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.587+0000 7f5870c00640 1 -- 172.21.15.32:0/3991117716 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f585c056b10 con 0x7f5874155fa0 2024-03-19T06:24:03.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.587+0000 7f5879400640 1 -- 172.21.15.32:0/3991117716 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5850067660 msgr2=0x7f5850069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:03.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.587+0000 7f5879400640 1 --2- 172.21.15.32:0/3991117716 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5850067660 0x7f5850069b20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5864007520 tx=0x7f586400b040 comp rx=0 tx=0).stop 2024-03-19T06:24:03.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.587+0000 7f5879400640 1 -- 172.21.15.32:0/3991117716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5874155fa0 msgr2=0x7f58741587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:03.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.587+0000 7f5879400640 1 --2- 172.21.15.32:0/3991117716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5874155fa0 0x7f58741587b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f585c0119b0 tx=0x7f585c011e70 comp rx=0 tx=0).stop 2024-03-19T06:24:03.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.587+0000 7f5879400640 1 -- 172.21.15.32:0/3991117716 shutdown_connections 2024-03-19T06:24:03.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.587+0000 7f5879400640 1 --2- 172.21.15.32:0/3991117716 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f5850067660 0x7f5850069b20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.587+0000 7f5879400640 1 --2- 172.21.15.32:0/3991117716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5874158cf0 0x7f58741f6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.587+0000 7f5879400640 1 --2- 172.21.15.32:0/3991117716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5874155fa0 0x7f58741587b0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.587+0000 7f5879400640 1 --2- 172.21.15.32:0/3991117716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5858004d50 0x7f58740c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.587+0000 7f5879400640 1 -- 172.21.15.32:0/3991117716 >> 172.21.15.32:0/3991117716 conn(0x7f587408b000 msgr2=0x7f58740cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:03.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.587+0000 7f5879400640 1 -- 172.21.15.32:0/3991117716 shutdown_connections 2024-03-19T06:24:03.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.587+0000 7f5879400640 1 -- 172.21.15.32:0/3991117716 wait complete. 2024-03-19T06:24:03.596 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2024-03-19T06:24:03.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f3187000640 1 Processor -- start 2024-03-19T06:24:03.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f3187000640 1 -- start start 2024-03-19T06:24:03.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f3187000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f31800aecf0 0x7f31800ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:03.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f3187000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f318015c010 0x7f318015f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:03.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f3187000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318015fe20 con 0x7f318006d6c0 2024-03-19T06:24:03.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f3187000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31801603e0 con 0x7f31800aecf0 2024-03-19T06:24:03.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f3187000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3180160100 con 0x7f318015c010 2024-03-19T06:24:03.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f317fe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f31800aecf0 0x7f31800ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:03.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f317fe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f31800aecf0 0x7f31800ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49806/0 (socket says 172.21.15.32:49806) 2024-03-19T06:24:03.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f3185000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f318006d6c0 0x7f31800cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:34726/0 (socket says 172.21.15.32:34726) 2024-03-19T06:24:03.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f317fe00640 1 -- 172.21.15.32:0/3552932096 learned_addr learned my addr 172.21.15.32:0/3552932096 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:03.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f3177e00640 1 --2- 172.21.15.32:0/3552932096 >> v2:172.21.15.171:3300/0 conn(0x7f318015c010 0x7f318015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:03.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f317fe00640 1 -- 172.21.15.32:0/3552932096 >> v2:172.21.15.171:3300/0 conn(0x7f318015c010 msgr2=0x7f318015f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:03.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f317fe00640 1 --2- 172.21.15.32:0/3552932096 >> v2:172.21.15.171:3300/0 conn(0x7f318015c010 0x7f318015f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f317fe00640 1 -- 172.21.15.32:0/3552932096 >> v1:172.21.15.32:6789/0 conn(0x7f318006d6c0 legacy=0x7f31800cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:03.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f317fe00640 1 -- 172.21.15.32:0/3552932096 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31800ca1f0 con 0x7f31800aecf0 2024-03-19T06:24:03.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.751+0000 7f317f400640 1 -- 172.21.15.32:0/3552932096 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732308295 0 0) 0x7f318015fe20 con 0x7f318006d6c0 2024-03-19T06:24:03.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.755+0000 7f317fe00640 1 --2- 172.21.15.32:0/3552932096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31800aecf0 0x7f31800ca9f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3180068930 tx=0x7f317001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfe4d3c3909adf3 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:03.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.755+0000 7f317f400640 1 -- 172.21.15.32:0/3552932096 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31700b1070 con 0x7f31800aecf0 2024-03-19T06:24:03.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.755+0000 7f317f400640 1 -- 172.21.15.32:0/3552932096 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31700ac600 con 0x7f31800aecf0 2024-03-19T06:24:03.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.755+0000 7f317f400640 1 -- 172.21.15.32:0/3552932096 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31700ac9d0 con 0x7f31800aecf0 2024-03-19T06:24:03.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.755+0000 7f3187000640 1 -- 172.21.15.32:0/3552932096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31800aecf0 msgr2=0x7f31800ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:03.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.755+0000 7f3187000640 1 --2- 172.21.15.32:0/3552932096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31800aecf0 0x7f31800ca9f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3180068930 tx=0x7f317001c490 comp rx=0 tx=0).stop 2024-03-19T06:24:03.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.755+0000 7f3187000640 1 -- 172.21.15.32:0/3552932096 shutdown_connections 2024-03-19T06:24:03.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.755+0000 7f3187000640 1 --2- 172.21.15.32:0/3552932096 >> v2:172.21.15.171:3300/0 conn(0x7f318015c010 0x7f318015f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.755+0000 7f3187000640 1 --2- 172.21.15.32:0/3552932096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31800aecf0 0x7f31800ca9f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.755+0000 7f3187000640 1 -- 172.21.15.32:0/3552932096 >> 172.21.15.32:0/3552932096 conn(0x7f31800b1280 msgr2=0x7f31800b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:03.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.755+0000 7f3187000640 1 -- 172.21.15.32:0/3552932096 shutdown_connections 2024-03-19T06:24:03.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.755+0000 7f3187000640 1 -- 172.21.15.32:0/3552932096 wait complete. 2024-03-19T06:24:03.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3187000640 1 Processor -- start 2024-03-19T06:24:03.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3187000640 1 -- start start 2024-03-19T06:24:03.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3187000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f318006d6c0 0x7f3180150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:03.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3187000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31800aecf0 0x7f31800cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:03.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3187000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f318015c010 0x7f31801502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:03.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3187000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318015fbe0 con 0x7f318015c010 2024-03-19T06:24:03.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3187000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318015fa60 con 0x7f31800aecf0 2024-03-19T06:24:03.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3187000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3180168ea0 con 0x7f318006d6c0 2024-03-19T06:24:03.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3185000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f318015c010 0x7f31801502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:03.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3185000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f318015c010 0x7f31801502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49810/0 (socket says 172.21.15.32:49810) 2024-03-19T06:24:03.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3185000640 1 -- 172.21.15.32:0/3867778888 learned_addr learned my addr 172.21.15.32:0/3867778888 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:03.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3177e00640 1 --2- 172.21.15.32:0/3867778888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31800aecf0 0x7f31800cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:03.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f317fe00640 1 --2- 172.21.15.32:0/3867778888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f318006d6c0 0x7f3180150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:03.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3185000640 1 -- 172.21.15.32:0/3867778888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f318006d6c0 msgr2=0x7f3180150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:03.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3185000640 1 --2- 172.21.15.32:0/3867778888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f318006d6c0 0x7f3180150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3185000640 1 -- 172.21.15.32:0/3867778888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31800aecf0 msgr2=0x7f31800cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:03.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3185000640 1 --2- 172.21.15.32:0/3867778888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31800aecf0 0x7f31800cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:03.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3185000640 1 -- 172.21.15.32:0/3867778888 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31800cedc0 con 0x7f318015c010 2024-03-19T06:24:03.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3185000640 1 --2- 172.21.15.32:0/3867778888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f318015c010 0x7f31801502f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f3178001570 tx=0x7f317800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:03.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f317cc00640 1 -- 172.21.15.32:0/3867778888 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3178018070 con 0x7f318015c010 2024-03-19T06:24:03.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f317cc00640 1 -- 172.21.15.32:0/3867778888 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317800a640 con 0x7f318015c010 2024-03-19T06:24:03.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f317cc00640 1 -- 172.21.15.32:0/3867778888 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317800aa30 con 0x7f318015c010 2024-03-19T06:24:03.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3187000640 1 -- 172.21.15.32:0/3867778888 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31800cf0a0 con 0x7f318015c010 2024-03-19T06:24:03.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3187000640 1 -- 172.21.15.32:0/3867778888 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318015b630 con 0x7f318015c010 2024-03-19T06:24:03.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.759+0000 7f3187000640 1 -- 172.21.15.32:0/3867778888 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31800749e0 con 0x7f318015c010 2024-03-19T06:24:03.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.763+0000 7f317cc00640 1 -- 172.21.15.32:0/3867778888 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f317801b070 con 0x7f318015c010 2024-03-19T06:24:03.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.763+0000 7f317cc00640 1 --2- 172.21.15.32:0/3867778888 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f315c067660 0x7f315c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:03.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.763+0000 7f317cc00640 1 -- 172.21.15.32:0/3867778888 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3178084be0 con 0x7f318015c010 2024-03-19T06:24:03.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.763+0000 7f317fe00640 1 --2- 172.21.15.32:0/3867778888 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f315c067660 0x7f315c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:03.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.763+0000 7f317fe00640 1 --2- 172.21.15.32:0/3867778888 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f315c067660 0x7f315c069b20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f31700ae000 tx=0x7f31700a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:03.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.767+0000 7f317cc00640 1 -- 172.21.15.32:0/3867778888 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f3178055470 con 0x7f318015c010 2024-03-19T06:24:03.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:03.987+0000 7f3187000640 1 -- 172.21.15.32:0/3867778888 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7f31800b4d50 con 0x7f318015c010 2024-03-19T06:24:04.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:04.223+0000 7f317cc00640 1 -- 172.21.15.32:0/3867778888 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v177) v1 ==== 134+0+0 (secure 0 0 0) 0x7f3178059510 con 0x7f318015c010 2024-03-19T06:24:04.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:04.223+0000 7f3187000640 1 -- 172.21.15.32:0/3867778888 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f315c067660 msgr2=0x7f315c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:04.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:04.223+0000 7f3187000640 1 --2- 172.21.15.32:0/3867778888 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f315c067660 0x7f315c069b20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f31700ae000 tx=0x7f31700a7000 comp rx=0 tx=0).stop 2024-03-19T06:24:04.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:04.223+0000 7f3187000640 1 -- 172.21.15.32:0/3867778888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f318015c010 msgr2=0x7f31801502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:04.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:04.223+0000 7f3187000640 1 --2- 172.21.15.32:0/3867778888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f318015c010 0x7f31801502f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f3178001570 tx=0x7f317800cca0 comp rx=0 tx=0).stop 2024-03-19T06:24:04.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:04.223+0000 7f3187000640 1 -- 172.21.15.32:0/3867778888 shutdown_connections 2024-03-19T06:24:04.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:04.223+0000 7f3187000640 1 --2- 172.21.15.32:0/3867778888 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f315c067660 0x7f315c069b20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:04.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:04.223+0000 7f3187000640 1 --2- 172.21.15.32:0/3867778888 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f318015c010 0x7f31801502f0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:04.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:04.223+0000 7f3187000640 1 --2- 172.21.15.32:0/3867778888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31800aecf0 0x7f31800cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:04.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:04.223+0000 7f3187000640 1 --2- 172.21.15.32:0/3867778888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f318006d6c0 0x7f3180150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:04.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:04.223+0000 7f3187000640 1 -- 172.21.15.32:0/3867778888 >> 172.21.15.32:0/3867778888 conn(0x7f31800b1280 msgr2=0x7f31800c9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:04.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:04.223+0000 7f3187000640 1 -- 172.21.15.32:0/3867778888 shutdown_connections 2024-03-19T06:24:04.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:04.223+0000 7f3187000640 1 -- 172.21.15.32:0/3867778888 wait complete. 2024-03-19T06:24:04.234 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ERROR 2024-03-19T06:24:04.234 INFO:tasks.cephfs_test_runner: 2024-03-19T06:24:04.234 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-19T06:24:04.235 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-03-19T06:24:04.235 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-19T06:24:04.235 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-19T06:24:04.235 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2024-03-19T06:24:04.235 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2024-03-19T06:24:04.235 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/cephfs/mount.py", line 775, in run_python 2024-03-19T06:24:04.235 INFO:tasks.cephfs_test_runner: p.wait() 2024-03-19T06:24:04.235 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait 2024-03-19T06:24:04.235 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-03-19T06:24:04.235 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-03-19T06:24:04.235 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-03-19T06:24:04.235 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi032 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2024-03-19T06:24:04.235 INFO:tasks.cephfs_test_runner: 2024-03-19T06:24:04.235 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-19T06:24:04.235 INFO:tasks.cephfs_test_runner:Ran 2 tests in 144.463s 2024-03-19T06:24:04.236 INFO:tasks.cephfs_test_runner: 2024-03-19T06:24:04.236 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-03-19T06:24:04.236 INFO:tasks.cephfs_test_runner: 2024-03-19T06:24:04.236 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-19T06:24:04.236 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-03-19T06:24:04.236 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-19T06:24:04.236 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-19T06:24:04.236 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2024-03-19T06:24:04.236 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2024-03-19T06:24:04.236 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/cephfs/mount.py", line 775, in run_python 2024-03-19T06:24:04.236 INFO:tasks.cephfs_test_runner: p.wait() 2024-03-19T06:24:04.236 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait 2024-03-19T06:24:04.237 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-03-19T06:24:04.237 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-03-19T06:24:04.237 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-03-19T06:24:04.237 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi032 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2024-03-19T06:24:04.237 INFO:tasks.cephfs_test_runner: 2024-03-19T06:24:04.237 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-03-19T06:24:04.468 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=6cc7f0d676414c6188f69461b86b1ce9 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-03-19T06:24:04.469 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-19T06:24:05.135 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-03-19T06:24:05.507 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-03-19T06:24:05.508 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:24:05.508 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:24:05.512 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:24:05.523 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357716k,nr_inodes=4089429,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4371 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-19T06:24:05.523 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-03-19T06:24:05.523 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:24:05.524 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:24:05.573 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357716k,nr_inodes=4089429,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4371 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-19T06:24:05.573 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:24:05.574 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:24:05.583 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-19T06:24:05.583 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-03-19T06:24:05.583 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:24:05.641 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-19T06:24:05.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:24:05.642 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-03-19T06:24:05.691 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-19T06:24:05.691 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-19T06:24:05.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:24:05.691 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:24:05.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:24:05.755 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-19T06:24:05.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:24:05.844 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link delete ceph-brx 2024-03-19T06:24:06.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:24:06.009 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-03-19T06:24:06.020 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-19T06:24:06.020 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-19T06:24:06.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:24:06.020 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:24:06.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:24:06.084 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-19T06:24:06.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:24:06.169 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2024-03-19T06:24:06.347 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-19T06:24:06.365 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-19T06:24:06.365 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:24:06.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a28a00640 1 Processor -- start 2024-03-19T06:24:06.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a28a00640 1 -- start start 2024-03-19T06:24:06.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a28a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240d00b0 0x7f0a240b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:06.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a28a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a240afe40 con 0x7f0a2406b1d0 2024-03-19T06:24:06.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a28a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a240b0120 con 0x7f0a240b1950 2024-03-19T06:24:06.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a28a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a240b0400 con 0x7f0a240d00b0 2024-03-19T06:24:06.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a22800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0a2406b1d0 0x7f0a240cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:34734/0 (socket says 172.21.15.32:34734) 2024-03-19T06:24:06.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a22800640 1 -- 172.21.15.32:0/1633472522 learned_addr learned my addr 172.21.15.32:0/1633472522 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:24:06.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a19e00640 1 --2- 172.21.15.32:0/1633472522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240d00b0 0x7f0a240b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:06.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a21e00640 1 -- 172.21.15.32:0/1633472522 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091343765 0 0) 0x7f0a240afe40 con 0x7f0a2406b1d0 2024-03-19T06:24:06.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a21e00640 1 -- 172.21.15.32:0/1633472522 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a08003530 con 0x7f0a2406b1d0 2024-03-19T06:24:06.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a21e00640 1 -- 172.21.15.32:0/1633472522 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1751509676 0 0) 0x7f0a08003530 con 0x7f0a2406b1d0 2024-03-19T06:24:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a21e00640 1 -- 172.21.15.32:0/1633472522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240d00b0 msgr2=0x7f0a240b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a21e00640 1 --2- 172.21.15.32:0/1633472522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240d00b0 0x7f0a240b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a21e00640 1 -- 172.21.15.32:0/1633472522 >> v1:172.21.15.171:6789/0 conn(0x7f0a240b1950 legacy=0x7f0a240cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a21e00640 1 -- 172.21.15.32:0/1633472522 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a240b06e0 con 0x7f0a2406b1d0 2024-03-19T06:24:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a21e00640 1 -- 172.21.15.32:0/1633472522 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f0a14001680 con 0x7f0a2406b1d0 2024-03-19T06:24:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a21e00640 1 -- 172.21.15.32:0/1633472522 >> v1:172.21.15.32:6789/0 conn(0x7f0a2406b1d0 legacy=0x7f0a240cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a21e00640 1 --2- 172.21.15.32:0/1633472522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a080039f0 0x7f0a08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a21e00640 1 --2- 172.21.15.32:0/1633472522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080043a0 0x7f0a08004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:06.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a21e00640 1 --2- 172.21.15.32:0/1633472522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240d00b0 0x7f0a080050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:06.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a21e00640 1 -- 172.21.15.32:0/1633472522 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a240b0400 con 0x7f0a080043a0 2024-03-19T06:24:06.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a21e00640 1 -- 172.21.15.32:0/1633472522 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0800b9d0 con 0x7f0a080039f0 2024-03-19T06:24:06.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.522+0000 7f0a21e00640 1 -- 172.21.15.32:0/1633472522 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0800bbd0 con 0x7f0a240d00b0 2024-03-19T06:24:06.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.526+0000 7f0a19e00640 1 --2- 172.21.15.32:0/1633472522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080043a0 0x7f0a08004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:06.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.526+0000 7f0a22800640 1 --2- 172.21.15.32:0/1633472522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a080039f0 0x7f0a08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:06.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.526+0000 7f0a23200640 1 --2- 172.21.15.32:0/1633472522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240d00b0 0x7f0a080050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.526+0000 7f0a19e00640 1 -- 172.21.15.32:0/1633472522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240d00b0 msgr2=0x7f0a080050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.526+0000 7f0a19e00640 1 --2- 172.21.15.32:0/1633472522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240d00b0 0x7f0a080050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.526+0000 7f0a19e00640 1 -- 172.21.15.32:0/1633472522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a080039f0 msgr2=0x7f0a08003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.526+0000 7f0a19e00640 1 --2- 172.21.15.32:0/1633472522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a080039f0 0x7f0a08003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.526+0000 7f0a19e00640 1 -- 172.21.15.32:0/1633472522 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a08003530 con 0x7f0a080043a0 2024-03-19T06:24:06.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.526+0000 7f0a19e00640 1 --2- 172.21.15.32:0/1633472522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080043a0 0x7f0a08004870 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009f90 tx=0x7f0a0c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6f4bfa960fe500 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:06.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.526+0000 7f0a21e00640 1 -- 172.21.15.32:0/1633472522 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c0b2070 con 0x7f0a080043a0 2024-03-19T06:24:06.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.526+0000 7f0a21e00640 1 -- 172.21.15.32:0/1633472522 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c0a5c50 con 0x7f0a080043a0 2024-03-19T06:24:06.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.526+0000 7f0a21e00640 1 -- 172.21.15.32:0/1633472522 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c009c10 con 0x7f0a080043a0 2024-03-19T06:24:06.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a28a00640 1 -- 172.21.15.32:0/1633472522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080043a0 msgr2=0x7f0a08004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:06.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a28a00640 1 --2- 172.21.15.32:0/1633472522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080043a0 0x7f0a08004870 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009f90 tx=0x7f0a0c01cc40 comp rx=0 tx=0).stop 2024-03-19T06:24:06.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a23200640 1 -- 172.21.15.32:0/1633472522 reap_dead start 2024-03-19T06:24:06.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a28a00640 1 -- 172.21.15.32:0/1633472522 shutdown_connections 2024-03-19T06:24:06.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a28a00640 1 -- 172.21.15.32:0/1633472522 >> 172.21.15.32:0/1633472522 conn(0x7f0a240b1ff0 msgr2=0x7f0a240b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:06.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a28a00640 1 -- 172.21.15.32:0/1633472522 shutdown_connections 2024-03-19T06:24:06.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a28a00640 1 -- 172.21.15.32:0/1633472522 wait complete. 2024-03-19T06:24:06.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a28a00640 1 Processor -- start 2024-03-19T06:24:06.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a28a00640 1 -- start start 2024-03-19T06:24:06.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a28a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080043a0 0x7f0a2414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:06.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a28a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240c4a00 0x7f0a241602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:06.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a28a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a24160800 0x7f0a240ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:06.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a28a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2406b730 con 0x7f0a080043a0 2024-03-19T06:24:06.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a28a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2406b5b0 con 0x7f0a24160800 2024-03-19T06:24:06.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a28a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a240b1410 con 0x7f0a240c4a00 2024-03-19T06:24:06.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a22800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080043a0 0x7f0a2414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:06.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a22800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080043a0 0x7f0a2414f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49818/0 (socket says 172.21.15.32:49818) 2024-03-19T06:24:06.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a22800640 1 -- 172.21.15.32:0/3707609658 learned_addr learned my addr 172.21.15.32:0/3707609658 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:06.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a23200640 1 --2- 172.21.15.32:0/3707609658 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a24160800 0x7f0a240ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:06.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a19e00640 1 --2- 172.21.15.32:0/3707609658 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240c4a00 0x7f0a241602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:06.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a22800640 1 -- 172.21.15.32:0/3707609658 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240c4a00 msgr2=0x7f0a241602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:06.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a22800640 1 --2- 172.21.15.32:0/3707609658 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240c4a00 0x7f0a241602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:06.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a22800640 1 -- 172.21.15.32:0/3707609658 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a24160800 msgr2=0x7f0a240ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:06.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a22800640 1 --2- 172.21.15.32:0/3707609658 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a24160800 0x7f0a240ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:06.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a22800640 1 -- 172.21.15.32:0/3707609658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a24160ca0 con 0x7f0a080043a0 2024-03-19T06:24:06.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.530+0000 7f0a22800640 1 --2- 172.21.15.32:0/3707609658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080043a0 0x7f0a2414f9b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f0a14000f70 tx=0x7f0a14007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:06.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.534+0000 7f0a1b400640 1 -- 172.21.15.32:0/3707609658 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1400f990 con 0x7f0a080043a0 2024-03-19T06:24:06.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.534+0000 7f0a1b400640 1 -- 172.21.15.32:0/3707609658 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a14018070 con 0x7f0a080043a0 2024-03-19T06:24:06.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.534+0000 7f0a1b400640 1 -- 172.21.15.32:0/3707609658 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1400fdb0 con 0x7f0a080043a0 2024-03-19T06:24:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.534+0000 7f0a28a00640 1 -- 172.21.15.32:0/3707609658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a24160f80 con 0x7f0a080043a0 2024-03-19T06:24:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.534+0000 7f0a28a00640 1 -- 172.21.15.32:0/3707609658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a240c4200 con 0x7f0a080043a0 2024-03-19T06:24:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.534+0000 7f0a28a00640 1 -- 172.21.15.32:0/3707609658 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a24075090 con 0x7f0a080043a0 2024-03-19T06:24:06.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.534+0000 7f0a1b400640 1 -- 172.21.15.32:0/3707609658 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0a1401d460 con 0x7f0a080043a0 2024-03-19T06:24:06.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.534+0000 7f0a1b400640 1 --2- 172.21.15.32:0/3707609658 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0a00067660 0x7f0a00069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:06.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.534+0000 7f0a1b400640 1 -- 172.21.15.32:0/3707609658 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0a140855f0 con 0x7f0a080043a0 2024-03-19T06:24:06.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.534+0000 7f0a19e00640 1 --2- 172.21.15.32:0/3707609658 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0a00067660 0x7f0a00069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:06.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.538+0000 7f0a19e00640 1 --2- 172.21.15.32:0/3707609658 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0a00067660 0x7f0a00069b20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009f90 tx=0x7f0a0c0a7040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:06.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.542+0000 7f0a1b400640 1 -- 172.21.15.32:0/3707609658 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f0a14055f10 con 0x7f0a080043a0 2024-03-19T06:24:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.702+0000 7f0a28a00640 1 -- 172.21.15.32:0/3707609658 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a2406f0b0 con 0x7f0a00067660 2024-03-19T06:24:06.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.702+0000 7f0a1b400640 1 -- 172.21.15.32:0/3707609658 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13450 (secure 0 0 0) 0x7f0a2406f0b0 con 0x7f0a00067660 2024-03-19T06:24:06.691 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:24:06.691 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:24:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.702+0000 7f0a28a00640 1 -- 172.21.15.32:0/3707609658 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0a00067660 msgr2=0x7f0a00069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.702+0000 7f0a28a00640 1 --2- 172.21.15.32:0/3707609658 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0a00067660 0x7f0a00069b20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009f90 tx=0x7f0a0c0a7040 comp rx=0 tx=0).stop 2024-03-19T06:24:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.702+0000 7f0a28a00640 1 -- 172.21.15.32:0/3707609658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080043a0 msgr2=0x7f0a2414f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.702+0000 7f0a28a00640 1 --2- 172.21.15.32:0/3707609658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080043a0 0x7f0a2414f9b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f0a14000f70 tx=0x7f0a14007720 comp rx=0 tx=0).stop 2024-03-19T06:24:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.702+0000 7f0a28a00640 1 -- 172.21.15.32:0/3707609658 shutdown_connections 2024-03-19T06:24:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.702+0000 7f0a28a00640 1 --2- 172.21.15.32:0/3707609658 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f0a00067660 0x7f0a00069b20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.702+0000 7f0a28a00640 1 --2- 172.21.15.32:0/3707609658 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a24160800 0x7f0a240ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.702+0000 7f0a28a00640 1 --2- 172.21.15.32:0/3707609658 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240c4a00 0x7f0a241602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:06.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.702+0000 7f0a28a00640 1 --2- 172.21.15.32:0/3707609658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080043a0 0x7f0a2414f9b0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:06.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.702+0000 7f0a28a00640 1 -- 172.21.15.32:0/3707609658 >> 172.21.15.32:0/3707609658 conn(0x7f0a240b1ff0 msgr2=0x7f0a2406f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:06.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.702+0000 7f0a28a00640 1 -- 172.21.15.32:0/3707609658 shutdown_connections 2024-03-19T06:24:06.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.702+0000 7f0a28a00640 1 -- 172.21.15.32:0/3707609658 wait complete. 2024-03-19T06:24:06.712 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-03-19T06:24:05.963703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":238996,"kb_used_data":6192,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735724,"statfs":{"total":773094113280,"available":772849381376,"internally_reserved":0,"allocated":6340608,"data_stored":3324742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14792,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-66,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001325"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":229,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-19T06:24:00.216464+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:24:00.216464+0000","last_peered":"2024-03-19T06:24:00.216464+0000","last_clean":"2024-03-19T06:24:00.216464+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:24:00.216464+0000","last_undegraded":"2024-03-19T06:24:00.216464+0000","last_fullsized":"2024-03-19T06:24:00.216464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1236992,"data_stored":856486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509480,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":630784,"data_stored":260507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":259855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":647168,"data_stored":276153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":643072,"data_stored":266154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509480,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1224704,"data_stored":850279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31836,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:24:06.713 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:24:06.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f8617800640 1 Processor -- start 2024-03-19T06:24:06.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f8617800640 1 -- start start 2024-03-19T06:24:06.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f8617800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f861009a480 0x7f86100cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:06.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f8617800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f86100cd390 0x7f86100cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:06.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f8617800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861015bf00 con 0x7f861015bb20 2024-03-19T06:24:06.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f8617800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86100cc3a0 con 0x7f86100cd390 2024-03-19T06:24:06.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f8617800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861009a8c0 con 0x7f861009a480 2024-03-19T06:24:06.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f8614e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f861015bb20 0x7f86100c53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:34744/0 (socket says 172.21.15.32:34744) 2024-03-19T06:24:06.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f8614e00640 1 -- 172.21.15.32:0/1121534094 learned_addr learned my addr 172.21.15.32:0/1121534094 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:24:06.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f8615800640 1 --2- 172.21.15.32:0/1121534094 >> v2:172.21.15.32:3300/0 conn(0x7f86100cd390 0x7f86100cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:06.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f860fe00640 1 --2- 172.21.15.32:0/1121534094 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f861009a480 0x7f86100cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:06.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f860f400640 1 -- 172.21.15.32:0/1121534094 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610039649 0 0) 0x7f861015bf00 con 0x7f861015bb20 2024-03-19T06:24:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f860f400640 1 -- 172.21.15.32:0/1121534094 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85f8003530 con 0x7f861015bb20 2024-03-19T06:24:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f8615800640 1 -- 172.21.15.32:0/1121534094 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f861009a480 msgr2=0x7f86100cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f8615800640 1 --2- 172.21.15.32:0/1121534094 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f861009a480 0x7f86100cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f8615800640 1 -- 172.21.15.32:0/1121534094 >> v1:172.21.15.32:6789/0 conn(0x7f861015bb20 legacy=0x7f86100c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:06.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.866+0000 7f8615800640 1 -- 172.21.15.32:0/1121534094 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86100cc5d0 con 0x7f86100cd390 2024-03-19T06:24:06.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.870+0000 7f8615800640 1 --2- 172.21.15.32:0/1121534094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86100cd390 0x7f86100cd820 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8608009d90 tx=0x7f860801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0c3bb6e81ab701 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:06.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.870+0000 7f860f400640 1 -- 172.21.15.32:0/1121534094 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86080b2070 con 0x7f86100cd390 2024-03-19T06:24:06.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.870+0000 7f860f400640 1 -- 172.21.15.32:0/1121534094 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86080a5830 con 0x7f86100cd390 2024-03-19T06:24:06.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.870+0000 7f860f400640 1 -- 172.21.15.32:0/1121534094 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86080a5c00 con 0x7f86100cd390 2024-03-19T06:24:06.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.870+0000 7f8617800640 1 -- 172.21.15.32:0/1121534094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86100cd390 msgr2=0x7f86100cd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:06.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.870+0000 7f8617800640 1 --2- 172.21.15.32:0/1121534094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86100cd390 0x7f86100cd820 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8608009d90 tx=0x7f860801c970 comp rx=0 tx=0).stop 2024-03-19T06:24:06.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.870+0000 7f8617800640 1 -- 172.21.15.32:0/1121534094 shutdown_connections 2024-03-19T06:24:06.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.870+0000 7f8617800640 1 --2- 172.21.15.32:0/1121534094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86100cd390 0x7f86100cd820 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:06.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.870+0000 7f8617800640 1 --2- 172.21.15.32:0/1121534094 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f861009a480 0x7f86100cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:06.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.870+0000 7f8617800640 1 -- 172.21.15.32:0/1121534094 >> 172.21.15.32:0/1121534094 conn(0x7f86100d1890 msgr2=0x7f86100d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:06.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.870+0000 7f8617800640 1 -- 172.21.15.32:0/1121534094 shutdown_connections 2024-03-19T06:24:06.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.870+0000 7f8617800640 1 -- 172.21.15.32:0/1121534094 wait complete. 2024-03-19T06:24:06.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f8617800640 1 Processor -- start 2024-03-19T06:24:06.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f8617800640 1 -- start start 2024-03-19T06:24:06.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f8617800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f861009a480 0x7f861015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:06.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f8617800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86100cd390 0x7f86101568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:06.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f8617800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f861015bb20 0x7f861015bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:06.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f8617800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86100c5af0 con 0x7f86100cd390 2024-03-19T06:24:06.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f8617800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86100cfbb0 con 0x7f861015bb20 2024-03-19T06:24:06.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f8617800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8610168940 con 0x7f861009a480 2024-03-19T06:24:06.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f860fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86100cd390 0x7f86101568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:06.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f860fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86100cd390 0x7f86101568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49842/0 (socket says 172.21.15.32:49842) 2024-03-19T06:24:06.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f860fe00640 1 -- 172.21.15.32:0/3427958878 learned_addr learned my addr 172.21.15.32:0/3427958878 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f8614e00640 1 --2- 172.21.15.32:0/3427958878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f861009a480 0x7f861015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f8615800640 1 --2- 172.21.15.32:0/3427958878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f861015bb20 0x7f861015bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f860fe00640 1 -- 172.21.15.32:0/3427958878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f861009a480 msgr2=0x7f861015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f860fe00640 1 --2- 172.21.15.32:0/3427958878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f861009a480 0x7f861015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f860fe00640 1 -- 172.21.15.32:0/3427958878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f861015bb20 msgr2=0x7f861015bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f860fe00640 1 --2- 172.21.15.32:0/3427958878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f861015bb20 0x7f861015bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f860fe00640 1 -- 172.21.15.32:0/3427958878 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8610155af0 con 0x7f86100cd390 2024-03-19T06:24:06.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f8614e00640 1 --2- 172.21.15.32:0/3427958878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f861009a480 0x7f861015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f860fe00640 1 --2- 172.21.15.32:0/3427958878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86100cd390 0x7f86101568b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00d5f0 tx=0x7f85fc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f860cc00640 1 -- 172.21.15.32:0/3427958878 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc0125f0 con 0x7f86100cd390 2024-03-19T06:24:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f860cc00640 1 -- 172.21.15.32:0/3427958878 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc019070 con 0x7f86100cd390 2024-03-19T06:24:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f8617800640 1 -- 172.21.15.32:0/3427958878 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8610155dd0 con 0x7f86100cd390 2024-03-19T06:24:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f860cc00640 1 -- 172.21.15.32:0/3427958878 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc0129b0 con 0x7f86100cd390 2024-03-19T06:24:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f8617800640 1 -- 172.21.15.32:0/3427958878 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8610155070 con 0x7f86100cd390 2024-03-19T06:24:06.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.874+0000 7f8617800640 1 -- 172.21.15.32:0/3427958878 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86100749e0 con 0x7f86100cd390 2024-03-19T06:24:06.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.878+0000 7f860cc00640 1 -- 172.21.15.32:0/3427958878 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f85fc012b50 con 0x7f86100cd390 2024-03-19T06:24:06.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.878+0000 7f860cc00640 1 --2- 172.21.15.32:0/3427958878 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f85f0067660 0x7f85f0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:06.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.878+0000 7f860cc00640 1 -- 172.21.15.32:0/3427958878 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f85fc0859f0 con 0x7f86100cd390 2024-03-19T06:24:06.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.878+0000 7f8614e00640 1 --2- 172.21.15.32:0/3427958878 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f85f0067660 0x7f85f0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:06.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.878+0000 7f8614e00640 1 --2- 172.21.15.32:0/3427958878 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f85f0067660 0x7f85f0069b20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8604005890 tx=0x7f8604009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:06.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:06.882+0000 7f860cc00640 1 -- 172.21.15.32:0/3427958878 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f85fc0568d0 con 0x7f86100cd390 2024-03-19T06:24:07.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.042+0000 7f8617800640 1 -- 172.21.15.32:0/3427958878 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f86100cdb40 con 0x7f85f0067660 2024-03-19T06:24:07.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.042+0000 7f860cc00640 1 -- 172.21.15.32:0/3427958878 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13450 (secure 0 0 0) 0x7f86100cdb40 con 0x7f85f0067660 2024-03-19T06:24:07.031 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:24:07.031 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:24:07.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.042+0000 7f8617800640 1 -- 172.21.15.32:0/3427958878 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f85f0067660 msgr2=0x7f85f0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:07.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.042+0000 7f8617800640 1 --2- 172.21.15.32:0/3427958878 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f85f0067660 0x7f85f0069b20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8604005890 tx=0x7f8604009040 comp rx=0 tx=0).stop 2024-03-19T06:24:07.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.042+0000 7f8617800640 1 -- 172.21.15.32:0/3427958878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86100cd390 msgr2=0x7f86101568b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:07.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.042+0000 7f8617800640 1 --2- 172.21.15.32:0/3427958878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86100cd390 0x7f86101568b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00d5f0 tx=0x7f85fc00dab0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.042+0000 7f8617800640 1 -- 172.21.15.32:0/3427958878 shutdown_connections 2024-03-19T06:24:07.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.042+0000 7f8617800640 1 --2- 172.21.15.32:0/3427958878 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f85f0067660 0x7f85f0069b20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.042+0000 7f8617800640 1 --2- 172.21.15.32:0/3427958878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f861015bb20 0x7f861015bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.042+0000 7f8617800640 1 --2- 172.21.15.32:0/3427958878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86100cd390 0x7f86101568b0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.042+0000 7f8617800640 1 --2- 172.21.15.32:0/3427958878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f861009a480 0x7f861015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.042+0000 7f8617800640 1 -- 172.21.15.32:0/3427958878 >> 172.21.15.32:0/3427958878 conn(0x7f86100d1890 msgr2=0x7f86100b7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:07.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.042+0000 7f8617800640 1 -- 172.21.15.32:0/3427958878 shutdown_connections 2024-03-19T06:24:07.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.042+0000 7f8617800640 1 -- 172.21.15.32:0/3427958878 wait complete. 2024-03-19T06:24:07.052 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-03-19T06:24:05.963703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":238996,"kb_used_data":6192,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735724,"statfs":{"total":773094113280,"available":772849381376,"internally_reserved":0,"allocated":6340608,"data_stored":3324742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14792,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-66,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001325"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":229,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-19T06:24:00.216464+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:24:00.216464+0000","last_peered":"2024-03-19T06:24:00.216464+0000","last_clean":"2024-03-19T06:24:00.216464+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:24:00.216464+0000","last_undegraded":"2024-03-19T06:24:00.216464+0000","last_fullsized":"2024-03-19T06:24:00.216464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1236992,"data_stored":856486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509480,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":630784,"data_stored":260507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":259855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":647168,"data_stored":276153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":643072,"data_stored":266154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509480,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1224704,"data_stored":850279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31836,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:24:07.052 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-19T06:24:07.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:24:07.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.202+0000 7ff871000640 1 Processor -- start 2024-03-19T06:24:07.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.202+0000 7ff871000640 1 -- start start 2024-03-19T06:24:07.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.206+0000 7ff871000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff86c15dd70 0x7ff86c09a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:07.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.206+0000 7ff871000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff86c06be50 0x7ff86c0d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:07.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.206+0000 7ff871000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86c0cfad0 con 0x7ff86c06c480 2024-03-19T06:24:07.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.206+0000 7ff871000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff86c0d0980 con 0x7ff86c06be50 2024-03-19T06:24:07.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.206+0000 7ff871000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c15e150 con 0x7ff86c15dd70 2024-03-19T06:24:07.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.206+0000 7ff869e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff86c15dd70 0x7ff86c09a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:07.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.206+0000 7ff869e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff86c15dd70 0x7ff86c09a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:42848/0 (socket says 172.21.15.32:42848) 2024-03-19T06:24:07.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.206+0000 7ff869e00640 1 -- 172.21.15.32:0/3738728350 learned_addr learned my addr 172.21.15.32:0/3738728350 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:07.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.206+0000 7ff861400640 1 --2- 172.21.15.32:0/3738728350 >> v2:172.21.15.171:3300/0 conn(0x7ff86c06be50 0x7ff86c0d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:07.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.206+0000 7ff869e00640 1 -- 172.21.15.32:0/3738728350 >> v2:172.21.15.171:3300/0 conn(0x7ff86c06be50 msgr2=0x7ff86c0d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:07.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.206+0000 7ff869e00640 1 --2- 172.21.15.32:0/3738728350 >> v2:172.21.15.171:3300/0 conn(0x7ff86c06be50 0x7ff86c0d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.206+0000 7ff869e00640 1 -- 172.21.15.32:0/3738728350 >> v1:172.21.15.171:6789/0 conn(0x7ff86c06c480 legacy=0x7ff86c0cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:07.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.206+0000 7ff869e00640 1 -- 172.21.15.32:0/3738728350 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c0cfd70 con 0x7ff86c15dd70 2024-03-19T06:24:07.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.210+0000 7ff869e00640 1 --2- 172.21.15.32:0/3738728350 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff86c15dd70 0x7ff86c09a480 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009870 tx=0x7ff85c01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2df3a3b0753154f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:07.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.210+0000 7ff869400640 1 -- 172.21.15.32:0/3738728350 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0b5070 con 0x7ff86c15dd70 2024-03-19T06:24:07.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.210+0000 7ff869400640 1 -- 172.21.15.32:0/3738728350 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c0a8a50 con 0x7ff86c15dd70 2024-03-19T06:24:07.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.210+0000 7ff869400640 1 -- 172.21.15.32:0/3738728350 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0a8e20 con 0x7ff86c15dd70 2024-03-19T06:24:07.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.210+0000 7ff871000640 1 -- 172.21.15.32:0/3738728350 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff86c15dd70 msgr2=0x7ff86c09a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:07.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.210+0000 7ff871000640 1 --2- 172.21.15.32:0/3738728350 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff86c15dd70 0x7ff86c09a480 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009870 tx=0x7ff85c01ed50 comp rx=0 tx=0).stop 2024-03-19T06:24:07.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.210+0000 7ff871000640 1 -- 172.21.15.32:0/3738728350 shutdown_connections 2024-03-19T06:24:07.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.210+0000 7ff871000640 1 --2- 172.21.15.32:0/3738728350 >> v2:172.21.15.171:3300/0 conn(0x7ff86c06be50 0x7ff86c0d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.210+0000 7ff871000640 1 --2- 172.21.15.32:0/3738728350 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff86c15dd70 0x7ff86c09a480 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.210+0000 7ff871000640 1 -- 172.21.15.32:0/3738728350 >> 172.21.15.32:0/3738728350 conn(0x7ff86c0d1890 msgr2=0x7ff86c0d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:07.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.210+0000 7ff871000640 1 -- 172.21.15.32:0/3738728350 shutdown_connections 2024-03-19T06:24:07.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.210+0000 7ff871000640 1 -- 172.21.15.32:0/3738728350 wait complete. 2024-03-19T06:24:07.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.210+0000 7ff871000640 1 Processor -- start 2024-03-19T06:24:07.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.210+0000 7ff871000640 1 -- start start 2024-03-19T06:24:07.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff871000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff86c06be50 0x7ff86c0c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:07.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff871000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff86c06c480 0x7ff86c154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:07.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff871000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff86c15dd70 0x7ff86c0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:07.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff871000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c0d0610 con 0x7ff86c06be50 2024-03-19T06:24:07.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff871000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c0d0330 con 0x7ff86c15dd70 2024-03-19T06:24:07.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff871000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c0d1350 con 0x7ff86c06c480 2024-03-19T06:24:07.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff869e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff86c06be50 0x7ff86c0c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:07.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff869e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff86c06be50 0x7ff86c0c7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49846/0 (socket says 172.21.15.32:49846) 2024-03-19T06:24:07.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff869e00640 1 -- 172.21.15.32:0/2018166271 learned_addr learned my addr 172.21.15.32:0/2018166271 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:07.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff861400640 1 --2- 172.21.15.32:0/2018166271 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff86c06c480 0x7ff86c154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:07.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff86a800640 1 --2- 172.21.15.32:0/2018166271 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff86c15dd70 0x7ff86c0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:07.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff869e00640 1 -- 172.21.15.32:0/2018166271 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff86c06c480 msgr2=0x7ff86c154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:07.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff869e00640 1 --2- 172.21.15.32:0/2018166271 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff86c06c480 0x7ff86c154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff869e00640 1 -- 172.21.15.32:0/2018166271 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff86c15dd70 msgr2=0x7ff86c0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:07.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff869e00640 1 --2- 172.21.15.32:0/2018166271 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff86c15dd70 0x7ff86c0cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff869e00640 1 -- 172.21.15.32:0/2018166271 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c0c8220 con 0x7ff86c06be50 2024-03-19T06:24:07.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff869e00640 1 --2- 172.21.15.32:0/2018166271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff86c06be50 0x7ff86c0c7ce0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0097c0 tx=0x7ff85c01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:07.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff862a00640 1 -- 172.21.15.32:0/2018166271 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0c0070 con 0x7ff86c06be50 2024-03-19T06:24:07.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff862a00640 1 -- 172.21.15.32:0/2018166271 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c0ae550 con 0x7ff86c06be50 2024-03-19T06:24:07.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff862a00640 1 -- 172.21.15.32:0/2018166271 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0b5070 con 0x7ff86c06be50 2024-03-19T06:24:07.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff871000640 1 -- 172.21.15.32:0/2018166271 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86c0c9fe0 con 0x7ff86c06be50 2024-03-19T06:24:07.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff871000640 1 -- 172.21.15.32:0/2018166271 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86c0c6c80 con 0x7ff86c06be50 2024-03-19T06:24:07.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.214+0000 7ff871000640 1 -- 172.21.15.32:0/2018166271 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86c0749e0 con 0x7ff86c06be50 2024-03-19T06:24:07.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.218+0000 7ff862a00640 1 -- 172.21.15.32:0/2018166271 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff85c0c3070 con 0x7ff86c06be50 2024-03-19T06:24:07.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.218+0000 7ff862a00640 1 --2- 172.21.15.32:0/2018166271 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff848067660 0x7ff848069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:07.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.218+0000 7ff862a00640 1 -- 172.21.15.32:0/2018166271 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff85c123130 con 0x7ff86c06be50 2024-03-19T06:24:07.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.218+0000 7ff861400640 1 --2- 172.21.15.32:0/2018166271 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff848067660 0x7ff848069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:07.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.218+0000 7ff861400640 1 --2- 172.21.15.32:0/2018166271 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff848067660 0x7ff848069b20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff86c0d2790 tx=0x7ff854009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:07.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.222+0000 7ff862a00640 1 -- 172.21.15.32:0/2018166271 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7ff85c0188b0 con 0x7ff86c06be50 2024-03-19T06:24:07.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.382+0000 7ff871000640 1 -- 172.21.15.32:0/2018166271 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff86c09af20 con 0x7ff848067660 2024-03-19T06:24:07.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.382+0000 7ff862a00640 1 -- 172.21.15.32:0/2018166271 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13450 (secure 0 0 0) 0x7ff86c09af20 con 0x7ff848067660 2024-03-19T06:24:07.371 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:24:07.371 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:24:07.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.382+0000 7ff871000640 1 -- 172.21.15.32:0/2018166271 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff848067660 msgr2=0x7ff848069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:07.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.382+0000 7ff871000640 1 --2- 172.21.15.32:0/2018166271 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff848067660 0x7ff848069b20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff86c0d2790 tx=0x7ff854009190 comp rx=0 tx=0).stop 2024-03-19T06:24:07.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.382+0000 7ff871000640 1 -- 172.21.15.32:0/2018166271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff86c06be50 msgr2=0x7ff86c0c7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:07.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.382+0000 7ff871000640 1 --2- 172.21.15.32:0/2018166271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff86c06be50 0x7ff86c0c7ce0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0097c0 tx=0x7ff85c01baf0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.382+0000 7ff871000640 1 -- 172.21.15.32:0/2018166271 shutdown_connections 2024-03-19T06:24:07.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.382+0000 7ff871000640 1 --2- 172.21.15.32:0/2018166271 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ff848067660 0x7ff848069b20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.382+0000 7ff871000640 1 --2- 172.21.15.32:0/2018166271 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff86c15dd70 0x7ff86c0cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.382+0000 7ff871000640 1 --2- 172.21.15.32:0/2018166271 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff86c06c480 0x7ff86c154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.382+0000 7ff871000640 1 --2- 172.21.15.32:0/2018166271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff86c06be50 0x7ff86c0c7ce0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.382+0000 7ff871000640 1 -- 172.21.15.32:0/2018166271 >> 172.21.15.32:0/2018166271 conn(0x7ff86c0d1890 msgr2=0x7ff86c0b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:07.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.382+0000 7ff871000640 1 -- 172.21.15.32:0/2018166271 shutdown_connections 2024-03-19T06:24:07.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.382+0000 7ff871000640 1 -- 172.21.15.32:0/2018166271 wait complete. 2024-03-19T06:24:07.391 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-03-19T06:24:05.963703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":238996,"kb_used_data":6192,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735724,"statfs":{"total":773094113280,"available":772849381376,"internally_reserved":0,"allocated":6340608,"data_stored":3324742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14792,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-66,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001325"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":229,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-19T06:24:00.216464+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:24:00.216464+0000","last_peered":"2024-03-19T06:24:00.216464+0000","last_clean":"2024-03-19T06:24:00.216464+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:24:00.216464+0000","last_undegraded":"2024-03-19T06:24:00.216464+0000","last_fullsized":"2024-03-19T06:24:00.216464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1236992,"data_stored":856486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509480,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":630784,"data_stored":260507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":259855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":647168,"data_stored":276153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":643072,"data_stored":266154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509480,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1224704,"data_stored":850279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31836,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:24:07.392 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:24:07.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f7e00640 1 Processor -- start 2024-03-19T06:24:07.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f7e00640 1 -- start start 2024-03-19T06:24:07.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f54f815da70 0x7f54f80cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:07.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54f80d18f0 0x7f54f80d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:07.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f80d2300 0x7f54f80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:07.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f7e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f80cf920 con 0x7f54f80d18f0 2024-03-19T06:24:07.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f7e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f80b6760 con 0x7f54f815da70 2024-03-19T06:24:07.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f7e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f80b6a40 con 0x7f54f80d2300 2024-03-19T06:24:07.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f6000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54f80d18f0 0x7f54f80d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:07.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f6000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54f80d18f0 0x7f54f80d1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49850/0 (socket says 172.21.15.32:49850) 2024-03-19T06:24:07.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f6000640 1 -- 172.21.15.32:0/372190138 learned_addr learned my addr 172.21.15.32:0/372190138 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:07.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f7400640 1 --2- 172.21.15.32:0/372190138 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f80d2300 0x7f54f80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f6a00640 1 --2- 172.21.15.32:0/372190138 >> v2:172.21.15.171:3300/0 conn(0x7f54f815da70 0x7f54f80cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f6000640 1 -- 172.21.15.32:0/372190138 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f80d2300 msgr2=0x7f54f80b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f6000640 1 --2- 172.21.15.32:0/372190138 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f80d2300 0x7f54f80b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f6000640 1 -- 172.21.15.32:0/372190138 >> v2:172.21.15.171:3300/0 conn(0x7f54f815da70 msgr2=0x7f54f80cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f6000640 1 --2- 172.21.15.32:0/372190138 >> v2:172.21.15.171:3300/0 conn(0x7f54f815da70 0x7f54f80cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f6000640 1 -- 172.21.15.32:0/372190138 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f80b6d20 con 0x7f54f80d18f0 2024-03-19T06:24:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.546+0000 7f54f6a00640 1 --2- 172.21.15.32:0/372190138 >> v2:172.21.15.171:3300/0 conn(0x7f54f815da70 0x7f54f80cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:24:07.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.550+0000 7f54f6000640 1 --2- 172.21.15.32:0/372190138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54f80d18f0 0x7f54f80d1dc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f54f808b610 tx=0x7f54e401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702e95f3c434efd9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:07.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.550+0000 7f54f5600640 1 -- 172.21.15.32:0/372190138 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e40b2070 con 0x7f54f80d18f0 2024-03-19T06:24:07.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.550+0000 7f54f5600640 1 -- 172.21.15.32:0/372190138 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e40a9070 con 0x7f54f80d18f0 2024-03-19T06:24:07.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.550+0000 7f54f5600640 1 -- 172.21.15.32:0/372190138 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e40ad880 con 0x7f54f80d18f0 2024-03-19T06:24:07.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.550+0000 7f54f7e00640 1 -- 172.21.15.32:0/372190138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54f80d18f0 msgr2=0x7f54f80d1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:07.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.550+0000 7f54f7e00640 1 --2- 172.21.15.32:0/372190138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54f80d18f0 0x7f54f80d1dc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f54f808b610 tx=0x7f54e401c490 comp rx=0 tx=0).stop 2024-03-19T06:24:07.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.550+0000 7f54f7e00640 1 -- 172.21.15.32:0/372190138 shutdown_connections 2024-03-19T06:24:07.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.550+0000 7f54f7e00640 1 --2- 172.21.15.32:0/372190138 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f80d2300 0x7f54f80b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.550+0000 7f54f7e00640 1 --2- 172.21.15.32:0/372190138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54f80d18f0 0x7f54f80d1dc0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.550+0000 7f54f7e00640 1 --2- 172.21.15.32:0/372190138 >> v2:172.21.15.171:3300/0 conn(0x7f54f815da70 0x7f54f80cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.550+0000 7f54f7e00640 1 -- 172.21.15.32:0/372190138 >> 172.21.15.32:0/372190138 conn(0x7f54f808b000 msgr2=0x7f54f80d37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:07.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.550+0000 7f54f7e00640 1 -- 172.21.15.32:0/372190138 shutdown_connections 2024-03-19T06:24:07.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.550+0000 7f54f7e00640 1 -- 172.21.15.32:0/372190138 wait complete. 2024-03-19T06:24:07.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.550+0000 7f54f7e00640 1 Processor -- start 2024-03-19T06:24:07.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.550+0000 7f54f7e00640 1 -- start start 2024-03-19T06:24:07.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f80d18f0 0x7f54f815f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:07.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54f80d2300 0x7f54f80c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:07.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54f815da70 0x7f54f8144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:07.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f80cffb0 con 0x7f54f815da70 2024-03-19T06:24:07.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f80cfe30 con 0x7f54f80d2300 2024-03-19T06:24:07.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f80d0130 con 0x7f54f80d18f0 2024-03-19T06:24:07.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54f815da70 0x7f54f8144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:07.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54f815da70 0x7f54f8144a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49852/0 (socket says 172.21.15.32:49852) 2024-03-19T06:24:07.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7400640 1 -- 172.21.15.32:0/3452449222 learned_addr learned my addr 172.21.15.32:0/3452449222 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:07.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f6000640 1 --2- 172.21.15.32:0/3452449222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54f80d2300 0x7f54f80c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:07.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f6a00640 1 --2- 172.21.15.32:0/3452449222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f80d18f0 0x7f54f815f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:07.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7400640 1 -- 172.21.15.32:0/3452449222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f80d18f0 msgr2=0x7f54f815f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:07.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7400640 1 --2- 172.21.15.32:0/3452449222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f80d18f0 0x7f54f815f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7400640 1 -- 172.21.15.32:0/3452449222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54f80d2300 msgr2=0x7f54f80c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:07.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7400640 1 --2- 172.21.15.32:0/3452449222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54f80d2300 0x7f54f80c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7400640 1 -- 172.21.15.32:0/3452449222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f8144fa0 con 0x7f54f815da70 2024-03-19T06:24:07.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7400640 1 --2- 172.21.15.32:0/3452449222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54f815da70 0x7f54f8144a60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f54f0007d10 tx=0x7f54f000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:07.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54ef400640 1 -- 172.21.15.32:0/3452449222 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0014420 con 0x7f54f815da70 2024-03-19T06:24:07.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54ef400640 1 -- 172.21.15.32:0/3452449222 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f0019070 con 0x7f54f815da70 2024-03-19T06:24:07.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7e00640 1 -- 172.21.15.32:0/3452449222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f815f7f0 con 0x7f54f815da70 2024-03-19T06:24:07.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54ef400640 1 -- 172.21.15.32:0/3452449222 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0014820 con 0x7f54f815da70 2024-03-19T06:24:07.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7e00640 1 -- 172.21.15.32:0/3452449222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f815fdb0 con 0x7f54f815da70 2024-03-19T06:24:07.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.554+0000 7f54f7e00640 1 -- 172.21.15.32:0/3452449222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f8075090 con 0x7f54f815da70 2024-03-19T06:24:07.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.558+0000 7f54ef400640 1 -- 172.21.15.32:0/3452449222 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f54f00149c0 con 0x7f54f815da70 2024-03-19T06:24:07.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.558+0000 7f54ef400640 1 --2- 172.21.15.32:0/3452449222 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f54d8067660 0x7f54d8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:07.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.558+0000 7f54ef400640 1 -- 172.21.15.32:0/3452449222 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f54f0085cf0 con 0x7f54f815da70 2024-03-19T06:24:07.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.558+0000 7f54f6a00640 1 --2- 172.21.15.32:0/3452449222 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f54d8067660 0x7f54d8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:07.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.558+0000 7f54f6a00640 1 --2- 172.21.15.32:0/3452449222 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f54d8067660 0x7f54d8069b20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f54e8006fd0 tx=0x7f54e8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:07.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.562+0000 7f54ef400640 1 -- 172.21.15.32:0/3452449222 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f54f00564f0 con 0x7f54f815da70 2024-03-19T06:24:07.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.726+0000 7f54f7e00640 1 -- 172.21.15.32:0/3452449222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54f80d13d0 con 0x7f54f815da70 2024-03-19T06:24:07.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.726+0000 7f54ef400640 1 -- 172.21.15.32:0/3452449222 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+13034 (secure 0 0 0) 0x7f54f005a590 con 0x7f54f815da70 2024-03-19T06:24:07.715 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:24:07.715 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":56,"fsid":"5b96820f-940f-489f-8b00-afd5c905fd95","created":"2024-03-19T06:20:44.030904+0000","modified":"2024-03-19T06:24:03.214719+0000","last_up_change":"2024-03-19T06:20:55.353330+0000","last_in_change":"2024-03-19T06:20:46.540624+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:20:55.980374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3474385b-fff3-4c03-ab2f-b478e54f93ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6809","nonce":2787806963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6811","nonce":2787806963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6815","nonce":2787806963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2787806963},{"type":"v1","addr":"172.21.15.32:6813","nonce":2787806963}]},"public_addr":"172.21.15.32:6809/2787806963","cluster_addr":"172.21.15.32:6811/2787806963","heartbeat_back_addr":"172.21.15.32:6815/2787806963","heartbeat_front_addr":"172.21.15.32:6813/2787806963","state":["exists","up"]},{"osd":1,"uuid":"ac890403-9829-40d7-8d50-80a17597ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6801","nonce":3354910175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6803","nonce":3354910175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6807","nonce":3354910175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3354910175},{"type":"v1","addr":"172.21.15.32:6805","nonce":3354910175}]},"public_addr":"172.21.15.32:6801/3354910175","cluster_addr":"172.21.15.32:6803/3354910175","heartbeat_back_addr":"172.21.15.32:6807/3354910175","heartbeat_front_addr":"172.21.15.32:6805/3354910175","state":["exists","up"]},{"osd":2,"uuid":"bf6c84c8-4914-45d4-97f3-cdf0fe1e682c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6825","nonce":1835843146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6827","nonce":1835843146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6831","nonce":1835843146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1835843146},{"type":"v1","addr":"172.21.15.32:6829","nonce":1835843146}]},"public_addr":"172.21.15.32:6825/1835843146","cluster_addr":"172.21.15.32:6827/1835843146","heartbeat_back_addr":"172.21.15.32:6831/1835843146","heartbeat_front_addr":"172.21.15.32:6829/1835843146","state":["exists","up"]},{"osd":3,"uuid":"6f68c8b3-3ec5-4d1b-85da-c683be6545dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6817","nonce":3701174485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6819","nonce":3701174485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6823","nonce":3701174485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3701174485},{"type":"v1","addr":"172.21.15.32:6821","nonce":3701174485}]},"public_addr":"172.21.15.32:6817/3701174485","cluster_addr":"172.21.15.32:6819/3701174485","heartbeat_back_addr":"172.21.15.32:6823/3701174485","heartbeat_front_addr":"172.21.15.32:6821/3701174485","state":["exists","up"]},{"osd":4,"uuid":"d41e788a-6f9d-4f6b-901a-a06adad2da3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6801","nonce":2358501242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6803","nonce":2358501242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6807","nonce":2358501242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2358501242},{"type":"v1","addr":"172.21.15.171:6805","nonce":2358501242}]},"public_addr":"172.21.15.171:6801/2358501242","cluster_addr":"172.21.15.171:6803/2358501242","heartbeat_back_addr":"172.21.15.171:6807/2358501242","heartbeat_front_addr":"172.21.15.171:6805/2358501242","state":["exists","up"]},{"osd":5,"uuid":"0fbf6c55-4612-4c22-b803-1ed93ad316b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6809","nonce":3784639902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6811","nonce":3784639902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6815","nonce":3784639902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3784639902},{"type":"v1","addr":"172.21.15.171:6813","nonce":3784639902}]},"public_addr":"172.21.15.171:6809/3784639902","cluster_addr":"172.21.15.171:6811/3784639902","heartbeat_back_addr":"172.21.15.171:6815/3784639902","heartbeat_front_addr":"172.21.15.171:6813/3784639902","state":["exists","up"]},{"osd":6,"uuid":"9a47209c-4cdd-4a80-9b5b-711e4972c996","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6825","nonce":1372815214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6827","nonce":1372815214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6831","nonce":1372815214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1372815214},{"type":"v1","addr":"172.21.15.171:6829","nonce":1372815214}]},"public_addr":"172.21.15.171:6825/1372815214","cluster_addr":"172.21.15.171:6827/1372815214","heartbeat_back_addr":"172.21.15.171:6831/1372815214","heartbeat_front_addr":"172.21.15.171:6829/1372815214","state":["exists","up"]},{"osd":7,"uuid":"1a87a320-7f3e-4a5e-ac33-5006d45551ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6817","nonce":2899212924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6819","nonce":2899212924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6823","nonce":2899212924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2899212924},{"type":"v1","addr":"172.21.15.171:6821","nonce":2899212924}]},"public_addr":"172.21.15.171:6817/2899212924","cluster_addr":"172.21.15.171:6819/2899212924","heartbeat_back_addr":"172.21.15.171:6823/2899212924","heartbeat_front_addr":"172.21.15.171:6821/2899212924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.043369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.998650+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.032218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.916952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.856319+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:51.990777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.216613+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:20:52.092864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.171:6837/1907516739":"2024-03-20T06:24:00.208446+0000","172.21.15.171:6835/1907516739":"2024-03-20T06:24:00.208446+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:24:07.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.726+0000 7f54f7e00640 1 -- 172.21.15.32:0/3452449222 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f54d8067660 msgr2=0x7f54d8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:07.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.726+0000 7f54f7e00640 1 --2- 172.21.15.32:0/3452449222 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f54d8067660 0x7f54d8069b20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f54e8006fd0 tx=0x7f54e8008040 comp rx=0 tx=0).stop 2024-03-19T06:24:07.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.726+0000 7f54f7e00640 1 -- 172.21.15.32:0/3452449222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54f815da70 msgr2=0x7f54f8144a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:07.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.726+0000 7f54f7e00640 1 --2- 172.21.15.32:0/3452449222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54f815da70 0x7f54f8144a60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f54f0007d10 tx=0x7f54f000e4b0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.726+0000 7f54f7e00640 1 -- 172.21.15.32:0/3452449222 shutdown_connections 2024-03-19T06:24:07.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.726+0000 7f54f7e00640 1 --2- 172.21.15.32:0/3452449222 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f54d8067660 0x7f54d8069b20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.726+0000 7f54f7e00640 1 --2- 172.21.15.32:0/3452449222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54f815da70 0x7f54f8144a60 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.726+0000 7f54f7e00640 1 --2- 172.21.15.32:0/3452449222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54f80d2300 0x7f54f80c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.726+0000 7f54f7e00640 1 --2- 172.21.15.32:0/3452449222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f80d18f0 0x7f54f815f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:07.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.726+0000 7f54f7e00640 1 -- 172.21.15.32:0/3452449222 >> 172.21.15.32:0/3452449222 conn(0x7f54f808b000 msgr2=0x7f54f8155520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:07.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.726+0000 7f54f7e00640 1 -- 172.21.15.32:0/3452449222 shutdown_connections 2024-03-19T06:24:07.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:07.726+0000 7f54f7e00640 1 -- 172.21.15.32:0/3452449222 wait complete. 2024-03-19T06:24:08.736 INFO:tasks.ceph:Scrubbing osd.0 2024-03-19T06:24:08.737 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-19T06:24:08.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.902+0000 7f7a18800640 1 Processor -- start 2024-03-19T06:24:08.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.902+0000 7f7a18800640 1 -- start start 2024-03-19T06:24:08.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.902+0000 7f7a18800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7a1006bee0 0x7f7a100cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:08.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.902+0000 7f7a18800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a100ce770 0x7f7a1006c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:08.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.902+0000 7f7a18800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a10161b70 con 0x7f7a1015dcb0 2024-03-19T06:24:08.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.902+0000 7f7a18800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1006c300 con 0x7f7a1006bee0 2024-03-19T06:24:08.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.902+0000 7f7a18800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a10161e50 con 0x7f7a100ce770 2024-03-19T06:24:08.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.902+0000 7f7a15400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7a1006bee0 0x7f7a100cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:08.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.902+0000 7f7a15400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7a1006bee0 0x7f7a100cf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49864/0 (socket says 172.21.15.32:49864) 2024-03-19T06:24:08.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.902+0000 7f7a15400640 1 -- 172.21.15.32:0/1829719407 learned_addr learned my addr 172.21.15.32:0/1829719407 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:08.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.902+0000 7f7a15e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7a1015dcb0 0x7f7a100ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:34750/0 (socket says 172.21.15.32:34750) 2024-03-19T06:24:08.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.906+0000 7f7a16800640 1 --2- 172.21.15.32:0/1829719407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a100ce770 0x7f7a1006c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:08.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.906+0000 7f7a15400640 1 -- 172.21.15.32:0/1829719407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a100ce770 msgr2=0x7f7a1006c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:08.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.906+0000 7f7a15400640 1 --2- 172.21.15.32:0/1829719407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a100ce770 0x7f7a1006c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:08.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.906+0000 7f7a15400640 1 -- 172.21.15.32:0/1829719407 >> v1:172.21.15.32:6789/0 conn(0x7f7a1015dcb0 legacy=0x7f7a100ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:08.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.906+0000 7f7a15400640 1 -- 172.21.15.32:0/1829719407 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a10162130 con 0x7f7a1006bee0 2024-03-19T06:24:08.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.906+0000 7f7a15400640 1 --2- 172.21.15.32:0/1829719407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a1006bee0 0x7f7a100cf4c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009870 tx=0x7f7a0001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5345b1483bdeb479 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:08.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.906+0000 7f7a14a00640 1 -- 172.21.15.32:0/1829719407 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a000aa620 con 0x7f7a1006bee0 2024-03-19T06:24:08.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.906+0000 7f7a14a00640 1 -- 172.21.15.32:0/1829719407 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a000af070 con 0x7f7a1006bee0 2024-03-19T06:24:08.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.906+0000 7f7a14a00640 1 -- 172.21.15.32:0/1829719407 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a000aa9e0 con 0x7f7a1006bee0 2024-03-19T06:24:08.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.906+0000 7f7a18800640 1 -- 172.21.15.32:0/1829719407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a1006bee0 msgr2=0x7f7a100cf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:08.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.906+0000 7f7a18800640 1 --2- 172.21.15.32:0/1829719407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a1006bee0 0x7f7a100cf4c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009870 tx=0x7f7a0001c4a0 comp rx=0 tx=0).stop 2024-03-19T06:24:08.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a18800640 1 -- 172.21.15.32:0/1829719407 shutdown_connections 2024-03-19T06:24:08.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a18800640 1 --2- 172.21.15.32:0/1829719407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a100ce770 0x7f7a1006c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:08.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a18800640 1 --2- 172.21.15.32:0/1829719407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a1006bee0 0x7f7a100cf4c0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:08.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a18800640 1 -- 172.21.15.32:0/1829719407 >> 172.21.15.32:0/1829719407 conn(0x7f7a100b3410 msgr2=0x7f7a100b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:08.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a18800640 1 -- 172.21.15.32:0/1829719407 shutdown_connections 2024-03-19T06:24:08.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a18800640 1 -- 172.21.15.32:0/1829719407 wait complete. 2024-03-19T06:24:08.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a18800640 1 Processor -- start 2024-03-19T06:24:08.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a18800640 1 -- start start 2024-03-19T06:24:08.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a18800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a1006bee0 0x7f7a1014edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:08.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a18800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a100ce770 0x7f7a1014f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:08.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a18800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a1015dcb0 0x7f7a10158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:08.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a18800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1016ad60 con 0x7f7a100ce770 2024-03-19T06:24:08.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a18800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1016abe0 con 0x7f7a1015dcb0 2024-03-19T06:24:08.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a18800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1016aee0 con 0x7f7a1006bee0 2024-03-19T06:24:08.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a15400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a100ce770 0x7f7a1014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:08.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a15400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a100ce770 0x7f7a1014f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49878/0 (socket says 172.21.15.32:49878) 2024-03-19T06:24:08.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a15400640 1 -- 172.21.15.32:0/1162925730 learned_addr learned my addr 172.21.15.32:0/1162925730 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:08.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a15e00640 1 --2- 172.21.15.32:0/1162925730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a1006bee0 0x7f7a1014edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:08.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a16800640 1 --2- 172.21.15.32:0/1162925730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a1015dcb0 0x7f7a10158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:08.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a15400640 1 -- 172.21.15.32:0/1162925730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a1006bee0 msgr2=0x7f7a1014edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:08.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a15400640 1 --2- 172.21.15.32:0/1162925730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a1006bee0 0x7f7a1014edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:08.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a15400640 1 -- 172.21.15.32:0/1162925730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a1015dcb0 msgr2=0x7f7a10158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:08.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a15400640 1 --2- 172.21.15.32:0/1162925730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a1015dcb0 0x7f7a10158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:08.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a15400640 1 -- 172.21.15.32:0/1162925730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1014f960 con 0x7f7a100ce770 2024-03-19T06:24:08.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a15e00640 1 --2- 172.21.15.32:0/1162925730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a1006bee0 0x7f7a1014edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:08.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a16800640 1 --2- 172.21.15.32:0/1162925730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a1015dcb0 0x7f7a10158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:08.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.910+0000 7f7a15400640 1 --2- 172.21.15.32:0/1162925730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a100ce770 0x7f7a1014f330 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7a000ac040 tx=0x7f7a0001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:08.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.914+0000 7f7a0a000640 1 -- 172.21.15.32:0/1162925730 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a000aad90 con 0x7f7a100ce770 2024-03-19T06:24:08.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.914+0000 7f7a0a000640 1 -- 172.21.15.32:0/1162925730 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a000bd3f0 con 0x7f7a100ce770 2024-03-19T06:24:08.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.914+0000 7f7a0a000640 1 -- 172.21.15.32:0/1162925730 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a000bd7e0 con 0x7f7a100ce770 2024-03-19T06:24:08.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.914+0000 7f7a18800640 1 -- 172.21.15.32:0/1162925730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1014fc40 con 0x7f7a100ce770 2024-03-19T06:24:08.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.914+0000 7f7a18800640 1 -- 172.21.15.32:0/1162925730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a10150200 con 0x7f7a100ce770 2024-03-19T06:24:08.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.914+0000 7f7a18800640 1 -- 172.21.15.32:0/1162925730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7a101576c0 con 0x7f7a100ce770 2024-03-19T06:24:08.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.914+0000 7f7a0a000640 1 -- 172.21.15.32:0/1162925730 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7a000b33f0 con 0x7f7a100ce770 2024-03-19T06:24:08.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.914+0000 7f7a0a000640 1 --2- 172.21.15.32:0/1162925730 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f79f4067660 0x7f79f4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:08.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.914+0000 7f7a0a000640 1 -- 172.21.15.32:0/1162925730 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7a0011fa70 con 0x7f7a100ce770 2024-03-19T06:24:08.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.914+0000 7f7a0a000640 1 --2- 172.21.15.32:0/1162925730 >> [v2:172.21.15.32:6808/2787806963,v1:172.21.15.32:6809/2787806963] conn(0x7f79f406d520 0x7f79f406f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:08.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.914+0000 7f7a0a000640 1 -- 172.21.15.32:0/1162925730 --> [v2:172.21.15.32:6808/2787806963,v1:172.21.15.32:6809/2787806963] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79f406fff0 con 0x7f79f406d520 2024-03-19T06:24:08.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.914+0000 7f7a0a000640 1 -- 172.21.15.32:0/1162925730 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a001242a0 con 0x7f7a100ce770 2024-03-19T06:24:08.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.914+0000 7f7a15e00640 1 --2- 172.21.15.32:0/1162925730 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f79f4067660 0x7f79f4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:08.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.914+0000 7f7a16800640 1 --2- 172.21.15.32:0/1162925730 >> [v2:172.21.15.32:6808/2787806963,v1:172.21.15.32:6809/2787806963] conn(0x7f79f406d520 0x7f79f406f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:08.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.918+0000 7f7a16800640 1 --2- 172.21.15.32:0/1162925730 >> [v2:172.21.15.32:6808/2787806963,v1:172.21.15.32:6809/2787806963] conn(0x7f79f406d520 0x7f79f406f940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:08.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.918+0000 7f7a15e00640 1 --2- 172.21.15.32:0/1162925730 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f79f4067660 0x7f79f4069b20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7a04000f70 tx=0x7f7a04007d70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:08.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.918+0000 7f7a0a000640 1 -- 172.21.15.32:0/1162925730 <== osd.0 v2:172.21.15.32:6808/2787806963 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f79f406fff0 con 0x7f79f406d520 2024-03-19T06:24:08.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.930+0000 7f7a18800640 1 -- 172.21.15.32:0/1162925730 --> [v2:172.21.15.32:6808/2787806963,v1:172.21.15.32:6809/2787806963] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7a100749e0 con 0x7f79f406d520 2024-03-19T06:24:08.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.930+0000 7f7a0a000640 1 -- 172.21.15.32:0/1162925730 <== osd.0 v2:172.21.15.32:6808/2787806963 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7a100749e0 con 0x7f79f406d520 2024-03-19T06:24:08.920 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:24:08.920 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-19T06:24:08.920 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:24:08.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.930+0000 7f7a18800640 1 -- 172.21.15.32:0/1162925730 >> [v2:172.21.15.32:6808/2787806963,v1:172.21.15.32:6809/2787806963] conn(0x7f79f406d520 msgr2=0x7f79f406f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:08.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.930+0000 7f7a18800640 1 --2- 172.21.15.32:0/1162925730 >> [v2:172.21.15.32:6808/2787806963,v1:172.21.15.32:6809/2787806963] conn(0x7f79f406d520 0x7f79f406f940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:08.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.930+0000 7f7a18800640 1 -- 172.21.15.32:0/1162925730 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f79f4067660 msgr2=0x7f79f4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:08.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.930+0000 7f7a18800640 1 --2- 172.21.15.32:0/1162925730 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f79f4067660 0x7f79f4069b20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7a04000f70 tx=0x7f7a04007d70 comp rx=0 tx=0).stop 2024-03-19T06:24:08.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.930+0000 7f7a18800640 1 -- 172.21.15.32:0/1162925730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a100ce770 msgr2=0x7f7a1014f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:08.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.930+0000 7f7a18800640 1 --2- 172.21.15.32:0/1162925730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a100ce770 0x7f7a1014f330 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7a000ac040 tx=0x7f7a0001ace0 comp rx=0 tx=0).stop 2024-03-19T06:24:08.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.930+0000 7f7a16800640 1 -- 172.21.15.32:0/1162925730 reap_dead start 2024-03-19T06:24:08.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.930+0000 7f7a18800640 1 -- 172.21.15.32:0/1162925730 shutdown_connections 2024-03-19T06:24:08.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.930+0000 7f7a18800640 1 -- 172.21.15.32:0/1162925730 >> 172.21.15.32:0/1162925730 conn(0x7f7a100b3410 msgr2=0x7f7a100c6900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:08.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.930+0000 7f7a18800640 1 -- 172.21.15.32:0/1162925730 shutdown_connections 2024-03-19T06:24:08.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:08.930+0000 7f7a18800640 1 -- 172.21.15.32:0/1162925730 wait complete. 2024-03-19T06:24:08.938 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-19T06:24:09.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.090+0000 7f0015200640 1 Processor -- start 2024-03-19T06:24:09.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.090+0000 7f0015200640 1 -- start start 2024-03-19T06:24:09.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f0015200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00100cc220 0x7f00100ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f0015200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f00100cc600 0x7f00100717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f0015200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0010161e10 0x7f00100cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f0015200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00101616a0 con 0x7f0010161e10 2024-03-19T06:24:09.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f0015200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0010071ee0 con 0x7f00100cc600 2024-03-19T06:24:09.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f0015200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00100721c0 con 0x7f00100cc220 2024-03-19T06:24:09.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f000e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0010161e10 0x7f00100cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f000e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0010161e10 0x7f00100cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49884/0 (socket says 172.21.15.32:49884) 2024-03-19T06:24:09.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f000e800640 1 -- 172.21.15.32:0/727699958 learned_addr learned my addr 172.21.15.32:0/727699958 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:09.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f000de00640 1 --2- 172.21.15.32:0/727699958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00100cc220 0x7f00100ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f0007e00640 1 --2- 172.21.15.32:0/727699958 >> v2:172.21.15.171:3300/0 conn(0x7f00100cc600 0x7f00100717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f000e800640 1 -- 172.21.15.32:0/727699958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00100cc220 msgr2=0x7f00100ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:09.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f000e800640 1 --2- 172.21.15.32:0/727699958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00100cc220 0x7f00100ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f000e800640 1 -- 172.21.15.32:0/727699958 >> v2:172.21.15.171:3300/0 conn(0x7f00100cc600 msgr2=0x7f00100717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:09.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f000e800640 1 --2- 172.21.15.32:0/727699958 >> v2:172.21.15.171:3300/0 conn(0x7f00100cc600 0x7f00100717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f000e800640 1 -- 172.21.15.32:0/727699958 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00100724a0 con 0x7f0010161e10 2024-03-19T06:24:09.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f000de00640 1 --2- 172.21.15.32:0/727699958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00100cc220 0x7f00100ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:09.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f0007e00640 1 --2- 172.21.15.32:0/727699958 >> v2:172.21.15.171:3300/0 conn(0x7f00100cc600 0x7f00100717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:09.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.094+0000 7f000e800640 1 --2- 172.21.15.32:0/727699958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0010161e10 0x7f00100cd180 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f00100c9bb0 tx=0x7f000801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28971d190f92e129 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:09.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f000d400640 1 -- 172.21.15.32:0/727699958 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00080a56f0 con 0x7f0010161e10 2024-03-19T06:24:09.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f000d400640 1 -- 172.21.15.32:0/727699958 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00080a5890 con 0x7f0010161e10 2024-03-19T06:24:09.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f000d400640 1 -- 172.21.15.32:0/727699958 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00080a5c60 con 0x7f0010161e10 2024-03-19T06:24:09.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 -- 172.21.15.32:0/727699958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0010161e10 msgr2=0x7f00100cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 --2- 172.21.15.32:0/727699958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0010161e10 0x7f00100cd180 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f00100c9bb0 tx=0x7f000801c960 comp rx=0 tx=0).stop 2024-03-19T06:24:09.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 -- 172.21.15.32:0/727699958 shutdown_connections 2024-03-19T06:24:09.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 --2- 172.21.15.32:0/727699958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0010161e10 0x7f00100cd180 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 --2- 172.21.15.32:0/727699958 >> v2:172.21.15.171:3300/0 conn(0x7f00100cc600 0x7f00100717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 --2- 172.21.15.32:0/727699958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00100cc220 0x7f00100ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 -- 172.21.15.32:0/727699958 >> 172.21.15.32:0/727699958 conn(0x7f00100b1280 msgr2=0x7f00100b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:09.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 -- 172.21.15.32:0/727699958 shutdown_connections 2024-03-19T06:24:09.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 -- 172.21.15.32:0/727699958 wait complete. 2024-03-19T06:24:09.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 Processor -- start 2024-03-19T06:24:09.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 -- start start 2024-03-19T06:24:09.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00100cc220 0x7f001015df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00100cc600 0x7f00100b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0010161e10 0x7f00101444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00100c8c90 con 0x7f00100cc220 2024-03-19T06:24:09.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00100c8b10 con 0x7f00100cc600 2024-03-19T06:24:09.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f0015200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00100c8e10 con 0x7f0010161e10 2024-03-19T06:24:09.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f000de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00100cc220 0x7f001015df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f000de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00100cc220 0x7f001015df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49898/0 (socket says 172.21.15.32:49898) 2024-03-19T06:24:09.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.098+0000 7f000de00640 1 -- 172.21.15.32:0/4062657498 learned_addr learned my addr 172.21.15.32:0/4062657498 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:09.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f0007e00640 1 --2- 172.21.15.32:0/4062657498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00100cc600 0x7f00100b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f000e800640 1 --2- 172.21.15.32:0/4062657498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0010161e10 0x7f00101444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f000de00640 1 -- 172.21.15.32:0/4062657498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0010161e10 msgr2=0x7f00101444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f000de00640 1 --2- 172.21.15.32:0/4062657498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0010161e10 0x7f00101444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f000de00640 1 -- 172.21.15.32:0/4062657498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00100cc600 msgr2=0x7f00100b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f000de00640 1 --2- 172.21.15.32:0/4062657498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00100cc600 0x7f00100b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f000de00640 1 -- 172.21.15.32:0/4062657498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001015ea10 con 0x7f00100cc220 2024-03-19T06:24:09.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f000de00640 1 --2- 172.21.15.32:0/4062657498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00100cc220 0x7f001015df60 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f000000e840 tx=0x7f000000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:09.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f0006000640 1 -- 172.21.15.32:0/4062657498 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000017070 con 0x7f00100cc220 2024-03-19T06:24:09.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f0006000640 1 -- 172.21.15.32:0/4062657498 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000000c8d0 con 0x7f00100cc220 2024-03-19T06:24:09.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f0015200640 1 -- 172.21.15.32:0/4062657498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001015ef60 con 0x7f00100cc220 2024-03-19T06:24:09.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f0006000640 1 -- 172.21.15.32:0/4062657498 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000f040 con 0x7f00100cc220 2024-03-19T06:24:09.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f0015200640 1 -- 172.21.15.32:0/4062657498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001015ec80 con 0x7f00100cc220 2024-03-19T06:24:09.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f0015200640 1 -- 172.21.15.32:0/4062657498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00100749e0 con 0x7f00100cc220 2024-03-19T06:24:09.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f0006000640 1 -- 172.21.15.32:0/4062657498 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f000001a070 con 0x7f00100cc220 2024-03-19T06:24:09.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f0006000640 1 --2- 172.21.15.32:0/4062657498 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7effec067660 0x7effec069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.102+0000 7f0006000640 1 -- 172.21.15.32:0/4062657498 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f00000850e0 con 0x7f00100cc220 2024-03-19T06:24:09.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.106+0000 7f0007e00640 1 --2- 172.21.15.32:0/4062657498 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7effec067660 0x7effec069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.106+0000 7f0007e00640 1 --2- 172.21.15.32:0/4062657498 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7effec067660 0x7effec069b20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f001015c870 tx=0x7efff8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:09.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.106+0000 7f0006000640 1 -- 172.21.15.32:0/4062657498 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f0000055a00 con 0x7f00100cc220 2024-03-19T06:24:09.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.270+0000 7f0015200640 1 -- 172.21.15.32:0/4062657498 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f0010161410 con 0x7effec067660 2024-03-19T06:24:09.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.274+0000 7f0006000640 1 -- 172.21.15.32:0/4062657498 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0010161410 con 0x7effec067660 2024-03-19T06:24:09.261 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 0 to deep-scrub 2024-03-19T06:24:09.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.274+0000 7f0015200640 1 -- 172.21.15.32:0/4062657498 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7effec067660 msgr2=0x7effec069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.274+0000 7f0015200640 1 --2- 172.21.15.32:0/4062657498 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7effec067660 0x7effec069b20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f001015c870 tx=0x7efff8008040 comp rx=0 tx=0).stop 2024-03-19T06:24:09.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.274+0000 7f0015200640 1 -- 172.21.15.32:0/4062657498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00100cc220 msgr2=0x7f001015df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.274+0000 7f0015200640 1 --2- 172.21.15.32:0/4062657498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00100cc220 0x7f001015df60 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f000000e840 tx=0x7f000000ed00 comp rx=0 tx=0).stop 2024-03-19T06:24:09.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.274+0000 7f0015200640 1 -- 172.21.15.32:0/4062657498 shutdown_connections 2024-03-19T06:24:09.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.274+0000 7f0015200640 1 --2- 172.21.15.32:0/4062657498 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7effec067660 0x7effec069b20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.274+0000 7f0015200640 1 --2- 172.21.15.32:0/4062657498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0010161e10 0x7f00101444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.274+0000 7f0015200640 1 --2- 172.21.15.32:0/4062657498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00100cc600 0x7f00100b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.274+0000 7f0015200640 1 --2- 172.21.15.32:0/4062657498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f00100cc220 0x7f001015df60 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.274+0000 7f0015200640 1 -- 172.21.15.32:0/4062657498 >> 172.21.15.32:0/4062657498 conn(0x7f00100b1280 msgr2=0x7f00100aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:09.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.274+0000 7f0015200640 1 -- 172.21.15.32:0/4062657498 shutdown_connections 2024-03-19T06:24:09.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.274+0000 7f0015200640 1 -- 172.21.15.32:0/4062657498 wait complete. 2024-03-19T06:24:09.282 INFO:tasks.ceph:Scrubbing osd.1 2024-03-19T06:24:09.283 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-19T06:24:09.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.438+0000 7f7f2b800640 1 Processor -- start 2024-03-19T06:24:09.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.438+0000 7f7f2b800640 1 -- start start 2024-03-19T06:24:09.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.438+0000 7f7f2b800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7f241450a0 0x7f7f2406d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.438+0000 7f7f2b800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f24071ad0 0x7f7f2415c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.438+0000 7f7f2b800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f240af190 con 0x7f7f2406d960 2024-03-19T06:24:09.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.438+0000 7f7f2b800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2406df90 con 0x7f7f241450a0 2024-03-19T06:24:09.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.438+0000 7f7f2b800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2406e270 con 0x7f7f24071ad0 2024-03-19T06:24:09.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.438+0000 7f7f28e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7f241450a0 0x7f7f2406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.438+0000 7f7f28e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7f241450a0 0x7f7f2406d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49904/0 (socket says 172.21.15.32:49904) 2024-03-19T06:24:09.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.438+0000 7f7f28e00640 1 -- 172.21.15.32:0/2864392875 learned_addr learned my addr 172.21.15.32:0/2864392875 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:09.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.438+0000 7f7f1be00640 1 --1- 172.21.15.32:0/2864392875 >> v1:172.21.15.32:6789/0 conn(0x7f7f2406d960 0x7f7f240713c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:34762/0 (socket says 172.21.15.32:34762) 2024-03-19T06:24:09.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.442+0000 7f7f29800640 1 --2- 172.21.15.32:0/2864392875 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f24071ad0 0x7f7f2415c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.442+0000 7f7f28e00640 1 -- 172.21.15.32:0/2864392875 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f24071ad0 msgr2=0x7f7f2415c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:09.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.442+0000 7f7f28e00640 1 --2- 172.21.15.32:0/2864392875 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f24071ad0 0x7f7f2415c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.442+0000 7f7f28e00640 1 -- 172.21.15.32:0/2864392875 >> v1:172.21.15.32:6789/0 conn(0x7f7f2406d960 legacy=0x7f7f240713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.442+0000 7f7f28e00640 1 -- 172.21.15.32:0/2864392875 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2406e550 con 0x7f7f241450a0 2024-03-19T06:24:09.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.442+0000 7f7f28e00640 1 --2- 172.21.15.32:0/2864392875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f241450a0 0x7f7f2406d420 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009870 tx=0x7f7f1401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df305bc4c2f3cb5f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:09.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.442+0000 7f7f23e00640 1 -- 172.21.15.32:0/2864392875 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f140b1070 con 0x7f7f241450a0 2024-03-19T06:24:09.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.442+0000 7f7f23e00640 1 -- 172.21.15.32:0/2864392875 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f140ac410 con 0x7f7f241450a0 2024-03-19T06:24:09.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.442+0000 7f7f23e00640 1 -- 172.21.15.32:0/2864392875 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f140ac7e0 con 0x7f7f241450a0 2024-03-19T06:24:09.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.442+0000 7f7f2b800640 1 -- 172.21.15.32:0/2864392875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f241450a0 msgr2=0x7f7f2406d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.442+0000 7f7f2b800640 1 --2- 172.21.15.32:0/2864392875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f241450a0 0x7f7f2406d420 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009870 tx=0x7f7f1401c4a0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.442+0000 7f7f2b800640 1 -- 172.21.15.32:0/2864392875 shutdown_connections 2024-03-19T06:24:09.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.442+0000 7f7f2b800640 1 --2- 172.21.15.32:0/2864392875 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f24071ad0 0x7f7f2415c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.442+0000 7f7f2b800640 1 --2- 172.21.15.32:0/2864392875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f241450a0 0x7f7f2406d420 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.442+0000 7f7f2b800640 1 -- 172.21.15.32:0/2864392875 >> 172.21.15.32:0/2864392875 conn(0x7f7f240671f0 msgr2=0x7f7f2406ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:09.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.442+0000 7f7f2b800640 1 -- 172.21.15.32:0/2864392875 shutdown_connections 2024-03-19T06:24:09.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f2b800640 1 -- 172.21.15.32:0/2864392875 wait complete. 2024-03-19T06:24:09.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f2b800640 1 Processor -- start 2024-03-19T06:24:09.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f2b800640 1 -- start start 2024-03-19T06:24:09.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f2b800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f2406d960 0x7f7f240b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f2b800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f24071ad0 0x7f7f241f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f2b800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f241450a0 0x7f7f240aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f2b800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2415d1d0 con 0x7f7f2406d960 2024-03-19T06:24:09.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f2b800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2415d050 con 0x7f7f241450a0 2024-03-19T06:24:09.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f2b800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2415d350 con 0x7f7f24071ad0 2024-03-19T06:24:09.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f28e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f2406d960 0x7f7f240b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f28e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f2406d960 0x7f7f240b0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49918/0 (socket says 172.21.15.32:49918) 2024-03-19T06:24:09.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f28e00640 1 -- 172.21.15.32:0/1972024101 learned_addr learned my addr 172.21.15.32:0/1972024101 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:09.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f1be00640 1 --2- 172.21.15.32:0/1972024101 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f24071ad0 0x7f7f241f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f29800640 1 --2- 172.21.15.32:0/1972024101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f241450a0 0x7f7f240aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f28e00640 1 -- 172.21.15.32:0/1972024101 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f24071ad0 msgr2=0x7f7f241f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f28e00640 1 --2- 172.21.15.32:0/1972024101 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f24071ad0 0x7f7f241f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f28e00640 1 -- 172.21.15.32:0/1972024101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f241450a0 msgr2=0x7f7f240aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f28e00640 1 --2- 172.21.15.32:0/1972024101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f241450a0 0x7f7f240aa8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f28e00640 1 -- 172.21.15.32:0/1972024101 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f24142db0 con 0x7f7f2406d960 2024-03-19T06:24:09.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f29800640 1 --2- 172.21.15.32:0/1972024101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f241450a0 0x7f7f240aa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:24:09.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f1be00640 1 --2- 172.21.15.32:0/1972024101 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f24071ad0 0x7f7f241f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:24:09.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f28e00640 1 --2- 172.21.15.32:0/1972024101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f2406d960 0x7f7f240b0060 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7f1401a0d0 tx=0x7f7f14019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:09.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f21600640 1 -- 172.21.15.32:0/1972024101 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f140b1040 con 0x7f7f2406d960 2024-03-19T06:24:09.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f21600640 1 -- 172.21.15.32:0/1972024101 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f140ba070 con 0x7f7f2406d960 2024-03-19T06:24:09.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f2b800640 1 -- 172.21.15.32:0/1972024101 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f24143090 con 0x7f7f2406d960 2024-03-19T06:24:09.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f21600640 1 -- 172.21.15.32:0/1972024101 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f140b5440 con 0x7f7f2406d960 2024-03-19T06:24:09.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.446+0000 7f7f2b800640 1 -- 172.21.15.32:0/1972024101 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f24143650 con 0x7f7f2406d960 2024-03-19T06:24:09.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.450+0000 7f7f2b800640 1 -- 172.21.15.32:0/1972024101 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f240749e0 con 0x7f7f2406d960 2024-03-19T06:24:09.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.450+0000 7f7f21600640 1 -- 172.21.15.32:0/1972024101 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7f140b55e0 con 0x7f7f2406d960 2024-03-19T06:24:09.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.450+0000 7f7f21600640 1 --2- 172.21.15.32:0/1972024101 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7f00067660 0x7f7f00069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.450+0000 7f7f21600640 1 -- 172.21.15.32:0/1972024101 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7f1411faa0 con 0x7f7f2406d960 2024-03-19T06:24:09.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.450+0000 7f7f21600640 1 --2- 172.21.15.32:0/1972024101 >> [v2:172.21.15.32:6800/3354910175,v1:172.21.15.32:6801/3354910175] conn(0x7f7f0006d520 0x7f7f0006f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.450+0000 7f7f21600640 1 -- 172.21.15.32:0/1972024101 --> [v2:172.21.15.32:6800/3354910175,v1:172.21.15.32:6801/3354910175] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f140c8ec0 con 0x7f7f0006d520 2024-03-19T06:24:09.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.450+0000 7f7f21600640 1 -- 172.21.15.32:0/1972024101 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f1411ff30 con 0x7f7f2406d960 2024-03-19T06:24:09.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.450+0000 7f7f1be00640 1 --2- 172.21.15.32:0/1972024101 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7f00067660 0x7f7f00069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.450+0000 7f7f29800640 1 --2- 172.21.15.32:0/1972024101 >> [v2:172.21.15.32:6800/3354910175,v1:172.21.15.32:6801/3354910175] conn(0x7f7f0006d520 0x7f7f0006f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.450+0000 7f7f29800640 1 --2- 172.21.15.32:0/1972024101 >> [v2:172.21.15.32:6800/3354910175,v1:172.21.15.32:6801/3354910175] conn(0x7f7f0006d520 0x7f7f0006f940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:09.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.450+0000 7f7f1be00640 1 --2- 172.21.15.32:0/1972024101 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7f00067660 0x7f7f00069b20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7f24140fd0 tx=0x7f7f0c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:09.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.454+0000 7f7f21600640 1 -- 172.21.15.32:0/1972024101 <== osd.1 v2:172.21.15.32:6800/3354910175 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7f140c8ec0 con 0x7f7f0006d520 2024-03-19T06:24:09.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.466+0000 7f7f2b800640 1 -- 172.21.15.32:0/1972024101 --> [v2:172.21.15.32:6800/3354910175,v1:172.21.15.32:6801/3354910175] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7f24143890 con 0x7f7f0006d520 2024-03-19T06:24:09.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.466+0000 7f7f21600640 1 -- 172.21.15.32:0/1972024101 <== osd.1 v2:172.21.15.32:6800/3354910175 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7f24143890 con 0x7f7f0006d520 2024-03-19T06:24:09.455 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:24:09.455 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-19T06:24:09.455 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:24:09.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.466+0000 7f7f2b800640 1 -- 172.21.15.32:0/1972024101 >> [v2:172.21.15.32:6800/3354910175,v1:172.21.15.32:6801/3354910175] conn(0x7f7f0006d520 msgr2=0x7f7f0006f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.466+0000 7f7f2b800640 1 --2- 172.21.15.32:0/1972024101 >> [v2:172.21.15.32:6800/3354910175,v1:172.21.15.32:6801/3354910175] conn(0x7f7f0006d520 0x7f7f0006f940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.466+0000 7f7f2b800640 1 -- 172.21.15.32:0/1972024101 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7f00067660 msgr2=0x7f7f00069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.466+0000 7f7f2b800640 1 --2- 172.21.15.32:0/1972024101 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7f00067660 0x7f7f00069b20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7f24140fd0 tx=0x7f7f0c009040 comp rx=0 tx=0).stop 2024-03-19T06:24:09.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.466+0000 7f7f2b800640 1 -- 172.21.15.32:0/1972024101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f2406d960 msgr2=0x7f7f240b0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.466+0000 7f7f2b800640 1 --2- 172.21.15.32:0/1972024101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f2406d960 0x7f7f240b0060 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7f1401a0d0 tx=0x7f7f14019240 comp rx=0 tx=0).stop 2024-03-19T06:24:09.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.466+0000 7f7f29800640 1 -- 172.21.15.32:0/1972024101 reap_dead start 2024-03-19T06:24:09.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.466+0000 7f7f2b800640 1 -- 172.21.15.32:0/1972024101 shutdown_connections 2024-03-19T06:24:09.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.466+0000 7f7f2b800640 1 -- 172.21.15.32:0/1972024101 >> 172.21.15.32:0/1972024101 conn(0x7f7f240671f0 msgr2=0x7f7f24164fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:09.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.466+0000 7f7f2b800640 1 -- 172.21.15.32:0/1972024101 shutdown_connections 2024-03-19T06:24:09.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.466+0000 7f7f2b800640 1 -- 172.21.15.32:0/1972024101 wait complete. 2024-03-19T06:24:09.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-19T06:24:09.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.626+0000 7f19e7e00640 1 Processor -- start 2024-03-19T06:24:09.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.626+0000 7f19e7e00640 1 -- start start 2024-03-19T06:24:09.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.626+0000 7f19e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f19e815ba10 0x7f19e809a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.626+0000 7f19e7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f19e80cfbc0 0x7f19e80ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.626+0000 7f19e7e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e80d0190 con 0x7f19e80cd2e0 2024-03-19T06:24:09.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.626+0000 7f19e7e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e80cc2c0 con 0x7f19e80cfbc0 2024-03-19T06:24:09.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.626+0000 7f19e7e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e80cc5a0 con 0x7f19e815ba10 2024-03-19T06:24:09.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.626+0000 7f19dfe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f19e80cfbc0 0x7f19e80ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.626+0000 7f19e7400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f19e80cd2e0 0x7f19e806f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:34766/0 (socket says 172.21.15.32:34766) 2024-03-19T06:24:09.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.626+0000 7f19e7400640 1 -- 172.21.15.32:0/1108363041 learned_addr learned my addr 172.21.15.32:0/1108363041 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:24:09.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.626+0000 7f19e6a00640 1 --2- 172.21.15.32:0/1108363041 >> v2:172.21.15.171:3300/0 conn(0x7f19e815ba10 0x7f19e809a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.626+0000 7f19dfe00640 1 -- 172.21.15.32:0/1108363041 >> v2:172.21.15.171:3300/0 conn(0x7f19e815ba10 msgr2=0x7f19e809a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:09.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.626+0000 7f19dfe00640 1 --2- 172.21.15.32:0/1108363041 >> v2:172.21.15.171:3300/0 conn(0x7f19e815ba10 0x7f19e809a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.626+0000 7f19dfe00640 1 -- 172.21.15.32:0/1108363041 >> v1:172.21.15.32:6789/0 conn(0x7f19e80cd2e0 legacy=0x7f19e806f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.626+0000 7f19dfe00640 1 -- 172.21.15.32:0/1108363041 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e80cc880 con 0x7f19e80cfbc0 2024-03-19T06:24:09.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.626+0000 7f19e6000640 1 -- 172.21.15.32:0/1108363041 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546233353 0 0) 0x7f19e80d0190 con 0x7f19e80cd2e0 2024-03-19T06:24:09.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.630+0000 7f19dfe00640 1 --2- 172.21.15.32:0/1108363041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e80cfbc0 0x7f19e80ccda0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f19e809a730 tx=0x7f19d001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33ec0020c67df57 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:09.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.630+0000 7f19e6000640 1 -- 172.21.15.32:0/1108363041 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d00b1070 con 0x7f19e80cfbc0 2024-03-19T06:24:09.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.630+0000 7f19e6000640 1 -- 172.21.15.32:0/1108363041 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d00ac5f0 con 0x7f19e80cfbc0 2024-03-19T06:24:09.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.630+0000 7f19e6000640 1 -- 172.21.15.32:0/1108363041 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d00ac9c0 con 0x7f19e80cfbc0 2024-03-19T06:24:09.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.630+0000 7f19e7e00640 1 -- 172.21.15.32:0/1108363041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e80cfbc0 msgr2=0x7f19e80ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.630+0000 7f19e7e00640 1 --2- 172.21.15.32:0/1108363041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e80cfbc0 0x7f19e80ccda0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f19e809a730 tx=0x7f19d001c3f0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.630+0000 7f19e7e00640 1 -- 172.21.15.32:0/1108363041 shutdown_connections 2024-03-19T06:24:09.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.630+0000 7f19e7e00640 1 --2- 172.21.15.32:0/1108363041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e80cfbc0 0x7f19e80ccda0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.630+0000 7f19e7e00640 1 --2- 172.21.15.32:0/1108363041 >> v2:172.21.15.171:3300/0 conn(0x7f19e815ba10 0x7f19e809a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.630+0000 7f19e7e00640 1 -- 172.21.15.32:0/1108363041 >> 172.21.15.32:0/1108363041 conn(0x7f19e80b3100 msgr2=0x7f19e80b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:09.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.630+0000 7f19e7e00640 1 -- 172.21.15.32:0/1108363041 shutdown_connections 2024-03-19T06:24:09.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.630+0000 7f19e7e00640 1 -- 172.21.15.32:0/1108363041 wait complete. 2024-03-19T06:24:09.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19e7e00640 1 Processor -- start 2024-03-19T06:24:09.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19e7e00640 1 -- start start 2024-03-19T06:24:09.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19e7e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19e80cfbc0 0x7f19e80cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19e7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e815ba10 0x7f19e81468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19e8154310 0x7f19e81547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19e7e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e81688b0 con 0x7f19e815ba10 2024-03-19T06:24:09.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19e7e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8168730 con 0x7f19e80cfbc0 2024-03-19T06:24:09.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19e7e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8168a30 con 0x7f19e8154310 2024-03-19T06:24:09.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19dfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e815ba10 0x7f19e81468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19dfe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e815ba10 0x7f19e81468f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49928/0 (socket says 172.21.15.32:49928) 2024-03-19T06:24:09.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19dfe00640 1 -- 172.21.15.32:0/3086053959 learned_addr learned my addr 172.21.15.32:0/3086053959 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:09.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19e6a00640 1 --2- 172.21.15.32:0/3086053959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19e80cfbc0 0x7f19e80cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19e7400640 1 --2- 172.21.15.32:0/3086053959 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19e8154310 0x7f19e81547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19dfe00640 1 -- 172.21.15.32:0/3086053959 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19e8154310 msgr2=0x7f19e81547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19dfe00640 1 --2- 172.21.15.32:0/3086053959 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19e8154310 0x7f19e81547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19dfe00640 1 -- 172.21.15.32:0/3086053959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19e80cfbc0 msgr2=0x7f19e80cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19dfe00640 1 --2- 172.21.15.32:0/3086053959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19e80cfbc0 0x7f19e80cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19dfe00640 1 -- 172.21.15.32:0/3086053959 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e815ac20 con 0x7f19e815ba10 2024-03-19T06:24:09.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19dfe00640 1 --2- 172.21.15.32:0/3086053959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e815ba10 0x7f19e81468f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f19d001aaa0 tx=0x7f19d0019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:09.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19dea00640 1 -- 172.21.15.32:0/3086053959 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d00b9020 con 0x7f19e815ba10 2024-03-19T06:24:09.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19dea00640 1 -- 172.21.15.32:0/3086053959 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d00b5410 con 0x7f19e815ba10 2024-03-19T06:24:09.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19dea00640 1 -- 172.21.15.32:0/3086053959 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d00b1040 con 0x7f19e815ba10 2024-03-19T06:24:09.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19e7e00640 1 -- 172.21.15.32:0/3086053959 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e8154d00 con 0x7f19e815ba10 2024-03-19T06:24:09.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19e7e00640 1 -- 172.21.15.32:0/3086053959 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e80af9e0 con 0x7f19e815ba10 2024-03-19T06:24:09.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.634+0000 7f19e7e00640 1 -- 172.21.15.32:0/3086053959 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e8075090 con 0x7f19e815ba10 2024-03-19T06:24:09.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.638+0000 7f19dea00640 1 -- 172.21.15.32:0/3086053959 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f19d00bc020 con 0x7f19e815ba10 2024-03-19T06:24:09.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.638+0000 7f19dea00640 1 --2- 172.21.15.32:0/3086053959 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f19c4067690 0x7f19c4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.638+0000 7f19dea00640 1 -- 172.21.15.32:0/3086053959 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f19d011f1b0 con 0x7f19e815ba10 2024-03-19T06:24:09.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.638+0000 7f19e6a00640 1 --2- 172.21.15.32:0/3086053959 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f19c4067690 0x7f19c4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.638+0000 7f19e6a00640 1 --2- 172.21.15.32:0/3086053959 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f19c4067690 0x7f19c4069b50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f19d800b9d0 tx=0x7f19d8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:09.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.642+0000 7f19dea00640 1 -- 172.21.15.32:0/3086053959 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f19d00c3030 con 0x7f19e815ba10 2024-03-19T06:24:09.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.802+0000 7f19e7e00640 1 -- 172.21.15.32:0/3086053959 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f19e80afcc0 con 0x7f19c4067690 2024-03-19T06:24:09.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.802+0000 7f19dea00640 1 -- 172.21.15.32:0/3086053959 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f19e80afcc0 con 0x7f19c4067690 2024-03-19T06:24:09.793 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 1 to deep-scrub 2024-03-19T06:24:09.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.806+0000 7f19e7e00640 1 -- 172.21.15.32:0/3086053959 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f19c4067690 msgr2=0x7f19c4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.806+0000 7f19e7e00640 1 --2- 172.21.15.32:0/3086053959 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f19c4067690 0x7f19c4069b50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f19d800b9d0 tx=0x7f19d8008040 comp rx=0 tx=0).stop 2024-03-19T06:24:09.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.806+0000 7f19e7e00640 1 -- 172.21.15.32:0/3086053959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e815ba10 msgr2=0x7f19e81468f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.806+0000 7f19e7e00640 1 --2- 172.21.15.32:0/3086053959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e815ba10 0x7f19e81468f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f19d001aaa0 tx=0x7f19d0019190 comp rx=0 tx=0).stop 2024-03-19T06:24:09.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.806+0000 7f19e7e00640 1 -- 172.21.15.32:0/3086053959 shutdown_connections 2024-03-19T06:24:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.806+0000 7f19e7e00640 1 --2- 172.21.15.32:0/3086053959 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f19c4067690 0x7f19c4069b50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.806+0000 7f19e7e00640 1 --2- 172.21.15.32:0/3086053959 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19e8154310 0x7f19e81547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.806+0000 7f19e7e00640 1 --2- 172.21.15.32:0/3086053959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19e815ba10 0x7f19e81468f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.806+0000 7f19e7e00640 1 --2- 172.21.15.32:0/3086053959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19e80cfbc0 0x7f19e80cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.806+0000 7f19e7e00640 1 -- 172.21.15.32:0/3086053959 >> 172.21.15.32:0/3086053959 conn(0x7f19e80b3100 msgr2=0x7f19e806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.806+0000 7f19e7e00640 1 -- 172.21.15.32:0/3086053959 shutdown_connections 2024-03-19T06:24:09.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.806+0000 7f19e7e00640 1 -- 172.21.15.32:0/3086053959 wait complete. 2024-03-19T06:24:09.814 INFO:tasks.ceph:Scrubbing osd.2 2024-03-19T06:24:09.814 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-19T06:24:09.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.970+0000 7f432a600640 1 Processor -- start 2024-03-19T06:24:09.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.970+0000 7f432a600640 1 -- start start 2024-03-19T06:24:09.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.974+0000 7f432a600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f432406bd50 0x7f432415df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.974+0000 7f432a600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43240b2bc0 0x7f432406c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.974+0000 7f432a600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432406c670 con 0x7f4324161510 2024-03-19T06:24:09.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.974+0000 7f432a600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432415e500 con 0x7f432406bd50 2024-03-19T06:24:09.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.974+0000 7f432a600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432415e7e0 con 0x7f43240b2bc0 2024-03-19T06:24:09.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.974+0000 7f4323e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43240b2bc0 0x7f432406c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.974+0000 7f4329c00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f4324161510 0x7f4324161990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.32:56002/0 (socket says 172.21.15.32:56002) 2024-03-19T06:24:09.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.974+0000 7f4329c00640 1 -- 172.21.15.32:0/1842276627 learned_addr learned my addr 172.21.15.32:0/1842276627 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:24:09.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.974+0000 7f4323e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43240b2bc0 0x7f432406c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.32:42952/0 (socket says 172.21.15.32:42952) 2024-03-19T06:24:09.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.974+0000 7f4329200640 1 --2- 172.21.15.32:0/1842276627 >> v2:172.21.15.171:3300/0 conn(0x7f432406bd50 0x7f432415df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.974+0000 7f4323e00640 1 -- 172.21.15.32:0/1842276627 >> v2:172.21.15.171:3300/0 conn(0x7f432406bd50 msgr2=0x7f432415df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:09.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.974+0000 7f4323e00640 1 --2- 172.21.15.32:0/1842276627 >> v2:172.21.15.171:3300/0 conn(0x7f432406bd50 0x7f432415df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.974+0000 7f4323400640 1 -- 172.21.15.32:0/1842276627 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224084319 0 0) 0x7f432406c670 con 0x7f4324161510 2024-03-19T06:24:09.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.974+0000 7f4323e00640 1 -- 172.21.15.32:0/1842276627 >> v1:172.21.15.171:6789/0 conn(0x7f4324161510 legacy=0x7f4324161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.974+0000 7f4323e00640 1 -- 172.21.15.32:0/1842276627 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432415eac0 con 0x7f43240b2bc0 2024-03-19T06:24:09.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.978+0000 7f4323e00640 1 --2- 172.21.15.32:0/1842276627 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43240b2bc0 0x7f432406c130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43100097c0 tx=0x7f431001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=366d481aa77d63ef server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.978+0000 7f4323400640 1 -- 172.21.15.32:0/1842276627 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43100ab600 con 0x7f43240b2bc0 2024-03-19T06:24:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.978+0000 7f4323400640 1 -- 172.21.15.32:0/1842276627 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43100b0070 con 0x7f43240b2bc0 2024-03-19T06:24:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.978+0000 7f4323400640 1 -- 172.21.15.32:0/1842276627 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43100ab9c0 con 0x7f43240b2bc0 2024-03-19T06:24:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.978+0000 7f432a600640 1 -- 172.21.15.32:0/1842276627 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43240b2bc0 msgr2=0x7f432406c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.978+0000 7f432a600640 1 --2- 172.21.15.32:0/1842276627 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43240b2bc0 0x7f432406c130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43100097c0 tx=0x7f431001c3e0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.978+0000 7f432a600640 1 -- 172.21.15.32:0/1842276627 shutdown_connections 2024-03-19T06:24:09.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.978+0000 7f432a600640 1 --2- 172.21.15.32:0/1842276627 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43240b2bc0 0x7f432406c130 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.978+0000 7f432a600640 1 --2- 172.21.15.32:0/1842276627 >> v2:172.21.15.171:3300/0 conn(0x7f432406bd50 0x7f432415df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.978+0000 7f432a600640 1 -- 172.21.15.32:0/1842276627 >> 172.21.15.32:0/1842276627 conn(0x7f4324071930 msgr2=0x7f4324071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:09.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.978+0000 7f432a600640 1 -- 172.21.15.32:0/1842276627 shutdown_connections 2024-03-19T06:24:09.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.978+0000 7f432a600640 1 -- 172.21.15.32:0/1842276627 wait complete. 2024-03-19T06:24:09.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.978+0000 7f432a600640 1 Processor -- start 2024-03-19T06:24:09.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.978+0000 7f432a600640 1 -- start start 2024-03-19T06:24:09.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f432a600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f432406bd50 0x7f43240cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f432a600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43240b2bc0 0x7f4324151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f432a600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4324161510 0x7f432414ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f432a600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432416b240 con 0x7f432406bd50 2024-03-19T06:24:09.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f432a600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432416b0c0 con 0x7f43240b2bc0 2024-03-19T06:24:09.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f432a600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432416b3c0 con 0x7f4324161510 2024-03-19T06:24:09.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f4329200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f432406bd50 0x7f43240cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f4329200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f432406bd50 0x7f43240cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49940/0 (socket says 172.21.15.32:49940) 2024-03-19T06:24:09.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f4329200640 1 -- 172.21.15.32:0/1973958165 learned_addr learned my addr 172.21.15.32:0/1973958165 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:09.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f4323e00640 1 --2- 172.21.15.32:0/1973958165 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43240b2bc0 0x7f4324151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f4329c00640 1 --2- 172.21.15.32:0/1973958165 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4324161510 0x7f432414ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f4329200640 1 -- 172.21.15.32:0/1973958165 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4324161510 msgr2=0x7f432414ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f4329200640 1 --2- 172.21.15.32:0/1973958165 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4324161510 0x7f432414ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f4329200640 1 -- 172.21.15.32:0/1973958165 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43240b2bc0 msgr2=0x7f4324151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f4329200640 1 --2- 172.21.15.32:0/1973958165 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43240b2bc0 0x7f4324151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f4329200640 1 -- 172.21.15.32:0/1973958165 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43240cc600 con 0x7f432406bd50 2024-03-19T06:24:09.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f4329c00640 1 --2- 172.21.15.32:0/1973958165 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4324161510 0x7f432414ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:09.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f4329200640 1 --2- 172.21.15.32:0/1973958165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f432406bd50 0x7f43240cbf40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f431800e930 tx=0x7f431800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:09.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f4320c00640 1 -- 172.21.15.32:0/1973958165 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4318017070 con 0x7f432406bd50 2024-03-19T06:24:09.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f4320c00640 1 -- 172.21.15.32:0/1973958165 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431800ca00 con 0x7f432406bd50 2024-03-19T06:24:09.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f432a600640 1 -- 172.21.15.32:0/1973958165 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43240cc8e0 con 0x7f432406bd50 2024-03-19T06:24:09.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f4320c00640 1 -- 172.21.15.32:0/1973958165 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431800cdb0 con 0x7f432406bd50 2024-03-19T06:24:09.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f432a600640 1 -- 172.21.15.32:0/1973958165 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43240cd390 con 0x7f432406bd50 2024-03-19T06:24:09.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f432a600640 1 -- 172.21.15.32:0/1973958165 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f43240cce00 con 0x7f432406bd50 2024-03-19T06:24:09.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.982+0000 7f4320c00640 1 -- 172.21.15.32:0/1973958165 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f431801a070 con 0x7f432406bd50 2024-03-19T06:24:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.986+0000 7f4320c00640 1 --2- 172.21.15.32:0/1973958165 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4304067690 0x7f4304069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.986+0000 7f4320c00640 1 -- 172.21.15.32:0/1973958165 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4318085db0 con 0x7f432406bd50 2024-03-19T06:24:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.986+0000 7f4320c00640 1 --2- 172.21.15.32:0/1973958165 >> [v2:172.21.15.32:6824/1835843146,v1:172.21.15.32:6825/1835843146] conn(0x7f430406d550 0x7f430406f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.986+0000 7f4320c00640 1 -- 172.21.15.32:0/1973958165 --> [v2:172.21.15.32:6824/1835843146,v1:172.21.15.32:6825/1835843146] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4304070020 con 0x7f430406d550 2024-03-19T06:24:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.986+0000 7f4320c00640 1 -- 172.21.15.32:0/1973958165 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4318086160 con 0x7f432406bd50 2024-03-19T06:24:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.986+0000 7f4323e00640 1 --2- 172.21.15.32:0/1973958165 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4304067690 0x7f4304069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.986+0000 7f4329c00640 1 --2- 172.21.15.32:0/1973958165 >> [v2:172.21.15.32:6824/1835843146,v1:172.21.15.32:6825/1835843146] conn(0x7f430406d550 0x7f430406f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.986+0000 7f4329c00640 1 --2- 172.21.15.32:0/1973958165 >> [v2:172.21.15.32:6824/1835843146,v1:172.21.15.32:6825/1835843146] conn(0x7f430406d550 0x7f430406f970 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:09.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.986+0000 7f4323e00640 1 --2- 172.21.15.32:0/1973958165 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4304067690 0x7f4304069b50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f43100af000 tx=0x7f43100a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:09.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.986+0000 7f4320c00640 1 -- 172.21.15.32:0/1973958165 <== osd.2 v2:172.21.15.32:6824/1835843146 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4304070020 con 0x7f430406d550 2024-03-19T06:24:09.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:09.998+0000 7f432a600640 1 -- 172.21.15.32:0/1973958165 --> [v2:172.21.15.32:6824/1835843146,v1:172.21.15.32:6825/1835843146] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4324075090 con 0x7f430406d550 2024-03-19T06:24:09.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.002+0000 7f4320c00640 1 -- 172.21.15.32:0/1973958165 <== osd.2 v2:172.21.15.32:6824/1835843146 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4324075090 con 0x7f430406d550 2024-03-19T06:24:09.989 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:24:09.989 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-19T06:24:09.989 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:24:09.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.002+0000 7f432a600640 1 -- 172.21.15.32:0/1973958165 >> [v2:172.21.15.32:6824/1835843146,v1:172.21.15.32:6825/1835843146] conn(0x7f430406d550 msgr2=0x7f430406f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.002+0000 7f432a600640 1 --2- 172.21.15.32:0/1973958165 >> [v2:172.21.15.32:6824/1835843146,v1:172.21.15.32:6825/1835843146] conn(0x7f430406d550 0x7f430406f970 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.002+0000 7f432a600640 1 -- 172.21.15.32:0/1973958165 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4304067690 msgr2=0x7f4304069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.002+0000 7f432a600640 1 --2- 172.21.15.32:0/1973958165 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f4304067690 0x7f4304069b50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f43100af000 tx=0x7f43100a7000 comp rx=0 tx=0).stop 2024-03-19T06:24:09.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.002+0000 7f432a600640 1 -- 172.21.15.32:0/1973958165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f432406bd50 msgr2=0x7f43240cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:09.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.002+0000 7f432a600640 1 --2- 172.21.15.32:0/1973958165 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f432406bd50 0x7f43240cbf40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f431800e930 tx=0x7f431800edf0 comp rx=0 tx=0).stop 2024-03-19T06:24:09.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.002+0000 7f4329c00640 1 -- 172.21.15.32:0/1973958165 reap_dead start 2024-03-19T06:24:09.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.002+0000 7f432a600640 1 -- 172.21.15.32:0/1973958165 shutdown_connections 2024-03-19T06:24:09.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.002+0000 7f432a600640 1 -- 172.21.15.32:0/1973958165 >> 172.21.15.32:0/1973958165 conn(0x7f4324071930 msgr2=0x7f4324161950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:09.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.002+0000 7f432a600640 1 -- 172.21.15.32:0/1973958165 shutdown_connections 2024-03-19T06:24:09.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.002+0000 7f432a600640 1 -- 172.21.15.32:0/1973958165 wait complete. 2024-03-19T06:24:10.008 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-19T06:24:10.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fcef6a00640 1 Processor -- start 2024-03-19T06:24:10.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fcef6a00640 1 -- start start 2024-03-19T06:24:10.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fcef6a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef00cefe0 0x7fcef0072540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fcef6a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcef015cb80 0x7fcef00717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fcef6a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcef0071d30 0x7fcef015f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fcef6a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef006df10 con 0x7fcef0071d30 2024-03-19T06:24:10.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fcef6a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef0072a80 con 0x7fcef015cb80 2024-03-19T06:24:10.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fcef6a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef00cf3c0 con 0x7fcef00cefe0 2024-03-19T06:24:10.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fcef4a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcef0071d30 0x7fcef015f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fcef4a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcef0071d30 0x7fcef015f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49952/0 (socket says 172.21.15.32:49952) 2024-03-19T06:24:10.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fcef4a00640 1 -- 172.21.15.32:0/1085582336 learned_addr learned my addr 172.21.15.32:0/1085582336 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:10.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fceefe00640 1 --2- 172.21.15.32:0/1085582336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef00cefe0 0x7fcef0072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fceef400640 1 --2- 172.21.15.32:0/1085582336 >> v2:172.21.15.171:3300/0 conn(0x7fcef015cb80 0x7fcef00717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fcef4a00640 1 -- 172.21.15.32:0/1085582336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef00cefe0 msgr2=0x7fcef0072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:10.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fcef4a00640 1 --2- 172.21.15.32:0/1085582336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef00cefe0 0x7fcef0072540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fcef4a00640 1 -- 172.21.15.32:0/1085582336 >> v2:172.21.15.171:3300/0 conn(0x7fcef015cb80 msgr2=0x7fcef00717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:10.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fcef4a00640 1 --2- 172.21.15.32:0/1085582336 >> v2:172.21.15.171:3300/0 conn(0x7fcef015cb80 0x7fcef00717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.162+0000 7fcef4a00640 1 -- 172.21.15.32:0/1085582336 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef006dc30 con 0x7fcef0071d30 2024-03-19T06:24:10.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.166+0000 7fcef4a00640 1 --2- 172.21.15.32:0/1085582336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef0071d30 0x7fcef015f510 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fcef00714e0 tx=0x7fcee801c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce7cd4eb915e3b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:10.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.166+0000 7fceeea00640 1 -- 172.21.15.32:0/1085582336 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee80ac070 con 0x7fcef0071d30 2024-03-19T06:24:10.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.166+0000 7fceeea00640 1 -- 172.21.15.32:0/1085582336 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee80a8420 con 0x7fcef0071d30 2024-03-19T06:24:10.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.166+0000 7fceeea00640 1 -- 172.21.15.32:0/1085582336 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee80a87f0 con 0x7fcef0071d30 2024-03-19T06:24:10.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.166+0000 7fcef6a00640 1 -- 172.21.15.32:0/1085582336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef0071d30 msgr2=0x7fcef015f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.166+0000 7fcef6a00640 1 --2- 172.21.15.32:0/1085582336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef0071d30 0x7fcef015f510 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fcef00714e0 tx=0x7fcee801c730 comp rx=0 tx=0).stop 2024-03-19T06:24:10.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.166+0000 7fcef6a00640 1 -- 172.21.15.32:0/1085582336 shutdown_connections 2024-03-19T06:24:10.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.166+0000 7fcef6a00640 1 --2- 172.21.15.32:0/1085582336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef0071d30 0x7fcef015f510 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.166+0000 7fcef6a00640 1 --2- 172.21.15.32:0/1085582336 >> v2:172.21.15.171:3300/0 conn(0x7fcef015cb80 0x7fcef00717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.166+0000 7fcef6a00640 1 --2- 172.21.15.32:0/1085582336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef00cefe0 0x7fcef0072540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.166+0000 7fcef6a00640 1 -- 172.21.15.32:0/1085582336 >> 172.21.15.32:0/1085582336 conn(0x7fcef00cc490 msgr2=0x7fcef00cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:10.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.166+0000 7fcef6a00640 1 -- 172.21.15.32:0/1085582336 shutdown_connections 2024-03-19T06:24:10.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.166+0000 7fcef6a00640 1 -- 172.21.15.32:0/1085582336 wait complete. 2024-03-19T06:24:10.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef6a00640 1 Processor -- start 2024-03-19T06:24:10.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef6a00640 1 -- start start 2024-03-19T06:24:10.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef6a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef0071d30 0x7fcef0144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef6a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcef00cefe0 0x7fcef00b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef6a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef015cb80 0x7fcef00b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef6a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef006d850 con 0x7fcef015cb80 2024-03-19T06:24:10.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef6a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef006ee70 con 0x7fcef00cefe0 2024-03-19T06:24:10.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef6a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef006d9d0 con 0x7fcef0071d30 2024-03-19T06:24:10.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef4a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef015cb80 0x7fcef00b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef4a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef015cb80 0x7fcef00b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49960/0 (socket says 172.21.15.32:49960) 2024-03-19T06:24:10.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef4a00640 1 -- 172.21.15.32:0/2542711509 learned_addr learned my addr 172.21.15.32:0/2542711509 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:10.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fceef400640 1 --2- 172.21.15.32:0/2542711509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcef00cefe0 0x7fcef00b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fceefe00640 1 --2- 172.21.15.32:0/2542711509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef0071d30 0x7fcef0144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef4a00640 1 -- 172.21.15.32:0/2542711509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef0071d30 msgr2=0x7fcef0144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef4a00640 1 --2- 172.21.15.32:0/2542711509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef0071d30 0x7fcef0144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef4a00640 1 -- 172.21.15.32:0/2542711509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcef00cefe0 msgr2=0x7fcef00b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef4a00640 1 --2- 172.21.15.32:0/2542711509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcef00cefe0 0x7fcef00b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef4a00640 1 -- 172.21.15.32:0/2542711509 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef01448f0 con 0x7fcef015cb80 2024-03-19T06:24:10.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fceef400640 1 --2- 172.21.15.32:0/2542711509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcef00cefe0 0x7fcef00b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:24:10.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fceefe00640 1 --2- 172.21.15.32:0/2542711509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef0071d30 0x7fcef0144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:24:10.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef4a00640 1 --2- 172.21.15.32:0/2542711509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef015cb80 0x7fcef00b3b20 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fcee801ade0 tx=0x7fcee80194d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:10.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcee7e00640 1 -- 172.21.15.32:0/2542711509 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee80ac040 con 0x7fcef015cb80 2024-03-19T06:24:10.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcee7e00640 1 -- 172.21.15.32:0/2542711509 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee80bd670 con 0x7fcef015cb80 2024-03-19T06:24:10.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef6a00640 1 -- 172.21.15.32:0/2542711509 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef014c730 con 0x7fcef015cb80 2024-03-19T06:24:10.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcee7e00640 1 -- 172.21.15.32:0/2542711509 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8009510 con 0x7fcef015cb80 2024-03-19T06:24:10.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.170+0000 7fcef6a00640 1 -- 172.21.15.32:0/2542711509 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef015a9b0 con 0x7fcef015cb80 2024-03-19T06:24:10.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.174+0000 7fcef6a00640 1 -- 172.21.15.32:0/2542711509 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef0159910 con 0x7fcef015cb80 2024-03-19T06:24:10.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.174+0000 7fcee7e00640 1 -- 172.21.15.32:0/2542711509 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fcee80af070 con 0x7fcef015cb80 2024-03-19T06:24:10.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.174+0000 7fcee7e00640 1 --2- 172.21.15.32:0/2542711509 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fced0067660 0x7fced0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.174+0000 7fcee7e00640 1 -- 172.21.15.32:0/2542711509 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcee811ff90 con 0x7fcef015cb80 2024-03-19T06:24:10.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.174+0000 7fceefe00640 1 --2- 172.21.15.32:0/2542711509 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fced0067660 0x7fced0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.174+0000 7fceefe00640 1 --2- 172.21.15.32:0/2542711509 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fced0067660 0x7fced0069b20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcee0009840 tx=0x7fcee0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:10.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.178+0000 7fcee7e00640 1 -- 172.21.15.32:0/2542711509 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fcef0159910 con 0x7fcef015cb80 2024-03-19T06:24:10.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.342+0000 7fcef6a00640 1 -- 172.21.15.32:0/2542711509 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fcef00749e0 con 0x7fced0067660 2024-03-19T06:24:10.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.342+0000 7fcee7e00640 1 -- 172.21.15.32:0/2542711509 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcef00749e0 con 0x7fced0067660 2024-03-19T06:24:10.330 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 2 to deep-scrub 2024-03-19T06:24:10.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.342+0000 7fcef6a00640 1 -- 172.21.15.32:0/2542711509 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fced0067660 msgr2=0x7fced0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.342+0000 7fcef6a00640 1 --2- 172.21.15.32:0/2542711509 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fced0067660 0x7fced0069b20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcee0009840 tx=0x7fcee0008040 comp rx=0 tx=0).stop 2024-03-19T06:24:10.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.342+0000 7fcef6a00640 1 -- 172.21.15.32:0/2542711509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef015cb80 msgr2=0x7fcef00b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.342+0000 7fcef6a00640 1 --2- 172.21.15.32:0/2542711509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef015cb80 0x7fcef00b3b20 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fcee801ade0 tx=0x7fcee80194d0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.342+0000 7fcef6a00640 1 -- 172.21.15.32:0/2542711509 shutdown_connections 2024-03-19T06:24:10.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.342+0000 7fcef6a00640 1 --2- 172.21.15.32:0/2542711509 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fced0067660 0x7fced0069b20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.342+0000 7fcef6a00640 1 --2- 172.21.15.32:0/2542711509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcef015cb80 0x7fcef00b3b20 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.342+0000 7fcef6a00640 1 --2- 172.21.15.32:0/2542711509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcef00cefe0 0x7fcef00b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.342+0000 7fcef6a00640 1 --2- 172.21.15.32:0/2542711509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcef0071d30 0x7fcef0144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.342+0000 7fcef6a00640 1 -- 172.21.15.32:0/2542711509 >> 172.21.15.32:0/2542711509 conn(0x7fcef00cc490 msgr2=0x7fcef00cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:10.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.342+0000 7fcef6a00640 1 -- 172.21.15.32:0/2542711509 shutdown_connections 2024-03-19T06:24:10.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.342+0000 7fcef6a00640 1 -- 172.21.15.32:0/2542711509 wait complete. 2024-03-19T06:24:10.352 INFO:tasks.ceph:Scrubbing osd.3 2024-03-19T06:24:10.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-19T06:24:10.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.506+0000 7f7a69800640 1 Processor -- start 2024-03-19T06:24:10.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.506+0000 7f7a69800640 1 -- start start 2024-03-19T06:24:10.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a69800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6406bee0 0x7f7a640cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a69800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7a640ce770 0x7f7a6406c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a69800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a64161b70 con 0x7f7a6415dcb0 2024-03-19T06:24:10.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a69800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a6406c300 con 0x7f7a640ce770 2024-03-19T06:24:10.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a69800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a64161e50 con 0x7f7a6406bee0 2024-03-19T06:24:10.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62a00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7a6415dcb0 0x7f7a640ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:34782/0 (socket says 172.21.15.32:34782) 2024-03-19T06:24:10.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62a00640 1 -- 172.21.15.32:0/296437512 learned_addr learned my addr 172.21.15.32:0/296437512 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:24:10.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a63400640 1 --2- 172.21.15.32:0/296437512 >> v2:172.21.15.171:3300/0 conn(0x7f7a640ce770 0x7f7a6406c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a5be00640 1 --2- 172.21.15.32:0/296437512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6406bee0 0x7f7a640cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62000640 1 -- 172.21.15.32:0/296437512 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401351332 0 0) 0x7f7a64161b70 con 0x7f7a6415dcb0 2024-03-19T06:24:10.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62000640 1 -- 172.21.15.32:0/296437512 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a48003530 con 0x7f7a6415dcb0 2024-03-19T06:24:10.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62000640 1 -- 172.21.15.32:0/296437512 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4244005736 0 0) 0x7f7a48003530 con 0x7f7a6415dcb0 2024-03-19T06:24:10.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62000640 1 -- 172.21.15.32:0/296437512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6406bee0 msgr2=0x7f7a640cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:10.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62000640 1 --2- 172.21.15.32:0/296437512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6406bee0 0x7f7a640cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62000640 1 -- 172.21.15.32:0/296437512 >> v2:172.21.15.171:3300/0 conn(0x7f7a640ce770 msgr2=0x7f7a6406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:10.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62000640 1 --2- 172.21.15.32:0/296437512 >> v2:172.21.15.171:3300/0 conn(0x7f7a640ce770 0x7f7a6406c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62000640 1 -- 172.21.15.32:0/296437512 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a64162130 con 0x7f7a6415dcb0 2024-03-19T06:24:10.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62000640 1 -- 172.21.15.32:0/296437512 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f7a54001680 con 0x7f7a6415dcb0 2024-03-19T06:24:10.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62000640 1 -- 172.21.15.32:0/296437512 >> v1:172.21.15.32:6789/0 conn(0x7f7a6415dcb0 legacy=0x7f7a640ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62000640 1 --2- 172.21.15.32:0/296437512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a480039c0 0x7f7a48003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62000640 1 --2- 172.21.15.32:0/296437512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6406bee0 0x7f7a48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62000640 1 --2- 172.21.15.32:0/296437512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a48004d50 0x7f7a480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62000640 1 -- 172.21.15.32:0/296437512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6406c300 con 0x7f7a48004d50 2024-03-19T06:24:10.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62000640 1 -- 172.21.15.32:0/296437512 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a64161e50 con 0x7f7a480039c0 2024-03-19T06:24:10.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62000640 1 -- 172.21.15.32:0/296437512 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4800b9d0 con 0x7f7a6406bee0 2024-03-19T06:24:10.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a63400640 1 --2- 172.21.15.32:0/296437512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a48004d50 0x7f7a480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a5be00640 1 --2- 172.21.15.32:0/296437512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6406bee0 0x7f7a48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a62a00640 1 --2- 172.21.15.32:0/296437512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a480039c0 0x7f7a48003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a63400640 1 -- 172.21.15.32:0/296437512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6406bee0 msgr2=0x7f7a48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:10.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a63400640 1 --2- 172.21.15.32:0/296437512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6406bee0 0x7f7a48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a63400640 1 -- 172.21.15.32:0/296437512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a480039c0 msgr2=0x7f7a48003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:10.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a63400640 1 --2- 172.21.15.32:0/296437512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a480039c0 0x7f7a48003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.510+0000 7f7a63400640 1 -- 172.21.15.32:0/296437512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a48003530 con 0x7f7a48004d50 2024-03-19T06:24:10.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.514+0000 7f7a63400640 1 --2- 172.21.15.32:0/296437512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a48004d50 0x7f7a480051d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7a64071e80 tx=0x7f7a5c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1772f8c41c888e5c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:10.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.514+0000 7f7a62000640 1 -- 172.21.15.32:0/296437512 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c0b0070 con 0x7f7a48004d50 2024-03-19T06:24:10.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.514+0000 7f7a62000640 1 -- 172.21.15.32:0/296437512 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c0ab600 con 0x7f7a48004d50 2024-03-19T06:24:10.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.514+0000 7f7a62000640 1 -- 172.21.15.32:0/296437512 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c009c10 con 0x7f7a48004d50 2024-03-19T06:24:10.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.514+0000 7f7a69800640 1 -- 172.21.15.32:0/296437512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a48004d50 msgr2=0x7f7a480051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.514+0000 7f7a69800640 1 --2- 172.21.15.32:0/296437512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a48004d50 0x7f7a480051d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7a64071e80 tx=0x7f7a5c01c8d0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.514+0000 7f7a63400640 1 -- 172.21.15.32:0/296437512 reap_dead start 2024-03-19T06:24:10.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.514+0000 7f7a69800640 1 -- 172.21.15.32:0/296437512 shutdown_connections 2024-03-19T06:24:10.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.514+0000 7f7a69800640 1 -- 172.21.15.32:0/296437512 >> 172.21.15.32:0/296437512 conn(0x7f7a640b3410 msgr2=0x7f7a640b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:10.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.514+0000 7f7a69800640 1 -- 172.21.15.32:0/296437512 shutdown_connections 2024-03-19T06:24:10.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.514+0000 7f7a69800640 1 -- 172.21.15.32:0/296437512 wait complete. 2024-03-19T06:24:10.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a69800640 1 Processor -- start 2024-03-19T06:24:10.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a69800640 1 -- start start 2024-03-19T06:24:10.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a69800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a48004d50 0x7f7a6415eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a69800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a640b5480 0x7f7a6415a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a69800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a6414d5d0 0x7f7a641600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a69800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6406d060 con 0x7f7a6414d5d0 2024-03-19T06:24:10.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a69800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6406cee0 con 0x7f7a640b5480 2024-03-19T06:24:10.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a69800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6406d1e0 con 0x7f7a48004d50 2024-03-19T06:24:10.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a63400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a6414d5d0 0x7f7a641600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a63400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a6414d5d0 0x7f7a641600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49976/0 (socket says 172.21.15.32:49976) 2024-03-19T06:24:10.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a63400640 1 -- 172.21.15.32:0/2072334896 learned_addr learned my addr 172.21.15.32:0/2072334896 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:10.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a62a00640 1 --2- 172.21.15.32:0/2072334896 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a48004d50 0x7f7a6415eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a5be00640 1 --2- 172.21.15.32:0/2072334896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a640b5480 0x7f7a6415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a63400640 1 -- 172.21.15.32:0/2072334896 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a48004d50 msgr2=0x7f7a6415eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a63400640 1 --2- 172.21.15.32:0/2072334896 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a48004d50 0x7f7a6415eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a63400640 1 -- 172.21.15.32:0/2072334896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a640b5480 msgr2=0x7f7a6415a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a63400640 1 --2- 172.21.15.32:0/2072334896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a640b5480 0x7f7a6415a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a63400640 1 -- 172.21.15.32:0/2072334896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6406c9e0 con 0x7f7a6414d5d0 2024-03-19T06:24:10.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a62a00640 1 --2- 172.21.15.32:0/2072334896 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a48004d50 0x7f7a6415eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:10.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a5be00640 1 --2- 172.21.15.32:0/2072334896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a640b5480 0x7f7a6415a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:10.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a63400640 1 --2- 172.21.15.32:0/2072334896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a6414d5d0 0x7f7a641600d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0ae040 tx=0x7f7a5c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:10.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a5aa00640 1 -- 172.21.15.32:0/2072334896 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c0b0040 con 0x7f7a6414d5d0 2024-03-19T06:24:10.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a5aa00640 1 -- 172.21.15.32:0/2072334896 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c0bd070 con 0x7f7a6414d5d0 2024-03-19T06:24:10.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a5aa00640 1 -- 172.21.15.32:0/2072334896 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c0a4e60 con 0x7f7a6414d5d0 2024-03-19T06:24:10.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a69800640 1 -- 172.21.15.32:0/2072334896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a6415f080 con 0x7f7a6414d5d0 2024-03-19T06:24:10.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a69800640 1 -- 172.21.15.32:0/2072334896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a64157ed0 con 0x7f7a6414d5d0 2024-03-19T06:24:10.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.518+0000 7f7a69800640 1 -- 172.21.15.32:0/2072334896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7a6415f5a0 con 0x7f7a6414d5d0 2024-03-19T06:24:10.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.522+0000 7f7a5aa00640 1 -- 172.21.15.32:0/2072334896 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7a5c0acca0 con 0x7f7a6414d5d0 2024-03-19T06:24:10.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.522+0000 7f7a5aa00640 1 --2- 172.21.15.32:0/2072334896 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7a40067660 0x7f7a40069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.522+0000 7f7a5aa00640 1 -- 172.21.15.32:0/2072334896 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7a5c11f7e0 con 0x7f7a6414d5d0 2024-03-19T06:24:10.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.522+0000 7f7a5aa00640 1 --2- 172.21.15.32:0/2072334896 >> [v2:172.21.15.32:6816/3701174485,v1:172.21.15.32:6817/3701174485] conn(0x7f7a4006d520 0x7f7a4006f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.522+0000 7f7a5aa00640 1 -- 172.21.15.32:0/2072334896 --> [v2:172.21.15.32:6816/3701174485,v1:172.21.15.32:6817/3701174485] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a4006fff0 con 0x7f7a4006d520 2024-03-19T06:24:10.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.522+0000 7f7a5aa00640 1 -- 172.21.15.32:0/2072334896 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a5c126050 con 0x7f7a6414d5d0 2024-03-19T06:24:10.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.522+0000 7f7a62a00640 1 --2- 172.21.15.32:0/2072334896 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7a40067660 0x7f7a40069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.522+0000 7f7a5be00640 1 --2- 172.21.15.32:0/2072334896 >> [v2:172.21.15.32:6816/3701174485,v1:172.21.15.32:6817/3701174485] conn(0x7f7a4006d520 0x7f7a4006f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.522+0000 7f7a5be00640 1 --2- 172.21.15.32:0/2072334896 >> [v2:172.21.15.32:6816/3701174485,v1:172.21.15.32:6817/3701174485] conn(0x7f7a4006d520 0x7f7a4006f940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:10.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.522+0000 7f7a62a00640 1 --2- 172.21.15.32:0/2072334896 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7a40067660 0x7f7a40069b20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7a54000c10 tx=0x7f7a54009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:10.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.522+0000 7f7a5aa00640 1 -- 172.21.15.32:0/2072334896 <== osd.3 v2:172.21.15.32:6816/3701174485 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7a4006fff0 con 0x7f7a4006d520 2024-03-19T06:24:10.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.538+0000 7f7a69800640 1 -- 172.21.15.32:0/2072334896 --> [v2:172.21.15.32:6816/3701174485,v1:172.21.15.32:6817/3701174485] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7a640749e0 con 0x7f7a4006d520 2024-03-19T06:24:10.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.538+0000 7f7a5aa00640 1 -- 172.21.15.32:0/2072334896 <== osd.3 v2:172.21.15.32:6816/3701174485 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7a640749e0 con 0x7f7a4006d520 2024-03-19T06:24:10.526 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:24:10.528 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-19T06:24:10.528 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:24:10.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.538+0000 7f7a69800640 1 -- 172.21.15.32:0/2072334896 >> [v2:172.21.15.32:6816/3701174485,v1:172.21.15.32:6817/3701174485] conn(0x7f7a4006d520 msgr2=0x7f7a4006f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.538+0000 7f7a69800640 1 --2- 172.21.15.32:0/2072334896 >> [v2:172.21.15.32:6816/3701174485,v1:172.21.15.32:6817/3701174485] conn(0x7f7a4006d520 0x7f7a4006f940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.538+0000 7f7a69800640 1 -- 172.21.15.32:0/2072334896 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7a40067660 msgr2=0x7f7a40069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.538+0000 7f7a69800640 1 --2- 172.21.15.32:0/2072334896 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7a40067660 0x7f7a40069b20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7a54000c10 tx=0x7f7a54009040 comp rx=0 tx=0).stop 2024-03-19T06:24:10.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.538+0000 7f7a69800640 1 -- 172.21.15.32:0/2072334896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a6414d5d0 msgr2=0x7f7a641600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.538+0000 7f7a69800640 1 --2- 172.21.15.32:0/2072334896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a6414d5d0 0x7f7a641600d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0ae040 tx=0x7f7a5c009750 comp rx=0 tx=0).stop 2024-03-19T06:24:10.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.538+0000 7f7a63400640 1 -- 172.21.15.32:0/2072334896 reap_dead start 2024-03-19T06:24:10.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.538+0000 7f7a69800640 1 -- 172.21.15.32:0/2072334896 shutdown_connections 2024-03-19T06:24:10.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.538+0000 7f7a69800640 1 -- 172.21.15.32:0/2072334896 >> 172.21.15.32:0/2072334896 conn(0x7f7a640b3410 msgr2=0x7f7a640cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:10.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.538+0000 7f7a69800640 1 -- 172.21.15.32:0/2072334896 shutdown_connections 2024-03-19T06:24:10.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.538+0000 7f7a69800640 1 -- 172.21.15.32:0/2072334896 wait complete. 2024-03-19T06:24:10.545 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-19T06:24:10.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.698+0000 7f86a5200640 1 Processor -- start 2024-03-19T06:24:10.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.698+0000 7f86a5200640 1 -- start start 2024-03-19T06:24:10.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f86a5200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f86a015a7c0 0x7f86a00cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f86a5200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86a00cc680 0x7f86a015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f86a5200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f86a00b4c50 0x7f86a00b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f86a5200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a015e860 con 0x7f86a00b4c50 2024-03-19T06:24:10.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f86a5200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a00cb670 con 0x7f86a015a7c0 2024-03-19T06:24:10.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f86a5200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00cb950 con 0x7f86a00cc680 2024-03-19T06:24:10.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f869e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f86a00b4c50 0x7f86a00b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f869e800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f86a00b4c50 0x7f86a00b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49986/0 (socket says 172.21.15.32:49986) 2024-03-19T06:24:10.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f869e800640 1 -- 172.21.15.32:0/3778453287 learned_addr learned my addr 172.21.15.32:0/3778453287 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:10.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f869e800640 1 -- 172.21.15.32:0/3778453287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86a00cc680 msgr2=0x7f86a015ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:10.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f869e800640 1 --2- 172.21.15.32:0/3778453287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86a00cc680 0x7f86a015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f869de00640 1 --2- 172.21.15.32:0/3778453287 >> v2:172.21.15.171:3300/0 conn(0x7f86a015a7c0 0x7f86a00cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f869e800640 1 -- 172.21.15.32:0/3778453287 >> v2:172.21.15.171:3300/0 conn(0x7f86a015a7c0 msgr2=0x7f86a00cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:10.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f869e800640 1 --2- 172.21.15.32:0/3778453287 >> v2:172.21.15.171:3300/0 conn(0x7f86a015a7c0 0x7f86a00cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f869e800640 1 -- 172.21.15.32:0/3778453287 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a015e4f0 con 0x7f86a00b4c50 2024-03-19T06:24:10.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f869de00640 1 --2- 172.21.15.32:0/3778453287 >> v2:172.21.15.171:3300/0 conn(0x7f86a015a7c0 0x7f86a00cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:24:10.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f869e800640 1 --2- 172.21.15.32:0/3778453287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86a00b4c50 0x7f86a00b50e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f86a00d06b0 tx=0x7f869801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8d9baa779a0d62 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:10.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.702+0000 7f869d400640 1 -- 172.21.15.32:0/3778453287 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869800b2d0 con 0x7f86a00b4c50 2024-03-19T06:24:10.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f869d400640 1 -- 172.21.15.32:0/3778453287 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869800b470 con 0x7f86a00b4c50 2024-03-19T06:24:10.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f869d400640 1 -- 172.21.15.32:0/3778453287 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86980a7b20 con 0x7f86a00b4c50 2024-03-19T06:24:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 -- 172.21.15.32:0/3778453287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86a00b4c50 msgr2=0x7f86a00b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 --2- 172.21.15.32:0/3778453287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86a00b4c50 0x7f86a00b50e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f86a00d06b0 tx=0x7f869801eb60 comp rx=0 tx=0).stop 2024-03-19T06:24:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 -- 172.21.15.32:0/3778453287 shutdown_connections 2024-03-19T06:24:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 --2- 172.21.15.32:0/3778453287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86a00b4c50 0x7f86a00b50e0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 --2- 172.21.15.32:0/3778453287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86a00cc680 0x7f86a015ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 --2- 172.21.15.32:0/3778453287 >> v2:172.21.15.171:3300/0 conn(0x7f86a015a7c0 0x7f86a00cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 -- 172.21.15.32:0/3778453287 >> 172.21.15.32:0/3778453287 conn(0x7f86a00b1280 msgr2=0x7f86a00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:10.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 -- 172.21.15.32:0/3778453287 shutdown_connections 2024-03-19T06:24:10.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 -- 172.21.15.32:0/3778453287 wait complete. 2024-03-19T06:24:10.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 Processor -- start 2024-03-19T06:24:10.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 -- start start 2024-03-19T06:24:10.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86a00b4c50 0x7f86a00ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86a00cc680 0x7f86a01574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86a015a7c0 0x7f86a00aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00cbdb0 con 0x7f86a00b4c50 2024-03-19T06:24:10.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00cbc30 con 0x7f86a00cc680 2024-03-19T06:24:10.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f86a5200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00c9c00 con 0x7f86a015a7c0 2024-03-19T06:24:10.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f869de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86a00b4c50 0x7f86a00ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f869de00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86a00b4c50 0x7f86a00ac330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50002/0 (socket says 172.21.15.32:50002) 2024-03-19T06:24:10.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.706+0000 7f869de00640 1 -- 172.21.15.32:0/3889751542 learned_addr learned my addr 172.21.15.32:0/3889751542 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:10.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.710+0000 7f869de00640 1 -- 172.21.15.32:0/3889751542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86a015a7c0 msgr2=0x7f86a00aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.710+0000 7f869de00640 1 --2- 172.21.15.32:0/3889751542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86a015a7c0 0x7f86a00aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.710+0000 7f869de00640 1 -- 172.21.15.32:0/3889751542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86a00cc680 msgr2=0x7f86a01574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.710+0000 7f869de00640 1 --2- 172.21.15.32:0/3889751542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86a00cc680 0x7f86a01574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.710+0000 7f869de00640 1 -- 172.21.15.32:0/3889751542 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a00c9980 con 0x7f86a00b4c50 2024-03-19T06:24:10.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.710+0000 7f869de00640 1 --2- 172.21.15.32:0/3889751542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86a00b4c50 0x7f86a00ac330 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f869000c7f0 tx=0x7f869000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:10.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.710+0000 7f8696000640 1 -- 172.21.15.32:0/3889751542 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690015070 con 0x7f86a00b4c50 2024-03-19T06:24:10.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.710+0000 7f8696000640 1 -- 172.21.15.32:0/3889751542 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8690007820 con 0x7f86a00b4c50 2024-03-19T06:24:10.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.710+0000 7f8696000640 1 -- 172.21.15.32:0/3889751542 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690007c10 con 0x7f86a00b4c50 2024-03-19T06:24:10.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.710+0000 7f86a5200640 1 -- 172.21.15.32:0/3889751542 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a00aadd0 con 0x7f86a00b4c50 2024-03-19T06:24:10.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.710+0000 7f86a5200640 1 -- 172.21.15.32:0/3889751542 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a015dc90 con 0x7f86a00b4c50 2024-03-19T06:24:10.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.710+0000 7f86a5200640 1 -- 172.21.15.32:0/3889751542 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a00749e0 con 0x7f86a00b4c50 2024-03-19T06:24:10.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.710+0000 7f8696000640 1 -- 172.21.15.32:0/3889751542 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8690018070 con 0x7f86a00b4c50 2024-03-19T06:24:10.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.710+0000 7f8696000640 1 --2- 172.21.15.32:0/3889751542 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f867c067660 0x7f867c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:10.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.710+0000 7f8696000640 1 -- 172.21.15.32:0/3889751542 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f86900856a0 con 0x7f86a00b4c50 2024-03-19T06:24:10.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.714+0000 7f8697e00640 1 --2- 172.21.15.32:0/3889751542 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f867c067660 0x7f867c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:10.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.714+0000 7f8697e00640 1 --2- 172.21.15.32:0/3889751542 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f867c067660 0x7f867c069b20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f86a00c9070 tx=0x7f8688006ca0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:10.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.714+0000 7f8696000640 1 -- 172.21.15.32:0/3889751542 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f8690056620 con 0x7f86a00b4c50 2024-03-19T06:24:10.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.878+0000 7f86a5200640 1 -- 172.21.15.32:0/3889751542 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f86a00ce2d0 con 0x7f867c067660 2024-03-19T06:24:10.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.882+0000 7f8696000640 1 -- 172.21.15.32:0/3889751542 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f86a00ce2d0 con 0x7f867c067660 2024-03-19T06:24:10.869 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 3 to deep-scrub 2024-03-19T06:24:10.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.882+0000 7f86a5200640 1 -- 172.21.15.32:0/3889751542 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f867c067660 msgr2=0x7f867c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.882+0000 7f86a5200640 1 --2- 172.21.15.32:0/3889751542 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f867c067660 0x7f867c069b20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f86a00c9070 tx=0x7f8688006ca0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.882+0000 7f86a5200640 1 -- 172.21.15.32:0/3889751542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86a00b4c50 msgr2=0x7f86a00ac330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:10.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.882+0000 7f86a5200640 1 --2- 172.21.15.32:0/3889751542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86a00b4c50 0x7f86a00ac330 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f869000c7f0 tx=0x7f869000ccb0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.882+0000 7f86a5200640 1 -- 172.21.15.32:0/3889751542 shutdown_connections 2024-03-19T06:24:10.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.882+0000 7f86a5200640 1 --2- 172.21.15.32:0/3889751542 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f867c067660 0x7f867c069b20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.882+0000 7f86a5200640 1 --2- 172.21.15.32:0/3889751542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86a015a7c0 0x7f86a00aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.882+0000 7f86a5200640 1 --2- 172.21.15.32:0/3889751542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86a00cc680 0x7f86a01574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.882+0000 7f86a5200640 1 --2- 172.21.15.32:0/3889751542 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86a00b4c50 0x7f86a00ac330 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:10.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.882+0000 7f86a5200640 1 -- 172.21.15.32:0/3889751542 >> 172.21.15.32:0/3889751542 conn(0x7f86a00b1280 msgr2=0x7f86a01597e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:10.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.882+0000 7f86a5200640 1 -- 172.21.15.32:0/3889751542 shutdown_connections 2024-03-19T06:24:10.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:10.882+0000 7f86a5200640 1 -- 172.21.15.32:0/3889751542 wait complete. 2024-03-19T06:24:10.891 INFO:tasks.ceph:Scrubbing osd.4 2024-03-19T06:24:10.891 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-19T06:24:11.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.046+0000 7f2181600640 1 Processor -- start 2024-03-19T06:24:11.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.046+0000 7f2181600640 1 -- start start 2024-03-19T06:24:11.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.046+0000 7f2181600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f217c15f3b0 0x7f217c15f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.046+0000 7f2181600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f217c1520a0 0x7f217c152510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.046+0000 7f2181600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f217c0aeb70 con 0x7f217c0cf810 2024-03-19T06:24:11.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.046+0000 7f2181600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f217c0aef90 con 0x7f217c1520a0 2024-03-19T06:24:11.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.046+0000 7f2181600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217c15fd30 con 0x7f217c15f3b0 2024-03-19T06:24:11.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.046+0000 7f217aa00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f217c0cf810 0x7f217c0ae460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:34792/0 (socket says 172.21.15.32:34792) 2024-03-19T06:24:11.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.046+0000 7f217aa00640 1 -- 172.21.15.32:0/708079109 learned_addr learned my addr 172.21.15.32:0/708079109 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:24:11.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f2173e00640 1 --2- 172.21.15.32:0/708079109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f217c15f3b0 0x7f217c15f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217b400640 1 --2- 172.21.15.32:0/708079109 >> v2:172.21.15.171:3300/0 conn(0x7f217c1520a0 0x7f217c152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217a000640 1 -- 172.21.15.32:0/708079109 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493784186 0 0) 0x7f217c0aeb70 con 0x7f217c0cf810 2024-03-19T06:24:11.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217a000640 1 -- 172.21.15.32:0/708079109 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2160003530 con 0x7f217c0cf810 2024-03-19T06:24:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217a000640 1 -- 172.21.15.32:0/708079109 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3673807938 0 0) 0x7f2160003530 con 0x7f217c0cf810 2024-03-19T06:24:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217a000640 1 -- 172.21.15.32:0/708079109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f217c15f3b0 msgr2=0x7f217c15f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217a000640 1 --2- 172.21.15.32:0/708079109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f217c15f3b0 0x7f217c15f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217a000640 1 -- 172.21.15.32:0/708079109 >> v2:172.21.15.171:3300/0 conn(0x7f217c1520a0 msgr2=0x7f217c152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217a000640 1 --2- 172.21.15.32:0/708079109 >> v2:172.21.15.171:3300/0 conn(0x7f217c1520a0 0x7f217c152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217a000640 1 -- 172.21.15.32:0/708079109 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c0af700 con 0x7f217c0cf810 2024-03-19T06:24:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217a000640 1 -- 172.21.15.32:0/708079109 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f216c001680 con 0x7f217c0cf810 2024-03-19T06:24:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217b400640 1 --2- 172.21.15.32:0/708079109 >> v2:172.21.15.171:3300/0 conn(0x7f217c1520a0 0x7f217c152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:24:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217a000640 1 -- 172.21.15.32:0/708079109 >> v1:172.21.15.32:6789/0 conn(0x7f217c0cf810 legacy=0x7f217c0ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217a000640 1 --2- 172.21.15.32:0/708079109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21600039c0 0x7f2160003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217a000640 1 --2- 172.21.15.32:0/708079109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f217c15f3b0 0x7f2160004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217a000640 1 --2- 172.21.15.32:0/708079109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2160004d50 0x7f21600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217a000640 1 -- 172.21.15.32:0/708079109 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c0aef90 con 0x7f21600039c0 2024-03-19T06:24:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217a000640 1 -- 172.21.15.32:0/708079109 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c15fd30 con 0x7f2160004d50 2024-03-19T06:24:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217a000640 1 -- 172.21.15.32:0/708079109 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216000b9d0 con 0x7f217c15f3b0 2024-03-19T06:24:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217aa00640 1 --2- 172.21.15.32:0/708079109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21600039c0 0x7f2160003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f2173e00640 1 --2- 172.21.15.32:0/708079109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f217c15f3b0 0x7f2160004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217b400640 1 --2- 172.21.15.32:0/708079109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2160004d50 0x7f21600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217aa00640 1 -- 172.21.15.32:0/708079109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f217c15f3b0 msgr2=0x7f2160004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:11.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217aa00640 1 --2- 172.21.15.32:0/708079109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f217c15f3b0 0x7f2160004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217aa00640 1 -- 172.21.15.32:0/708079109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2160004d50 msgr2=0x7f21600051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:11.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217aa00640 1 --2- 172.21.15.32:0/708079109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2160004d50 0x7f21600051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217aa00640 1 -- 172.21.15.32:0/708079109 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160003530 con 0x7f21600039c0 2024-03-19T06:24:11.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f217b400640 1 --2- 172.21.15.32:0/708079109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2160004d50 0x7f21600051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:11.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.050+0000 7f2173e00640 1 --2- 172.21.15.32:0/708079109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f217c15f3b0 0x7f2160004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:11.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f217aa00640 1 --2- 172.21.15.32:0/708079109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21600039c0 0x7f2160003de0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c270 tx=0x7f216c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b57550d77c5d248 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:11.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f217a000640 1 -- 172.21.15.32:0/708079109 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c007d60 con 0x7f21600039c0 2024-03-19T06:24:11.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f217a000640 1 -- 172.21.15.32:0/708079109 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c0a9020 con 0x7f21600039c0 2024-03-19T06:24:11.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f217a000640 1 -- 172.21.15.32:0/708079109 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c005ae0 con 0x7f21600039c0 2024-03-19T06:24:11.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f2181600640 1 -- 172.21.15.32:0/708079109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21600039c0 msgr2=0x7f2160003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f2181600640 1 --2- 172.21.15.32:0/708079109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21600039c0 0x7f2160003de0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c270 tx=0x7f216c01ccc0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f217b400640 1 -- 172.21.15.32:0/708079109 reap_dead start 2024-03-19T06:24:11.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f2181600640 1 -- 172.21.15.32:0/708079109 shutdown_connections 2024-03-19T06:24:11.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f2181600640 1 -- 172.21.15.32:0/708079109 >> 172.21.15.32:0/708079109 conn(0x7f217c0d0450 msgr2=0x7f217c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:11.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f2181600640 1 -- 172.21.15.32:0/708079109 shutdown_connections 2024-03-19T06:24:11.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f2181600640 1 -- 172.21.15.32:0/708079109 wait complete. 2024-03-19T06:24:11.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f2181600640 1 Processor -- start 2024-03-19T06:24:11.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f2181600640 1 -- start start 2024-03-19T06:24:11.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f2181600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21600039c0 0x7f217c14ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f2181600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f217c0ae010 0x7f217c0ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f2181600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f217c09d200 0x7f217c09d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f2181600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c0af1e0 con 0x7f21600039c0 2024-03-19T06:24:11.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f2181600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c0cfbf0 con 0x7f217c0ae010 2024-03-19T06:24:11.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.054+0000 7f2181600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217c0703e0 con 0x7f217c09d200 2024-03-19T06:24:11.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f217aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21600039c0 0x7f217c14ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f217aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21600039c0 0x7f217c14ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50018/0 (socket says 172.21.15.32:50018) 2024-03-19T06:24:11.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f217aa00640 1 -- 172.21.15.32:0/3162487206 learned_addr learned my addr 172.21.15.32:0/3162487206 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:11.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f217aa00640 1 -- 172.21.15.32:0/3162487206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f217c09d200 msgr2=0x7f217c09d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f217aa00640 1 --2- 172.21.15.32:0/3162487206 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f217c09d200 0x7f217c09d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f217aa00640 1 -- 172.21.15.32:0/3162487206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f217c0ae010 msgr2=0x7f217c0ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f217aa00640 1 --2- 172.21.15.32:0/3162487206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f217c0ae010 0x7f217c0ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f217aa00640 1 -- 172.21.15.32:0/3162487206 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c099ba0 con 0x7f21600039c0 2024-03-19T06:24:11.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f217aa00640 1 --2- 172.21.15.32:0/3162487206 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21600039c0 0x7f217c14ebb0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c270 tx=0x7f2160005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:11.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f2172a00640 1 -- 172.21.15.32:0/3162487206 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c0a5a90 con 0x7f21600039c0 2024-03-19T06:24:11.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f2172a00640 1 -- 172.21.15.32:0/3162487206 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c0a5c30 con 0x7f21600039c0 2024-03-19T06:24:11.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f2172a00640 1 -- 172.21.15.32:0/3162487206 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c0047f0 con 0x7f21600039c0 2024-03-19T06:24:11.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f2181600640 1 -- 172.21.15.32:0/3162487206 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217c099e80 con 0x7f21600039c0 2024-03-19T06:24:11.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f2181600640 1 -- 172.21.15.32:0/3162487206 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217c09a440 con 0x7f21600039c0 2024-03-19T06:24:11.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f2181600640 1 -- 172.21.15.32:0/3162487206 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f217c0749e0 con 0x7f21600039c0 2024-03-19T06:24:11.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f2172a00640 1 -- 172.21.15.32:0/3162487206 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f216c004990 con 0x7f21600039c0 2024-03-19T06:24:11.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.058+0000 7f2172a00640 1 --2- 172.21.15.32:0/3162487206 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2158067660 0x7f2158069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.062+0000 7f2172a00640 1 -- 172.21.15.32:0/3162487206 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f216c11f3f0 con 0x7f21600039c0 2024-03-19T06:24:11.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.062+0000 7f2172a00640 1 --2- 172.21.15.32:0/3162487206 >> [v2:172.21.15.171:6800/2358501242,v1:172.21.15.171:6801/2358501242] conn(0x7f215806d520 0x7f215806f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.062+0000 7f2172a00640 1 -- 172.21.15.32:0/3162487206 --> [v2:172.21.15.171:6800/2358501242,v1:172.21.15.171:6801/2358501242] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f215806fff0 con 0x7f215806d520 2024-03-19T06:24:11.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.062+0000 7f2172a00640 1 -- 172.21.15.32:0/3162487206 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f216c126050 con 0x7f21600039c0 2024-03-19T06:24:11.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.062+0000 7f2173e00640 1 --2- 172.21.15.32:0/3162487206 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2158067660 0x7f2158069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.062+0000 7f217b400640 1 --2- 172.21.15.32:0/3162487206 >> [v2:172.21.15.171:6800/2358501242,v1:172.21.15.171:6801/2358501242] conn(0x7f215806d520 0x7f215806f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.062+0000 7f2173e00640 1 --2- 172.21.15.32:0/3162487206 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2158067660 0x7f2158069b20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f217c1f63f0 tx=0x7f2164008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:11.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.062+0000 7f217b400640 1 --2- 172.21.15.32:0/3162487206 >> [v2:172.21.15.171:6800/2358501242,v1:172.21.15.171:6801/2358501242] conn(0x7f215806d520 0x7f215806f940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:11.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.062+0000 7f2172a00640 1 -- 172.21.15.32:0/3162487206 <== osd.4 v2:172.21.15.171:6800/2358501242 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f215806fff0 con 0x7f215806d520 2024-03-19T06:24:11.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.074+0000 7f2181600640 1 -- 172.21.15.32:0/3162487206 --> [v2:172.21.15.171:6800/2358501242,v1:172.21.15.171:6801/2358501242] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f217c15a550 con 0x7f215806d520 2024-03-19T06:24:11.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.078+0000 7f2172a00640 1 -- 172.21.15.32:0/3162487206 <== osd.4 v2:172.21.15.171:6800/2358501242 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f217c15a550 con 0x7f215806d520 2024-03-19T06:24:11.065 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:24:11.065 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-19T06:24:11.065 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:24:11.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.078+0000 7f2181600640 1 -- 172.21.15.32:0/3162487206 >> [v2:172.21.15.171:6800/2358501242,v1:172.21.15.171:6801/2358501242] conn(0x7f215806d520 msgr2=0x7f215806f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.078+0000 7f2181600640 1 --2- 172.21.15.32:0/3162487206 >> [v2:172.21.15.171:6800/2358501242,v1:172.21.15.171:6801/2358501242] conn(0x7f215806d520 0x7f215806f940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.078+0000 7f2181600640 1 -- 172.21.15.32:0/3162487206 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2158067660 msgr2=0x7f2158069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.078+0000 7f2181600640 1 --2- 172.21.15.32:0/3162487206 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f2158067660 0x7f2158069b20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f217c1f63f0 tx=0x7f2164008040 comp rx=0 tx=0).stop 2024-03-19T06:24:11.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.078+0000 7f2181600640 1 -- 172.21.15.32:0/3162487206 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21600039c0 msgr2=0x7f217c14ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.078+0000 7f2181600640 1 --2- 172.21.15.32:0/3162487206 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f21600039c0 0x7f217c14ebb0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c270 tx=0x7f2160005840 comp rx=0 tx=0).stop 2024-03-19T06:24:11.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.078+0000 7f217b400640 1 -- 172.21.15.32:0/3162487206 reap_dead start 2024-03-19T06:24:11.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.078+0000 7f2181600640 1 -- 172.21.15.32:0/3162487206 shutdown_connections 2024-03-19T06:24:11.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.078+0000 7f2181600640 1 -- 172.21.15.32:0/3162487206 >> 172.21.15.32:0/3162487206 conn(0x7f217c0d0450 msgr2=0x7f217c1599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:11.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.078+0000 7f2181600640 1 -- 172.21.15.32:0/3162487206 shutdown_connections 2024-03-19T06:24:11.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.078+0000 7f2181600640 1 -- 172.21.15.32:0/3162487206 wait complete. 2024-03-19T06:24:11.084 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-19T06:24:11.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.238+0000 7f79e1600640 1 Processor -- start 2024-03-19T06:24:11.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.238+0000 7f79e1600640 1 -- start start 2024-03-19T06:24:11.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.238+0000 7f79e1600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f79dc0cc600 0x7f79dc0ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.238+0000 7f79e1600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79dc0717b0 0x7f79dc0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.238+0000 7f79e1600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc162520 con 0x7f79dc0cc220 2024-03-19T06:24:11.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.238+0000 7f79e1600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79dc1616a0 con 0x7f79dc0cc600 2024-03-19T06:24:11.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.238+0000 7f79e1600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc071ee0 con 0x7f79dc0717b0 2024-03-19T06:24:11.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.238+0000 7f79d2000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f79dc0cc600 0x7f79dc0ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.238+0000 7f79d2000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f79dc0cc600 0x7f79dc0ceff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50032/0 (socket says 172.21.15.32:50032) 2024-03-19T06:24:11.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.238+0000 7f79d2000640 1 -- 172.21.15.32:0/367085282 learned_addr learned my addr 172.21.15.32:0/367085282 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:11.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.238+0000 7f79db400640 1 --2- 172.21.15.32:0/367085282 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79dc0717b0 0x7f79dc0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.238+0000 7f79d2000640 1 -- 172.21.15.32:0/367085282 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79dc0717b0 msgr2=0x7f79dc0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:11.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.238+0000 7f79d2000640 1 --2- 172.21.15.32:0/367085282 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79dc0717b0 0x7f79dc0cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.238+0000 7f79d2000640 1 -- 172.21.15.32:0/367085282 >> v1:172.21.15.32:6789/0 conn(0x7f79dc0cc220 legacy=0x7f79dc161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.238+0000 7f79d2000640 1 -- 172.21.15.32:0/367085282 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc0721c0 con 0x7f79dc0cc600 2024-03-19T06:24:11.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.238+0000 7f79db400640 1 --2- 172.21.15.32:0/367085282 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79dc0717b0 0x7f79dc0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:24:11.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.242+0000 7f79d2000640 1 --2- 172.21.15.32:0/367085282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79dc0cc600 0x7f79dc0ceff0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009870 tx=0x7f79c401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6d17c01eb3d3ca server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:11.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.242+0000 7f79da000640 1 -- 172.21.15.32:0/367085282 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c40ab640 con 0x7f79dc0cc600 2024-03-19T06:24:11.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.242+0000 7f79da000640 1 -- 172.21.15.32:0/367085282 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c40b0070 con 0x7f79dc0cc600 2024-03-19T06:24:11.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.242+0000 7f79da000640 1 -- 172.21.15.32:0/367085282 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c40aba00 con 0x7f79dc0cc600 2024-03-19T06:24:11.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.242+0000 7f79e1600640 1 -- 172.21.15.32:0/367085282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79dc0cc600 msgr2=0x7f79dc0ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.242+0000 7f79e1600640 1 --2- 172.21.15.32:0/367085282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79dc0cc600 0x7f79dc0ceff0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009870 tx=0x7f79c401c530 comp rx=0 tx=0).stop 2024-03-19T06:24:11.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.242+0000 7f79e1600640 1 -- 172.21.15.32:0/367085282 shutdown_connections 2024-03-19T06:24:11.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.242+0000 7f79e1600640 1 --2- 172.21.15.32:0/367085282 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79dc0717b0 0x7f79dc0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.242+0000 7f79e1600640 1 --2- 172.21.15.32:0/367085282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79dc0cc600 0x7f79dc0ceff0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.242+0000 7f79e1600640 1 -- 172.21.15.32:0/367085282 >> 172.21.15.32:0/367085282 conn(0x7f79dc0b1280 msgr2=0x7f79dc0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:11.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.242+0000 7f79e1600640 1 -- 172.21.15.32:0/367085282 shutdown_connections 2024-03-19T06:24:11.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.242+0000 7f79e1600640 1 -- 172.21.15.32:0/367085282 wait complete. 2024-03-19T06:24:11.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79e1600640 1 Processor -- start 2024-03-19T06:24:11.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79e1600640 1 -- start start 2024-03-19T06:24:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79e1600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79dc0717b0 0x7f79dc13cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79e1600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79dc0cc220 0x7f79dc15d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79e1600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79dc0cc600 0x7f79dc06d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79e1600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc16abc0 con 0x7f79dc0cc600 2024-03-19T06:24:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79e1600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc16aa40 con 0x7f79dc0717b0 2024-03-19T06:24:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79e1600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc16ad40 con 0x7f79dc0cc220 2024-03-19T06:24:11.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79db400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79dc0cc600 0x7f79dc06d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79db400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79dc0cc600 0x7f79dc06d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50046/0 (socket says 172.21.15.32:50046) 2024-03-19T06:24:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79db400640 1 -- 172.21.15.32:0/113902215 learned_addr learned my addr 172.21.15.32:0/113902215 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79d2000640 1 --2- 172.21.15.32:0/113902215 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79dc0cc220 0x7f79dc15d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79daa00640 1 --2- 172.21.15.32:0/113902215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79dc0717b0 0x7f79dc13cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79db400640 1 -- 172.21.15.32:0/113902215 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79dc0cc220 msgr2=0x7f79dc15d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79db400640 1 --2- 172.21.15.32:0/113902215 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79dc0cc220 0x7f79dc15d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79db400640 1 -- 172.21.15.32:0/113902215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79dc0717b0 msgr2=0x7f79dc13cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79db400640 1 --2- 172.21.15.32:0/113902215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79dc0717b0 0x7f79dc13cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79db400640 1 -- 172.21.15.32:0/113902215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc13d200 con 0x7f79dc0cc600 2024-03-19T06:24:11.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79db400640 1 --2- 172.21.15.32:0/113902215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79dc0cc600 0x7f79dc06d610 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f79d400cd50 tx=0x7f79d400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:11.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79d3400640 1 -- 172.21.15.32:0/113902215 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d400f680 con 0x7f79dc0cc600 2024-03-19T06:24:11.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79d3400640 1 -- 172.21.15.32:0/113902215 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d400f840 con 0x7f79dc0cc600 2024-03-19T06:24:11.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79d3400640 1 -- 172.21.15.32:0/113902215 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d400fc30 con 0x7f79dc0cc600 2024-03-19T06:24:11.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79e1600640 1 -- 172.21.15.32:0/113902215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79dc13d4e0 con 0x7f79dc0cc600 2024-03-19T06:24:11.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.246+0000 7f79e1600640 1 -- 172.21.15.32:0/113902215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc13dd80 con 0x7f79dc0cc600 2024-03-19T06:24:11.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.250+0000 7f79e1600640 1 -- 172.21.15.32:0/113902215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79dc13d6b0 con 0x7f79dc0cc600 2024-03-19T06:24:11.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.250+0000 7f79d3400640 1 -- 172.21.15.32:0/113902215 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f79d400e3e0 con 0x7f79dc0cc600 2024-03-19T06:24:11.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.250+0000 7f79d3400640 1 --2- 172.21.15.32:0/113902215 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f79b8067660 0x7f79b8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.250+0000 7f79d3400640 1 -- 172.21.15.32:0/113902215 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f79d4086220 con 0x7f79dc0cc600 2024-03-19T06:24:11.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.250+0000 7f79daa00640 1 --2- 172.21.15.32:0/113902215 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f79b8067660 0x7f79b8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.250+0000 7f79daa00640 1 --2- 172.21.15.32:0/113902215 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f79b8067660 0x7f79b8069b20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f79cc001810 tx=0x7f79cc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:11.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.254+0000 7f79d3400640 1 -- 172.21.15.32:0/113902215 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f79d4014030 con 0x7f79dc0cc600 2024-03-19T06:24:11.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.414+0000 7f79e1600640 1 -- 172.21.15.32:0/113902215 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f79dc0749e0 con 0x7f79b8067660 2024-03-19T06:24:11.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.418+0000 7f79d3400640 1 -- 172.21.15.32:0/113902215 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f79dc0749e0 con 0x7f79b8067660 2024-03-19T06:24:11.405 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 4 to deep-scrub 2024-03-19T06:24:11.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.418+0000 7f79e1600640 1 -- 172.21.15.32:0/113902215 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f79b8067660 msgr2=0x7f79b8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.418+0000 7f79e1600640 1 --2- 172.21.15.32:0/113902215 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f79b8067660 0x7f79b8069b20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f79cc001810 tx=0x7f79cc009040 comp rx=0 tx=0).stop 2024-03-19T06:24:11.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.418+0000 7f79e1600640 1 -- 172.21.15.32:0/113902215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79dc0cc600 msgr2=0x7f79dc06d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.418+0000 7f79e1600640 1 --2- 172.21.15.32:0/113902215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79dc0cc600 0x7f79dc06d610 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f79d400cd50 tx=0x7f79d400a650 comp rx=0 tx=0).stop 2024-03-19T06:24:11.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.418+0000 7f79e1600640 1 -- 172.21.15.32:0/113902215 shutdown_connections 2024-03-19T06:24:11.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.418+0000 7f79e1600640 1 --2- 172.21.15.32:0/113902215 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f79b8067660 0x7f79b8069b20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.418+0000 7f79e1600640 1 --2- 172.21.15.32:0/113902215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79dc0cc600 0x7f79dc06d610 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.418+0000 7f79e1600640 1 --2- 172.21.15.32:0/113902215 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79dc0cc220 0x7f79dc15d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.418+0000 7f79e1600640 1 --2- 172.21.15.32:0/113902215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79dc0717b0 0x7f79dc13cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.418+0000 7f79e1600640 1 -- 172.21.15.32:0/113902215 >> 172.21.15.32:0/113902215 conn(0x7f79dc0b1280 msgr2=0x7f79dc074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:11.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.418+0000 7f79e1600640 1 -- 172.21.15.32:0/113902215 shutdown_connections 2024-03-19T06:24:11.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.418+0000 7f79e1600640 1 -- 172.21.15.32:0/113902215 wait complete. 2024-03-19T06:24:11.426 INFO:tasks.ceph:Scrubbing osd.5 2024-03-19T06:24:11.426 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-19T06:24:11.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.582+0000 7f349f200640 1 Processor -- start 2024-03-19T06:24:11.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.582+0000 7f349f200640 1 -- start start 2024-03-19T06:24:11.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.582+0000 7f349f200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34a00d0420 0x7f34a0099a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.582+0000 7f349f200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a00cf380 con 0x7f34a00b29e0 2024-03-19T06:24:11.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.582+0000 7f349f200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a00cf660 con 0x7f34a0099fb0 2024-03-19T06:24:11.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.582+0000 7f349f200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00cff90 con 0x7f34a00d0420 2024-03-19T06:24:11.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.582+0000 7f349de00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f34a00b29e0 0x7f34a00ccd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:34812/0 (socket says 172.21.15.32:34812) 2024-03-19T06:24:11.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.582+0000 7f349de00640 1 -- 172.21.15.32:0/4001339252 learned_addr learned my addr 172.21.15.32:0/4001339252 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:24:11.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.582+0000 7f3497e00640 1 --2- 172.21.15.32:0/4001339252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34a00d0420 0x7f34a0099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.586+0000 7f349d400640 1 -- 172.21.15.32:0/4001339252 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635008487 0 0) 0x7f34a00cf380 con 0x7f34a00b29e0 2024-03-19T06:24:11.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.586+0000 7f349d400640 1 -- 172.21.15.32:0/4001339252 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3484003530 con 0x7f34a00b29e0 2024-03-19T06:24:11.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.586+0000 7f349d400640 1 -- 172.21.15.32:0/4001339252 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29241642 0 0) 0x7f34a00cf660 con 0x7f34a0099fb0 2024-03-19T06:24:11.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.586+0000 7f349d400640 1 -- 172.21.15.32:0/4001339252 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34a00cf380 con 0x7f34a0099fb0 2024-03-19T06:24:11.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.586+0000 7f3497e00640 1 -- 172.21.15.32:0/4001339252 >> v1:172.21.15.171:6789/0 conn(0x7f34a0099fb0 legacy=0x7f34a00b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.586+0000 7f3497e00640 1 -- 172.21.15.32:0/4001339252 >> v1:172.21.15.32:6789/0 conn(0x7f34a00b29e0 legacy=0x7f34a00ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.586+0000 7f3497e00640 1 -- 172.21.15.32:0/4001339252 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a00cf940 con 0x7f34a00d0420 2024-03-19T06:24:11.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.586+0000 7f3497e00640 1 --2- 172.21.15.32:0/4001339252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34a00d0420 0x7f34a0099a70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f34880097f0 tx=0x7f348801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dbe24d385cf91db server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:11.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.586+0000 7f349d400640 1 -- 172.21.15.32:0/4001339252 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880b0070 con 0x7f34a00d0420 2024-03-19T06:24:11.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.586+0000 7f349d400640 1 -- 172.21.15.32:0/4001339252 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34880ab400 con 0x7f34a00d0420 2024-03-19T06:24:11.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.586+0000 7f349d400640 1 -- 172.21.15.32:0/4001339252 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880ab7d0 con 0x7f34a00d0420 2024-03-19T06:24:11.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349f200640 1 -- 172.21.15.32:0/4001339252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34a00d0420 msgr2=0x7f34a0099a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349f200640 1 --2- 172.21.15.32:0/4001339252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34a00d0420 0x7f34a0099a70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f34880097f0 tx=0x7f348801c450 comp rx=0 tx=0).stop 2024-03-19T06:24:11.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349f200640 1 -- 172.21.15.32:0/4001339252 shutdown_connections 2024-03-19T06:24:11.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349f200640 1 --2- 172.21.15.32:0/4001339252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34a00d0420 0x7f34a0099a70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349f200640 1 -- 172.21.15.32:0/4001339252 >> 172.21.15.32:0/4001339252 conn(0x7f34a00b3100 msgr2=0x7f34a00b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:11.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349f200640 1 -- 172.21.15.32:0/4001339252 shutdown_connections 2024-03-19T06:24:11.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349f200640 1 -- 172.21.15.32:0/4001339252 wait complete. 2024-03-19T06:24:11.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349f200640 1 Processor -- start 2024-03-19T06:24:11.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349f200640 1 -- start start 2024-03-19T06:24:11.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349f200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34a0099fb0 0x7f34a00c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349f200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34a00b29e0 0x7f34a0163c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349f200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34a00d0420 0x7f34a0151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349f200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0169b60 con 0x7f34a00b29e0 2024-03-19T06:24:11.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349f200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a01699e0 con 0x7f34a0099fb0 2024-03-19T06:24:11.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349f200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0169ce0 con 0x7f34a00d0420 2024-03-19T06:24:11.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f3497e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34a00b29e0 0x7f34a0163c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f3497e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34a00b29e0 0x7f34a0163c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50048/0 (socket says 172.21.15.32:50048) 2024-03-19T06:24:11.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f3497e00640 1 -- 172.21.15.32:0/3022443029 learned_addr learned my addr 172.21.15.32:0/3022443029 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:11.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349de00640 1 --2- 172.21.15.32:0/3022443029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34a0099fb0 0x7f34a00c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f349e800640 1 --2- 172.21.15.32:0/3022443029 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34a00d0420 0x7f34a0151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f3497e00640 1 -- 172.21.15.32:0/3022443029 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34a00d0420 msgr2=0x7f34a0151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f3497e00640 1 --2- 172.21.15.32:0/3022443029 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34a00d0420 0x7f34a0151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f3497e00640 1 -- 172.21.15.32:0/3022443029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34a0099fb0 msgr2=0x7f34a00c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f3497e00640 1 --2- 172.21.15.32:0/3022443029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34a0099fb0 0x7f34a00c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.590+0000 7f3497e00640 1 -- 172.21.15.32:0/3022443029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0165550 con 0x7f34a00b29e0 2024-03-19T06:24:11.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.594+0000 7f3497e00640 1 --2- 172.21.15.32:0/3022443029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34a00b29e0 0x7f34a0163c80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f34880097f0 tx=0x7f34880191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:11.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.594+0000 7f3496000640 1 -- 172.21.15.32:0/3022443029 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880b0040 con 0x7f34a00b29e0 2024-03-19T06:24:11.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.594+0000 7f3496000640 1 -- 172.21.15.32:0/3022443029 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34880ba070 con 0x7f34a00b29e0 2024-03-19T06:24:11.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.594+0000 7f349f200640 1 -- 172.21.15.32:0/3022443029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a01644b0 con 0x7f34a00b29e0 2024-03-19T06:24:11.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.594+0000 7f3496000640 1 -- 172.21.15.32:0/3022443029 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880b4650 con 0x7f34a00b29e0 2024-03-19T06:24:11.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.594+0000 7f349f200640 1 -- 172.21.15.32:0/3022443029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a0164a70 con 0x7f34a00b29e0 2024-03-19T06:24:11.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.594+0000 7f349f200640 1 -- 172.21.15.32:0/3022443029 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f34a0075090 con 0x7f34a00b29e0 2024-03-19T06:24:11.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.594+0000 7f3496000640 1 -- 172.21.15.32:0/3022443029 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f34880b47f0 con 0x7f34a00b29e0 2024-03-19T06:24:11.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.594+0000 7f3496000640 1 --2- 172.21.15.32:0/3022443029 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f347c067660 0x7f347c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.594+0000 7f3496000640 1 -- 172.21.15.32:0/3022443029 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f348811f1d0 con 0x7f34a00b29e0 2024-03-19T06:24:11.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.594+0000 7f3496000640 1 --2- 172.21.15.32:0/3022443029 >> [v2:172.21.15.171:6808/3784639902,v1:172.21.15.171:6809/3784639902] conn(0x7f347c06d520 0x7f347c06f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.594+0000 7f3496000640 1 -- 172.21.15.32:0/3022443029 --> [v2:172.21.15.171:6808/3784639902,v1:172.21.15.171:6809/3784639902] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f348800af30 con 0x7f347c06d520 2024-03-19T06:24:11.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.594+0000 7f3496000640 1 -- 172.21.15.32:0/3022443029 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3488126050 con 0x7f34a00b29e0 2024-03-19T06:24:11.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.594+0000 7f349de00640 1 --2- 172.21.15.32:0/3022443029 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f347c067660 0x7f347c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.594+0000 7f349e800640 1 --2- 172.21.15.32:0/3022443029 >> [v2:172.21.15.171:6808/3784639902,v1:172.21.15.171:6809/3784639902] conn(0x7f347c06d520 0x7f347c06f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.598+0000 7f349de00640 1 --2- 172.21.15.32:0/3022443029 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f347c067660 0x7f347c069b20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3490000f70 tx=0x7f3490009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:11.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.598+0000 7f349e800640 1 --2- 172.21.15.32:0/3022443029 >> [v2:172.21.15.171:6808/3784639902,v1:172.21.15.171:6809/3784639902] conn(0x7f347c06d520 0x7f347c06f940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:11.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.598+0000 7f3496000640 1 -- 172.21.15.32:0/3022443029 <== osd.5 v2:172.21.15.171:6808/3784639902 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f348800af30 con 0x7f347c06d520 2024-03-19T06:24:11.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.610+0000 7f349f200640 1 -- 172.21.15.32:0/3022443029 --> [v2:172.21.15.171:6808/3784639902,v1:172.21.15.171:6809/3784639902] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f34a00b0ab0 con 0x7f347c06d520 2024-03-19T06:24:11.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.610+0000 7f3496000640 1 -- 172.21.15.32:0/3022443029 <== osd.5 v2:172.21.15.171:6808/3784639902 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f34a00b0ab0 con 0x7f347c06d520 2024-03-19T06:24:11.601 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:24:11.601 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-19T06:24:11.601 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:24:11.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.614+0000 7f349f200640 1 -- 172.21.15.32:0/3022443029 >> [v2:172.21.15.171:6808/3784639902,v1:172.21.15.171:6809/3784639902] conn(0x7f347c06d520 msgr2=0x7f347c06f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.614+0000 7f349f200640 1 --2- 172.21.15.32:0/3022443029 >> [v2:172.21.15.171:6808/3784639902,v1:172.21.15.171:6809/3784639902] conn(0x7f347c06d520 0x7f347c06f940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.614+0000 7f349f200640 1 -- 172.21.15.32:0/3022443029 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f347c067660 msgr2=0x7f347c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.614+0000 7f349f200640 1 --2- 172.21.15.32:0/3022443029 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f347c067660 0x7f347c069b20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3490000f70 tx=0x7f3490009040 comp rx=0 tx=0).stop 2024-03-19T06:24:11.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.614+0000 7f349f200640 1 -- 172.21.15.32:0/3022443029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34a00b29e0 msgr2=0x7f34a0163c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.614+0000 7f349f200640 1 --2- 172.21.15.32:0/3022443029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34a00b29e0 0x7f34a0163c80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f34880097f0 tx=0x7f34880191f0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.614+0000 7f349e800640 1 -- 172.21.15.32:0/3022443029 reap_dead start 2024-03-19T06:24:11.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.614+0000 7f349f200640 1 -- 172.21.15.32:0/3022443029 shutdown_connections 2024-03-19T06:24:11.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.614+0000 7f349f200640 1 -- 172.21.15.32:0/3022443029 >> 172.21.15.32:0/3022443029 conn(0x7f34a00b3100 msgr2=0x7f34a00cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:11.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.614+0000 7f349f200640 1 -- 172.21.15.32:0/3022443029 shutdown_connections 2024-03-19T06:24:11.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.614+0000 7f349f200640 1 -- 172.21.15.32:0/3022443029 wait complete. 2024-03-19T06:24:11.619 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-19T06:24:11.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47f2000640 1 Processor -- start 2024-03-19T06:24:11.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47f2000640 1 -- start start 2024-03-19T06:24:11.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47f2000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47ec0b0650 0x7f47ec0cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47f2000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f47ec06f440 0x7f47ec06f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47f2000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ec0cce80 con 0x7f47ec15ef90 2024-03-19T06:24:11.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47f2000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ec0cd160 con 0x7f47ec06f440 2024-03-19T06:24:11.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47f2000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0cd440 con 0x7f47ec0b0650 2024-03-19T06:24:11.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47f0c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f47ec15ef90 0x7f47ec0cf510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:34816/0 (socket says 172.21.15.32:34816) 2024-03-19T06:24:11.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47f0c00640 1 -- 172.21.15.32:0/3594644179 learned_addr learned my addr 172.21.15.32:0/3594644179 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:24:11.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47ebe00640 1 --2- 172.21.15.32:0/3594644179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47ec0b0650 0x7f47ec0cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47f1600640 1 --2- 172.21.15.32:0/3594644179 >> v2:172.21.15.171:3300/0 conn(0x7f47ec06f440 0x7f47ec06f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47eb400640 1 -- 172.21.15.32:0/3594644179 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250644501 0 0) 0x7f47ec0cce80 con 0x7f47ec15ef90 2024-03-19T06:24:11.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47eb400640 1 -- 172.21.15.32:0/3594644179 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47d4003530 con 0x7f47ec15ef90 2024-03-19T06:24:11.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47eb400640 1 -- 172.21.15.32:0/3594644179 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1949521261 0 0) 0x7f47d4003530 con 0x7f47ec15ef90 2024-03-19T06:24:11.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47eb400640 1 -- 172.21.15.32:0/3594644179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47ec0b0650 msgr2=0x7f47ec0cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:11.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47eb400640 1 --2- 172.21.15.32:0/3594644179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47ec0b0650 0x7f47ec0cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47eb400640 1 -- 172.21.15.32:0/3594644179 >> v2:172.21.15.171:3300/0 conn(0x7f47ec06f440 msgr2=0x7f47ec06f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47eb400640 1 --2- 172.21.15.32:0/3594644179 >> v2:172.21.15.171:3300/0 conn(0x7f47ec06f440 0x7f47ec06f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47eb400640 1 -- 172.21.15.32:0/3594644179 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec0d24a0 con 0x7f47ec15ef90 2024-03-19T06:24:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47eb400640 1 -- 172.21.15.32:0/3594644179 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f47e0001680 con 0x7f47ec15ef90 2024-03-19T06:24:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47eb400640 1 -- 172.21.15.32:0/3594644179 >> v1:172.21.15.32:6789/0 conn(0x7f47ec15ef90 legacy=0x7f47ec0cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47eb400640 1 --2- 172.21.15.32:0/3594644179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47d40039c0 0x7f47d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47eb400640 1 --2- 172.21.15.32:0/3594644179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47ec0b0650 0x7f47d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47eb400640 1 --2- 172.21.15.32:0/3594644179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47d4004d50 0x7f47d40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47eb400640 1 -- 172.21.15.32:0/3594644179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0cd160 con 0x7f47d4004d50 2024-03-19T06:24:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47eb400640 1 -- 172.21.15.32:0/3594644179 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0cd440 con 0x7f47d40039c0 2024-03-19T06:24:11.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47eb400640 1 -- 172.21.15.32:0/3594644179 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d400ba50 con 0x7f47ec0b0650 2024-03-19T06:24:11.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47f1600640 1 --2- 172.21.15.32:0/3594644179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47d4004d50 0x7f47d40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47f0c00640 1 --2- 172.21.15.32:0/3594644179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47d40039c0 0x7f47d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.774+0000 7f47ebe00640 1 --2- 172.21.15.32:0/3594644179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47ec0b0650 0x7f47d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.778+0000 7f47f1600640 1 -- 172.21.15.32:0/3594644179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47ec0b0650 msgr2=0x7f47d4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:11.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.778+0000 7f47f1600640 1 --2- 172.21.15.32:0/3594644179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47ec0b0650 0x7f47d4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.778+0000 7f47f1600640 1 -- 172.21.15.32:0/3594644179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47d40039c0 msgr2=0x7f47d4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:11.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.778+0000 7f47f1600640 1 --2- 172.21.15.32:0/3594644179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47d40039c0 0x7f47d4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.778+0000 7f47f1600640 1 -- 172.21.15.32:0/3594644179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d4003530 con 0x7f47d4004d50 2024-03-19T06:24:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.778+0000 7f47f1600640 1 --2- 172.21.15.32:0/3594644179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47d4004d50 0x7f47d40051d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009fc0 tx=0x7f47e401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b1badd3800bb07 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.778+0000 7f47eb400640 1 -- 172.21.15.32:0/3594644179 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e40b2070 con 0x7f47d4004d50 2024-03-19T06:24:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.778+0000 7f47eb400640 1 -- 172.21.15.32:0/3594644179 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e40a5cd0 con 0x7f47d4004d50 2024-03-19T06:24:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.778+0000 7f47eb400640 1 -- 172.21.15.32:0/3594644179 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e4009c10 con 0x7f47d4004d50 2024-03-19T06:24:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.778+0000 7f47f2000640 1 -- 172.21.15.32:0/3594644179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47d4004d50 msgr2=0x7f47d40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.778+0000 7f47f2000640 1 --2- 172.21.15.32:0/3594644179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47d4004d50 0x7f47d40051d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009fc0 tx=0x7f47e401ccc0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.778+0000 7f47f1600640 1 -- 172.21.15.32:0/3594644179 reap_dead start 2024-03-19T06:24:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.778+0000 7f47f2000640 1 -- 172.21.15.32:0/3594644179 shutdown_connections 2024-03-19T06:24:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.778+0000 7f47f2000640 1 -- 172.21.15.32:0/3594644179 >> 172.21.15.32:0/3594644179 conn(0x7f47ec0d1610 msgr2=0x7f47ec0d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.778+0000 7f47f2000640 1 -- 172.21.15.32:0/3594644179 shutdown_connections 2024-03-19T06:24:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.778+0000 7f47f2000640 1 -- 172.21.15.32:0/3594644179 wait complete. 2024-03-19T06:24:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f2000640 1 Processor -- start 2024-03-19T06:24:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f2000640 1 -- start start 2024-03-19T06:24:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f2000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47d4004d50 0x7f47ec06da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f2000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ec0c41d0 0x7f47ec06f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47ec06fd60 0x7f47ec0c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f2000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec15f4f0 con 0x7f47ec06fd60 2024-03-19T06:24:11.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f2000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec15f370 con 0x7f47ec0c41d0 2024-03-19T06:24:11.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f2000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0cfc20 con 0x7f47d4004d50 2024-03-19T06:24:11.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f1600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47ec06fd60 0x7f47ec0c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f1600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47ec06fd60 0x7f47ec0c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50064/0 (socket says 172.21.15.32:50064) 2024-03-19T06:24:11.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f1600640 1 -- 172.21.15.32:0/58786086 learned_addr learned my addr 172.21.15.32:0/58786086 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f0c00640 1 --2- 172.21.15.32:0/58786086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47d4004d50 0x7f47ec06da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47ebe00640 1 --2- 172.21.15.32:0/58786086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ec0c41d0 0x7f47ec06f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f1600640 1 -- 172.21.15.32:0/58786086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47d4004d50 msgr2=0x7f47ec06da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f1600640 1 --2- 172.21.15.32:0/58786086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47d4004d50 0x7f47ec06da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f1600640 1 -- 172.21.15.32:0/58786086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ec0c41d0 msgr2=0x7f47ec06f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f1600640 1 --2- 172.21.15.32:0/58786086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ec0c41d0 0x7f47ec06f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f1600640 1 -- 172.21.15.32:0/58786086 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec0b55b0 con 0x7f47ec06fd60 2024-03-19T06:24:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47ebe00640 1 --2- 172.21.15.32:0/58786086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ec0c41d0 0x7f47ec06f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f0c00640 1 --2- 172.21.15.32:0/58786086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47d4004d50 0x7f47ec06da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:11.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f1600640 1 --2- 172.21.15.32:0/58786086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47ec06fd60 0x7f47ec0c86e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f47e40b0040 tx=0x7f47e4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:11.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47e8c00640 1 -- 172.21.15.32:0/58786086 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e40b2040 con 0x7f47ec06fd60 2024-03-19T06:24:11.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47e8c00640 1 -- 172.21.15.32:0/58786086 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e40a5ad0 con 0x7f47ec06fd60 2024-03-19T06:24:11.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47f2000640 1 -- 172.21.15.32:0/58786086 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ec0b5890 con 0x7f47ec06fd60 2024-03-19T06:24:11.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.782+0000 7f47e8c00640 1 -- 172.21.15.32:0/58786086 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e4009c10 con 0x7f47ec06fd60 2024-03-19T06:24:11.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.786+0000 7f47f2000640 1 -- 172.21.15.32:0/58786086 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ec0b5e50 con 0x7f47ec06fd60 2024-03-19T06:24:11.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.786+0000 7f47f2000640 1 -- 172.21.15.32:0/58786086 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ec075090 con 0x7f47ec06fd60 2024-03-19T06:24:11.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.786+0000 7f47e8c00640 1 -- 172.21.15.32:0/58786086 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f47e40ae930 con 0x7f47ec06fd60 2024-03-19T06:24:11.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.786+0000 7f47e8c00640 1 --2- 172.21.15.32:0/58786086 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f47cc067690 0x7f47cc069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:11.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.786+0000 7f47e8c00640 1 -- 172.21.15.32:0/58786086 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f47e411f5f0 con 0x7f47ec06fd60 2024-03-19T06:24:11.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.786+0000 7f47f0c00640 1 --2- 172.21.15.32:0/58786086 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f47cc067690 0x7f47cc069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:11.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.786+0000 7f47f0c00640 1 --2- 172.21.15.32:0/58786086 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f47cc067690 0x7f47cc069b50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f47e0001060 tx=0x7f47e0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:11.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.790+0000 7f47e8c00640 1 -- 172.21.15.32:0/58786086 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f47e40169d0 con 0x7f47ec06fd60 2024-03-19T06:24:11.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.954+0000 7f47f2000640 1 -- 172.21.15.32:0/58786086 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f47ec0b0ef0 con 0x7f47cc067690 2024-03-19T06:24:11.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.954+0000 7f47e8c00640 1 -- 172.21.15.32:0/58786086 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f47ec0b0ef0 con 0x7f47cc067690 2024-03-19T06:24:11.944 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 5 to deep-scrub 2024-03-19T06:24:11.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.958+0000 7f47f2000640 1 -- 172.21.15.32:0/58786086 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f47cc067690 msgr2=0x7f47cc069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.958+0000 7f47f2000640 1 --2- 172.21.15.32:0/58786086 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f47cc067690 0x7f47cc069b50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f47e0001060 tx=0x7f47e0009040 comp rx=0 tx=0).stop 2024-03-19T06:24:11.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.958+0000 7f47f2000640 1 -- 172.21.15.32:0/58786086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47ec06fd60 msgr2=0x7f47ec0c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:11.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.958+0000 7f47f2000640 1 --2- 172.21.15.32:0/58786086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47ec06fd60 0x7f47ec0c86e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f47e40b0040 tx=0x7f47e4009750 comp rx=0 tx=0).stop 2024-03-19T06:24:11.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.958+0000 7f47f2000640 1 -- 172.21.15.32:0/58786086 shutdown_connections 2024-03-19T06:24:11.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.958+0000 7f47f2000640 1 --2- 172.21.15.32:0/58786086 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f47cc067690 0x7f47cc069b50 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.958+0000 7f47f2000640 1 --2- 172.21.15.32:0/58786086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47ec06fd60 0x7f47ec0c86e0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.958+0000 7f47f2000640 1 --2- 172.21.15.32:0/58786086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ec0c41d0 0x7f47ec06f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.958+0000 7f47f2000640 1 --2- 172.21.15.32:0/58786086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47d4004d50 0x7f47ec06da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:11.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.958+0000 7f47f2000640 1 -- 172.21.15.32:0/58786086 >> 172.21.15.32:0/58786086 conn(0x7f47ec0d1610 msgr2=0x7f47ec0cf510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:11.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.958+0000 7f47f2000640 1 -- 172.21.15.32:0/58786086 shutdown_connections 2024-03-19T06:24:11.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:11.958+0000 7f47f2000640 1 -- 172.21.15.32:0/58786086 wait complete. 2024-03-19T06:24:11.965 INFO:tasks.ceph:Scrubbing osd.6 2024-03-19T06:24:11.965 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-19T06:24:12.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.122+0000 7fb1d8a00640 1 Processor -- start 2024-03-19T06:24:12.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.122+0000 7fb1d8a00640 1 -- start start 2024-03-19T06:24:12.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.122+0000 7fb1d8a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb1d415dc00 0x7fb1d406c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.122+0000 7fb1d8a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d4099a70 0x7fb1d4099f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.122+0000 7fb1d8a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d40cfc90 con 0x7fb1d40d0a50 2024-03-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.122+0000 7fb1d8a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d40cff70 con 0x7fb1d415dc00 2024-03-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.122+0000 7fb1d8a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40d0250 con 0x7fb1d4099a70 2024-03-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.122+0000 7fb1d3400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb1d415dc00 0x7fb1d406c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.122+0000 7fb1d3400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb1d415dc00 0x7fb1d406c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50070/0 (socket says 172.21.15.32:50070) 2024-03-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.122+0000 7fb1d3400640 1 -- 172.21.15.32:0/2796839775 learned_addr learned my addr 172.21.15.32:0/2796839775 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.122+0000 7fb1d3400640 1 -- 172.21.15.32:0/2796839775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d4099a70 msgr2=0x7fb1d4099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.122+0000 7fb1d3e00640 1 --2- 172.21.15.32:0/2796839775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d4099a70 0x7fb1d4099f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.122+0000 7fb1d3400640 1 --2- 172.21.15.32:0/2796839775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d4099a70 0x7fb1d4099f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.122+0000 7fb1d3400640 1 -- 172.21.15.32:0/2796839775 >> v1:172.21.15.171:6789/0 conn(0x7fb1d40d0a50 legacy=0x7fb1d409a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.122+0000 7fb1d3400640 1 -- 172.21.15.32:0/2796839775 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d40d0530 con 0x7fb1d415dc00 2024-03-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.122+0000 7fb1d3e00640 1 --2- 172.21.15.32:0/2796839775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d4099a70 0x7fb1d4099f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.126+0000 7fb1d3400640 1 --2- 172.21.15.32:0/2796839775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d415dc00 0x7fb1d406c1f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009870 tx=0x7fb1c401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa96a6e486f6feba server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.126+0000 7fb1d2a00640 1 -- 172.21.15.32:0/2796839775 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c40b0070 con 0x7fb1d415dc00 2024-03-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.126+0000 7fb1d2a00640 1 -- 172.21.15.32:0/2796839775 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c40ab600 con 0x7fb1d415dc00 2024-03-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.126+0000 7fb1d2a00640 1 -- 172.21.15.32:0/2796839775 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c40ab9d0 con 0x7fb1d415dc00 2024-03-19T06:24:12.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.126+0000 7fb1d8a00640 1 -- 172.21.15.32:0/2796839775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d415dc00 msgr2=0x7fb1d406c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.126+0000 7fb1d8a00640 1 --2- 172.21.15.32:0/2796839775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d415dc00 0x7fb1d406c1f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009870 tx=0x7fb1c401c520 comp rx=0 tx=0).stop 2024-03-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.126+0000 7fb1d8a00640 1 -- 172.21.15.32:0/2796839775 shutdown_connections 2024-03-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.126+0000 7fb1d8a00640 1 --2- 172.21.15.32:0/2796839775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d4099a70 0x7fb1d4099f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.126+0000 7fb1d8a00640 1 --2- 172.21.15.32:0/2796839775 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d415dc00 0x7fb1d406c1f0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.126+0000 7fb1d8a00640 1 -- 172.21.15.32:0/2796839775 >> 172.21.15.32:0/2796839775 conn(0x7fb1d40b3110 msgr2=0x7fb1d40b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.126+0000 7fb1d8a00640 1 -- 172.21.15.32:0/2796839775 shutdown_connections 2024-03-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.126+0000 7fb1d8a00640 1 -- 172.21.15.32:0/2796839775 wait complete. 2024-03-19T06:24:12.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d8a00640 1 Processor -- start 2024-03-19T06:24:12.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d8a00640 1 -- start start 2024-03-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d8a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1d4099a70 0x7fb1d4154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d8a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d40d0a50 0x7fb1d415b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d8a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d415dc00 0x7fb1d415b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d8a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40cc850 con 0x7fb1d415dc00 2024-03-19T06:24:12.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d8a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40cc6d0 con 0x7fb1d4099a70 2024-03-19T06:24:12.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d8a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40cc9d0 con 0x7fb1d40d0a50 2024-03-19T06:24:12.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d415dc00 0x7fb1d415b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d415dc00 0x7fb1d415b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50082/0 (socket says 172.21.15.32:50082) 2024-03-19T06:24:12.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d3e00640 1 -- 172.21.15.32:0/3048813430 learned_addr learned my addr 172.21.15.32:0/3048813430 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:12.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1cbe00640 1 --2- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d40d0a50 0x7fb1d415b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d3400640 1 --2- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1d4099a70 0x7fb1d4154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d3e00640 1 -- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d40d0a50 msgr2=0x7fb1d415b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d3e00640 1 --2- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d40d0a50 0x7fb1d415b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d3e00640 1 -- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1d4099a70 msgr2=0x7fb1d4154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d3e00640 1 --2- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1d4099a70 0x7fb1d4154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d3e00640 1 -- 172.21.15.32:0/3048813430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d41554c0 con 0x7fb1d415dc00 2024-03-19T06:24:12.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1cbe00640 1 --2- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1d40d0a50 0x7fb1d415b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:12.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d3e00640 1 --2- 172.21.15.32:0/3048813430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d415dc00 0x7fb1d415b980 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00cd50 tx=0x7fb1cc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:12.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1cb400640 1 -- 172.21.15.32:0/3048813430 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc00f680 con 0x7fb1d415dc00 2024-03-19T06:24:12.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1cb400640 1 -- 172.21.15.32:0/3048813430 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc00f840 con 0x7fb1d415dc00 2024-03-19T06:24:12.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1cb400640 1 -- 172.21.15.32:0/3048813430 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc00fc30 con 0x7fb1d415dc00 2024-03-19T06:24:12.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d8a00640 1 -- 172.21.15.32:0/3048813430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d41557a0 con 0x7fb1d415dc00 2024-03-19T06:24:12.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.130+0000 7fb1d8a00640 1 -- 172.21.15.32:0/3048813430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d4155d60 con 0x7fb1d415dc00 2024-03-19T06:24:12.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.134+0000 7fb1d8a00640 1 -- 172.21.15.32:0/3048813430 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1d4075090 con 0x7fb1d415dc00 2024-03-19T06:24:12.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.134+0000 7fb1cb400640 1 -- 172.21.15.32:0/3048813430 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb1cc00e3e0 con 0x7fb1d415dc00 2024-03-19T06:24:12.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.134+0000 7fb1cb400640 1 --2- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb1b0067660 0x7fb1b0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.134+0000 7fb1cb400640 1 -- 172.21.15.32:0/3048813430 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb1cc0862c0 con 0x7fb1d415dc00 2024-03-19T06:24:12.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.134+0000 7fb1cb400640 1 --2- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:6824/1372815214,v1:172.21.15.171:6825/1372815214] conn(0x7fb1b006d520 0x7fb1b006f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.134+0000 7fb1cb400640 1 -- 172.21.15.32:0/3048813430 --> [v2:172.21.15.171:6824/1372815214,v1:172.21.15.171:6825/1372815214] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1b006fff0 con 0x7fb1b006d520 2024-03-19T06:24:12.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.134+0000 7fb1cb400640 1 -- 172.21.15.32:0/3048813430 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1cc08d050 con 0x7fb1d415dc00 2024-03-19T06:24:12.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.134+0000 7fb1d3400640 1 --2- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb1b0067660 0x7fb1b0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.134+0000 7fb1cbe00640 1 --2- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:6824/1372815214,v1:172.21.15.171:6825/1372815214] conn(0x7fb1b006d520 0x7fb1b006f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.134+0000 7fb1d3400640 1 --2- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb1b0067660 0x7fb1b0069b20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40ad000 tx=0x7fb1c4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:12.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.134+0000 7fb1cbe00640 1 --2- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:6824/1372815214,v1:172.21.15.171:6825/1372815214] conn(0x7fb1b006d520 0x7fb1b006f940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:12.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.138+0000 7fb1cb400640 1 -- 172.21.15.32:0/3048813430 <== osd.6 v2:172.21.15.171:6824/1372815214 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb1b006fff0 con 0x7fb1b006d520 2024-03-19T06:24:12.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.150+0000 7fb1d8a00640 1 -- 172.21.15.32:0/3048813430 --> [v2:172.21.15.171:6824/1372815214,v1:172.21.15.171:6825/1372815214] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb1d40c81b0 con 0x7fb1b006d520 2024-03-19T06:24:12.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.150+0000 7fb1cb400640 1 -- 172.21.15.32:0/3048813430 <== osd.6 v2:172.21.15.171:6824/1372815214 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb1d40c81b0 con 0x7fb1b006d520 2024-03-19T06:24:12.140 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:24:12.140 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-19T06:24:12.140 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:24:12.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.150+0000 7fb1d8a00640 1 -- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:6824/1372815214,v1:172.21.15.171:6825/1372815214] conn(0x7fb1b006d520 msgr2=0x7fb1b006f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.150+0000 7fb1d8a00640 1 --2- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:6824/1372815214,v1:172.21.15.171:6825/1372815214] conn(0x7fb1b006d520 0x7fb1b006f940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.150+0000 7fb1d8a00640 1 -- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb1b0067660 msgr2=0x7fb1b0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.150+0000 7fb1d8a00640 1 --2- 172.21.15.32:0/3048813430 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fb1b0067660 0x7fb1b0069b20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40ad000 tx=0x7fb1c4008040 comp rx=0 tx=0).stop 2024-03-19T06:24:12.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.150+0000 7fb1d8a00640 1 -- 172.21.15.32:0/3048813430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d415dc00 msgr2=0x7fb1d415b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.150+0000 7fb1d8a00640 1 --2- 172.21.15.32:0/3048813430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1d415dc00 0x7fb1d415b980 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00cd50 tx=0x7fb1cc00a650 comp rx=0 tx=0).stop 2024-03-19T06:24:12.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.150+0000 7fb1d3e00640 1 -- 172.21.15.32:0/3048813430 reap_dead start 2024-03-19T06:24:12.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.150+0000 7fb1d8a00640 1 -- 172.21.15.32:0/3048813430 shutdown_connections 2024-03-19T06:24:12.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.150+0000 7fb1d8a00640 1 -- 172.21.15.32:0/3048813430 >> 172.21.15.32:0/3048813430 conn(0x7fb1d40b3110 msgr2=0x7fb1d40b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:12.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.150+0000 7fb1d8a00640 1 -- 172.21.15.32:0/3048813430 shutdown_connections 2024-03-19T06:24:12.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.150+0000 7fb1d8a00640 1 -- 172.21.15.32:0/3048813430 wait complete. 2024-03-19T06:24:12.159 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-19T06:24:12.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.314+0000 7f331f000640 1 Processor -- start 2024-03-19T06:24:12.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.314+0000 7f331f000640 1 -- start start 2024-03-19T06:24:12.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.314+0000 7f331f000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3318159ed0 0x7f33180cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.314+0000 7f331f000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331815a2b0 0x7f33180caf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.314+0000 7f331f000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33180ce3e0 con 0x7f33180cdb40 2024-03-19T06:24:12.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.314+0000 7f331f000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33180ca1d0 con 0x7f3318159ed0 2024-03-19T06:24:12.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.314+0000 7f331f000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33180ca4b0 con 0x7f331815a2b0 2024-03-19T06:24:12.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.314+0000 7f3317e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3318159ed0 0x7f33180cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.314+0000 7f3317e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3318159ed0 0x7f33180cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50092/0 (socket says 172.21.15.32:50092) 2024-03-19T06:24:12.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.314+0000 7f3317e00640 1 -- 172.21.15.32:0/3819178941 learned_addr learned my addr 172.21.15.32:0/3819178941 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:12.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.314+0000 7f3317400640 1 --2- 172.21.15.32:0/3819178941 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331815a2b0 0x7f33180caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.314+0000 7f3317e00640 1 -- 172.21.15.32:0/3819178941 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331815a2b0 msgr2=0x7f33180caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:12.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.314+0000 7f3317e00640 1 --2- 172.21.15.32:0/3819178941 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331815a2b0 0x7f33180caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.314+0000 7f3317e00640 1 -- 172.21.15.32:0/3819178941 >> v1:172.21.15.171:6789/0 conn(0x7f33180cdb40 legacy=0x7f3318071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.314+0000 7f3317e00640 1 -- 172.21.15.32:0/3819178941 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33180ca790 con 0x7f3318159ed0 2024-03-19T06:24:12.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.314+0000 7f3317400640 1 --2- 172.21.15.32:0/3819178941 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331815a2b0 0x7f33180caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:12.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.318+0000 7f3317e00640 1 --2- 172.21.15.32:0/3819178941 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3318159ed0 0x7f33180cea60 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f330800aa10 tx=0x7f330801d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f010ccd5fdd3a22 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:12.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.318+0000 7f3316a00640 1 -- 172.21.15.32:0/3819178941 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33080b3070 con 0x7f3318159ed0 2024-03-19T06:24:12.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.318+0000 7f3316a00640 1 -- 172.21.15.32:0/3819178941 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33080a68e0 con 0x7f3318159ed0 2024-03-19T06:24:12.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.318+0000 7f3316a00640 1 -- 172.21.15.32:0/3819178941 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800b040 con 0x7f3318159ed0 2024-03-19T06:24:12.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.318+0000 7f331f000640 1 -- 172.21.15.32:0/3819178941 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3318159ed0 msgr2=0x7f33180cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.318+0000 7f331f000640 1 --2- 172.21.15.32:0/3819178941 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3318159ed0 0x7f33180cea60 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f330800aa10 tx=0x7f330801d870 comp rx=0 tx=0).stop 2024-03-19T06:24:12.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.318+0000 7f331f000640 1 -- 172.21.15.32:0/3819178941 shutdown_connections 2024-03-19T06:24:12.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.318+0000 7f331f000640 1 --2- 172.21.15.32:0/3819178941 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331815a2b0 0x7f33180caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.318+0000 7f331f000640 1 --2- 172.21.15.32:0/3819178941 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3318159ed0 0x7f33180cea60 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.318+0000 7f331f000640 1 -- 172.21.15.32:0/3819178941 >> 172.21.15.32:0/3819178941 conn(0x7f33180b1280 msgr2=0x7f33180b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:12.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.318+0000 7f331f000640 1 -- 172.21.15.32:0/3819178941 shutdown_connections 2024-03-19T06:24:12.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.318+0000 7f331f000640 1 -- 172.21.15.32:0/3819178941 wait complete. 2024-03-19T06:24:12.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f331f000640 1 Processor -- start 2024-03-19T06:24:12.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f331f000640 1 -- start start 2024-03-19T06:24:12.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f331f000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33180cdb40 0x7f33180a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f331f000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3318159ed0 0x7f331806e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f331f000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f331815a2b0 0x7f33180c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f331f000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3318071a60 con 0x7f3318159ed0 2024-03-19T06:24:12.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f331f000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33180ce160 con 0x7f331815a2b0 2024-03-19T06:24:12.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f331f000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3318071be0 con 0x7f33180cdb40 2024-03-19T06:24:12.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f3317400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3318159ed0 0x7f331806e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f3317400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3318159ed0 0x7f331806e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50100/0 (socket says 172.21.15.32:50100) 2024-03-19T06:24:12.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f3317400640 1 -- 172.21.15.32:0/2078710132 learned_addr learned my addr 172.21.15.32:0/2078710132 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:12.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f3317400640 1 -- 172.21.15.32:0/2078710132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33180cdb40 msgr2=0x7f33180a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f3317400640 1 --2- 172.21.15.32:0/2078710132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33180cdb40 0x7f33180a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f3317400640 1 -- 172.21.15.32:0/2078710132 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f331815a2b0 msgr2=0x7f33180c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f3317400640 1 --2- 172.21.15.32:0/2078710132 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f331815a2b0 0x7f33180c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f3317400640 1 -- 172.21.15.32:0/2078710132 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33180c9680 con 0x7f3318159ed0 2024-03-19T06:24:12.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f3317400640 1 --2- 172.21.15.32:0/2078710132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3318159ed0 0x7f331806e120 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f330400e840 tx=0x7f330400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:12.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f330fe00640 1 -- 172.21.15.32:0/2078710132 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304017070 con 0x7f3318159ed0 2024-03-19T06:24:12.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f330fe00640 1 -- 172.21.15.32:0/2078710132 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330400c8d0 con 0x7f3318159ed0 2024-03-19T06:24:12.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f330fe00640 1 -- 172.21.15.32:0/2078710132 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400f040 con 0x7f3318159ed0 2024-03-19T06:24:12.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f331f000640 1 -- 172.21.15.32:0/2078710132 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33180c9960 con 0x7f3318159ed0 2024-03-19T06:24:12.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.322+0000 7f331f000640 1 -- 172.21.15.32:0/2078710132 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33180c6890 con 0x7f3318159ed0 2024-03-19T06:24:12.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.326+0000 7f331f000640 1 -- 172.21.15.32:0/2078710132 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33180749e0 con 0x7f3318159ed0 2024-03-19T06:24:12.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.326+0000 7f330fe00640 1 -- 172.21.15.32:0/2078710132 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f330401a070 con 0x7f3318159ed0 2024-03-19T06:24:12.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.326+0000 7f330fe00640 1 --2- 172.21.15.32:0/2078710132 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f32f8067660 0x7f32f8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.326+0000 7f330fe00640 1 -- 172.21.15.32:0/2078710132 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f33040851c0 con 0x7f3318159ed0 2024-03-19T06:24:12.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.326+0000 7f3317e00640 1 --2- 172.21.15.32:0/2078710132 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f32f8067660 0x7f32f8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.326+0000 7f3317e00640 1 --2- 172.21.15.32:0/2078710132 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f32f8067660 0x7f32f8069b20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f33080b0000 tx=0x7f330800c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:12.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.330+0000 7f330fe00640 1 -- 172.21.15.32:0/2078710132 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f3304056130 con 0x7f3318159ed0 2024-03-19T06:24:12.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.494+0000 7f331f000640 1 -- 172.21.15.32:0/2078710132 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f33180ae980 con 0x7f32f8067660 2024-03-19T06:24:12.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.494+0000 7f330fe00640 1 -- 172.21.15.32:0/2078710132 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f33180ae980 con 0x7f32f8067660 2024-03-19T06:24:12.484 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 6 to deep-scrub 2024-03-19T06:24:12.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.498+0000 7f331f000640 1 -- 172.21.15.32:0/2078710132 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f32f8067660 msgr2=0x7f32f8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.498+0000 7f331f000640 1 --2- 172.21.15.32:0/2078710132 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f32f8067660 0x7f32f8069b20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f33080b0000 tx=0x7f330800c040 comp rx=0 tx=0).stop 2024-03-19T06:24:12.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.498+0000 7f331f000640 1 -- 172.21.15.32:0/2078710132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3318159ed0 msgr2=0x7f331806e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.498+0000 7f331f000640 1 --2- 172.21.15.32:0/2078710132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3318159ed0 0x7f331806e120 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f330400e840 tx=0x7f330400ed00 comp rx=0 tx=0).stop 2024-03-19T06:24:12.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.498+0000 7f331f000640 1 -- 172.21.15.32:0/2078710132 shutdown_connections 2024-03-19T06:24:12.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.498+0000 7f331f000640 1 --2- 172.21.15.32:0/2078710132 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f32f8067660 0x7f32f8069b20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.498+0000 7f331f000640 1 --2- 172.21.15.32:0/2078710132 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f331815a2b0 0x7f33180c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.498+0000 7f331f000640 1 --2- 172.21.15.32:0/2078710132 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3318159ed0 0x7f331806e120 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.498+0000 7f331f000640 1 --2- 172.21.15.32:0/2078710132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33180cdb40 0x7f33180a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.498+0000 7f331f000640 1 -- 172.21.15.32:0/2078710132 >> 172.21.15.32:0/2078710132 conn(0x7f33180b1280 msgr2=0x7f3318159180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:12.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.498+0000 7f331f000640 1 -- 172.21.15.32:0/2078710132 shutdown_connections 2024-03-19T06:24:12.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.498+0000 7f331f000640 1 -- 172.21.15.32:0/2078710132 wait complete. 2024-03-19T06:24:12.505 INFO:tasks.ceph:Scrubbing osd.7 2024-03-19T06:24:12.505 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-19T06:24:12.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25b6600640 1 Processor -- start 2024-03-19T06:24:12.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25b6600640 1 -- start start 2024-03-19T06:24:12.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25b6600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f25b015dbf0 0x7f25b006c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25b6600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f25b006cda0 0x7f25b00ce170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25b6600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b00ce6b0 0x7f25b00b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25b6600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b00b2590 con 0x7f25b006cda0 2024-03-19T06:24:12.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25b6600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b00b2870 con 0x7f25b015dbf0 2024-03-19T06:24:12.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25b6600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b006c060 con 0x7f25b00ce6b0 2024-03-19T06:24:12.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25a7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f25b006cda0 0x7f25b00ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25a7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f25b006cda0 0x7f25b00ce170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50102/0 (socket says 172.21.15.32:50102) 2024-03-19T06:24:12.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25a7e00640 1 -- 172.21.15.32:0/1657703749 learned_addr learned my addr 172.21.15.32:0/1657703749 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:12.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25afe00640 1 --2- 172.21.15.32:0/1657703749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b00ce6b0 0x7f25b00b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25af400640 1 --2- 172.21.15.32:0/1657703749 >> v2:172.21.15.171:3300/0 conn(0x7f25b015dbf0 0x7f25b006c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25a7e00640 1 -- 172.21.15.32:0/1657703749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b00ce6b0 msgr2=0x7f25b00b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:12.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25a7e00640 1 --2- 172.21.15.32:0/1657703749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b00ce6b0 0x7f25b00b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25a7e00640 1 -- 172.21.15.32:0/1657703749 >> v2:172.21.15.171:3300/0 conn(0x7f25b015dbf0 msgr2=0x7f25b006c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:12.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25a7e00640 1 --2- 172.21.15.32:0/1657703749 >> v2:172.21.15.171:3300/0 conn(0x7f25b015dbf0 0x7f25b006c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.662+0000 7f25a7e00640 1 -- 172.21.15.32:0/1657703749 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b006c340 con 0x7f25b006cda0 2024-03-19T06:24:12.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.666+0000 7f25a7e00640 1 --2- 172.21.15.32:0/1657703749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b006cda0 0x7f25b00ce170 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f25b00cef90 tx=0x7f259801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42e137fa950f64 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:12.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.666+0000 7f25aea00640 1 -- 172.21.15.32:0/1657703749 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25980b0070 con 0x7f25b006cda0 2024-03-19T06:24:12.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.666+0000 7f25aea00640 1 -- 172.21.15.32:0/1657703749 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25980ab600 con 0x7f25b006cda0 2024-03-19T06:24:12.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.666+0000 7f25aea00640 1 -- 172.21.15.32:0/1657703749 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25980ab9d0 con 0x7f25b006cda0 2024-03-19T06:24:12.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.666+0000 7f25b6600640 1 -- 172.21.15.32:0/1657703749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b006cda0 msgr2=0x7f25b00ce170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.666+0000 7f25b6600640 1 --2- 172.21.15.32:0/1657703749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b006cda0 0x7f25b00ce170 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f25b00cef90 tx=0x7f259801c490 comp rx=0 tx=0).stop 2024-03-19T06:24:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.666+0000 7f25b6600640 1 -- 172.21.15.32:0/1657703749 shutdown_connections 2024-03-19T06:24:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.666+0000 7f25b6600640 1 --2- 172.21.15.32:0/1657703749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b00ce6b0 0x7f25b00b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.666+0000 7f25b6600640 1 --2- 172.21.15.32:0/1657703749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b006cda0 0x7f25b00ce170 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.666+0000 7f25b6600640 1 --2- 172.21.15.32:0/1657703749 >> v2:172.21.15.171:3300/0 conn(0x7f25b015dbf0 0x7f25b006c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.666+0000 7f25b6600640 1 -- 172.21.15.32:0/1657703749 >> 172.21.15.32:0/1657703749 conn(0x7f25b00d1860 msgr2=0x7f25b00d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:12.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.666+0000 7f25b6600640 1 -- 172.21.15.32:0/1657703749 shutdown_connections 2024-03-19T06:24:12.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.666+0000 7f25b6600640 1 -- 172.21.15.32:0/1657703749 wait complete. 2024-03-19T06:24:12.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25b6600640 1 Processor -- start 2024-03-19T06:24:12.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25b6600640 1 -- start start 2024-03-19T06:24:12.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25b6600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b006cda0 0x7f25b014d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25b6600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b00ce6b0 0x7f25b014ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25b6600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25b015dbf0 0x7f25b014c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25b6600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b0099e00 con 0x7f25b00ce6b0 2024-03-19T06:24:12.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25b6600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b0099c80 con 0x7f25b015dbf0 2024-03-19T06:24:12.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25b6600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b0099f80 con 0x7f25b006cda0 2024-03-19T06:24:12.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25a7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b00ce6b0 0x7f25b014ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25a7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b00ce6b0 0x7f25b014ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50118/0 (socket says 172.21.15.32:50118) 2024-03-19T06:24:12.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25af400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b006cda0 0x7f25b014d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25a7e00640 1 -- 172.21.15.32:0/1741622707 learned_addr learned my addr 172.21.15.32:0/1741622707 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:12.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25afe00640 1 --2- 172.21.15.32:0/1741622707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25b015dbf0 0x7f25b014c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25a7e00640 1 -- 172.21.15.32:0/1741622707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b006cda0 msgr2=0x7f25b014d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25a7e00640 1 --2- 172.21.15.32:0/1741622707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f25b006cda0 0x7f25b014d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25a7e00640 1 -- 172.21.15.32:0/1741622707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25b015dbf0 msgr2=0x7f25b014c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25a7e00640 1 --2- 172.21.15.32:0/1741622707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25b015dbf0 0x7f25b014c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25a7e00640 1 -- 172.21.15.32:0/1741622707 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b0154970 con 0x7f25b00ce6b0 2024-03-19T06:24:12.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25a7e00640 1 --2- 172.21.15.32:0/1741622707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b00ce6b0 0x7f25b014ffc0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f25980ae040 tx=0x7f2598019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:12.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25a7400640 1 -- 172.21.15.32:0/1741622707 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25980b0040 con 0x7f25b00ce6b0 2024-03-19T06:24:12.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25a7400640 1 -- 172.21.15.32:0/1741622707 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25980b9070 con 0x7f25b00ce6b0 2024-03-19T06:24:12.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25a7400640 1 -- 172.21.15.32:0/1741622707 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25980aa970 con 0x7f25b00ce6b0 2024-03-19T06:24:12.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25b6600640 1 -- 172.21.15.32:0/1741622707 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b0154c50 con 0x7f25b00ce6b0 2024-03-19T06:24:12.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25b6600640 1 -- 172.21.15.32:0/1741622707 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b0155950 con 0x7f25b00ce6b0 2024-03-19T06:24:12.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.670+0000 7f25b6600640 1 -- 172.21.15.32:0/1741622707 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25b00749e0 con 0x7f25b00ce6b0 2024-03-19T06:24:12.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.674+0000 7f25a7400640 1 -- 172.21.15.32:0/1741622707 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f25980aab10 con 0x7f25b00ce6b0 2024-03-19T06:24:12.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.674+0000 7f25a7400640 1 --2- 172.21.15.32:0/1741622707 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f258c067660 0x7f258c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.674+0000 7f25a7400640 1 -- 172.21.15.32:0/1741622707 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f259811f630 con 0x7f25b00ce6b0 2024-03-19T06:24:12.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.674+0000 7f25a7400640 1 --2- 172.21.15.32:0/1741622707 >> [v2:172.21.15.171:6816/2899212924,v1:172.21.15.171:6817/2899212924] conn(0x7f258c06d520 0x7f258c06f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.674+0000 7f25a7400640 1 -- 172.21.15.32:0/1741622707 --> [v2:172.21.15.171:6816/2899212924,v1:172.21.15.171:6817/2899212924] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f258c06fff0 con 0x7f258c06d520 2024-03-19T06:24:12.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.674+0000 7f25a7400640 1 -- 172.21.15.32:0/1741622707 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2598126050 con 0x7f25b00ce6b0 2024-03-19T06:24:12.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.674+0000 7f25af400640 1 --2- 172.21.15.32:0/1741622707 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f258c067660 0x7f258c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.674+0000 7f25afe00640 1 --2- 172.21.15.32:0/1741622707 >> [v2:172.21.15.171:6816/2899212924,v1:172.21.15.171:6817/2899212924] conn(0x7f258c06d520 0x7f258c06f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.674+0000 7f25af400640 1 --2- 172.21.15.32:0/1741622707 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f258c067660 0x7f258c069b20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f25a00079c0 tx=0x7f25a0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:12.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.674+0000 7f25afe00640 1 --2- 172.21.15.32:0/1741622707 >> [v2:172.21.15.171:6816/2899212924,v1:172.21.15.171:6817/2899212924] conn(0x7f258c06d520 0x7f258c06f940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:12.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.674+0000 7f25a7400640 1 -- 172.21.15.32:0/1741622707 <== osd.7 v2:172.21.15.171:6816/2899212924 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f258c06fff0 con 0x7f258c06d520 2024-03-19T06:24:12.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.690+0000 7f25b6600640 1 -- 172.21.15.32:0/1741622707 --> [v2:172.21.15.171:6816/2899212924,v1:172.21.15.171:6817/2899212924] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f25b01533a0 con 0x7f258c06d520 2024-03-19T06:24:12.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.690+0000 7f25a7400640 1 -- 172.21.15.32:0/1741622707 <== osd.7 v2:172.21.15.171:6816/2899212924 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f25b01533a0 con 0x7f258c06d520 2024-03-19T06:24:12.679 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-03-19T06:24:12.679 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-19T06:24:12.679 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-03-19T06:24:12.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.690+0000 7f25b6600640 1 -- 172.21.15.32:0/1741622707 >> [v2:172.21.15.171:6816/2899212924,v1:172.21.15.171:6817/2899212924] conn(0x7f258c06d520 msgr2=0x7f258c06f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.690+0000 7f25b6600640 1 --2- 172.21.15.32:0/1741622707 >> [v2:172.21.15.171:6816/2899212924,v1:172.21.15.171:6817/2899212924] conn(0x7f258c06d520 0x7f258c06f940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.690+0000 7f25b6600640 1 -- 172.21.15.32:0/1741622707 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f258c067660 msgr2=0x7f258c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.690+0000 7f25b6600640 1 --2- 172.21.15.32:0/1741622707 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f258c067660 0x7f258c069b20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f25a00079c0 tx=0x7f25a0008040 comp rx=0 tx=0).stop 2024-03-19T06:24:12.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.690+0000 7f25b6600640 1 -- 172.21.15.32:0/1741622707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b00ce6b0 msgr2=0x7f25b014ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.690+0000 7f25b6600640 1 --2- 172.21.15.32:0/1741622707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25b00ce6b0 0x7f25b014ffc0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f25980ae040 tx=0x7f2598019230 comp rx=0 tx=0).stop 2024-03-19T06:24:12.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.690+0000 7f25afe00640 1 -- 172.21.15.32:0/1741622707 reap_dead start 2024-03-19T06:24:12.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.690+0000 7f25b6600640 1 -- 172.21.15.32:0/1741622707 shutdown_connections 2024-03-19T06:24:12.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.690+0000 7f25b6600640 1 -- 172.21.15.32:0/1741622707 >> 172.21.15.32:0/1741622707 conn(0x7f25b00d1860 msgr2=0x7f25b00d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:12.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.690+0000 7f25b6600640 1 -- 172.21.15.32:0/1741622707 shutdown_connections 2024-03-19T06:24:12.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.690+0000 7f25b6600640 1 -- 172.21.15.32:0/1741622707 wait complete. 2024-03-19T06:24:12.697 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-19T06:24:12.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8ea5c00640 1 Processor -- start 2024-03-19T06:24:12.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8ea5c00640 1 -- start start 2024-03-19T06:24:12.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8ea5c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8ea015bb20 0x7f8ea009a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8ea5c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea00cf460 0x7f8ea00c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8ea5c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea015bf00 con 0x7f8ea00c5920 2024-03-19T06:24:12.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8ea5c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea00cc3a0 con 0x7f8ea015bb20 2024-03-19T06:24:12.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8ea5c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00cfbb0 con 0x7f8ea00cf460 2024-03-19T06:24:12.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8e9f400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8ea00c5920 0x7f8ea00cd390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:34832/0 (socket says 172.21.15.32:34832) 2024-03-19T06:24:12.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8e9f400640 1 -- 172.21.15.32:0/1666164082 learned_addr learned my addr 172.21.15.32:0/1666164082 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:24:12.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8e9ea00640 1 --2- 172.21.15.32:0/1666164082 >> v2:172.21.15.171:3300/0 conn(0x7f8ea015bb20 0x7f8ea009a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8e96000640 1 --2- 172.21.15.32:0/1666164082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea00cf460 0x7f8ea00c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8e9e000640 1 -- 172.21.15.32:0/1666164082 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232558627 0 0) 0x7f8ea015bf00 con 0x7f8ea00c5920 2024-03-19T06:24:12.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8e9e000640 1 -- 172.21.15.32:0/1666164082 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e84003530 con 0x7f8ea00c5920 2024-03-19T06:24:12.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8e96000640 1 -- 172.21.15.32:0/1666164082 >> v2:172.21.15.171:3300/0 conn(0x7f8ea015bb20 msgr2=0x7f8ea009a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:12.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8e96000640 1 --2- 172.21.15.32:0/1666164082 >> v2:172.21.15.171:3300/0 conn(0x7f8ea015bb20 0x7f8ea009a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8e96000640 1 -- 172.21.15.32:0/1666164082 >> v1:172.21.15.32:6789/0 conn(0x7f8ea00c5920 legacy=0x7f8ea00cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.850+0000 7f8e96000640 1 -- 172.21.15.32:0/1666164082 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea00cc5d0 con 0x7f8ea00cf460 2024-03-19T06:24:12.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.854+0000 7f8e96000640 1 --2- 172.21.15.32:0/1666164082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea00cf460 0x7f8ea00c53e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8e880097c0 tx=0x7f8e8801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f50e98d94e8a5d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:12.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.854+0000 7f8e9e000640 1 -- 172.21.15.32:0/1666164082 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e880a7070 con 0x7f8ea00cf460 2024-03-19T06:24:12.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.854+0000 7f8e9e000640 1 -- 172.21.15.32:0/1666164082 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e880b0070 con 0x7f8ea00cf460 2024-03-19T06:24:12.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.854+0000 7f8e9e000640 1 -- 172.21.15.32:0/1666164082 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e880ab890 con 0x7f8ea00cf460 2024-03-19T06:24:12.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.854+0000 7f8ea5c00640 1 -- 172.21.15.32:0/1666164082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea00cf460 msgr2=0x7f8ea00c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.854+0000 7f8ea5c00640 1 --2- 172.21.15.32:0/1666164082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea00cf460 0x7f8ea00c53e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8e880097c0 tx=0x7f8e8801c470 comp rx=0 tx=0).stop 2024-03-19T06:24:12.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.854+0000 7f8ea5c00640 1 -- 172.21.15.32:0/1666164082 shutdown_connections 2024-03-19T06:24:12.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.854+0000 7f8ea5c00640 1 --2- 172.21.15.32:0/1666164082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea00cf460 0x7f8ea00c53e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.854+0000 7f8ea5c00640 1 --2- 172.21.15.32:0/1666164082 >> v2:172.21.15.171:3300/0 conn(0x7f8ea015bb20 0x7f8ea009a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.854+0000 7f8ea5c00640 1 -- 172.21.15.32:0/1666164082 >> 172.21.15.32:0/1666164082 conn(0x7f8ea00d1890 msgr2=0x7f8ea00d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:12.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.854+0000 7f8ea5c00640 1 -- 172.21.15.32:0/1666164082 shutdown_connections 2024-03-19T06:24:12.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.854+0000 7f8ea5c00640 1 -- 172.21.15.32:0/1666164082 wait complete. 2024-03-19T06:24:12.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8ea5c00640 1 Processor -- start 2024-03-19T06:24:12.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8ea5c00640 1 -- start start 2024-03-19T06:24:12.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8ea5c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea00c5920 0x7f8ea0152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8ea5c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea00cf460 0x7f8ea0151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8ea5c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ea015bb20 0x7f8ea015a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8ea5c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea0168940 con 0x7f8ea00c5920 2024-03-19T06:24:12.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8ea5c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00cf8a0 con 0x7f8ea015bb20 2024-03-19T06:24:12.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8ea5c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea0168ac0 con 0x7f8ea00cf460 2024-03-19T06:24:12.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8e9ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea00c5920 0x7f8ea0152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8e9ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea00c5920 0x7f8ea0152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50128/0 (socket says 172.21.15.32:50128) 2024-03-19T06:24:12.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8e9ea00640 1 -- 172.21.15.32:0/2679238929 learned_addr learned my addr 172.21.15.32:0/2679238929 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:12.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8e96000640 1 --2- 172.21.15.32:0/2679238929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea00cf460 0x7f8ea0151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8e9f400640 1 --2- 172.21.15.32:0/2679238929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ea015bb20 0x7f8ea015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8e9ea00640 1 -- 172.21.15.32:0/2679238929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea00cf460 msgr2=0x7f8ea0151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8e9ea00640 1 --2- 172.21.15.32:0/2679238929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea00cf460 0x7f8ea0151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8e9ea00640 1 -- 172.21.15.32:0/2679238929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ea015bb20 msgr2=0x7f8ea015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:12.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8e9ea00640 1 --2- 172.21.15.32:0/2679238929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ea015bb20 0x7f8ea015a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:12.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8e9ea00640 1 -- 172.21.15.32:0/2679238929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea01521d0 con 0x7f8ea00c5920 2024-03-19T06:24:12.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8e96000640 1 --2- 172.21.15.32:0/2679238929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea00cf460 0x7f8ea0151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:12.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8e9ea00640 1 --2- 172.21.15.32:0/2679238929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea00c5920 0x7f8ea0152f90 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000e870 tx=0x7f8e9000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:12.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8e97400640 1 -- 172.21.15.32:0/2679238929 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e90017070 con 0x7f8ea00c5920 2024-03-19T06:24:12.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8e97400640 1 -- 172.21.15.32:0/2679238929 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9000c940 con 0x7f8ea00c5920 2024-03-19T06:24:12.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8e97400640 1 -- 172.21.15.32:0/2679238929 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000ccf0 con 0x7f8ea00c5920 2024-03-19T06:24:12.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8ea5c00640 1 -- 172.21.15.32:0/2679238929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea01524b0 con 0x7f8ea00c5920 2024-03-19T06:24:12.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.858+0000 7f8ea5c00640 1 -- 172.21.15.32:0/2679238929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea0151c60 con 0x7f8ea00c5920 2024-03-19T06:24:12.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.862+0000 7f8ea5c00640 1 -- 172.21.15.32:0/2679238929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea00749e0 con 0x7f8ea00c5920 2024-03-19T06:24:12.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.862+0000 7f8e97400640 1 -- 172.21.15.32:0/2679238929 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8e9001a070 con 0x7f8ea00c5920 2024-03-19T06:24:12.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.862+0000 7f8e97400640 1 --2- 172.21.15.32:0/2679238929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e7c067660 0x7f8e7c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:12.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.862+0000 7f8e97400640 1 -- 172.21.15.32:0/2679238929 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8e90085820 con 0x7f8ea00c5920 2024-03-19T06:24:12.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.862+0000 7f8e96000640 1 --2- 172.21.15.32:0/2679238929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e7c067660 0x7f8e7c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:12.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.862+0000 7f8e96000640 1 --2- 172.21.15.32:0/2679238929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e7c067660 0x7f8e7c069b20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8e880af000 tx=0x7f8e880a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:12.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:12.866+0000 7f8e97400640 1 -- 172.21.15.32:0/2679238929 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f8e900567a0 con 0x7f8ea00c5920 2024-03-19T06:24:13.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.030+0000 7f8ea5c00640 1 -- 172.21.15.32:0/2679238929 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ea00b7810 con 0x7f8e7c067660 2024-03-19T06:24:13.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.030+0000 7f8e97400640 1 -- 172.21.15.32:0/2679238929 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8ea00b7810 con 0x7f8e7c067660 2024-03-19T06:24:13.019 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 7 to deep-scrub 2024-03-19T06:24:13.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.034+0000 7f8ea5c00640 1 -- 172.21.15.32:0/2679238929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e7c067660 msgr2=0x7f8e7c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:13.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.034+0000 7f8ea5c00640 1 --2- 172.21.15.32:0/2679238929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e7c067660 0x7f8e7c069b20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8e880af000 tx=0x7f8e880a7000 comp rx=0 tx=0).stop 2024-03-19T06:24:13.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.034+0000 7f8ea5c00640 1 -- 172.21.15.32:0/2679238929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea00c5920 msgr2=0x7f8ea0152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:13.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.034+0000 7f8ea5c00640 1 --2- 172.21.15.32:0/2679238929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea00c5920 0x7f8ea0152f90 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000e870 tx=0x7f8e9000ec70 comp rx=0 tx=0).stop 2024-03-19T06:24:13.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.034+0000 7f8ea5c00640 1 -- 172.21.15.32:0/2679238929 shutdown_connections 2024-03-19T06:24:13.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.034+0000 7f8ea5c00640 1 --2- 172.21.15.32:0/2679238929 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f8e7c067660 0x7f8e7c069b20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:13.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.034+0000 7f8ea5c00640 1 --2- 172.21.15.32:0/2679238929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ea015bb20 0x7f8ea015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:13.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.034+0000 7f8ea5c00640 1 --2- 172.21.15.32:0/2679238929 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ea00cf460 0x7f8ea0151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:13.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.034+0000 7f8ea5c00640 1 --2- 172.21.15.32:0/2679238929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea00c5920 0x7f8ea0152f90 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:13.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.034+0000 7f8ea5c00640 1 -- 172.21.15.32:0/2679238929 >> 172.21.15.32:0/2679238929 conn(0x7f8ea00d1890 msgr2=0x7f8ea00c5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:13.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.034+0000 7f8ea5c00640 1 -- 172.21.15.32:0/2679238929 shutdown_connections 2024-03-19T06:24:13.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.034+0000 7f8ea5c00640 1 -- 172.21.15.32:0/2679238929 wait complete. 2024-03-19T06:24:13.041 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:24:13.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.194+0000 7f07d6a00640 1 Processor -- start 2024-03-19T06:24:13.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.194+0000 7f07d6a00640 1 -- start start 2024-03-19T06:24:13.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.194+0000 7f07d6a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f07d015c010 0x7f07d015f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:13.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.194+0000 7f07d6a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d015fe20 con 0x7f07d00aecf0 2024-03-19T06:24:13.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.194+0000 7f07d6a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d0160100 con 0x7f07d006d6c0 2024-03-19T06:24:13.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.194+0000 7f07d6a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d01603e0 con 0x7f07d015c010 2024-03-19T06:24:13.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.194+0000 7f07cfe00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f07d00aecf0 0x7f07d00ca9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:34844/0 (socket says 172.21.15.32:34844) 2024-03-19T06:24:13.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.194+0000 7f07cfe00640 1 -- 172.21.15.32:0/3607816697 learned_addr learned my addr 172.21.15.32:0/3607816697 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:24:13.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.194+0000 7f07c7400640 1 --2- 172.21.15.32:0/3607816697 >> v2:172.21.15.171:3300/0 conn(0x7f07d015c010 0x7f07d015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:13.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.194+0000 7f07cf400640 1 -- 172.21.15.32:0/3607816697 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204558178 0 0) 0x7f07d015fe20 con 0x7f07d00aecf0 2024-03-19T06:24:13.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.194+0000 7f07cf400640 1 -- 172.21.15.32:0/3607816697 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07b4003530 con 0x7f07d00aecf0 2024-03-19T06:24:13.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.194+0000 7f07c7400640 1 -- 172.21.15.32:0/3607816697 >> v1:172.21.15.171:6789/0 conn(0x7f07d006d6c0 legacy=0x7f07d00cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:13.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.194+0000 7f07cf400640 1 -- 172.21.15.32:0/3607816697 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933255798 0 0) 0x7f07d0160100 con 0x7f07d006d6c0 2024-03-19T06:24:13.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.194+0000 7f07c7400640 1 -- 172.21.15.32:0/3607816697 >> v1:172.21.15.32:6789/0 conn(0x7f07d00aecf0 legacy=0x7f07d00ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:13.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.194+0000 7f07c7400640 1 -- 172.21.15.32:0/3607816697 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00ca1f0 con 0x7f07d015c010 2024-03-19T06:24:13.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.198+0000 7f07c7400640 1 --2- 172.21.15.32:0/3607816697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07d015c010 0x7f07d015f520 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f07b80097c0 tx=0x7f07b801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a94d30ab703ad0a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:13.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.198+0000 7f07cf400640 1 -- 172.21.15.32:0/3607816697 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b80b0070 con 0x7f07d015c010 2024-03-19T06:24:13.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.198+0000 7f07cf400640 1 -- 172.21.15.32:0/3607816697 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b80ab600 con 0x7f07d015c010 2024-03-19T06:24:13.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.198+0000 7f07cf400640 1 -- 172.21.15.32:0/3607816697 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b80ab9d0 con 0x7f07d015c010 2024-03-19T06:24:13.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.198+0000 7f07d6a00640 1 -- 172.21.15.32:0/3607816697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07d015c010 msgr2=0x7f07d015f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:13.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.198+0000 7f07d6a00640 1 --2- 172.21.15.32:0/3607816697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07d015c010 0x7f07d015f520 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f07b80097c0 tx=0x7f07b801c410 comp rx=0 tx=0).stop 2024-03-19T06:24:13.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.198+0000 7f07d6a00640 1 -- 172.21.15.32:0/3607816697 shutdown_connections 2024-03-19T06:24:13.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.198+0000 7f07d6a00640 1 --2- 172.21.15.32:0/3607816697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07d015c010 0x7f07d015f520 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:13.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.198+0000 7f07d6a00640 1 -- 172.21.15.32:0/3607816697 >> 172.21.15.32:0/3607816697 conn(0x7f07d00b1280 msgr2=0x7f07d00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:13.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.198+0000 7f07d6a00640 1 -- 172.21.15.32:0/3607816697 shutdown_connections 2024-03-19T06:24:13.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.198+0000 7f07d6a00640 1 -- 172.21.15.32:0/3607816697 wait complete. 2024-03-19T06:24:13.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07d6a00640 1 Processor -- start 2024-03-19T06:24:13.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07d6a00640 1 -- start start 2024-03-19T06:24:13.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07d6a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07d006d6c0 0x7f07d00ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:13.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07d6a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07d00aecf0 0x7f07d015df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:13.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07d6a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07d015c010 0x7f07d0155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:13.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07d6a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d016a030 con 0x7f07d00aecf0 2024-03-19T06:24:13.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07d6a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d0169eb0 con 0x7f07d015c010 2024-03-19T06:24:13.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07d6a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d016a1b0 con 0x7f07d006d6c0 2024-03-19T06:24:13.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07c7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07d00aecf0 0x7f07d015df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:13.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07c7400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07d00aecf0 0x7f07d015df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50138/0 (socket says 172.21.15.32:50138) 2024-03-19T06:24:13.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07c7400640 1 -- 172.21.15.32:0/3195561518 learned_addr learned my addr 172.21.15.32:0/3195561518 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:13.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07cfe00640 1 --2- 172.21.15.32:0/3195561518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07d006d6c0 0x7f07d00ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:13.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07d4a00640 1 --2- 172.21.15.32:0/3195561518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07d015c010 0x7f07d0155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:13.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07c7400640 1 -- 172.21.15.32:0/3195561518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07d006d6c0 msgr2=0x7f07d00ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:13.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07c7400640 1 --2- 172.21.15.32:0/3195561518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07d006d6c0 0x7f07d00ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:13.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07c7400640 1 -- 172.21.15.32:0/3195561518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07d015c010 msgr2=0x7f07d0155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:13.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07c7400640 1 --2- 172.21.15.32:0/3195561518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07d015c010 0x7f07d0155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:13.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07c7400640 1 -- 172.21.15.32:0/3195561518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00b26c0 con 0x7f07d00aecf0 2024-03-19T06:24:13.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07d4a00640 1 --2- 172.21.15.32:0/3195561518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07d015c010 0x7f07d0155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:13.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07c7400640 1 --2- 172.21.15.32:0/3195561518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07d00aecf0 0x7f07d015df40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f07b80ae040 tx=0x7f07b80191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:13.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07ccc00640 1 -- 172.21.15.32:0/3195561518 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b80b8070 con 0x7f07d00aecf0 2024-03-19T06:24:13.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07ccc00640 1 -- 172.21.15.32:0/3195561518 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b8004020 con 0x7f07d00aecf0 2024-03-19T06:24:13.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07ccc00640 1 -- 172.21.15.32:0/3195561518 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b80b0040 con 0x7f07d00aecf0 2024-03-19T06:24:13.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07d6a00640 1 -- 172.21.15.32:0/3195561518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d00b29a0 con 0x7f07d00aecf0 2024-03-19T06:24:13.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.202+0000 7f07d6a00640 1 -- 172.21.15.32:0/3195561518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d00b32b0 con 0x7f07d00aecf0 2024-03-19T06:24:13.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.206+0000 7f07d6a00640 1 -- 172.21.15.32:0/3195561518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d00749e0 con 0x7f07d00aecf0 2024-03-19T06:24:13.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.206+0000 7f07ccc00640 1 -- 172.21.15.32:0/3195561518 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f07b8003620 con 0x7f07d00aecf0 2024-03-19T06:24:13.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.206+0000 7f07ccc00640 1 --2- 172.21.15.32:0/3195561518 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f07ac067660 0x7f07ac069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:13.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.206+0000 7f07ccc00640 1 -- 172.21.15.32:0/3195561518 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f07b811f0c0 con 0x7f07d00aecf0 2024-03-19T06:24:13.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.206+0000 7f07cfe00640 1 --2- 172.21.15.32:0/3195561518 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f07ac067660 0x7f07ac069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:13.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.206+0000 7f07cfe00640 1 --2- 172.21.15.32:0/3195561518 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f07ac067660 0x7f07ac069b20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f07c0007fd0 tx=0x7f07c0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:13.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.210+0000 7f07ccc00640 1 -- 172.21.15.32:0/3195561518 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f07b8016090 con 0x7f07d00aecf0 2024-03-19T06:24:13.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.374+0000 7f07d6a00640 1 -- 172.21.15.32:0/3195561518 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07d0156f20 con 0x7f07ac067660 2024-03-19T06:24:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.374+0000 7f07ccc00640 1 -- 172.21.15.32:0/3195561518 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13352 (secure 0 0 0) 0x7f07d0156f20 con 0x7f07ac067660 2024-03-19T06:24:13.363 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:24:13.364 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:24:13.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.378+0000 7f07d6a00640 1 -- 172.21.15.32:0/3195561518 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f07ac067660 msgr2=0x7f07ac069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:13.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.378+0000 7f07d6a00640 1 --2- 172.21.15.32:0/3195561518 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f07ac067660 0x7f07ac069b20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f07c0007fd0 tx=0x7f07c0009040 comp rx=0 tx=0).stop 2024-03-19T06:24:13.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.378+0000 7f07d6a00640 1 -- 172.21.15.32:0/3195561518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07d00aecf0 msgr2=0x7f07d015df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:13.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.378+0000 7f07d6a00640 1 --2- 172.21.15.32:0/3195561518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07d00aecf0 0x7f07d015df40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f07b80ae040 tx=0x7f07b80191b0 comp rx=0 tx=0).stop 2024-03-19T06:24:13.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.378+0000 7f07d6a00640 1 -- 172.21.15.32:0/3195561518 shutdown_connections 2024-03-19T06:24:13.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.378+0000 7f07d6a00640 1 --2- 172.21.15.32:0/3195561518 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f07ac067660 0x7f07ac069b20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:13.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.378+0000 7f07d6a00640 1 --2- 172.21.15.32:0/3195561518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07d015c010 0x7f07d0155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:13.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.378+0000 7f07d6a00640 1 --2- 172.21.15.32:0/3195561518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07d00aecf0 0x7f07d015df40 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:13.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.378+0000 7f07d6a00640 1 --2- 172.21.15.32:0/3195561518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07d006d6c0 0x7f07d00ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:13.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.378+0000 7f07d6a00640 1 -- 172.21.15.32:0/3195561518 >> 172.21.15.32:0/3195561518 conn(0x7f07d00b1280 msgr2=0x7f07d00c8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:13.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.378+0000 7f07d6a00640 1 -- 172.21.15.32:0/3195561518 shutdown_connections 2024-03-19T06:24:13.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:13.378+0000 7f07d6a00640 1 -- 172.21.15.32:0/3195561518 wait complete. 2024-03-19T06:24:13.384 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-03-19T06:24:11.965089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":239184,"kb_used_data":6376,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735536,"statfs":{"total":773094113280,"available":772849188864,"internally_reserved":0,"allocated":6529024,"data_stored":3401968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.746933"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":233,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-19T06:24:03.228379+0000","last_change":"2024-03-19T06:20:57.499108+0000","last_active":"2024-03-19T06:24:03.228379+0000","last_peered":"2024-03-19T06:24:03.228379+0000","last_clean":"2024-03-19T06:24:03.228379+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:24:03.228379+0000","last_undegraded":"2024-03-19T06:24:03.228379+0000","last_fullsized":"2024-03-19T06:24:03.228379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:20:56.356014+0000","last_clean_scrub_stamp":"2024-03-19T06:20:56.356014+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:07.180524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1261568,"data_stored":868022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31832,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31832,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509482,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1261568,"data_stored":868022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31836,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:24:13.387 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-19T06:20:56.356014+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=20, tm_sec=56, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=24, tm_sec=7, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:24:13.387 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-19T06:24:33.389 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:24:33.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.554+0000 7ffa97a00640 1 Processor -- start 2024-03-19T06:24:33.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.554+0000 7ffa97a00640 1 -- start start 2024-03-19T06:24:33.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.554+0000 7ffa97a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffa90099a70 0x7ffa90099e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:33.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.554+0000 7ffa97a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffa900700a0 0x7ffa900704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:33.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.554+0000 7ffa97a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9006fbe0 con 0x7ffa9006c060 2024-03-19T06:24:33.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.554+0000 7ffa97a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9015e720 con 0x7ffa900700a0 2024-03-19T06:24:33.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.554+0000 7ffa97a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9009a390 con 0x7ffa90099a70 2024-03-19T06:24:33.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.554+0000 7ffa87e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ffa9006c060 0x7ffa9015e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47746/0 (socket says 172.21.15.32:47746) 2024-03-19T06:24:33.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.554+0000 7ffa87e00640 1 -- 172.21.15.32:0/3738966822 learned_addr learned my addr 172.21.15.32:0/3738966822 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:24:33.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.554+0000 7ffa95a00640 1 --2- 172.21.15.32:0/3738966822 >> v2:172.21.15.32:3300/0 conn(0x7ffa900700a0 0x7ffa900704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.554+0000 7ffa95000640 1 --2- 172.21.15.32:0/3738966822 >> v2:172.21.15.171:3300/0 conn(0x7ffa90099a70 0x7ffa90099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.554+0000 7ffa95a00640 1 -- 172.21.15.32:0/3738966822 >> v2:172.21.15.171:3300/0 conn(0x7ffa90099a70 msgr2=0x7ffa90099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.554+0000 7ffa95a00640 1 --2- 172.21.15.32:0/3738966822 >> v2:172.21.15.171:3300/0 conn(0x7ffa90099a70 0x7ffa90099e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.554+0000 7ffa95a00640 1 -- 172.21.15.32:0/3738966822 >> v1:172.21.15.32:6789/0 conn(0x7ffa9006c060 legacy=0x7ffa9015e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:33.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.554+0000 7ffa95a00640 1 -- 172.21.15.32:0/3738966822 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9015e940 con 0x7ffa900700a0 2024-03-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.558+0000 7ffa95a00640 1 --2- 172.21.15.32:0/3738966822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa900700a0 0x7ffa900704d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ffa900725b0 tx=0x7ffa8801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f36b9bc86ddc94e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.558+0000 7ffa8fe00640 1 -- 172.21.15.32:0/3738966822 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880b2070 con 0x7ffa900700a0 2024-03-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.558+0000 7ffa8fe00640 1 -- 172.21.15.32:0/3738966822 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa880a58e0 con 0x7ffa900700a0 2024-03-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.558+0000 7ffa8fe00640 1 -- 172.21.15.32:0/3738966822 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880a5cb0 con 0x7ffa900700a0 2024-03-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.558+0000 7ffa97a00640 1 -- 172.21.15.32:0/3738966822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa900700a0 msgr2=0x7ffa900704d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.558+0000 7ffa97a00640 1 --2- 172.21.15.32:0/3738966822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa900700a0 0x7ffa900704d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ffa900725b0 tx=0x7ffa8801c930 comp rx=0 tx=0).stop 2024-03-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.558+0000 7ffa97a00640 1 -- 172.21.15.32:0/3738966822 shutdown_connections 2024-03-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.558+0000 7ffa97a00640 1 --2- 172.21.15.32:0/3738966822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa900700a0 0x7ffa900704d0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.558+0000 7ffa97a00640 1 --2- 172.21.15.32:0/3738966822 >> v2:172.21.15.171:3300/0 conn(0x7ffa90099a70 0x7ffa90099e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.558+0000 7ffa97a00640 1 -- 172.21.15.32:0/3738966822 >> 172.21.15.32:0/3738966822 conn(0x7ffa900b3300 msgr2=0x7ffa900b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:33.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.558+0000 7ffa97a00640 1 -- 172.21.15.32:0/3738966822 shutdown_connections 2024-03-19T06:24:33.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.558+0000 7ffa97a00640 1 -- 172.21.15.32:0/3738966822 wait complete. 2024-03-19T06:24:33.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa97a00640 1 Processor -- start 2024-03-19T06:24:33.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa97a00640 1 -- start start 2024-03-19T06:24:33.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa97a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa9006c060 0x7ffa9015a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:33.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa97a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa900700a0 0x7ffa9015ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:33.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa97a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa90099a70 0x7ffa90151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:33.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa97a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9016ac00 con 0x7ffa9006c060 2024-03-19T06:24:33.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa97a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9009a760 con 0x7ffa90099a70 2024-03-19T06:24:33.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa97a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9016ad80 con 0x7ffa900700a0 2024-03-19T06:24:33.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa95000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa9006c060 0x7ffa9015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:33.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa95000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa9006c060 0x7ffa9015a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39184/0 (socket says 172.21.15.32:39184) 2024-03-19T06:24:33.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa95000640 1 -- 172.21.15.32:0/266640806 learned_addr learned my addr 172.21.15.32:0/266640806 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:33.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa87e00640 1 --2- 172.21.15.32:0/266640806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa900700a0 0x7ffa9015ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:33.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa95a00640 1 --2- 172.21.15.32:0/266640806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa90099a70 0x7ffa90151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:33.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa95000640 1 -- 172.21.15.32:0/266640806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa900700a0 msgr2=0x7ffa9015ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:33.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa95000640 1 --2- 172.21.15.32:0/266640806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa900700a0 0x7ffa9015ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:33.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa95000640 1 -- 172.21.15.32:0/266640806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa90099a70 msgr2=0x7ffa90151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:33.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa95000640 1 --2- 172.21.15.32:0/266640806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa90099a70 0x7ffa90151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:33.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa95000640 1 -- 172.21.15.32:0/266640806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa901593c0 con 0x7ffa9006c060 2024-03-19T06:24:33.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa87e00640 1 --2- 172.21.15.32:0/266640806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa900700a0 0x7ffa9015ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:24:33.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa95000640 1 --2- 172.21.15.32:0/266640806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa9006c060 0x7ffa9015a420 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000d800 tx=0x7ffa8000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:33.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa8d600640 1 -- 172.21.15.32:0/266640806 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000b6c0 con 0x7ffa9006c060 2024-03-19T06:24:33.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa8d600640 1 -- 172.21.15.32:0/266640806 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa80019070 con 0x7ffa9006c060 2024-03-19T06:24:33.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa8d600640 1 -- 172.21.15.32:0/266640806 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000ba60 con 0x7ffa9006c060 2024-03-19T06:24:33.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa97a00640 1 -- 172.21.15.32:0/266640806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa90159660 con 0x7ffa9006c060 2024-03-19T06:24:33.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.562+0000 7ffa97a00640 1 -- 172.21.15.32:0/266640806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa90159c20 con 0x7ffa9006c060 2024-03-19T06:24:33.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.566+0000 7ffa97a00640 1 -- 172.21.15.32:0/266640806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa900749e0 con 0x7ffa9006c060 2024-03-19T06:24:33.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.566+0000 7ffa8d600640 1 -- 172.21.15.32:0/266640806 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ffa8000bc00 con 0x7ffa9006c060 2024-03-19T06:24:33.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.566+0000 7ffa8d600640 1 --2- 172.21.15.32:0/266640806 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffa6c067660 0x7ffa6c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:33.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.566+0000 7ffa8d600640 1 -- 172.21.15.32:0/266640806 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffa80085a10 con 0x7ffa9006c060 2024-03-19T06:24:33.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.566+0000 7ffa87e00640 1 --2- 172.21.15.32:0/266640806 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffa6c067660 0x7ffa6c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:33.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.566+0000 7ffa87e00640 1 --2- 172.21.15.32:0/266640806 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffa6c067660 0x7ffa6c069b20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ffa901527d0 tx=0x7ffa78009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:33.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.570+0000 7ffa8d600640 1 -- 172.21.15.32:0/266640806 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7ffa800568f0 con 0x7ffa9006c060 2024-03-19T06:24:33.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.730+0000 7ffa97a00640 1 -- 172.21.15.32:0/266640806 --> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa901689d0 con 0x7ffa6c067660 2024-03-19T06:24:33.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.734+0000 7ffa8d600640 1 -- 172.21.15.32:0/266640806 <== mgr.4109 v2:172.21.15.171:6832/2098850483 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13359 (secure 0 0 0) 0x7ffa901689d0 con 0x7ffa6c067660 2024-03-19T06:24:33.721 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:24:33.722 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-03-19T06:24:33.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.734+0000 7ffa97a00640 1 -- 172.21.15.32:0/266640806 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffa6c067660 msgr2=0x7ffa6c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:33.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.734+0000 7ffa97a00640 1 --2- 172.21.15.32:0/266640806 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffa6c067660 0x7ffa6c069b20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ffa901527d0 tx=0x7ffa78009040 comp rx=0 tx=0).stop 2024-03-19T06:24:33.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.734+0000 7ffa97a00640 1 -- 172.21.15.32:0/266640806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa9006c060 msgr2=0x7ffa9015a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:33.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.734+0000 7ffa97a00640 1 --2- 172.21.15.32:0/266640806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa9006c060 0x7ffa9015a420 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000d800 tx=0x7ffa8000dcc0 comp rx=0 tx=0).stop 2024-03-19T06:24:33.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.734+0000 7ffa97a00640 1 -- 172.21.15.32:0/266640806 shutdown_connections 2024-03-19T06:24:33.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.734+0000 7ffa97a00640 1 --2- 172.21.15.32:0/266640806 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7ffa6c067660 0x7ffa6c069b20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:33.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.734+0000 7ffa97a00640 1 --2- 172.21.15.32:0/266640806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa90099a70 0x7ffa90151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:33.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.734+0000 7ffa97a00640 1 --2- 172.21.15.32:0/266640806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa900700a0 0x7ffa9015ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:33.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.734+0000 7ffa97a00640 1 --2- 172.21.15.32:0/266640806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa9006c060 0x7ffa9015a420 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:33.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.734+0000 7ffa97a00640 1 -- 172.21.15.32:0/266640806 >> 172.21.15.32:0/266640806 conn(0x7ffa900b3300 msgr2=0x7ffa900b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:33.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.734+0000 7ffa97a00640 1 -- 172.21.15.32:0/266640806 shutdown_connections 2024-03-19T06:24:33.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.734+0000 7ffa97a00640 1 -- 172.21.15.32:0/266640806 wait complete. 2024-03-19T06:24:33.743 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-03-19T06:24:31.969962+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":239176,"kb_used_data":6376,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735544,"statfs":{"total":773094113280,"available":772849197056,"internally_reserved":0,"allocated":6529024,"data_stored":3401968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002738"},"pg_stats":[{"pgid":"1.0","version":"56'119","reported_seq":244,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-19T06:24:13.400025+0000","last_change":"2024-03-19T06:24:13.400082+0000","last_active":"2024-03-19T06:24:13.400025+0000","last_peered":"2024-03-19T06:24:13.400025+0000","last_clean":"2024-03-19T06:24:13.400025+0000","last_became_active":"2024-03-19T06:20:57.498182+0000","last_became_peered":"2024-03-19T06:20:57.498182+0000","last_unstale":"2024-03-19T06:24:13.400025+0000","last_undegraded":"2024-03-19T06:24:13.400025+0000","last_fullsized":"2024-03-19T06:24:13.400025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'119","last_scrub_stamp":"2024-03-19T06:24:13.399919+0000","last_deep_scrub":"56'119","last_deep_scrub_stamp":"2024-03-19T06:24:13.399919+0000","last_clean_scrub_stamp":"2024-03-19T06:24:13.399919+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:01:04.997484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1261568,"data_stored":868022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31832,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31832,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1261568,"data_stored":868022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31836,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":667648,"data_stored":277654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:24:33.745 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-19T06:24:33.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.894+0000 7f7626000640 1 Processor -- start 2024-03-19T06:24:33.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.894+0000 7f7626000640 1 -- start start 2024-03-19T06:24:33.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f7626000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762009a180 0x7f762015fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:33.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f7626000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f762009a760 0x7f76200b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:33.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f7626000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76200cf460 con 0x7f762015b9b0 2024-03-19T06:24:33.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f7626000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76200ccd50 con 0x7f762009a760 2024-03-19T06:24:33.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f7626000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76200cc420 con 0x7f762009a180 2024-03-19T06:24:33.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f7624c00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f762015b9b0 0x7f7620099a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47750/0 (socket says 172.21.15.32:47750) 2024-03-19T06:24:33.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f7624c00640 1 -- 172.21.15.32:0/2166443355 learned_addr learned my addr 172.21.15.32:0/2166443355 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:24:33.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761fe00640 1 --2- 172.21.15.32:0/2166443355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762009a180 0x7f762015fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:33.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f7625600640 1 --2- 172.21.15.32:0/2166443355 >> v2:172.21.15.171:3300/0 conn(0x7f762009a760 0x7f76200b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:33.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761f400640 1 -- 172.21.15.32:0/2166443355 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831414498 0 0) 0x7f76200cf460 con 0x7f762015b9b0 2024-03-19T06:24:33.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761f400640 1 -- 172.21.15.32:0/2166443355 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7608003530 con 0x7f762015b9b0 2024-03-19T06:24:33.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761f400640 1 -- 172.21.15.32:0/2166443355 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2933766047 0 0) 0x7f7608003530 con 0x7f762015b9b0 2024-03-19T06:24:33.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761f400640 1 -- 172.21.15.32:0/2166443355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762009a180 msgr2=0x7f762015fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:33.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761f400640 1 --2- 172.21.15.32:0/2166443355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762009a180 0x7f762015fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:33.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761f400640 1 -- 172.21.15.32:0/2166443355 >> v2:172.21.15.171:3300/0 conn(0x7f762009a760 msgr2=0x7f76200b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:33.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761f400640 1 --2- 172.21.15.32:0/2166443355 >> v2:172.21.15.171:3300/0 conn(0x7f762009a760 0x7f76200b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:33.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761f400640 1 -- 172.21.15.32:0/2166443355 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76200cc700 con 0x7f762015b9b0 2024-03-19T06:24:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761f400640 1 -- 172.21.15.32:0/2166443355 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3548685928 0 0) 0x7f7614001680 con 0x7f762015b9b0 2024-03-19T06:24:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761f400640 1 -- 172.21.15.32:0/2166443355 >> v1:172.21.15.32:6789/0 conn(0x7f762015b9b0 legacy=0x7f7620099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761f400640 1 --2- 172.21.15.32:0/2166443355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76080039c0 0x7f7608003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761f400640 1 --2- 172.21.15.32:0/2166443355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762009a180 0x7f7608004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761f400640 1 --2- 172.21.15.32:0/2166443355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7608004d50 0x7f76080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761f400640 1 -- 172.21.15.32:0/2166443355 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76200ccd50 con 0x7f76080039c0 2024-03-19T06:24:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761f400640 1 -- 172.21.15.32:0/2166443355 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76200cc420 con 0x7f7608004d50 2024-03-19T06:24:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761f400640 1 -- 172.21.15.32:0/2166443355 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760800ba50 con 0x7f762009a180 2024-03-19T06:24:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f7624c00640 1 --2- 172.21.15.32:0/2166443355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76080039c0 0x7f7608003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:33.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f761fe00640 1 --2- 172.21.15.32:0/2166443355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762009a180 0x7f7608004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:33.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f7625600640 1 --2- 172.21.15.32:0/2166443355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7608004d50 0x7f76080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:33.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f7624c00640 1 -- 172.21.15.32:0/2166443355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762009a180 msgr2=0x7f7608004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:33.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f7624c00640 1 --2- 172.21.15.32:0/2166443355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f762009a180 0x7f7608004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:33.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f7624c00640 1 -- 172.21.15.32:0/2166443355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7608004d50 msgr2=0x7f76080051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:24:33.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f7624c00640 1 --2- 172.21.15.32:0/2166443355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7608004d50 0x7f76080051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:33.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.898+0000 7f7624c00640 1 -- 172.21.15.32:0/2166443355 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7608003530 con 0x7f76080039c0 2024-03-19T06:24:33.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.902+0000 7f7624c00640 1 --2- 172.21.15.32:0/2166443355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76080039c0 0x7f7608003de0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f761400c240 tx=0x7f761401cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b81e1d26a32fa8 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:33.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.902+0000 7f761f400640 1 -- 172.21.15.32:0/2166443355 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7614007d60 con 0x7f76080039c0 2024-03-19T06:24:33.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.902+0000 7f761f400640 1 -- 172.21.15.32:0/2166443355 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76140a9020 con 0x7f76080039c0 2024-03-19T06:24:33.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.902+0000 7f761f400640 1 -- 172.21.15.32:0/2166443355 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7614005ae0 con 0x7f76080039c0 2024-03-19T06:24:33.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.902+0000 7f7626000640 1 -- 172.21.15.32:0/2166443355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76080039c0 msgr2=0x7f7608003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:33.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.902+0000 7f7626000640 1 --2- 172.21.15.32:0/2166443355 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76080039c0 0x7f7608003de0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f761400c240 tx=0x7f761401cc90 comp rx=0 tx=0).stop 2024-03-19T06:24:33.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.902+0000 7f7625600640 1 -- 172.21.15.32:0/2166443355 reap_dead start 2024-03-19T06:24:33.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.902+0000 7f7626000640 1 -- 172.21.15.32:0/2166443355 shutdown_connections 2024-03-19T06:24:33.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.902+0000 7f7626000640 1 -- 172.21.15.32:0/2166443355 >> 172.21.15.32:0/2166443355 conn(0x7f76200b3110 msgr2=0x7f76200b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:33.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.902+0000 7f7626000640 1 -- 172.21.15.32:0/2166443355 shutdown_connections 2024-03-19T06:24:33.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.902+0000 7f7626000640 1 -- 172.21.15.32:0/2166443355 wait complete. 2024-03-19T06:24:33.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.902+0000 7f7626000640 1 Processor -- start 2024-03-19T06:24:33.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.902+0000 7f7626000640 1 -- start start 2024-03-19T06:24:33.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7626000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76080039c0 0x7f762015a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:33.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7626000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76200ca7e0 0x7f7620149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:33.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7626000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76200cac60 0x7f7620149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:33.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7626000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7620166880 con 0x7f76080039c0 2024-03-19T06:24:33.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7626000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7620166700 con 0x7f76200cac60 2024-03-19T06:24:33.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7626000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7620166a00 con 0x7f76200ca7e0 2024-03-19T06:24:33.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7624c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76080039c0 0x7f762015a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:33.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7624c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76080039c0 0x7f762015a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39204/0 (socket says 172.21.15.32:39204) 2024-03-19T06:24:33.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7624c00640 1 -- 172.21.15.32:0/2110603825 learned_addr learned my addr 172.21.15.32:0/2110603825 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:33.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7625600640 1 --2- 172.21.15.32:0/2110603825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76200cac60 0x7f7620149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:33.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f761fe00640 1 --2- 172.21.15.32:0/2110603825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76200ca7e0 0x7f7620149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:33.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7624c00640 1 -- 172.21.15.32:0/2110603825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76200ca7e0 msgr2=0x7f7620149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:33.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7624c00640 1 --2- 172.21.15.32:0/2110603825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76200ca7e0 0x7f7620149840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:33.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7624c00640 1 -- 172.21.15.32:0/2110603825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76200cac60 msgr2=0x7f7620149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:33.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7624c00640 1 --2- 172.21.15.32:0/2110603825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76200cac60 0x7f7620149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:33.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7624c00640 1 -- 172.21.15.32:0/2110603825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76200cb780 con 0x7f76080039c0 2024-03-19T06:24:33.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7624c00640 1 --2- 172.21.15.32:0/2110603825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76080039c0 0x7f762015a7e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7614000c10 tx=0x7f7608005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:33.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f761cc00640 1 -- 172.21.15.32:0/2110603825 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7614001ca0 con 0x7f76080039c0 2024-03-19T06:24:33.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f761cc00640 1 -- 172.21.15.32:0/2110603825 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76140a5a80 con 0x7f76080039c0 2024-03-19T06:24:33.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7626000640 1 -- 172.21.15.32:0/2110603825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76200cb1c0 con 0x7f76080039c0 2024-03-19T06:24:33.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f761cc00640 1 -- 172.21.15.32:0/2110603825 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76140a5e50 con 0x7f76080039c0 2024-03-19T06:24:33.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7626000640 1 -- 172.21.15.32:0/2110603825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76200c51f0 con 0x7f76080039c0 2024-03-19T06:24:33.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.906+0000 7f7626000640 1 -- 172.21.15.32:0/2110603825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7620075090 con 0x7f76080039c0 2024-03-19T06:24:33.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.910+0000 7f761cc00640 1 -- 172.21.15.32:0/2110603825 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f76140047f0 con 0x7f76080039c0 2024-03-19T06:24:33.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.910+0000 7f761cc00640 1 --2- 172.21.15.32:0/2110603825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7600067800 0x7f7600069cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:33.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.910+0000 7f761cc00640 1 -- 172.21.15.32:0/2110603825 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f761411f210 con 0x7f76080039c0 2024-03-19T06:24:33.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.910+0000 7f761fe00640 1 --2- 172.21.15.32:0/2110603825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7600067800 0x7f7600069cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:33.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.910+0000 7f761fe00640 1 --2- 172.21.15.32:0/2110603825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7600067800 0x7f7600069cc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f762015b2b0 tx=0x7f760c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:33.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:33.914+0000 7f761cc00640 1 -- 172.21.15.32:0/2110603825 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7f76140169d0 con 0x7f76080039c0 2024-03-19T06:24:34.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.078+0000 7f7626000640 1 -- 172.21.15.32:0/2110603825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f76200d1060 con 0x7f76080039c0 2024-03-19T06:24:34.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.082+0000 7f761cc00640 1 -- 172.21.15.32:0/2110603825 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7f76140f00f0 con 0x7f76080039c0 2024-03-19T06:24:34.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.082+0000 7f761cc00640 1 -- 172.21.15.32:0/2110603825 <== mon.0 v2:172.21.15.32:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f76140ef9f0 con 0x7f76080039c0 2024-03-19T06:24:34.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.086+0000 7f7626000640 1 -- 172.21.15.32:0/2110603825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7600067800 msgr2=0x7f7600069cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:34.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.086+0000 7f7626000640 1 --2- 172.21.15.32:0/2110603825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7600067800 0x7f7600069cc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f762015b2b0 tx=0x7f760c009190 comp rx=0 tx=0).stop 2024-03-19T06:24:34.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.086+0000 7f7626000640 1 -- 172.21.15.32:0/2110603825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76080039c0 msgr2=0x7f762015a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:34.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.086+0000 7f7626000640 1 --2- 172.21.15.32:0/2110603825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76080039c0 0x7f762015a7e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7614000c10 tx=0x7f7608005840 comp rx=0 tx=0).stop 2024-03-19T06:24:34.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.086+0000 7f7626000640 1 -- 172.21.15.32:0/2110603825 shutdown_connections 2024-03-19T06:24:34.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.086+0000 7f7626000640 1 --2- 172.21.15.32:0/2110603825 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7f7600067800 0x7f7600069cc0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:34.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.086+0000 7f7626000640 1 --2- 172.21.15.32:0/2110603825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76200cac60 0x7f7620149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:34.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.086+0000 7f7626000640 1 --2- 172.21.15.32:0/2110603825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76200ca7e0 0x7f7620149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:34.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.086+0000 7f7626000640 1 --2- 172.21.15.32:0/2110603825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76080039c0 0x7f762015a7e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:34.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.086+0000 7f7626000640 1 -- 172.21.15.32:0/2110603825 >> 172.21.15.32:0/2110603825 conn(0x7f76200b3110 msgr2=0x7f762006f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:34.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.086+0000 7f7626000640 1 -- 172.21.15.32:0/2110603825 shutdown_connections 2024-03-19T06:24:34.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.086+0000 7f7626000640 1 -- 172.21.15.32:0/2110603825 wait complete. 2024-03-19T06:24:34.092 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-19T06:24:34.093 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:24:34.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.246+0000 7fe1bde00640 1 Processor -- start 2024-03-19T06:24:34.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.246+0000 7fe1bde00640 1 -- start start 2024-03-19T06:24:34.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.246+0000 7fe1bde00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe1b80700f0 0x7fe1b80cc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:34.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.246+0000 7fe1bde00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b806e550 con 0x7fe1b806c460 2024-03-19T06:24:34.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.246+0000 7fe1bde00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b80b49b0 con 0x7fe1b815bbf0 2024-03-19T06:24:34.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.246+0000 7fe1bde00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b80cc690 con 0x7fe1b80700f0 2024-03-19T06:24:34.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.246+0000 7fe1ae000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe1b806c460 0x7fe1b815bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47766/0 (socket says 172.21.15.32:47766) 2024-03-19T06:24:34.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.246+0000 7fe1ae000640 1 -- 172.21.15.32:0/4256054593 learned_addr learned my addr 172.21.15.32:0/4256054593 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-03-19T06:24:34.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.246+0000 7fe1b7400640 1 --2- 172.21.15.32:0/4256054593 >> v2:172.21.15.171:3300/0 conn(0x7fe1b80700f0 0x7fe1b80cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:34.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.246+0000 7fe1b6000640 1 -- 172.21.15.32:0/4256054593 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277949937 0 0) 0x7fe1b806e550 con 0x7fe1b806c460 2024-03-19T06:24:34.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.250+0000 7fe1b6000640 1 -- 172.21.15.32:0/4256054593 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe19c003530 con 0x7fe1b806c460 2024-03-19T06:24:34.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.250+0000 7fe1b6000640 1 -- 172.21.15.32:0/4256054593 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099802758 0 0) 0x7fe1b80b49b0 con 0x7fe1b815bbf0 2024-03-19T06:24:34.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.250+0000 7fe1b6000640 1 -- 172.21.15.32:0/4256054593 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1b806e550 con 0x7fe1b815bbf0 2024-03-19T06:24:34.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.250+0000 7fe1b7400640 1 -- 172.21.15.32:0/4256054593 >> v1:172.21.15.171:6789/0 conn(0x7fe1b815bbf0 legacy=0x7fe1b806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:34.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.250+0000 7fe1b7400640 1 -- 172.21.15.32:0/4256054593 >> v1:172.21.15.32:6789/0 conn(0x7fe1b806c460 legacy=0x7fe1b815bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:34.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.250+0000 7fe1b7400640 1 -- 172.21.15.32:0/4256054593 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b80b4c90 con 0x7fe1b80700f0 2024-03-19T06:24:34.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.250+0000 7fe1b7400640 1 --2- 172.21.15.32:0/4256054593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1b80700f0 0x7fe1b80cc150 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00097c0 tx=0x7fe1b001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7133f5cccfceb09f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:34.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.250+0000 7fe1b6000640 1 -- 172.21.15.32:0/4256054593 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00b0070 con 0x7fe1b80700f0 2024-03-19T06:24:34.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.250+0000 7fe1b6000640 1 -- 172.21.15.32:0/4256054593 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe1b00ab600 con 0x7fe1b80700f0 2024-03-19T06:24:34.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.250+0000 7fe1b6000640 1 -- 172.21.15.32:0/4256054593 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00ab9f0 con 0x7fe1b80700f0 2024-03-19T06:24:34.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.250+0000 7fe1bde00640 1 -- 172.21.15.32:0/4256054593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1b80700f0 msgr2=0x7fe1b80cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:34.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.250+0000 7fe1bde00640 1 --2- 172.21.15.32:0/4256054593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1b80700f0 0x7fe1b80cc150 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00097c0 tx=0x7fe1b001c410 comp rx=0 tx=0).stop 2024-03-19T06:24:34.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1bde00640 1 -- 172.21.15.32:0/4256054593 shutdown_connections 2024-03-19T06:24:34.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1bde00640 1 --2- 172.21.15.32:0/4256054593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1b80700f0 0x7fe1b80cc150 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:34.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1bde00640 1 -- 172.21.15.32:0/4256054593 >> 172.21.15.32:0/4256054593 conn(0x7fe1b8071c50 msgr2=0x7fe1b8072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:34.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1bde00640 1 -- 172.21.15.32:0/4256054593 shutdown_connections 2024-03-19T06:24:34.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1bde00640 1 -- 172.21.15.32:0/4256054593 wait complete. 2024-03-19T06:24:34.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1bde00640 1 Processor -- start 2024-03-19T06:24:34.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1bde00640 1 -- start start 2024-03-19T06:24:34.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1bde00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1b806c460 0x7fe1b8156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:34.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1bde00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1b80700f0 0x7fe1b8147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:34.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1bde00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1b815bbf0 0x7fe1b8158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:34.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1bde00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b815d280 con 0x7fe1b80700f0 2024-03-19T06:24:34.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1bde00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b815d100 con 0x7fe1b806c460 2024-03-19T06:24:34.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1bde00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b81591d0 con 0x7fe1b815bbf0 2024-03-19T06:24:34.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1ae000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1b80700f0 0x7fe1b8147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:34.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1ae000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1b80700f0 0x7fe1b8147230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39220/0 (socket says 172.21.15.32:39220) 2024-03-19T06:24:34.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1ae000640 1 -- 172.21.15.32:0/2005171740 learned_addr learned my addr 172.21.15.32:0/2005171740 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-03-19T06:24:34.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1b7400640 1 --2- 172.21.15.32:0/2005171740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1b815bbf0 0x7fe1b8158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1b6a00640 1 --2- 172.21.15.32:0/2005171740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1b806c460 0x7fe1b8156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1ae000640 1 -- 172.21.15.32:0/2005171740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1b815bbf0 msgr2=0x7fe1b8158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1ae000640 1 --2- 172.21.15.32:0/2005171740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1b815bbf0 0x7fe1b8158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1ae000640 1 -- 172.21.15.32:0/2005171740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1b806c460 msgr2=0x7fe1b8156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1ae000640 1 --2- 172.21.15.32:0/2005171740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1b806c460 0x7fe1b8156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1ae000640 1 -- 172.21.15.32:0/2005171740 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8159430 con 0x7fe1b80700f0 2024-03-19T06:24:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1b7400640 1 --2- 172.21.15.32:0/2005171740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1b815bbf0 0x7fe1b8158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:24:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1b6a00640 1 --2- 172.21.15.32:0/2005171740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1b806c460 0x7fe1b8156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:24:34.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1ae000640 1 --2- 172.21.15.32:0/2005171740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1b80700f0 0x7fe1b8147230 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000cb70 tx=0x7fe1a000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:34.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1afe00640 1 -- 172.21.15.32:0/2005171740 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0017070 con 0x7fe1b80700f0 2024-03-19T06:24:34.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1afe00640 1 -- 172.21.15.32:0/2005171740 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe1a000ad40 con 0x7fe1b80700f0 2024-03-19T06:24:34.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1bde00640 1 -- 172.21.15.32:0/2005171740 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b8159710 con 0x7fe1b80700f0 2024-03-19T06:24:34.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.254+0000 7fe1afe00640 1 -- 172.21.15.32:0/2005171740 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0012620 con 0x7fe1b80700f0 2024-03-19T06:24:34.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.258+0000 7fe1bde00640 1 -- 172.21.15.32:0/2005171740 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b80ccb90 con 0x7fe1b80700f0 2024-03-19T06:24:34.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.258+0000 7fe1bde00640 1 -- 172.21.15.32:0/2005171740 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b80ccd90 con 0x7fe1b80700f0 2024-03-19T06:24:34.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.258+0000 7fe1afe00640 1 -- 172.21.15.32:0/2005171740 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe1a001a070 con 0x7fe1b80700f0 2024-03-19T06:24:34.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.258+0000 7fe1afe00640 1 --2- 172.21.15.32:0/2005171740 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe194067660 0x7fe194069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:24:34.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.258+0000 7fe1afe00640 1 -- 172.21.15.32:0/2005171740 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe1a00854d0 con 0x7fe1b80700f0 2024-03-19T06:24:34.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.258+0000 7fe1b6a00640 1 --2- 172.21.15.32:0/2005171740 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe194067660 0x7fe194069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:24:34.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.258+0000 7fe1b6a00640 1 --2- 172.21.15.32:0/2005171740 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe194067660 0x7fe194069b20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80011f0 tx=0x7fe1a8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:24:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.262+0000 7fe1afe00640 1 -- 172.21.15.32:0/2005171740 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176481 (secure 0 0 0) 0x7fe1b80ccd90 con 0x7fe1b80700f0 2024-03-19T06:24:34.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.458+0000 7fe1bde00640 1 -- 172.21.15.32:0/2005171740 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1b80749e0 con 0x7fe1b80700f0 2024-03-19T06:24:34.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.458+0000 7fe1afe00640 1 -- 172.21.15.32:0/2005171740 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3705 (secure 0 0 0) 0x7fe1a0056320 con 0x7fe1b80700f0 2024-03-19T06:24:34.449 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-03-19T06:24:34.449 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3631486110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3631486110},{"type":"v1","addr":"172.21.15.171:6836","nonce":3631486110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1700623705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1700623705},{"type":"v1","addr":"172.21.15.171:6837","nonce":1700623705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/3410824978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":3410824978},{"type":"v1","addr":"172.21.15.32:6833","nonce":3410824978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3585939515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3585939515},{"type":"v1","addr":"172.21.15.32:6835","nonce":3585939515}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[]} 2024-03-19T06:24:34.449 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 28 2024-03-19T06:24:34.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.462+0000 7fe1bde00640 1 -- 172.21.15.32:0/2005171740 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe194067660 msgr2=0x7fe194069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:34.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.462+0000 7fe1bde00640 1 --2- 172.21.15.32:0/2005171740 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe194067660 0x7fe194069b20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80011f0 tx=0x7fe1a8009040 comp rx=0 tx=0).stop 2024-03-19T06:24:34.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.462+0000 7fe1bde00640 1 -- 172.21.15.32:0/2005171740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1b80700f0 msgr2=0x7fe1b8147230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:24:34.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.462+0000 7fe1bde00640 1 --2- 172.21.15.32:0/2005171740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1b80700f0 0x7fe1b8147230 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000cb70 tx=0x7fe1a000a430 comp rx=0 tx=0).stop 2024-03-19T06:24:34.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.462+0000 7fe1bde00640 1 -- 172.21.15.32:0/2005171740 shutdown_connections 2024-03-19T06:24:34.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.462+0000 7fe1bde00640 1 --2- 172.21.15.32:0/2005171740 >> [v2:172.21.15.171:6832/2098850483,v1:172.21.15.171:6833/2098850483] conn(0x7fe194067660 0x7fe194069b20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:34.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.462+0000 7fe1bde00640 1 --2- 172.21.15.32:0/2005171740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1b815bbf0 0x7fe1b8158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:34.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.462+0000 7fe1bde00640 1 --2- 172.21.15.32:0/2005171740 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1b80700f0 0x7fe1b8147230 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:34.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.462+0000 7fe1bde00640 1 --2- 172.21.15.32:0/2005171740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1b806c460 0x7fe1b8156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:24:34.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.462+0000 7fe1bde00640 1 -- 172.21.15.32:0/2005171740 >> 172.21.15.32:0/2005171740 conn(0x7fe1b8071c50 msgr2=0x7fe1b815d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:24:34.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.462+0000 7fe1bde00640 1 -- 172.21.15.32:0/2005171740 shutdown_connections 2024-03-19T06:24:34.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-03-19T06:24:34.462+0000 7fe1bde00640 1 -- 172.21.15.32:0/2005171740 wait complete. 2024-03-19T06:24:34.470 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-19T06:24:34.470 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-19T06:24:34.470 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-19T06:24:34.471 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:34.482 INFO:tasks.ceph.mds.a:Stopped 2024-03-19T06:24:34.483 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-19T06:24:34.483 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:34.537 INFO:tasks.ceph.mds.c:Stopped 2024-03-19T06:24:34.538 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-19T06:24:34.538 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:34.553 INFO:tasks.ceph.mds.b:Stopped 2024-03-19T06:24:34.554 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-19T06:24:34.554 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:34.612 INFO:tasks.ceph.mds.d:Stopped 2024-03-19T06:24:34.613 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-19T06:24:34.613 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-19T06:24:34.613 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:34.703 INFO:tasks.ceph.osd.0:Stopped 2024-03-19T06:24:34.704 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-19T06:24:34.704 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:34.802 INFO:tasks.ceph.osd.1:Stopped 2024-03-19T06:24:34.803 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-19T06:24:34.803 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:34.895 INFO:tasks.ceph.osd.2:Stopped 2024-03-19T06:24:34.896 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-19T06:24:34.896 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:34.966 INFO:tasks.ceph.osd.3:Stopped 2024-03-19T06:24:34.967 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-19T06:24:34.967 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:35.037 INFO:tasks.ceph.osd.4:Stopped 2024-03-19T06:24:35.038 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-19T06:24:35.038 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:35.590 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:24:35.594 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:24:36.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-03-19T06:24:41.140 INFO:tasks.ceph.osd.5:Stopped 2024-03-19T06:24:41.140 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-19T06:24:41.140 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:41.210 INFO:tasks.ceph.osd.6:Stopped 2024-03-19T06:24:41.210 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-19T06:24:41.210 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:41.290 INFO:tasks.ceph.osd.7:Stopped 2024-03-19T06:24:41.290 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-19T06:24:41.291 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-19T06:24:41.291 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:41.348 INFO:tasks.ceph.mgr.y:Stopped 2024-03-19T06:24:41.348 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-19T06:24:41.348 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:41.405 INFO:tasks.ceph.mgr.x:Stopped 2024-03-19T06:24:41.405 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-19T06:24:41.406 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-19T06:24:41.406 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:41.425 INFO:tasks.ceph.mon.a:Stopped 2024-03-19T06:24:41.425 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-19T06:24:41.425 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:41.440 INFO:tasks.ceph.mon.b:Stopped 2024-03-19T06:24:41.440 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-19T06:24:41.440 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:24:41.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~6s 2024-03-19T06:24:41.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-03-19T06:24:41.497 INFO:tasks.ceph.mon.c:Stopped 2024-03-19T06:24:41.497 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-19T06:24:41.498 DEBUG:teuthology.orchestra.run.smithi032:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-03-19T06:24:41.531 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:24:41.531 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-19T06:24:41.849 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:24:41.850 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-19T06:24:42.083 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:24:42.084 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-19T06:24:42.290 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:24:42.290 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-19T06:24:42.501 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:24:42.502 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-19T06:24:42.727 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:24:42.728 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-19T06:24:42.898 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:24:42.898 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-19T06:24:43.081 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:24:43.081 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-19T06:24:43.249 INFO:tasks.ceph:Archiving mon data... 2024-03-19T06:24:43.250 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674/data/mon.a.tgz 2024-03-19T06:24:43.251 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-03-19T06:24:43.261 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.XVrJ9vflD1 2024-03-19T06:24:43.261 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.XVrJ9vflD1 2024-03-19T06:24:43.396 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.XVrJ9vflD1 2024-03-19T06:24:43.477 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.XVrJ9vflD1 is 352KB 2024-03-19T06:24:43.543 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.XVrJ9vflD1 2024-03-19T06:24:43.551 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674/data/mon.b.tgz 2024-03-19T06:24:43.552 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-03-19T06:24:43.561 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.IZMLY7zHup 2024-03-19T06:24:43.561 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.IZMLY7zHup 2024-03-19T06:24:43.712 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.IZMLY7zHup 2024-03-19T06:24:43.785 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.IZMLY7zHup is 459KB 2024-03-19T06:24:43.852 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.IZMLY7zHup 2024-03-19T06:24:43.860 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674/data/mon.c.tgz 2024-03-19T06:24:43.860 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-03-19T06:24:43.908 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.QsLr5IqQ6E 2024-03-19T06:24:43.909 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.QsLr5IqQ6E 2024-03-19T06:24:44.056 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.QsLr5IqQ6E 2024-03-19T06:24:44.129 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.QsLr5IqQ6E is 459KB 2024-03-19T06:24:44.191 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.QsLr5IqQ6E 2024-03-19T06:24:44.200 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-19T06:24:44.200 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-19T06:24:44.203 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-19T06:24:44.277 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-19T06:24:44.309 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-19T06:24:44.309 INFO:tasks.ceph:Archiving crash dumps... 2024-03-19T06:24:44.311 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674/remote/smithi032/crash 2024-03-19T06:24:44.312 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-19T06:24:44.341 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674/remote/smithi171/crash 2024-03-19T06:24:44.342 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-19T06:24:44.370 INFO:tasks.ceph:Shutting down logrotate 2024-03-19T06:24:44.371 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:24:44.391 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:24:44.456 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-19T06:24:44.477 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-19T06:24:44.515 INFO:tasks.ceph:Compressing logs... 2024-03-19T06:24:44.515 DEBUG:teuthology.orchestra.run.smithi032:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-19T06:24:44.523 DEBUG:teuthology.orchestra.run.smithi171:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-19T06:24:44.552 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31790.log 2024-03-19T06:24:44.552 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35018.log 2024-03-19T06:24:44.553 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37851.log 2024-03-19T06:24:44.553 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31790.log.gz 2024-03-19T06:24:44.554 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32910.log 2024-03-19T06:24:44.554 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35018.log.gz 2024-03-19T06:24:44.556 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40464.log 2024-03-19T06:24:44.556 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37851.log.gz 2024-03-19T06:24:44.556 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33983.log 2024-03-19T06:24:44.556 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32910.log.gz 2024-03-19T06:24:44.557 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39311.log 2024-03-19T06:24:44.557 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40464.log.gz 2024-03-19T06:24:44.558 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40308.log 2024-03-19T06:24:44.558 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33983.log.gz 2024-03-19T06:24:44.559 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38035.log 2024-03-19T06:24:44.559 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39311.log.gz 2024-03-19T06:24:44.559 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37957.log 2024-03-19T06:24:44.559 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40308.log.gz 2024-03-19T06:24:44.561 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38035.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-19T06:24:44.561 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38035.log.gz 2024-03-19T06:24:44.561 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37068.log 2024-03-19T06:24:44.561 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37957.log.gz 2024-03-19T06:24:44.563 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40926.log 2024-03-19T06:24:44.563 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32280.log 2024-03-19T06:24:44.563 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37068.log.gz 2024-03-19T06:24:44.563 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31922.log 2024-03-19T06:24:44.564 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40926.log.gz 2024-03-19T06:24:44.565 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40978.log 2024-03-19T06:24:44.566 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32280.log.gz 2024-03-19T06:24:44.566 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37415.log 2024-03-19T06:24:44.566 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31922.log.gz 2024-03-19T06:24:44.566 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-19T06:24:44.566 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39125.log 2024-03-19T06:24:44.567 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40978.log.gz 2024-03-19T06:24:44.567 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.37415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37879.log 2024-03-19T06:24:44.568 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38262.log 2024-03-19T06:24:44.569 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39125.log.gz 2024-03-19T06:24:44.569 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37879.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37415.log.gz 2024-03-19T06:24:44.569 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35896.log 2024-03-19T06:24:44.569 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37879.log.gz 2024-03-19T06:24:44.570 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33801.log 2024-03-19T06:24:44.570 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38262.log.gz 2024-03-19T06:24:44.570 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27343.log 2024-03-19T06:24:44.571 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35896.log.gz 2024-03-19T06:24:44.571 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32494.log 2024-03-19T06:24:44.571 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33801.log.gz 2024-03-19T06:24:44.572 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.27343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34334.log 2024-03-19T06:24:44.572 INFO:teuthology.orchestra.run.smithi032.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.27343.log.gz 2024-03-19T06:24:44.577 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35788.log 2024-03-19T06:24:44.577 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32494.log.gz 2024-03-19T06:24:44.577 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41056.log 2024-03-19T06:24:44.577 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34334.log.gz 2024-03-19T06:24:44.577 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34120.log 2024-03-19T06:24:44.577 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35788.log.gz 2024-03-19T06:24:44.578 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40256.log 2024-03-19T06:24:44.578 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41056.log.gz 2024-03-19T06:24:44.578 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39180.log 2024-03-19T06:24:44.578 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34120.log.gz 2024-03-19T06:24:44.578 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40256.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-19T06:24:44.580 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40256.log.gz 2024-03-19T06:24:44.580 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.39180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38709.log 2024-03-19T06:24:44.580 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39813.log 2024-03-19T06:24:44.580 INFO:teuthology.orchestra.run.smithi032.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.39180.log.gz 2024-03-19T06:24:44.581 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32988.log 2024-03-19T06:24:44.581 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38709.log.gz 2024-03-19T06:24:44.581 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41134.log 2024-03-19T06:24:44.582 INFO:teuthology.orchestra.run.smithi032.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39813.log.gz 2024-03-19T06:24:44.582 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38995.log 2024-03-19T06:24:44.582 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32988.log.gz 2024-03-19T06:24:44.582 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37730.log 2024-03-19T06:24:44.583 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41134.log.gz 2024-03-19T06:24:44.584 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32288.log 2024-03-19T06:24:44.584 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38995.log.gz 2024-03-19T06:24:44.584 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32272.log 2024-03-19T06:24:44.584 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37730.log.gz 2024-03-19T06:24:44.585 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34438.log 2024-03-19T06:24:44.585 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32288.log.gz 2024-03-19T06:24:44.586 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37303.log 2024-03-19T06:24:44.586 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32272.log.gz 2024-03-19T06:24:44.590 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34516.log 2024-03-19T06:24:44.590 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34438.log.gz 2024-03-19T06:24:44.590 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39285.log 2024-03-19T06:24:44.590 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37303.log.gz 2024-03-19T06:24:44.590 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38683.log 2024-03-19T06:24:44.591 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34516.log.gz 2024-03-19T06:24:44.591 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38655.log 2024-03-19T06:24:44.591 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39285.log.gz 2024-03-19T06:24:44.591 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36037.log 2024-03-19T06:24:44.594 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27667.log 2024-03-19T06:24:44.594 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27531.log 2024-03-19T06:24:44.595 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27667.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-19T06:24:44.595 INFO:teuthology.orchestra.run.smithi171.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27667.log.gz 2024-03-19T06:24:44.595 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27531.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-19T06:24:44.595 INFO:teuthology.orchestra.run.smithi171.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27531.log.gz 2024-03-19T06:24:44.595 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27571.log 2024-03-19T06:24:44.595 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-19T06:24:44.598 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38683.log.gz 2024-03-19T06:24:44.598 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33827.log 2024-03-19T06:24:44.598 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38655.log.gz 2024-03-19T06:24:44.598 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34303.log 2024-03-19T06:24:44.598 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36037.log.gz 2024-03-19T06:24:44.599 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40360.log 2024-03-19T06:24:44.599 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33827.log.gz 2024-03-19T06:24:44.599 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36271.log 2024-03-19T06:24:44.599 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34303.log.gz 2024-03-19T06:24:44.600 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36450.log 2024-03-19T06:24:44.600 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40360.log.gz 2024-03-19T06:24:44.600 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38943.log 2024-03-19T06:24:44.600 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36271.log.gz 2024-03-19T06:24:44.601 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32962.log 2024-03-19T06:24:44.601 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36450.log.gz 2024-03-19T06:24:44.601 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37983.log 2024-03-19T06:24:44.602 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38943.log.gz 2024-03-19T06:24:44.602 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37094.log 2024-03-19T06:24:44.602 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32962.log.gz 2024-03-19T06:24:44.614 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27571.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-19T06:24:44.614 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27571.log.gz 2024-03-19T06:24:44.614 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27691.log 2024-03-19T06:24:44.614 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-19T06:24:44.614 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27619.log 2024-03-19T06:24:44.615 INFO:teuthology.orchestra.run.smithi171.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27691.log.gz 2024-03-19T06:24:44.615 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27595.log 2024-03-19T06:24:44.615 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27619.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-19T06:24:44.615 INFO:teuthology.orchestra.run.smithi171.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27619.log.gz 2024-03-19T06:24:44.615 INFO:teuthology.orchestra.run.smithi171.stderr: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-19T06:24:44.615 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33240.log 2024-03-19T06:24:44.615 INFO:teuthology.orchestra.run.smithi171.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27595.log.gz 2024-03-19T06:24:44.615 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27643.log 2024-03-19T06:24:44.616 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.3.33240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33127.log 2024-03-19T06:24:44.616 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27643.log: 90.8% -- replaced with /var/log/ceph/ceph-client.3.33240.log.gz 2024-03-19T06:24:44.616 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27643.log.gz 2024-03-19T06:24:44.616 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-19T06:24:44.616 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.33127.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-19T06:24:44.616 INFO:teuthology.orchestra.run.smithi171.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.1.33127.log.gz/var/log/ceph/ceph.audit.log: 2024-03-19T06:24:44.616 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mds.d.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-19T06:24:44.616 INFO:teuthology.orchestra.run.smithi171.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-19T06:24:44.616 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-19T06:24:44.617 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-19T06:24:44.617 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27715.log 2024-03-19T06:24:44.618 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.27715.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27715.log.gz 2024-03-19T06:24:44.618 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-19T06:24:44.622 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32026.log 2024-03-19T06:24:44.623 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37983.log.gz 2024-03-19T06:24:44.623 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36193.log 2024-03-19T06:24:44.623 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37094.log.gz 2024-03-19T06:24:44.623 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34172.log 2024-03-19T06:24:44.624 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32026.log.gz 2024-03-19T06:24:44.624 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33567.log 2024-03-19T06:24:44.624 INFO:teuthology.orchestra.run.smithi032.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36193.log.gz 2024-03-19T06:24:44.624 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35454.log 2024-03-19T06:24:44.625 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34172.log.gz 2024-03-19T06:24:44.625 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31647.log 2024-03-19T06:24:44.625 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33567.log.gz 2024-03-19T06:24:44.625 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40822.log 2024-03-19T06:24:44.626 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35454.log.gz 2024-03-19T06:24:44.626 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27584.log 2024-03-19T06:24:44.626 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31647.log.gz 2024-03-19T06:24:44.627 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35253.log 2024-03-19T06:24:44.627 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40822.log.gz 2024-03-19T06:24:44.627 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.27584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40796.log 2024-03-19T06:24:44.627 INFO:teuthology.orchestra.run.smithi032.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.27584.log.gz 2024-03-19T06:24:44.628 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36063.log 2024-03-19T06:24:44.628 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35253.log.gz 2024-03-19T06:24:44.628 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31816.log 2024-03-19T06:24:44.628 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40796.log.gz 2024-03-19T06:24:44.629 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36089.log 2024-03-19T06:24:44.629 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36063.log.gz 2024-03-19T06:24:44.629 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37651.log 2024-03-19T06:24:44.629 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31816.log.gz 2024-03-19T06:24:44.630 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37931.log 2024-03-19T06:24:44.630 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36089.log.gz 2024-03-19T06:24:44.630 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39922.log 2024-03-19T06:24:44.631 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37651.log.gz 2024-03-19T06:24:44.631 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34225.log 2024-03-19T06:24:44.631 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37931.log.gz 2024-03-19T06:24:44.631 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36347.log 2024-03-19T06:24:44.632 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39922.log.gz 2024-03-19T06:24:44.632 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37146.log 2024-03-19T06:24:44.632 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34225.log.gz 2024-03-19T06:24:44.632 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37360.log 2024-03-19T06:24:44.632 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36347.log.gz 2024-03-19T06:24:44.633 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39337.log 2024-03-19T06:24:44.633 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37146.log.gz 2024-03-19T06:24:44.633 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38113.log 2024-03-19T06:24:44.633 INFO:teuthology.orchestra.run.smithi032.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.37360.log.gz 2024-03-19T06:24:44.634 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39580.log 2024-03-19T06:24:44.634 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39337.log.gz 2024-03-19T06:24:44.634 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40718.log 2024-03-19T06:24:44.634 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38113.log.gz 2024-03-19T06:24:44.635 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.39580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39978.log 2024-03-19T06:24:44.635 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40718.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40718.log.gz 2024-03-19T06:24:44.635 INFO:teuthology.orchestra.run.smithi032.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.0.39580.log.gz 2024-03-19T06:24:44.635 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-19T06:24:44.636 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.39978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35840.log 2024-03-19T06:24:44.643 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.4.log: 90.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-19T06:24:44.656 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40900.log 2024-03-19T06:24:44.656 INFO:teuthology.orchestra.run.smithi032.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.0.39978.log.gz 2024-03-19T06:24:44.656 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36908.log 2024-03-19T06:24:44.657 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35840.log.gz 2024-03-19T06:24:44.657 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32073.log 2024-03-19T06:24:44.657 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40900.log.gz 2024-03-19T06:24:44.657 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31359.log 2024-03-19T06:24:44.657 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36908.log.gz 2024-03-19T06:24:44.657 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36011.log 2024-03-19T06:24:44.657 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32073.log.gz 2024-03-19T06:24:44.657 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38184.log 2024-03-19T06:24:44.657 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31359.log.gz 2024-03-19T06:24:44.658 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36011.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36011.log.gz 2024-03-19T06:24:44.658 INFO:teuthology.orchestra.run.smithi032.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34940.log 2024-03-19T06:24:44.658 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35578.log 2024-03-19T06:24:44.658 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38184.log.gz 2024-03-19T06:24:44.658 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35227.log 2024-03-19T06:24:44.658 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34940.log.gz 2024-03-19T06:24:44.658 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38787.log 2024-03-19T06:24:44.659 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35578.log.gz 2024-03-19T06:24:44.659 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41186.log 2024-03-19T06:24:44.659 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35227.log.gz 2024-03-19T06:24:44.659 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39047.log 2024-03-19T06:24:44.659 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38787.log.gz 2024-03-19T06:24:44.659 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35931.log 2024-03-19T06:24:44.659 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41186.log.gz 2024-03-19T06:24:44.659 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39047.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-19T06:24:44.660 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39047.log.gz 2024-03-19T06:24:44.660 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32060.log 2024-03-19T06:24:44.660 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35931.log.gz 2024-03-19T06:24:44.660 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36849.log 2024-03-19T06:24:44.660 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32060.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32060.log.gz 2024-03-19T06:24:44.660 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39787.log 2024-03-19T06:24:44.660 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37572.log 2024-03-19T06:24:44.661 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36849.log: /var/log/ceph/ceph-client.admin.39787.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36849.log.gz 2024-03-19T06:24:44.661 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38139.log 2024-03-19T06:24:44.661 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39787.log.gz 2024-03-19T06:24:44.661 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38813.log 2024-03-19T06:24:44.661 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37572.log.gz 2024-03-19T06:24:44.661 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36964.log 2024-03-19T06:24:44.661 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38813.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38139.log.gz 2024-03-19T06:24:44.661 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38813.log.gz 2024-03-19T06:24:44.662 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35357.log 2024-03-19T06:24:44.662 INFO:teuthology.orchestra.run.smithi032.stderr:gzip/var/log/ceph/ceph-client.0.36964.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33775.log 2024-03-19T06:24:44.662 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37251.log 2024-03-19T06:24:44.662 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35357.log.gz 2024-03-19T06:24:44.662 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33775.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.36964.log.gz 2024-03-19T06:24:44.663 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35045.log 2024-03-19T06:24:44.663 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33775.log.gz 2024-03-19T06:24:44.663 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34648.log 2024-03-19T06:24:44.663 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37251.log.gz 2024-03-19T06:24:44.663 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36402.log 2024-03-19T06:24:44.663 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35045.log.gz 2024-03-19T06:24:44.663 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32286.log 2024-03-19T06:24:44.664 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34648.log.gz 2024-03-19T06:24:44.664 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.36402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33515.log 2024-03-19T06:24:44.664 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36245.log 2024-03-19T06:24:44.664 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32286.log.gz 2024-03-19T06:24:44.664 INFO:teuthology.orchestra.run.smithi032.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.36402.log.gz 2024-03-19T06:24:44.664 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36797.log 2024-03-19T06:24:44.664 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33515.log.gz 2024-03-19T06:24:44.665 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40568.log 2024-03-19T06:24:44.665 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36245.log: /var/log/ceph/ceph-client.admin.36797.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36245.log.gz 2024-03-19T06:24:44.665 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39629.log 2024-03-19T06:24:44.665 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36797.log.gz 2024-03-19T06:24:44.665 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38425.log 2024-03-19T06:24:44.666 INFO:teuthology.orchestra.run.smithi171.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-19T06:24:44.670 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40568.log.gz 2024-03-19T06:24:44.671 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32472.log 2024-03-19T06:24:44.671 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39629.log.gz 2024-03-19T06:24:44.671 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34094.log 2024-03-19T06:24:44.671 INFO:teuthology.orchestra.run.smithi032.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38425.log.gz 2024-03-19T06:24:44.671 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35383.log 2024-03-19T06:24:44.671 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32472.log.gz 2024-03-19T06:24:44.671 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37468.log 2024-03-19T06:24:44.671 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34094.log.gz 2024-03-19T06:24:44.672 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31701.log 2024-03-19T06:24:44.672 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35383.log.gz 2024-03-19T06:24:44.672 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31595.log 2024-03-19T06:24:44.672 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37468.log.gz 2024-03-19T06:24:44.672 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32075.log 2024-03-19T06:24:44.673 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31701.log.gz 2024-03-19T06:24:44.673 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32283.log 2024-03-19T06:24:44.673 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31595.log.gz 2024-03-19T06:24:44.673 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35409.log 2024-03-19T06:24:44.673 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32075.log.gz 2024-03-19T06:24:44.673 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33014.log 2024-03-19T06:24:44.673 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32283.log.gz 2024-03-19T06:24:44.673 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35409.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.35409.log.gz --verbose 2024-03-19T06:24:44.674 INFO:teuthology.orchestra.run.smithi032.stderr: -- /var/log/ceph/ceph-client.admin.32000.log 2024-03-19T06:24:44.674 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40033.log 2024-03-19T06:24:44.674 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33014.log.gz 2024-03-19T06:24:44.674 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41210.log 2024-03-19T06:24:44.674 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32000.log.gz 2024-03-19T06:24:44.677 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34622.log 2024-03-19T06:24:44.677 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40033.log.gz 2024-03-19T06:24:44.677 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31870.log 2024-03-19T06:24:44.677 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41210.log.gz/var/log/ceph/ceph-client.admin.34622.log: 2024-03-19T06:24:44.677 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36504.log 2024-03-19T06:24:44.677 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34622.log.gz 2024-03-19T06:24:44.678 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32079.log 2024-03-19T06:24:44.678 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31870.log.gz 2024-03-19T06:24:44.678 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40542.log 2024-03-19T06:24:44.678 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36504.log.gz 2024-03-19T06:24:44.678 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34862.log 2024-03-19T06:24:44.678 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32079.log.gz 2024-03-19T06:24:44.680 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32496.log 2024-03-19T06:24:44.680 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40542.log.gz 2024-03-19T06:24:44.680 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33121.log 2024-03-19T06:24:44.680 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34862.log: /var/log/ceph/ceph-client.admin.32496.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34862.log.gz 2024-03-19T06:24:44.680 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35957.log 2024-03-19T06:24:44.680 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32496.log.gz 2024-03-19T06:24:44.681 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37703.log 2024-03-19T06:24:44.681 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33121.log.gz 2024-03-19T06:24:44.681 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34568.log 2024-03-19T06:24:44.682 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35957.log.gz 2024-03-19T06:24:44.682 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31673.log 2024-03-19T06:24:44.683 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37703.log.gz 2024-03-19T06:24:44.683 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31540.log 2024-03-19T06:24:44.684 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34568.log.gz 2024-03-19T06:24:44.684 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38575.log 2024-03-19T06:24:44.685 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31673.log: /var/log/ceph/ceph-client.admin.31540.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31673.log.gz 2024-03-19T06:24:44.686 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38761.log 2024-03-19T06:24:44.686 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31540.log.gz 2024-03-19T06:24:44.687 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40692.log 2024-03-19T06:24:44.687 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38575.log.gz 2024-03-19T06:24:44.687 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39442.log 2024-03-19T06:24:44.688 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38761.log: /var/log/ceph/ceph-client.admin.40692.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38761.log.gz 2024-03-19T06:24:44.689 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-19T06:24:44.689 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40692.log.gz 2024-03-19T06:24:44.690 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33905.log 2024-03-19T06:24:44.690 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39442.log.gz 2024-03-19T06:24:44.690 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39656.log 2024-03-19T06:24:44.692 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.33905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38457.log 2024-03-19T06:24:44.692 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33905.log.gz 2024-03-19T06:24:44.692 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35123.log 2024-03-19T06:24:44.693 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39656.log.gz 2024-03-19T06:24:44.694 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35604.log 2024-03-19T06:24:44.694 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35123.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38457.log.gz 2024-03-19T06:24:44.695 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35071.log 2024-03-19T06:24:44.695 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35123.log.gz 2024-03-19T06:24:44.696 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39760.log 2024-03-19T06:24:44.696 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35604.log.gz 2024-03-19T06:24:44.697 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35149.log 2024-03-19T06:24:44.699 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35071.log: /var/log/ceph/ceph-client.admin.39760.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35071.log.gz 2024-03-19T06:24:44.699 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33671.log 2024-03-19T06:24:44.699 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39760.log.gz 2024-03-19T06:24:44.699 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34700.log 2024-03-19T06:24:44.700 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35149.log.gz 2024-03-19T06:24:44.700 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32728.log 2024-03-19T06:24:44.700 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33671.log.gz 2024-03-19T06:24:44.701 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39525.log 2024-03-19T06:24:44.701 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34700.log.gz 2024-03-19T06:24:44.702 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36745.log 2024-03-19T06:24:44.703 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32728.log.gz 2024-03-19T06:24:44.703 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33541.log 2024-03-19T06:24:44.704 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39525.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39525.log.gz 2024-03-19T06:24:44.704 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32487.log 2024-03-19T06:24:44.704 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36745.log.gz 2024-03-19T06:24:44.706 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35814.log 2024-03-19T06:24:44.706 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33541.log.gz 2024-03-19T06:24:44.706 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32936.log 2024-03-19T06:24:44.707 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32487.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32487.log.gz 2024-03-19T06:24:44.708 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37905.log 2024-03-19T06:24:44.708 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35814.log.gz 2024-03-19T06:24:44.708 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36875.log 2024-03-19T06:24:44.709 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32936.log.gz 2024-03-19T06:24:44.710 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38549.log 2024-03-19T06:24:44.710 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37905.log.gz 2024-03-19T06:24:44.711 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40203.log 2024-03-19T06:24:44.711 INFO:teuthology.orchestra.run.smithi032.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.36875.log.gz 2024-03-19T06:24:44.712 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36167.log 2024-03-19T06:24:44.712 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38549.log.gz 2024-03-19T06:24:44.713 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40594.log 2024-03-19T06:24:44.713 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40203.log.gz 2024-03-19T06:24:44.714 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40334.log 2024-03-19T06:24:44.714 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36167.log.gz 2024-03-19T06:24:44.715 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log 2024-03-19T06:24:44.715 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40594.log.gz 2024-03-19T06:24:44.716 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35983.log 2024-03-19T06:24:44.717 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40334.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40334.log.gz 2024-03-19T06:24:44.717 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38366.log 2024-03-19T06:24:44.718 INFO:teuthology.orchestra.run.smithi032.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34542.log.gz 2024-03-19T06:24:44.718 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35983.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-19T06:24:44.719 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35983.log.gz 2024-03-19T06:24:44.719 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39682.log 2024-03-19T06:24:44.720 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.1.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38366.log.gz 2024-03-19T06:24:44.720 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31896.log 2024-03-19T06:24:44.722 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35175.log 2024-03-19T06:24:44.722 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39682.log.gz 2024-03-19T06:24:44.723 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40516.log 2024-03-19T06:24:44.723 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31896.log.gz 2024-03-19T06:24:44.724 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41108.log 2024-03-19T06:24:44.725 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35175.log.gz 2024-03-19T06:24:44.725 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35097.log 2024-03-19T06:24:44.725 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40516.log.gz 2024-03-19T06:24:44.726 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38314.log 2024-03-19T06:24:44.727 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41108.log.gz 2024-03-19T06:24:44.727 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32492.log 2024-03-19T06:24:44.728 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35097.log.gz 2024-03-19T06:24:44.729 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34251.log 2024-03-19T06:24:44.729 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38314.log.gz 2024-03-19T06:24:44.730 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40091.log 2024-03-19T06:24:44.730 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32492.log.gz 2024-03-19T06:24:44.731 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27453.log 2024-03-19T06:24:44.731 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34251.log.gz 2024-03-19T06:24:44.732 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38917.log 2024-03-19T06:24:44.733 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40091.log.gz 2024-03-19T06:24:44.733 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.27453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34805.log 2024-03-19T06:24:44.733 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27453.log.gz 2024-03-19T06:24:44.735 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38210.log 2024-03-19T06:24:44.735 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38917.log.gz 2024-03-19T06:24:44.736 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38839.log 2024-03-19T06:24:44.736 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34805.log.gz 2024-03-19T06:24:44.737 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31729.log 2024-03-19T06:24:44.738 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38210.log.gz 2024-03-19T06:24:44.738 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33645.log 2024-03-19T06:24:44.738 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38839.log.gz 2024-03-19T06:24:44.740 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34490.log 2024-03-19T06:24:44.740 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31729.log.gz 2024-03-19T06:24:44.741 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39891.log 2024-03-19T06:24:44.741 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33645.log.gz 2024-03-19T06:24:44.742 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36614.log 2024-03-19T06:24:44.742 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34490.log.gz 2024-03-19T06:24:44.743 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31416.log 2024-03-19T06:24:44.743 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39891.log.gz 2024-03-19T06:24:44.744 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39734.log 2024-03-19T06:24:44.744 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36614.log.gz 2024-03-19T06:24:44.746 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33931.log 2024-03-19T06:24:44.746 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31416.log.gz 2024-03-19T06:24:44.746 INFO:teuthology.orchestra.run.smithi171.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-19T06:24:44.747 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32270.log 2024-03-19T06:24:44.747 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39734.log.gz 2024-03-19T06:24:44.748 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35305.log 2024-03-19T06:24:44.748 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33931.log.gz 2024-03-19T06:24:44.749 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37225.log 2024-03-19T06:24:44.750 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32270.log.gz 2024-03-19T06:24:44.750 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38865.log 2024-03-19T06:24:44.750 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35305.log.gz 2024-03-19T06:24:44.751 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32471.log 2024-03-19T06:24:44.751 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37225.log.gz 2024-03-19T06:24:44.753 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.33385.log 2024-03-19T06:24:44.753 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38865.log.gz 2024-03-19T06:24:44.754 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32471.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32471.log.gz 2024-03-19T06:24:44.754 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33247.log 2024-03-19T06:24:44.755 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.2.33385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33957.log 2024-03-19T06:24:44.756 INFO:teuthology.orchestra.run.smithi032.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.2.33385.log.gz 2024-03-19T06:24:44.757 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.33247.log: /var/log/ceph/ceph-client.admin.33957.log: 90.7% -- replaced with /var/log/ceph/ceph-client.0.33247.log.gz 2024-03-19T06:24:44.758 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35514.log 2024-03-19T06:24:44.758 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33957.log.gz 2024-03-19T06:24:44.759 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39865.log 2024-03-19T06:24:44.761 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37120.log 2024-03-19T06:24:44.761 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35514.log.gz 2024-03-19T06:24:44.761 INFO:teuthology.orchestra.run.smithi171.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-19T06:24:44.762 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39416.log 2024-03-19T06:24:44.762 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39865.log.gz 2024-03-19T06:24:44.763 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37120.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37120.log.gz 2024-03-19T06:24:44.763 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33429.log 2024-03-19T06:24:44.764 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39416.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39416.log.gz 2024-03-19T06:24:44.765 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40666.log 2024-03-19T06:24:44.766 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33429.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-19T06:24:44.766 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33429.log.gz 2024-03-19T06:24:44.767 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32068.log 2024-03-19T06:24:44.767 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40666.log.gz 2024-03-19T06:24:44.769 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.32068.log: 85.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-19T06:24:44.769 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36692.log 2024-03-19T06:24:44.769 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32068.log.gz 2024-03-19T06:24:44.770 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36219.log 2024-03-19T06:24:44.772 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37788.log 2024-03-19T06:24:44.772 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36692.log.gz 2024-03-19T06:24:44.773 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36219.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36219.log.gz 2024-03-19T06:24:44.774 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37788.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37788.log.gz 2024-03-19T06:24:44.775 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38288.log 2024-03-19T06:24:44.776 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38236.log 2024-03-19T06:24:44.777 INFO:teuthology.orchestra.run.smithi171.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-19T06:24:44.778 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37546.log 2024-03-19T06:24:44.778 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38288.log.gz 2024-03-19T06:24:44.779 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32780.log 2024-03-19T06:24:44.779 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38236.log.gz 2024-03-19T06:24:44.779 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37546.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37546.log.gz 2024-03-19T06:24:44.780 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32482.log 2024-03-19T06:24:44.781 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38735.log 2024-03-19T06:24:44.781 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32780.log.gz 2024-03-19T06:24:44.782 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32076.log 2024-03-19T06:24:44.782 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32482.log.gz 2024-03-19T06:24:44.784 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38735.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38735.log.gz 2024-03-19T06:24:44.784 INFO:teuthology.orchestra.run.smithi171.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-19T06:24:44.785 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40848.log 2024-03-19T06:24:44.785 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32076.log.gz 2024-03-19T06:24:44.786 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38061.log 2024-03-19T06:24:44.787 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40848.log: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-19T06:24:44.787 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31844.log 2024-03-19T06:24:44.787 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40848.log.gz 2024-03-19T06:24:44.788 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37520.log 2024-03-19T06:24:44.788 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38061.log.gz 2024-03-19T06:24:44.789 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40490.log 2024-03-19T06:24:44.789 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31844.log: /var/log/ceph/ceph-client.admin.37520.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31844.log.gz 2024-03-19T06:24:44.790 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33879.log 2024-03-19T06:24:44.790 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37520.log.gz 2024-03-19T06:24:44.791 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36771.log 2024-03-19T06:24:44.791 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40490.log.gz 2024-03-19T06:24:44.792 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38523.log 2024-03-19T06:24:44.792 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33879.log.gz 2024-03-19T06:24:44.793 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31449.log 2024-03-19T06:24:44.793 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36771.log.gz 2024-03-19T06:24:44.794 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38392.log 2024-03-19T06:24:44.795 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38523.log.gz 2024-03-19T06:24:44.795 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33619.log 2024-03-19T06:24:44.795 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31449.log.gz 2024-03-19T06:24:44.796 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40744.log 2024-03-19T06:24:44.796 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38392.log.gz 2024-03-19T06:24:44.797 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39021.log 2024-03-19T06:24:44.798 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33619.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33619.log.gz 2024-03-19T06:24:44.798 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40744.log: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-19T06:24:44.798 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33294.log 2024-03-19T06:24:44.799 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40744.log.gz 2024-03-19T06:24:44.799 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32858.log 2024-03-19T06:24:44.799 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39021.log.gz 2024-03-19T06:24:44.800 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34966.log 2024-03-19T06:24:44.801 INFO:teuthology.orchestra.run.smithi032.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33294.log.gz 2024-03-19T06:24:44.801 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40169.log 2024-03-19T06:24:44.802 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32858.log.gz 2024-03-19T06:24:44.802 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37494.log 2024-03-19T06:24:44.803 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34966.log.gz 2024-03-19T06:24:44.803 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32884.log 2024-03-19T06:24:44.804 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40169.log.gz 2024-03-19T06:24:44.804 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36666.log 2024-03-19T06:24:44.805 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37494.log.gz 2024-03-19T06:24:44.806 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34360.log 2024-03-19T06:24:44.806 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32884.log.gz 2024-03-19T06:24:44.806 INFO:teuthology.orchestra.run.smithi032.stderr:gzip/var/log/ceph/ceph-client.admin.36666.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34199.log 2024-03-19T06:24:44.807 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36666.log.gz 2024-03-19T06:24:44.807 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40230.log 2024-03-19T06:24:44.808 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34360.log.gz 2024-03-19T06:24:44.808 INFO:teuthology.orchestra.run.smithi171.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-19T06:24:44.809 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39708.log 2024-03-19T06:24:44.809 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34199.log.gz 2024-03-19T06:24:44.810 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36141.log 2024-03-19T06:24:44.810 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40230.log.gz/var/log/ceph/ceph-client.admin.39708.log: 2024-03-19T06:24:44.811 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32276.log 2024-03-19T06:24:44.811 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39708.log.gz 2024-03-19T06:24:44.812 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37825.log 2024-03-19T06:24:44.812 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36141.log.gz 2024-03-19T06:24:44.813 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37199.log 2024-03-19T06:24:44.813 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32276.log: /var/log/ceph/ceph-client.admin.37825.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32276.log.gz 2024-03-19T06:24:44.814 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34068.log 2024-03-19T06:24:44.814 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37825.log.gz 2024-03-19T06:24:44.815 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37756.log 2024-03-19T06:24:44.815 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37199.log.gz 2024-03-19T06:24:44.816 INFO:teuthology.orchestra.run.smithi032.stderr:gzip/var/log/ceph/ceph-client.admin.34068.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36115.log 2024-03-19T06:24:44.816 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34068.log.gz 2024-03-19T06:24:44.817 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40282.log 2024-03-19T06:24:44.817 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37756.log.gz 2024-03-19T06:24:44.818 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36640.log 2024-03-19T06:24:44.818 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36115.log.gz 2024-03-19T06:24:44.819 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5/var/log/ceph/ceph-client.admin.40282.log: --verbose -- /var/log/ceph/ceph-client.admin.34386.log 2024-03-19T06:24:44.819 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36640.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40282.log.gz 2024-03-19T06:24:44.820 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38087.log 2024-03-19T06:24:44.820 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36640.log.gz 2024-03-19T06:24:44.821 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37042.log 2024-03-19T06:24:44.821 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34386.log.gz 2024-03-19T06:24:44.822 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34596.log 2024-03-19T06:24:44.822 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38087.log.gz 2024-03-19T06:24:44.823 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34464.log 2024-03-19T06:24:44.823 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37042.log.gz 2024-03-19T06:24:44.824 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34596.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34596.log.gz 2024-03-19T06:24:44.824 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35331.log 2024-03-19T06:24:44.825 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39232.log 2024-03-19T06:24:44.826 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34464.log: /var/log/ceph/ceph-client.admin.35331.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34464.log.gz 2024-03-19T06:24:44.826 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34992.log 2024-03-19T06:24:44.827 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35331.log.gz 2024-03-19T06:24:44.827 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41160.log 2024-03-19T06:24:44.828 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39232.log.gz 2024-03-19T06:24:44.828 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41004.log 2024-03-19T06:24:44.829 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34992.log: /var/log/ceph/ceph-client.admin.41160.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34992.log.gz 2024-03-19T06:24:44.830 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35630.log 2024-03-19T06:24:44.830 INFO:teuthology.orchestra.run.smithi032.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41160.log.gz 2024-03-19T06:24:44.831 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41004.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-19T06:24:44.831 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41004.log.gz 2024-03-19T06:24:44.832 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35762.log 2024-03-19T06:24:44.832 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35630.log.gz 2024-03-19T06:24:44.833 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-19T06:24:44.834 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39839.log 2024-03-19T06:24:44.835 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35762.log.gz 2024-03-19T06:24:44.835 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-19T06:24:44.835 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36297.log 2024-03-19T06:24:44.836 INFO:teuthology.orchestra.run.smithi171.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-19T06:24:44.837 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39839.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-19T06:24:44.837 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39839.log.gz 2024-03-19T06:24:44.838 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40386.log 2024-03-19T06:24:44.838 INFO:teuthology.orchestra.run.smithi032.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.36297.log.gz 2024-03-19T06:24:44.839 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40770.log 2024-03-19T06:24:44.839 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-03-19T06:24:44.839 INFO:teuthology.orchestra.run.smithi171.stderr:real 0m0.271s 2024-03-19T06:24:44.840 INFO:teuthology.orchestra.run.smithi171.stderr:user 0m1.118s 2024-03-19T06:24:44.840 INFO:teuthology.orchestra.run.smithi171.stderr:sys 0m0.159s 2024-03-19T06:24:44.841 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37016.log 2024-03-19T06:24:44.841 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40386.log.gz 2024-03-19T06:24:44.841 INFO:teuthology.orchestra.run.smithi032.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-19T06:24:44.842 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37173.log 2024-03-19T06:24:44.842 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40770.log.gz 2024-03-19T06:24:44.842 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36823.log 2024-03-19T06:24:44.842 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37016.log.gz 2024-03-19T06:24:44.843 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41082.log 2024-03-19T06:24:44.843 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37173.log.gz 2024-03-19T06:24:44.844 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35684.log 2024-03-19T06:24:44.844 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36823.log.gz 2024-03-19T06:24:44.845 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34888.log 2024-03-19T06:24:44.845 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41082.log.gz 2024-03-19T06:24:44.846 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40638.log 2024-03-19T06:24:44.846 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35684.log.gz 2024-03-19T06:24:44.847 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33487.log 2024-03-19T06:24:44.848 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34888.log.gz 2024-03-19T06:24:44.848 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36588.log 2024-03-19T06:24:44.849 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40638.log.gz 2024-03-19T06:24:44.849 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34914.log 2024-03-19T06:24:44.849 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33487.log.gz 2024-03-19T06:24:44.850 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34412.log 2024-03-19T06:24:44.851 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36588.log.gz 2024-03-19T06:24:44.851 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31621.log 2024-03-19T06:24:44.851 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34914.log.gz 2024-03-19T06:24:44.852 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32080.log 2024-03-19T06:24:44.853 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34412.log.gz 2024-03-19T06:24:44.853 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35480.log 2024-03-19T06:24:44.854 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31621.log.gz 2024-03-19T06:24:44.855 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37334.log 2024-03-19T06:24:44.855 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32080.log.gz 2024-03-19T06:24:44.856 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33040.log 2024-03-19T06:24:44.856 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37334.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35480.log.gz 2024-03-19T06:24:44.857 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33066.log 2024-03-19T06:24:44.857 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37334.log.gz 2024-03-19T06:24:44.858 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31569.log 2024-03-19T06:24:44.858 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33040.log.gz 2024-03-19T06:24:44.860 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33455.log 2024-03-19T06:24:44.860 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37277.log 2024-03-19T06:24:44.860 INFO:teuthology.orchestra.run.smithi032.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.33066.log.gz 2024-03-19T06:24:44.860 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31569.log.gz 2024-03-19T06:24:44.861 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33853.log 2024-03-19T06:24:44.861 INFO:teuthology.orchestra.run.smithi032.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33455.log.gz 2024-03-19T06:24:44.862 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40952.log 2024-03-19T06:24:44.863 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37277.log.gz 2024-03-19T06:24:44.863 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41030.log 2024-03-19T06:24:44.863 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33853.log.gz 2024-03-19T06:24:44.864 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40438.log 2024-03-19T06:24:44.865 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40952.log.gz 2024-03-19T06:24:44.865 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39494.log 2024-03-19T06:24:44.865 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41030.log.gz 2024-03-19T06:24:44.866 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33723.log 2024-03-19T06:24:44.866 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40438.log.gz 2024-03-19T06:24:44.867 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40874.log 2024-03-19T06:24:44.867 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39494.log.gz 2024-03-19T06:24:44.869 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38340.log 2024-03-19T06:24:44.869 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33723.log.gz 2024-03-19T06:24:44.870 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36478.log 2024-03-19T06:24:44.870 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40874.log.gz 2024-03-19T06:24:44.870 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32495.log 2024-03-19T06:24:44.871 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38340.log.gz 2024-03-19T06:24:44.871 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31764.log 2024-03-19T06:24:44.872 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36478.log.gz 2024-03-19T06:24:44.872 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34009.log 2024-03-19T06:24:44.873 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32495.log.gz 2024-03-19T06:24:44.874 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40117.log 2024-03-19T06:24:44.874 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31764.log.gz 2024-03-19T06:24:44.875 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37598.log 2024-03-19T06:24:44.875 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34009.log.gz 2024-03-19T06:24:44.876 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34831.log 2024-03-19T06:24:44.876 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40117.log.gz 2024-03-19T06:24:44.877 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31948.log 2024-03-19T06:24:44.877 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37598.log.gz 2024-03-19T06:24:44.878 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33593.log 2024-03-19T06:24:44.878 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34831.log.gz 2024-03-19T06:24:44.879 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35868.log 2024-03-19T06:24:44.879 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31948.log.gz 2024-03-19T06:24:44.880 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34727.log 2024-03-19T06:24:44.880 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33593.log.gz 2024-03-19T06:24:44.881 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log 2024-03-19T06:24:44.881 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35868.log.gz 2024-03-19T06:24:44.882 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36718.log 2024-03-19T06:24:44.882 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34727.log.gz 2024-03-19T06:24:44.883 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38969.log 2024-03-19T06:24:44.884 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40143.log.gz 2024-03-19T06:24:44.884 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39075.log 2024-03-19T06:24:44.885 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36718.log.gz 2024-03-19T06:24:44.885 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40065.log 2024-03-19T06:24:44.886 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38969.log.gz 2024-03-19T06:24:44.886 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32281.log 2024-03-19T06:24:44.887 INFO:teuthology.orchestra.run.smithi032.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.39075.log.gz 2024-03-19T06:24:44.888 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32806.log 2024-03-19T06:24:44.888 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40065.log.gz 2024-03-19T06:24:44.890 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31514.log 2024-03-19T06:24:44.890 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32281.log.gz 2024-03-19T06:24:44.890 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34779.log 2024-03-19T06:24:44.890 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32806.log.gz 2024-03-19T06:24:44.891 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39363.log 2024-03-19T06:24:44.891 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31514.log.gz 2024-03-19T06:24:44.892 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41236.log 2024-03-19T06:24:44.892 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34779.log.gz 2024-03-19T06:24:44.893 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39363.log: gzip -5 88.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.39363.log.gz /var/log/ceph/ceph-client.admin.38601.log 2024-03-19T06:24:44.893 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-03-19T06:24:44.894 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34753.log 2024-03-19T06:24:44.895 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41236.log.gz 2024-03-19T06:24:44.895 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31974.log 2024-03-19T06:24:44.896 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38601.log.gz 2024-03-19T06:24:44.896 INFO:teuthology.orchestra.run.smithi032.stderr: 91.1%/var/log/ceph/ceph-client.admin.34753.log: -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-19T06:24:44.897 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32676.log 2024-03-19T06:24:44.897 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34753.log.gz 2024-03-19T06:24:44.897 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36530.log 2024-03-19T06:24:44.898 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31974.log.gz 2024-03-19T06:24:44.898 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37677.log 2024-03-19T06:24:44.899 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32676.log.gz 2024-03-19T06:24:44.899 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33697.log 2024-03-19T06:24:44.900 INFO:teuthology.orchestra.run.smithi032.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36530.log.gz 2024-03-19T06:24:44.900 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32832.log 2024-03-19T06:24:44.901 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37677.log.gz 2024-03-19T06:24:44.902 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34277.log 2024-03-19T06:24:44.902 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33697.log.gz 2024-03-19T06:24:44.903 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40412.log 2024-03-19T06:24:44.903 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32832.log.gz 2024-03-19T06:24:44.904 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39468.log 2024-03-19T06:24:44.904 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34277.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34277.log.gz 2024-03-19T06:24:44.905 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32754.log 2024-03-19T06:24:44.905 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40412.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40412.log.gz 2024-03-19T06:24:44.906 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35658.log 2024-03-19T06:24:44.906 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39468.log.gz 2024-03-19T06:24:44.907 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38009.log 2024-03-19T06:24:44.907 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32754.log.gz 2024-03-19T06:24:44.908 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38891.log 2024-03-19T06:24:44.908 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35658.log: /var/log/ceph/ceph-client.admin.38009.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35658.log.gz 2024-03-19T06:24:44.909 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38009.log.gz 2024-03-19T06:24:44.909 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39390.log 2024-03-19T06:24:44.910 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22491.log 2024-03-19T06:24:44.911 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38891.log: /var/log/ceph/ceph-client.admin.39390.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38891.log.gz 2024-03-19T06:24:44.911 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35279.log 2024-03-19T06:24:44.911 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39390.log.gz 2024-03-19T06:24:44.914 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.tmp-client.admin.22491.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22491.log.gz 2024-03-19T06:24:44.914 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34035.log 2024-03-19T06:24:44.914 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35736.log 2024-03-19T06:24:44.914 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35279.log.gz 2024-03-19T06:24:44.915 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38627.log 2024-03-19T06:24:44.915 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34035.log.gz 2024-03-19T06:24:44.915 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32065.log 2024-03-19T06:24:44.916 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2%/var/log/ceph/ceph-client.admin.38627.log: -- replaced with /var/log/ceph/ceph-client.admin.35736.log.gz 2024-03-19T06:24:44.916 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34146.log 2024-03-19T06:24:44.917 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38627.log.gz 2024-03-19T06:24:44.918 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32702.log 2024-03-19T06:24:44.918 INFO:teuthology.orchestra.run.smithi032.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32065.log.gz 2024-03-19T06:24:44.918 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35710.log 2024-03-19T06:24:44.919 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34146.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34146.log.gz 2024-03-19T06:24:44.920 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33749.log 2024-03-19T06:24:44.920 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32702.log.gz 2024-03-19T06:24:44.921 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34674.log 2024-03-19T06:24:44.921 INFO:teuthology.orchestra.run.smithi032.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35710.log.gz 2024-03-19T06:24:44.921 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37625.log 2024-03-19T06:24:44.922 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33749.log.gz 2024-03-19T06:24:44.923 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39259.log 2024-03-19T06:24:44.923 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34674.log.gz 2024-03-19T06:24:44.924 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37625.log: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-19T06:24:44.924 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36561.log 2024-03-19T06:24:44.924 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37625.log.gz 2024-03-19T06:24:44.925 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35201.log 2024-03-19T06:24:44.925 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39259.log.gz 2024-03-19T06:24:44.926 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36561.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36561.log.gz 2024-03-19T06:24:44.927 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35201.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35201.log.gz 2024-03-19T06:24:44.942 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-19T06:24:44.974 INFO:teuthology.orchestra.run.smithi032.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-19T06:24:44.976 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-03-19T06:24:44.976 INFO:teuthology.orchestra.run.smithi032.stderr:real 0m0.449s 2024-03-19T06:24:44.976 INFO:teuthology.orchestra.run.smithi032.stderr:user 0m1.570s 2024-03-19T06:24:44.976 INFO:teuthology.orchestra.run.smithi032.stderr:sys 0m0.669s 2024-03-19T06:24:44.977 INFO:tasks.ceph:Archiving logs... 2024-03-19T06:24:44.977 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674/remote/smithi032/log 2024-03-19T06:24:44.978 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-19T06:24:45.447 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674/remote/smithi171/log 2024-03-19T06:24:45.448 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-19T06:24:45.597 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-19T06:24:45.623 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-19T06:24:45.623 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-19T06:24:45.626 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-19T06:24:45.697 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-19T06:24:45.706 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-19T06:24:45.706 DEBUG:teuthology.orchestra.run.smithi032:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-19T06:24:45.709 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-19T06:24:45.720 INFO:teuthology.orchestra.run.smithi032.stdout: remote refid st t when poll reach delay offset jitter 2024-03-19T06:24:45.721 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================== 2024-03-19T06:24:45.721 INFO:teuthology.orchestra.run.smithi032.stdout:*hv01.front.sepi 44.4.53.2 2 u 3 64 377 0.096 -2.219 1.807 2024-03-19T06:24:45.721 INFO:teuthology.orchestra.run.smithi032.stdout:+hv02.front.sepi 63.231.80.2 3 u 63 64 177 0.089 +2.185 0.841 2024-03-19T06:24:45.721 INFO:teuthology.orchestra.run.smithi032.stdout:+hv03.front.sepi 74.6.168.72 3 u 9 64 377 0.084 -1.470 0.988 2024-03-19T06:24:45.721 INFO:teuthology.orchestra.run.smithi032.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-19T06:24:45.724 INFO:teuthology.orchestra.run.smithi171.stdout: remote refid st t when poll reach delay offset jitter 2024-03-19T06:24:45.724 INFO:teuthology.orchestra.run.smithi171.stdout:============================================================================== 2024-03-19T06:24:45.724 INFO:teuthology.orchestra.run.smithi171.stdout:*hv01.front.sepi 44.4.53.2 2 u 7 64 377 0.084 -2.784 1.664 2024-03-19T06:24:45.724 INFO:teuthology.orchestra.run.smithi171.stdout:+hv02.front.sepi 63.231.80.2 3 u 11 64 377 0.075 +0.132 1.666 2024-03-19T06:24:45.724 INFO:teuthology.orchestra.run.smithi171.stdout: hv03.front.sepi 74.6.168.72 3 u 7 64 377 0.091 -4.582 2.229 2024-03-19T06:24:45.724 INFO:teuthology.orchestra.run.smithi171.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-19T06:24:45.725 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-19T06:24:45.734 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-19T06:24:45.735 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-19T06:24:45.744 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-19T06:24:45.752 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-19T06:24:45.762 INFO:teuthology.task.internal:Duration was 938.417060 seconds 2024-03-19T06:24:45.762 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-19T06:24:45.777 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-19T06:24:45.777 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-19T06:24:45.780 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-19T06:24:45.865 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-19T06:24:45.865 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi032.front.sepia.ceph.com 2024-03-19T06:24:45.865 DEBUG:teuthology.orchestra.run.smithi032:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-19T06:24:45.885 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com 2024-03-19T06:24:45.886 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-19T06:24:45.906 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-19T06:24:45.906 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-19T06:24:45.935 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-19T06:24:45.989 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-19T06:24:45.989 DEBUG:teuthology.orchestra.run.smithi032:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-19T06:24:46.015 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-19T06:24:46.104 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-19T06:24:46.114 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-19T06:24:46.115 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-19T06:24:46.135 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-19T06:24:46.155 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-19T06:24:46.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-19T06:24:46.178 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-19T06:24:46.193 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = core 2024-03-19T06:24:46.217 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core 2024-03-19T06:24:46.235 DEBUG:teuthology.orchestra.run.smithi032:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-19T06:24:46.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:24:46.263 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-19T06:24:46.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:24:46.284 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-19T06:24:46.294 INFO:teuthology.task.internal:Transferring archived files... 2024-03-19T06:24:46.295 DEBUG:teuthology.misc:Transferring archived files from smithi032:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674/remote/smithi032 2024-03-19T06:24:46.295 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-19T06:24:46.330 DEBUG:teuthology.misc:Transferring archived files from smithi171:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674/remote/smithi171 2024-03-19T06:24:46.330 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-19T06:24:46.356 INFO:teuthology.task.internal:Removing archive directory... 2024-03-19T06:24:46.356 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-19T06:24:46.374 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-19T06:24:46.401 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-19T06:24:46.412 INFO:teuthology.task.internal:Not uploading archives. 2024-03-19T06:24:46.412 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-19T06:24:46.422 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-19T06:24:46.423 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-19T06:24:46.426 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-19T06:24:46.432 INFO:teuthology.orchestra.run.smithi032.stdout: 658113 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 19 06:24 /home/ubuntu/cephtest 2024-03-19T06:24:46.448 INFO:teuthology.orchestra.run.smithi171.stdout: 655428 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 19 06:24 /home/ubuntu/cephtest 2024-03-19T06:24:46.450 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-19T06:24:46.461 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-19T06:24:46.483 INFO:teuthology.nuke:Checking targets against current locks 2024-03-19T06:24:46.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-03-19T06:24:46.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-03-19T06:24:46.509 DEBUG:teuthology.nuke:shortname: smithi032 2024-03-19T06:24:46.510 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-19T06:24:46.533 DEBUG:teuthology.nuke:shortname: smithi171 2024-03-19T06:24:46.533 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-19T06:24:46.537 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-19 05:58:52.323850', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHK9D/Y/H040981xY6SRILI9PlrGvBdT45cqKN9ms4MWqoJxDItCeKGfnYVMK2YLr60XQgtwZy69sOwvE0FBczs='} 2024-03-19T06:24:46.562 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610674', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-19 05:58:52.325181', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGAmXfjV+X+ZH5sgNguN6cRoHoYI4pszUisZKBbkrDTITM2/5G8zzZ2HpMijH9SO7rvKJL3a8Y2mZDaJjGxxkLM='} 2024-03-19T06:24:46.586 INFO:teuthology.orchestra.console.smithi032:Power off 2024-03-19T06:24:46.586 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-19T06:24:46.614 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2024-03-19T06:24:46.614 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:24:46.629 INFO:teuthology.orchestra.console.smithi171:Power off 2024-03-19T06:24:46.630 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-19T06:24:46.642 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-03-19T06:24:46.651 DEBUG:teuthology.orchestra.console.smithi171:power off output: Chassis Power Control: Down/Off 2024-03-19T06:24:46.651 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:24:46.674 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-03-19T06:24:50.643 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:24:50.676 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:24:50.755 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-03-19T06:24:50.786 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-03-19T06:24:54.759 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:24:54.789 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:24:54.869 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2024-03-19T06:24:54.900 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-03-19T06:24:54.971 INFO:teuthology.orchestra.console.smithi032:Power off completed 2024-03-19T06:24:58.902 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:24:59.014 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off 2024-03-19T06:24:59.114 INFO:teuthology.orchestra.console.smithi171:Power off completed 2024-03-19T06:24:59.219 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/pool-perm} duration: 938.4170596599579 failure_reason: 'Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm)' flavor: default mon.a-kernel-sha1: 908b6b276e8f14e16032b32a9770077cd37b6bd4 mon.b-kernel-sha1: 908b6b276e8f14e16032b32a9770077cd37b6bd4 owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=6cc7f0d676414c6188f69461b86b1ce9 status: fail success: false 2024-03-19T06:24:59.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T06:24:59.311 INFO:teuthology.run:FAIL